DeepMind, the Alphabet Inc-owned artificial intelligence (AI) company best known for creating software capable of beating the world’s best go players, has targeted StarCraft II as its next big research milestone, but so far, space is proving a difficult frontier for the company’s algorithms.
DeepMind’s algorithms, including those that performed with superhuman skill across a host of classic Atari titles, “cannot win a single game against the easiest built-in AI” in StarCraft II, let alone challenge skilled humans, the company said in a blog post on Wednesday.
The built-in agents, which are created by StarCraft publisher Activision Blizzard Inc, use hard-coded rules to determine their gameplay rather than the kinds of advanced machine learning techniques in which DeepMind specializes.
Photo: EPA
The company said new breakthroughs in machine learning would be required for its software agents to master the game.
The post did not reveal how close DeepMind might be to such breakthroughs.
The algorithm that mastered the Atari games was unveiled in June last year. Since then, DeepMind has published a number of research papers that hint it might be closing in on creating software capable of many of the tasks — such as prioritizing goals, long-term planning and memory — that any system would need to play StarCraft II successfully.
The company said that its algorithms performed well at learning some basic steps, such as moving around the game environment and selecting units, that would be critical to mastering the game.
StarCraft is considered an important target for machine-learning researchers because, unlike go, in which both players can see the entire board and take turns moving pieces, players in StarCraft cannot see what is happening in the entire game environment at one time and both players move their units simultaneously.
The game also requires players to carry out sub-tasks, such as building structures and mining resources, while also conducting reconnaissance, mounting attacks and defending territory.
To succeed, a player needs to have a good memory, prioritize among tasks and plan under conditions of uncertainty.
Because of these factors, StarCraft II comes much closer to approximating many real-world situations than games such as chess, go or even poker.
StarCraft II is also used in e-sports competitions, so there are highly skilled human opponents with which an AI can match wits.
To help computer scientists use StarCraft II as a testbed for AI, DeepMind has partnered with Blizzard to create an interface that allows outside software to access and play the game.
The two companies this week unveiled the interface, along with a set of tools to help other computer scientists train AI agents to play the game, at a machine learning conference in Australia.
Among the tools Blizzard is making public are a dataset of anonymized game replays — recordings of humans playing the game — that computer scientist would be able to use to help train their systems.
“One technique that we know allows our agents to learn stronger policies is imitation learning,” DeepMind said in its blog post. “This kind of training will soon be far easier thanks to Blizzard, which has committed to ongoing releases of hundreds of thousands of anonymized replays.”
DeepMind also said it was releasing a series of “mini-game” environments that would help researchers train their AI agents on basic components of the game.
It follows efforts by other companies, such as Facebook Inc and Microsoft Corp, to open game environments, including the original StarCraft and Minecraft, to the entire AI research community.
Among the rows of vibrators, rubber torsos and leather harnesses at a Chinese sex toys exhibition in Shanghai this weekend, the beginnings of an artificial intelligence (AI)-driven shift in the industry quietly pulsed. China manufactures about 70 percent of the world’s sex toys, most of it the “hardware” on display at the fair — whether that be technicolor tentacled dildos or hyper-realistic personalized silicone dolls. Yet smart toys have been rising in popularity for some time. Many major European and US brands already offer tech-enhanced products that can enable long-distance love, monitor well-being and even bring people one step closer to
Malaysia’s leader yesterday announced plans to build a massive semiconductor design park, aiming to boost the Southeast Asian nation’s role in the global chip industry. A prominent player in the semiconductor industry for decades, Malaysia accounts for an estimated 13 percent of global back-end manufacturing, according to German tech giant Bosch. Now it wants to go beyond production and emerge as a chip design powerhouse too, Malaysian Prime Minister Anwar Ibrahim said. “I am pleased to announce the largest IC (integrated circuit) Design Park in Southeast Asia, that will house world-class anchor tenants and collaborate with global companies such as Arm [Holdings PLC],”
Sales in the retail, and food and beverage sectors last month continued to rise, increasing 0.7 percent and 13.6 percent respectively from a year earlier, setting record highs for the month of March, the Ministry of Economic Affairs said yesterday. Sales in the wholesale sector also grew last month by 4.6 annually, mainly due to the business opportunities for emerging applications related to artificial intelligence (AI) and high-performance computing technologies, the ministry said in a report. The ministry forecast that retail, and food and beverage sales this month would retain their growth momentum as the former would benefit from Tomb Sweeping Day
Thousands of parents in Singapore are furious after a Cordlife Group Ltd (康盛人生集團), a major operator of cord blood banks in Asia, irreparably damaged their children’s samples through improper handling, with some now pursuing legal action. The ongoing case, one of the worst to hit the largely untested industry, has renewed concerns over companies marketing themselves to anxious parents with mostly unproven assurances. This has implications across the region, given Cordlife’s operations in Hong Kong, Macau, Indonesia, the Philippines and India. The parents paid for years to have their infants’ cord blood stored, with the understanding that the stem cells they contained