The First Entirely AI-Generated Video Game Is Insanely Weird and Fun

November 14, 2024:

Minecraft remains remarkably popular a decade or so after it was first released, thanks to a unique mix of quirky gameplay and open world building possibilities.

A knock-off called Oasis, released last month, captures much of the original game’s flavor with a remarkable and weird twist. The entire game is generated not by a game engine and hand-coded rules, but by an AI model that dreams up each frame.

Oasis was built by an Israeli AI startup called Decart in collaboration with Etched, a company that designs custom silicon, to demonstrate the potential of hardware optimized to power transformer-based AI algorithms.

Oasis uses a transformer AI model, similar to the one that powers a large language model—only trained, apparently, on endless examples of people playing Minecraft, to dream up each new video frame in response to the previous one and to user input like clicks or mouse moves. Oasis is similar to a video-generating model like Sora except a user can control its output.

You can play Oasis online for free, and it is both fascinating and surreal to explore. Besides harboring bizarre artifacts, like misshapen livestock and stairs that go nowhere, the game has an amazing, Inception-like quality. Because each frame is generated based on what the AI model imagines should come after the frame it currently sees, the in-game world is never entirely stable, and will gladly shift and morph with a little nudging. If you stare too closely at a texture, for example, when you look up again, the block world in front of you may be completely different from the one you last saw.

It’s also possible to upload your own image for Oasis to work with. I tried adding a photo of my cat, Leona, and the game turned her into a beautiful blockish landscape (sadly not a feline character in the game, but hey …).

Oasis has become a viral hit with people exploring ways to get its AI engine to hallucinate new environments. Sometimes, it can even be tricked into teleporting you to a dark moonscape resembling The End of Minecraft. It’s telling that this generative AI project is not entirely original, but rather seems to be a bizarro knock-off of the world’s most popular game (it was trained on an open source Minecraft dataset from OpenAI).

“People are trying to teleport into different worlds and speed run,” says Robert Wachen, chief operating officer at Etched. “It’s one of the main reasons it went viral.”

The AI approach taken with Oasis is too inconsistent and uncontrollable to be useful for a conventional game, says Julian Togelius, a computer science professor at New York University. Generative AI has future potential for controlling in-game characters and perhaps generating scenes or worlds, he says, but it is still early. “It is very interesting and impressive technology, but at the moment it is an answer in search of a question,” Togelius says.

Frank Lantz, a game designer and director of the department for game design at New York University, says that Oasis seems to be caught in a kind of uncanny valley that prevents it from being genuinely fun to play. But he suggests that an enterprising young game designer might well figure out a way to turn that game into one people love. “This is so obviously cool and interesting,” he says.

Source link

tags

Abkhazia Afghanistan Africa Albania Algeria Andorra Angola Antigua and Barbuda Argentina Armenia Australia Austria Azerbaijan Bahamas Bahrain Bangladesh Barbados Belarus Belgium Belize Benin Bolivia Bosnia and Herzegovina Botswana Brazil Bulgaria Burkina Faso Burundi Cambodia Cameroon Canada Cape Verde Central African Republic Chad Chile China Colombia Comoros Costa Rica Croatia Cuba Curacao Cyprus Czech Republic Denmark Djibouti Dominica Dominican Republic East Timor Ecuador Egypt El Salvador Equatorial Guinea Eritrea Estonia Ethiopia Fiji Finland France French Polynesia Gabon Gambia Georgia Germany Ghana Greece Grenada Guam Guatemala Guinea Guyana Haiti Honduras Hong Kong Hungary Iceland India Indonesia Iran Iraq Ireland Israel Italy Jamaica Japan Jordan Kazakhstan Kenya Kiribati Kosovo Kuwait Kyrgyzstan Laos Latvia Lebanon Lesotho Liberia Libya Liechtenstein Lithuania Luxembourg Macau Madagascar Malawi Malaysia Maldives Mali Malta Mauritania Mauritius Mexico Moldova Monaco Mongolia Montenegro Morocco Mozambique Myanmar Namibia Nepal Netherlands New Zealand Nicaragua Niger Nigeria North Korea North Macedonia Northern Cyprus Norway Oman Pakistan Palestine Panama Papua New Guinea Paraguay Peru Philippines Poland Portugal Puerto Rico Qatar Republic of the Congo Romania Russia Rwanda Saint Lucia Samoa San Marino Saudi Arabia Senegal Serbia Sierra Leone Singapore Slovakia Slovenia Solomon Islands Somalia South Korea South Sudan Spain Sri Lanka Sudan Sweden Switzerland Syria Taiwan Tajikistan Tanzania Thailand Togo Tonga Trinidad and Tobago Tunisia Turkey Turkmenistan Uganda UK Ukraine United Arab Emirates Uruguay USA Uzbekistan Vatican City Venezuela Vietnam Western Sahara Yemen Zambia Zimbabwe