Flooded with AI-generated images, some art communities ban them completely

September 12, 2022:

An assortment of robot images generated by Stable Diffusion
Enlarge / An assortment of robot portraits generated by Stable Diffusion as found on the Lexica search engine.

Confronted with an overwhelming amount of artificial-intelligence-generated artwork flooding in, some online art communities have taken dramatic steps to ban or curb its presence on their sites, including Newgrounds, Inkblot Art, and Fur Affinity, according to Andy Baio of Waxy.org.

Baio, who has been following AI art ethics closely on his blog, first noticed the bans and reported about them on Friday. So far, major art communities DeviantArt and ArtStation have not made any AI-related policy changes, but some vocal artists on social media have complained about how much AI art they regularly see on those platforms as well.

The arrival of widely available image synthesis models such as Midjourney and Stable Diffusion has provoked an intense online battle between artists who view AI-assisted artwork as a form of theft (more on that below) and artists who enthusiastically embrace the new creative tools.

Established artist communities are at a tough crossroads because they fear non-AI artwork getting drowned out by an unlimited supply of AI-generated art, and yet the tools have also become notably popular among some of their members.

In banning art created through image synthesis in its Art Portal, Newgrounds wrote, “We want to keep the focus on art made by people and not have the Art Portal flooded with computer-generated art.”

Fur Affinity cited concerns about the ethics of how image synthesis models learn from existing artwork, writing, “Our goal is to support artists and their content. We don’t believe it’s in our community’s best interests to allow AI generated content on the site.”

These are only the latest moves in a quickly evolving debate about how art communities (and art professionals) can adapt to software that can potentially produce unlimited works of beautiful art at a rate that no human working without the tools could match.

Part of a wider art ethics debate

An array of non-AI artworks used to train Stable Diffusion, assembled by Waxy.org.
Enlarge / An array of non-AI artworks used to train Stable Diffusion, assembled by Waxy.org.

The current wave of image synthesis tools allows users to type in a written description (called a “prompt”) and output a matching image, almost like magic. The results often need cherry-picking and dedication to get just right, but with a skillfully crafted prompt, the results can imitate the works of human artists with sometimes stunning detail.

The most successful prompts often reference existing artists and art websites by name but rarely alone. Mixing artists can create innovative new stylistic blends. For example, here is the prompt that created the robotic woman in the center of the image at the top of this article in Stable Diffusion:

Beautiful crying! female mechanical android!, half portrait, intricate detailed environment, photorealistic!, intricate, elegant, highly detailed, digital painting, artstation, concept art, smooth, sharp focus, illustration, art by artgerm and greg rutkowski and alphonse mucha (Seed 79409656)

The most popular image synthesis models use the latent diffusion technique to create novel artwork by analyzing billions of images without consent from artists or copyright holders. In the case of Stable Diffusion, those images come sourced directly from the Internet, courtesy of the LAION-5B database. (Images found on the Internet often come with descriptions attached, which is ideal for training AI models.)

Recently, Baio and AI researcher Simon Willison grabbed data for more than 12 million images in LAION-5B and created a search tool that lets users peek into a small but representative slice of the much larger set. (You can also search the LAION5B image set for artwork—or even your own name—in a demo hosted on Github.)

A search for Jeremy Lipking, a living fine art painter, brings up results in the LAION data set.
Enlarge / A search for Jeremy Lipking, a living fine art painter, brings up results in the LAION data set.

Ars Technica

A few weeks ago, some artists began discovering their artwork in the Stable Diffusion data set, and they weren’t happy about it. Charlie Warzel wrote a detailed report about these reactions for The Atlantic last week. With battle lines being drawn firmly in the sand and new AI creativity tools coming out steadily, this debate will likely continue for some time to come.

Source link