Google AI on verge of writing fiction, producing movies… however people are nonetheless an element

Could AI quickly be writing fiction, producing long-form movies or composing music? Well, that’s what Google is attempting to grasp. With its new Wordcraft mission, Google’s chatbot LaMDA is now writing fiction based mostly on inputs from writers. LaMDA is Google’s conversational AI that run into controversy earlier this yr after an engineer claimed the AI was sentient. Google revealed at its AI occasion in New York that it had “teamed up with professional writers who used the Wordcraft editor to create a volume of short stories.” These tales at the moment are accessible on-line for the general public to learn.

“I believe we’re going to transform how people express themselves creatively. We engaged with professional authors and invited them to write experimental fiction using LaMDA as a tool. We also learned it’s not easy. LaMDA is also not doing all the work. It’s the writers who are doing the work,” Douglas Eck, Senior Research Director at Google Research, stated in a press briefing previous to the occasion.

So does Google see a future the place LaMDA might maybe substitute human writers? Not but, in accordance with Eck, who admitted that if one requested LaMDA to jot down the entire story, the outcomes are usually not nearly as good or attention-grabbing. “What’s interesting is to use the technology as a spice, an addition to what you’re trying to do. We’ll keep moving the bar on what these tools can do. But these tools will effectively remain a spice of sorts, they’ll remain as a way to enable us to tell stories differently,” he defined.

He additionally acknowledged that these fashions pose critical dangers, and the purpose is to not blur the excellence between what’s actual and what’s AI-based. “We also have to consider the conversation about generative models intersecting with intellectual property,” he famous.

Writing fiction is just not the one artistic avenue that Google is exploring with the assistance of its AI fashions. Google can be taking a look at how AI might be used to generate video and music.

On AI-based video technology, Google revealed two new fashions referred to as Imagen and Phenaki. While the Imagen Video makes use of diffusion to generate high-quality particular person pictures, which Google claims are extra appropriate for shorter movies, Phenaki makes use of a “sequence learning technique that generates a series of tokens over time,” to create long-form movies. Google stated that combining the 2 fashions will guarantee super-resolution on the body degree and coherence in time.

It additionally revealed movies created by the 2 fashions. When requested concerning the challenges of utilizing AI to create a video, Eck stated that whereas they’re seeing progress, it’s nonetheless a tricky job. “The difficulty is ensuring coherence between each frame. If you predict one frame from the previous frame, the model begins to lose coherence,” he defined. This was a elementary problem in video technology, which Google says it’s but to unravel totally.

Finally, AudioLM is a brand new framework for producing sensible speech and music based mostly on solely a brief audio pattern. The music is proscribed to piano for now. Google says this “is a pure audio model trained without any text or symbolic representation of music.”