See how artificial intelligence writes a new scene for Greta Gerwig’s 2017 film Lady Bird.
Over the past few months, myself and my creative partner Jacob Vaus have been researching the interface between AI and human creativity. In a number of VideosWe focused on testing the AI’s ability to pick up existing works and continue with newly created material.
We have already created a new song from the musical Hamilton, an Eminem Diss track on Mark Zuckerberg, and even tried it baking cookies. More recently we’ve had AI write a short film and make a new one Dr. Seuss novel.
For our tests we use GPA-3 from OpenAI, an API that provides a universal “text-in-text-out” interface. That means you can enter any English text and the task will be created. For one of our more recent experiments, we entered “The following is a new scene from the film Lady Bird” into the web-based program and generated a script for us.
As aspiring filmmakers, we’ve adapted the script as closely as possible to the film it was modeled from. After finding our actors and a small crew, we worked on defining the look of the film. After the preparation, we recorded the new scene exactly according to the script before editing it, determining the sound design and the color.
Here are the results.
As people who also write our own original films, working with the AI software is fascinating. It’s amazing how well the program can capture a writer’s voice, the tone of a script, or the beginnings of narrative threads in a story. Some of our previous work exemplifies this in the form of original short films in which we wrote the first page of a script and let the software write the rest.
It’s also amazing to see how advanced the software is, having the ability to seemingly grasp everything about the movie from just the input of a single sentence and knowing how to write the output in script format. It nails the characters, their relationship with each other, how they speak, what they want and where the scenes are supposed to take place.
Granted, the AI does all of this in a way that’s easy to laugh about, but at the same time, with a little tweaking, it’s not too far removed from real-life scenes that might very well have landed on the cutting room floor.
Personally, we’re both big fans of Gerwig’s work, so it was a challenge to do something like that. We hope that other fans will enjoy it as well, both for the kind of nostalgic entertainment and the fascinating calculations of the film with artificial intelligence.
Let us know what you think in the comments!