AI animation TESTS & SHORTS
The AI Lab
Jon Draper - AI animatION CONSULTANT/ANIMATOR/studio founder
A page of video tests and animated shorts utilising AI tools, sometimes mixed with traditional digital animation/compositing processes. These videos were created to try out AI creative tools and conduct workflow experiments.... and some are made just for arts sake... whilst a few lead on to future tutorials and AI animation course material.
Created: 27th October 2024
Disconnected - Act One Runway Test
A short stroy about the internet breaking.
A fun little narrative as I test out Runways new Act One lipsyncing tooll.
Plus some other video generations via Minimax.
Created: 23rd October 2024
Echoes of Samhain - 2D AI Gen Animation
A short story (poem) telling the origins of Halloween (Samhain).
Character images created with MidJourney. Brought to life with AI video gen tools. Voice restyled with Eleven Labs. Music created with AI tool Udio. Edited in Adobe Premiere with, so extra colour grading touches and added stock sound fx.
Created: 21st October 2024
Explorer - AI Video Gen - Minimax
A short cinematic sci-fi tale. As I explore generation approaches via Minimax. Mixing realistic characters and environments with dynamic motion generated via pure prompting accompanied by a source image.
Created: 16th September 2024
Edith & Fred - Runway Gen 3 Vid 2 Vid
In this video I used a mix of LivePortrait to animate the characters based on a filmed performance. Then used Runway ML's Gen 3 Vid to Vid capability to restyle it into a Knitted Wool style aesthetic.
Find out more about the actual course over at the hub.
Created: 28th August 2024
Margaret & James - AI Lipsync Course
Animation with two chracters being interviewed as part of a short emotive story. This is the final result from a new paid AI lipsyncing course.
This used a mix of AI image generation, filmed live performance, AI lipsyncing tools, video upscaling/enhancing and AI voiceover replacement processes.
Find out more about the actual course over at the hub.
Created: 20th August 2024
Echo - AI Short + Walking Test
Sad dystopian short, with a stop motion feel. Both R&D and a promo for an upcoming AI course on the sites new 'Hub'.
Mixture of AI tools. With some compositing in After Effects.
Interesting advancement with both the AI generated 3D robot composited with Runwal ML background. Plus the walking shot with the main character combined a 3D (AI created) rig to drive the motion on the character image. With lip-sync added afterwards.
Created: 15th August 2024
George & Doris - AI Lipsync Test
Heartwarming short story told with two characters.
I used midJourney to create the two character images. Then recorded myself on a webcam acting out each characters performance, then used that to drive thier motion via an AI lipsync tool called LivePortrait.
I then used the speed-to-speech tool at Eleven labs to change my voice to an AI voice to better match the characters.
The final shot was created using a still image brought to life with RunwayML.
Finally edited via Adobe Creative Suite and added a stock music track.
Created: 15th August 2024
Lost in the Snow - Face & 3D Workflow Test
Testing some lipsync and 3D text to animation tools. With Adobe After Effects compositing and eleven labs for audio change.
Created: 17th August 2024
Lost In The Jungle - Runway Gen3 Test
A fun exploration of Runway ML Gen 3's new image to video generation tool.
Images made via MidJourney.
Clips animated via RunwayML Gen 3, with text prompts for direction.
Elevenlabs used to for opening words.
Music generated using AI music tool, Suno.
Horror Homage - Runway Gen2 Test
Trying out Pika and Runway ML Gen 2's (now surpassed) image to video generation tool.
Images made via MidJourney and Photoshop. With lots of reference images generated and repurposed. Clips animated via RunwayML Gen 2, with text prompts, camera controls and motion brush used for direction.
Elevenlabs used to for dialogue. Chat GPT helped with some (not all) the script writing.
Music generated using AI music tool, Suno.
Created: 1st December 2023
AI Christmas Short - Runway Gen2
Playing with Runway ML Gen 2 (now surpassed) image to video generation tool.
LOTS of Images made via MidJourney and Photoshop.
Clips animated via RunwayML, with text prompts, motion brush and camera controls for direction.
Edited in Premiere.
Stock music from Artlist.
Created: 10th December 2023
Astronaut Bay - Runway Gen2
Playing with Runway ML Gen 2 (now surpassed) image to video generation tool.
LOTS of Images made via MidJourney and Photoshop.
Clips animated via RunwayML, with text prompts, motion brush and camera controls for direction. Lip sync added via Sync Labs v.1
Edited in Premiere.
AI music generated using Suno.
Created: 14th Janaury 2024
Zombie Anime - DomoAI
Using clips from an old zombie short, filmed with my son (for fun).
Then using DomoAI to do an animae style transfer on the clips.