THE HUB:

AI Lipsync & Facial Animation Course


Share:

$120 • Buy The Course 

Enrol in the course today

*Includes 14-Day Money Back Guarantee

*Course length around 30 minutes


AI Lipsync Course:


This course guides you through animating a still image with facial expressions and lip-syncing. You'll also learn to add lip-sync to existing animations or AI-generated clips.



AI Animation Course Lipsync Clip

Design Characters

Using MidJourney


Process.
• Character Image Requirements
• Intro to MidJourney
• Edit Generations
• Upscale Images





Image

Introduction To Lipsync Tools

Explore the range of options


Process:
• Introduce the current AI lipsync tools available and highlight their pros & cons.





How to install LivePortrait

Install Live Portrait

Or use via a cloud service


Process:
• Show options for installing locally on Mac & PC
• Cloud-based option provided





Video Performance Recording

Record Performance

+Tips for best results


Process:
• Record yourself or an actor to drive the facial animation
• Including tips on starting pose and (basic) acting skills





Basic video editing skills with Adobe Premiere

Basic Editing Skills

Using Adobe Premiere


Process:
• Edit generated clips & recorded footage of performance






AI Audio Swap

AI Voice Swap

Using Eleven Labs


Process:
• Replace recorded audio with that of an AI voice





AI Video Upscaling and Enhancement

AI Enhance/Upscale

Using 2 Tools


Process:
• Enhance/Stylise Output
• Upscale/Change FPS of Output 





Add lipsync to animation with AI

Apply Lip Sync To Existing Animation

Bonus Content


Process:
• Apply Lip sync to existing animation, filmed footage or AI generated clips





What do we create?

Final output


The core of the course takes you through bringing two characters to life to tell a short story. A simple way to show the process and give a fun result to take away at the end of the course.





Skill Level:


The course is accessible for all, though familiarity with video editing and compositing techniques (i.e. After Effects) would be beneficial to take the skills learnt and use them in wider productions.


Limitations:

  • The output is an mp4 video file, there is no 3D model.
  • Works best with human characters that are realistic or not too stylised.
  • Animals (*Some animals work i.e. cats/dogs. (PC/Linux only at the moment
  • (**Animals are not currently supported for Mac Users)
  • Only works for 'mostly' front-on shots (i.e. not side-on views)
  • The character can be on a green background to aid in compositing as part of a wider workflow.

 

Tools Used:


Paid Tools:
Midjourney • Adobe Premiere • Eleven Labs
+Optional AI powered tools to enhance/upscale output

Free Tools:
Live Portrait can be run locally for free. 
*An alternative free image gen tool could be used for characters i.e. Flux.1. 
*You could edit using DaVinci Resolve for free.

**No 3D software is required.


Image

Your Instructor

Jon Draper


Hey! I'm Jon Draper, an animator and AI studio consultant with a passion for bringing characters to life and telling stories. My journey kicked off in the UK, where I studied illustration and animation. Where my 3D degree film snagged a Royal Television award - which was nice!

Over the past 20+ years, I've been on a wild ride through the world of animation. I've dabbled in everything from 2D to 3D, film, mastering After Effects, VFX, and video editing along the way. In 2013, I took the plunge, moved to the coast and started Stormy Studio. We've had a blast working with global companies and picking up some shiny awards too!

Having tinkered with coding projects over the years, in 2022 I took a keen interest in AI, I eventually launched aianimation.com, a hub for creatives that's grown to over 4,500 users. I also run a YouTube channel where I geek out about AI animation and share tools and techniques.

From traditional hand-drawn animation to cutting-edge AI, I love pushing the boundaries of what's possible in this field. It's been an incredible journey, and I'm excited to see where this blend of creativity and technology takes us next!





$120 • Buy The Course 

Enrol in the course today


*Includes 14-Day Money Back Guarantee

*Email hello@aianimation.com for support and queries.

Share:


Signup For AI Animation Course News & Offers ⚡️