Wan Infinite Talk and Animate combination (proof of concept)
https://reddit.com/link/1owivgn/video/r8fscghlh41g1/player
I thought, why not, this should work.
Workflow:
- Create song with SUNO using lyrics from original song by my band.
- Use vocals from SUNO in Wan Infinite Talk (example workflow from KiJai github) and some old SD1.5 headshot to generate face video.
- Search and collect different vids from insta/tiktok/of/whatever to use for pose video
- MODIFY THE KIJAI ANIMATE WORKFLOW EXAMPLE 2:
- Copy and Paste the entire Preprocessing group.
- In the original Preprocessing group mute/bypass everything except what is needed for the pose images output.
- In the copied Preprocessing group mute/bypass everything except what is needed for the face images output.
- On the WanVideo Animate Embeds unlink the bg_images and mask inputs (unless you want to replace character)
- Set the Get_face_images and Get_frame_count nodes (also add this to the final video combine node) to the face video outputs (with the _0 added to the name in the list)
- Execute:>!!<
- Put your Infinite Talk face video in the face preprocessing load video node
- Put your goon pose vid in the pose preprocessing load video node
- Select your favorite generated images or create new ones you want to animate and put them into the Reference Image load image node 1 by 1 and generate clips.
- Use skip_first_frames and load_frames_cap to control which parts of the lyrics and the pose video you want to generate. - Put together in your favorite video editor (like DaVinci Resolve, it's free)
Posted Nov 14, 2025, 1:11 AM UTC