r/comfyui•
HocusP2

Wan Infinite Talk and Animate combination (proof of concept)

Tutorial

https://reddit.com/link/1owivgn/video/r8fscghlh41g1/player

I thought, why not, this should work.

Workflow:

  1. Create song with SUNO using lyrics from original song by my band.
  2. Use vocals from SUNO in Wan Infinite Talk (example workflow from KiJai github) and some old SD1.5 headshot to generate face video.
  3. Search and collect different vids from insta/tiktok/of/whatever to use for pose video
  4. MODIFY THE KIJAI ANIMATE WORKFLOW EXAMPLE 2:

- Copy and Paste the entire Preprocessing group.
- In the original Preprocessing group mute/bypass everything except what is needed for the pose images output.
- In the copied Preprocessing group mute/bypass everything except what is needed for the face images output.
- On the WanVideo Animate Embeds unlink the bg_images and mask inputs (unless you want to replace character)
- Set the Get_face_images and Get_frame_count nodes (also add this to the final video combine node) to the face video outputs (with the _0 added to the name in the list)

  1. Execute:>!​!<
    - Put your Infinite Talk face video in the face preprocessing load video node
    - Put your goon pose vid in the pose preprocessing load video node
    - Select your favorite generated images or create new ones you want to animate and put them into the Reference Image load image node 1 by 1 and generate clips.
    - Use skip_first_frames and load_frames_cap to control which parts of the lyrics and the pose video you want to generate.
  2. Put together in your favorite video editor (like DaVinci Resolve, it's free)

Posted Nov 14, 2025, 1:11 AM UTC

10

Comments aren't archived yet

Comments for this period haven't been loaded into the archive yet.