

Originally did this song for my daughter and her friend and wanted to do a video for it in the style of typical dance music videos, but it got saucy pretty quickly so I changed some lyrics and renamed the characters and let it go where it wanted to go. Hope the workflow can be helpful to someone trying to figure this out for themselves.

  
Original Character Design: Midjourney then made realistic and created Character Sheets with Seedream 5. I normally use NanoBanana but this project has made me a Seedream fan. Nano Banana has a tendency to make cool looking Midjourney characters look boring and strips away a lot of the uniqueness that Midjourney imparts. Once I had a ton of outfits created in Midjourney I used Seedream to turn them into product shots on solid grey backgrounds. I could then add any of the outfits onto my characters on the existing product sheets easily with Seedream without it changing the features of the character like Nano Banana has a tendency to do.

  
World Plates: Created all of the settings in Midjourney. Occasionally made edits using Nano Banana or Seedream.

  
Video Gens: All Seedance 2.5 Reference 1080p. I could upload my character sheet, the world plate, and any props and reference them in the prompt. I tried to do longer generations where I wanted multiple shots to maintain consistency of character location within a room. Did the dancing/singing sections as long generations of 15-25 seconds while prompting multiple shots within.

  
Prompting: I would compose a long description consisting of a general description, then a shot by shot description with timecode references where I wanted certain things to happen. I edited in Davinci Resolve and would have my music loaded. I would then export the section of the song that coincided with the scene I was generating as a video clip with just a black background and use this to help develop the actual Seedance prompt. I used a website [Karadeo.com](http://Karadeo.com) that I would upload my audio to and it would give precise timing (sometimes needed minor editing) for the lyrics that I would also use to generate the prompt. After composing my description of all of the shots with timecode I would use either Claude or ChatGPT to create the actual prompt. I used a skill on both that I got from Joey (https://www.youtube.com/@noisygroup) called Cinema Director. I loaded this skill, pasted my "pre-prompt" description, uploaded the assets: character sheets, world plates, prop sheets, and the MP4 file that was my music clip for the scene with the black video. The LLM would spit out a super long prompt that I then used in Seedance with the same uploaded assets.

  
Dance Choreography: After trying several methods that failed I came across the method I used for this music video. ChatGPT couldn't analyze video clips but it would allow me to upload screen shots (per it's instructions), so I found video of dance moves I liked, mostly from the band KATSEYE, and I would upload 5-12 screenshots in sequence of the dance move I wanted to use. It basically functioned like an animated gif. ChatGPT was able to infer the missing frames and extract the movement for each dance move and was extremely detailed. With ChatGPT I built a library of about 20 dance moves (I should have done more) but I could just ask ChatGPT to insert DanceMove02 or DanceMove11 etc... I also included descriptions of camera moves I noticed in many dance videos like: Closeups with camera pans down the body, whip pans to the other dancer, etc... and basically to alway keep the camera moving in and out and up and down and to cut on my specified shots to the next dance move. I got lots of generations that worked out great on the first go, some I had to edit myself. I used this DanceMove library in conjunction with the Cinema Director skill to get my final prompt to feed Seedance.

  
Lip-Sync: I always provided the lyrics and the timecode in my pre-prompt and let the LLM integrate them into the prompt. I always specified to use the audio in the reference video as the driver behind the lip-sync but I think having the timing and the words helps keep things accurate.

  
Audio: Suno. Minor editing and Mastering in FL Studio. Title sequence audio in FL Studio.

  
UpScale: Upscaled to 4K 60 Frames per Second in the Topaz desktop app. (This would have been very expensive if done on Magnific or Higgsfield)

  
Conclusion: I would say I spent betwen $200-$300 creating this, not cheap, but it was a learning experiment for me as I couldn't find any good videos on Youtube explaining how to do dance choreography. I used a combination of MidJourney, Magnific, Higgsfield, and [RunComfy.com](http://RunComfy.com) to generate my images and video.

[Workflow] [Dance-Pop, LyKi - Own This Town] Choreographed Dance Experiment