Built an AI pipeline to convert scripts into videos using my cloned voice, looking for feedback and tips!

Hi everyone!

I am currently building a fully automated system that turns a plain text script into a final branded video, complete with voiceover using my cloned voice (via ElevenLabs). No manual editing required.

Here is what I have set up so far:

Workflow Overview:

1. Input: Google Sheet with text scripts
2. TTS: ElevenLabs turns the script into audio + word-level timestamps
3. Video: RunwayML (Gen-3 Turbo) generates short clips from scene prompts
4. Auto-sync: Each video scene matches voice timing
5. Branding: Logo, colors, lower-thirds added via CloudConvert or MoviePy
6. Output: 1080p MP4 + subtitles
7. Auto-upload: Video goes straight to YouTube or Google Drive

Built using: • Make.com for orchestration • ElevenLabs API • RunwayML API • CloudConvert for video merge • Google Sheets + YouTube API

What I am looking for: • Better ways to improve scene detection from narration • Music underlay sync tips • Has anyone here integrated HeyGen for lip-sync or avatar layers? • Any alternate tools worth trying (esp. open-source or cheaper models)?

This is mainly for educational + branding content but the pipeline could be useful for creators, trainers, or even indie filmmakers.

Happy to share more details if anyone’s curious or wants to replicate something similar!