How are video elements extracted without background?
Hello.
So I've been watching videos such as The Glorious Octagon of Destiny, Kitchen Gun - 3 Shots Of Derek Bum and Muscular Wonders - Terry Crews' Greatest Hits with great amazement not only towards the musical feat which was achieved in these collaborations but also to the large editing effort which went into creating the visuals.
From what I understand (with my rather basic knowledge of video editing and 3D animation) these videos are most often a blend of 3D or 2D animation followed by tons of work in a program such as Adobe After effects.
My question regarding these, however, is much simpler (I hope). The videos all base on a/a few proceeding video(s) which provide some key visuals used throughout the entire project. For example, in the case of The Glorious Octagon of Destiny this video would be Sesame Street: Jack Black defines Octagon. Now the element which I would specifically like trying my hand at (and can't seem to figure out on my own) is how to extract the video elements without background from the original video(s).
Is it done by "cutting out" the person or object from the original video by hand: frame-by-frame or is there an AI that is able to automatically do the work, or is it done in an entirely different way?
While I am primarily looking for the way to do so, I am also wondering if anyone knows if this is possible with the things I have directly available which would be Sony Vegas Pro 14 for video editing and a few programs such as Magix Photo & Graphics designer for image-based editing (as well as free alternatives such as Gimp and Paint.net).
I'd like to thank you for reading through my question and prematurely thank anyone who can solve this mystery.
I wish you a good day.
Footnote: I tried looking through the wiki for a solution, however as it would seem just exactly the page for rotoscoping/cutting stuff out of a video seems to be missing: the wiki page.
Footnote 2: I hope I didn't butcher any technical terms in my submission.
Posted Apr 13, 2020, 1:24 AM UTC ยท edited
Basically, to cut people out of video, what you're looking for is called rotoscoping. That is where they mask out the object of person frame by frame. However, if the background is a relatively solid color - while the same color is not present on what you're cutting out - you can use a process called chroma key. That is what using a green screen is called (but you can easemtially do it with any color.
You would need a compositing software like After Effects to pull that off though.
Not OP but I have to thank you for this comment. This was something I was searching for a longer time. Anyways, I always ended up finding a mask and never thought about keyframes+mask. Rotoscoping is a good term to find some more tutorials - thanks for that kind stranger <3
No problem. I'm glad I could help. FYI, rotoscoping is the worst. Haha
Hello, thanks a lot for your response. I've looked further into rotoscoping and found a tutorial on how to do it with Sony Vegas.
For now, I've only done 1 frame https://imgur.com/Tk0MsCC, but I am really happy with the result for doing it for the first time (please forgive the masking mess, I accidentally created 3 masks instead of 1 and couldn't figure out of to connect them).
Thanks again for your advice!
Hey, that's pretty great for your first try.
Actually, using multiple masks is the best way to do it. So, instead of having to adjust all the points for the whole body throughout the duration of the clip, you would have 1 mask for the head, 1 for each arm, 1 for the body and so on.
Great job! Thanks for the silver, by the way. ๐