How this guy is making this type of videos?

codingMinds

Regular Member
Joined
Apr 14, 2019
Messages
282
Reaction score
55
Hello, this channel is gaining popularity day by day and there is no other channel like this. The major difference is this guy animates the whole body, this is not like using some normal ai character. Anyone know how he is doing this?
Youtube channel:- https://www.youtube.com/@VirtualSypac/shorts
 
Adobe products include real-time voice matching and character movement that allow you to do this. Once you explore adobe, doing this is a piece of cake.
 
Adobe products include real-time voice matching and character movement that allow you to do this. Once you explore adobe, doing this is a piece of cake.
Can I get the same result with adobe products? Is he doing it real-time or first recording the video and then converting it?
 
WOW, Amazing!! How is he doing it?
Yeah, he is smashing the views and subscribers. The content is not unique, the only thing unique he changed the person with an avatar. I have lots of ideas but I am not able to crack how he is creating such avatars with hand motion.
 
I think He is using Unreal Engine's Live Link Face Motion Capture technique to generate his 3D avatar !

Here something like this >
But how he is managing to move hands and fingers?
 
It's not an AI generated video. (At least the motion and voice are not AI generated) - the hand you're seeing are his real hands.

He is actually recording the video himself in front of a green screen, then using a technique similar to those face swapping videos to superimpose an avatar on his face.

The rest is just creative editing.

He may be an advanced editor using something like After Effects.

But there are apps like Persona and Prequel that can turn any video into a cartoon-ish style.

This is a new form of faceless, I guess.
 
It's not an AI generated video. (At least the motion and voice are not AI generated) - the hand you're seeing are his real hands.

He is actually recording the video himself in front of a green screen, then using a technique similar to those face swapping videos to superimpose an avatar on his face.

The rest is just creative editing.

He may be an advanced editor using something like After Effects.

But there are apps like Persona and Prequel that can turn any video into a cartoon-ish style.

This is a new form of faceless, I guess.
Or maybe he is using a mocap suit to track motion. Whatever he is doing but he gained lots of subs in little time.
 
Or maybe he is using a mocap suit to track motion. Whatever he is doing but he gained lots of subs in little time.

I doubt he's doing that. Because he doesn't have any major motions except for his facial expressions (which won't require a suit) and his hands.

Most tools these days are advanced enough these days to detect basic motion capture.

You can try recording yourself in front of a blank wall and then running it through Prequel or Persona.

You can also use your image to get midjourney to give you an avatar and then superimpose that avatar on your footage.

He's recording and basically animifying it. Look at his first video and you'll understand what I mean. Overtime he has improved his editing skills and his quality has improved by a lot.
 
I'm sure there must be some other tool as well to do it more easily.. following this thread.
 
I checked tool like Persona, adobe animator but their results are not nearly the shorts he is posting. There must be some other tool he is using. Please guys help in finding his secret recipe.
 
I think He is using Unreal Engine's Live Link Face Motion Capture technique to generate his 3D avatar !

Here something like this >
Defenetely, I also found you can combine it with deepmotion that website they use blender, unreal engine and unity and more maybe there is an asset that can be purchase on the unreal engine instead of creating one from scratch I'll share the website so you can cehck it out.
Hello, this channel is gaining popularity day by day and there is no other channel like this. The major difference is this guy animates the whole body, this is not like using some normal ai character. Anyone know how he is doing this?
Youtube channel:- https://www.youtube.com/@VirtualSypac/shorts
You can check this website, doesn,t look the same but maybe as TDR says they combine it with unreal engine or any other software.
https://www.deepmotion.com/
 
Insane tactics, guys!
I've seen there are text to voice local llm which could automate this a lot more!
not even a need for a green screen!
 
Defenetely, I also found you can combine it with deepmotion that website they use blender, unreal engine and unity and more maybe there is an asset that can be purchase on the unreal engine instead of creating one from scratch I'll share the website so you can cehck it out.

You can check this website, doesn,t look the same but maybe as TDR says they combine it with unreal engine or any other software.
https://www.deepmotion.com/
Thanks. I have checked this but this is not doing what I'm looking for. I can understand he is unreal engine live link but again the question is ue live link supports only face animations but in some videos this guys is using his full body motion.
 
You can do it by Adobe. Adobe's video editing software is a powerful tool that helps to create professional high-quality videos. It's a good tool even for beginners, but once you explore Adobe you can play with It like a pro.
 
I came back to this recently, and was surprised just how limited although very user friendly the adobe suite is especially character animator, if you need a simple toon face from webcam movement.

But to go beyond the basics that adobe has for animation you really need to use something like industry standard Cartoon Animator. You can get a 30 day trial.
 
I came back to this recently, and was surprised just how limited although very user friendly the adobe suite is especially character animator, if you need a simple toon face from webcam movement.

But to go beyond the basics that adobe has for animation you really need to use something like industry standard Cartoon Animator. You can get a 30 day trial.
Lol your joking right, most of adobe products have been consolidated under their brand:

Substance painter was purchased and it's probably the only product that's not layers, if rather node ui, rather layers something blender and Houdini do well.

The only product adobe has with a graph UI node editor is substance designer.

Overall the product I like of adobe would be substance painter, but if we're talking about animations then try [camenduru GitHub], the guys got the Holly Grail colab gear you can run, I mean the holly Grail and bleeding edge ai, keeps updating the repository.


Well Nvidia product allows AI hand tracking it's impressive.
 
Last edited:
Thanks. I have checked this but this is not doing what I'm looking for. I can understand he is unreal engine live link but again the question is ue live link supports only face animations but in some videos this guys is using his full body motion.
It should really not be that tricky or confusing. these days there are tons of AI tools, and i atleast remember seeing a few, that can track your face and hands via cam footage, and change it into an animated avatar.
but anyway for the unreal thing this should answer your question, because i don't see why unreal engine would not be able to track simple things like hand when it can track the complex features such as facial motion:

https://forums.unrealengine.com/t/b...altime-body-hands-mocap-from-an-iphone/237874
Screenshot 2023-12-28 133739.png
 
Back
Top