📱

Get Our Mobile App

Take your business learning on the go!

Download on the App StoreGet it on Google Play

My AI Avatar Clone is So Realistic It Replaced Me

Dan Kieft18:01

Transcription

Okay, this is crazy. Come a bit closer because we need to talk about AI clones. What you're seeing right now is my very own clone. This is not real. This is all AI. Just look how realistic the movements are. Yeah, that's scary, right?

Like, this technology has come a far away because I used to have an AI clone and everyone called me out on it. They all noticed it was fake. But if you can't tell, this is AI, too. Now, this is what my clone used to look like when I tried to do this with VO3 Tree like 9 months ago. And this is what we got right now. What this means is that you don't have to be in the studio anymore because all I have to do is upload an audio clip of me talking and a reference image and this is what you get.

Okay, so now it's the real and to prove this, I'm going to drink this cup of water because we all know AI cannot do that. Yeah, all jokes aside, this is actually crazy, right? Like, did I fool you or not? Let me know in the comments down below. In this video, I will breaking down exactly how you can make your own AI clone that looks exactly like you to make fun videos like I've just shown you. I'll also break down a few different use cases of how you can make something useful out of this.

Now, for this video, we're using Cance through Hicksfield. It has all the tools that we need to make these kind of videos. If you want to follow along, click the link in the description down below. I'll also add in a link to my school community where you can find all of the prompts I used and some other files that might be useful.

Okay, so the big question is, what is so good about these AI clones? Well, there are three reasons why I think this looks good. First, we have the amount of detail. If you look at these shots, you can see everything from my skin texture to my imperfections, pimples, freckles, like all of that. You see it on my skin. If we actually take a look at this other example right here, then let me walk you through it why I think this looks amazing. We got a few things going on and I want to discuss the detail. My face looks exactly like the image input. If I show you the image input that I used here, it's this image and it used that quite well. We can even see the bags underneath my eyes because there have just been too much work to do. I also like how this character is walking into the screen. She's taking a video and it looks like, of course, if you really zoom into it, you will notice, but I I do think it looks realistic. The other thing that I want to point out, this guy right here, that's exactly the type of like look or the exactly the type of face I would have at influencers in the wild. Like that's why I'm in this studio locked away from everyone else. I don't want to film in public like this because I will have people like this dude looking at me and that's why I'm just being in the public with my AI. the scooter right here. If we take a look at the light that is reflecting on some of these things. So, we see the vending machine right here, we have the light. Then also on this pole right there, we have the reflection of the light too. Overall, this is becoming so good that people are getting fooled by it.

The other reason why I think these AI clones are so good is the natural dialogue. Just have a listen to this. One of the easiest ways to tell something is AI generated is the dialogue. Specifically, the flow of it. Like we're talking about pauses, and as if you don't have them, you have a big chance that it's AI generated. That's crazy. Like, tell me that doesn't sound like me. tell me that doesn't look like me. Like the amount of detail and even like how I look away where I'm when I'm taking a break, where I'm pausing, like that's something I do quite often. Like you don't see me looking into the camera enough. Like I as as soon as I start to think about something or like I'm I'm like looking up or looking to the side. I'm doing that here too. If we just take a look at this, >> something is AI generated is the dialogue. >> There you had it. Just looked at the side. >> Like we're talking about >> the hand movements. It all looks and sound natural. I use a lot of pauses in my speech. Even here, it is using that. But the ability for Cedance to understand that there's pauses. The ability for Cedance to not cut out that pause to to also have my character take a little break when I'm taking a pause and look away. Maybe that is just incredible. If we compare that to what Hen made, for example, in this example, not even that old video that I did about Hen. I'm going to show you how I generate AI avatars that look and sound exactly like me. No matter the background, the clothing, or the camera angles, you will remain completely like the dialogue, the movement, all of it just feels more fake.

That also brings me to the last reason why I think this looks so good, which is the natural movement. That comes to like natural movement. This AI understands so well how good the natural movement is. Here's a little vlog that I made. More of a travel thing, but look at the natural movement here. Most people think of this as scary and inauthentic and all of that, but I'm here to say anyone can now be a creator. You don't have any limitations anymore. The only limitation you have is credits. And that is like that is a big thing. But I will show you how to save on some credits later.

Now that you understand what it is that it makes this look so good, it is time for you to learn like how to actually make your own clone. And it is way simpler than you might think. I will walk you through all the different steps to create your own clone because first you have to make your reference. Now for making a reference, I literally just use my phone and I took a selfie of me. So this is the selfie that I made. This already is good enough for 99% of your generations. The only tip I have is I wished I took like a a top down selfie to show my outfit. Like a selfie like this. To explain the reason why is in this video right here, I had some outfit issues. As you see in the first shot, I'm wearing black pants and in the second shot I'm wearing beige pants. Even though I prompted it to be black pants, um because it doesn't have a reference of me wearing black pants, it can sometimes up. So that's the tip that I want to give you. If you are doing this as a reference and you want to include more of your outfit, make sure you maybe also include another reference of your full outfit. But all in all, the main thing you need is a selfie of you. And I hear you're thinking, why are we not using a carrot sheet? And let me explain. This is the exact character sheet I made with GT Image 2 that looks just like me. The reason why I don't use these character sheets for my vlog type videos is because of the level of detail. Right now with this charact sheet, we have like my full image and we have like the side angles, all of that. But if we zoom in, it's not as detailed as a actual selfie of me. To show you a comparison, I've used the same prompt, but one video had the selfie as a reference and the other video had the character sheet as a reference. If we take a look at them side by side, and if we zoom in on my face, then we can see that there's a lot more detail and a lot less smoothness, which also can be good if you have some imperfections. But on my selfie image, it looked a lot better in my opinion. So that's why I went with the selfie approach. So that is how you make your clone or how you clone yourself.

Okay. The next challenge we have is making the AI sound like you. Now there are three different ways of how you can approach it. I will first show you the best method. If you have a good mic, then the best thing you can do is record your own audio. I've done this two different ways. I've used Audacity. This is literally a free tool where you can just plug in your microphone and then literally say anything you want. Then you take that audio and you upload it as a reference inside of Cance. Now that's the beauty of Cance. It can take in audio references if you didn't know that. Make sure that it is less than 13 seconds. For some reason, you can only do 13 seconds and not 15 seconds. So keep that in mind when you're generating or recording your voice. The only issue we have is it still alternates and changes your voice. Here's a side-by-side comparison of my real recording and what Cance made out of it. Okay, so this is crazy. Come a bit closer because we need to talk about AI clones. Okay, this is crazy. Come a bit closer because we need to talk about AI clones. Now, as you hear the Cense version is different from my original audio output, so expect it to change your voice a little bit. if you want it to exaggerate a bit more. Then make sure that your input audio is also like way more expressive. The other thing it does, it can add in some background noise. Now, this works best for talking heads videos that are like in a studio environment like this example. Yeah, that's scary, right? Like this technology has come a far away because I used to have an AI clone and everyone called me out on it. They all noticed it was fake.

If you're not in position to record each and every clip or just takes too long, then you can use this different method which is cloning your voice. The easiest and cheapest way to do it if you already have Hicksfield is to use audio and then voice over. Here you can create your own voice clone by submitting a audio file that is max 2 minutes long of you speaking. I did that right here. If you want to have the best possible clone, I would recommend using 11 laps, making a professional voice clone right there and using that to make your voiceovers. For example, this is what I sound like with an 11lapse voice. This is my voice clone on 11laps. What do you think?

Now that we got the two input references, so we got the image of us and then we also have the voice segment, we can now start generating. And let me explain how I prompt for this. So the first thing I do is I go to video, then I go to C dance and then over here I'm uploading both of these things. The next thing that you want to do is you want to add in your prompt. Now there are so many different ways to prompt it. There's no right or wrong, but the method I'd like to use for this is called timeline prompting. And the reason why is because it's very specific. It also allows you and any eye tool that you're using to think about like what you're actually putting in there. If I go over and break down the prompt, it's like this. I add in the format. So, I'm basically explaining it's a 9-second single continuous shot. I know you got the setting inside of Hickfield where you can select like how many seconds you have. Make sure you match that with what you have in your prompt. So, then we go over the subject. That's where I add and tag image one. So, in Hickfield, make sure you add in and tag that image one. Then for the wardrop, I'm going over like same. It's the exact same as image one. Environment exact same because it's one continuous shot. It's not that like difficult for this one. Then the style anchor. So, I'm going in with a locked studio talking at podcast YouTuber creator aesthetic. Here you can change this up to what you have in mind. If it's not a continuous shot, then you can change something like, oh, outside in the park, we have a handheld camera shot, like all of that. You can basically add in all the different details of how you want it to look. The shot was quite easy to be honest because a talking head shot is a static shot. It's all set on a tripod. So, we don't have anything difficult going on. The delivery, it's going to be conversational, reflective, mid-tempo with natural micro pauses, lip sync driven, and it's captured by a podcast mic. Clean, direct, micro tone, no reverb. Here, you don't want to simply copy what I did. If you're outside, if you have any type of background noise, you can add that in here. Now, for the logic rule, it's basically to prevent that the eye does anything weird. So, I'm just repeating myself with a single continuous shot. No cuts, no jumps, no zooms. I don't want to see that in this shot. If you do want to do that, then prompt it that you want to have that happen. Negative prompt, no music, no captions. Sometimes it tends to add in captions and music. Then for the action, this is where the timeline starts. It's not really a time-lap prompt because we have just one prompt. That's the only shot in the timeline. Um, so for 0 to 9 seconds, it is a talking headsh shot where I am in the studio and I've tagged myself again here and I am prompting like how I deliver these words. So, I'm saying like it's relaxed conversational energy, but while he's saying that, his right hand lifts up and he casually points toward the right side. Not sure which side that is, gesturing into open space. Then I repeat what I have set. And then I turn back to the lens and I continue. And this is what we got right now. That's just to give the AI a bit more of a breakdown of what we want to see. So, this is what it generated for me.

Now, this is what my clone used to look like when I tried to do this with V3 like 9 months ago. And this is what we got right now. Honestly, this is quite impressive. The first time I saw this, I showed it to my friends and they all thought it was the Realme. The main thing I did here is I did use 1080p quality and that is because I'm using this for YouTube videos which are upscaled to 4K. Ideally, you might even want to upscale this video, but although sometimes when you upscale tends to look a bit fake. Um, but yeah, this is very usable already. If you do want to save some credits though, then you might want to switch over to 720p because as you see, it's a lot lot cheaper um than 1080p. So, that is one tip for you there.

Now, you don't have to reinvent the wheel and prompt all of this yourself. Um you don't get as a polished of a result as I just had. So, to save you some time, I've made this MD file, which you can find in the school community. Then, you upload this MD file into your cloth or into your chip. Then, you also upload a reference image of you. And you can also even add in your audio file. Then you just start prompting it. It can be a super simple prompt like I just did a very short prompt where I said using the MD file and my reference images and my audio file from me a handheld camera scene of this man giving a tour in a boutique small but nice five-star hotel room. Uh it has to be like 13 seconds long, one continuous tick. Then I also give a breakdown of what the transcript is saying, like what the audio files say, so you don't leave that guesswork up to the AI. Then it will spit out a prompt. If you copy that prompt, put it into Hicksfield. Also, add in your references there, and then you hit generate, it will make you something like this. So, this is where I'll be staying for the time being. Here's the bathroom. Pretty fancy. And here's the bed. And then there's the huge TV. And yeah, I'd say it's pretty nice. Yeah, everything was AI generated. Even the voice, I used the 11laps for that.

Now, I hear you're thinking, how can I use this in real life? like what is actually the benefit of having this AI clone. I've already shown you a number of different examples, but now let's get a bit specific. The main use case of using this right now would be to generate short clips. Unfortunately, you can only do 13-second videos, but you can stitch them together to make something longer, but it will cost you a lot of credits. So, how are people using this in real life? Let me showcase you a few examples. So, for example, the first one that I want to share with you is this page right here. This guy literally went viral for making AI videos of some random guy. Like it doesn't even have to be you. Like I use me as an example right now, but it can be anyone. You use this guy, put him in a suit, and it's like completely fake. They make money through this like W course I reckon, and they already got like 130k followers. Now, here's another one. I don't know why they're picking old people, I think, for credibility, but this person has almost 400k followers. even has her own website and it's probably some dude just making these clips. Now there are also people making more entertainment style videos like here again they didn't use a image of themselves. They have built this imaginary character. These already have like 2 million followers and they're making real money with clips like that. One last example I want to give you is people using this for podcasts. >> So uh I think the AI creator space is very much a um show don't tell. >> Yeah. So, what I'm trying to tell you here is that you can make entertainment videos of yourself. You can put yourself on a podcast. You can make any type of video you can imagine.

To get a bit more practical, I've made a few examples of what I think this could be used for. So, here, for example, I used it as AI VFX. If you have played Minecraft, then you'd know exactly what this is. Man, I'd never need to walk ever again. Now, this can be a fun intro opener for my real or for my YouTube videos, and you can do this, too. The other one that I want to share with you is more of an AI ad. Now, here I made a Unilo ad. So, there you go, Uniqlo. That was some free promotion for you. I will send the invoice later. I think this this is like four shots. I generated everything like two or three times. In total, this will cost you like 500 credits max on Hicksfield, which comes down to depending on which plan you have. Max, that shot would cost you 25 bucks, which still feels pretty expensive. But the way I look at it, like I spend a lot of credit, and I burn a lot of money on it, I look at this as like a tool. Like instead of you buying a expensive camera or instead of you buying like a literal set and purchasing like all the people that can help you with that, renting out all the equipment, you can make something looking halfdeent with AI and big brands are already doing it.

My main point is that there are just so many different ways to make cool stuff with AI right now. I used to not even want to be on camera and now that's even more justified because I can just use a clone of me. I've seen so many people, so many characters that already are doing this. They are benefiting from it. They are using this in their business, in their social media, in every type of aspect. The main question I have to you is, are you going to be one of these early adapters or are you just going to be mad about this? I can see both ways, but still, I would give it a try. Again, the link to Hicksfield and the link to my prompts are in the description down below. Check it out. If you want to see more implications of how I use C dance, then click the video that's on the screen right now. I have a few cool videos that literally explain all kind of different use cases of how you can master seed dance.