📱

Get Our Mobile App

Take your business learning on the go!

Download on the App StoreGet it on Google Play

Blender Can Do AI Now (and it's insane)

The Blenderender17:07

Transcription

You can now use Claude, one of the most powerful AI models in the entire world, in Blender. Recently, Claude integrated into Blender as a corporate patron. And what happened is that we now also have a direct MCP from Claude to Blender. And what does that mean? That means that you can prompt the AI to make things for you in Blender. And in this video, I'm going to show you exactly what this AI can do.

We're going to dive into asset generation, texture generation, creating animations, making file organization easier, making geometry node setups, creating our own add-ons on the spot, testing out whether Claude can follow YouTube tutorials, and more. So stick around if you want to know everything about this newly released feature. But before we get started, I'm going to show you how you can use it too, completely for free, in less than 5 minutes. So let's dive right into it.

If you want to install Claude right now, you either need the desktop version or Cloud Code. Both of these are fine. I think the desktop version is a bit more friendly for most people to use. So, get started with the desktop app. If you click on this, you can download it for Windows. This will get you a Cloud setup.exe. And if you double-click on this, you will get Cloud Code.

Once you open Cloud Code, you will be presented with a window that looks like this. So, let me make that full screen. Now, there are two options. You can either follow this tutorial or you can ask Claude itself how to do it. But first things first, in order for this to run, you need Blender 3.5.1. It is only compatible with Blender 3.5.1 and higher. What you also need is the Blender MCP add-on. It is on this link.

Now, all the links can be found in the description, including a piece of code that I'm going to give you right now. What you can do is go to the installation, open up Blender, and what you can do is drag and drop this into Blender. So, if I take this, drag and drop it in here, then it will check for the extension. I already have it installed. Now, if this is the first time that you do this, what you need to do once it's done installing the labs extension is drag and drop it into Blender again. And once you do that, you will have the MCP installed. You can double-check that by going to Edit, Preferences, going to Add-ons, typing MCP, and here you will find MCP, which stands for Model Context Protocol, by the way. And if you go over here, you will see a localhost:9876 and everything is turned on. And otherwise, you need to click here on Start MCP Server. I have it on auto-start.

Now, before Claude can actually use this, we need to go into Claude itself and make sure that it's turned on. So, click right here on your profile name. Go to Settings and then go to Connectors. Under Connectors, you want to browse for connectors or add a custom connector. I'm simply going to browse for it. If you browse to Blender, then you will see it right here. And you will click on plus. It will tell you to install. And it might seem like you're installing Blender. That's not the case. Just click install. And that will enable the MCP. I believe it should work right now. If it doesn't, I have a piece of code that will help you out.

In order to get that done, you need to click right here, go to Settings, go to Developer right here, and Edit Config. Right now, I already have it running, but you might need to add a piece of code. If you do not see this Edit Config, it will open up a folder structure right here and a JSON file. Right-mouse-click, Edit in Notepad. Right here, you will have a Notepad that looks like this. You can then Ctrl+V this entire command in there, which has the argument for the Blender MCP file save. And then it will be done. You might need this, you might not need this. In any case, it is right here if you do.

And then it is very simple. We can now start prompting Claude. And I'm going to prompt him, "Delete the default cube." Let's see. There you go. The default cube has been deleted. And now we know it works. So, let's continue. And I'll show you exactly what you can do with this.

First, I generated a cozy living room scene. It took around 2 minutes and Claude built everything. I think it's pretty cool what this is able to do, just as a first test. However, I would really like to explore some more extreme things we've never seen before. So, right now, I am in a different scene with an iPhone. There are no keyframes here. And if I play this, nothing happens. And I want to give an animation to this iPhone. So, I'm going to undo all the rotations and X and all of that stuff. And I'm going into Claude and I'm going to ask him, "Make a premium animation for the iPhone using the empty called main iPhone controller and make a camera animation that's tracking the iPhone. Make it look premium."

So, let's see how Claude is able to perform with this task. I'm just going to wait for Claude. This doesn't take a lot of time, by the way. So, right now, I think we're in it for approximately a minute. It has placed more keyframes than I can do in a minute. So, it is now giving me a debriefing of what it created. Let's go to the very first frame. All right. So, it's not the most beautiful animation, right? But I can definitely see, like, until over here is kind of all right. There you go. And then from here, it starts to get a bit wacky, doing these flips like this. But you can definitely see that it is starting to animate and it's starting to work. So that's quite interesting. Uh, maybe right here, we can also have a look at what it does with the camera. It is indeed changing the focal range a little bit. If I look over here, you can see keyframes on the focal length and on the f-stop. If you want to know how to create this iPhone or get it for free, the link's in the description. I think it did a pretty cool job animating this. Of course, it's not completely finished. And I also didn't specify things in the prompt. I can also be a bit more specific with my prompt, like, "Do a 360° rotation, use the bezier curve, and make sure that it is fast in the beginning, slow in the middle, fast in the end." So you can also be way more specific with these prompts.

Now, the next thing I'll show you is very powerful. It is actually integrating Python scripts in Blender, and these can be very useful in specific projects, and I'm going to show you exactly what I mean. So, recently I created this Rolex animation. It has a photo scan. It has an entire Rolex with all of these internal parts, like so. And all of these parts obviously have a subdivision modifier on it. This makes the viewport very slow. You will see that as soon as I start to play this, we get a 7 FPS uh in this viewport. Now, these consist of a lot of parts, and it would be quite annoying to go into the outliner or select all of these, like, uh, like so, for example, make sure not to select some other stuff such as the empty, and then go in there and do the modifier changing so that we can actually get some smooth playback.

Now, what I want to do is go into Claude and I can ask it to either turn everything off for me, turn all the modifiers off in the viewport so that I have smoother playback, or I can ask it to make an add-on for me that does this forever and ever. So, I'm going to do the second option: "Create a quick add-on for me with a single button that turns off all the modifiers in the viewport so I can have smoother playback. Don't turn it off in the render."

All right. So, I'm just going to prompt it for this. Now, it's going to do some Python magic. And this is all for free, by the way. Of course, you're going to hit your limits rather soon if you start prompting with this some more. All right. So, it has created a button for me. Now, I'm not entirely sure if I want it to be over here. I think it's messing up the rest of my UI a little bit. I would rather have it be somewhere over here. Right. So, with the modifiers on, we can see that this one has a subdivision in the viewport, has a level of three. And I'm going to click on "Modifiers Off." And there you go. It has turned invisible for the viewport. Now, let's see what it did for our playback speed. 24 FPS. So, this is a life hack, guys. If you have those problems with 7 FPS in your viewport when trying to do your animations, that can be very frustrating. However, I just coded a very simple button, and now I have perfect playback on my computer with 24 FPS for this animation. And now I can actually see what it looks like. So that's another very cool use case that you can use Claude for directly in Blender.

Now, I'm going to show you something else that I think is pretty insane. So, I got Darth Vader right here. It is a Lego version, but I want to add some more photorealism to this model. And I'm just simply going to ask Claude and see if it's able to detect this and add some photorealistic scratches. So, let's prompt Claude in order to do that for us. Going to try and make sense of the scene. I didn't name anything. Once again, it's also going to take screenshots of the window so it can use some sort of clip vision in order to see what is going on. It has a clear picture. I can see the Lego Darth Vader with his chest texture, lightsaber, white Lego bricks. So, it's even seeing the chest texture, right? Okay, so it's finished. And I do indeed see some changes here. So, let's click on that. We see a more pronounced bump. There's some more dense and, uh, maybe some scratch-type things there. I'm not entirely sure. Shader Editor. Let's see. It did indeed add this entire node block: noise textures, bump, and roughness, and all of that good stuff. I think it did indeed improve, but I want to see a more extreme example.

All right, so here I have some headphones and, uh, let's ask Claude to change it completely. I've reached 90% of my session limit, so I might just have to upgrade in a while. But do remember, we created a cozy living room, made a complete iPhone animation with camera and all, we made our own add-on in order to speed up our playback in the viewport, made a completely procedural texturing setup, and now we're going to see what it will do for the last 10%. All right, so now it hit me with the, uh, session limits. All right, so I now have the Pro plan right here, and we can continue back to our chat.

And if you're like, "Oh no, I cannot afford Claude Pro. I do not have the money for that." Then you might want to check out my course that teaches you how to make money with Blender and AI. After following this course, you will be a multi-skilled creator with video editing skills, Blender skills, and AI skills that you can use in order to make money. There's also a complete dedicated section showing you how to get your first paying customer. It also has a step-by-step case study showing how I closed a client that still pays me €4,000 per month. So, if you're interested in leveling up, click the link in the description.

So, it's working again. Now, we're going to wait for this and see how it is going to do its job. All right, so it is done creating all of this. Let's see. Uh, it didn't do everything, as we can see right here. Turn those into black. Or maybe that was the intention. Doesn't look bad necessarily. Uh, we also got some black buttons right here. And we've got the brown texture on this part. It turned this into some type of green, I believe. And, uh, yeah, it's all right. It's all right. It's It's not stunning. If you have a model, you can simply prompt it, "Hey, texture this for me," and then it will make the entire texture setup.

Now, let's try something completely new. I want you to make a fully procedural lemon. All right, so it has finished creating our lemon. Let's have a look. It seems like we got a pretty interesting-looking material right there. It's not the best lemon you can create. It did create some procedural textures, some noise textures. It's not completely what I expected it to be, but it didn't add in some of those green textures right there. We have these weird little blobs right here. If I go into the shader editor and see what it did, it's actually just a UV sphere, and it applied all of those textures to it. And you might be wondering, "Okay, but this is not exactly what I wanted." So, I'm going to give you a little hack here that is going to shoot me in the foot because what I think I can do, and I'm not entirely sure, but I'm going to test it out right now, is I will go to YouTube and on my account here, I have a strawberry tutorial. Okay, so this is going to show you exactly how to create this beautiful-looking strawberry. Not entirely sure if it is going to be able to do this, but I'm going to test it right now.

So, I'm going into Claude. "I want you to create a strawberry. Follow this tutorial." So, I just pasted my YouTube link in there. I hope it is able to take a transcription out of that and using that transcription, it's going to try and rebuild that strawberry. So, I hope this will work. And that kind of shoots me in the foot because, well, I made the tutorial. Now, you're not going to watch the tutorial. You're just going to ask Claude, and that's completely fine. I'm wondering if it's able to do this because I'm not quite happy with the lemon it produced. Now, if this does work, then all of a sudden you have a library full of tutorials, including my tutorials, that you can simply put into Claude, and it will recreate it for you.

All right, so it has finished creating our strawberry. And let's see what it looks like. It's definitely not perfect, and this is probably due to Claude not having access to all the modeling tools. Like, I used proportional editing in the original to adjust the shape of the strawberry. Didn't follow the tutorial exactly. And we also have some unconnected outputs here. So there's a map range that is not connected. Not sure why that is, but it did manage to create a strawberry. So this is definitely not perfect yet. We can also see that. So for the lemon and a strawberry, it kind of failed there, in my opinion. So it seems for now that following the tutorial is still a better method to create these models.

Now, I'm going to show you two more things. One of these is going to be organization, and the last one will be geometry nodes. So let's see what it is able to do. So right here I have a helicopter, and I want Claude to create a full organization for this. So as you can see, this doesn't have a name. All of these parts over here also don't have names. They are just planes and stuff like that which I modeled to make it look like a helicopter. So let's go over to Claude. "I have a helicopter in my scene. I want you to organize file names."

All right. So it has finished. It also turned on my backup collection, which I have right here. I'm going to turn those off. We've got the helicopter collection right here. And under helicopter, we have the rotor body, tail rotor, and landing gear. Quite interesting. So, I'm just going to open up the body first. If I select all of these, then indeed, we do have everything that belongs to the body. So, it seems. So, the only problem I found is that with the tail rotor, it only selected these two parts, and it actually added a lot of those to landing gear. So, I would have to change those manually. But it did name everything correctly. Or at least that's what I think. I don't know a lot about helicopters. And basically, our entire helicopter, instead of being one big mess, is now a neatly organized collection, which I didn't want to do by hand anyways. And now we have something that is well organized for this helicopter. But for organization, which is some of the most boring things that you can do, we have now fully automated this, and it is no longer necessary to do something like that.

So let's start in a new blend file and do some geometry nodes. Let's go to Claude. "I want you to create a geometry nodes setup." So, let's ask him to do this now. Basically, the idea is that if a ball rolls over a cube, then the next cube will be in time for the ball to roll over. All right. So, it seems to be finished. Has created an animation. I think this one, it's almost there. It's almost there. It's not completely there. All right. So, we do have a pretty cool. It is kind of tapping it sometimes, and sometimes it's a bit too slow or too late. Let's have a look at this geometry node setup. So, it's not actually based on the proximity of the object. It is actually based on math. Pretty interesting. I wonder what would happen if I were to feed it my own setup of proximity nodes and ask it to improve the animation or improve certain elements about it, or maybe add some elements to it, such as growing curves from the cubes or something.

For this video, I simply wanted to test everything in the first shot. Can Claude oneshot it? And I think it failed in a lot of aspects, but it also was very successful in some of them. So, I think for texturing, it worked out very well. I think for creating models was a little bit basic. Creating add-ons, very powerful. So, we got the modifiers on and off button right here. File organization, super powerful. Actually worked great. For following tutorials, it's not entirely there yet. I will try to find a method in order to improve this, and maybe I can take the transcript of the video myself and then paste it into Claude so it knows the exact steps. I'm not entirely sure yet, but I will figure that out.

So that's it. We have explored a lot of things that you can do with Claude in Blender. Now I will use this some more and explore different use cases. So if you're interested in seeing that, I will upload another video in about two or three weeks where I'm going to dive into some more advanced concepts. Click on subscribe so you don't miss it. And if you want to become an undeniable force in the 3D space, then I highly recommend watching this video next.