Transcription
If you are an active user of Claude code, then you definitely know that Skills are a very powerful thing. And if you are an active user of code and Skills together, then you definitely know about the pressing problems that exist with skills. For example, you created a skill, you need to evaluate it, how useful it is, right? That is, to run some evaluation for code, but it simply doesn't exist. Or your skills are not triggered at the right moment, Claude code simply does not call them, does not pick them up. There is also the problem of skills becoming obsolete. When you had a skill, it worked perfectly, a new model came out, and the skill is no longer relevant. And there are actually many other problems with skills. But not too long ago, on March 3, 2026, the Claude code team released a serious, I can even say, a grandiose update for skills. I can even say that the update is called Skills 2.0. There is really a lot of interesting stuff, a lot of problems are being solved. And today we will look at what kind of update it is, what kind of improving skill creator it is, which solves a lot of problems. We will consider all the theory that you need, absolutely everything on this topic. Also, of course, we will move on to practice, open the code, I will show you step by step how to install this skill, what can be done with it at all, and we will create a custom cool skill together. So let's go. The first thing I want to start with is to state that there are two types of skills. The first is a capability uplift skill. Well, a simple example, for instance, you all know how Claude OPUS 4.6, for example, generates frontend, right? That is, this is a normal, so-called ISOP. The sites are monotonous, they don't look very nice, but there are special skills, I think you all know about them perfectly, various skills that help models, for example, Opus 4.6 again, generate really beautiful frontend for your sites, so that it doesn't look like AI slop. Such skills are called capability uplift skills, meaning Claude code can do something, right, in some field, but with a skill, it does it much better. The second type of skills is encoded preference skills. This is when, for example, Claude code knows how to do something, but you want to combine all these abilities into one framework, into one skill, and clearly create a structure, so to speak, a kind of workflow, maybe an automation scenario. That is, you have a clear first step, you need to open the web, the second step is to find keywords, the third step is to analyze everything, parse it, then analyze it all. That is, in your skill, the tasks are clearly divided into 1, 2, 3, 4 or A, B, C, D. These are the two main types of skills that need to be understood. The next point that they added with the appearance of a new skill called Skill Creator, which again we will look at in practice today, is the addition of metric evaluation, i.e., EVS, in order to test your skill and improve it when needed. They give an example of their PDF skill, which fills out a PDF. Here. And testing and improving the skill with their skill. This is how it was done. Not very cool. Afterwards, of course, it does everything much better. This is called AVS. That is, again, a big problem was that you created any skills, but you cannot evaluate their work. The same thing happened before with agents, when they just started to come into use, and you could not adequately evaluate them, how well they perform their work. It's the same here. Only now we have the opportunity to evaluate the work of skills. Does it help Claude code at all? Maybe it only makes things worse, right? This actually happens quite often when skills are not very good. In this way, you can evaluate skills, run various evaluation metrics, and thereby gradually improve the skill. Here, for example, they give such an example of a benchmark PDF skill, their own, which they talk about above, without a skill and with a skill. And show me a side-by-side comparison, respectively, of this skill. Here they provide such a table with a skill comparison and without a skill. This is what evaluation with this Skill Creator looks like. That is, you will be able to do evaluations on your skills and thereby really improve the performance of skills. Also here they also talk about skills, that you can do AB testing. For example, one executor loads a task with a skill, another executor does the same task without a skill. And then these, respectively, outputs are taken, compared with each other, and we get such a report. Next, a big, one of the most important pressing problems is skill trigger tuning. For example, you created a skill or got a skill from somewhere, and you write some prompt to Claude code, give it a task, and you expect Claude code to call the skill, because for you it is, in principle, obvious that in this case your skill, which is specifically made for this task, should be called. But it often happens that Claude code simply skips it, it doesn't call it, because in the skill's description field, in Claude code, only the description is loaded initially, not the skill itself, not the entire prompt of 5,000 tokens, so to speak. Only about 100 tokens of the skill are loaded, where the description tab is loaded, which describes the skill itself. Depending on how well your description is written, whether it's too narrow or too broad. This determines how well Claude code will trigger this skill when it's needed. And here they also write that here they have done optimization on the description. Over time, you accumulate many skills, and again Claude code does not call the skill when you need it. And because of this, you have the need to improve the description so that it better understands when to call a particular skill. In general, guys, this was, in principle, all the theory on Skill Creator. Now let's move on to practice and see how well all this works in practice. Before we move on to practice, I wanted to inform you that if you are really interested in AI coding agents like Claude code, how to work with them, various methodologies, autonomous application development methods like Ralphloop, and if you are also interested in various skills. In general, if you are really interested in understanding how coding works, how you can actually create your own projects, then I invite you to our community Riversity. For example, in one of the latest videos, I analyzed such an interesting skill that visualizes your project, creates, for example, such slides, right? With the help of these slides, you can, so to speak, go and sell your application. In general, this skill, this particular skill, visualizes your code, breaks it down into components, and so on. I'm saying all this because there is already a lot of content in RНS University. It's practically a library, a knowledge base. So, for those who are interested in delving deeper into AI, into AI coding in particular, I invite you to RAN University. The link will be in the description under this video. So, first of all, let's open the terminal. You need to update your Claude code. To do this, just type Cloud update in the terminal. Update it, yes, the latest version at the moment is 2.1.7, I think, let's launch Claude. I already updated it before the video. And at the moment, the latest version is 2.1.70. To install the official skill called Skill Creator, which, in principle, I was talking about today, you need to go to plugins, that is, just type the command Plugin and here in the Discover field, type skill das creator, go here, press Enter. We want to install it. Also, personally, I will install it for myself, that is, for the user scope, so that this skill is available to me in all my projects. You can install it so that it is available only in this repository, or install it so that it is available, so to speak, for this project. In general, let's press Enter for install, that is, for a global installation. For those who are interested, this is exactly what the Skill Creator Skill looks like. It is located in the official Anthropic repository. I will leave the link in my Telegram channel. There will be a separate post for this video. All the links you might need will be there. And here there is a Skill MD tab. This is what the Skill Creator Markdown file looks like, respectively. For example, description, create new skills, modify and improve existing skills and measure skill performance. Here it is described in detail what this skill creator is, what it does, how it should work. In general, for those who are more interested in reading it, the link will be in my Telegram channel. And the link to my Telegram channel, of course, is in the description under this video. For example, in this video, I want to create a skill for a Telegram bot. This skill should improve the UI in the Telegram bot. That is, for example, a recent update added color buttons, in principle, beautiful buttons, text formatting, when you write more, and all that. That is, I want to create a skill with which Claude Code can improve the UI in a Telegram bot. I give it such a prompt, a completely simple prompt. I write Ultra Think use web search. And at the end, for safety, I will write use skill creator. Yes, in principle, this could have been omitted. It should have picked it up on its own, but I will write it for safety. In general, let's launch it and see what it can offer us. Also, in one of the recent updates, they finally brought back keywords like Ultraath, which make the thinking process in Claude code better. In principle, honestly, since the appearance of this command, I have constantly used it. I haven't noticed that they removed it. Perhaps it just wasn't highlighted in such bright colors, but I haven't noticed that they removed anything, added anything, as if it was always there. I include the Ultraat Think command in every important request of mine. Sometimes even two or three times. Honestly, in my experience, it seems to improve the quality of thinking, respectively, of the model. So, let's wait for now. We are currently doing a web search. So, research done. Let me use the skill creator to build this skill. Now it will create, respectively, this skill. So, it has created the skill. Let's click yes. Now comes the most interesting part. It wants to create three test cases for this skill, which I told you about at the beginning of this video, that when it creates skills, it can also do evaluation. And now, before your eyes, it is creating three test cases to do EVS on this skill. So, this skill, respectively, is located in the Skills Telegram UI tab. And there is a separate file, respectively, and it will be able to do an evaluation for this skill, which is very, very cool. Of course, we allow it to do so. And let's wait for the output. So, as we can see, it has launched six agents, because we have three evaluation tests, and for each evaluation test, it does AB testing, that is, it runs the same task with the skill and without the skill, which I also told you about at the beginning of this video. Honestly, this is really, really cool. They have really significantly improved the skill. All six tests ran and launched. Let's click yes. And we get such a benchmark. Well, the first test, formatting, with the skill was 6 out of 6, without the skill 3 out of 6. Then translation UI, with the skill was 5.5, and the baseline without the skill was 3 out of 5. And then evaluation trick confirm dialog was 7 out of 7 with the skill and without the skill was 6 out of 7. So, this is what our custom skill turned out to be from scratch. It's very cool that they finally added evaluations. I was really waiting for this to understand how well, respectively, this skill works. Today we covered what Skill Creator is, looked at what Skills 2.0 is. Most importantly, we looked in practice at how these skills are created using this Skill Creator and looked at very cool evaluations. I believe that this update is truly significant. It's a real step forward. I really like this update. I am, of course, very grateful to the Claude code team. Be sure to give this video a like if you enjoyed it. Write in the comments what you really think about this update in skills. It's very interesting to know your opinion. Also, don't forget that AI Rains is on Instagram. All links will be in the description. Thank you for watching. See you soon.