Transcription
I keep asking my friends when does the asymptote arrive and when does the curve slow down. We've not seen it yet. There will be one, right? It is actually true that there is a limit to our craziness. We have not found it yet. The next thing that's really interesting and terrifying also is recursive self-improvement, but we don't have it yet.
What we do have >> guys, Eric Schmidt just gave a banger interview during an AI conference last week. Eric talked about the upcoming AI and its dangers for humanity. And he said if we don't control AI now, it could become an existential threat to humanity in the coming years. Guys, I must say here that Eric is one guy who's been warning us about AGI for a very long time now. In a recent interview, he literally said that uncontrolled AI has the potential to become a bigger problem for us comparatively to nuclear bombs. So, I mean, he's been the CEO of Google, and when he says AI is a bigger threat than nukes, it should be enough to open everyone's eyes. Let's watch the interview, and I'll give my opinion as we go.
>> So, I'll start with a question that uh I'd love to hear you expand on, which is we're living through a historic moment right now, right? Um, could you define the moment we're in and give us sort of a state of the union of what's going on in AI? We're 10 or 15% into the impacts of this and you can see it. You can feel it and some of it will happen, some of it will take longer, right? So, for example, hardware takes longer than software. Sort of robots take longer than digital systems on traditional hardware, things like that. Um, we've not, um, the next thing that's really interesting and terrifying also is recursive self-improvement.
>> Mhm.
>> It's not happening yet. And so, it's easy to convince yourself that you're going to have human agents, uh, sorry, computer agents that are humanlike completely within a year or two. We don't have the science for that yet. People are working on it. I can describe how I think it'll play out, but we don't have it yet. What we do have is reasoning systems that are perfect partners for human beings for good and bad, right? And that has a lot of implications. So if we stop today, which we're not, and it's not stoppable or controllable by any government or any single individual or corporation, we would still have advanced humanity because of these reasoning agents.
>> How fast do you imagine this is going to accelerate? Um, the there's a thing which I call the San Francisco consensus and the reason I call it is because everyone in San Francisco believes this uh everyone I know anyway which is that it it's easy to understand uh this is the year of agents which we can discuss why agents will take over everything this year.
>> During this year the scaling of the use of agents and reasoning will sort of grow at this enormous rate. Everybody's out of hardware, everybody's out of electricity. It's a real boom, right? It's like the biggest boom I've seen, and I've been through three or four of these in my career. Um, in this thinking, once you have recursive self-improvement where the system can begin to improve itself, you have intelligence learning on its own. And it will, in this argument, it will learn faster than we can because we're biologically limited. And the way this is expressed in San Francisco, and I'll give a simple example. You have a tech company with a thousand fantastic AI researchers. Um, so one day they turn on AI research. That is an AI research agent. Well, how many AI research agents do you have?
>> Mhm.
>> Well, as many as you're limited by electricity, right? You don't have to feed them. They don't need housing. There's no more housing in San Francisco. You all that kind of stuff, right? You don't have those problems. You don't have an HR department for them, if you will. Uh, and you don't have to pay them. You just have to feed them electricity. So how many could you have? Well, maybe maybe a million of these agents. Now in AI, the way you determine that you've made progress is you have clear metrics that the reasoning or testing or whatever the evaluation framework is better, right? So that's what happens. So in that scenario, the slope goes like this because you're already at this slope. Then you add more people. Then you get the agents and you go like this. And this is essentially a super intelligence moment. The belief in San Francisco is this occurs within 2 to 3 years. The evidence in favor goes something like this. Um, Claude Code came out a couple months ago, the the latest one, Opus, whatever it is.
>> 4.6. Yes. Thank you.
>> And everyone I know in the Bay Area that's doing software says it was 80/20, now it's 20/80.
>> The best analysis I can come up with is it's not the Claude code part, it's that the that the underlying LLM can produce more reasoning over time, better quality tokens over time. It's a deeper thinker,
>> right? And all the labs now are competing for that. This is not just the size of the context window. It's actually the reasoning skill and the length of which it can think. It can just think longer and produce more stuff, right?
I'm going to pause here for a bit, guys. I've been hearing tech people on podcasts saying that the recursive self-improvement is exponential. That's wrong. Recursive self-improvement is not exponential. Just because a system can improve itself doesn't mean that it does so by a constant factor each time. In fact, technology generally tends to show diminishing improvements as it matures. Yes, a better model can make improvements faster, but this ignores the current state of things that is being improved upon, and as it improves, it gets harder and harder to improve, which can cancel out the fact that the models are better and better at improving.
I watched this stuff uh when I was I moved to the Bay Area when I was 21 and I was a programmer in high school way back when and I was pretty good programmer and I watch what it does and I go my god I'm over you know there there's not a thing that I could do that it cannot do. So when they wrote a C compiler in Rust I could it's over you know like declare six. So I think part of this part of this is because the people who are building it are also seeing the dimmonition of their own skill. They're being forced to go from programmers, which is what I'm very proud to have been, to being the the director of a programming system.
>> Right? And the most likely scenario, by the way, there's a lot of implications for this.
>> Mhm.
>> One is that it's always been true, speaking as your local arrogant programmer, that the very top programmers were worth 10 times more than the ones right below. There's something special about the mathematical reasoning skills of programmers. Those people will become more valuable, not less valuable, because these systems need to be controlled by humans at the moment. Those people will be capable of grasping the parallelization and the activities of this. But I do have a proposal for universities. Those of you who are associated with universities, you should stop everything else you're doing in the university right now and design a course for freshmen, men and women, uh uh who starting in September, which is a prompt engineering class.
>> Why? Why? Why university? Why not high school?
>> God, you're so aggressive, Peter.
>> Let's start with university. You can improve my idea. I I thought 18-year-olds would be would be young enough. Maybe you think it's younger. Here's the most important thing. Spend spend spend a quarter or a semester. The first thing they learn in university is how to use these tools. Universities are completely opposed to my idea as usual.
>> Yeah.
>> Because it violates every one of their tenets. But if you think about the student, and I mean every student, liberal arts, you know, math, whatever, they're going, this platform will be the expression platform for their art, their music, their writing, and so forth. Why wouldn't you teach them immediately, Peter, improve my proposal?
>> No, I I just I just feel like we're that AI is going to impact every student in high school today.
>> Yeah. and that they're living an unnatural life by not engaging with it. And when they hit universities, for those that still exist, um
>> well, plus your kids are that age and so they're literally right now doing exactly what you're describing. So
>> people here who have teenagers, you know what I'm talking about cuz they're all in it already. So So I think you're that's an improvement to my argument that there's a problem of age restriction.
>> Uh you really have to think about vulnerable teenagers with this technology. Um I did some some analysis of where the real problems are with this stuff. Um a simple summary is that at some point there will be jobs impact from this stuff. We're seeing it in software and we're seeing it in certain customer service industries. Not across the board. At some point that will happen. That's an issue.
>> Another one is how do we as a country maintain our moral values while we're also racing against China. Another one is the impact on um uh young people. It is not okay for 13-year-olds to be committing suicide because of an LLM. It's just not okay. It should it's it's it needs to be addressed. It needs to be addressed right now.
>> for sure.
>> Uh and there's all sorts of other issues. The other one I came up with was in agent orchestration. Agents can be combined. I I've always been worried that when you put the agents together, especially if they're from non uh non-compatible vendors, you get unpredictable effects.
>> Yeah.
>> So, so these are problems to be solved. So, we herald the future and we solve the problems that it brought. So, we're we're going to talk about China and government and jobs. But before we do that, um I want to stay I'm I'm in this savor the moments kind of mode right now because I feel like the world to a year from today will be nothing like the world today. and all everything we're doing right now I've enjoyed so much for so long and so I just want to savor the moment but reminisce for one minute about the fact that while you were running Google the transformer got invented there the TPU got invented there Dennis Hassabis solved protein folding which is now universally used you know does the work in I think it's does the work in an hour that used to take a PhD student four years four years yeah.
>> it's like 300 million times more efficient.
>> Um, all of that and all the diaspora from that, all the people working in the field in San Francisco, as you mentioned, they all were your people.
>> And so, you were there at the creation of everything we're experiencing right now. Is there anything anything like that profoundly strikes you about that moment? I mean, did you even realize at the time?
>> I think when you're making history, you typically don't know it. Um, I give a lot of credit to Larry and Sergey um because they were ahead of me. I'm I'm an operating CEO and they pushed pushed and pushed for excellence. And I'll give you an example. In the early years of Google, Larry would um my favorite interaction was one day I said, "We need to hire some people doing Java." And Larry and Sergey said, "This is the stupidest idea we have ever heard." And and I could never tell with them whether they were being serious or not, or they were just joking with me. But their argument was that real programmers were programming one level lower. Today Google has many thousands of of things but they but they were so precise and so um driven to excellence in technology.
>> Yeah.
>> Right. That I could not uh fool them. I couldn't market around them. I needed to have the technical expert and they say, "Oh, that's boring. Don't do that. That's another one of your ideas." Right? We want a new idea.
>> And I give them a lot of credit for it.
>> But what about the TPU in particular? like that to me cuz I didn't even hear about it until much later and it takes years to to build design and build your own internal chips and now it's it's about to explode. I don't know how much is public or not but it's it's just.
>> So the TPU version one was essentially a matrix multiplier of a particular kind. When they went to version two they changed the algorithm in a complicated way and it's particularly good for inference. Whether it's brilliance or just luck, those decisions made 10 years ago set up the TPU as the perfect inference engine. And for everybody's benefit, inference is what the reasoning tech steps that I'm describing on. So Google is particularly well positioned. As you know, Nvidia purchased Grok um for the reason of getting that integ. And what's interesting about Nvidia, if you look at them, I was looking at the Reuben architecture. They managed to do Nvidia managed to do what Intel could never do. Intel could never get control of the complete server architecture and they tried. Nvidia has managed to build real supercomputers that you can really buy with enough time and money and so forth and it will really be delivered to your to your and it just do the whole thing. These are major industrial achievements and that's why both companies will do incredibly well.
Okay. In the following part, Eric talks about robotics and how he fears that China might defeat the United States in the robotics race. Guys, one thing is pretty clear at this point. China is advancing much more rapidly on the hardware level compared to the United States. I mean, if you look at the electric vehicle production and advancement, they've outpaced the US with a huge margin. Guys, China is fundamentally a socialist country. Their long-term goal is to reduce labor for the benefit of the people. Now if that actually materializes which is of course a real question in itself but at their core they believe that the productivity of the working class is a shared national good. So I mean it's really important for the United States to understand the dynamics of our competition with China.
>> Uh I read a time op-ed piece you wrote last night um China can dominate the physical AI future or uh what did you can you summarize that for us? It was an important conversation.
>> In in the geopolitical context. Um the and I've said this many times I'll say it again. The American competitor, not enemy but competitor is China.
>> I think it's by the way I think it's an important distinction for you to make. So thank you.
>> Not not enemy competitor. Um and how to understand them as a competitor. They have lots of money. They're very very smart. Their work ethic is equal or stronger than ours. and they dominate key industries, right? In with respect to robotics, we somehow decided it was okay for them to dominate the electric vehicle industry. This was an error. To be very clear, it's an error. Why do you not understand it's an error? Because we don't allow their cars in. Spend some time outside of this country in Chinese cars. Trust me, they are real competitors. They've done a great job. As I understand it, China is capable of vertical integration and build these gigafactories at a scale that we can't for all sorts of reasons. That's got to get addressed.
>> Mhm.
>> So if you want to compete and I want to compete and win with China and and I compete not enemy. I want us to have the same kind of system. So in robotics, it turns out robotics um you can understand robots as essentially actuators. These little stepper motors click click click click click and a brain. Ignoring the appearance and the googly, you know, eyes and all of that kind of stuff. It turns out that the industry of the electric vehicle produces the same kind of motors and the same kind of systems. They have an expertise that we don't. My own view is that at least for very low cost, China is going to win that. And that was what I was trying to say in that piece.
>> And I worry about that. Now, today these are not particularly useful. You know, they're they're fun toys. Is there a replacement for the dog if you get mad at your dog? Sorry, I like I love dogs, but you get the idea. Um, so, so we we need to address this, but at the moment, it sure looks to me like the robotic hardware of China is the winner at the low end. I'm not talking about the high-end. I'm not talking about the expensive stuff. I'm not talking about industrial robots. And if you're confused, watch the Unit um, uh, robot dance with the humans.
>> Yeah. It came out about a month ago.
>> We have Unitry here in the tech hub and the co-founder will be on stage with us later today.
>> Pay pay attention to them. They're they're very very impressive. Uh and I spent some time with them last time I was in China and they're one of many. And the way China works is that they have brutal competition. Um brutal brutal. It's like unbelievable. I was talking to my friend, we teach at Stanford and he said, you know, in China we don't have the board dinner. We have a two-hour meeting. We get back to work and there's no preamble. We're not, you know, we don't say hello, how are you, how's the family, that kind of stuff. We're boom, boom,
>> right? Uh it's just cultural.
>> Yeah.
>> And the work, the the the work ethic, the precision, and the scale that is possible in China is a real competitor.
>> Um I don't want to lose the robotic revolution in my view, the way we lost the electric vehicle revolution, at least on the low end.
>> Interesting.
>> because the Chinese model very much has a a well-built out supply chain with many vendors in the loop. But when you know we've been on a worldwide tour of all the humanoid robotics companies and just by coincidence I guess but when you look at the Gigafactory and look at Elon's vertical integration and also red adcock at figure same thing it's all vertically integrated why well because there's no vendor.
>> Yeah I have no choice. So, so it appears that to get to again we're in this is the abundance group, the abundance club. The way you get to abundance is you drive prices down and you get vertically integrated. And Elon in our country pioneered that to his credit,
>> right?
>> You know, the old joke about Google was we would build anything including the buildings. Well, Elon is actually doing that, right? You know, he's And why? Not because he's insane, but because he actually that's how you drive cost down. Yeah,
>> guys, the Chinese are very good at scaling at incredible rates. For example, they built the Tesla Shanghai Gigafactory in only 168 days. People point to Boston Dynamics is evidence that the US is winning, but they're missing the speed and scale. Boston Dynamics is basically one of two advanced humanoid robot companies based in the US, and they've been working on Atlas for almost 15 years. China has dozens and dozens of manufacturers with advanced humanoid robot solutions that have sprung up in only two to three years. Today, they're producing thousands of robots annually and deploying them to their mega factories. At this rate, the US is going to lose the race just like we did with drones and electric vehicles.
All right, guys. That's it for today's video. I'll see you guys next week with another.