Transcription
Okay, you can now run local AI models on your phone. Watch this.
We're going to go into airplane mode. Now, we're going to launch the AI Edge Gallery from Google. It's from this app that we can actually download and run Gemma 4.
Now, what is that? This is Google's new open-source AI models, completely local. And while they do have some bigger ones, they made some models that can run on a phone. The effective 2 billion and 4 billion models. Let's try them out.
Now, I'm running on an iPhone here and I did download these before putting myself into airplane mode. And we can ask it a question. Now, that's crazy fast. And the craziest part about this is that there's no internet happening here. It's not talking out to any server. All this inference, all this compute is happening on my phone.
We'll try a bigger model, the effective 4B. And this is just as fast. Now, this is not the craziest thing you can do here. If I go back here a bit, I can do images. Like, check this out. We'll do the effective 4 billion for this one. I'll add an image. For example, I'm in Japan right now. And let's see if it can tell me what this is.
Okay, so just think about that for a second. You arrive in Japan, foreign country, don't have internet on your phone, don't have cellular service, but you have a local AI model and you can just simply do this. There's no internet happening.
You can also do audio. I haven't tried this yet. Hey, I'm recording some audio to test some things. Do you work? Okay, it does.
And this one's a little creepy. They have a mobile actions model which is not related to Gemma 4. But watch this. Turn on my flashlight. Turn it off.
So, I don't know about you, but this gets me so excited about edge AI computing where we can actually run real AI models that can actually do things that aren't useless on our phones. Have you tried this yet? Seriously, go download the Google AI Edge Gallery. I'm not sure what you need as far as phone hardware to run it. This is an iPhone latest model, but I'm seriously impressed by this.
And if you want to learn more about local AI models and how to host more yourself, subscribe.