#MadeByGoogle ‘24: Keynote
>> ANNOUNCER: Please welcome, Rick Osterloh. [ Cheers and Applause ] >> RICK OSTERLOH: Good morning, good morning. Welcome to everyone joining us on YouTube from around the world, and right here in Google's beautiful Bay View campus in Mountain View.
A few months ago at Google I/O, we shared a broad range of breakthroughs to make AI more helpful for everyone. We're obsessed with the idea that AI can make life easier and more productive for people. It can help us learn, and help us express ourselves. And it can help us be more creative. The most important place to get this right is in the devices we carry with us every day. So today we're going to share Google's progress in bringing cutting-edge AI to mobile in a way that benefits the entire Android ecosystem. We're going to discuss specific
AI innovations coming to our own Google Pixel portfolio. We're going to answer the biggest question people have about AI... What can AI do for me? I understand people's skepticism.
There have been so many promises, so many coming soons, and not enough real-world helpfulness when it comes to AI. Which is why today, we're getting real. We have lots of live demos of products, features, and AI experiences that are starting to ship with Android and our new Pixel devices, and Gemini is the key to it all. We're fully in the Gemini era, with AI infused into almost everything we're doing at Google, across our full tech stack. Our integrated AI strategy means we're in control of where we're heading, and we're innovating at every layer of the stack. It's all to bring you the most helpful AI. For 25 years, we have invested
in world-class technical infrastructure. This resulted in the development of our Tensor Processing Units, custom designed to deliver Gemini helpfulness to people all over the world. You'll see lots of new AI experiences today that put those TPUs to work for you. Our technical expertise also enables us to build our own mobile SOC in-house, and work with silicon partners to optimize their chips to run state of the art on-device AI. This hybrid infrastructure is what lets us run Gemini models at scale in the cloud, and efficiently right on your device. These models are the result of years of research, and one of the biggest science and engineering efforts we've ever undertaken as a company.
Gemini models include our latest Gemini 1.5 Pro developer preview model, which is now number on the L-M-SYS Chatbot Arena leaderboard. [ Cheers and Applause ] And with our advanced AI models running in the cloud on our world-class infrastructure, we're able to deliver help through our incredible apps and services like never before. All six of our products with more than two billion monthly users are now using Gemini models to help you, So you can get information faster in Search... Get more done in Docs... Get writing help in Gmail...
And start a chat with Gemini directly from the Chrome address bar. And as we announced just last week, there are some exciting new ways Gemini is making your home smarter, safer, and easier to manage. Taken together, Google has spent years building the world's most advanced tech stack in the cloud.
At the same time, we're bringing all that helpfulness closer to the user, with a mobile compute tech stack that you can hold in your hand. This comes to life as a global ecosystem of Android devices that brings breakthrough mobile experiences to billions of people. This device layer includes our own Pixel devices, and we'll have a lot to tell you today about our updated Pixel portfolio. This Android ecosystem even has its own custom AI model. Gemini Nano is the most efficient model for powering on-device experiences, which you'll hear more about today. We're reimagining the entire OS
layer, putting Gemini right at the core of Android, the world's most popular OS. You can see how we're innovating with AI at every layer of the tech stack - from the infrastructure and foundation models, to the OS and devices, and the apps and services you use every day. It's a complete end-to-end experience that only Google can deliver. And I want to talk about the work we're doing to connect it all together with an integrated, helpful AI assistant for everyone.
It changes how people interact with their mobile devices, and we're building it right into Android. For years, we've been pursuing our vision of a mobile AI assistant that you can work with, like you'd work with a real-life personal assistant. But we've been limited by the bounds of what existing technologies could do.
So we've completely rebuilt the entire assistant experience around our Gemini models, creating a novel kind of mobile computing help for the Gemini era. The new Gemini assistant can go beyond understanding your words, to understanding your intent, so you can communicate more naturally. It can synthesize large amounts of information in seconds, and tackle complex tasks. It can draft messages for you, brainstorm with you, and give you ideas on how you can improve your work.
With your permission, it can offer unparalleled personalized help, accessing relevant information across your Gmail inbox, your Google Calendar, and more. And it can reason across personal information and Google's world knowledge to provide just the right help and insight you need. And it's only possible through advances in Gemini models we've made over the last six months. It's the biggest leap forward since we launched Google Assistant. We're going to keep building responsibly, and pushing to make sure Gemini is available to everyone, on every phone. And of course, this starts with Android. Here's Sameer to tell you more.
[ Cheers and Applause ] >> SAMEER SAMAT: Hi, everyone! At Google I/O we talked about a once-in-a-generation opportunity to reimagine what phones can do and how we're rebuilding Android with AI at the core. As Rick said, Gemini is a key part of this vision, and we want to bring all the improvements of an AI-powered OS to everyone. That's why Gemini is being built for Android scale. It already supports 45 languages
in more than 200 countries and territories and we're continuing to add more. It's available on hundreds of phone models, from dozens of device makers and I'm not just talking about flagship devices with the latest processors. We've brought Gemini to existing devices as well, which means your Android phone keeps getting better over time. With Gemini supported on billions of devices globally, it's by far the world's most widely available AI assistant. But what I'm really excited about is our collaboration with partners to tailor the Gemini experience for their unique hardware... like foldables! Motorola has already brought
Gemini to the external display of the Razr+. It's great for when you want a quick summary of your recent emails, but don't want to open your phone and get distracted by all your other notifications. And, with the Samsung Galaxy Z Fold6, you can use Gemini in split view to take advantage of the big, immersive display for multitasking that helps you get more done. And this isn't some future state. On Android, Gemini is available
around the world right now - far beyond English speakers, and a single market. But beyond scale, in order for Gemini to be your go-to, trusted assistant for your most important tasks, it's critical that your personal information is protected and private. With your permission, a truly capable AI assistant can help you connect your relevant personal data with all the valuable knowledge that Google has organized and made accessible. Like Create a daily workout routine based on my personal trainer's email. Or use my resume in Google Drive to write a new bio for work.
Or even Based on my friend's dietary restrictions listed in Keep, can we go out to eat seafood paella? As Rick said earlier, this is where our decades of investment in AI and Google's full tech stack make Gemini really special. Gemini can handle these kinds of complex, personal queries within Google's own secure cloud. And for some of the most sensitive use cases, like summarizing audio from a phone call or suggesting a helpful reply to an encrypted text message, we've pioneered on-device generative AI with Gemini Nano. It's the first time a large, multimodal AI model has been optimized for a mobile device, so the data never leaves your phone. With Gemini deeply integrated with Android, we are well on our way to rebuilding the OS with AI at the core. The new Gemini assistant brings
the benefits of AI to billions around the world, while helping keep your personal information secure and private. Android is truly leading the way toward AI for everyone. Now the fun part! We are going to show you how the latest Gemini experiences on Android can help you be more productive, creative and expressive. Here's Jenny to tell you more. [ Cheers and Applause ] >> JENNY BLACKBURN: There are so many different ways that people around the world are already using Gemini to make everyday tasks easier. People love the new Gemini assistant because it can help them do so much more, from writing, to brainstorming, to working through a tough problem, and even taking action using their favorite Google Apps.
And Gemini is getting a lot of love from students and teachers, who are using it to make learning more fun and interactive. Working on the eighth draft of an essay? Ask Gemini to critique your argument so you can focus on the right areas to improve. Having a hard time with a math concept? Ask Gemini to walk you through a problem, step by step.
Learning about photosynthesis? Ask Gemini to explain it in ways a gamer will understand. And we're just getting started, constantly working to make Gemini even better. Jess and Dave are going to take us through some of the new ways people can use Gemini on Android.
[ Cheers and Applause ] >> DAVE CITRON: Thanks, Jenny! Gemini is multimodal, which means it can go beyond text, to images and videos. And if you choose to use Workspace extensions in Gemini, it can now connect to even more of the apps you rely on, like Calendar, Tasks, and Keep. Let me show you how it works on this Samsung Galaxy S24 Ultra.
All the demos we're doing today are live, by the way. So if I happen to come across this concert poster for Sabrina Carpenter... I'll just open Gemini, take a photo and ask Gemini to Check my calendar and see if I'm free when she's coming to San Francisco this year. Gemini pulls relevant content from the image, connects with my Calendar, and gives me the information I'm looking for.
Looks like we had a little demo issue. Let me try one more time. All right. Check my calendar and see if I'm free when she's coming to San Francisco this year. Let's see if the demo spirits are with us today. Nope. Uh-oh. Looks like they're not with us.
All right. Let me try that one more time on another device. Sorry about this, folks. Let me go back. I'm going to take that photo. One more time. Check my calendar and see if I'm free when she's coming to San Francisco this year.
All right. There we go. [ Cheers and Applause ] thank you, demo spirits. Now I will ask Gemini to Set a reminder to check ticket prices tonight at 7. That's if they haven't sold out already...
Gemini connects to my Tasks app and just like that, the reminder is set! [ Cheers and Applause ] Oh and in honor of the song of the summer, add espresso to my shopping list. Gemini knows my personal context, coordinates for me across my apps, and takes action better than ever. And just like that, my Google Keep shopping list is up to date. [ Cheers and Applause ] >> JESS CARPENTER: Gemini can also understand what I show it on my screen, like this video I'm watching on my Motorola Razr+. I'm checking out this Korean food vlog from one of my favorite YouTube creators, to get ready for a trip to Seoul this fall. As I'm wrapping up the video,
I'll bring up Gemini like this, press here, and say create a list of the foods in this list of the foods she eats in this video." So here, Gemini is connecting with YouTube to find relevant information from the video's captions. And look, just like that, I have Hunt To make sure I can reference these later, I'll add all of these foods to a new things to try in Korea list.
Korean sweet potatoes and strawberry milk. If you know, you know. Now I'll know just what to taste. And of course, every great adventure needs a great soundtrack, so I'll ask Gemini to create one for me, maybe Create a K-pop playlist that would be great for walking around Seoul. Gemini can understand all the ways you may ask for a song or playlist so you can just describe the vibe you're going for, the same way you're talking to a friend. No more having to remember precise titles or lyrics! And there, it created a playlist that I can play now, or save for later. [ Cheers and Applause ]
>> DAVE CITRON: We've all had those moments where you need to write something on your phone, or get a head start on a draft. Gemini really shines in those situations. For example: Write a formal email to my landlord, Teresa, that my AC unit is broken. Make it sound urgent but still polite. [ Laughter ] All right. I'm excited to see Gemini comes
up with. Here we go. Dear Teresa, I hope this e-mail finds you well. I'm writing to report a serious issue. Okay. Let's try another fun. Draft a note to Professor Gellman, I missed class because I was sick and request a few more days to work on my project. What would normally take me
minutes, Gemini does in seconds. All right. Let's take a look... Dear Professor Gellman, I'm writing to inform you I was unfortunately absent from your class -- As you see, Gemini does a great job drafting emails for me, so I don't have to start from a blank page. And it's so easy to move these drafts to Gmail, so I can then polish up and send. Gemini is the perfect writing companion for moments like these. And now back to you, Jenny! [ Cheers and Applause ] >> JENNY BLACKBURN: Thanks, Jess and Dave! All of these are really great examples of how Gemini can help in your everyday life.
Simply prompt Gemini with a task or question, and it will provide instant help. But we believe a truly helpful personal AI assistant must do more. It needs to be able to communicate with you conversationally, because sometimes conversation is the best way to work through something complex. Like exploring a concept by talking it through. Or tossing ideas back and forth to help you brainstorm.
Or even acting as your anytime practice partner to help you prepare for an important conversation or interview. That's why I'm so excited about Gemini Live, the most natural way to interact with Gemini. Now you can have a free flowing conversation with Gemini, you can interrupt when you think of something important, or change topics as the conversation flows. Gemini will be right there with you. Let me show you how it works, and like what you just saw from Jess and Dave, this will also be a live demo. When I first go live with
Gemini, there will be ten different voices to choose from. Let's meet a few. >> AI AGENT: Great, let's get going. Here's one of the voices I have, but there's more to choose from. Swipe to give them a listen or
tap start to get chatting. >> JENNY BLACKBURN: All right, it's nice but I want to hear a couple more. >> AI AGENT: Here's another voice you can use. I'm looking forward to discussing with you the world's most profound questions like why is pickleball so popular? [ Laughter ] >> JENNY BLACKBURN: That is profound let's try one more. >> AI AGENT: Or maybe you want to listen to a voice like this, a pretty great one if I may say so myself, but don't worry.
There's more to choose from. >> JENNY BLACKBURN: Okay, I'll go with this one. Let's start chatting. >> AI AGENT: You can always change my voice in settings later. >> JENNY BLACKBURN: Hi, Gemini,
how are you doing? >> AI AGENT: I'm doing well, how can I help you today? >> JENNY BLACKBURN: Well, my niece and nephew are coming over this weekend, and I need ideas for something fun and educational we can do together, maybe something with chemistry... something a bit magical? >> AI AGENT: That sounds like a fantastic idea. How about doing a classic science experience like making a homemade volcano. It's super easy and there's a real sense of excitement when it erupts. I can find a few other ideas, now. Do you want to hear about them now? >> JENNY BLACKBURN: I totally do, and think magical. >> AI AGENT: Okay, how about
invisible ink? You can write secret messages that only appear when you use a hairdryer or homemade lava lamps. It looks super cool and trippy. >> JENNY BLACKBURN: That sounds cool, let's do the invisible ink. Is there a way to take it up a level? >> AI AGENT: Sure, we can try making the invisible ink change colors when it's heated up. Imagine writing a message that goes from clear to hot pink. That would be cool, right? Or we can try making a special solution that makes it glow under a black light. >> JENNY BLACKBURN: Oh, I love the black light, that's super cool. >> JENNY BLACKBURN: Okay, is
this going to be messy at all? >> AI AGENT: The invisible ink itself isn't too messy but you will need a few bowls to mix everything. You might want to cover your work area just in case. >> JENNY BLACKBURN: Okay. That seems cool. One last question for you help me come up with some creative name ideas for this experiment. >> AI AGENT: Absolutely. How about spy training academy
or the secret message lab? >> JENNY BLACKBURN: Cool, I love it. Thanks for your help, Gemini. [ Applause ] This experience is so cool. I love talking to Gemini in a
free-flowing conversation that can go in any direction. Gemini Live is available first in English to Gemini Advanced subscribers. And everything we just showed you, including Live, is beginning to roll out today on Pixel, Samsung, and other Android phones. I can't wait for you to try it. Across all these demos, you can
see how Gemini on Android helps you by pulling together real knowledge about the world, with your own information, and the apps and services you use every day. And this is only the beginning. Gemini will keep getting better, as we work to make the Gemini assistant even more capable and helpful. Let's take another look. [ Music ] [ Music ] >> How can I embarrass my sister during a wedding toast, but, like, respectfully? >> AI AGENT: Okay. Here's the deal. [ Music ]
[ Music ] [ Cheers and Applause ] >> BRIAN RAKOWSKI: Hi, everyone. We've got some fantastic new devices to show you today. In fact it's the biggest update we've ever made to the Pixel family. Pixel is our platform for showcasing the very best of Google AI. All the Gemini helpfulness you've seen so far is built right into Pixel. And we're going even further
with Pixel 9, the first phone designed for the Gemini Era. The full stack that Rick walked you through comes to life in Pixel, in ways that are simple and helpful. You've got Tensor, our custom-designed silicon that's specially tuned for our AI models. And you've got our latest on-device model, Gemini Nano with Multimodality. Thanks to this powerful
on-device infrastructure, nearly every experience across the phone is powered by AI, including unique features we've developed just for Pixel. Today, we're going to show you new ways that on-device AI is improving your phone calls... New Gemini-powered features to help you be more organized, or be more creative... And of course, new Pixel Camera features that help you get the perfect photo or video. But let's start with Pixel 9's new look, our biggest Pixel design progression in years. We have four new phones, including the gorgeous new Pixel 9, and the reimagined Pixel 9 Pro Fold. And we've heard from Pixel users
that just because they want a pro phone, doesn't necessarily mean they want a big phone. So for the first time, you can choose between Pixel 9 Pro and Pixel 9 Pro XL, without compromises. [ Cheers and Applause ] They have the same incredible display, sleek design, premium craftsmanship, processing power, and the same Pro Pixel Camera.
All of our new Pixel 9 phones feature a completely re-engineered, sculpted design that's not only stunning to look at but optimized for feel in hand, compactness, and durability. Thanks to the luxurious metal frame with its seamless rounded corners, and the scratch-resistant, flat Gorilla Glass Victus 2, the Pixel 9 phones are twice as durable as the previous generation, to withstand the inevitable accidental drops. Pixel 9 has an even brighter Actua display, and the Pro models use our Super Actua displays. Both are the best and brightest displays in their classes. Underneath that bright display, there's a new ultrasonic sensor for Fingerprint Unlock that's now 50% faster.
And as we always do, we've developed a diverse collection of striking colors. Let's take a look at the magic inside of our Pixel 9 phones. Across the full lineup, they have some serious horsepower, with hardware that's designed and tuned right here at Google to get the most out of our Gemini models. The new Google Tensor G4 chip, our fourth generation processor, is our fastest and most efficient yet. It's designed to improve everyday use cases. So web browsing, streaming on
YouTube, taking a photo, and shooting a video are smoother, with less of a hit to your battery. We custom developed Tensor G4 working hand-in-hand with Google DeepMind. So the industry's top AI research team is collaborating directly on the silicon for Pixel, and optimizing it for Google's advanced AI models.
Including our latest on-device model. Pixel 9 is the first phone to launch with Gemini Nano with Multimodality the most capable on-device AI model ever shipped on a phone. In fact, it's three times more capable and sophisticated than the Gemini Nano model we shipped just nine months ago on Pixel 8 Pro.
And even with this increase in size and complexity, the TPU in Tensor G4 can generate an industry-leading mobile output rate of up to 45 tokens per second. That's more than double Pixel 8's peak rate with Gemini Nano. We've also upgraded the memory across the entire Pixel 9 family... With 12 gigabytes of RAM for Pixel 9... And the Pro models come with 16 gigabytes. Put simply, Tensor, Gemini Nano,
and your phone's memory work together so generative AI on Pixel is faster and more intelligent, and your phone will be able to keep up with future AI advances too. And amazingly, we've packed in all this AI goodness while also improving thermals and battery performance. We're introducing a new vapor chamber in Pixel 9 Pro, a more advanced cooling technology to make sure your phone can maintain peak performance, even when it's working hard for you. And thanks to optimizations across Tensor, AI, and software, Pixel 9 phones deliver significantly more battery life than last year's devices. The entire line of Pixel 9s are also the first Android phones to include our new Satellite SOS... So you can contact emergency responders and share your location, even without cellular service.
It's the kind of feature we hope you never need, but it lets you go off the grid with the assurance that the grid is there if you need it. Satellite SOS will be available first in the US on Pixel 9 devices, regardless of your carrier plan. Now, all of those Pixel enhancements are also coming to our most forward-looking, most versatile phone, Pixel 9 Pro Fold.
It's the pinnacle of mobile computing, so let's check it out... [ Cheers and Applause ] It's noticeably thinner and lighter than our first-gen foldable. When it's folded, it has the same size display as Pixel 9 Pro, and comparable thickness too. It feels and functions like a phone. Then you unfold it and Pixel 9 Pro Fold becomes something else altogether... An 8-inch tablet with the big and bright Super Actua Flex display. It's the largest display on a
phone, and it's 80% brighter than the first generation. The big screen gives you so much more surface area for entertainment, productivity, multitasking, and content creation. With Pixel 9 Pro Fold, you're getting the best of both worlds...
An 8-inch tablet for power users that turns into a phone you can fit in your purse or pocket. And you're getting the same Tensor G4... And 16 gigabytes of RAM to power great new features that are just for foldables.
The big beautiful phone screen pairs with NFL Sunday Ticket from YouTube TV. Check out the cool multiview experience. And with Split Screen, you can multitask across different apps at the same time.
While you're watching the game, open up Messages to talk some trash in the group chat. [ Laughter ] And wait 'til you see what the camera can do. We'll get there in a few minutes.
The new Pixel 9 phones are the only smartphones in the world built specifically to connect you to Google's AI models, both in the data center and directly on your device. Nearly every experience is enhanced by Gemini, Android, Tensor, and the Google services you use every day. So let's get to some demos. Here's Alex to show you what Pixel 9 can do... [ Cheers and Applause ] >> ALEX SCHIFFHAUER: Good morning! Pixel has always been about unlocking the full potential of Google AI, to help you find what you're looking for, get more done, and be more creative. The Pixel 9 lineup is no different they're shipping with the new Gemini assistant.
And by combining Tensor G4 on your device with TPUs in the cloud, Pixel 9 phones introduce a unique set of helpful AI features that are only available on Pixel. I've got a lot to show you today, so let's get into it... One of the most common things we do on our phone is check the weather. For a lot of us, it's the first
thing we look up in the morning. So we're using AI to make the experience much more helpful and delightful with the new Pixel Weather app. Let's use it to get a live look at the weather here in Mountain View.
You can see the app is beautifully designed, with super accurate weather forecasts. And Gemini Nano generates a custom AI weather report, so you don't have to scroll through a bunch of numbers to get a sense of the day's weather. You can even customize the app based on what you want to see. Maybe you're keeping an eye on the UV index to see if you need sunscreen... You can just drag and drop it. Nice and easy. The new Pixel Weather app is shipping on all of our Pixel 9 phones.
Google AI on Pixel 9 isn't just helping you get ready for the day it's helping you throughout the day, too. For years, Pixel Call Assist has been blocking spam callers, helping you navigate phone trees, predicting the hold time for you, and a personal favorite even waiting on hold for you. No other phone handles all those headaches. And now Pixel Call Assist gets
even better with Call Notes, which follows up on your phone calls with a completely private summary of the conversation. So when you're on a call and you don't have a pen and paper handy, you still have easy access to phone numbers, times, details, and any other info you don't want to forget. So here's an example... I'm thinking of switching up my
hair, and going with a broccoli cut. It's trendy but I feel like I can pull it off. Now, my barber... can't, so he referred me to a new barbershop. The problem is, I forgot to jot down the number. Thankfully I have Call Notes. Let me show you how it works. I can easily locate the phone number to make an appointment.
And if I need to, I can also review the full transcript of the original call Like how much did that cut cost? Call Notes is completely private and runs entirely on-device, so your phone calls and summaries are never sent to the cloud. It's easy to activate it, which notifies everyone on the call, and then your Pixel will start transcribing and summarizing. Couldn't be easier, and you're always in control of when and how you use it. Now, you'd expect your phone to be good at phone calls and telling you the weather.
We're also using Google AI to deliver some new kinds of help as well. Here's a scenario we're all familiar with... You come across something on your phone you want to remember. Maybe you make a mental note, or maybe you grab a screenshot. But more often than not, you
forget the thing you wanted to remember, or you can't quickly find what you need when you need it. The new Pixel Screenshots can help with that. It's an app for Pixel 9 that helps you save, organize, and recall anything you need. Pixel Screenshots is like your
own visual library of everything you want to remember... Items in a recipe, wifi or door codes, restaurant recommendations, or anything else. So if you're like me, you're always coming across cool stuff online that would make great gifts, but then when it comes time to buy the gift, I can't remember the ideas or where I saw them. Like, I just got this text from my fianc e that she's really excited about Keke Palmer's new book. I'll just click the link, and then instead of leaving this tab open until the end of time, I'll screenshot it. Pixel Screenshots analyzes the content of the image and makes it searchable. And it is all running privately
on device, thanks to Gemini Nano and Tensor G4. Let's see, I'm quickly going to add this to my collection of gift ideas, with a note that my fianc e Christine wants it. If I want to look through the other gift ideas I've saved, I can open the Pixel Screenshots app, and navigate to the collection. And I can see Keke's book, along with lots of other great gift ideas I've saved here. The thing is I don't just screenshot gift ideas for other people, but I also screenshot things that I want.
For example, I was looking to buy a new bike this summer, and I took dozens of screenshots so I can compare them. I just tap the search bar and I can search my screenshots, in this case bikes. See how fast that is? Tensor G4 was designed for Gemini Nano with Multimodality, so it's fast. I was also looking for shoes. I can find them instantly. And because Pixel Screenshots is designed to extract the information within an image, I can type t-shirt price. Here, you can see Pixel Screenshots didn't just find the original image, but also provided me with an answer, in natural language, based on the information in the image.
And Pixel Screenshots can even remember where I grabbed each screenshot so I can tap to go back to where I found them, and buy that shirt. [ Cheers and Applause ] The best thing about Pixel Screenshots is I don't have to do anything differently. I just keep screenshotting anything I want to remember. Pixel Screenshots is shipping with all of our new Pixel 9 devices.
And we're also working on some new ways to be creative using AI >> KEKE PALMER: Alex, Alex, Alex. >> ALEX SCHIFFHAUER: Oh, hey, it's Keke Palmer! >> KEKE PALMER: Alex, I loved the demo but lemme save you some trouble. Give my new book to your fianc e My new book out this November, pre-orders available now and whatever you do, don't get the broccoli cut. That's two favors she owes me.
To all of you at home, I hope you'll join me for the first Made By Google After Party on YouTube. No guest list, no wristbands, it's a VIP after party where everybody's invited! It starts right after this, and I'll see you there! >> ALEX SCHIFFHAUER: Thanks Keke! Christine, if you're watching, I think we just got our first wedding gift. All right, back to AI on Pixel. We've got another first to show
you. Every Pixel 9 phone ships with the new Pixel Studio, a first-of-its-kind image generator. It's powered by an on-device diffusion model running on Tensor G4 and our Imagen 3 text-to-image model in the cloud. So you can just type what you want to create. Perfect example, a funky party invite. Our co-worker Tejas is moving back to San Francisco and finally getting his own place. And nothing says Welcome Back to
California like a party at the firepits at Ocean Beach. Watch how easy it is to whip up an invite, I'll make one live right now. I'll just tap Create and start with a simple prompt, beach bonfire pit at sunset. We've made Pixel Studio fast, not much waiting here. As you can see. That looks pretty good, now let's make it quintessential San Francisco and add the Golden Gate Bridge. Let's see what Pixel Studio comes back with.
I want this to feel like a party, and Pixel Studio lets me get creative. What if I added some fireworks in the sky? Let's see what that looks like... Nice, now I want it to feel more like an invite instead of a photo. If I tap the Style button, I can quickly change how the image looks. Why don't we try a cartoon? It'll just take a moment like changing your prompt would.
Changing your style is quick, easy... and honestly pretty fun. It's not what I'm looking for. What if I made it look like a retro video game? Really cool. And if I want to change the composition, I don't need to change my prompt. I can just hit the refresh button to get a new version. Nice. That looks so good. Now, in Pixel Studio you can
also make stickers from your images, and I already have a few of Tejas so I'll just throw them right in here. [ Laughter ] I think a giant Tejas head is kind of hilarious let's put it right near the fireworks. And I've got a few more stickers of him why don't I put one right near the bonfire? He looks a little lonely. No worries, I was a second Tejas. The only things missing are the party details. Ocean Beach, Friday 7PM Ah, the font feels out of place, So we can easily change it. Why don't we go take a look.
This one looks retro and it will match the vibes pretty well. Nice. Cool. It took me just a moment to create the perfect invite, so now I'll just copy and paste it into the group chat. And by the way, with RCS coming to the iPhone, all my friends will get the same high-quality image, no matter what phone they're using. [ Cheers and Applause ]
That's a lot of new AI helpfulness... the all-new Pixel Weather App, Call Notes, Pixel Screenshots, and Pixel Studio are shipping with our new Pixel 9 phones. I'm so excited for you to try them! And I'm also excited to hand the stage over to Shenaz and Kenny, to take you through the magical new camera capabilities in Pixel 9. [ Cheers and Applause ]
>> SHENAZ ZACK: The award-winning Pixel Camera is the world's first AI-powered camera experience. And Google continues to be the only mobile phone maker that builds the entire camera, end-to-end. So it can deliver new Pixel-exclusive features that have never been possible before. >> KENNY SULAIMON: With Pixel 9, upgrades across that entire system come together to make every photo stunning, and to solve everyday camera challenges for you. So now it's easier than ever to
frame up a beautiful scene, capture it with incredible image quality, and edit it to look just the way you want. >> SHENAZ ZACK: Let's start with the image quality. This year, we've rebuilt our signature HDR+ pipeline from the ground up, taking what we've learned from Real Tone and over nine years of building an amazing Pixel Camera. So your photos and videos authentically reflect the world around you, the way you see it with your own eyes.
>> KENNY SULAIMON: Take this image for example. We've made improvements across exposure, sharpness, detail, contrast, tone mapping and white balance. And the difference is remarkable, with more accurate skin tones, texture, shadows, and even better Night Sight for exquisite low-light shots. And we're bringing that same HDR+ pipeline to Panorama. Panoramas are a staple in mobile
photography, but they haven't really evolved in years. We've rebuilt Pixel 9's Panorama mode, starting with the UI, which now intuitively guides your hand. Once you've captured the full scene, Pixel runs the photos through the full image processing pipeline, for gorgeous, incredibly detailed panoramas. And by the way, the image processing includes Night Sight. [ Cheers and Applause ] Pixel was the first phone with Night Sight for your photos... The first to use it for video...
And now Pixel is the first phone to use it for brilliant low-light panoramas. [ Cheers and Applause ] The quality is actually pretty wild. Check out this panorama of the Tetons.
And now check it out at night. And now check it out compared to another smartphone camera. [ Cheers and Applause ] Look at the detail, sharpness and color - it's amazing in a sick panorama photo that goes all the way up to 50 megapixels of resolution. >> SHENAZ ZACK: And here's something we've all struggled with: Getting the perfect group photo. We made group photos a lot better last year with Best Take, which makes sure everyone looks their best. But one of the biggest problems with group photos is how to include the entire group sometimes you end up taking a photo that you also want to be in! The new Add Me fixes that, so you can be included in your family vacation photos, or that once-in-a-lifetime photo with your favorite athlete.
We'll show you how it works with the Pixel 9 Pro, and with a Pixel user who's a six-time NBA all-star... Jimmy Butler. [ Cheers and Applause ] Thank you for joining us on stage and for helping us demo Add Me. Would you mind if we take a picture with you? >> JIMMY BUTLER: Of course, anything for you. >> SHENAZ ZACK: And don't box me
out. >> KENNY SULAIMON: Now I'm going to line up the photo and make sure I leave some room for myself on the left hand side. Perfect, you both look amazing. Okay, so it's a great shot, but this is my one chance to get a photo with Mr. Buckets himself, Jimmy Butler... >> SHENAZ ZACK: You can see the augmented reality overlay that guides my hand to make sure I take the photo and you can see it's processed in one single shot.
[ Cheers and Applause ] >> JIMMY BUTLER: You look great, by the way. >> SHENAZ ZACK: Thanks for that. So does Kenny. >> KENNY SULAIMON: Thanks for being a good sport, Jimmy. Hope we see a lot more of you here in the Golden State. >> JIMMY BUTLER: That's my cue.
You're not going to get me in trouble. >> KENNY SULAIMON: So as you just saw with Add Me, you don't need to hand your phone to a random bystander, try to get too close to each other and stretch your arm, or be left out of the photo entirely. All thanks to Add Me. >> SHENAZ ZACK: Add Me is
available at launch on all of our Pixel 9 phones. And now let me show you what we're doing with Pixel 9 Pro Fold to solve the trickiest challenge in photography: getting a fussy toddler to look at the camera and smile. The new Made You Look is here to help! Just turn it on and pick one of the fun, colorful visuals for your outer screen each with its own personality and sounds to get your child's attention on the camera. Made You Look gets your baby smiling, so you can capture a happy memory and that elusive perfect baby photo! And if anyone can make your kid smile, it's Joy from Disney and Pixar's Inside Out. She's coming to Made You Look in an upcoming Pixel Feature Drop. I wish my parents had this when I was a child. [ Laughter ]
I wouldn't be that grumpy. >> KENNY SULAIMON: Pixel 9 Pro Fold includes lots of other foldable camera features too. You get Dual Screen Preview, which lets both you and your subject see how the shot's going to turn out. And Rear Camera Selfies, so every shot you take, is taken with the best camera on your phone. This year, we've also added Pro controls, with professional camera features like shutter speed, manual focus, and more.
When you match these experiences with the amazing image quality from Pixel Camera, Pixel 9 Pro Fold is the best camera available in a foldable form factor. >> SHENAZ ZACK: We're also improving the accessibility of Pixel Camera, across the entire Pixel 9 family. With Guided Frame, people who have blindness or low-vision can take great photos and selfies. Guided Frame now offers even better face angle guidance, and lets you know when you might need to improve your lighting. And it's now easier to enable,
right from the Camera settings. >> KENNY SULAIMON: Now, Pixel Camera isn't just about taking gorgeous photos and videos. It also helps you with everything that happens after you've got the photo, helping you perfect your image and make it look just how you want it to look. We started this journey three years ago with Magic Eraser, and we're continuing it today with the evolved Magic Editor experience, using generative AI. Let me open my Pixel 9 Pro Fold and show you how it works... Thank you, Shenaz.
Let's open up this bad boy. So this is a good image, but it's a bit slanted. It could've been so much better, if only I had more time to frame my subject. This is where Auto frame in Magic Editor comes in. It uses generative AI to help recompose my image, applying photographic techniques like rule of thirds and golden ratios. So right now, it's filling in the blanks, and finding the perfect crop to reframe my subject. Wow.
That is awesome. Let's go with this one. And it even recovered the piece of his shoe that got left out of the initial photo. Pretty great. [ Cheers and Applause ] I chose that one by clicking the checkmark in the corner here. And just like that, I've
transformed my first photo into a stunning landscape shot. But we're not done yet, let's say I want to re-imagine the photo entirely. I can just tap on the grass here and I can simply type what I want to see. What do you wanna see Shenaz? >> SHENAZ ZACK: How about wildflowers? >> KENNY SULAIMON: Love that, let's add some color to this photo. I'll just type in wildflowers and, again, this is a live demo of generative AI. We're all going to see these
photos together. They're going to be great, I promise you. >> SHENAZ ZACK: Definitely. Still cooking. These are our colors. >> KENNY SULAIMON: This one is awesome.
I'm going to hit that check mark again. This scene is looking pretty great now, but it still needs something... Fun though right Shenaz? >> SHENAZ ZACK: How about a hot air balloon? >> KENNY SULAIMON: I love that idea, let's do it. I have a few ways to select what I want to edit. I can tap on an entire area, or if I want to get really precise, I can zoom in for detailed edits.
Now let's tap in hot air balloon. Right now Gemini models are taking the prompt I typed in and expanding it to include additional details and information based on the scene and wow. That's a little abstract. [ Laughter ] There it is. Generative AI but I love this one. This is my favorite. Let's do that. And, again, just to show you the
before and after, amazing. [ Cheers and Applause ] It's never been easier to edit your images - just describe what you want, and see your ideas come to life. The evolved Magic Editor is available right out of the box on all the new Pixel 9 phones. >> SHENAZ ZACK: All of our Pixel 9s also continue to push into new terrain for smartphone video. Pixel's video continues to make big leaps forward, thanks to a computational video technology called Dual Exposure. In simple terms, it takes two
exposures at the same time - one optimized for shadows and another optimized for highlights - and combines them to use the best of both, in real time. So you get sharper, less grainy videos, even in challenging low-light scenarios. It's the kind of computational videography you can get from a Pixel that isn't even available on many modern SLRs and mirrorless cameras. >> KENNY SULAIMON: And this year, we're continuing to raise the baseline video quality across the entire Pixel 9 family. At the same time, we're adding new capabilities to Video Boost, for our Pixel 9 Pro phones. It sets a new bar for mobile video by combining Tensor and camera hardware on the device with our full HDR+ pipeline in the cloud. >> SHENAZ ZACK: We've improved
Night Sight Video, so your low-light videos are even more natural, brighter, and more detailed. And we're moving Video Boost to Tensor Processing Units in the cloud, so when you enable Video Boost, it will now render your videos up to twice as fast. >> KENNY SULAIMON: When we combine Video Boost, with the brand new, 5X telephoto camera in Pixel 9 Pro, you can now shoot super high resolution zoom videos, up to 20X. That can sound abstract, so let me put it this way: You can crop in 5X... 10X...
All the way up to 20X, without sacrificing any quality. In fact, it has HDR+ across the zoom range. And this is on every. Single. video frame.
It's pretty dope, I can't lie. It's pretty good. [ Cheers and Applause ] >> SHENAZ ZACK: We were at Outside Lands Festival last Friday, and we caught an amazing Performance from Rene Rapp. When we apply video boost, look at the detail and the lighting... And now we'll just zooooom back
to where we were actually standing. It's pretty magical. >> KENNY SULAIMON: And check this out, we're also using generative AI and Video Boost TPUs to upscale your videos to 8K resolution, even though you're shooting 4K video. The quality and resolution are
so high, you can even pull high quality 33 megapixel still photos from any frame. That's huge for creators and streamers, since you're now able to get high quality thumbnail stills from any moment in your YouTube videos. [ Cheers and Applause ] >> SHENAZ ZACK: All that to say, Pixel is once again rated the best smartphone for photography.
And today, we're excited to announce that Pixel 9 Pro with Video Boost, has also been rated the smartphone with the highest-quality video. [ Cheers and Applause ] Pixel 9, Pixel 9 Pro, and Pixel 9 Pro Fold take smartphone photography and video to completely new heights, just like every Pixel before them. Now let's welcome Brian back to the stage. [ Cheers and Applause ] >> BRIAN RAKOWSKI: With an incredible range of Pixel-exclusive features, and a bold and beautiful new look, you're going to love this new lineup of Pixel devices. We've got Pixel 9, the powerfully sophisticated Google phone, with an unbelievable upgraded camera, supercharged performance, and the latest AI features... Like the new Gemini assistant, Add Me, Pixel Screenshots, Pixel Studio, and so much more. Pixel 9 starts at $799.
Pixel 9 Pro adds pro-level performance and speed with 16 gigabytes of RAM, meticulously crafted materials and finishes, the brilliant Super Actua display, and the pro-grade camera with the best video quality on a smartphone. Pixel 9 Pro comes in two sizes, starting at $999. And finally, the reimagined Pixel 9 Pro Fold. It's thinner and lighter, with the largest display on a phone and innovative features that you can only get on a foldable phone. Pixel 9 Pro Fold starts at $1,799. The entire Pixel 9 family is available for preorder today in the US, Japan, and Europe. Pixel 9 and Pixel 9 Pro XL begin
shipping on August 22nd, with the rest of the phones starting to ship in September. And we want to make sure our most powerful phones have access to the latest and greatest Gemini models and app features. So all three Pro phones come with one year of Gemini Advanced and 2 terabytes of cloud storage. [ Cheers and Applause ]
It turns Pixel 9 Pro into a true generative AI powerhouse that's miles ahead of any other phone on the market. And of course, every Pixel 9 is going to keep getting better over time, with a steady stream of new features with Pixel Drops, and seven years of OS and security updates. It's a different kind of phone, that could only be made by Google. We hope you love it! [ Applause ] >> SANDEEP WARAICH: Pixel Watch has come so far in just two generations.
It's now being worn by millions of people, who tell us they love the special place it plays in improving their lives. With Pixel Watch 3 we are bringing our best lineup yet. It delivers our gorgeous, iconic design, for the first time ever, in two sizes. We are introducing an all-new 45 millimeter size, that's perfect for people who want more from their watch... It gives you 40% more display and a 35% bigger battery. You also get our
custom-designed, durable 3D coverglass and our brand new Actua display - it's our most advanced and power-efficient display. With up to 2000 nits of brightness... It's twice as bright as before, and it flexes all the way down to 1 nit in a dark room. The smaller 41 millimeter uses the same Actua technology, giving you 10% more display in the same compact size. Pixel Watch 3 is also our deepest integration with Google and Pixel yet. Your watch can now livestream your Nest Camera and Doorbell, control your Pixel phone camera, and act as your Google TV remote.
You can use Google Maps, even when offline... And take voice notes with the Recorder app. And Pixel Call Assist continues to get better with the new Hold a Minute. It answers for you and lets you hold the call while you find a quiet place to talk. It's an incredibly helpful smartwatch, but it's so much more than that. With Fitbit's fitness and health tracking built right in, Pixel Watch 3 is equally an advanced personal health and fitness device.
This year, we are introducing our most comprehensive fitness experience yet including a whole host of features, to help runners like me. A great running companion shouldn't just track my runs. It should help me plan my workout, guide me through it, and help me reflect on my progress. The new workout builder helps me run with a gameplan each day. I can build custom workouts, add
intervals, set targets, and build tempo runs. And with Fitbit Premium, Google AI does the legwork by automatically building my daily run workouts... Personalized just for me. During my run, I get real-time guidance, letting me know when my warm up is over, when it's time for my next interval, or when I'm behind pace, and need to pick it up. And across everything you do with your Pixel Watch 3, you're getting highly accurate heart rate tracking, with continuous sampling not just during workouts, but all day and all night.
And now we're taking it a notch further, by tuning Pixel Watch 3's heart rate tracking specifically for running. It's one of the toughest environments for heart-rate sensing. Your heart rate can change rapidly during your run, while your ground contact and arm movement introduce motion and light artifacts. Pixel Watch 3 accounts for exactly these challenges, to deliver our most accurate Heart Rate tracking for running.
Pixel Watch 3 even helps you improve your running form using advanced motion sensing to track your running dynamics like step cadence, vertical oscillation and stride length. For instance, last month on my longer-distance runs, my cadence dropped and my strides dragged longer as I lost steam. Fitbit sensed it and shared that insight with me. By correcting my form, I was able to lower the potential risk of injury, and improve my pace and distance.
Now, fitness isn't just about going all out on workouts. It's also about balancing that intensity with my body's need for recovery. To help find that balance, we're introducing three new tools. First, an all-new Readiness
Score that combines sleep, heart rate variability, and resting heart rate to give me a holistic picture of how ready I am to train. Second, a new metric called Cardio Load that tracks my heart's exertion during my workouts, and helps me understand if I am over or under training. And third, a personalized daily Target Load that combines my readiness and cardio load metrics to guide me on how much intensity to take on each day. And all these insights come together in the new Fitbit Morning Brief along with weather, my sleep insights, and how I'm tracking against my weekly exercise goals.
It's delivered automatically to my Pixel Watch 3 each morning, and it's awesome for someone like me, who wakes up at 6am to go for a run. Well, more like 5am now that I'm a parent. And you know, for those mornings when running just isn't my jam, Fitbit Premium provides daily picks, from a library of video workouts now with incredible workout classes from Peloton. Now, along with helping with your workouts, and your recovery, there's another special role that a watch can play.
With the power of real-time sensing, it can be a powerful health and Safety guardian, and prompt life-saving action when every second counts... Like a car crash, or a bad fall. Today, I'm excited to share a pioneering innovation, a first-of-its kind capability, called Loss of Pulse Detection. Take a look. >> VIDEO: I think the average
person doesn't think about their pulse. It's something that we take for granted. The phrase "loss of pulse" is one that many people may not have heard of, but a loss of pulse event could really happen to anyone. >> Loss of pulse is a health
emergency when the heart is not beating in a life-sustaining fashion. We have all of this infrastructure in place to get people help as quickly as possible, but it's all predicated on the idea that someone will be there to make a call to emergency medical services on your behalf, but we know that more than half the time, people experience these events with no one around and they are virtually unsurvivable if you don't have someone to help. So, we've built a Loss of Pulse Detection feature for the Pixel Watch that is the first of its kind. It can detect if someone has lost their pulse, is nonresponsive, and can make a call to emergency medical services where key information is provided, like the location of where the user is so they can get help as quickly as possible. >> A loss of pulse event is
really a time-critical emergency. The feature is specifically looking for a pulse, but also looking at physiological and motion data and then tying these together in a really smart algorithm driven by AI that
2024-08-14 20:08
