MadeByGoogle ‘24 Keynote

Show video

>> ANNOUNCER: Please welcome,   Rick Osterloh. [ Cheers and Applause ]   >> RICK OSTERLOH: Good morning, good morning. Welcome to everyone joining   us on YouTube from around the world, and right here in   Google's beautiful Bay View campus in Mountain View.  

A few months ago at Google I/O, we shared a broad range of   breakthroughs to make AI more helpful for everyone.   We're obsessed with the idea that AI can make life easier and   more productive for people. It can help us learn, and help   us express ourselves. And it can help us be more   creative. The most important place to get   this right is in the devices we carry with us every day.   So today we're going to share Google's progress in bringing   cutting-edge AI to mobile in a way that benefits the entire   Android ecosystem. We're going to discuss specific  

AI innovations coming to our own Google Pixel portfolio.   We're going to answer the biggest question people have   about AI... What can AI do for me?   I understand people's skepticism.  

There have been so many promises, so many coming soons,   and not enough real-world helpfulness when it comes to AI.   Which is why today, we're getting real.   We have lots of live demos of products, features, and AI   experiences that are starting to ship with Android and our new   Pixel devices, and Gemini is the key to it all.   We're fully in the Gemini era, with AI infused into almost   everything we're doing at Google, across our full tech   stack. Our integrated AI strategy means   we're in control of where we're heading, and we're innovating at   every layer of the stack. It's all to bring you the most   helpful AI. For 25 years, we have invested  

in world-class technical infrastructure.   This resulted in the development of our Tensor Processing Units,   custom designed to deliver Gemini helpfulness to people all   over the world. You'll see lots of new AI   experiences today that put those TPUs to work for you.   Our technical expertise also enables us to build our own   mobile SOC in-house, and work with silicon partners to   optimize their chips to run state of the art on-device AI.   This hybrid infrastructure is what lets us run Gemini models   at scale in the cloud, and efficiently right on your   device. These models are the result of   years of research, and one of the biggest science and   engineering efforts we've ever undertaken as a company.  

Gemini models include our latest Gemini 1.5 Pro developer preview   model, which is now number on the L-M-SYS Chatbot Arena   leaderboard. [ Cheers and Applause ]   And with our advanced AI models running in the cloud on our   world-class infrastructure, we're able to deliver help   through our incredible apps and services like never before.   All six of our products with more than two billion monthly   users are now using Gemini models to help you,   So you can get information faster in Search...   Get more done in Docs... Get writing help in Gmail...  

And start a chat with Gemini directly from the Chrome address   bar. And as we announced just last   week, there are some exciting new ways Gemini is making your   home smarter, safer, and easier to manage.   Taken together, Google has spent years building the world's most   advanced tech stack in the cloud.  

At the same time, we're bringing all that helpfulness closer to   the user, with a mobile compute tech stack that you can hold in   your hand. This comes to life as a global   ecosystem of Android devices that brings breakthrough mobile   experiences to billions of people.   This device layer includes our own Pixel devices, and we'll   have a lot to tell you today about our updated Pixel   portfolio. This Android ecosystem even has   its own custom AI model. Gemini Nano is the most   efficient model for powering on-device experiences, which   you'll hear more about today. We're reimagining the entire OS  

layer, putting Gemini right at the core of Android, the world's   most popular OS. You can see how we're innovating   with AI at every layer of the tech stack - from the   infrastructure and foundation models, to the OS and devices,   and the apps and services you use every day.   It's a complete end-to-end experience that only Google can   deliver. And I want to talk about the   work we're doing to connect it all together with an integrated,   helpful AI assistant for everyone.  

It changes how people interact with their mobile devices, and   we're building it right into Android.   For years, we've been pursuing our vision of a mobile AI   assistant that you can work with, like you'd work with a   real-life personal assistant. But we've been limited by the   bounds of what existing technologies could do.  

So we've completely rebuilt the entire assistant experience   around our Gemini models, creating a novel kind of mobile   computing help for the Gemini era.   The new Gemini assistant can go beyond understanding your words,   to understanding your intent, so you can communicate more   naturally. It can synthesize large amounts   of information in seconds, and tackle complex tasks.   It can draft messages for you, brainstorm with you, and give   you ideas on how you can improve your work.  

With your permission, it can offer unparalleled personalized   help, accessing relevant information across your Gmail   inbox, your Google Calendar, and more.   And it can reason across personal information and   Google's world knowledge to provide just the right help and   insight you need. And it's only possible through   advances in Gemini models we've made over the last six months.   It's the biggest leap forward since we launched Google   Assistant. We're going to keep building   responsibly, and pushing to make sure Gemini is available to   everyone, on every phone. And of course, this starts with   Android. Here's Sameer to tell you more.  

[ Cheers and Applause ] >> SAMEER SAMAT: Hi, everyone!   At Google I/O we talked about a once-in-a-generation opportunity   to reimagine what phones can do and how we're rebuilding   Android with AI at the core. As Rick said, Gemini is a key   part of this vision, and we want to bring all the improvements of   an AI-powered OS to everyone. That's why Gemini is being built   for Android scale. It already supports 45 languages  

in more than 200 countries and territories and we're   continuing to add more. It's available on hundreds of   phone models, from dozens of device makers and I'm not just   talking about flagship devices with the latest processors.   We've brought Gemini to existing devices as well, which means   your Android phone keeps getting better over time.   With Gemini supported on billions of devices globally,   it's by far the world's most widely available AI assistant.   But what I'm really excited about is our collaboration with   partners to tailor the Gemini experience for their unique   hardware... like foldables! Motorola has already brought  

Gemini to the external display of the Razr+.   It's great for when you want a quick summary of your recent   emails, but don't want to open your phone and get distracted by   all your other notifications. And, with the Samsung Galaxy Z   Fold6, you can use Gemini in split view to take advantage of   the big, immersive display for multitasking that helps you get   more done. And this isn't some future   state. On Android, Gemini is available  

around the world right now - far beyond English speakers, and a   single market. But beyond scale, in order for   Gemini to be your go-to, trusted assistant for your most   important tasks, it's critical that your personal information   is protected and private. With your permission, a truly   capable AI assistant can help you connect your relevant   personal data with all the valuable knowledge that Google   has organized and made accessible.   Like Create a daily workout routine based on my personal   trainer's email. Or use my resume in Google   Drive to write a new bio for work.  

Or even Based on my friend's dietary restrictions listed in   Keep, can we go out to eat seafood paella?   As Rick said earlier, this is where our decades of investment   in AI and Google's full tech stack make Gemini really   special. Gemini can handle these kinds of   complex, personal queries within Google's own secure cloud.   And for some of the most sensitive use cases, like   summarizing audio from a phone call or suggesting a helpful   reply to an encrypted text message, we've pioneered   on-device generative AI with Gemini Nano.   It's the first time a large, multimodal AI model has been   optimized for a mobile device, so the data never leaves your   phone. With Gemini deeply integrated   with Android, we are well on our way to rebuilding the OS with AI   at the core. The new Gemini assistant brings  

the benefits of AI to billions around the world, while helping   keep your personal information secure and private.   Android is truly leading the way toward AI for everyone.   Now the fun part! We are going to show you how the   latest Gemini experiences on Android can help you be more   productive, creative and expressive.   Here's Jenny to tell you more. [ Cheers and Applause ]   >> JENNY BLACKBURN: There are so many different ways that people   around the world are already using Gemini to make everyday   tasks easier. People love the new Gemini   assistant because it can help them do so much more, from   writing, to brainstorming, to working through a tough problem,   and even taking action using their favorite Google Apps.  

And Gemini is getting a lot of love from students and teachers,   who are using it to make learning more fun and   interactive. Working on the eighth draft of   an essay? Ask Gemini to critique your   argument so you can focus on the right areas to improve.   Having a hard time with a math concept?   Ask Gemini to walk you through a problem, step by step.  

Learning about photosynthesis? Ask Gemini to explain it in ways   a gamer will understand. And we're just getting started,   constantly working to make Gemini even better.   Jess and Dave are going to take us through some of the new ways   people can use Gemini on Android.  

[ Cheers and Applause ] >> DAVE CITRON: Thanks, Jenny!   Gemini is multimodal, which means it can go beyond text, to   images and videos. And if you choose to use   Workspace extensions in Gemini, it can now connect to even more   of the apps you rely on, like Calendar, Tasks, and Keep.   Let me show you how it works on this Samsung Galaxy S24 Ultra.  

All the demos we're doing today are live, by the way.   So if I happen to come across this concert poster for Sabrina   Carpenter... I'll just open Gemini, take a   photo and ask Gemini to Check my calendar and see if I'm free   when she's coming to San Francisco this year.   Gemini pulls relevant content from the image, connects with my   Calendar, and gives me the information I'm looking for.  

Looks like we had a little demo issue.   Let me try one more time. All right.   Check my calendar and see if I'm free when she's coming to   San Francisco this year. Let's see if the demo spirits   are with us today. Nope.   Uh-oh. Looks like they're not with us.  

All right. Let me try that one more time on   another device. Sorry about this, folks.   Let me go back. I'm going to take that photo.   One more time. Check my calendar and see if   I'm free when she's coming to San Francisco this year.  

All right. There we go.   [ Cheers and Applause ] thank you, demo spirits.   Now I will ask Gemini to Set a reminder to   check ticket prices tonight at 7.   That's if they haven't sold out already...  

Gemini connects to my Tasks app and just like that, the reminder   is set! [ Cheers and Applause ]   Oh and in honor of the song of the summer, add espresso to my   shopping list. Gemini knows my personal   context, coordinates for me across my apps, and takes action   better than ever. And just like that, my Google   Keep shopping list is up to date.   [ Cheers and Applause ] >> JESS CARPENTER: Gemini can   also understand what I show it on my screen, like this video   I'm watching on my Motorola Razr+.   I'm checking out this Korean food vlog from one of my   favorite YouTube creators, to get ready for a trip to Seoul   this fall. As I'm wrapping up the video,  

I'll bring up Gemini like this, press here, and say create a   list of the foods in this list of the foods she eats in   this video." So here, Gemini is connecting   with YouTube to find relevant information from the video's   captions. And look, just like that,   I have Hunt   To make sure I can reference these later, I'll add all of   these foods to a new things to try in Korea list.  

Korean sweet potatoes and strawberry milk.   If you know, you know. Now I'll know just what to   taste. And of course, every great   adventure needs a great soundtrack, so I'll ask Gemini   to create one for me, maybe Create a K-pop playlist that   would be great for walking around Seoul.   Gemini can understand all the ways you may ask for a song or   playlist so you can just describe the vibe you're going   for, the same way you're talking to a friend.   No more having to remember precise titles or lyrics!   And there, it created a playlist that I can play now, or save for   later. [ Cheers and Applause ]  

>> DAVE CITRON: We've all had those moments where you need to   write something on your phone, or get a head start on a draft.   Gemini really shines in those situations.   For example: Write a formal email to my landlord, Teresa,   that my AC unit is broken. Make it sound urgent but still   polite. [ Laughter ]   All right. I'm excited to see Gemini comes  

up with. Here we go.   Dear Teresa, I hope this e-mail finds you well.   I'm writing to report a serious issue.   Okay. Let's try another fun.   Draft a note to Professor Gellman, I missed class because   I was sick and request a few more days to work on my   project. What would normally take me  

minutes, Gemini does in seconds. All right.   Let's take a look... Dear Professor Gellman, I'm   writing to inform you I was unfortunately absent from your   class -- As you see, Gemini does a great   job drafting emails for me, so I don't have to start from a blank   page. And it's so easy to move these   drafts to Gmail, so I can then polish up and send.   Gemini is the perfect writing companion for moments like   these. And now back to you, Jenny!   [ Cheers and Applause ] >> JENNY BLACKBURN: Thanks, Jess   and Dave! All of these are really great   examples of how Gemini can help in your everyday life.  

Simply prompt Gemini with a task or question, and it will provide   instant help. But we believe a truly helpful   personal AI assistant must do more.   It needs to be able to communicate with you   conversationally, because sometimes conversation is the   best way to work through something complex.   Like exploring a concept by talking it through.   Or tossing ideas back and forth to help you brainstorm.  

Or even acting as your anytime practice partner to help you   prepare for an important conversation or interview.   That's why I'm so excited about Gemini Live, the most natural   way to interact with Gemini. Now you can have a free flowing   conversation with Gemini, you can interrupt when you think of   something important, or change topics as the conversation   flows. Gemini will be right there with   you. Let me show you how it works,   and like what you just saw from Jess and Dave, this will also be   a live demo. When I first go live with  

Gemini, there will be ten different voices to choose from.   Let's meet a few. >> AI AGENT: Great, let's get   going. Here's one of the voices I have,   but there's more to choose from. Swipe to give them a listen or  

tap start to get chatting. >> JENNY BLACKBURN: All right,   it's nice but I want to hear a   couple more. >> AI AGENT: Here's another   voice you can use. I'm looking forward to   discussing with you the world's most profound questions like why   is pickleball so popular? [ Laughter ]   >> JENNY BLACKBURN: That is profound let's try one more.   >> AI AGENT: Or maybe you want to listen to a voice like this,   a pretty great one if I may say so myself, but don't worry.  

There's more to choose from. >> JENNY BLACKBURN: Okay, I'll   go with this one. Let's start chatting.   >> AI AGENT: You can always change my voice in settings   later. >> JENNY BLACKBURN: Hi, Gemini,  

how are you doing? >> AI AGENT: I'm doing well, how   can I help you today? >> JENNY BLACKBURN: Well, my   niece and nephew are coming over this weekend, and I need ideas   for something fun and educational we can do together,   maybe something with chemistry... something a bit   magical? >> AI AGENT: That sounds like a   fantastic idea. How about doing a classic   science experience like making a homemade volcano.   It's super easy and there's a real sense of excitement when it   erupts. I can find a few other ideas,   now. Do you want to hear about them   now? >> JENNY BLACKBURN: I totally   do, and think magical. >> AI AGENT: Okay, how about  

invisible ink? You can write secret messages   that only appear when you use a hairdryer or homemade lava   lamps. It looks super cool and trippy.   >> JENNY BLACKBURN: That sounds cool, let's do the invisible   ink. Is there a way to take it up a   level? >> AI AGENT: Sure, we can try   making the invisible ink change colors when it's heated up.   Imagine writing a message that goes from clear to hot pink.   That would be cool, right? Or we can try making a special   solution that makes it glow under a black light.   >> JENNY BLACKBURN: Oh, I love the black light, that's super   cool. >> JENNY BLACKBURN: Okay, is  

this going to be messy at all? >> AI AGENT: The invisible ink   itself isn't too messy but you will need a few bowls to mix   everything. You might want to cover your   work area just in case. >> JENNY BLACKBURN: Okay.   That seems cool. One last question for you help   me come up with some creative name ideas for this experiment.   >> AI AGENT: Absolutely. How about spy training academy  

or the secret message lab? >> JENNY BLACKBURN: Cool,   I love it.   Thanks for your help, Gemini. [ Applause ]   This experience is so cool. I love talking to Gemini in a  

free-flowing conversation that can go in any direction.   Gemini Live is available first in English to Gemini Advanced   subscribers. And everything we just showed   you, including Live, is beginning to roll out today on   Pixel, Samsung, and other Android phones.   I can't wait for you to try it. Across all these demos, you can  

see how Gemini on Android helps you by pulling together real   knowledge about the world, with your own information, and the   apps and services you use every day.   And this is only the beginning. Gemini will keep getting better,   as we work to make the Gemini assistant even more capable and   helpful. Let's take another look.   [ Music ] [ Music ]   >> How can I embarrass my sister during a wedding toast, but,   like, respectfully? >> AI AGENT: Okay.   Here's the deal. [ Music ]  

[ Music ] [ Cheers and Applause ]   >> BRIAN RAKOWSKI:   Hi, everyone.   We've got some fantastic new devices to show you today.   In fact it's the biggest update we've ever made to the Pixel   family. Pixel is our platform for   showcasing the very best of Google AI.   All the Gemini helpfulness you've seen so far is built   right into Pixel. And we're going even further  

with Pixel 9, the first phone designed for the Gemini Era.   The full stack that Rick walked you through comes to life in   Pixel, in ways that are simple and helpful.   You've got Tensor, our custom-designed silicon that's   specially tuned for our AI models.   And you've got our latest on-device model, Gemini Nano   with Multimodality. Thanks to this powerful  

on-device infrastructure, nearly every experience across the   phone is powered by AI, including unique features we've   developed just for Pixel. Today, we're going to show you   new ways that on-device AI is improving your phone calls...   New Gemini-powered features to help you be more organized, or   be more creative... And of course, new Pixel Camera   features that help you get the perfect photo or video.   But let's start with Pixel 9's new look, our biggest Pixel   design progression in years. We have four new phones,   including the gorgeous new Pixel 9, and the reimagined Pixel 9   Pro Fold. And we've heard from Pixel users  

that just because they want a pro phone, doesn't necessarily   mean they want a big phone. So for the first time, you can   choose between Pixel 9 Pro and Pixel 9 Pro XL, without   compromises. [ Cheers and Applause ]   They have the same incredible display, sleek design, premium   craftsmanship, processing power, and the same Pro Pixel Camera.  

All of our new Pixel 9 phones feature a completely   re-engineered, sculpted design that's not only stunning to look   at but optimized for feel in hand, compactness, and   durability. Thanks to the luxurious metal   frame with its seamless rounded corners, and the   scratch-resistant, flat Gorilla Glass Victus 2, the Pixel 9   phones are twice as durable as the previous generation, to   withstand the inevitable accidental drops.   Pixel 9 has an even brighter Actua display, and the Pro   models use our Super Actua displays.   Both are the best and brightest displays in their classes.   Underneath that bright display, there's a new ultrasonic sensor   for Fingerprint Unlock that's now 50% faster.  

And as we always do, we've developed a diverse collection   of striking colors. Let's take a look at the magic   inside of our Pixel 9 phones. Across the full lineup, they   have some serious horsepower, with hardware that's designed   and tuned right here at Google to get the most out of our   Gemini models. The new Google Tensor G4 chip,   our fourth generation processor, is our fastest and most   efficient yet. It's designed to improve   everyday use cases. So web browsing, streaming on  

YouTube, taking a photo, and shooting a video are smoother,   with less of a hit to your battery.   We custom developed Tensor G4 working hand-in-hand with Google   DeepMind. So the industry's top AI   research team is collaborating directly on the silicon for   Pixel, and optimizing it for Google's advanced AI models.  

Including our latest on-device model.   Pixel 9 is the first phone to launch with Gemini Nano with   Multimodality the most capable on-device AI model ever shipped   on a phone. In fact, it's three times more   capable and sophisticated than the Gemini Nano model we shipped   just nine months ago on Pixel 8 Pro.  

And even with this increase in size and complexity, the TPU in   Tensor G4 can generate an industry-leading mobile output   rate of up to 45 tokens per second.   That's more than double Pixel 8's peak rate with Gemini Nano.   We've also upgraded the memory across the entire Pixel 9   family... With 12 gigabytes of RAM for   Pixel 9... And the Pro models come with 16   gigabytes. Put simply, Tensor, Gemini Nano,  

and your phone's memory work together so generative AI on   Pixel is faster and more intelligent, and your phone will   be able to keep up with future AI advances too.   And amazingly, we've packed in all this AI goodness while also   improving thermals and battery performance.   We're introducing a new vapor chamber in Pixel 9 Pro, a more   advanced cooling technology to make sure your phone can   maintain peak performance, even when it's working hard for you.   And thanks to optimizations across Tensor, AI, and software,   Pixel 9 phones deliver significantly more battery life   than last year's devices. The entire line of Pixel 9s are   also the first Android phones to include our new Satellite SOS...   So you can contact emergency responders and share your   location, even without cellular service.  

It's the kind of feature we hope you never need, but it lets you   go off the grid with the assurance that the grid is there   if you need it. Satellite SOS will be available   first in the US on Pixel 9 devices, regardless of your   carrier plan. Now, all of those Pixel   enhancements are also coming to our most forward-looking, most   versatile phone, Pixel 9 Pro Fold.  

It's the pinnacle of mobile computing, so let's check it   out... [ Cheers and Applause ]   It's noticeably thinner and lighter than our first-gen   foldable. When it's folded, it has the   same size display as Pixel 9 Pro, and comparable thickness   too. It feels and functions like a   phone. Then you unfold it and Pixel 9   Pro Fold becomes something else altogether...   An 8-inch tablet with the big and bright Super Actua Flex   display. It's the largest display on a  

phone, and it's 80% brighter than the first generation.   The big screen gives you so much more surface area for   entertainment, productivity, multitasking, and content   creation. With Pixel 9 Pro Fold, you're   getting the best of both worlds...  

An 8-inch tablet for power users that turns into a phone you can   fit in your purse or pocket. And you're getting the same   Tensor G4... And 16 gigabytes of RAM to power   great new features that are just for foldables.  

The big beautiful phone screen pairs with NFL Sunday Ticket   from YouTube TV. Check out the cool multiview   experience. And with Split Screen, you can   multitask across different apps at the same time.  

While you're watching the game, open up Messages to talk some   trash in the group chat. [ Laughter ]   And wait 'til you see what the camera can do.   We'll get there in a few minutes.  

The new Pixel 9 phones are the only smartphones in the world   built specifically to connect you to Google's AI models, both   in the data center and directly on your device.   Nearly every experience is enhanced by Gemini, Android,   Tensor, and the Google services you use every day.   So let's get to some demos. Here's Alex to show you what   Pixel 9 can do... [ Cheers and Applause ]   >> ALEX SCHIFFHAUER: Good morning!   Pixel has always been about unlocking the full potential of   Google AI, to help you find what you're looking for, get more   done, and be more creative. The Pixel 9 lineup is no   different they're shipping with the new Gemini assistant.  

And by combining Tensor G4 on your device with TPUs in the   cloud, Pixel 9 phones introduce a unique set of helpful AI   features that are only available on Pixel.   I've got a lot to show you today, so let's get into it...   One of the most common things we do on our phone is check the   weather. For a lot of us, it's the first  

thing we look up in the morning. So we're using AI to make the   experience much more helpful and delightful with the new Pixel   Weather app. Let's use it to get a live look   at the weather here in Mountain View.  

You can see the app is beautifully designed, with super   accurate weather forecasts. And Gemini Nano generates a   custom AI weather report, so you don't have to scroll through a   bunch of numbers to get a sense of the day's weather.   You can even customize the app based on what you want to see.   Maybe you're keeping an eye on the UV index to see if you need   sunscreen... You can just drag and drop it.   Nice and easy. The new Pixel Weather app is   shipping on all of our Pixel 9 phones.  

Google AI on Pixel 9 isn't just helping you get ready for the   day it's helping you throughout the day, too.   For years, Pixel Call Assist has been blocking spam callers,   helping you navigate phone trees, predicting the hold time   for you, and a personal favorite even waiting on hold   for you. No other phone handles all those   headaches. And now Pixel Call Assist gets  

even better with Call Notes, which follows up on your phone   calls with a completely private summary of the conversation.   So when you're on a call and you don't have a pen and paper   handy, you still have easy access to phone numbers, times,   details, and any other info you don't want to forget.   So here's an example... I'm thinking of switching up my  

hair, and going with a broccoli cut.   It's trendy but I feel like I can pull it off.   Now, my barber... can't, so he referred me to a new barbershop.   The problem is, I forgot to jot down the number.   Thankfully I have Call Notes. Let me show you how it works.   I can easily locate the phone number to make an appointment.  

And if I need to, I can also review the full transcript of   the original call Like how much did that cut cost?   Call Notes is completely private and runs entirely on-device, so   your phone calls and summaries are never sent to the cloud.   It's easy to activate it, which notifies everyone on the call,   and then your Pixel will start transcribing and summarizing.   Couldn't be easier, and you're always in control of when and   how you use it. Now, you'd expect your phone to   be good at phone calls and telling you the weather.  

We're also using Google AI to deliver some new kinds of help   as well. Here's a scenario we're all   familiar with... You come across something on   your phone you want to remember. Maybe you make a mental note, or   maybe you grab a screenshot. But more often than not, you  

forget the thing you wanted to remember, or you can't quickly   find what you need when you need it.   The new Pixel Screenshots can help with that.   It's an app for Pixel 9 that helps you save, organize, and   recall anything you need. Pixel Screenshots is like your  

own visual library of everything you want to remember...   Items in a recipe, wifi or door codes, restaurant   recommendations, or anything else.   So if you're like me, you're always coming across cool stuff   online that would make great gifts, but then when it comes   time to buy the gift, I can't remember the ideas or where I   saw them. Like, I just got this text from   my fianc e that she's really excited about Keke Palmer's new   book.   I'll just click the link, and then instead of leaving this tab   open until the end of time, I'll screenshot it.   Pixel Screenshots analyzes the content of the image and makes   it searchable. And it is all running privately  

on device, thanks to Gemini Nano and Tensor G4.   Let's see, I'm quickly going to add this to my collection of   gift ideas, with a note that my fianc e Christine wants it.   If I want to look through the other gift ideas I've saved, I   can open the Pixel Screenshots app, and navigate to the   collection. And I can see Keke's book, along   with lots of other great gift ideas I've saved here.   The thing is I don't just screenshot gift ideas for other   people, but I also screenshot things that I want.  

For example, I was looking to buy a new bike this summer, and   I took dozens of screenshots so I can compare them.   I just tap the search bar and I can search my screenshots, in   this case bikes. See how fast that is?   Tensor G4 was designed for Gemini Nano with Multimodality,   so it's fast. I was also looking for shoes.   I can find them instantly. And because Pixel Screenshots is   designed to extract the information within an image, I   can type t-shirt price. Here, you can see Pixel   Screenshots didn't just find the   original image, but also provided me with an answer, in   natural language, based on the information in the image.  

And Pixel Screenshots can even remember where I grabbed each   screenshot so I can tap to go back to where I found them, and   buy that shirt. [ Cheers and Applause ]   The best thing about Pixel Screenshots is I don't have to   do anything differently. I just keep screenshotting   anything I want to remember. Pixel Screenshots is shipping   with all of our new Pixel 9 devices.  

And we're also working on some   new ways to be creative using AI >> KEKE PALMER: Alex, Alex,   Alex. >> ALEX SCHIFFHAUER: Oh, hey,   it's Keke Palmer! >> KEKE PALMER: Alex, I loved   the demo but lemme save you some trouble.   Give my new book to your fianc e My new book out this November,   pre-orders available now and whatever you do, don't get the   broccoli cut. That's two favors she owes me.  

To all of you at home, I hope you'll join me for the first   Made By Google After Party on YouTube.   No guest list, no wristbands, it's a VIP after party where   everybody's invited! It starts right after this, and   I'll see you there! >> ALEX SCHIFFHAUER: Thanks   Keke! Christine, if you're watching, I   think we just got our first wedding gift.   All right, back to AI on Pixel. We've got another first to show  

you. Every Pixel 9 phone ships with   the new Pixel Studio, a first-of-its-kind image   generator. It's powered by an on-device   diffusion model running on Tensor G4 and our Imagen 3   text-to-image model in the cloud.   So you can just type what you want to create.   Perfect example, a funky party invite.   Our co-worker Tejas is moving back to San Francisco and   finally getting his own place. And nothing says Welcome Back to  

California like a party at the firepits at Ocean Beach.   Watch how easy it is to whip up an invite, I'll make one live   right now.   I'll just tap Create and start with a simple prompt, beach   bonfire pit at sunset. We've made Pixel Studio fast,   not much waiting here. As you can see.   That looks pretty good, now let's make it quintessential San   Francisco and add the Golden Gate Bridge.   Let's see what Pixel Studio comes back with.  

I want this to feel like a party, and Pixel Studio lets me   get creative. What if I added some fireworks   in the sky? Let's see what that looks   like... Nice, now I want it to feel more   like an invite instead of a photo.   If I tap the Style button, I can quickly change how the image   looks. Why don't we try a cartoon?   It'll just take a moment like changing your prompt would.  

Changing your style is quick, easy... and honestly pretty fun.   It's not what I'm looking for. What if I made it look like a   retro video game? Really cool.   And if I want to change the composition, I don't need to   change my prompt. I can just hit the refresh   button to get a new version. Nice.   That looks so good. Now, in Pixel Studio you can  

also make stickers from your images, and I already have a few   of Tejas so I'll just throw them right in here.   [ Laughter ] I think a giant Tejas head is   kind of hilarious let's put it right near the fireworks.   And I've got a few more stickers of him why don't I put one   right near the bonfire? He looks a little lonely.   No worries, I was a second Tejas.   The only things missing are the party details.   Ocean Beach, Friday 7PM Ah, the font feels out of place,   So we can easily change it. Why don't we go take a look.  

This one looks retro and it will match the vibes pretty well.   Nice. Cool.   It took me just a moment to create the perfect invite, so   now I'll just copy and paste it into the group chat.   And by the way, with RCS coming to the iPhone, all my friends   will get the same high-quality image, no matter what phone   they're using. [ Cheers and Applause ]  

That's a lot of new AI helpfulness... the all-new Pixel   Weather App, Call Notes, Pixel Screenshots, and Pixel Studio   are shipping with our new Pixel 9 phones.   I'm so excited for you to try them!   And I'm also excited to hand the stage over to Shenaz and Kenny,   to take you through the magical new camera capabilities in Pixel   9. [ Cheers and Applause ]  

>> SHENAZ ZACK: The award-winning Pixel Camera is   the world's first AI-powered camera experience.   And Google continues to be the only mobile phone maker that   builds the entire camera, end-to-end.   So it can deliver new Pixel-exclusive features that   have never been possible before. >> KENNY SULAIMON: With Pixel 9,   upgrades across that entire system come together to make   every photo stunning, and to solve everyday camera challenges   for you. So now it's easier than ever to  

frame up a beautiful scene, capture it with incredible image   quality, and edit it to look just the way you want.   >> SHENAZ ZACK: Let's start with the image quality.   This year, we've rebuilt our signature HDR+ pipeline from the   ground up, taking what we've learned from Real Tone and over   nine years of building an amazing Pixel Camera.   So your photos and videos authentically reflect the world   around you, the way you see it with your own eyes.  

>> KENNY SULAIMON: Take this image for example.   We've made improvements across exposure, sharpness, detail,   contrast, tone mapping and white balance.   And the difference is remarkable, with more accurate   skin tones, texture, shadows, and even better Night Sight for   exquisite low-light shots. And we're bringing that same   HDR+ pipeline to Panorama. Panoramas are a staple in mobile  

photography, but they haven't really evolved in years.   We've rebuilt Pixel 9's Panorama mode, starting with the UI,   which now intuitively guides your hand.   Once you've captured the full scene, Pixel runs the photos   through the full image processing pipeline, for   gorgeous, incredibly detailed panoramas.   And by the way, the image processing includes Night Sight.   [ Cheers and Applause ] Pixel was the first phone with   Night Sight for your photos... The first to use it for video...  

And now Pixel is the first phone to use it for brilliant   low-light panoramas. [ Cheers and Applause ]   The quality is actually pretty wild.   Check out this panorama of the Tetons.  

And now check it out at night. And now check it out compared to   another smartphone camera. [ Cheers and Applause ]   Look at the detail, sharpness and color - it's amazing in a   sick panorama photo that goes all the way up to 50 megapixels   of resolution. >> SHENAZ ZACK: And here's   something we've all struggled with: Getting the perfect group   photo. We made group photos a lot   better last year with Best Take, which makes sure everyone looks   their best. But one of the biggest problems   with group photos is how to include the entire group   sometimes you end up taking a photo that you also want to be   in! The new Add Me fixes that, so   you can be included in your family vacation photos, or that   once-in-a-lifetime photo with your favorite athlete.  

We'll show you how it works with the Pixel 9 Pro, and with a   Pixel user who's a six-time NBA all-star...   Jimmy Butler. [ Cheers and Applause ]   Thank you for joining us on stage and for helping us demo   Add Me. Would you mind if we take a   picture with you? >> JIMMY BUTLER: Of course,   anything for you. >> SHENAZ ZACK: And don't box me  

out. >> KENNY   SULAIMON: Now I'm going to line up the photo and make   sure I leave some room for myself on the left hand side.   Perfect, you both look amazing. Okay, so it's a great shot, but   this is my one chance to get a photo with Mr. Buckets himself,   Jimmy Butler... >> SHENAZ ZACK: You can see the   augmented reality overlay that   guides my hand to make sure I take the photo and you can see   it's processed in one single shot.  

[ Cheers and Applause ] >> JIMMY BUTLER: You look great,   by the way. >> SHENAZ ZACK: Thanks for that.   So does Kenny. >> KENNY SULAIMON: Thanks for   being a good sport, Jimmy. Hope we see a lot more of you   here in the Golden State. >> JIMMY BUTLER: That's my cue.  

You're not going to get me in   trouble. >> KENNY SULAIMON: So as you   just saw with Add Me, you don't need to hand your phone to a   random bystander, try to get too close to each other and stretch   your arm, or be left out of the photo entirely.   All thanks to Add Me. >> SHENAZ ZACK: Add Me is  

available at launch on all of our Pixel 9 phones.   And now let me show you what we're doing with Pixel 9 Pro   Fold to solve the trickiest challenge in photography:   getting a fussy toddler to look at the camera and smile.   The new Made You Look is here to help!   Just turn it on and pick one of the fun, colorful visuals for   your outer screen each with its own personality and sounds   to get your child's attention on the camera.   Made You Look gets your baby smiling, so you can capture a   happy memory and that elusive perfect baby photo!   And if anyone can make your kid smile, it's Joy from Disney and   Pixar's Inside Out. She's coming to Made You Look in   an upcoming Pixel Feature Drop. I wish my parents had this when   I was a child. [ Laughter ]  

I wouldn't be that grumpy. >> KENNY SULAIMON: Pixel 9 Pro   Fold includes lots of other foldable camera features too.   You get Dual Screen Preview, which lets both you and your   subject see how the shot's going to turn out.   And Rear Camera Selfies, so every shot you take, is taken   with the best camera on your phone.   This year, we've also added Pro controls, with professional   camera features like shutter speed, manual focus, and more.  

When you match these experiences with the amazing image quality   from Pixel Camera, Pixel 9 Pro Fold is the best camera   available in a foldable form factor.   >> SHENAZ ZACK: We're also improving the accessibility of   Pixel Camera, across the entire Pixel 9 family.   With Guided Frame, people who have blindness or low-vision can   take great photos and selfies. Guided Frame now offers even   better face angle guidance, and lets you know when you might   need to improve your lighting. And it's now easier to enable,  

right from the Camera settings. >> KENNY SULAIMON: Now, Pixel   Camera isn't just about taking gorgeous photos and videos.   It also helps you with everything that happens after   you've got the photo, helping you perfect your image and make   it look just how you want it to look.   We started this journey three years ago with Magic Eraser, and   we're continuing it today with the evolved Magic Editor   experience, using generative AI. Let me open my Pixel 9 Pro Fold   and show you how it works... Thank you, Shenaz.  

Let's open up this bad boy. So this is a good image, but   it's a bit slanted. It could've been so much better,   if only I had more time to frame my subject.   This is where Auto frame in Magic Editor comes in.   It uses generative AI to help recompose my image, applying   photographic techniques like rule of thirds and golden   ratios. So right now, it's filling in   the blanks, and finding the perfect crop to reframe my   subject. Wow.  

That is awesome. Let's go with this one.   And it even recovered the piece of his shoe that got left out of   the initial photo.   Pretty great. [   Cheers and Applause ] I chose that one by clicking the   checkmark in the corner here. And just like that, I've  

transformed my first photo into a stunning landscape shot.   But we're not done yet, let's say I want to re-imagine the   photo entirely. I can just tap on the grass here   and I can simply type what I want to see.   What do you wanna see Shenaz? >> SHENAZ ZACK: How about   wildflowers? >> KENNY SULAIMON: Love that,   let's add some color to this photo.   I'll just type in wildflowers and, again, this is a live demo   of generative AI. We're all going to see these  

photos together. They're going to be great, I   promise you. >> SHENAZ ZACK: Definitely.   Still cooking. These are our colors.   >> KENNY SULAIMON: This one is awesome.  

I'm going to hit that check mark again.   This scene is looking pretty great now, but it still needs   something... Fun though right Shenaz?   >> SHENAZ ZACK: How about a hot air balloon?   >> KENNY SULAIMON: I love that idea, let's do it.   I have a few ways to select what I want to edit.   I can tap on an entire area, or if I want to get really precise,   I can zoom in for detailed edits.  

Now let's tap in hot air balloon.   Right now Gemini models are taking the prompt I typed in and   expanding it to include additional details and   information based on the scene and wow.   That's a little abstract. [ Laughter ]   There it is. Generative AI but I love this   one. This is my favorite.   Let's do that. And, again, just to show you the  

before and after, amazing. [ Cheers and Applause ]   It's never been easier to edit your images - just describe what   you want, and see your ideas come to life.   The evolved Magic Editor is available right out of the box   on all the new Pixel 9 phones. >> SHENAZ ZACK: All of our Pixel   9s also continue to push into new terrain for smartphone   video. Pixel's video continues to make   big leaps forward, thanks to a computational video technology   called Dual Exposure. In simple terms, it takes two  

exposures at the same time - one optimized for shadows and   another optimized for highlights - and combines them to use the   best of both, in real time. So you get sharper, less grainy   videos, even in challenging low-light scenarios.   It's the kind of computational videography you can get from a   Pixel that isn't even available on many modern SLRs and   mirrorless cameras. >> KENNY SULAIMON: And this   year, we're continuing to raise the baseline video quality   across the entire Pixel 9 family.   At the same time, we're adding new capabilities to Video Boost,   for our Pixel 9 Pro phones. It sets a new bar for mobile   video by combining Tensor and camera hardware on the device   with our full HDR+ pipeline in   the cloud. >> SHENAZ ZACK: We've improved  

Night Sight Video, so your low-light videos are even more   natural, brighter, and more detailed.   And we're moving Video Boost to Tensor Processing Units in the   cloud, so when you enable Video Boost, it will now render your   videos up to twice as fast. >> KENNY SULAIMON: When we   combine Video Boost, with the brand new, 5X telephoto camera   in Pixel 9 Pro, you can now shoot super high resolution zoom   videos, up to 20X. That can sound abstract, so let   me put it this way: You can crop in 5X... 10X...  

All the way up to 20X, without sacrificing any quality.   In fact, it has HDR+ across the zoom range.   And this is on every. Single. video frame.  

It's pretty dope, I can't lie. It's pretty good.   [ Cheers and Applause ] >> SHENAZ ZACK: We were at   Outside Lands Festival last Friday, and we caught an amazing   Performance from Rene Rapp.   When we apply video boost, look at the detail and the   lighting... And now we'll just zooooom back  

to where we were actually standing.   It's pretty magical. >> KENNY SULAIMON: And check   this out, we're also using generative AI and Video Boost   TPUs to upscale your videos to 8K resolution, even though   you're shooting 4K video. The quality and resolution are  

so high, you can even pull high quality 33 megapixel still   photos from any frame. That's huge for creators and   streamers, since you're now able to get high quality thumbnail   stills from any moment in your YouTube videos.   [ Cheers and Applause ] >> SHENAZ ZACK: All that to say,   Pixel is once again rated the best smartphone for photography.  

And today, we're excited to announce that Pixel 9 Pro with   Video Boost, has also been rated the smartphone with the   highest-quality video. [ Cheers and Applause ]   Pixel 9, Pixel 9 Pro, and Pixel 9 Pro Fold take smartphone   photography and video to completely new heights, just   like every Pixel before them. Now let's welcome Brian back to   the stage. [ Cheers and Applause ]   >> BRIAN RAKOWSKI: With an incredible range of   Pixel-exclusive features, and a bold and beautiful new look,   you're going to love this new lineup of Pixel devices.   We've got Pixel 9, the powerfully sophisticated Google   phone, with an unbelievable upgraded camera, supercharged   performance, and the latest AI features...   Like the new Gemini assistant, Add Me, Pixel Screenshots, Pixel   Studio, and so much more. Pixel 9 starts at $799.  

Pixel 9 Pro adds pro-level performance and speed with 16   gigabytes of RAM, meticulously crafted materials and finishes,   the brilliant Super Actua display, and the pro-grade   camera with the best video quality on a smartphone.   Pixel 9 Pro comes in two sizes, starting at $999.   And finally, the reimagined Pixel 9 Pro Fold.   It's thinner and lighter, with the largest display on a phone   and innovative features that you can only get on a foldable   phone. Pixel 9 Pro Fold   starts at $1,799.   The entire Pixel 9 family is available for preorder today in   the US, Japan, and Europe. Pixel 9 and Pixel 9 Pro XL begin  

shipping on August 22nd, with the rest of the phones starting   to ship in September. And we want to make sure our   most powerful phones have access to the latest and greatest   Gemini models and app features. So all three Pro phones come   with one year of Gemini Advanced and 2 terabytes of cloud   storage. [ Cheers and Applause ]  

It turns Pixel 9 Pro into a true generative AI powerhouse that's   miles ahead of any other phone on the market.   And of course, every Pixel 9 is going to keep getting better   over time, with a steady stream of new features with Pixel   Drops, and seven years of OS and security updates.   It's a different kind of phone, that could only be made by   Google. We hope you love it!   [ Applause ] >> SANDEEP WARAICH: Pixel Watch   has come so far in just two generations.  

It's now being worn by millions of people, who tell us they love   the special place it plays in improving their lives.   With Pixel Watch 3 we are bringing our best lineup yet.   It delivers our gorgeous, iconic design, for the first time ever,   in two sizes. We are introducing an all-new 45   millimeter size, that's perfect for people who want more from   their watch... It gives you 40% more display   and a 35% bigger battery. You also get our  

custom-designed, durable 3D coverglass and our brand new   Actua display - it's our most advanced and power-efficient   display. With up to 2000 nits of   brightness... It's twice as bright as before,   and it flexes all the way down to 1 nit in a dark room.   The smaller 41 millimeter uses the same Actua technology,   giving you 10% more display in the same compact size.   Pixel Watch 3 is also our deepest integration with Google   and Pixel yet. Your watch can now livestream   your Nest Camera and Doorbell, control your Pixel phone camera,   and act as your Google TV remote.  

You can use Google Maps, even when offline...   And take voice notes with the Recorder app.   And Pixel Call Assist continues to get better with the new Hold   a Minute. It answers for you and lets you   hold the call while you find a quiet place to talk.   It's an incredibly helpful smartwatch, but it's so much   more than that. With Fitbit's fitness and health   tracking built right in, Pixel Watch 3 is equally an advanced   personal health and fitness device.  

This year, we are introducing our most comprehensive fitness   experience yet including a whole host of features, to help   runners like me. A great running companion   shouldn't just track my runs. It should help me plan my   workout, guide me through it, and help me reflect on my   progress. The new workout builder helps me   run with a gameplan each day. I can build custom workouts, add  

intervals, set targets, and build tempo runs.   And with Fitbit Premium, Google AI does the legwork by   automatically building my daily run workouts...   Personalized just for me. During my run, I get real-time   guidance, letting me know when my warm up is over, when it's   time for my next interval, or when I'm behind pace, and need   to pick it up. And across everything you do   with your Pixel Watch 3, you're getting highly accurate heart   rate tracking, with continuous sampling not just during   workouts, but all day and all night.  

And now we're taking it a notch further, by tuning Pixel Watch   3's heart rate tracking specifically for running.   It's one of the toughest environments for heart-rate   sensing. Your heart rate can change   rapidly during your run, while your ground contact and arm   movement introduce motion and light artifacts.   Pixel Watch 3 accounts for exactly these challenges, to   deliver our most accurate Heart Rate tracking for running.  

Pixel Watch 3 even helps you improve your running form using   advanced motion sensing to track your running dynamics like step   cadence, vertical oscillation and stride length.   For instance, last month on my longer-distance runs, my cadence   dropped and my strides dragged longer as I lost steam.   Fitbit sensed it and shared that insight with me.   By correcting my form, I was able to lower the potential risk   of injury, and improve my pace and distance.  

Now, fitness isn't just about going all out on workouts.   It's also about balancing that intensity with my body's need   for recovery. To help find that balance, we're   introducing three new tools. First, an all-new Readiness  

Score that combines sleep, heart rate variability, and resting   heart rate to give me a holistic picture of how ready I am to   train. Second, a new metric called   Cardio Load that tracks my heart's exertion during my   workouts, and helps me understand if I am over or under   training. And third, a personalized daily   Target Load that combines my readiness and cardio load   metrics to guide me on how much intensity to take on each day.   And all these insights come together in the new Fitbit   Morning Brief along with weather, my sleep insights, and   how I'm tracking against my weekly exercise goals.  

It's delivered automatically to my Pixel Watch 3 each morning,   and it's awesome for someone like me, who wakes up at 6am to   go for a run. Well, more like 5am now that I'm   a parent. And you know, for those mornings   when running just isn't my jam, Fitbit Premium provides daily   picks, from a library of video workouts now with incredible   workout classes from Peloton. Now, along with helping with   your workouts, and your recovery, there's another   special role that a watch can play.  

With the power of real-time sensing, it can be a powerful   health and Safety guardian, and prompt life-saving action when   every second counts... Like a car crash, or a bad fall.   Today, I'm excited to share a pioneering innovation, a   first-of-its kind capability, called Loss of Pulse Detection.   Take a look. >> VIDEO: I think the average  

person doesn't think about their pulse.   It's something that we take for granted.   The phrase "loss of pulse" is one that many people may not   have heard of, but a loss of pulse event could really happen   to anyone. >> Loss of pulse is a health  

emergency when the heart is not beating in a life-sustaining   fashion. We have all of this   infrastructure in place to get people help as quickly as   possible, but it's all predicated on the idea that   someone will be there to make a call to emergency medical   services on your behalf, but we know that more than half the   time, people experience these events with no one around and   they are virtually unsurvivable if you don't have someone to   help. So, we've built a Loss of Pulse   Detection feature for the Pixel Watch that is the first of its   kind. It can detect if someone has   lost their pulse, is nonresponsive, and can make a   call to emergency medical services where key information   is provided, like the location of where the user is so they can   get help as quickly as possible. >> A loss of pulse event is  

really a time-critical emergency.   The feature is specifically looking for a pulse, but also   looking at physiological and motion data and then tying these   together in a really smart algorithm driven by AI that

2024-08-14

Show video