Google Cloud Next—Day 1 livestream

[Music] [Music] [Music] [Music] [Music] [Music] uh [Music] [Music] [Music] [Music] you [Music] [Music] so [Music] so [Music] [Music] foreign [Music] so [Music] do [Music] [Music] this [Music] do [Music] [Music] do [Music] do [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] do [Music] [Music] [Music] [Music] do [Music] [Music] do [Music] [Applause] [Music] so [Music] [Applause] [Music] [Music] [Music] [Music] [Music] [Music] so [Music] [Music] so [Music] [Music] [Music] [Music] [Music] do [Music] so [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] foreign [Music] um [Music] uh [Music] ah me [Applause] [Music] bye [Music] bye [Music] [Applause] [Music] [Applause] [Music] so [Music] you [Music] hmm so [Music] [Music] [Music] do [Music] [Music] do [Music] [Music] roundhouse my [Music] [Music] do [Music] do [Music] [Music] [Music] [Music] so [Music] do [Music] do [Music] [Music] do [Music] [Music] so [Music] [Music] [Music] [Music] so [Music] [Music] [Music] [Music] [Music] i need you to put him on his mark we're literally going to throw it in hey there we are about six minutes from the kickoff of google cloud next and i'm glad you're here i'm jonathan sham coming to you live from our sunnyvale campus with a few of my cloud next colleagues over the next three days you'll have complete access to our keynotes demos q and a's and sessions where you can engage with our google experts live and when you can't be with us in real time customize your on demand playlist to watch your favorite content anytime anywhere in the next few minutes we're going to share some of our google cloud partner and customer award winners and you'll meet a few of our sponsors who created video introductions just for you first up check out how accenture combines its industry expertise with google cloud's technology to deliver transformation at scale disruption is here ever changing customer demands technologies climate thriving requires a compelling vision for the future an innovative mindset and deep competency to deliver true partnership brings these elements together this is why accenture formed agb the accenture google cloud business group we tap into google's innovations in hybrid and multi-cloud platforms and accenture's vast industry knowledge we envision accelerate and transform industries and help get you to value faster it's award seasons around here and we want to recognize our partners who are on the front lines of digital innovation and driving exceptional results for customers today i'm excited to share the google cloud partner awards here are global winners in nine industry categories our reseller partner of the year do it international services partner of the year deloitte in the industry solutions category capgemini the breakthrough award tcs and expansion wix our technology partner of the year palo alto networks our public sector deloitte and diversity equity and inclusion partner of the year go pomelo and finally our social impact partner of the year award goes to atos to see all of our winners are recognized across regions check out our website congratulations to our global winners and big thank you to all our google cloud partners that are enabling and accelerating cloud transformation for our customers every day next up meet atos maven waif a leading google cloud digital transformation partner with more than 11 partner specializations and a four-time google services partner of the year award winner most recently the company was named global social impact partner of the year here's more in the digital first world innovation has no limits seamless digital transformation that modernizes business hybrid work environments for on-demand collaboration and cloud integration that optimizes workflow the fastest smoothest path to digital transformation engineered by google cloud made easier by maven wave and autos and now i'm thrilled to announce the inaugural google cloud customer awards these awards recognize customers that innovate and create industry-leading solutions and exceptional customer experiences with google cloud there are some truly outstanding success stories impacting our world in countless ways which is why it's my honor to present to you our customer award winners of 2021 in the following categories social impact diversity equity and inclusion cross industry we had multiple winners in this category retail again lots of winners in this category as well manufacturing communications and service providers moving on to financial services again many winners in financial services gaming health care and life sciences media and entertainment government and our final customer award in the category of education congratulations to all our winners google cloud is proud to be part of your story and finally we want to thank all our sponsors for being great partners and continuing to support us including deloitte our four-time global services partner of the year winner here's how deloitte can help with your digital transformation journey foreign thanks for watching our cloud next 21 pre-show we'd like to thank our sponsors accenture atos maven wave and deloitte thanks to our partners and our customers and congratulations to all our award winners we hope you enjoy the next three days of next and be sure to build your custom playlist share it on social and join the conversation on twitter and linkedin with google cloud next now stay right here the live keynote is about to begin [Music] so [Music] hi everyone i'm alison wagenfeld with google cloud welcome to google cloud next and thank you to our google orchestra composed of bay area googlers we are coming to you live from our google thomas currien we have an incredible lineup over the next three days with live keynotes demos and q a with our leadership in over 140 sessions covering all our cloud solutions our customers and partners will share how they're using google cloud in google workspace technology to tackle their greatest challenges and opportunities we are humbled to support their work and share their stories thank you for being here with us and now please join me in welcoming google and alphabet ceo sundar pichai hi everyone welcome to google cloud next 2021 we are happy you're here of course i'd be happier if he could actually be here in person don't get me wrong thomas is great company but he still doesn't laugh at my container jokes so while many of us are still waiting for a return to normal it does feel like we are on our way the question is will we recognize normal when we get there the pandemic has sped up digitization in all aspects of our lives it's changed how we visit a doctor how our kids learn in school and how we connect with one another and it's made the future of work our present giving us renewed opportunity to transform our organizations from our work with customers thomas and i have learned there are three things that position us to be most helpful to businesses first our cloud platform it's designed to help enterprises transform through digitization built on the deep investments we've made in technical infrastructure over the past 23 years looking at our networking and data center investments alone we have the largest network with the lowest latency of any cloud provider with our expansions into warsaw delhi melbourne and toronto this year we now have 28 regions with plans for 10 more and it's all connected by 19 subsea cables a grace opera transatlantic cable will be the first to incorporate novel optical fiber switching second our enterprise customers benefit from our consumer scale and innovation we have a deep and broad consumer ecosystem of devices and services youtube connects a global community of viewers and creators android nest assistant and maps are loved by people around the world we have the unique ability to connect consumer ecosystems with enterprise ecosystems for example the realistic voices in language understanding that powers google assistant can improve enterprise customer experiences and increase satisfaction and the underlying visual technology that enables google lens to help people shop or learn about a new flower in their garden can help manufacturers identify defects third we offer comprehensive security that helps organizations including ours protect what matters security is foundational to everything we do we have a long history of building it into every layer of the computing environment we are a pioneer of zero trust computing and have deep experience running this model at scale on its own any one of these pillars would be helpful to customers put together they can be transformative which is the mission of google cloud we continue to drive innovation through our products over the past year we have had more than 1500 product and feature releases that's about four a day they're all designed to be helpful from smart canvas in google workspace that makes collaboration richer to new ai powered industry solutions and bigquery omni for data analytics across any cloud we've also made significant partnership announcements for example we teamed up with global telecom leaders such as ericsson nokia and t-systems to deliver 5g edge and hosted computing solutions what i'm most excited about is how our strengths in cloud consumer and security are helping top enterprises accelerate their transformation ford chose google as their transformation partner because of our strength in consumer and cloud together we are innovating in electrification connectivity and self-driving technologies ford is harnessing google maps to help drivers navigate google assistant to help drivers concentrate on google play to keep passengers learning and entertain l'oreal partnered across google to build a virtual try on experience they are harnessing the best ai models as well as using youtube to build a community of fans and google shopping to make it easy to discover and buy their products we are humble that so many organizations continue to put their trust in google cloud and we are committed to helping you solve the biggest challenges you face i'll be back a little later to talk more about how we do that but first i'll turn the stage over to thomas korean ceo of google cloud to talk more about our mission thank you sundar hello everyone it's a pleasure to be here on google's silicon valley campus today for the moment we all look forward to all year long the opportunity to connect with you our customers partners and developers and to share all the amazing exciting stuff we've been working on a special thank you to all our sponsors especially our luminary sponsors accenture atos maven wave and deloitte let's first hear from some of our customers about the amazing ways in which they have accelerated transformation with google cloud [Music] the pandemic really did accelerate the digital wave of change by easily three to five years we transitioned to all virtual care we're better positioned to accelerate fast forward to today we have a truly profound permanent structural transformation now our team can look at hundreds of calls in minutes instead of weeks our business has really been transformed with the help of google cloud we have spikes in demand we can scale four times in less than five minutes schrodinger is transforming the way scientists are developing drugs chemical space is almost infinite we can do things we couldn't do before can't i just track by shipment we think that we can help solve that for the supply chain how can we help workers with artificial intelligence suddenly lots of ideas become interesting we're very excited to develop our artificial intelligence and machine learning access to innovation the speed of innovation seconds milliseconds all matter we're rethinking routine and pioneering simplicity the partnership with google cloud provides us with technology that will drive us to be better [Music] now it's not a secret that many of the biggest and most innovative technology companies leaders such as spotify twitter shopify mikado libre sharechat dapper labs and so many other exciting startups and tech leaders choose google cloud to help them build scale and innovate still other customers are transforming using our purpose-built industry solutions the home depot for instance use contact center ai to reduce customer resolution time by 91 million minutes procter gamble creates personalized omni-channel journeys from over 275 million consumer records ikea retail used recommendations ai to increase e-commerce click-through rates by 30 percent and increase order value by 2 percent fih a foxconn company used visual inspection to identify defects 10 times more accurately mr cooper a leading mortgage services provider used document ai to process mortgage documents 400 percent more efficiently and bank of new york mellon developed a liquidity solution that predicts nearly 40 percent of security settlement failures with 90 percent accuracy we're helping many businesses drive durable innovation through long-term partnerships with google's transformation cloud now to help them transform we focus on five key themes one are we the best at understanding and using data in an industry two do we have the industry's leading technology infrastructure three are we creating the best hybrid workplace for our passionate and talented employees four do we know that our data systems and users are secure now and that they will be secure in the future and five are we working together to address the most important challenges facing our world today we help organizations address these important questions let's start with the first question are we the best at understanding and using data in an industry we help organizations unify their data across multiple clouds and silos combining structured and unstructured data and making data every employee's super power using data analytics and ai together schrodinger accelerated clinical drug discovery by 60 percent finding new breakthroughs faster like many states around the united states the wisconsin department of workforce development confronted a wave of new unemployment claims using google's data cloud they clear over 750 000 unemployment claims reducing claim times from weeks to just days and dispersing over 2 billion in unemployment benefits walmart is transforming the experience for the approximately 220 million shoppers around the globe who visit a walmart store club or e-commerce website each week i'm honored today to welcome suresh kumar executive vice president walmart's global chief technology officer and chief development officer hi thomas and hello everyone i'm excited to be here today to share about how we at walmart are innovating on behalf of our customers our associates and the role that our partners like you google have played in our innovation journey now i came to walmart at a time of incredible digital transformation and jointly with my team created a robust execution plan to accelerate the transformation across three areas building great customer experiences optimizing our business and modernizing our platform and our infrastructure each of these three priorities are individually important but when you bring them together at the scale of a business like walmart it has a massive impact if you move with speed you can completely transform global operations and disrupt entire industries some of our most data intensive or critical decisioning process are getting the bigquery treatment through this not only are we seeing significant savings that will continue as we migrate more and more data over we are also seeing the ability to use the data in interesting ways including enabling analytics at scale and turning data into actionable insights from a data migration to bigquery standpoint 97 percent of the tables used for data vectors have already migrated to the cloud and 30 of the big data have been migrated with plans to almost double that by the end of this fiscal year and the cherry on the top is that bigquery has allowed us to integrate with pretty much any data visualization tool and analytics tool that's out there thereby improving our processing time by 23 and of course needless to say a much better user experience using bigquery has had a direct impact on our business an excellent example is our ability to close our financial books in three days instead of five days and that's a pretty big deal leveraging our cloud has enabled us to unleash the potential of ai across our entire business this goes from predicting demand to managing in-stock levels to optimizing supply chain to freeing up time for our associates to serve our customers as one example express delivery which is our two hour delivery service which we launched last year actively uses ai behind the scenes as the customer is creating that order multiple algorithms work in unison to optimize the delivery route and determine if the customer is eligible for express delivery we are building our own ai and ml capabilities to power multiple areas of our business including classification natural language processing forecasting regression computer vision predictions process automations and a whole lot more so to wrap up i'm really excited about the opportunity walmart has to drive innovation and to further disrupt the retail industry i hope you will agree that our work together is making a huge difference for our customers and our associates thank you for having me thank you suresh you know tens of thousands of incredible organizations like walmart choose google's data cloud for four reasons first google's data cloud is the most complete and unified data and ai platform to help you manage every stage of the data lifecycle from running operational transactions to developing analytical applications we help customers unify data lakes and warehouses as data lake houses to reduce complexity and to combine structured and unstructured data built in data science and ai with support for mapreduce spark and presto enables continuous learning and experimentation and we support real time streaming that natively uses open source standards like beam and flink google's data cloud is also unmatched for speed scale security and reliability bigquery one of the most successful and beloved data warehouse solutions with its unique serverless approach during a typical week helps more than three thousand different organizations analyze more than two hundred petabytes of data and thousands of customers use data proc to run spark and hadoop clusters easily spanner a fully managed relational database with unlimited scale and multi-zone and multi-region consistency serves more than 1 billion requests per second and provides a 5 9 sla google data cloud's vertex ai offers the ai pioneered at google research and deep mind so that every data scientist and ml engineer can now build deploy and scale ai models faster and with 80 percent less code using ai the same way google does for instance ge appliances an appliance manufacturing leader for more than a century is using google cloud including ai the edge to build innovative digital products with over-the-air updates finally google's data cloud is more open standards based you can choose from postgres mysql redis mongodb or migrate from oracle or sql server and we have strategic partners with leading data driven applications for instance c3ai has made its entire lineup of ai-based applications available on google cloud our customers can analyze govern and visualize data from many databases and storage system on google or other clouds including all of google's databases google sheets and bigquery using looker our premiere bi and embedded analytics solution you know today we're thrilled and excited to announce that we'll be integrating tableau a leader in data visualization with looker google sheets and bigquery tableau customers will soon be able to use looker's semantic model enabling new levels of data governance and access to data let's take a look at this alex over to you thank you thomas in this demo we're going to show you how you can seamlessly use looker and tableau together to answer your critical business questions let's say i work at an e-commerce company and our looker model provides a consistent view across the organization for our most important business metrics here for example you can see the definition for gross margin our looker dashboard is based on that same semantic model since it provides trusted insights at a glance i can immediately see that sales are up however did i miss anything let's find out say i'm more comfortable working in spreadsheets i can now take advantage of the new integration between looker and google sheets with a couple of clicks i have access to my governed and trusted looker data in sheets and i can easily connect to my data models to understand which factors are impacting sales i'll drag and drop fields from my model into a pivot table to break out sales by category over time since it's pulling from looker i can trust that all the data definitions are consistent i can use familiar sheets formulas and formatting to get insights faster and understand how specific products are selling we see a notable downward trend month over month for activewear i want to share these findings with my marketing team who's using tableau now i can use the new tableau and looker integration to combine data for my looker data model with marketing data to build a more comprehensive view of my business next i'm going to plot sales by category and then add marketing spend to the view tableau makes it easy for me to drill down on relevant data now i can see that social marketing spend was significantly lower for activewear and this is why there's a downward trend in activewear sales i'm going to publish this result on tableau online and tag my marketing team so they can take action leveraging integrations between tableau sheets and looker allows our teams to build powerful visualizations using trusted data we can then share these visualizations throughout our organization to drive informed decisions action and impact back over to you thomas thank you alex the second questions customers ask do we have industry leading technology infrastructure we're experiencing great momentum with our open infrastructure cloud many of the most demanding and technically advanced customers in the world disproportionately choose us take for example leading media companies and streaming services such as univision and global the largest media group in latin america they use our high performance networking computing and storage to broadcast media including live events such as the recent tokyo olympics leading telecommunications companies are also choosing google cloud reliance geo the world's second largest mobile carrier is automating its 5g network vodafone is processing over a billion network events each day at t is delivering new multi-access edge computing solutions and telus is migrating critical i.t and network workloads all to google cloud you know leading data management companies including data bricks redis cockroach labs couch base elastic influx data mariadb mongodb neo4j and single store are all growing faster on google cloud than on any other cloud and they love our storage scalability and advanced infrastructure mongodb for instance has more net new customers via google cloud marketplace than on any other cloud leading cyber security companies such as palo alto networks fy shape splunk broadcom and forgerock are also choosing google cloud for its performance global scale and underlying security customers are migrating and transforming sap and vmware workloads to google cloud in just the last year we've added three times the number of sap customers as the prior year and we're exhilarating paypal for instance has an sap hana scale out system supporting 40 million business transactions daily 200 billion records touched in just 30 seconds mitel in canada migrated over 1 000 vmware virtual machines in less than 90 days to google cloud vmware engine nilas an api platform company chose our tile virtual machines along with google kubernetes engine as they saw over 40 percent better price performance than in a competitor you know customers choose our open cloud infrastructure for three main reasons first we make your path to migrate and modernize using cloud easy with migration tools new serverless and container capabilities and managed services as your developers spend more time building experiences that your customers love second we offer transformative capabilities with cutting edge performance and security and our network offers three times the throughput of other cloud providers third we remain and were the very first and only cloud provider with a clear multi-cloud strategy we provide you with a consistent developer experience built an open source to write once and deploy anywhere many customers like plaid a financial services leader use antos to deploy operate and manage applications across multiple clouds recently we introduced anthos for virtual machines standardizing the way that you manage applications across both virtual machines and containers for multi-cloud data bigquery omni lets customers analyze data across google cloud aws and azure with it johnson johnson for instance was able to combine data in google cloud and aws s3 using bigquery omni without needing to migrate data customers also want to expand where they use google cloud whether in their private data centers or out on the edge for instance some workloads cannot move to the public cloud entirely due to the need for large amounts of local data processing extremely low latency or strict regulations to solve these challenges we're announcing today google distributed cloud a portfolio of hardware and software solutions that extend our infrastructure to the edge and even into your own data center to tell you more about it please welcome inez from our google cloud distributed cloud team thank you thomas google distributed cloud is a set of fully managed services running on google managed hardware based on open apis and built on antos it gives customers greater deployment flexibility and ensures more consistent operations across hybrid and multi-cloud environments more than any other cloud provider there are four deployment scenarios depending on your specific needs google's network edge this allows customers to leverage over 140 network x locations around the world operator ads this scenario is designed to accommodate emerging services and applications with a stringent latency and reliability requirements for a specific operator customer ads this scenario supports customer owned edge locations such as retail stores factory floors or branch offices which require localized compute and processing and finally customer data centers this deployment option is specific to customer owned data centers and color facilities google distributed cloud also includes a hosted mode to run sensitive workloads and address data sovereignty security and privacy requirements it does not require connectivity to google cloud at any time to manage infrastructure services apis or tooling you have the choice to manage it yourself or host through a designated trusted partner back to you thomas thank you ines partners like hpe dell cisco and netapp are key as we deploy google distributed cloud globally on best-in-class hardware i am pleased to announce the expansion of our partnership with network appliance in two important ways first netapp is our primary partner supporting google's distributed cloud storage infrastructure second for customers using google cloud vmware engine they now have preview access for netapp cloud volumes we are the only hyperscaler to provide customers with this choice deep partnerships with t systems and tolus have also enabled us to address the evolving sovereignty requirements for cloud technology in germany and france the next question we hear is how can we provide the best environment to help employees create and innovate together especially in a hybrid workplace you know hybrid is redefining how we all work making it less about where we work but more about the quality of our experience studies estimate that more than 48 of employees will work remotely post covet google workspace is the best platform for hybrid work with simple powerful and secure tools to help people communicate and collaborate with one another no matter where they are we introduce smart canvas to help content creators remove friction from workflows and enable teams to stay connected outside of meetings to foster well-being and reduce video call fatigue we made communication and collaboration completely seamless for instance users can easily present and collaborate in meetings create meeting notes from the calendar present and meet directly from doc sheets or slides and collaborate directly from chat and spaces we optimize collaboration from all mobile devices to provide great experiences for frontline workers who make up eighty percent of the global workforce one of america's largest hospital systems common spirit health is advancing its mission during the pandemic by making its frontline doctors and nurses productive with google workspace since hybrid work has removed the notion of a physical location for work google workspace created spaces a unified digital location for work today more than 3 billion users move securely and seamlessly between mail chat audio video and now spaces and you too can choose among the over 5 300 public apps in our marketplace and you can also add thousands of private apps to enhance your workspace now i want to step aside for just a minute and tell you about a hidden secret in our portfolio products app sheet our no-code platform that makes it easy for everyone not just professional developers to build amazing apps and workflows for instance property managers at car 4 properties used app sheet to build a mobile app to log track and resolve problems with headquarters replacing a multi-step manual process we're also partnering with citrix because employees sometimes need access to windows and mac os applications and desktops directly served from the cloud we're expanding our partnership with citrix today to deliver an integrated desktop as a service solution purpose built on google cloud now customers ask us do we know that our data systems and users are secure and how do we keep them secure in the future you know as more digital users access more data from more locations the risk of cyber security breaches is exhilarating by pioneering new approaches to security google keeps more people safe online than anyone else in the world take for instance jetblue it's keeping its system secure protecting the data of all its travelers and modernizing its security operations using chronicle to detect threats across petabytes of security telemetry eliminating data blind spots commence bank one of germany's largest banks is using our new certificate authority service to verify machine and workload identity improving security simplifying operations eliminating entire classes of threats secure by default drives customers to choose google cloud first we've implemented zero trust at the core of our services and our operations enabling you to trust nothing second we've built cloud scale threat detection and response allowing you to detect everything and third we know it's not just about tools we provide the advisory services you need to transform security operations we keep customers safe with beyond corp enterprise which enables zero trust access for all your users today we're expanding beyond corp to all your applications modern and legacy web and desktop and even to production environments we keep customers safe by eliminating software supply chain vulnerabilities over the past two decades we pioneered an approach to secure our own software supply chain we are now making that technology available through the salsa open source framework and as managed services on our cloud to help you secure your own software supply chain we keep customers safe by integrating chronicles threat detection capability with our security command center allowing you to respond faster to potential risks and we keep customers safe by bringing our security expertise to you with our google cyber security action team a team of our leading security experts who can help shape your security transformation from your very first implementation through responding to a major incident and engineering new solutions as needs change finally we continue to expand our security ecosystem with companies like fortinet palo alto networks tallest and so many more today i'd like to welcome a new security partner cyber reason with whom we are collaborating to deliver a new extended detection and response offering that will combine chronicles capability with cyber reasons mallops engine for faster easier threat detection and response our products our new cyber security action team and our partnerships all make the world safer from cyber threats to talk more about how we help keep each and every one of you secure and how we're addressing some of the most important challenges facing our world i'd like to invite sundar back thank you thank you thomas security is top of mind for businesses of all sizes as well as the public sector and despite the progress that has been made in cyber security large-scale breaches continue to make headlines that's why in august google announced we'll invest 10 billion dollars over the next five years to strengthen cyber security that includes expanding zero trust programs helping secure the software supply chain and enhancing open source security a new challenge is keeping collaboration secure and private as we move to hybrid work environments to help we are introducing a new work safer program it provides the highest level of security for your email meetings messaging and more and brings together google workspace with tight and security keys beyond corp and other secure technologies products and partners now every kind of organization and business can access the same security protections that make work safer at google security is an issue that affects us all and this brings us to the last question thomas posed are we addressing the most important challenges facing our world climate change is one of the most profound challenges we face it'll take all of us working together to solve it sustainability has been a core value for us for more than two decades google has been carbon neutral since 2007 and we've matched our operations with hundred percent renewable energy over four consecutive years last year we set out to make our third decade of climate action our biggest yet that included a bold commitment to operate on 24 7 carbon free energy across our offices and data centers by 2030 and last week we announced new ways we are helping one billion people make more sustainable when it comes to enterprises one of the most important sustainability choices is where to run your technology idc predicts cloud migrations over the next four years could reduce carbon emissions by over 1 billion metric tons or the equivalent of removing 200 million cars off the road for a year we are proud that google cloud is the cleanest cloud in the industry earlier this year we introduced a way for customers to choose the cleanest regions to run their workloads today we are expanding our portfolio of solutions and partnerships to help reduce your carbon footprint first we are focused on giving you greater transparency around carbon emissions data we are announcing carbon footprint a new service to measure track and report the gross carbon emissions associated with your google cloud usage having this data at your fingertips is really important and we know that many customers track sustainability data in other places that's why i'm happy to announce that google cloud emission data will integrate directly into salesforce sustainability cloud we also want to give you the tools to act on the data so today we are introducing a new tool that will alert you when you have idle workloads and make recommendations to reduce carbon emissions it's all part of our goal to help make your cloud transformation secure and sustainable and solve for what's next so on behalf of thomas and myself let me thank you once again for trusting us to be a partner with you on this journey and we hope you enjoy the next three days thank you [Music] hello and welcome to our very first spotlight i hope you enjoyed the opening keynote for the next hour we will be diving into all things data i'm stephanie wong a developer advocate and i'm here with garrett kasbyr who leads database analytics and bi solutions at google cloud thanks stephanie i'm very excited to be here and to share with everyone what we have been working on the team thought we start on the light side of things here and start with a joke one of my favorite jokes actually so here it goes a secret query walks into a bar and approaches two tables and asks can i join you [Music] okay i guess we wrote a video instead [Music] innovation is a huge challenge in baseball the current mlb fan expects us to be relevant customers call us patients call us numbers call us and you can imagine a team that's just buried under the weight of thousands of call recordings we look at so much data everything you can imagine we analyze frankly we spend 70 percent of our time just trying to to capture it and trying to sift through it we're expecting to transfer around 300 to 400 petabytes to the cloud it's hard to even describe how big that is google cloud was very impressive to us it allowed us flexibility in storage and compute scaling google cloud provides us with technology that will drive us to be better now our team can look at hundreds of calls a day in minutes instead of weeks with google cloud we're going to be able to spend our time analyzing real time and using the data that we've been collecting we thought google cloud was the best partner for us i think this is very much going to be an open and evolving long-term relationship between google and twitter it's a perfect fit with google cloud as we go forward google's made it possible for us to reach exceptional customer experience in a way that hasn't been done before [Music] and welcome back so what are we solving for today this spotlight session is about how to leverage data as your most strategic business asset especially as you adapt to and anticipate change data has the power to transform stagnant businesses into profitable ones streamline operations to improve people's lives and identify areas of waste to radically reduce unnecessary spending it can be used to solve businesses and world problems both the simple ones and the ones that keep people up at night it has the potential to accelerate progress faster than a think tank or world summit and it's largely untapped as you learn more about google cloud capabilities and make progress on your data cloud journey you can unlock your own 10x mindset as external factors accelerate the pace of change never before have we faced this much uncertainty and now is the time when every company can turn data into an ability the reality today is that too many companies struggle to remove the barriers to turn data into intelligence this is exactly what we are seeing with our customers turning data into intelligence and delivering value is no longer a nice to have it is essential a recent study shows that only 32 percent of the companies surveyed gain value from their data investments and this is the result of difficult to access slow unreliable complex and fragmented systems many companies just feel overwhelmed with the demand for the various types of working with data and of doing it at scale they feel walled in with a lack of integration a lack of openness a lack of portability and very poor apis it is time to reimagine our data cloud strategy that is unlocking your data advantage build great applications that understand and interact with your customer on operational databases that scale to billions of queries per second react on any event in real time and process millions of data streams analyze petabytes of data without sizing or tuning your data warehouse anymore and ultimately optimize your processes with hundreds of machine learning models in production this is how you unlock your data cloud and unlock your data advantage to build your data cloud you need your systems to be simple and this requires a partner that meets you where you are today and helps you to mature where you want to be but at your own pace making the complex simple is our business it has been for decades building systems that mask the complexity of the entire internet behind a simple single interface and building applications with billions of users it all runs on data and analytics so you can say the data is our dna and we can't predict the future but we can plan for it and we are deeply grateful to work with tens of thousands of organizations who build their data clouds on google cloud and unlock ultimately their data advantage from databases to analytics to streams to lakes to ai and build a unified data cloud together with us it's leaders like you who are accelerating their use of data to transform complexity into simplicity this week at next you'll hear from leading organizations that have chosen google cloud for their data cloud strategy over market alternatives verizon media is one of these customers verizon uses bigquery and looker to scale their massive enterprise media warehouse supporting monthly scans of more than one exabyte of data the performance improvements include 90 plus productivity improvements across the board and lower overall tco compared to other cloud providers almost overnight traffic to chess.com tripled the pandemic and successful series the queen's gambit created a perfect storm ten years worth of growth occurred in just six months and daily active users rose from 280 000 to more than 1 million there's no way to handle that search without the move to google cloud using bigquery's near infinite ability to scale in response to demand this meant that chess.com didn't have to forecast site traffic and worry about unexpected surges or waste money by over provisioning servers that go unused take autotrader it's uk's largest online automotive marketplace and they were able to migrate more than 60 of their current oracle footprint to cloud sql autotrader builds their data cloud by leveraging cloud sql bigquery and looker to deliver access to their data to all of their users and with cloud sql as a fully managed service all the greater release cadence has improved by over 130 percent year over year enabling an impressive peak of more than 450 releases to production on a single day and this is how you build your data advantage when cardinal health migrated to google cloud they enabled disaster recovery increased their ability to respond to business challenges and leveraged machine learning to drive business efficiencies all while reducing their costs by 25 percent we would like to welcome ray bajaj cto of cardinal health to share their data transformation story ray thank you so much for joining us here today thanks stephanie and i'm really happy to be here today cardinal health is a pioneer in healthcare industry for leveraging the cloud as our primary source of infrastructure achieving our cloud transformation journey goal with more than 80 percent of our workload fully migrated onto the cloud our journey to google cloud started in 2018 leveraging the security and flexibility of google cloud allows us to scale and innovate at lower cost which empowers our organization to focus on building the future of healthcare and driving better outcomes across the healthcare ecosystem so why google cloud with google we can deliver modern data insights capabilities to our engineering teams so that they can transform our core business while also improving the customer experience helping the organization evolve in the adjacent areas of healthcare we also selected google cloud because of its ability to partner with sap and run massive erp workloads reliably now what outcomes have you been able to realize as a result of this we leverage google's local and bigquery to develop episode analytics a data-driven predictive cost tracking tool that enables community oncology practices to accurately measure the cost of care and provides clearer insights into value based performance well ray cardinal is clearly at the forefront of these shifts and we can't wait to see what's in store for you so thank you so much for being here with us today thank you organizations like cardinal health are solving complex challenges with google cloud but what is holding others back from using data to accelerate innovation companies are looking for solutions that can simplify their data landscape to move from a state where every scenario requires a new tool to an agile platform that combines data analytics databases data engineering and science security and governance into a single platform to move from data at rest to a platform where data is accessible in real time our vision is to provide a platform that allows data to unfold its full potential ultimately enabling us to reach new horizons ranging from newly built digital experiences products and business models to advanced machine learning and ai to ultimately empowering humans to reason beyond their own biological capacity and we have built the industry's most simple intelligent and best integrated cloud data platform that enables businesses to fuel their own digital transformation and this is how you unlock your data advantage to seize new opportunities improve operational efficiencies and deliver new user experiences that delight customers partners and your employees thanks to you our customers and partners google's data platform is one of the fastest growing clouds fueled by the demand for products like big query and here comes the most exciting part today we are excited to announce a number of new product innovations and the first announcement goes out to all of the data engineers in the world who are using spark on google cloud open standards are at the heart of our data cloud strategy and at google we follow an open approach that enables flexibility and choice and today i am excited to announce project big spark it is the world's first auto scaling serverless spark service in existence and regardless of whether you are a big query user a data proc user our cloud ai user we have created an integrated ecosystem around spark the de facto standard for data engineering workloads we want to make it easy for you to onboard on our platform with spark and never limit your ambition with data science and data engineering our long history in the open source community has shown us that betting on the community first is always the right strategy to give our customers portability and optionality we're excited to make spark a first-class citizen on our platform and to automate the productionalization of your data engineering and data science workloads the next announcement goes to all of the data scientists as enterprises consolidate their data platforms the distinction between advanced analytics and data science and machine learning is really diminishing today more than ever data scientists are looking for unified interface to it to be able to seamlessly connect their entire data estate and also run all explorations with sql spark and other machine learning libraries with vertex ai we have simplified the experience for data scientists with 80 percent less code required to drain a model compared to any other platform as a part of google's vertex ai strategy i am happy to announce the preview of ai notebook for vertex ci that offers a fully managed scalable and enterprise great ide combined with easily enforceable policies and user management these ai notebook innovations are great examples of google bringing together the power of data and ai google truly aims to fast-track innovation by eliminating the need for data scientists to shift context between aspects like data analytics data science and machine learning that is right on and here is an exciting announcement to all of the developers we are adding a postgres interface for spanner which continues our commitment to openness and reinforces our efforts to democratize the access to spanner with this new postgres interface enterprises can take advantage of spanner's unmatched global scale five nines of availability and strong consistency using skills and tools from the popular postgres ecosystem and starting today you can create a spanner database that uses sql dialect and connect with its open wire protocol this interface supports banner's rich feature set using the most popular postgres data types and sql features and thus democratizing access to spanner for millions of developers out there our commitment to the ecosystem has been long standing with ongoing support for cloud sql for mysql postgres and sql server so you can lift and shift your databases our mission with cloud sql is compatibility and we were the first cloud provider to support postgres 13. these announcements are so exciting because postgres has emerged as a popular choice for operational databases postgres is known and loved for its stability and feature set and has built an active and growing ecosystem of developers and tools our investments in postgres are a step in the right direction to continue meeting developers where they are with the tools they love we are excited to announce new ways to help organizations going beyond traditional business intelligence to analyze access and act on data looker continues to integrate with the other offerings in our portfolio as well as continues to innovate with our core product and to address the needs we are continuing to simplify the experience across bigquery looker and data studio together with connected sheets today we are announcing new enhancements which bring the reality of augmented analytics to more people with looker solution for contact center ai to help businesses leverage ai and converse naturally with customers and deliver outstanding experiences we are also announcing a new looker block for healthcare nlp ai which creates a user interface to advanced ai in natural language functionality and this helps healthcare providers to gain deeper understandings of their patient data part of the secret sauce lies in lookers in database architecture and the semantic layer which makes it possible for business users to trust data no matter how they experience it via a dashboard email or text alert or even a custom application we are excited for these recent innovations but we couldn't do this alone together with our community of customers partners and developers we are delivering innovation across a variety of use cases we are able to create new solutions and accelerate your journey to transform data into value next i want to announce an important partnership with informatica we have partnered with informatica to help hundreds of customers succeed with their journey to the cloud together we are helping customers move mission critical workloads to the cloud and integrate with google cloud technologies such as bigquery today we are excited to announce that we are deepening our partnership with informatica even more first for existing informatica power center customers we are so pleased to announce our migration factory which will help to accelerate migration of data-driven workloads to google cloud with informatica cloud second we are pleased to announce our new services on google cloud's marketplace which will include informatica's integration and enterprise data catalog offerings and we are continuing to invest in key product integrations with data bricks our engineering and product teams continue to work together to deliver the joint roadmap and we have multiple customers using our latest enterprise security and performance enhancements of databricks on gke in q4 we will also deliver databrick sql databricks photon on google cloud as well as we are launching new data center regions together in emea and apec our ai teams are engaged to allow customers to experiment and develop models on data bricks and vertex ai together and deploy models at scale into production with vertex ml ops suite so much goodness okay before we get into the live demo i recommend tuning in to more sessions to hear from all our customers this week join the chief data officer panel discussion and listen to our product strategy sessions for database data analytics bi and ai we can't wait to hear from you connect with you join us in our community and share your expertise and ask you questions but most importantly start to build your data cloud and unlock your data advantage okay time now to get hands on and check out our products in real action join us for live demo and interact with our experts and one another and then stick around for the live q a following the demo i see you there [Music] [Music] do [Music] hi everybody i'm leah and i'm nikita and welcome to the data cloud live demo if you're just joining us from this morning's keynote and spotlight you heard some of the latest innovations we launched earth engine spark on google cloud postgres sql interface for spanner and vertex ai workbench all to help organization complex fragmented data systems and simplify them bringing together data on a massive scale to explore a real-world scenario for climate and supply chain analytics in order to do this we're going to need the whole data team say hi everyone hello i'm brad hi i'm derek now a quick reminder this demo is truly live and you can engage with us directly so ask questions say hi in the chat window and hit those emojis i think i see some coming in now i see lots of hearts and fire a lot of people saying hello in the chat thanks everyone for joining us today so if you can't see the or the chat just go back to the next event website and click on the blue join the interactive experience button okay hey you're actually joining us for our weekly stand up at symbol superstore a fictional us-based grocery chain focused on sourcing from local producers like many different industries we need to bring together disparate data sources to build resilience specifically for us drought in the western u.s has impacted

our producers and our supply chain has been disrupted with decreased shipments week over week we need to better understand how to manage inventory and to prevent stockouts and ensure we can scale in both how we analyze information and how we run our transactions all right team so to address the supply and scale challenges that nikita justin we have four different workloads first i'm going to evaluate the best climate information to identify at-risk producers then brad will mature our data pipelines to transform that data next derrick will dig into scaling our transaction processing and finally nikita will show how we're gaining new insights by evolving our data science capabilities let's get into it and let's keep hearing from all of you out there our data pros leah you're up first great thanks nikita so in order to gain insight into our supply chain first i need to evaluate the risks so i'm focusing on figuring out how drought impacts the very source of our grocery products and to do this i turned to google's platform for earth science data and analytics earth engine which has a huge catalog of satellite images for things like climate weather croplands and much more there's currently over like 50 petabytes of data in the catalog plus more and more images are added each day so let me just go ahead and bring up this cool little application that i built using the earth engine code editor so i can walk you through the three data sets we'll be using today first is going to be crop data from the usda nass program which i can grab right from the public data catalog by searching so this data set is going to contain one image of the us each year going back all the way to 1997. and each 10 meter pixel in this image has actually been assigned a crop type let me just close up the second data set that contains the outline of agricultural fields and we're going to use earth engine to assign each one of these fields the crop type that is most prevalent among the cells that cover it so in this view that i'm showing right here the pink fields are alfalfa and the dark green fields almonds leah these visuals are super super helpful but can we export this data for analysis in other environments yep i'm actually going to push this into cloud storage and bigquery in just a sec but first i want to add in some additional signals on drought so the third data set that i'm using is a collection of both short and long term drought indicators meaning that we can see what drought looks like for each field time now using data sets like these does require some deep subject matter expertise so special thanks to our real world partners at climate engine who build solutions on top of earth engines api helping organizations ground their analytics projects with scientifically accepted methodologies okay so you just saw how we use geospatial data and i want to know how you use it in your analysis so go ahead and answer that poll so we can see all right everyone so with these layers in place we can start exploring drought risk let me just go ahead and zoom to this field and here i'm going to show an almond orchard northeast of modesto california and what we're looking at is the long-term drought indicator so this orange tint that you're seeing means that this field has experienced pretty high levels of drought over the last five years now if i go ahead and just zoom out a bit we can actually see that the entire central valley in california is pretty drought stressed so my last step was to calculate drought risk for each of the fields i showed before and this will tell us which farms and produce types are potentially at risk for not meeting customer demand which is just one consideration to inform symbols resilience strategy better yet we can incorporate the geography data with other spatial stuff like store and customer locations that are already inside of bigquery and anyone who knows me knows that i love bigquery if you agree let me see in the emojis all right so the code editor has been great for interacting with earth engine but making these calculations at scale requires a different approach so i went ahead and created earth engine tasks for batch processing to run these calculations over all the data in five day increments for this 10 years i also set up a cloud function to run every five days going forward so that will always have fresh data now just as a quick recap we jumped into earth engine to evaluate earth science data that indicates climate risk for our farm fields now we'll have fresh drought data available in cloud storage so just think of the power of integrating huge amounts of specialized data giving us a complete picture of supply risk for our business oh and i think i can see the poll results coming in now it looks like lots of people are using geospatial data for all different kinds of things and if your answer wasn't in the poll just go ahead and let us know in the chat so next up brad will transform and push this data into bigquery for geospatial analysis with our existing data so brad over to you okay that was pretty cool leah thanks all right so to gain more insight into how drought is impacting production my main focus has been building out the data transformation pipeline to push farm field drought indicators from cloud storage into bigquery speaking of batch processing as you know to assist with inventory management price optimization and product assortment we use spark to standardize our large scale data processing and we use google cloud data proc as our long-running clusters for you data pros out there we'd love to know how you're using spark today so let us know while i go ahead and pull up the cloud console so here is a data proc cluster we currently use to schedule pi spark jobs cluster with some pi spar code this code is typical boilerplate code right to do basic data transformations in this case we are processing the earth engine files from cloud storage performing type checking and mapping to ensure proper ingestion into bigquery using the spark bigquery connector hey so this is pretty cool but i think having a batch workflow that's scheduled on a continuously running cluster seems like it can be kind of wasteful so is there any way we can make this more efficient that's a fair point leah there is still some overhead management here and for hardened batch cases like this it would be preferred to have these jobs run on their own discrete resources but good news with the new serverless option for dataproc we can submit a pi spark job without spinning up any infrastructure these auto magic capabilities i can spend more dev time writing code and less time on managing infrastructure all right brad first off i'm pretty sure that you just set me up for that and second you definitely made up that word automagic yeah can i get some emoji love for that anyway i'll now go ahead and export this notebook to a python file using nb convert okay and next let's go and use the cloud sdk to submit a serverless price mark job we can use the dataproc api and call batches to submit a serverless job so i'm showing you here a pi spark job but i can also submit spark jobs written in scala r or sql with auto provision and auto scale no infrastructure configuration is needed this helps with how powerful distributed data processing model with these capabilities there's no need to manually create in tune clusters so once i've submitted the just some long-term gap data and then some gps looking into a new solution for creating long-running clusters or a place where our infrastructure can manage dataproc clusters now fortunately we feel that spark on gke fits our use case and lets us utilize our existing gke infrastructure so clearly it's been a busy week for me using spark serverless to create pipelines to push drought data into bigquery but the efficiency improvements will gain by not needing to manage cluster overhead will be wor

2021-10-15 09:01

Other news