Lenovo Tech World 2024 Keynote | Smarter AI Innovates Faster in Every Industry (Afternoon Session)

oh [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] right [Music] oh [Music] h [Music] [Music] [Music] [Music] la [Music] let [Music] oh [Music] [Music] oh [Music] [Music] he [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] all [Music] w [Music] [Music] [Music] [Music] [Music] la [Music] [Music] la [Music] [Music] get [Music] let [Music] [Music] [Music] [Music] oh [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] [Music] all [Music] [Music] w [Music] no [Music] [Applause] [Music] [Music] please welcome to the stage Executive Vice President president of international sales organization Matt [Music] zalinski all right part two welcome back everyone as you already know I'm your host Matt and I spent a lot of time on the road connecting with as you may not know I'm your it Matt and I'm helping coders save time maybe he'll do it I'm legal assistant Matt and I'm reviewing your RFP in just a few seconds to make sure it meets legal standards so loyly hey there I'm automation Matt and I'm helping streamline your supply chain operations guys can you slow this thing down guys hi I'm marketing Matt and I'm creating thousands of personalized marketing collateral in a snap whoa how am I going to get out of here I'm customer service M and I'm making the complex crystal clear for customers can someone get that I'm busy hosting Tech world I'm manufacturing Matt and after analyzing millions of parameters I predict a critical failure in the next 3 weeks 2 hours and 22 minutes but you passed big guy you know that's like we thought we we thought we'd start off the second part of the show with one big long dad joke but we'll see let's get into it now look I spent a lot of time in the Road connecting with customers and partners worldwide and often choosing between events in Barcelona or meetings in Dubai but with our hybrid AI solutions that might soon be a thing of thing of the past but can AI run the show welcome back back to Tech World 2024 you know H okay you know I'm still on here I've honestly never been so irritated by so many versions of myself but you know boss if I I may get off the road for while and just send these guys in my place but look and that's really the power of AI hybrid AI Solutions like many like my Army of have these many am these many avatars here really put the expertise of thousands right at our fingertips you know to bring the many mats to life however we have to make sure they are not only connected to the right data but also know when and how to use it we need an intermediary an air traffic controller if you will that helps direct where the AI request should go and which data sources it should use should it go to our company's private AI Solutions should it use public data AI tools like chat GPT or even to my own personal aipc lenovo's new talk solution is built to do exactly that so let's do let's use itmat as an example and see new talk in action bear with me here you know for those of us who aren't as well versed in software development as my it Avatar it is worth noting that coding is extremely time intensive not because coding tasks themselves are difficult but because adding one feature requires hundreds of tasks in instead of dealing with all of these tasks all at once which would be for me probably my personal nightmare software developers could code in a series of programming blocks a set of tasks that become a story and a set of stories that become an epic and programming epics become the key features of the apps we use every day just designing these blocks can take days even before you put a team of developers on the stories themselves but with the right Integrations new talk can accelerate this process and automate which AI tools and data sources to use across public and private domains so let's use new Talk itself as an example and take a look at how we optimize its search function with large language models a feature technically called retrieval augmented generation or rag as many of us know it as and so let's uh add an expert coder into the mix Mah and do some prompting contrl V enter here we go an epics that one tookes hours that one took of hours or days will now take basically about a second as you can see with a let's see do I got it pulled up the right way I do thank goodness with a tool like new talk one developer can dramatically improve productivity and there's no substitute fort expertise but with the power of AI new talk vastly increases efficiency and puts human expertise on the tasks that matter most things like Vision strategic design and project Direction all with a simple solution that is running right now behind the scenes this instance of new talk is connected to multiple critic critical data sources both private and public one the J project management tool our developer teams rely on sort of the data track traffic controller two internal new talk project information propri to our business or the local research assistant third and finally external technical documents available in the public domain like blogs research papers reports or external research agent that's three agents in action all dedicated to fully integrating public and private data and improving productivity from it mat to manufacturing mat to every mat in between the avatars you just saw personify some of the solutions we plan to enable with a new talk something you can learn a heck of a lot more about with the team and our showcase experience but for now it is my privilege to introduce my friend and colleague to speak more about how Cutting Edge Loval Innovation is helping businesses accelerate outcomes in every industry just making sure I don't get interrupted by my nine brothers over here or look alikes without further Ado however please welcome my work brother and dear friend Vlad rosovich Vlad come on out buddy [Music] Matt how are you good to see you wonderful how are you good to see you good to see you I am amazed you know after seeing that video I know why you are in so many different places and I feel like you're on the road talking to customers all the time because there's multiple mats there really are I but you know I can I'm going to use a couple of those guys to make my life loser but you know what have a good show all right thanks can I can I get some of those mats later on too you bet you all right hey uh welcome everybody and welcome to the afternoon session I think this is really from my perspective this is the most exciting part of our business today when we start talking about the data center space The Cutting Edge Innovations like that new talk demo you just saw uh it's starting to bring hybrid AI to life and and with software like that that integrate AI uh in in in environments where you're starting to look at how do we safeguard that data how do we ensure that the security of that data is needed most uh what we are really doing is looking at how do we adopt generative AI starting to leverage private as y why mentioned this morning when you talk about personal and Enterprise private data is so important that leverage with the public data across an organization and like Matt I'm on the road all the time uh and if there's something that I've learned from talking to customers it's that when we're looking at what AI can do to bring to the Enterprise there's an excitement that all Enterprises are seeing but what we also notice is there's a lot of challenges behind what they face and first of all and most importantly we talk about the data the data the data security all the devices that Luca showed this morning the amount of data that's being generated from those devices is being created faster than ever before and in some Industries and I'll go into this a little bit more in detail later like the healthcare industry the privacy of that data that sub to compliancy and Regulatory constraints that's going to be the important part of how do we make sure we're leveraging all of this data for AI and that really becomes one of the big challenges that the industry is facing today second what we're seeing and we mentioned this earlier is the fact that sustainability and power consumption is top of mind for everyone when we look at things like reducing waste sustainable Computing AI Tech is requiring an ever increasing amount of power and the AI That's adopting this infrastructure is requiring even more efficient infrastructure Solutions that's going to help Enterprises achieve their sustainability goals and third and most important as I've gone off and talked to cios and CTO all around the world it's what's the ROI what is the ROI for AI and so it's this Roi and efficiency that the new part and and one of the things that we see is how do we make sure that when we look at the ROI it's making sure that you ensure that the deployment you have is scalable to the workloads that you're trying to create and it's how do you accelerate that AI deployment that is becoming a challenge of so many cios and CTO today and so let's start with the data that I mentioned I said you know it's coming from everywhere multiple sources so much of this data is unstructured it's siloed within different parts of the organization and the one thing we talk about is data sovereignty data gravity it's that location of the data that matters in high performance Computing deployments making sure that you have low latency in sovereign country deployments making s sure that you have that privacy and security so the questions that a lot of cios and CTO have is you know where is this data being created what is it needed for and where is the going to be afterwards and how do we make sure we keep it safe and secure and so today we see that powerful AI capabilities have started in the public Cloud you know everything that we have seen today really revolves around those large language models but what we're seeing is customers are also realizing that there's a need for that private cloud in their infrastructure and not only in the data center but also at the edge where much of that data is being created and what this creates it creates a hybrid approach and it needs and it calls for the right mix of private and public AI because that's going to be the important part of how we look at hybrid Cloud how do you make sure you you you take on that amazing power that the public Cloud gives you and how do you make sure it's secure and Sovereign and private in your infrastructure and so this is the approach to figure out how do we make sure we create that right solution for these gen gen workloads so at Lenovo I really do believe we are uniquely positioned uh to offer these solutions to the market around hybrid AI uh and and in many cases we are out there helping our customers talk about their AI strategy and what is that right mix that people are looking for for their business outcomes and their use cases and so when I look at this you know Lenova has done an amazing job in both Port portions of this market for instance in the public Cloud today Lenovo collaborates and helps power eight of the top 10 world's public cloud service providers it's with our unique odm plus capability that we engineer these unique custom design Solutions using technology that the hyperscalers and the csps are looking for and we manufacture that ourselves in Lenovo factories that are vertically integrated all around the world and so for private clouds and Edge this is where we deliver and really put time in making sure customers understand our secure approach to on Prem infrastructure and that we can control and customize these solutions to tailor what customers workloads are needed to ensure that that data stays private and and the reason for that privacy is is you know there's so many reasons there could be things like security compliancy latency data sovereignty and most important data gravity you know what's pulling all that data together so at Lenova we do offer this endtoend portfolio in fact we have over 80 products today that are AI optimized for our customers businesses and we're creating that Foundation that any Enterprise needs and as they're building out their future of AI we are going to consistently revolve around how do we improve that product portfolio we have so what what our customers are looking for for their business outcomes is something that we have and it could be from the smallest wallmounted Edge servers that we produce for things like Quick Serve retail uh that utilize things like specialized air filtration and quieter Acoustics and levels of security to Bringing Ai workloads and inferencing to some of these areas like uh retail self-checkout uh to computer Vision manufacturing deployments uh and for things like financial fraud detection especially in emerging countri Ries so you look at all that that we do on the small side all the way up to those large 8way llm optimized servers and in fact if you went out to the booth uh next door you actually would have seen a lot of the Lenovo portfolio around these large servers that are really looking at how do we how do we ensure that as llms are being developed that our Solutions are most optimized for training in this hybrid Cloud approach and so one of the things we're very proud of is over the last 10 years Lenovo has actually been named as the most reliable supplier in the IT industry today from a server perspective and so when we think about what's important here it's the fact that when we look at how do we have a leading industry storage and data management solution to make sure that as you create data as these devices create data as as these remote offices create data your data is structured it's accessible and it's secure and through our engineering collaboration our hybrid AI Factory is designing and deploying the next generation of AI Solutions all with some of the industry's fastest time to Market and you saw some of those players in the industry today uh with Lisa and Pat up on stage earlier uh talking about the Partnerships that we have and later with Nvidia and Jensen today you're going to see that those Partnerships are critical to lenovo's success on how we deliver on those business outcomes and to actually go more in depth on that layer of ecosystem that's required uh I want you to take a look at a video about some of those other hybrid AI solutions that Lenovo is engaged with today [Music] red hat and Lenovo have been longstanding Partners in delivering integrated hardware and software solutions to support the most demanding AI workloads across across hybrid Cloud environments new tanx and Lenovo make gen accessible to customers large and small we're BR in the next wave of applications and we can make our customers successful together n's AI part with Lenova think system servers is empowering organizations to harness the capabilities of AI and ensuring they can focus on gaining insights from their data [Music] I really want to thank some of those Partners like red and and and red hat and net app uh and nanic and it doesn't stop there there's a there's organizations that we work with like Microsoft and Cisco and so many others that are really bringing this hybrid AI Vision to life and it doesn't stop there one of the things Lenovo has done is we introduced something called our AI innovators program where we have worked with over 165 different AI vertically and horizontal isvs that are able to create solutions for what businesses are looking for and they're all available to deploy through our Global Professional Services and what that means it means that we are ready to make and manage and help you uh to manage AI when and where you need it most because the customers is what comes first and we think about it we look at this from an approach of what's needed in the classroom what's needed in the stores what's needed in the banks what's needed at manufacturing sites like Matt's manufacturing site when he was going on that conveyor belt you know those are the things and Healthcare organizations and Beyond those are some of the things that Lenovo looking at and so specifically to drill down into the healthc care side of of this uh it's my pleasure uh to welcome uh Banner Etna Executive Vice President and chief medical officer Dr Robert Groves to the [Music] stage Robert how are you I am well thank you it is absolutely wonderful to have you here today thank you for joining us thanks for inviting me so the first question I have is what is a chief medical officer actually doing at an IT event oh come on I me this is 2024 I can't think of a job that's not influenced by it uh this is not the time to put your head in the sand in fact the the role of Technology as we all know is continually increasing almost in every role in healthcare yeah so tell me a little bit about you know who is Banner Etna and and what what is is it that you do for the industry okay Banner Etna is is a partnership it it's truly Technic it's a joint venture uh between Banner Health and the ET insurance company and what we were formed to do was to improve care uh in our Market to make it faster better better care Better Health and uh lower cost obviously I mean that's something that we're all working on and uh we're constantly scanning The Horizon as a pilot site for both our parent companies to test out new technologies new strategies Etc and today we are using technology tools like large language models computer vision and of course data analytics you you know what's amazing is is when Robert and I were talking he told me in his in his past profession he was actually a critical care physician and I couldn't think of anything more important than having critical care for cios and CTO when they look at things like AI in the industry today and so one of the things that I I know Robert is is healthc care is complex when we start looking at the complexity due to data protection changing regulations where do you start as the C CMO to say this is where we need to focus yeah you know that's a great question and and data is foundational I mean it drives everything else and that's always been the case in healthcare um but in healthc care data is highly fragmented uh it's often poorly defined and as you mentioned it is highly regulated and highly sensitive so we need to have good strategies for data governance and and for data management but right now we are laser focused on a variety of projects at like uh for example revenue cycle prior authorization risk adjustment fraud detection ambient scribe Technologies diagnostic support and finally member engagement so there are a whole bunch of opportunities out there and so what we need referring to our last presentation is essentially a medical mat well we could all use a lot more mats but but one one of the things I see see Robert is everything you just mentioned there was a business outcome and and when we think about that business outcomes is really what this transformation of AI is all about so when you think about your your patient care and how you approach this what are some of the things that are critical for you well you know I love the idea of the hybrid model because it's very much the way healthc care works you go and see a general internist and then they need Specialists to fill out that knowledge Gap it's kind of like the uh the commander large language model and those individual models down below that that have special expert in a certain area uh and using those large and small language models seems to me to be the most efficient way to deliver uh you know what we're looking for and at bannera today and what we're starting with is for example computer vision so that x-rays can be pre- reviewed and the radiologist can come back and look at those that are actually critical because time is life in healthcare and so getting those x-rays red and the the uh having the doctor act on them very quickly is critical the other case that we're using is U ambient scribe technology we've all seen the doctor staring at their computer screen and typing when we're in there seeing them well ambient scribe technology allows them to get back to the business of creating that healing therapeutic relationship with their patients we also think that's critical to addressing physician burnout that's where they get meaning and purpose in their jobs and then finally we have uh something we call continuous remote care and what this does is we have patients with heart failure and they are constantly in contact with their physician they can send data 7 days a week they can contact their care team 7 days a week and using that technology and understanding where to focus our attention we've been able to reduce readmissions for heart failure significantly uh these are all active projects that we're working on today you know it's amazing everything you mentioned there is such a business outcome and honestly instead of having more mats I'd actually have I'd rather have more Roberts uh you know in this Marketplace um and so when we think about this there's so many use cases that actually start taking advantage of AI how did you decide which projects to work on First and what are you doing to make sure that we're helping accelerate those yeah yeah you know that's uh that's something we all Wrestle with but I you know it's my belief that we're just at the very beginning of our AI future I think there's going to be U you know some ShakeOut some consolidation in the industry like there was 25 years ago uh in information technology so I think we're going to see that happen and so one of the foundational principles for me is you got to pick partners that are both trustworthy and durable uh if you don't do that you don't know what you're uh going to align yourself with somebody who's not going to be here in 5 years so that's critical uh you know the most productive strategy in my mind is Partnerships and that's great because that's lenovo's DNA is Partnerships and bringing uh disparate expertise and disparate perspectives together whether it's you know care delivery or payment or technology having all those perspectives working on a problem with align incentives I think that's the way to choose what you work on First and we have such Partners in all of those projects I talked about and like you know Partners like Lenovo who help us move forward with confidence that they're going to be there and we're going to be there for the long term well I'll tell you I I think you've just nailed everything that we think about from a business relationship as well it's the collaboration it's the partnership it's listening to customers such as yourself on what do you need to help that business outcome uh and I'll tell you smart guys like you having you out there helping direct where AI is heading Dr Gro I couldn't be happier to be on stage with you today and we really want to thank you thank you Vlad it's been a real pleasure thank you sir all right so so as you just heard from Robert right AI starts with data but it doesn't end there when we look at the massive amount of computing and the massive amount of processing that's required it means that you're going to have a massive amount of power and that really focuses in on what's that emphasis on sustain ability and over a decade we mentioned it this morning Lenovo has been involved in leading the industry and we're proud to announce our sixth generation of Neptune liquid cool systems and we are reshaping the way water cooling and pushing the industry boundaries even further than they have before and we're doing it with Innovation we're doing it with engineering we're doing it with the highest accelerated Computing capacity available in a small form factor chassis that any size organization can use and when I think about it it's lenovo's Neptune warm water uh cooled system that's very unlike others in the marketplace today for instance one of the things we do is instead of having to chill the water before it goes into one of these racks you could actually use standard ambient water temperatures warm water and we use things like copper instead of PVC and if you haven't taken a look at it please take a look at it at the uh in in the Showcase next door because what we're after is how do you remove that heat because think about it if you could actually have water that comes out a 45° SE after it exits the system you could actually use things like repurposing techniques and we've seen this happen where people actually use that warm water that's now coming out of that server to be used to actually create heat environments for cold temperature uh uh Office Buildings or schools or or university sites and so you're actually having this use of this this reconciliation or reuse of that water and so one of the things I am so ploud proud to introduce today is our new think system n380 which you see behind me so the n380 it it really does it advances Neptune water cooling even more further and faster than we have before we've reimagined the engineering of what rack integration looks like for vertical Computing nodes optimized in spaces where total heat removal is most critical to these deployments and this infrastructure actually fits within less than one square meter which is really the size of your you know industry standard 19inch racks and what we're doing is we're pushing the boundaries of compact general purpose Computing you know this patented gamechanging approach we're redefining the way we look at water cooling in this approach we are at 100% heat removal for the first first time ever and it's through that advanced heat sink technology that we use that water loop design the highly reliable copper that we engineer into these systems the efficient and uh and productive aluminum coal plates uh that we put in the system and by using Neptune you can actually direct 30% more of your cooling energy now to compute and so now you actually have a situation where electricity is being used for what you need it most which is computer C and so when I think about it it's an open ecosystem it's an impeccable design that our Engineers have created uh and it's no wonder that lenovo's Neptune water cooling system has actually won multiple Awards some of which are crn's 2024 best green energy product of the year and the 2024 seal sustainable product Award winner because Lenovo Neptune liquid cooling is the most widely used cooling system in the industry today and it's synonymous with quality efficiency and most importantly The Innovation that our awesome Engineers actually put into it as enterpris adapt this new error of AI and they adopt this new a optimized infrastructure cost and risk is always top of mind and one of the things that we know is when we look at time to Value how do you actually get your return on investment this is the third point that I mentioned earlier you know capacity utilization of those AI Solutions how do they scale you know at Lenovo this is really what we mean by smarter AI for all and one way we do that is with our true scale initiative this is a unique pay as you go model it helps customers mitigate some of the capacity risks due to unknown circumstances or how fast their businesses are going to grow and for now what we have launched is our true scale GPU as a service and we're really helping custom customers realize a faster Roi for their AI projects with less risk for their business and so one of the things I am so proud to talk about today and you'll be hard to find a a a more impressive candidate um is is something that we have done with the mass open Cloud Alliance the Moc Alliance is a nonprofit Collective of universities government institutions organizations and businesses including Boston University which I am an alma moer of go terriers and and other universities such as Harvard North Eastern MIT uh University of Massachusetts and they're providing a national open production research Focus Cloud theoc needed reliable cost-effective solutions to scale its collaborative approach to research and they turned to Lenova for help and to talk a little bit more about this I want to welcome theoc strategic engagement coordinator John stump to the stage [Music] [Applause] [Music] John great great to have you thanks for having me you mind if we go sit down I've been I've been up here for a little bit so you know it was nice John and I actually went to dinner last night uh with Michael from UNC that you saw earlier and I'll tell you it was awesome to see the collaboration of two smart Minds talking about where this industry is heading so I thoroughly enjoyed that dinner last night John well hey first of all uh uh thanks for for joining me um so I I know a little bit about the mock because the Moc since I've I've been there uh but I'm I'm wondering if maybe you can kind of share a little bit with the with the audience a little bit more about the alliance sure we launched the Moc in 2013 with a vision to create a production cloud and that would better position our research Community to partner with industry and innovate together this Vision came to life as the Moc is now um been used by thousands of researchers and students and this uh it's become a laboratory for cloud research and Innovation that's yielded um hundreds of Publications and countless contributions to open source software now our cloud is hosted at the Massachusetts green high performance Computing Center which is a state-of-the-art 990,000 foot Intercollegiate Data Center and our member New England universities use it but now we've expanded this year to include a number of colleges and universities across North America and more to come yeah well and one of the things John that I see is that when you look at the compute capacity that you're giving a lot of these researchers professors scientists it really is it's something that um you know is is an area where many of these researchers wouldn't have been able to access that type of compute power uh as as they are today and so can you explain a little bit about how uh GPU as a service through our true scale product offering actually helped the Moc yeah so true scale GPU as a service has been a game changer for us you know we focused on large scale systems research that's what we do and the solution that you've provided allows us to attract the research that's focused on today that being large language models and other types of AI research you know such as Red Hats open shift AI they do their development and instruct lab now our first cluster as you know um was 64 A1 100s that was delivered earlier this year and is in production today and our second cluster arrived yesterday and right now we're unpacking it and getting ready to install it um over the next couple of weeks Y and those are on what product those are the h100s the 192 h100s so in short you know this true scale GPU as a service has provided us with the capabilities that can support the work of these AI researchers across the institutions that we support today and the h100s just make that story much more more compelling yeah and one of the things that I also see you know especially dealing with red hat and instruct lab you're also Happ kind of you're helping build that ecosystem yes for for open shift Ai and and really a whole solution stack around that yes I represent um the uh uh Moc alliance with the AI Alliance AI Alliance is uh we're a founding member of that and we're looking to attract more work through there but many organizations today um are also looking for sustainable Solutions and the Massachusetts green uh high performance Computing Center is a a green data center uh supported by hydroelectric power and we needed and wanted a more efficient supercomputing uh solution and the Lenovo Neptune that you guys have outside there allows us to have a much greater power density than we otherwise would because of its sophisticated Cooling and what what I love about that John is you're really taking to heart that message of sustainability yes and what it means I mean it's actually kind of one of the the underlying you know areas for the whole uh Alliance itself yeah I mean the the small form factor the fact that you can pack four gpus in a oneu package is astounding and it's only because of the liquid cooling you know the sophistication that you have that is is able to make that happen and those 192 gpus are in two racks for us that's you know unbelievable yeah oh that's great that's great well I'll tell you you know the work that John is doing with theoc uh it's truly gamechanging and and we really do we can't thank you enough for the partnership the engagement John uh I I know I've known you for a while you're you're one of the sharpest CTO in the industry and and the things that you are doing to really revolutionize kind of how AI is is used for researchers professors University Academia workloads and doing it in a green sustainable way uh is something that uh should be mimicked by many many University and and research sites all around the world yeah it it's fantastic work I'm really enjoying it and um you hopefully we can emulate this across you know other universities we're looking to share what we're doing and it's only through the the uh the work that you were able to do in terms of creating this service for us that's making this possible and it um it's a testament to you Lenovo being a partner versus just a vendor selling me stuff so it's it's was a fantastic uh accomplishment to get this in thank you it's been awesome to be part of that Journey with you John so so thank you so much um you know right now it's it's you know I I want to thank you for that um and and you know if there's anything that we can do to kind of help as we go on you know when we think about this this is really kind of the future of the industry so John thanks so much thank you all right really appreciate it and so when we think about that I I absolutely love the work that John is doing um you know and there's so much of it that when we see that there's this you know this challenge uh of AI and how are we making sure that we are really building the right products that enterprises need most to meet those challenges you know when I see it you know it's about data uh we need to make sure that you know we're giving you a a a commitment to secure efficient hybrid infrastructure at every Point all the way from those Edge Products all the way to the large cloud and if you need processing power what Lenovo is doing is we're finding even more efficient ways that how do we deliver a sustainab sustainable story around our new generation of Neptune liquid cooling products that continues to set the stage for the in Industry around the Innovation that we deliver and if you think about the scalability scalability is so important for things like the research that Dr Groves and and and John stump are doing that when we look at it the scalable Solutions those customized Services you know it's going to really require the most comp comprehensive AI partner ecosystem in the world that Lenovo can provide and this is really what I see as the Forefront of hybrid AI you know it's through the quality of our products from The Edge to the cloud to the breadth of the expertise that we're starting to build this Foundation of smarter AI for all today and we're unleashing the power for Enterprises Everywhere by unlocking the potential to access and use that data anywhere and with the thousands of customers and the thousands of of places that we operate you know it's every single day that we are focused on this market so with that I want to say thank you for the attention and here's to a sustainable future for all of us and with that and with that to actually learn a little bit more about lenovo's efforts uh to make AI the AI error more sustainable uh I'm going to shoot it back to the Showcase floor with our senior uh Vice President Chief legal officer as well as our corporate responsibility officer uh Lori Laura catella and our executive director uh of Regulatory Compliance Mary jacs take it away thanks vad hi we're back live as Vlad said on the showroom floor I'm Laura catella lenovo's Chief legal and corporate responsibility officer and I'm Mary jacqu lenovo's executive director of global ESG and Regulatory Compliance today you've heard a lot about Innovation and opportunity around Ai and Lenovo has put proactive governance in place to make sure that our AI Solutions are responsible ethical and secure we've seen some remarkable examples of human Centric Innovation that leverage the strengths of AI to bridge gaps in memory and communication and organizations at Lenovo we understand that AI is a powerful tool that can be used to create a smart future but as we focus on the fight against climate change we have to prioritize measurable Solutions that's right because we know that training one AI model can produce over 600,000 pounds of CO2 equivalent that's five times the lifetime emissions of an average American car and what that shows us is the importance of being able to measure and really understand the energy impact of AI but it also shows us how important Innovations like lenovo's Neptune liquid cooling systems are to showing us a path to a more sustainable future as we continue our services LED transformation at Lenovo our teams have listened to our customers and have provided an array of options that help them better understand and measure their energy consumption ultimately leading to more informed decision-making that help them Reach their sustainability goals whether it's the GPU as a service offering or the new Aid driven tool lenov 's intelligent sustainability Solutions adviser or Lissa our services are connecting Enterprise and supporting our customer sustainability goals as well improving the sustainability of our products and services is core to our strategy and you'll see examples of that all over the show show floor today but it's also a part of our own emission reduction Journey we're on track to meet our 2030 climate reduction targets and we've committed to achieve Net Zero by 2050 to the science-based targets initiative just like with the digital transformation of AI the transformation to a more sustainable future requires that we work together that we understand our impact and that we share common standards that's why we're so proud to have been one of the first companies to have our Net Zero targets validated by the sbti this shows that not only are we aligned with the science but we're also committed to working together towards a smarter and more sustainable future no matter what comes next we know that our Approach at Lenovo to sustainability will future prooof our business and give us the agility to succeed learn more here at the Showcase about all the ways we're innovating to promote sustainability and to meet our customers needs enjoy the rest of the show and it's my pleasure to introduce Dr Young Ray [Music] [Applause] [Music] good afternoon people need to get excited so in this session I want to share with all of you lenovo's exciting journey into AI defined vehicle Computing for the past 40 years Lenovo has been consistently successful in many large scale complex Computing systems from PCS to tablets and from data centers to high performance Computing a question I want to ask myself and all of us here is what is the next big Computing scenario the answer to me is vehicle Computing in the past several years the automotive industry has been transforming as Vehicles shift from a distributed to a centralized electrical and electronic architecture the shift actually opens a large scale complex Computing scenario with enormous Market potential vehicle Computing not only is the next big Computing scenario but also the next big AI scenario the success of endtoend food self-driving FSD demonstrated 5 months ago marked the beginning of the second generation autonomous driving algorithm this remarkable progress was made possible by using Bird's ey view Bev plus Transformer which reduced first generation 3,000 lines of code to only 3,000 this paradigm shift at the algorithm level also pushes the underlying computing power to shift from first generation's CPU Computing to the second generation AI Computing AI is also transforming the in vehicle infotainment system to evolve from isolated AI that may not work all the time to integrate AI that is very robust extending all the features from driver's seat to the third r with lenovo's expertise in hetrogeneous Computing Hardware firmware joint optimization also AI technology we are uniquely positioned to lead the next B wave in AI defined vehicle Computing now let's take a look what this means for autonomous driving please roll the video [Music] [Music] great Lenovo Lenovo in partnership with Nvidia Lenovo is currently developing the drive Thor based AI Computing platform ad1 and ah1 to help algorithm partners deliver autonomous driving solutions to end customers I'd like to highlight three key benefits here first ad1 provides 2,000 tops of AI computing power and at the same time the 546 gigabyte pers second DDR significantly speeds up endtoend processing with these two features ad1 is well suited for large model AI processing second ad1 and ah1 meet the cyber security standard ISO 21434 and also the functional safety standard ISO 26262 it has also achieved the highest level of functional safety asil Level D Level D is the highest level third time to Market ad1 is uh industry's First Automotive grade versus the regular industrial grade autonomous driving platform that can withstand various road conditions vibrations and impacts A1 is also the first in Market to offer the L2 Plus+ DCU to automakers Beyond autonomous driving we believe the Next Generation AI defined vehicle Computing will also be a smart space too where the capabilities of our devices will be leveraged let's roll the video [Music] [Music] Lov lovo again that familiar music Lenovo already has a large number of devices in the market and we are continuously exploring the Synergy among them to create Innovative use cases let me highlight three aspects of our infotainment system first our Multi-Device infotainment engine allows users to access a wide array of Hardware devices from incar systems to user mobile phones all very simply and intuitively second our Multi-Device infotainment engine doubles industry standard highdefinition channels from 5 to 10 for screen sharing and also at the same time cuts audio latency from 15 milliseconds to only 5 milliseconds meeting the professional Esports standard third and most amazingly Vehicles now can be integrated into lenovo's comprehensive device ecosystem delivering a seamless and natural experience for every passengers through hundreds and thousands of applications I just talked about lenovo's Aon autonomous driving and also infotainment scenarios Technologies and solutions but we at Lenovo know that we cannot do this alone so now let me invite one of our great Partners Ali Kenny VP and general manager of Nvidia Automotive to the stage welcome Ali [Music] [Applause] [Music] hi Ali the floor is yours hi everyone uh it's my privilege to be here today at Lov Tech world I'm here to talk about Automotive so the automotive industry is going through a massive transformation uh before Vehicles would essentially depreciate from the day you took them off the lot uh but now vehicles are being re-architected to be softwar defined so you could create new applications new services for your customer that get better over the life of a car but to do that you need to sort of build a car test it in a completely new way and you know there's three core things that we do to help make that happen the first is we offer you know really high performance computers inside the car um that are designed to be really easy to program for machine learning applications the second is is the data center that you need to test and train and develop these models are super large because you're no longer training on images you're training on video uh and so we're building these data centers for automotive um that are very large in scope and are optimized to let you build Rich self-driving applications or inside the car applications that let you ask any question or understand all the uh customers preferences but finally you can't build and test a car just on data that you catch in the real world you also have to have a simulation computer so that things that you don't find but Corner case scenarios that you might be doing in your testing you create those scenarios in Sim and you need a simulation computer that's physically accurate you could train your models and you could test your car as if it's happening in the real world when you when you have an endtoend development flow from car to cloud and simulation like this is the only chance that you could build autonomous driving in a safe way we're super excited about the Lenovo partnership because they're working with us across this stack Automotive companies don't have this capability inhouse they need to partner with worldclass technology companies who understand Ai and also understand how to build something with high quality Automotive grade quality and security Lenovo is really unique in their ability to do this um and we're super proud of the partnership Dr ruie uh because we kind of see the growing success of the Lenovo team in automotive and we really think that they're going to be a you know a strong Powerhouse in this industry over time thank you thank you Ali thank you and also thank you all for listening Lenovo is looking forward to work with all our partners to build a smarter future for AI defined vehicle Computing thank you all please welcome to the stage Ken Wong Executive Vice President president Solutions and Services Group please welcome to the stage Ken Wong [Applause] [Music] [Music] [Music] [Applause] [Music] please welcome to the stage Ken Wong [Music] [Applause] wow thank you take the check out of me wow hello everyone good afternoon well I'm sorry to be late because I just lost track of time driving that beautiful Lotus car that you have just seen But Dr Ray you're right you convinced me that autonomous driving is good enough that I could let the car park itself wow now that my heart rate has recovered from that ride so let me once again welcome you to Tech world and Seattle now I'm excited to tell you how Lenovo is delivering solution to customer with speed ease and expertise now a Lotus car is the perfect symbol for that it has super fast speed drive with ease and it's made with some of the best expertise in Auto industry now Lotus is also a customer of Lenovo and I will tell you more about in just a few minutes now but first let's take a quick look at the current Global AI landscape now we know right now there is a lot of excitement for AI but there is also some fatigue now companies that were eagerly adopters that were early adopters are struggling to prove the ROI of their investment now in lenovo's global study 61% of CIO said they found it very challenging to demonstrate Roi from their AI Investments now at the same time some company haven't introduced AI yet because the organization are not ready and just over half of the CIO said their it function do not have the right skills to deploy Ai and still other companies don't know how to get started but yet all these businesses are being pushed to deliver AI value deliver value of AI now in fact while many CIO expect to wait maybe two or three years to show ouri they're realizing that this is too long to wait which is why speed is so important now you don't have to make high performance cost to know the value of speed because today I'm exced excited to tell you about the Lenovo AI fast do one of our AI services that answered that Need for Speed now ai fast start lets companies demonstrate the value of AI use cases in 90 days or even less now fast starts bring brings Clarity by helping customers identify the most promising use cases now one stat is clear but design and Implement a work model or proof of concept in a matter of weeks we build a production quality AI solution using customers data now I would like to highlight two recent examples from two very different companies with very different needs first is sap now with the new technology center opening immunic sap wanted an immersive state-of-the-art technology experience as soon as visitor walked through the door now with the open opening day coming up they turn to us Lenovo now here is the story sap a global leader in Enterprise applications needed a way to engage visitors at its brand new experience Center in Munich with the center opening in a couple of months they needed to deploy a solution quickly so they engaged Lenovo fast start and the team got to work Lenovo partnered with deep brain to create a conversational AI human and 90 days later the sap for me customer Avatar was up and running in time for opening day this AI human not only welcomes visitors but it also showcases the power of AI in creating interactive and informative environments the sap for me customer Avatar has transformed The Experience Center making it a truly memorable experience for visitors Lenovo Lenovo wow this is a great example of how Lenovo leverages are large ecosystem of Partners to deliver rapid Innovation now we worked with deep brain one of the Lenovo AI innovator in our Global Network and the solution runs on technology from Nvidia a key Lenovo partner now let's look at another example a Formula One brings every rate to hundreds of millions of fans around the world through live stream videos now these videos need to show the car consisteny so fans can follow their favorite throughout the race now when Formula 1 decided to increase the number of live streams they knew their camera Engineers could not ensure continuity on so many video advance so again they turned to Lenovo here's what happened for Formula 1 bringing the race to their fans means capturing the action from all angles it also means adjusting the images real time for consistency so that fans can easily follow along this year Formula 1 wanted to vastly increase the number of live streams videos but that would increase the number of image Corrections needed exponentially far too many for their Engineers to handle with 24 races happening in 9 months around the world F1 needed to find a solution fast so they turned to Lenovo lenovo's solution AI enhanced Hardware that automatically detects lowquality frames and performs Dynamic Corrections fans get many more videos per race with the same high quality they have come to expect by partnering with Lenovo Formula 1 was able to go from concept to reality in just 90 days and that's a win for everyone now as an F1 fan myself I'm especially inspired by this story these fast out examples show how Lenovo helps companies demonstrate concrete results with measurable Roi now one final point I would like to make is that with AI fast start not only do customer get a quick win but they also end up several steps ahead of the AI journey and from there they can move forward with an accelerated pace so both of the examples of fast start run on Nvidia technology so AI fter leverages the Nvidia AI software platform to build a private AI solution for our customers now to talk more about Lenovo and Nvidia about our supporting customer on their entire AI journey I would like to welcome vice president of generative AI software product krie brisy [Applause] welcome hi hi Carrie hi Ken thanks for joining us thanks for having me wow now since I have you on stage and there are so much interest about our partnership I have a couple of question for you Carrie well first come first you know we have Incorporated the Nvidia technology and the Lenovo AI fast start offering so tell us more about how are we going to help our customers to set up gen use cases all right that's right the technology so one of the building blocks of generative AI applications and systems um are foundational models and nvidia's Nim is the easiest most performant and portable way to deploy large language models into production and I'm sure that you all believe me when I say that Nims are awesome but sometimes seen is believing so we're going to put Nim into action and solve multiple crossword puzzles at once so so right here we're showcasing uh the speed and concurrency of models side by side on the left side we have Nim off versus Nim on on the right side and you can see as it starts to complete uh Crossroad puzzles it starts to light up green so Crossroad puzzles are inherently very complicated tasks uh we have about an input sequence length of 2,000 output sequence length of 100 tokens and we're doing 150 llm calls per Crossroad puzzle so it's pretty evident that the nimon is completing faster and is better than the leading um open Source uh software Solutions so Nim off took so long that we have to speed it up so in the video so I'm not just standing here on stage uh staring at Ken and twiddling our thumbs and so you saw there that you had 2.5 um times the throughput with Nim on now we did another one we we boosted up the concurrency to 250 Crossroad puzzles concurrently and you can see here that with higher concurrency you get three times more the throughput so what that's showing is that you can with Nim on you get a better total cost of ownership and higher return on investment so since Lenovo AI fast starts uh Builds on the modularization of nim Lomo is able to help customers get to Market faster with reliable performance wow yeah right amazing I like the I like the the demo by the way the video is really good so the second question Carrie I I would like to ask is you know a lot of customer asking once they stand up you know the proof of concept the next thing they're going to talk about is how can I scale and how can I get positive Roi I think vlat just talked about Roi in his session so tell us more about how we're going to help our customer with this one yeah that's right so sometimes you now you have these really great Nims what are you going to do with them you have access to them but what uh how can you get this total solution so that's what based on learnings uh working with early adopters of generative AI Nvidia is sharing what we call nim agent Blueprints and so these are uh reference workflows that can be customized to meet the unique requirements of an Enterprise uh so for example the latest advancements are in agentic AI uh digital agents so these help save time and provide insights and take actions to help human experts but they require customization they require access to your tools and uh databases and so basically you need to onboard them to your Enterprise uh with this customization and the Nvidia Nim agent blueprints includes a consistent way to create datadriven AI flywheels built with the Nvidia Nim microservices and Nvidia Nemo it's all part of the Nvidia AI Enterprise platform wow thank you Carrie I think now I understand much much better well so we talk about how to help our customer to stand up uh gen use cases fast and also how can we help them to scale and get to positive Roi I think the last question that I think you and I see a lot of customers right the next question that they're going to ask is we all know there's no one-size fitall approach especially about AI right we we talk about private personal uh Enterprise and public AI right and could be large small medium language model well so I mean how can we work together uh to help our customer to implement hybrid AI Solution that's right so we talked about Nims we talked about uh nagan blueprints but so organizations are actually taking a hybrid approach to deploy AI applications so Lenovo and Nvidia provide Choice across public and private Cloud so Nvidia provides the latest most advanced AI um infrastructure and software for building generative AI now and in the future so leveraging Nvidia AI accelerated Computing uh for that full stack solution so gpus Nvidia AI Enterprise Nvidia Nim uh Nvidia Nim agent blueprints Nvidia Nemo so that simplification is essential to make AI successful and easy for the long term wow so I think there there a lot of powerful tools and I think the great thing is you know we're working together to bring diesel to all our customer well I think what you just spoke is a bit of the ease part of our value proposition that I'm I will be talking about in just a minute but the bottom line Carri is that together today Lenovo and Nvidia you know are working to help to guide our customer throughout their entire AI Journey so once again thank you kri I like the demo thanks for having you here and share such an Insight with our new offerings that the two companies are br

2024-10-17 08:24

Other news