Snapdragon XR Spotlight @ Snapdragon Summit 2023
[Music] please welcome vice president and general manager of XR Hugo [Applause] Schwartz hello everyone what an amazing morning so far I am continually fascinated by the pace of Technology progress back in the early 2000s I started my career working on bringing wireless data to cell phones I saw firsthand the transition from the PC Internet to the mobile internet that we carry in our pockets every day this transition took time with the evolution of 3G better displays better processors and the explosive growth of the app ecosystem we saw a true Revolution I'm seeing the same path happening XR as we evolve to the spatial internet it feels almost like theja Vu but this time I see an even bigger impact to society where we truly merge our digital and physical lives where screens disappear and the world becomes your desktop and we are not too far off the last decade we have already made tremendous progress and we're seeing XR applications have an impact in exciting ways from professional athletes able to improve their mental Readiness for intense competitions field technicians able to ramp on into the workforce quicker to guided immersive training and through theraputic XR experiences designed to help veterans and First Responders overcome PTSD these are just a few examples of XR Beyond gaming and entertainment and I'm excited to see all the positive impacts these Technologies can have to our daily lives with qualcom we're working every day to address the full spectrum of realities that comprise spatial Computing from immersive VR in 100% Virtual Worlds to mix reality where you experience immersive content while being able to see and merge your physical space using video seethrough to augment the reality where virtual objects overlay on your world through thinner lighter glasses we have put an emphasis on developing class leading technologies that enable affordable and Powerful XR devices that everyone can experience today we have been continuing to realize our vision with two very important platform launches the first is the Snapdragon xr2 Gen 2 the first platform designed to democratize premium Mr and VR experiences this platform is optimized to heat The Sweet Spot in the market it supports 3K displays per eye a blazing fast GPU best inclass on device AI all optimized for an allinone headset that don't require an external battery pack we're excited that the xr2 Gen 2 is fing The Meta Quest 3 this is the most powerful Quest yet and will will enable millions of users to experience the next generation of immersive Games Live sports fitness and so much more and at the outer end of the spatial Computing spectrum is smart glasses a category we have been investing as well last year at the summit we announced Snapdragon AR 2 gen one our first premium AR platform for fully immersive AR glasses leveraging distributed processing which leads me to our second major recent announcement the Snapdragon ar1 gen1 ar1 is purpose-built to expand the smart glasses category to even more consumers with premium cameras for hands-free photos video cap capture and live streaming and Powerful AI to help you capture the best content Empower your virtual AI assistant we are thrilled that both new platforms just announced last month are already shipping in the latest devices from meta and here to talk about how we collaborated to bring these exciting devices to Market please welcome to the stage head of harder Partnerships and meta Jennifer [Applause] H thank you Jennifer thank you Hugo great to be here at my first Snapdragon Summit So Meta just had the big connect event a few weeks back how did that go you know connect was a huge success for us we announced the meta Quest 3 the Rayband meta smart glasses and gave the world a glimpse into the future of the metaverse the most important takeaway for our developers and partners is that AI has the power to transform XR experiences for creators it will open up so many new opportunities to create amazing experiences and give you and me the consumer superhuman capabilities very soon you'll be able to ask your meta AI a question and the AI will answer you with the context of seeing and hearing through your smart classes this is a major breakthrough totally agree and uh we have been working together for closely many years uh but can you speak to the broader collaboration between meta and Qualcomm teams of course meta and Qualcomm and actually you and me Hugo have been working together for over 8 years which in this business is like a lifetime remember when we collaborated on the Oculus go meta's first Standalone VR headset yeah it was awesome that's like going back to the days of the motor of Razor phones if for those of us who can remember that um the problems we're trying to solve in XR are mind-numbingly complicated neither one of us alone would have been able to solve some of these technical challenges together we've had some amazing successes for example our work together on machine learning has made so many aspects of the quest 3 better with more accurate hand body and controller tracking we're able to create much more realistic avatars and track your hands with much more Precision whether you're typing on a keyboard or playing on a virtual Piano the two teams by working together dramatically improved image quality with a sharpening algorithm that is two times faster than before and now the work that we're doing to enable on device AI will not only benefit XR but all other mobile platforms as well it's just amazing I couldn't agree more the expertise that each of our respective teams bring to the industry is second to none we just launched two exciting platforms together one being the xr2 Gen 2 can you share your vision for what experiences meta wants to drive with this new Quest 3 sure Quest 3 is bringing to life the next generation of mixed reality experiences for cons consumers and businesses alike let's check it [Applause] out make it look easy it's like riding a bike bump up and down because I know what I like I keep it rolling from the side to the side from the left to the right from the day to the night [Music] it up I'm all about the hey I'm all about the hey I'm all about the hype I'm all about the hype pick it up pick it up pick it up Pi it up Pi it up pick it [Music] up oh I like to dream and make it grow in the dark I make it real cuz that's a walk in the park I'm moving so fast I'm as bright as the Stars yeah I'm bigger than large and I'm off of the ches I'm all about the hype I'm all about the I'm all about the I'm all about [Music] the all right Quest 3 is just amazing it has twice the graphics processing power of the Quest 2 all thanks to our work together on xer 2 Gen 2 and the vastly improved full color video pass through it'll seamlessly blend digital objects into your physical surroundings now you can actually bring the gameplay into your living room mixed reality will also transform Fitness making the experience much safer and less cumbersome so now when you go on a ride on your stationary bike through the Swiss Alps you know no longer need to Fumble with taking your headset on and off just to find your water bottle how awesome is that I'm really excited to see the creativity that these new devices will unleash I agree I've been loving the Mr experiences on the quest 3 and I'm really excited to see what developers can do with all these new exciting capabilities now we also launched another platform together the Snapdragon ar1 gen one that powers the Ray Ban Mana smart glasses that I'm wearing right now could you tell us more about these absolutely by bringing together the iconic style of Rayban and meta's Technology we've built a pair of smart glasses that will make you look not only make you look brilliant but be brilliant at the same time these smart glasses are a big step forwards towards realizing our vision of all day wearable lightweight stylish AR glasses that will be your portal into the metaverse come 2024 you'll be able to use your Rayband meta smart glasses to translate street signs for you in real time while you're traveling through a foreign city with meta aai the best part is your smart glasses will get even smarter with use over time the possibilities are truly endless truly revolutionary I can't wait for everyone here to experience all the amazing things that we built together thank you Jennifer not just for joining us here at the summit but for being an amazing partner thank you thank you so much for having me all right thank [Applause] you now if you hadn't had a chance to try out the quest 3 I highly recommend it I'm having a blast with mine definitely a must have for this holiday season I also can't wait to capture and share my next trip with the new Ray band oh wait a second maybe I should take a picture of the audience here another one here and another one here all right some of our snappr insiders were lucky to get their hands on them here in Maui and uh here uh you have a sample of what they captured so far looks like they're having a good time here in myi so but we are just starting and uh on what our ar1 platform can do smart glasses will become the eyes and the ears for virtual AI assistance allowing people to experience AI in the most human form with our census guiding you through the preparation of your next family meal helping parents or older parents read a menu with a small print or removing barriers between two strangers by translator their conversation in real time I am super excited to announce that we have multiple OEM Partners developing smart glasses based on snapdragon ar1 these glasses will not only feature camera audio and AI capabilities but we will also feature either monocular or binocular displays and we expect to see this designs from these customers launching next year and as part of our strategy to scale to new brands we have also developed a smart glass reference platform we have partnered with the leaders in waveguide Optics compact light engines and smart glass manufacturing to develop this design we are very excited to see the shapes the Styles the functionality that our OEM customers will bring to the market following this reference platform next I'd like to introduce a colleague of mine to speak about the importance of AI in developing XR apps and experience please welcome to the stage Rogue [Applause] Fong thank you R thank [Music] you thank you so much Hugo good morning everyone it's such a pleasure to be with you here today I'm Rogue Fong and I run developer education for our exr ecosystem as part of that role it's been super fulfilling to empower our partners with the latest advancements in Qualcomm technology enabling new use cases for them to explore one of these key Technologies I'm sure you've heard a lot of over the course of the Summit is on device artificial intelligence AI is fundamental to XR as it's a core Foundation of perception technology with the on device processing capabilities of our latest platforms we are able to add new and exciting Dimensions to XR experiences we'll start out with how I usually start my day fitness there are amazing smart Fitness devices that bring a virtual trainer into your home but I often wonder how much better could that experience be with the one-on-one realtime feedback on your form and technique that you get from an in-person Fitness class to elevate how we think about smart Fitness today we worked with popular XR fitness app developer light sport along with a Sensei AI to deliver on this concept let's check it out [Music] welcome to your personalized workout of the day from light sport powered by a Sensei [Music] AI 2 3 I see that you aren't getting low enough on your squats I want you to try and get down a little deeper so your thighs are almost in parallel with the floor your form looks great keep it up all right put your weights down and Shake It Out you did great work [Music] today all right who's stoked about this I know I am this will definitely get me ready for ski season this experience was developed using our Snapdragon spaces XR developer platform and together with Snapdragon seamless announced yesterday connects products that we use every day your smartphone camera to track your body pose in real time you're wearable to capture biometric data like heart rate and blood oxygen level and now with ar glasses you can bring the trainer right into your home to give you a personalized Fitness experience and as someone whose second home is the gym I'm excited to bring someone on stage who can talk about how immersive Technologies are helping to evolve Fitness please welcome president of exponential Plus at exponential Fitness Garett Marshall thank [Applause] you thank you very much Rogue uh first let me say it's a real honor to be part of such a spectacular event an event that's been filled with so many exciting announcements what I want to do in the next just couple of minutes here is share with you a real world example of a Global Fitness brand that's venturing into these Technologies right now as we speak I want to touch on some of the macro dnamic that are perpetuating the interest in our industry the fitness industry in these Technologies and last but not least I'll show you uh a sneak peek of our newest app release which will launch next week on Quest 3 okay uh for those of you to start things off who aren't familiar with exponential Fitness we are the largest operator of Boutique Fitness studios in the world we are publicly traded on the New York Stock Exchange under the ticker xpf uh we serve 10 Fitness verticals through the 10 brand you can see uh on screen behind me and we operate collectively 3,000 locations with another 3,000 locations sold and obligated to open okay to make sense of going to show you in the next couple slides I thought it'd be useful if I shared with you our mission which is to make Boutique Fitness more accessible for consumers everywhere but historically time cost and proximity have been among the prime constraints to the growth of our industry Boutique Fitness One obvious antidote to that is digital Fitness digital Fitness can be done by anyone anytime anywhere it can also be delivered at a very low cost so nearly 5 years ago at the beginning of 2019 we decided and made the Strategic decision to invest very heavily in digital Fitness if you fast forward to today we now have exponential plus which is our digital platform where we deliver live and On Demand Fitness classes this platform serves hundreds of thousands of consumers today and it's available on 10 different operating systems with the recent edition of meta Quest and so the subject matter of the next few slides uh is designed to shed light on the business case for why we decided to incorporate this 10th channel of meta Quest so let's take a look uh at the industry top down um consumers in a postco era they care more about their Wellness than they ever have before it's more or less indisputable uh I think for most of us as consumers the very definition of what Wellness encompasses has likely broadened it's expanded uh but it's also a very different competitive landscape uh consumers are eating off of many plates to serve their diverse Fitness needs one statistic that surprises most people is that today the number of frequent exercisers those are people who exercise three times a week for 30 minutes or more that do not belong to any gym or studio is actually larger than the population of frequent exercisers that do belong to gyms and Studios and it should be noted that this is not the result of an erosion of market share on behalf of Jims and Studio uh Studios but it is rather an increase in total participation in Fitness and so there's a real positive Silver Lining there for society as a whole but what it does is it casts a light on how the incumbent uh Fitness Brands like ours and many others need to think about customer acquisition and how to engage with the consumer in the 21st century so in our appics in our business digital Fitness plays a very topof funnel role it allows us it allows us to reach wider and further to engage with consumers who haven't had the opportunity to experience one of our Brands and it's pretty effective at that for many of the efficiencies we we just mentioned but what consumers trade in exchange for all of those efficiencies that are gained they're tra what they're trading is experience when it comes to digital Fitness we know that the Pinnacle experience we can offer a consumer is in a physical location where that consumer is surrounded by a community who share their same aspirations uh a sensory environment that's been purpose-built and a world class instructor there to motivate them so the obvious question bearing that philosophy philosophy in mind the obvious question is once again why invest in these new virtual Technologies the answer is is because of the evolutions in the technology you've seen here for the first time we have a hybrid opportunity where we can leverage all of the efficiencies of standard digital Fitness while at the same time recapturing some of the immersion and the experience that sacrificed when you can't make it in a physical location and to give you a sense of what I mean here I'd like to share with you the trailer for our latest uh app release which will launch next week on medaquest [Music] what's up y'all it's Isabelle here with pure Bar and today we get to do a 20 minute Empower class make sure you've already synced your surface all right let's go ahead and get started up lift up and up so targeting your inner outer thighs getting into your upper body as well and this is it you did it your 20 minute Empower class is dead thank you so much we'll see you all next time [Music] hey welcome in I'm Tamara here to take you through a quick five minute stretch rotate your right shoulder down and back as you gently lift your chest and squeeze your left arm I will see you next time for your next stretch La [Music] session [Music] so obviously we're very very excited about this app launch the capabilities that are provided by the new Snapdragon xr2 Gen 2 chipset in particular for our app experience like full color pass through spatial anchoring natural depth perception these are really prerequisite isite Technologies for us to launch any of our modalities in a virtual or a mixed environment for example mixed reality allows a user to have a fully immersive Fitness experience while at the same time engaging with physical fitness equipment like a bike a treadmill or a rower and so these Technologies are not only critical for user safety but they're really critical just to provide an optimal user experience or a great workout so I think it's very likely if not given that uh in the future as these Technologies evolve we'll be able to far surpass what's possible in a purely physical fitness experience the technologies that Qualcomm is developing particularly in the areas of artificial intelligence mixed reality and augmented reality collectively produce the unprecedented opportunity to accelerate Fitness outcomes for consumers on a very very broad scale so together with Qualcomm we couldn't be more thrilled to be venturing into a future where we're making Fitness more accessible more entertaining and ultimately more effective for consumers everywhere thank [Applause] you thank you so much Garrett it's exciting to see developers pushing the envelope with Snapdragon powered technology while developers like light Sport and exponential Fitness are driving in ation and immersive Fitness experiences so too are developers driving Innovation with generative AI in the future you will be able to create Rich 3D environments that you can walk around in in AR and VR using nothing more than a voice command in order to get to that future we need a bridge and that bridge is built using the generative AI tools that developers are using today now let me show you a demonstration using Snapdragon powered AR glasses and a smartphone to decorate a 3D environment with generative art all offline and on device in this experience you can turn your environment into a museum with blank sculptures and canvases ready for you to put your personal touch on let's say you like long walks on the beach with your dog and how about a nice New York slice to go with it romantic right well now with stable diffusion and AR you can speak that Vision to life I'm excited to share my creation of a dog sitting on the beach eating pizza with you so I'll just plaster it up here in this virtual gallery for you and everyone else to see now let's turn our attention to the sculpture of a surfboard catching a wave I'm still feeling a bit romantic here and what's more romantic than Italy I'm thinking a nice Mosaic and the style of Italian architecture would look good on this piece like the sculptures in this experience your generative AI Visions are no longer confined to 2D screens this is just the first step for collaborating on entire Virtual Worlds I can't wait to see what artists and creators will be able to do with the power of Snapdragon n XR something I love about what I get to do is that I get to work with developers building experiences like the ones you've just seen when developers work with powerful tools they push the boundaries of what is possible by Leaps and Bounds and we have created a powerful tool to allow developers to do just that Snapdragon spaces with Snapdragon spaces we have enabled developers to build everything from the fitness apps as you've seen to Enterprise solutions to everything in between but don't just take this all from me let's hear from one of our developer Partners sphere sphere is all about immersive collaboration it's an XR Sol solution that unifies all the major use cases in Enterprise XR in a unified software product at its foundation it's all about collaboration meaning that you can collaborate work communicate with people wherever they are in the world whether they're collocated with you or whether they're distributed all around the world even if they speak different languages you can seamlessly communicate and collaborate with them as if they were in the same room with you I think the foundational work that Qualcomm is doing with Snap Dragon spaces is phenomenal for all isvs in the space but especially also for us because fear has always been um a cross device a device agnostic uh platform and Qualcomm and snap dragon space makes it really really easy to Port from one Snapdragon space enabled device to the next without losing any functionality uh with the same capabilities and provide all the underlying services like meshing like hand tracking um to the developers um like us which is which is a complete Game Change I've had the absolute pleasure of working with spere along with many other incredible developers and I've witnessed firsthand the amazing applications they've been developing on Snapdragon spaces our XR ecosystem continues to inspire me every day and together we're envisioning and building the future that you've gotten a taste of over the past few days so before I leave you all today I'd like to give you a taste of what our broader XR ecosystem is serving up [Music] enjoy this time as you all know it's about XR and the metaps it's Jan Jan's music in a different [Music] universe this this phenomenal using the smartphone as a controller is [Applause] [Music] incredible Dragon SPAC [Music] thank you Rogue I'm amazed every day what developers are creating with Snapdragon spaces as you can see there are many exciting developments happening in XR from our latest Snapdragon XR platforms sping the quest 3 and the raid band meta smart glasses to how we are utilizing the power of XR and AI to help people achieve their health and fitness goals or enabling users to create generative art and bring it into an immersive spatial environment I have personally been on this journey in XR for over a decade and I can see how everything is coming together and I can't wait for what is still to come thank you [Applause] all
2023-10-29 16:16
