2022 Silicon Valley AR & VR wearables Thought leaders conference HoloLens 2, Teamviewer AR, 5G IoT
![2022 Silicon Valley AR & VR wearables Thought leaders conference HoloLens 2, Teamviewer AR, 5G IoT 2022 Silicon Valley AR & VR wearables Thought leaders conference HoloLens 2, Teamviewer AR, 5G IoT](/pic/2022_silicon_valley_ar_and_vr_wearables_thought_leaders_conference_hololens_2_teamviewer_ar_5g_iot/ZEhLVVRNeWNNS0E_.jpeg)
research firm garner incorporated forecasts that end user spending on wearable devices will hit a new high worldwide over 81.5 billion dollars in 2021 up 18 from 2020 the wireless communications alliance and vola systems presents a webinar on wireless ar and vr we look beyond the world of consumer products to the future of wearable technologies using this tech in the workplace using virtual and augmented reality new applications are emerging they drive productivity for a range of industries from medical professionals to engineers and manufacturers providing new solutions for everything from task tracking at a construction [Music] site helping a doctor remotely assess a patient [Music] the lineup includes leading experts in the internet of things ar vr and the public cloud and then we can kind of get started and i encourage everyone to ask questions in the chat room while we proceed so thank you very much jeremy to you thanks andy um yeah i'm jeremy tollen the board member and vice president of wireless communication alliance um this is a great series that andy's come up with um talking about wearables in the ar vr world so the wca has been around since 1994. we're a non-profit business league dedicated to collaboration in the wireless industry worldwide we've been bringing you wireless webinar events for the last year plus through the pandemic but we we've done a bunch of uh in-person events as well and we run off of volunteers and sponsorships um next slides please andy so that said we'd like to thank our sponsors uh as bill corporation google cig sensorworks etherny technologies bowler systems energis iot nation mobile experts and sensotel and we if you find this to be of value and you'd like to be part of this organization we'd love to discuss sponsorship with you so please feel free to contact me at jeremy.toll at wca.org or
or go to our website at wca.org next andy and um for the events the beyond this this great event today we're we're going to do one in june that's talking about open wi-fi along with the telecom info project uh tip july broadband for underserved rural areas and in august we'll do iot applications um private equity and hedge funds so we'll be getting some people from the investment community and september is a flagship event called iot gizmos and gadgets we're going to do that in conjunction with an oktoberfest and if all goes well that will be an in-person event that will be hybrid with with a webinar and then finally for this year um we have another flagship event what's hot what's not that's um usually the week before thanksgiving and now we'll be talking about trends um for what's hot and what's predictions for the future and a couple housekeeping items um we we're going to use a zoom chat section for questions um we're we're still learning about uh real-time comments on on questions so we like prefer to just have you write them in in the chat and let us know what you want and then we'll feed that out to andy and he'll be asking the questions we're also recording this and the presentations and the recordings will be available on the wca.org website within 48 hours and would like to say greetings to the world and thanks for being our guest we we're definitely excited to have people from all over the world now and that's one of the silver linings of this this pandemic for the last year that we've been able to reach more people than we have in the past well said okay so and then finally the thing that you guys all really came here for is this this chance to win at bug repellent fan um you must be president at the time of the raffle and we will send the fan directly the winner so once your name gets called um please send a you know private chat message to to me and and i'll get you uh get your contact info we'll send it to you so roughly an hour into this presentation we'll do that um and then the presentation will continue or the q and a will continue after that so give people an opportunity to to check that out it's not what it's not wireless per se but it's wireless wind so you know just think of that wireless one right yeah there you go it's portable it's portable right thanks for that um intro uh jeremy um i think sure we can yeah we can get started here without further ado andy doe from sensorworks and the wca appreciate it thank you jeremy yes um hello everyone from around the world and and uh east uh west coast uh thank you for for coming uh in your evening uh for the east coast folks um today's agenda we are gonna talk about uh wearables and wearables we could talk about all the what what a wearable is and so forth but we're going to focus a little bit more on smart glasses and ar vr so with that um you know uh i had a slide for an introduction in terms of wearables and this is what i came up with uh this is just me googling and finding out you know the evolution of a wearable right and uh you know there's such a thing as an abacus ring so that you could say that's the first smart ring that was ever invented i don't know how you can actually do any math with that that little pin uh first radio hat you know uh so you know that was before the the the the the radio you know the portable radio then the hearing aid and then the pacemaker surprisingly i found this old picture from a company and that was the size of a basically a an av cart so i didn't realize it was that big in 1958 then of course the evolution of smart wearables from the 80s all the way to the 90s i can't see us anyone wearing that and looking cool so we're trying to be more cool uh with the invention of the smart glasses from some of the leading tech companies today uh so i'm hoping that um today we'll be able to talk to the panelists about what it means to to uh use and wear a smart wearable and make it cool and and what are the applications out there and as i mentioned in the abstract uh the wearable market is huge uh i i you know i was blown away in terms of uh what that market potential is gartner forecast about 81 billion dollars in wearables whether it be smart watches smart classes uh et cetera for the uh in 2021 and wearables today is not such more uh more of a a fashion statement it is actually a productivity statement and and you're going to listen to a lot of these speakers talk about how it's being used in business so with that i'd like to introduce our first speaker or give you an um a uh overview of the speakers today um so we have walt mcclay from roller systems uh who will talk about uh wearables from a design perspective and he has a wealth of experience there next we'll talk to uh josh gertz from teamviewer who has a cons who has the perspective of uh wearables uh in terms of the platform and then lastly tom harshbarger from senex to discuss um the the applications uh and uh uh talk about microsoft's initiative uh into uh this very uh very hot space so with that i will hand it over to walt and do an intro and before i do that let me introduce uh walt formally um so walt uh president and founder of strawberry tree uh voter systems uh he they are a top electronic design firm in silicon valley uh volder is particularly experienced in designing wearables and iot devices uh and particularly in sensors and wireless technology so with that walt um did you want to share your screen yeah get to it thank you very much andy so i'm going to introduce you to several things that will help you with the rest of what we're going to be talking about today okay so first of all just to briefly talk about batteries uh everybody would like batteries to be smaller and last longer and they're looking for big changes in the future and i'm afraid that's not going to be what's happening they're not changing very fast if they were if they changed like semiconductors you'd have a device the size of a head of a pin that powered your car and cost a cent and you you know we're never going to be there it's we're limited by what you can store in in chemical energy so we're going to be working around those limitations forever and that means in one area we're going to be looking at the wireless communication how do you do wireless communication efficiently uh and they're basically three ways that you get data from a device a wearable device or an iot device into the cloud uh some devices go directly to the cloud your cell phone does that uh some devices use a gateway and this is very often wi-fi so you've got a wi-fi gateway it's connected to the cloud and you just go to wi-fi and it doesn't need as much power as itself cell phone uh but a very common way for a wearable device is to go to a mobile phone which is the gateway and that very often you're using bluetooth or bluetooth le which is very very low in power so let's take a look at some of the wireless technologies that are available and they each have their strength and weakness we take a look at the the first four on here these are all long distance communication intended for low data rates so ltem nbiot sigfox and lora now when i say low data rates the first thing you look at is data rate of one megabit per second for ltem well it can do that but it's not really useful for that it's designed for much lower data rates as all are the others and in many cases you're sending a few hundred bits per second and what they're really good at is going a long distance at low power some of them support audio some don't uh it's important to understand about public network versus private a cell phone uses a public network you pay to be on the network but you don't have to install the infrastructure it's there you can roam easily a private network is where you put in a base station and as long as you're near that base station it works and when you move away it doesn't but there's no monthly fee however there's an upfront cost so you'll notice that laura is very interesting it has both you can put in your own base station or there are there's a portion of the country that's covered where it's available and you can roam the big advantage of ltem and nbiot is that they now cover well over 90 of the country and they're available in a large part of the world though notably india and china are lacking unless that's changed very recently so it looks like sig fox has very low uh density that most people don't have it so being public only it appears like it's losing out in the race of who becomes the standard now you take a look at these others bluetooth le that's bluetooth low energy mesh is new uh but this is for a small area you know if you can go more than 10 meters you're doing well with bluetooth or bluetooth led so it's limited in several ways zigbee is a mature capability it's been around for several decades it's used quite a bit but it's since zigbee isn't built into cell phones anytime you want to use a cell phone it it's not a good choice and of course wi-fi and well whether it's lte or 5g it's cellular the big advantage there is speed you know you can send streaming video on either one of those wi-fi doesn't go the distance but it's got less power so now let's take a look at a comparison of power distance and data rate so across the top of the next chart will be different data rates down the side on the left is different distances and the power consumption will be in each of the blocks so here i'm looking at uh 100 100 bits per second very slow 10 kilobits per second which could just barely handle audio and above 40 kilobits per second so even that is fairly slow uh and then between a meter which everybody can handle and over a kilometer which only a few can handle so take a look at the upper left corner right over here bluetooth led ble4 it says and zigbee as well as ble mesh less than a milliwatt they're the winners in the low power and that's why bluetooth le is so popular but the distance is very limited uh it won't go 50 meters the speed is quite limited it can go at 10 kilobits per second but not above that so there's trade-offs standard bluetooth you may not be aware is very different from bluetooth le it consumes a lot more power it does go faster it's designed for audio uh it also is limited in distance it doesn't appear down here in the 50 meter section wi-fi of course uh quite a bit more power but it can handle any of these speeds and much more way way higher in the megabits and wi-fi gets you to 50 meters but it doesn't get you to a kilometer now in the next block you're seeing laura sigfoxx nbiot ltem these have very low power as long as the data rate's low and the distance is low notice what happens when we go to the next block at a longer distance the power goes up quite a bit so as you move around the power is going to change they're still a lot lower than let's see if you look over here at uh the next column you know cellular 200 milliwatts uh ltem even ltm and mbiot at this speed they're going to be 100 milliwatts so you've got all kinds of trade-offs of power speed and data rate but what is interesting is that because nbiot and ltem now are available almost as much as cellular coverage i think they're going to become the standard when you want a device to connect directly to the internet now let's change and give you a little different background we're going to be talking about augmented reality devices augmented er augmented reality glasses what's in them what kind of hardware's in them well they all have a processor and almost every one of them is designed for video streaming so it takes a fairly powerful processor this is not low power they have a display they display on the glasses sometimes they'll actually display directly on your eye but most of them display on the lens of the glasses there's almost always a camera so that you can pick up data or video as well as displaying it a microphone for audio is almost always there uh because you're streaming video it uses wi-fi communication uh you know there's nothing that's gonna handle that speed it's lower power and then they often have bluetooth communication so that you can turn off the wi-fi you're not may not always be streaming video and then you've got a much lower communication but much more power communication but obviously not good for video there's frequently a motion chip motion chips are inexpensive and used for lots of things for example you can detect the position of the head and the motion of the head it's great for doing a wide wide view as you turn your head you can update the video and it looks like you're in a complete well with vr you would do this but even in ar it may be helpful to to understand where you're looking gesture recognition is common as a since you don't have a keyboard how do you communicate with this device one way is with gesture recognition another way of course is with voice and and then you have a battery and because these are some power hungry devices the camera and the microprocessor the battery needs to be fairly good size and there's a significant trade-off between how heavy this device is and how long it lasts between charges now before i turn this over to everybody else so you can learn about more about the ar devices let me just tell you about some interesting wearable devices that i'm familiar with and of course ar and vr on your head glucose monitoring there is done with patches so if anybody has diabetes you may be using those they're common now sleep monitors are becoming popular you can they're used in different places one is just to monitor your sleep you can get an app on your phone even it'll do that but there are devices that you can put on your chest that will monitor your sleep as effectively as going to a sleep lab but in a sleep lab your sleep isn't very normal with these devices you sleep in your bed very normally and you can do several days worth so they're better than going to a laboratory if you're diagnosing a sleep condition eeg devices mounted on the head for example as a helmet or just as glasses with electrodes they can be used for monitoring disease or for games there's the device that was introduced several years ago where you think and the device moves and you control the speed in the direction of its movement hearables people have been wearing earbuds for a long time for listening to music since they're already there the in the ear is a great place to pick up signals from the body it's now possible to measure heart rate spo2 which is oxygen in the blood and of course motion with a hearable and these devices can be pretty small so you can still have audio at the same time we developed a leg band that goes around your leg and monitors swelling after a knee replacement surgery so that the doctor can know remotely how the patient is recovering there are infrared light devices that are supposed to change your mood i don't know if there's been any double-blind studies on these so there's some uncertainty about how well they work but apparently they do work uh voltage is used to treat pain so some of you may have had devices where uh for if you've got back pain they put a tens device t-e-n-s uh that's fairly old technology but there are also implanted devices that relieve pain and in some cases they treat disease for example well there's one device available that stops tremors and it's just a device you wear on the wrist and you use it several times a day there's a device you put on your head that applies the magnetic field that stops migraines there are some shirts out and they typically monitor ecg oxygen breathing rate and other parameters the shirt is a convenient place to make these measurements but if you're running you may not be wearing a shirt so there's a pants that will measure your ecg and measuring the ecg in pants is difficult the ecg is electrocardiogram the heart signal uh the signal is isn't as strong when you get away from the chest and to be able to measure it while you're running with dry electrodes is difficult but we we came up with an algorithm that worked and then you one that you may have seen several times it's it's a real popular one is monitoring glucose in the eye this is not a real device it's it's a novelty that yeah they can monitor it but i don't know how well they can convey it wirelessly and how long it works it's not ready for prime time yet the mojo lens is a display that is on contact lenses and that one i'm not sure if it's actually a device yet that's getting into the early stuff but sony has a pocket air conditioner it both heats and cools you wear it on the back of your neck which seems to be a very efficient place for making you feel comfortable by changing the temperature so there's all kinds of wearable devices and it's growing every day hey thanks for that well yeah there's uh it seems like wearables that you've mentioned uh the wacky wearables are all touching some sort of the five senses and i was going to ask the panelists uh to think about a wacky wearable so what's is just to um kind of tie it onto what you did what's the wackiest wearable the most absurd uh word about that you have seen out there um that either you have touched design or heard about well asking me that that's uh what i was just showing you that's the weirdest thing we've seen okay yeah i i could see you've touched pretty every much part of the body so thank you for that i appreciate it so um with that i'd like to uh introduce our next speaker and our next speaker is josh gert so josh hello welcome hello great we can hear you thank you yes so josh works for teamviewer uh 25 years in new media high tech sales he is the enterprise account exec for teamviewer uh and acquired uh formerly the manager u.s sales manager for ub max which was acquired by teamviewer uh also a founder of a uh in uh or an involvement in the mp3.com
um site and business neurotic media and daqri as well as ceo zachary i see i knew i knew i probably should have said that what my brain was thinking so jacquery and ceo of gridsvr so so josh um i have to say you know when i started this uh this excursion or or this process of learning about ar vr smart glasses which i thank my friends at teamviewer for sending me this um you know i i was not sure what i was getting into and in terms of you know the vision uh thing and having one thing blocked and uh you know i think the audience would love to hear from you uh to kind of demystify what is ar you know and the difference between vr and in mixed reality there's all these you know these terms that are they're thrown around can you help clarify what that means to be an ar device and you know what smart glasses absolutely yeah thanks everyone uh thank andy for inviting me to speak today thanks everyone for joining um yeah let's talk a little bit about uh wearable devices and you can't see my desk but i've got a whole cornucopia of every wearable device known to man you know including the ones we're going to talk about in a few minutes but uh point being that wearable computing uh is a methodology of taking uh generally instructions that you would have been getting in an industrial environment and moving those out of your hands onto something that is wearable and that could be a head mounted wearable could be a wrist mounted variable we see chest mounted wearables we see wearables that are mounted on the trolley or the or the forklift the question is the idea being that your hands are not occupied by that screen and then that further drips down into the idea of these are being used for ar and i i want to talk about that for a minute because that term gets thrown around a lot uh the typical term ar as it is i guess used long for a long time is augmented reality and what the heck is that i'm sure most people on this call know this so i apologize uh for the basic nature of this but uh augmented reality is digital information superimposed on top of the real world uh when when i got into this business many years ago the only good example that everybody knew was uh the yellow line on the football field when you're watching football uh that the players don't see that line that's the tv station or the network imposing that on top of the the digital image to create an experience for the user and then a few years ago luckily a game called pokemon go came around which if you have kids as i do you know pokemon go because it was an obsession and now there are children all over the world holding up their phones in front of fountains and battling dragons and again those images aren't real they're only available on the phone but when you view them they are actually in place they are situationally aware they are on the fountain so you can have that that interaction augmented reality is an amazing technology and i know the next speaker is going to talk a lot about it and it has a tremendous future uh in a lot of places but as far as the industrial application of that it is somewhat limited in today's market based on the amount of devices that are available that make that experience useful in an industrial scenario so if you look at the music's andy that you showed or the real wear or the google or the panasonic or the toshiba i mean there's there's so many of these monocular devices out there they have small screens and even though it's right in front of your eye and you have a really good way to view it and you can see a lot of what's on that screen um it is a more challenging environment to then recreate the real world superimpose digital imagery on top of that and ask the worker to find the little green square on the little green screen or whatever that may be again in a minute i know we're gonna have a speaker come to talk about a device that is much more capable for these things but in our world we typically use the term ar to mean assisted reality not augmented assisted reality is the concept that you are getting information on demand usually voice activated and that information is designed for making your job more efficient more uh less mistakes whatever whatever the goal of the program may be and that technology is very heavily proliferated across industry even today much more so than i think the general public is really aware of uh there are again wearables of all types being used to solve every kind of problem imagine uh from picking in logistics to inspections of machines to assembly in the biggest automotive plants in the world to maintenance on every kind of truck part and machine you can possibly imagine having the ability to give you information on demand has multiple benefits first off in a lot of technical careers now there is an aging workforce and a lot of my customers some of the biggest companies in the world struggle to replace the most senior engineers repair people managers in that regard and having the the less experienced employee or even the brand new employee have access to the instructions they need to do their job on demand as they need it anytime without impeding their process by having their hands free is proving to be a very effective training tool and that may be an unintended consequence of these devices but we're seeing that uh as a key factor in the decision making among a lot of the largest companies in the world because you know we we talk a lot about a term called tribal knowledge tribal knowledge is the idea that if bill doesn't come to work today nobody can fix the radiator because bill's the only guy who knows how to fix the radiator well that has to be a thing of the past we have technology available to you that allows you to digitize and synthesize these workflows into a way where anybody can have access to them in a way that makes sense for them in their language in their uh own device in there in a way that they can use very readily so assisted reality is very proliferative wearable technology very proliferated but i think we're just still on the cost when it comes to using augmented reality uh in the industrial workspace yeah that was a very thorough answer uh thank you there josh so um you know some of the applications uh that uh teamviewer uh has come across um you know what what what verticals has really been taking off with with uh wearables or specifically smart glasses that you've seen in the ar space yep uh there are a lot uh one of the things that we struggle with is that our technology can be used in so many different ways that we really have to approach the client very holistically and try and find out what problems they're trying to solve but i'll tell you there's there's really two that i think are maybe a little bit more advanced uh the first one would be logistics uh logistics is a very complex part of most big businesses i don't care if you're a manufacturer a distributor or a retailer or what you do you have a logistics piece to your business you need to receive items you will make them or ship them or count them or whatever it may be and this may surprise you but something like i don't know the actual number it's like 30 or some some huge number of warehouses around the world in 2021 are still using pen and paper not surprised and there's just a long way to come that they see now that this technology has become affordable uh it's become something that they can implement rather easily the journey into ar is much shorter than it used to be you can prove concept this for a low amount of money uh in a very short period of time so logistics in order to solve all of those those repetitive details that happen over and over again keep people from their brains wandering you know one of the issues they have in logistics if you ask me to pick the same thing over and over again all day there's a chance that my brain might miss one of those and it's not that i don't mean well or i'm not the best employee it's just the way the human brain works and having those visual cues in front of you the picture of the item the quality of the item having to say confirm having to actually put the process through every time keeps you from making those mistakes so logistics is definitely one yeah go ahead for the second one yeah yeah for the second one is definitely remote collaboration or remote support so what we're doing right now you know zoom or facetime or skype only designed for the wearable device the ability for me to see what you're seeing provide you remote support cut down on the time that we need to fix problems remotely i think kovid was the big uh driver there suddenly every maker of every machine everywhere in the world could not go to fix those machines when they broke and now they you know big companies the biggest auto companies uh the biggest retailers are all looking at how can i provide support without actually having to send people there all the time yeah yeah i i i i basically um agree with that this is a productivity tool and if we all think back about you know the mouse made it more predict productive in terms of our work you know in some computers and then our smartphones made it a little bit more productive now i think this is kind of the next evolution of productivity um one of the things that really surprised me uh josh was how much uh voice recognition is in these classes you know because i'm thinking you see things i really did not uh appreciate the the the workflow rules that teamviewer had implemented in terms of voice hey something's wrong okay call supervisor you know that that was really uh amazing to you to know that this is really integrated that can can you speak to um just uh you know applications where um uh you know it really brings everything together you got the the remote worker you've got the camera like there's seems like there's four or five different sensor type of things in here what's the most complex you know uh type of ar solution that you've come across oh boy uh keep it short i would say the most complex solutions are those that require uh real-time collaboration and input from people who are very disparate so you've got people in europe who bought the machine or who made the machine and people in the united states who own the machine and the software provider who's in colombia who's trying to provide support on this machine and they're all collaborating in real time and each person's having to present their piece of the story in a way that resonates with everyone else remotely this is not all of us standing in the same room there are new rules and so that piece of it becomes very complex now i refuse to do a commercial for what i do there are software's that make some of that easier mine and others but the key being that that type of collaboration isn't possible even with the software we're using right now i can't annotate your screen i can't pull an image off of something you're doing and modify it and then re-share it i we can't be collaborative in this environment so these tools give us more collaborative tools that's cool yeah uh i think uh when we first met you showed me some video i don't know if you if you haven't yet yeah yeah it was really amazing what was possible you know just really blows your mind in terms of what what ar can do and what it should be yeah let me yeah let me share my screen i do want to show two different videos and then uh i have a good whacky example i want to show as well so uh andy if you could let me know and you can my screen or dhl yeah we see that okay so this this is a uh dhl facility that they run for uh rico copiers and uh in this facility uh they use the glasses in an entirely uh voice activated way you'll see in a moment um this gentleman's pulling a trolley and trolley has 15 drawers so that's what's been recreated for him in the glass this is all completely voice activated he says out loud ilt-1 followed by location 0253 followed by pick 2 and at that point it shows him we should place those locations items in the box in the trolley and he places them correspondingly and right at that moment he gets the next pick and he can keep right on moving hands-free um when i show this example i always like to point out a very unintended consequence of this program globally at dhl is that we have cut onboarding time for new employees by 80 percent used to be uh one full day in the classroom learning how to use the uh the scan gun and the pixes and then two full days shadowing before you were allowed to pick a loan uh today it's four hours learning how to use the glass software and then you pick on day one okay so that was a good that was a good example of assisted reality um andy did you have a comment there i'm sorry no i was frozen yeah just so amazing that the the amount of you know training time you're reducing and you said you had another video yeah i do i have one more i'd like to show um you gotta find it here it is um this is museum not to steal any thunder from upcoming presentations but uh this is more of a mixed reality solution um this is an industrial solution using the hololens where there are several key advantages to this device you'll see in this particular workflow there's a cad model a 3d model of the item that she's working on she's able to pull that model right out and in the same frame while she's working on that model she's actually able to make a remote call and get support on that and that's some of the power of these newer devices that allow us to have all of these advanced functionalities so she can pull out the model she can call someone remotely on the same screen and get help and then that person can guide her through actually making the repair right there uh in real time yeah it's simply amazing uh where you know you are truly hands-free and you have so much power at the palm of your hands uh through these classes so um before we move on i'm gonna ask you what is your wacky wearable uh all right i got that okay so so this isn't so much a wearables but uh since i'm focusing here on ar i i just absolutely love this i gotta share it with everyone if you haven't seen this before uh this is the uh aquarium in tokyo japan and uh they wanted to uh drum up some marketing and some attention and boy did they ever uh they created an ar app that if you were when within one kilometer of the uh of the actual aquarium here you can whip out your phone and uh they actually digitize the fleet of penguins and you can follow the penguins from wherever you are all the way to the aquarium nice that is cool yeah it makes going to the aquarium even more fun that's right yeah yeah and what's cool is they show you in this video they actually brought the penguins into a mocap studio i mean the whole bit and actually digitized them so pretty cool use of ar so uh yeah so with that uh i'd like to introduce our next speaker tom harshbarter there how tom are you oh you're mute yeah dude doing great andy thanks for getting the name right this time yeah i'm sorry i'll get it one day uh um but uh tom um so you uh let me pull up your bio here and uh by may so tom you lead the microsoft uh practice uh for cynics uh vice president of microsoft cloud devices and iot and the business units um you also um have our stakeholder in the company initiatives as it pertains to ai mixed reality iot and public cloud you've also led the design sales engineering and development for the stellar team so i think tom you've got a pretty good mix of everything from iot to cloud and then now you have um smart classes and hololens under your umbrella so with that um i wanted to ask of you since you know microsoft and hololens has been uh in the news lately and probably the one the biggest one that's been been in the news was um i believe uh the u.s army announced the contract without a lens uh i think it was something like 21 billion dollars over 10 year period for some sort of hololens type uh headset for soldiers tell us the story of hololens and and how that microsoft evolution came to be and maybe share with us some applications yeah sounds great and thank you very much for having me here great to join the rest of your speakers and reach the audience um so a little little story about how hololens came to be i don't know how many people are familiar with microsoft's research arm think about it as a 5 billion a year startup that goes and looks for cool stuff to build the the group is amazing they're researching everything from how to sequence dna properly to beat cancer at the source um to all sorts of technological things so it's both humanitarian and technological um the story hololens begins actually in the year 2000 when microsoft research started using a video infrared eventually radar to develop a device that could see a human all right somebody somebody might be talking off mute there um but uh uh started then with using those technologies to create a device that could actually capture human movement uh the major joints you know head legs etc 10 years later uh microsoft xbox connect hit the market and that was actually the first public product in that journey towards where we are now which is mixed reality um that eventually led to the first hololens which was a great proof of concept and did an amazing job of building neck muscles um and then now has led us to hololens 2 which you can see on the screen and just to tie in a few points from the earlier speakers um you know this this is not your eight to ten hour a day wearable um you know as as walt mentioned uh you know if we strapped a car battery to the back your head this thing could run for days but you might end up having some neck issues um it's not lte enabled so you need wi-fi and i'll talk about that a little bit more simply because the power drill on lte or any other wireless connection is so so much higher but what you do have it's a high-end computer and a really comfortable headset with lots and lots of cool stuff to talk about so i'm going to go ahead and launch into it just a little bit there we go so i promise not a lot of these slides but just to give you an idea of you know this is microsoft story and path it's not dissimilar to google aws others as well there's a lot of agreement about this but um intelligent cloud what does that mean it means a ton of things but if we frame it into the mixed reality world what it means is the hololens device the 2d devices that go with it you can use google glass complement teamviewer all sorts of things they require connectivity intelligent edge and intelligent cloud and why is that there is a lot of real-time processing you can do on hololens 2 to identify objects we built something very similar to the dhl setup here at cinex for our warehouse is to train people to be able to pickpack ship day one instead of two weeks of training so the device can do a bunch of that but hardcore analytics managerial decision making bi those things that's not gonna happen on your face and so then you start talking about edge devices be they wireless routers uh that have some intelligence on them or other devices you need edge processing for real-time processing and feedback to your devices beyond what the device can do and then you need some form of public cloud in our case azure that can do the real crunching the the artificial intelligence the machine learning decision trees all that and so you end up with a device that is very powerful on its own um but no way shape or form reaches its potential until it has communication edge compute power and then back end compute power so it makes for a really nice cascade of technologies you can introduce to better the experience and for all of us you know there's an opportunity to blow away your customer um but also you know create a sales channel for yourself because you know we're distributor we ship boxes but my group doesn't ship boxes um we could sell hololens all day at two percent margin and think we're doing great but that's no good there's no value so working with the likes of you wrapping actual solutions around it and then the whole story out to the public cloud gives us all an opportunity to work with customers for years and then just just a visual given what we've talked about today um if you think about augmented reality virtual reality so virtual reality is on the right um it's oculus it's you're blacked out to the world and living in the space in front of you really cool applications not great for walking around a workspace and then ar augmented reality is the physical world your 2d devices can do that well today and then hololens creeps up into the middle um on the mixed reality spectrum so you're getting a rich display that's augmenting the world in front of you whether it's with information communications remote assist to repair that pipe that they can't come repair for you but they can advise you over it and so you're blending in kind of the best of both worlds at either end into a single device for it so that's where that sits on the spectrum and just a few looks at the use cases so the picture here itself is awesome um and i don't know if any of you have really good eyes you can squint over my shoulder here and see some of this stuff going for real but i've worn one of these the ability to see crisp true rich 3d images charts real-time feedback on this is absolutely amazing and some of the top use cases for it and you know obviously the army's going to use it for everything it's worth but uh bmw boeing there's you know the list of fortune 100 and now tricky trickling down into smb um they're using these things so improve skilling you know i think uh both josh and i have hit on that skill people up a lot more quickly and your repair techs your warehouse workers even you know your business analysts don't have to be absolute experts all the time because they've got the device with them they can look up anything from a parts manual to get somebody on the screen actually marking on their screen to tell them what to do put this pipe here turn that nut there etc efficiency obviously not just in training but think about the efficiency of having all this here while you're wearing it and being able to make real-time decisions as opposed to what's just generally slower conference calls 2d screen in front of you with a flat excel file in front of you and then first line workers you know no bigger time in the last 15 months for this the use cases across healthcare for being able to do face-to-face remote diagnosis um even some site-to-site advice during surgery being able to see what each other is seeing and so many other things it's brought a lot more medical care to very sick people and healthy people in a way that does not require you know a very expensive doctor on each and every case the doctor can scale by helping frontline workers along the way so pretty cool stuff i have a question you know for those who um haven't uh put on these uh uh glasses for the very first time where it's vr ar um you know how much time does it take to get trained on to get used to that perception and and you know is there such a thing as arvr motion sickness you know what have you seen out there yeah you know the the longest draw in the onboarding um is getting used to the weight on your head um and it's you know it's certainly no anvil no wiley coyote here um but it is different than putting on a pair of glasses or a hat so it's getting the headset adjusted so that you're comfortable in your motion in terms of uptime training it is incredibly slow it uses nothing but natural gestures with your hands clicking objects grabbing objects you can actually type on the screen and so they're all very fluid motions um we don't have to come up with any swipe four fingers left and one thumb up and then wink if you want to get to that menu much more intuitive and human friendly there very cool very cool thank you yeah very long yeah and i've talked about most of these already so i'm not going to read the slide to you but it just brings a little more life to a few of the scenarios we've talked about across assistance collaboration training and then the the last one being the contextual data access i will say a little bit more about that what's contextual data access if you really think about it that makes absolutely no sense what it actually is is being able to see your data your analytics overlaid on your environment so you want to see in the warehouse which skus are moving the fastest where you have shortages great you can see that visually with colors charts etc it's not a spreadsheet we have to map back to a location so you can really check out all sorts of hot spots cold spots employee performance machine performance all that kind of stuff using that kind of contextual data access that's uh just a quick picture give you what it looks like up close and personal and it really is amazing version one to version two um so the cameras there are a lot of them um not only to orient where you are in space um but to give the right kind of feedback based on the right angle so it's not just a flat display you can move around in your context of what you're seeing will move left to right as well as your perspective lidar radar all that good stuff in there and then something really cool that is becoming more and more available is uh the use cases to go with hololens um simply having that headset great however lots of different harsh environments so hololens with a hard hat hololens with a full face shield for medical there are just tons of use cases coming out every day first and third party but adapt these devices to the customer environment versus you know think think about somebody working in the field for an electric company having to tiptoe around and adapt to a very fragile 3 000 computer on your face not well suited so really making great progress there and then this talks what we we were talking about up at the very front that the device itself is great but it is in a community of technology and devices um you know everything from your phones and tablets to drones to iot devices and then on up through the microsoft technology stack which is a really open stack and it'll let you take that input and data and then start doing pretty amazing things with it and be able to show a real return on investment to your end customer which is that's always the magic button for us is you know did i get 20 to one return on the three thousand dollars right we can prove to the bottom line you're in great shape required billboard of big customer names um so lots of automotive aerospace manufacturing oil gas health and public sector list gets longer every day and while these slides always focus on the names hopefully everybody recognizes around the world the names that you absolutely would not recognize unless you lived in greenville south carolina or some other location is growing daily we've got a lot of success with uh auto body shops small chains things of that nature where they can use this device to get real-time feedback information user manuals making their skilled frontline workers even more efficient because they're not trolling through all the paper volumes and things that they traditionally do the questions and to walt for example there was a question earlier about how do people feel about having you know a a a radio near their head and and you know you mentioned wi-fi bluetooth still a radio uh if some sorts and and now potentially talking about cellular are there any concerns there uh to to have such a emitter near your head yes uh so there are when it comes to something like cellular there are actually regulations for how much energy is absorbed by the head and it's significant enough that there's concern it's still not completely proven just how big an issue it is but then there are some people that are worried about signals as small as bluetooth le and you saw that the power difference was about a thousand to one so some people are worried about things they shouldn't be but it's not an issue that is without concern yeah yes you're right i mean you know we've had bluetooth headsets for the longest time right so uh certainly um uh different technologies you have what is it sars uh test i believe yes yes yeah to to get past that um yeah and there's uh some other questions here um uh uh i there was uh questions about uh let me see if i could find someone had mentioned how does the upcoming wi-fi 6 standard come into play with arvr the additional bandwidth avail was tremendous seems to be a good fit so would wi-fi and this is to all the panelists would wi-fi 6 be kind of the answer uh to um truly making it an ar vr um you know um uh the device that that could really do everything in in real time i'll i'll touch on that um so i can tell you that in the industrial world in these giant factories uh almost all of them experience dead spots on their wi-fi no matter what they do and 5g ymax wi-fi 6 and ymax are definitely solutions that big industry is counting on to make the coverage in their buildings these five million square foot factories and up uh better so we're very much looking forward to that great thank you uh and then we'll we'll have uh one more question here um a lot of love comments for a great presentation everyone um let me see if i could find something that is unrelated to power a lot of power questions so a question i guess to you back to you all here it says do headset glasses design rules include some sort of directional shielding between the wearable and the head uh well i presume we're talking about electromagnetic shielding which is the issue of how much energy is absorbed by the head and you know having something heating my brain is something that does concern me and they've been so uh there's not much shielding because we're not dealing with cellular signals wi-fi as far as i know doesn't have a requirement for minimizing the absorption it it may have and certainly there's nothing with bluetooth so you're getting something in your head and you know there have been lots of studies in this area and there isn't a consensus on exactly how much of a problem it is part of the problem is that many of the studies were done by companies that had a stake in this industry we'll leave it at that i like this question a lot and i think to the smart glass folks um are these device devices potential vectors for cyber attack or do they have some sort of defense built in so attacking your glass and controlling your head well they the even though with the exception of the hololens um they're they're mostly android tablets so they they would be as vulnerable or you know the same as any other android tablet on the market yeah there are definitely ways to exploit android if you're not careful and uh that's where i think a lot of our mdm partners come in to to manage some of that and you know you're you need a sharp i.t team but it's not something that we face to date but at the same time it's a real concern what do you think tom yeah so never will i say any device isn't permeable having said that though a few things on hl2 so it's not running windows so your normal windows attack vectors aren't there it as josh just mentioned around device management um it runs uh in tune or actually autopilot on all of them um so instant wipe and reset without it is available should you detect any breach and then the entire surface family um security starts at the actual chip for power up and goes all the way out to the cloud so in terms of concerns about those devices we don't have much but you're always one headline away from having a newfound concern not nothing out there is bulletproof clearly right right that's good yeah sorry i've got a comment on this did you have a comment before no please no i'd love to hear it so we've developed lots of wearable devices and when it comes to consumer products there's not a lot of concern about security particularly with a startup because they have a choice of getting it to market fast or spending extra time and money and making it more secure and when you go to buy something in a store do you make a choice based on security and if it is secure how do you even prove it now in the case of medical devices it's a different story the fda has some recommended security measures and when they recommend something if you don't follow it you're going to have a little bit of an issue it doesn't mean you have to do it but it's becoming standard and then with large medical device companies there have been enough stories that they're getting paranoid about security so the security is changing and i think it will eventually affect consumer products for example the the govern us government now requires a certain level of security on devices that they're buying or it's going into effect soon that will affect everything great thank you well i i know some of you are anxious to get a raffle for the uh the fan uh so i want to make sure we can do that and if some of you want to leave after this and we can certainly continue as more questions come in so jeremy if you're still there if you uh can help us with the random raffle i am there i just did a random uh draw and theory winner is drumroll um marissa hernandez congratulations if you're still i looks like you're still on so if you could just shoot me a quick uh chat with your contact or email or your address um then we can get that out to you as soon as possible yeah thank you marissa yeah and send us a shot of it when you get it you have to have yourself using a picture of it and use and we can we can post that right so um just to finish up and if there's any more uh questions um you know for the finalists uh last last couple questions here um right now you know uh we're just getting used to buying a thousand dollar smartphone right some of us aren't some of us aren't but that's what that's the going rate these days for a high-end smartphone um what do you think it will take whether it be price or or or just um application to to get these uh smart glasses mainstream um and and you know there is the famous story of google glasses trying to go mainstream and that didn't happen for numerous reasons privacy is was one of them um tom i'll start with you uh what do you think it's gonna take sure so um a couple things you know evolution of technology for sure like anything that you know this three thousand dollar hololens is two thousand dollar that in a couple of years this device will be a thousand dollars and its big brother and sister will be around um so i think normal evolution of cost of technology uh probably gonna be a bit delayed here since producing anything right now around the world is a bit of a nightmare um so that that's one part of it um and then i think the the second part is intelligently building more uh i guess more specific feature sets hololens now flagship product top end it can do everything that a holo lens can do while the adaptability to different work environments different head pieces etc is great having more specialized devices for certain industries with maybe a smaller set of capabilities to make them more affordable and a quicker path to roi is important and i'm going to throw in a third one as well the continued maturation of the technology around these glasses that support and extend it so your tablet your phone the cloud all these other pieces that don't require three to five thousand dollars every time you want someone to put something on their head yeah i i i would concur um how about you josh what do you think is gonna take it to make this mainstream i'm gonna respectfully disagree with tom and say that all those things are important i'm not knocking any of them but glasses are a personal expression and until they make fashionable glasses that i can put on and feel really good about wearing and they come in enough different looks and feels for me to feel fashionable wearing them it's not going to succeed i i think apple is going to come out with a device in the next 12 months that'll have three or four different frames and lens sizes and until somebody cracks that nut and makes it a fashion statement to wear these uh you know i don't think it's gonna hit the consumer market so you're going with the cool factor uh and i've i've looked online they're saying that those glasses might come out at 500 up 500 or so maybe a little bit more we don't know yet customers apple customers don't care yeah right right it's apple so yeah they've got the whole ecosystem so yeah that that would uh would uh certainly uh be important to see if that's gonna stick stick how about you walt uh you know mainstream question uh mainstream being you know you'll see more of it every day well you know i think that we're already seeing the mainstream for business use that's we've just seen software that really makes them useful and really saves money and this is what we need i think what's been holding it back for businesses is the applications and and we're we're getting them so that's happening now for a device that costs more than a thousand dollars it's really hard to have that become a consumer product that's been a major problem and there's also been a lack of applications so we'll see apple could change it they've done that in the past we'll see what happens and my my uh ability to first see the future isn't so good yeah yeah no from it from an industrial i think uh a point of view industry 4.0 i mean that's definitely where it's going and i could see a day where every uh logistic factory worker has one of these uh whether it be a full-blown you know hololens or kind of a smart glass there's a comment here in the chat based on calculated savings hololens can get people to pay for the lens via savings upfront capital will not allow smaller users to justify capital expenses so kind of uh uh highlighting uh what you guys have said uh uh in in terms of uh smaller users will will have to justify it so with that um uh does anyone else have any other comments uh you are welcome to um chime in and raise your hand uh but uh if there are any other questions i'd like to thank our our wonderful panelists uh to share their views on on wearables smart glasses hololens i've learned some things being here and i hope you guys have too uh so with that uh i want to close out and uh jeremy i don't know if we have any uh closing slides let me see here um i think i think maybe just outside contact info yeah right so with that um uh please join us uh for our next event at thewca.org we are a non-profit and we do work on sponsorship as well as donations so if you have uh any interest there please do contact us and the wireless communication line is one of the oldest wireless cigs in the country uh since the 90s we are continuing on and and our charter uh is to you know expand technology and with the iot applications we're going to use that interest to tie into wireless so thank you everyone for your time thank you panelists and we'll have this recording in about 48 hours for you to review thank you thank you thanks everybody thank you thanks andy and everybody thanks guys great information really enjoyed it have a great day thank you all right here we go thank you
2021-06-04 03:24
Other news
![](/pic/you_may_not_like_it_but_this_is_what_peak_combustion_technology_looks_like_-_rotary_vane_engine/VVBGRlhCQWU1bWM_.jpeg)
![](/pic/abc_news_prime_race_to_the_white_house_holiday_travel_new_tech_protecting_teens_on_social_media/NlJhY0UxdWpLWEk_.jpeg)
![](/pic/stanford_webinar_-_identifying_ai_opportunities_strategies_for_market_success/WE5xcHlTVjk3SVU_.jpeg)