XR Technologies the Natural Evolution of the 4th Industrial Revolution

Show video

hello before we alive my name is david co-founder of visionaries triple seven i'd like to kick off things by thanking the fourier live team and the before your team these events are no easy task and thank you so much for the whole organization and really thank you for the invitation it's a pleasure and an honor for us to be able to share the stage with such amazing talented people in the augmented mixed reality industry so i'd like to kick off things by introducing briefly the company we are visionaries we believe that winter and mixed reality are the natural evolution of the fourth industrial revolution we see that the folding data revolution has brought a lot of you know iot ultimate automation um you know very advanced features on the hardware side and of course software side but we do believe that there is still a gap between all the technology on the physical items and the people interacting with them and we do think that augmented and makes reality bridge that gap to make it easier for people to work more efficiently in the physical world we truly believe that anyone can learn faster you know work more efficiently be less dependent on on traditional learning models or maintenance manuals with augmented mixed reality and vuforia for sure has been a great tool for us to to to sell this idea to our clients worldwide we have been quite lucky to work with global leaders in both or let's say europe the us and and japan primarily um and so our job is to really find ways to optimize processes within different parts of the of the company so this could be from training tools manufacturing optimization on on facility management or marketing tools so of course due to confidentiality topics i cannot show all the crazy things going on inside the manufacturing side but i'll show you a bit more of what we're doing and how these technologies are helping our clients so this this started with uh our first client was um w motors from dubai the owner ralph what he wanted to do was he wanted a trade shows for the clients to be able to customize their vehicle the lycan hypersport this vehicle became very famous uh because of the fast and the furious films i'm not sure if you've seen that film but there's a one of the films one of the 74 films that exists when vin diesel drives a car out of a building and he jumps out into another building of course all base in in historical facts and so our job was to create a tool with euphoria that anyone could then scan the vehicle and customize the vehicle and it was quite extraordinary at the time this ability you know it was very new very innovative so it was really good fun for anyone to just grab this and let people you know release their imagination of how the dream car would be of course a three million years old vehicle for anyone to really customize it that was definitely a great uh adventure for any for many people we then started working with a larger car maker which is infinity so infinity is a luxury brand of the nissan group and the first two we built for them was a training tool so you see here is a training tool that was built for the sole purpose of having every single salesperson whether it would be in china mexico or the us everyone speaking the same language when it comes to when it came to explaining the invisible technologies inside the vehicle it is quite difficult as we know for sales people to keep up with all the technologically uh the technological features the new features of every vehicle we're not just talking about four wheels and five doors anymore these are super computers in a way very advanced computers um with cool new materials and all these kind of lidar sensors or very advanced features that are difficult to explain and we really want to make sure that the salesperson regardless of where they are what language they speak or knowledge level they really speak the same language and as we can see here we scan the physical object and we overlay data on top and now if i could maybe give you an example how this is using manufacturing our clients in the factory floor would do the exact same thing where the the software using euphoria would scan the physical object and overlay for example iot data on top of the machine and then show you step by step how to assemble or how to repair the machine um so this was really started as a training tool but then we moved on to uh leveraging this tool in trade shows so it became a very powerful tool and they realized that for example to explain to the media all the new technologies inside vehicles are sometimes explained with pictures and videos but it's nothing better or more exciting than actually having you know a scan of of the object with a tablet or with the phone or of course now with with mixed reality hololens glasses for example and then show these features inside the vehicle and then we scaled it even further now it's being um used um in the concept showrooms of the future so automakers as we know they're going to be reducing the physical footprint of dealerships in in in trade in physical spaces worldwide as dealerships become smaller and smaller there needs to be a supplement of digital technologies and so what we do with euphoria is again we have the salesperson showcase all the features inside the vehicle to explain the technologies for because for example if you want to explain the pro pilot technology of infinity this is a technology inside different car models so with just one physical car model you can already explain all the different features of the vehicles and we do think it is very exciting to see the transition of the of the product being used throughout different um stages in the in the customer journey and product life cycle you know we started as i showed with the training tool internally then it goes into trade shows and now it's going to be used in in in showrooms and you know in the future maybe it will be part of your experience when you buy a vehicle scan the vehicle and maybe you can already repair the vehicle yourself or learn how to utilize you know the features of the vehicle by scanning the product so for sure we will see more of this coming in the near future um not only are we working with the automakers the oems but we're also working with the suppliers in the automotive industry so we always forget that a vehicle has 30 000 components and 30 000 components meaning that there are multiple companies behind this 30 000 components so you have a array of tier 1 and tier 2 suppliers um so the challenge that they have like a company like bose audio what they want to do is they want to showcase every single component inside the vehicle but it can be quite difficult for you to have people imagine all the 17 or 18 components inside the vehicle where they're actually inside the vehicle and so again with before it's quite powerful all we need to do is we scan the vehicle and then we can already show you where every single component is inside the vehicle um and i we do think that that is a very big uh cost-benefit feature for clients traditionally they would literally have to like open up a car or you know cut the car in half and or you know you know have we figure out all these creative ways but we do think that with these features we can actually save a lot of costs on by just you know having the physical vehicle there and scanning it um of course the tool has a a two-part tool so one is when there is a physical vehicle in front of the of the person but let's say a sales person is now visiting a client anywhere in the world uh you're at the offices of you know ford or gm or bmw you cannot actually bring a car into the meeting room what you could do is you could bring a digital twin you know a virtual copy in a winter reality of that of that vehicle so again here we have the full textured vehicle but we can always jump into the x-ray vision of the vehicle so we we do think that it is quite a powerful tool that can be used by by suppliers in the automotive industry to explain any kind of components you know whether it's a lighter system you know speaker system in this case um semiconductors so we do have quite a few uh suppliers already working with us on on helping also explain what the component does within the within the vehicle and how it can help the you know better communicate for the sales it can help but communicate the the usp of the product um we're also working with smaller brands and so for example john coombs this family-owned business that i completely mispronounced in german they're going to laugh at me as always my friends in munich so this is a family-owned business what you see here is they actually take apart engines so they do displays for huge global brands huge global brands for global brands um and so once they you know take every components away they actually have to repaint them put it back together um these these items are being shipped worldwide but of course the problem is that sometimes for example there's a trade show in in china um and one of the the engines stopped working it is quite difficult for them to fly especially now with covets to help do maintenance on this kind of machinery so the way they started using euphoria was for remote assistance to be able to you know with fourier engine can i have the the um clients at the other end you know select a part and i can say look these components maybe it's not working remove it or you need to put you know some um oil in this in these parts whatever um so yeah it definitely you know the the explosion mechanism to show every component it then became in itself a marketing feature of the um of the of the of the clients of jordan kungst um and it also became a marketing tool for them so that you know these engines for example they cannot take carry them everywhere to a meeting so the same tool that they're using for maintenance is now being used as a marketing tool so we've digitalized the tool and when they're at the meeting they can actually show the engine on a display like here in augmented reality to scale of course they can show all the components they can show how they and they can animate the engine to make it look very cool um they can explode it and they can show in this case it's a it's um it's a motorcycle engine they can they can actually show the the how the motorcycle would be inside the where it would be lying inside the um inside the the motorcycle yeah um so i've given you examples of course on mainly on on tablets and phones but the beauty of this is now for us it's very powerful that euphoria can be you know a cross-platform solution before your engine it's very powerful because we can convince clients in the fact that they're actually investing in the future so yes they may only be able to use in some cases a couple of years back only tablets and phones but we always said to them don't worry whenever the newest hardware comes out before it will always be ready to to deploy it into the newest hardware and that's a very big key decision factor for many of our clients because they're always looking into long and um you know scalable software just like the infinity example and so we always have to make sure that even though we may start on a prototype level with an ipad that these really can scale into all the kind of hardware and so yeah this is a great example of how um you know the the the the johanna cooks the same product you can be used with with mixed reality and hololens and i've given you many examples now of of how we've been working on with the euphoria area with fourier engine but um i wanted to give you an example that is not related to automotive but it is very exciting for us because this example is now using the fourier target so the example that you're seeing here it's actually for the hospitality industry due to covert many hotels around the world you know staff started getting sick people couldn't be trained as efficiently and you know if you look at a five-star hotel they need to maintain the standards globally for every single process within the organization and it does become a challenge when you cannot have person training or where new staff don't have the same level of you know deep rooted and quality mindsets to make sure that they really follow every single step so the greatest the great thing now is that we can actually digitalize spaces with fourier area targets with just an ipad so this space we actually produce a lighter scan with the new ipad that has lighter scanners that point cloud 3d model um or 3d we used to then understand the location of the person within that space with area euphoria area target and that means that we can then you know remotely create any kind of facility management routine security routine uh you know fire safety routine uh sounds they have to check every month or every week i think they'll check the sound inside this bedroom um make sure the speakers are working all of these things could be done uh managed remotely and me and making sure that with scanning one room we can then probably use the same room scan in multiple countries in different areas and the same 24 points of checklist can be used by different teams and going back to what i just mentioned before of course everything looks amazing in hololens too but it is still you know a an expensive piece of hardware um in this case it wouldn't make any sense it's just too maybe bulky and and just the price may may not make sense it may make more sense on the on the mechanical room to to repair more things like engines or whatnot but of course what i'm trying to get to is that we do have a cross-platform solution once again so many of our clients we always go and show the latest hardware we say look let us show you that what the future is going to be you know apple lenovo samsung i think last night uh snapchat released their their new um mixed reality headsets so we do that everyone is moving towards this industry so we always show the clients we like to show them the future but being realistic we need to make sure that everything works in ios and sorry ar core and ar kids and again we couldn't ask for more with the support that we get from from vuforia in that sense we everything is really up to date we always can deploy it easily and and we do think it adds tremendous value to any organization um so yeah i i hope that you've enjoyed this brief webinar um i'm always looking forward to speaking to anyone in the industry you know we we are not that many as we all know and and now with with this pandemic we are definitely i think we're getting closer just the fact that we can now have these webinars online but i truly hope that next year we can all meet in person and have a beer and so with that i would like to end thanks again and feel feel free to ask any questions looking forward to talking to you excellent great stuff thank you david thank you so much for the presentation and and staying up late for us to uh to do this um i thought it'd be good for us to do a little q a and take some questions from the audience here so feel free to please put your questions in the uh the chat and we'll uh try to get to as many of those as we can super cool looking forward to it thank you so much all right so so one of the questions i have here um when you're working with the car companies or really anybody i guess i'll ask this from my perspective too but uh in doing model targets how do you get the cad models from from the car from the companies that you're working with uh yeah so that's definitely a it's still a complex situation because you know that's where the trust you know this is a highly confidential file so you you still need to go through a lot of you know big contracts and things to get this once you do get the files we are always asking for the step files so this is you know the this is the most universal um format but sometimes they send us the fbx if we do get the the fba access to a very high poly um model so we do need a lot of manual work and optimization uh for the real-time application but so that's pretty much where we actually have a in-house a third of the team is specializing in 3d models for for that reason yeah excellent so you guys are doing all your optimization yeah in-house for the large cad models and uh yeah that that was another question was you know how do you take that very large cad model and display it in an application and a model using using your uh model target is that a pretty big process in reducing a model or do you have any tips and tricks for people in doing stuff like that yeah i think basically there's two angles to it number one is if you could just try to get rid of all the dates that you're not going to be visualizing the experience so if you're looking at a machine and you're doing the maintenance step-by-step you know instruction manual then you don't really need all the mechan the electronics all the nuts and bolts of the whole thing just removing all these things that won't be visually experienced can really make the the file much lighter and the second thing is that during these experiences we make sure that the the user is sending from a certain angle um and that means that we just make sure that you know they we can just track one specific area let's say from the front of the machine and that way we can we don't have to be worrying about you know they're going to be standing from everywhere so we can just make sure they stand in one area and that also optimizes the the experience excellent yeah very good yeah i know it's uh it could be a lot of work sometimes as well and it's something i think any developer has to be prepared for it so yeah that's great um let's see so we had a a comment from uh florence here uh the airy target demo in the hotel is slick so i have to assume he's uh he's in france right yeah one of our favorite guys here yep but uh you know that being said so if you have a hotel uh you're doing area targets uh in a hotel is there a way that you can go from floor to floor how do you deal with uh you know different floors of buildings um in the space that you're working on yeah yeah that's a good point so we we tested um um let's say the conclusion just in a nutshell the reality is that we still think it's a bit dangerous for people to going down the stairwell with ar um and even maybe with mixed reality in the future we don't know how that's going to play out but right now the easiest way is just for to make sure that we either tell the the user okay now you need to move to this floor or for them to just you know scan a qr code or identify a certain picture and then we know exactly where they're in they have to select the floor manually um because yeah just right now it's more of a safety topic um but you know at the same time most of these routines are being assets access through the lift once you get into the lift you're going to lose the the tracking 100 guaranteed right so you better just sell the software i mean this floor and then you can continue your your process right right um so i have two questions here uh i'm going to try and combine these into one question right but uh i'll do it maybe two parts so all of the examples that you showed today in your video uh your videos what uh vue fourier platform did you use to um to use to build those i mean that's all but done with engine premium yes yeah yeah it was kind of a softball question but you know i was asked in the in the chat here and i just want to make sure that you know everything that you're using is engine there was also a second part here was a question is um well we answered part of it did you use euphoria engine or studio to do these um have you ever used before a studio or do you have a preference one versus where one versus the other um when do you use one versus the other maybe that's a better question yeah so we have done both for sure um and i think that engine is still more used when we are looking at the quality of the 3d has to be a lot more detailed when you have to be you know the quality of the of the experience is a little more uh let's say customer facing um because if it's if it's a a maintenance tool for a machine you don't really need to worry too much about the how beautiful the the the the 3d model is so i think uh studio could work better for that experience at the same time when it comes to customized experiences you know if you're working with a client and oem someone who needs a very specific experience you really need to follow street guidelines and you know corporate identity you know graphic elements then you really need to use engine um on the studio side you really are very box into the the tool so it's it's different use cases but um i think that if people are really looking into into uh using either they should just really start trying them both right i think once you get a feel for what they can do the capabilities of each one of them they will both have advantages and disadvantages but the good thing is that then again before i wouldn't cover all those necessities great great thank you um you know i think this is something that you touched on in your session here but maybe we can reiterate this the question was um you know the hotel scenario is very creative and very cool um but it wouldn't be as very cost effective since the hololens cost 3 500 to get that but i think you actually mentioned in there because you know they're expensive you use an iphone in some cases right correct how do you address the needs of your clients as far as like the cost of um everything from from the licenses you use to the hardware that they want to do and how do you kind of structure that out yeah i think let's say because we we've been working on this you know ar topic for so many years my business partners i think they they were hacking their first mixed reality experience 12 years ago they really know know their stuff many of the clients that we're talking to we really convince them that this is the future and so in that sense they really are preparing the infrastructure for what happens when you know smart glasses become cheaper you know lighter and anyone can use them and so whenever we approach them we always are very realistic saying you know in a hotel for example you may still want to have one or two holder lenses to uh you know fix or repair or do something very mechanical when it comes to very complex processes um because the hardware may justify the investments but the on the other side if you're looking like a hotel room then we just say the same infrastructure can be used cross-platform and so we think that's very powerful the fact that when we do an experience it's just a matter of maybe changing a bit the interface of course because you're using your hands and on the device on the other one you're actually doing a hand tracking um but i think that's very powerful right the fact that we can really produce pretty much the same experience cross-platform and that's how we convince them and in terms of licenses i think that many of them especially now with kobe they realize that there is a huge uh advantage to have digital knowledge transfer and not just in terms of you know pictures and pdfs and these kind of things but a more immersive experience they really can see the value of this for training purposes for um you know having people really not forget a certain thing yeah i think all of us hopefully in this call we realize that many of our clients are realizing that digitalization is a number now awaits the way to go for many clients but b that we could really see now remote assistance for example with augmented reality and mixed reality how powerful this is this really was we think it's a big game changer a game changer for us now yep great thank you um so when you're you're building this i mean this is actually something we talked about before your session started today so i think this is a great question here but what what hardware to use to scan the environment so when you're you're looking at a hotel or a you know large building versus a small room what are the different things that you do um to to scan that or capture that environment yeah i think i think this is as you and i were just talking just now it's very exciting to see that the the other part of the puzzle is the scanning capabilities right and for example we're now talking to a huge convenience store chain we could literally scan a convenience store if it's less than 100 square meters i'm sorry i don't know the feeds but a small area um you could you could do it with an ipads or or with a with a you know lighter scan if you're having something a bit bigger you could go for a matterport scanner and now in large environments you have these navis uh these navi scanners from germany so the point is that we are definitely seeing a huge array of products coming out in the next couple of years to make scanning easier and these services will be much easier and available for anyone to use and so that's that we think is going to be also very exciting and so yeah i think pretty much you can now find for whatever the requirements are you can really find those solutions in the market great very good and and maybe just to i'm just going to answer part of this question as well uh the the specific question too uh from from the audience here was what hardware uh do you use to do the lidar scans with ipads and so that's a ipad pro with lidar scanner so i think there's a couple of different versions maybe two different sizes of that uh cost differences but it does require that the uh has the the lidar camera on it as well yeah very good all right so let's see what else we have here um one of the questions uh was how do you how do you figure out the the time so let's take the lycan or any any of the car examples and you're you're doing color uh overlays or accessory overlays or anything like that how do you get the accuracy um you know even some other projects that we've been talking about um how do you get the level of accuracy so that the physical object is completely covered and we're only looking at the overlays the augmented overlays in in the context of that object what's the the best way to do that without uh you know ruining the uh the illusion that augmented reality creates so yeah i think not to get too technical the reality is that you guys have before you have done a great job making it easier for us to just basically use the actual physics physical reflections through the camera of the device and then we just overlay the color um i think at the same time this needs a lot of testing because we have we have seen that this works better with some devices than other even in their ar enabled um but yeah i think there's a lot of testing going back and forth and really playing around and you can imagine clients being like that's not the purple that i want so i would just say play around and make sure your clients test it out before you release it because otherwise it's a it could be painful right right okay um we have uh just a couple of minutes left here um the the lycan project for fast the furious when you guys worked on that i wanted to know if uh if you actually got to meet vin diesel in that uh yeah yeah that scenario yeah we became best friends we [Laughter] we didn't get to meet the guy no i i wish i was in the car next to him when he was jumping and you know driving a car out of the building but yeah i know we didn't but funny so how can people uh get more information about visionary 777 oh you see websites vsan7.com and you know i'm i'm pleased literally i'm very excited thank you so much for the opportunity brad it was exciting talking to you and again thanks to the whole team for arranging this extraordinary conference i know it's not easy and yeah looking forward to speaking to anyone who wants to chat more about this in the future hopefully in person next time there you go well thanks so much for being here and uh thanks to everyone for for watching the session and uh we appreciate all the questions if you have any other questions like david said feel free to follow up with us and we're more than happy to answer those cheers thank you everyone you

2022-03-21

Show video