Engaging the Workforce and Customers through AR/VR
00:00:03:22 - 00:00:40:29 Speaker 1 And welcome and good morning. We're going to kick off today's seminar. It's 932 here, so thank you for joining us. I see a few more people are popping in in our attendance count, but I do want to respect everyone's time today. So my name is Jason Trombley. I am an instructor here and NWTC in Green Bay, Wisconsin. I teach in trades and engineering and I'm part of our industry 4.0 development team, which focuses a lot on data analytics, cybersecurity, AR, VR and additive manufacturing.
00:00:41:00 - 00:01:10:29 Speaker 1 So if you attended any of our previous seminars, we covered some of those subjects and we've got one more coming up here we'll talk about in a little bit additive manufacturing in April. So I'd like to start by thanking our guests for joining us and our speakers. We've got a really exciting group today. I hope to have some great conversation, questions and answers as well for our first speakers, and that can be found if you're new to teams and the Q&A app on the right hand corner of your screen.
00:01:12:12 - 00:01:42:29 Speaker 1 I did post a link for a post survey, so if you would, our team would greatly appreciate it if you would take a couple of minutes and fill out the survey for our seminar today. You'll also get that as a follow up email as well. So recording today, we are recording today's seminar. So for those of you that have to go or teammates that we're able to attend, we will send the recording out as a link as well after today's seminar. 00:01:43:00 - 00:02:07:15 Speaker 1 So again, thank you for joining us today. We are talking about augmented and virtual
reality and how it is affecting our industry, how it's improving our processes. We've got some great speakers that are going to talk on behalf of that on both manufacturing side and the construction side. So I'm super excited to have both industries represented here today with our panelists. 00:02:07:19 - 00:02:32:05 Speaker 1 One note for housekeeping. We unfortunately, our original keynote speaker was unable to
attend today's events due to unexpected circumstances. And graciously, Hector has taken the lead and will be our first presenter today. So thank you, Hector, for that. And Casey and Amy and Mike will be following up after our keynote today.
00:02:38:00 - 00:02:43:16 Speaker 1 It's good morning, Hector. 00:02:44:27 - 00:03:09:18 Speaker 2 Good morning, Jason. Thank you. Thank you so much. Thank you for having me here. Thank you to all who are attending this conversation. Thank you to all the panelists. I'm so excited
to talk about this topic. And. I'm a fan a big fan of this. Of this. Of these technologies. How can an augmented reality how can actual reality can improve the way people engage with information? 00:03:09:27 - 00:03:33:04 Speaker 2 And this will be the main topic of my conversation. Right? So I will. I'm sharing the grade now, my screen. If you have any questions, please use the Q&A section of the teams, and I will gladly help you to resolve any doubts you may have. And by the way, today is February
14th. What a better way to show that you care by sharing knowledge. 00:03:33:04 - 00:03:58:02 Speaker 2 Right. So let's start with this. And without further ado, again, thank you so much for your time. I appreciate your interest in this conversation. My name is actor humanist. I am basing Mexico City and I work for Rockwell Automation. I've been working for Rockwell Automation for about four years, and before that I worked for another technology company that is PDC. 00:03:58:16 - 00:04:32:02 Speaker 2 With this background, I've been able to work with augmented reality technologies and move forward into other extended reality solutions, right? So today's conversation will be about how can we focus that energy? How can we work with this technology into making people's lives easier within the industries? On how I was, I was telling you how we share, how we interact with information, how we make better decision and intelligent decisions by having the information in front of me.
00:04:32:07 - 00:05:07:15 Speaker 2 Right. So this is the agenda for today's conversation. I will try to be very punctual with each with each part. And I hope you find this interesting at the end. We're trying to make these easy to understand, make you feel interested on implementing this technology, experimenting with this technology. And at the end, on the on the work field, in the end, as part of the workforce or leading a workforce, you will be able to choose between these solutions and make people's lives right. 00:05:07:21 - 00:05:33:05 Speaker 2 So let's begin bursting. First, the long and winding road of digital transformation. I would like to say that when we talk about digital transformation with our customers, it's an easy topic to discuss. But really it is. And sometimes we we think about digital
transformation as something ethereal, something that cannot be college or is only data floating on top of our heads. 00:05:33:19 - 00:06:02:29 Speaker 2 And but that's not really the case. We use that data. We do you use that information. We take it and we take advantage of that information. But first, we need to consider three fundamental pillars. Okay. So before we begin choosing our solutions or starting doing some air experiences or email modeling, we need to consider these these elements. First off, the assets on which we take that information, we, we extract that information and make it useful.
00:06:03:11 - 00:06:29:27 Speaker 2 Then the processes on which we are trying to improve make it better for our users. And talking about users on top of it all, there are the people without the people using the information, without the people using that technology, we're practically lost because they need to get used to that information, to that solution. They need to get used to changing the way they did things, and maybe they feel comfortable with one thing.
00:06:29:27 - 00:06:58:22 Speaker 2 But now we will make them feel more comfortable because we are using the right the right data for them for the specific role. Okay. These three pillars and and that distributor build the digital transformation strategy that we've trying to to push us as part of an organization. Now, because of this, we need to consider that the potential of digital transformation is clear.
00:06:58:29 - 00:07:27:12 Speaker 2 Right? We are looking at percentages and numbers and money and money saved, time saved, a shorter change over, etc. But at the end we have real, real use cases with our customers in food and beverage, in mining, in life sciences that are implementing digital transformation technologies in order to make their lives easier and in order to improve the way they do things. 00:07:27:18 - 00:07:59:00 Speaker 2 And of course, impacting on and impacting on the business right? Making making their machines more available, making their users more comfortable with what they do, more secure, of course. But this is just an example of the numbers that we can find when implementing digital trends, implementing digital transformation technologies. The thing is, the early adopters are surging ahead. Let's be honest, augmented reality, it's not really not such a really
new topic. 00:07:59:08 - 00:08:20:09 Speaker 2 However, the way we implemented in the industries is a little bit new. And if you if you talk about my personal experience, if we talk about my personal experience in the area in which I developed a business, then yeah, it's newer than other places in the world. However, when we have these early adopters, these people are surging ahead.
00:08:20:18 - 00:09:01:03 Speaker 2 They're finding benefits of implementing digital transformation technologies in, in, in, in a way that they can take information, identify their areas of opportunity, finding a return of investment, and at the end, benefiting the businesses they work with. They work it. So for people who are trying to develop technology for these industries, in the case of making information clearer information, more useful information easier to obtain, we need to re-imagine our ambitions. 00:09:01:16 - 00:09:27:13 Speaker 2 What do we see as our potential? And when I talk about potential, these maybe will think that something related to industry or a customer. But we as innovators, as engineers and as technical people, we always try to remind our our ambition, get the latest of our technology and make it work to our benefit. For our benefit. What are what is our digital potential? 00:09:27:13 - 00:09:53:13 Speaker 2 What can we take advantage of? Create machine learning models, create augmented reality experiences, all those things can be placed into something useful. For now, this is 18
Seth right? That people who work, people who can take benefit of what we create and how can we take these solutions for our own knowledge? And what's holding me back? How can I get this technology? 00:09:53:13 - 00:10:17:24 Speaker 2 How can it work? We, we, we weave with information. How can we create something from scratch, maybe something that's already been built for a specific use case? All those things will have an answer today. And I hope that at the end, and maybe with these conversation, with all these speakers and information that they will share with you, you will find something useful for your next endeavor, right? 00:10:19:07 - 00:10:42:27 Speaker 2 The first thing so the first thing when we talk about extended reality, augmented reality is where is my knowledge? And I would like to make a boss here. And just to say that when I talk about extended reality, I am considering the fact that when we are using something that enhances the information, sometimes it's just placing something in a physical space. 00:10:43:13 - 00:11:11:24 Speaker 2 Sometimes all the things are virtual. Maybe sometimes it's just looking at an image in
front of me without having a printed element. So that's why I am talking about extended reality. It's a big spectrum, and within the extended reality, the area that we need to consider from augmented to virtual to the real to the real physical space. So that's
why I am I'm doing this differentiation between extended and augmented reality. 00:11:12:05 - 00:11:34:22 Speaker 2 So let's move on. What is my I know that I was telling you I would I would focus on some industrial use cases that we happened to find. Every time we talk with customers, the first thing is how knowledge leaves the organization. Sometimes people retire, sometimes people find a new job, and with that they leave with a knowledge.
00:11:35:04 - 00:12:01:03 Speaker 2 And where they live with the knowledge, the new the new workers or the old workers who depended on the people who are retired cannot find that information to do the work, the work they need to do in a in a good way. Right. So the next thing is the information that we have sometimes they are it's printed in heavy tomes and maybe these these heavy tomes are outdated or maybe something even worse. 00:12:01:03 - 00:12:28:24 Speaker 2 The information is placed not only the tomes on the books, it's it's in a sheet of paper. It's in a blackboard that's been erased. I don't know. All these informations require
a unique repository so everyone can be consulted and every time they want to write. The next thing is that our our users, the organizations would love to have all their processes working correctly, everything at full capacity. 00:12:28:24 - 00:12:57:09 Speaker 2 Their quality inspection is passing every time their production running smoothly. All the things that that we might consider is a dream. There sometimes happens that every week or every two days we find an issue. The quality inspections are not quite correct. The production stopped because we couldn't finish a service or maintenance procedure because we didn't have the proper information.
00:12:58:04 - 00:13:26:10 Speaker 2 All all things are working in minimum capacity. And finally, the changeover when we talk about change or are we talking about how can we change the configuration of our machines? And considering the recipes for different products and different configuration of products and it takes sometimes to stop the process, change the configuration needed, and then move on to the to the new configuration for these different products, these different line of bread in this case. 00:13:27:02 - 00:13:57:12 Speaker 2 Yeah, this this slide shows you that it's taken like about 15 minutes to do the changeover.
But what if it was shorter time? What if we could use this time to make something more productive if we consider that these these doesn't happen just one time in the week, or maybe we need to do several changeovers during the day, this time gets summed up and you get more and more time lost, more and more time lost, and impacts directly in costs. 00:13:57:24 - 00:14:29:04 Speaker 2 So as you might, you may see it's always incredible to create elements that that that are virtual elements that will help us identify how can we work with augmented reality. But the things you create, the things that you're going to do as a student, as a as an engineer, can benefit to these these kinds of issues. Right. And we have to identify these these pains and make it work for for all the people, for other organizations, once you're considering to move into this kind of technology.
00:14:29:29 - 00:15:01:02 Speaker 2 So we need to break down the industrial skills gap because these issues are maybe big and mostly because of the lack of information we're having a huge skills gap. And currently during these years, we're having people who are retaining, as I was telling you, ineffective traditional training methods like I said, I was telling you the outdated books, the over the shoulder training and whatnot, and the negative perceptions of industrial work which I wish there weren't. 00:15:01:02 - 00:15:25:09 Speaker 2 But there is the thinking that this is a dirty, dangerous job, not very technical and not technologically advanced enough for me, etc., etc. Things that need to need to be or of course, the current friendly working information is insufficient to their needs, to their security, to the way they see the information and to the way they feel secure by using the tools and elements that they use to to complete a task. 00:15:25:18 - 00:15:57:09 Speaker 2 And finally, the things that been happening during these two or three years with the pandemic, the way we work now, sometimes it gets difficult to work directly or life in person with another with another colleague. And we need to find a way to help them solve the same issues without trying to be onsite right. Remote working has been moving forward since the pandemic,
and sometimes it's easy to have these teams meeting. 00:15:57:18 - 00:16:23:05 Speaker 2 But what happens when you need to have full fatigue instructions without having the expert in right in front of you or next to you? Right. These are things that we need to tackle using these these kind of technology, these kind of extended reality technologies, so that these things considered happened to impact the way markets are facing greater pressure. 00:16:23:28 - 00:16:48:14 Speaker 2 The the growing worker skills gap that I was telling you about the increase in product and process complexity. We're always evolving. The technology is evolving. And because of
that, we need to find a way to act, make the learning curve shorter, too, to to tackle these new technologies. And and in the end, evolving the customer demands we need. 00:16:48:14 - 00:17:08:08 Speaker 2 We the customers, all of us as customers as well. We need things faster. We need things easier, and we need things with a higher quality. Okay, so where do I begin? All these things lead us on how we interact with information, how we share knowledge, and how can we access knowledge in an easy way? In an easy way.
00:17:08:20 - 00:17:31:03 Speaker 2 Because as I was telling you, two or three slides before traditional work and instructions and methods fall short where having this product complexity is complexity growing the time and cost of training, the way we share information that maybe it's not really updated or the person who's the expert, it's not it's not me around to to give some training. 00:17:31:08 - 00:18:02:25 Speaker 2 So these information needs to be in front of us immediately, long and costly sales cycles and employee efficiency. Of course, the first time rate growing out of of success and safety, we make we have to make them feel safe. We have they have they need to have the right equipment and, of course, having the right information. So they don't make a mistake and not only affect the business, but first of all, affect themselves. 00:18:04:15 - 00:18:40:04 Speaker 2 And it's important because when you think of a solution and extend reality solution, maybe we think about something enjoyable, fun, like a game, something that we can make like a mario kart. There are augmented reality circuits, right? Something enjoyable and fun
that we can share with all the family. But in the case of organic or industrial organizations, 75% of our workers are on the frontline and they need that information in a way that they can interact with it securely and they can make things faster and efficiently, more efficiently. 00:18:41:24 - 00:19:09:24 Speaker 2 What do we say to people and not only the people that are our customers, not only people in the industrial world, is that sometimes we have the elements in front of us that makes zero sense to us, right? We see these image and we can find anything. It's really a very sterile, sterile area and not many things can be can be taken advantage of. 00:19:09:24 - 00:19:51:16 Speaker 2 Right. However, if we have sensors here, we have places, if we have databases on which
we have the behavior of these of these machines, of these assets, we could create a digital environment on which we can take advantage of that information and place it in front of us so we can interact with and see information real time. So the issues that are appearing in front of me at the moment, I'm looking at that information and all those things to make the digital menus, the information that I'm connecting, the interface that you're looking at here comprise an augmented reality solution and what's the purpose of it? 00:19:51:29 - 00:20:15:01 Speaker 2 Connecting the workers with the critical information. It will allow the superimposition of digital information directly to the real world, reducing the cognitive load, the the heavy the heavy task of going to the computer. Look at that information, then going back to solve the issue and see that all things have changed. Now we have different data, we have a different behavior.
00:20:15:06 - 00:20:45:19 Speaker 2 And this causes a high stress for for our workers. And we try to improve work, efficiency and accuracy. I'm not telling you these just as an anecdote, right? The value is clear that our numbers that are showing us that industries are betting on these kind of technology. So it's a body of air. It's here in 2021, 65% of application focus and industrial use cases were made with augmented reality. 00:20:45:19 - 00:21:16:29 Speaker 2 Right. We're expecting to have for next year 1.73 billion air mobile users. And this is
augmenting, this is growing, augmented, growing exponentially. Right. And the implementations allow our people or organization and our customers to reduce the cost, improving productivity, reducing repeat buckets and reducing travel time that will impact in the business and how we take advantage of our own operators and engineers and they can make their work more efficient. 00:21:17:15 - 00:21:45:27 Speaker 2 They are market is projected to be over 80 billion by this year. And of course, it's not only for use cases that our customers are creating or we have them create for in our personal case, but for example, we do use some of materiality solutions for some of our products from from some of our axes, from some of our support a from a support a teams. 00:21:46:06 - 00:22:11:22 Speaker 2 They use some remote assistance technology for our customers. This is a value that we
try to push forward and seed and make them our customers see that not only they can benefit, but we are benefiting to help them be better paid. So at the end where we're connecting frontline workers with critical information, we guide them through tasks, keeping the worker safe and in compliance. 00:22:11:22 - 00:22:33:10 Speaker 2 Of course, all the related on how can we see that information if it's with a mobile device, if it's with a pair of a eyewear glasses so they can take, take, take a look. And that technology, they can enable interaction with the system in context, having the elements, the physical elements in front of them and helping them visualize critical information.
00:22:34:04 - 00:23:06:15 Speaker 2 So we moving from traditional methods, methods to augmented reality elements and mixed reality, augmented reality, the way we interact with information and how can we see that, that, that data in front of us in real time and updated all the time. We have a unique repository of information we can update it and these will propagating to all our devices, into all our teams in order to benefit them from the real time updated information. 00:23:07:29 - 00:23:37:16 Speaker 2 So when you create or you're considered to create or implement some use cases we need to consider, how can we apply it into the real world or our teams or our classmates or whatnot? We can do some remote assistance and collaboration. We could do some knowledge based airport constructions. We can do CAD based air work instructions. We can create tailor data experiences with 3D and Iot, and we can do a product visualization and demonstrations. 00:23:37:29 - 00:24:04:04 Speaker 2 The thing is, all digital information is different. We could have some numbers, but we could have
some cat models. We could have some images, videos and elements that we capture in real time when we do a task. And all those things need to be considered when choosing the right augmented reality solution, right? So I would like to make that technology. 00:24:04:10 - 00:24:30:22 Speaker 2 My closest friend in this case, we can see technologies like a remote assistance and collaboration. The base of this solution is basically we're considering these kind of solutions is like having a video call, but using augmented reality to create digital marks that stick into the environment so we can follow instructions when having a call with the expert. Right?
00:24:31:12 - 00:24:58:12 Speaker 2 So how can this be done? We start a conversation. We can see the view of the people who's asking for help. This person scans the environment around him or around here, and finally they could start placing marks in the machine or in the process that they trying to resolve. As you can see, the video, there's no audio. We'll try to describe everything that we're
looking at, the videos we're placing these marks. 00:24:58:12 - 00:25:30:02 Speaker 2 And even if the user if the operator moves around the mask with Dick there and at the end you will have a documentation because the same system will capture the images of each mark you made. So you can have a follow up of what's what, what, what we did during the call and how can we take advantage of it to share this information, to share this knowledge and have an acknowledgment that the procedure was completed right.
00:25:30:02 - 00:25:59:14 Speaker 2 The way you identify how these could be played during the day across abolishing the buddy chain these days through the use cases right. The key use cases that is basically support, remote support for a person who's not there but who has a knowledge and they can share that knowledge without being there. Take some 30 minutes of my time having this conversation with the people with this person, and then follow the instructions so they can solve the issue instead of waiting for you.
00:25:59:14 - 00:26:25:12 Speaker 2 Right. And if you're in the expert and two days have passed and the issue persists, right. We need to avoid that. The the element that I wish that I was showing you involved and the pump and what not having information the information in front of you interacting information that you can show through a series of images, labels, text gauges, digital gauges that connect to real time information. 00:26:25:27 - 00:26:54:27 Speaker 2 And this is a solution or you need to consider that there are solutions on which you create the the experience from scratch, the difference from the solution to some others on on which you use a lot of programing and a lot of code is that these in an in an industrial environment will benefit the user because they don't need to create the icon or the app from scratch or a lot of coding. 00:26:55:12 - 00:27:25:20 Speaker 2 So there are solutions that I only drag and drop to place the media that information to benefit them. And there's there's some there are some use cases that we're looking at here,
like the guided instructions for the line that it's a first video in the middle, we have the product familiarization and part, for example, on which we can have an x ray view of the elements within that pump and start looking at this information for training or for new hires. 00:27:25:20 - 00:27:56:29 Speaker 2 For example, and customer self-service instructions and which we can ask sorry, on which we can scan the environment and then moving, moving through some instructions arrows. So, so the user can look at their task and then the real time information from the area on which he's working on or she's working. Right. So these are some just some examples of how can we
create these from scratch? 00:27:57:11 - 00:28:21:00 Speaker 2 And there's a solution for which you have a blank canvas and the only thing you need to do is do some binding, some of the information, dragging the specific widgets to place cat bottles or a 3D label or AD three to gauge to connect a real time data so we can publish it. And it in this specific library of experiences, right? 00:28:21:05 - 00:28:50:23 Speaker 2 With only one application, we can access our library of experiences and choose the use case related to my team or related to the do the training I need to do. Right. So how do we activate this information? We can activate it. Activate them by placing them on a horizontal
surface. We can activate them through a barcode. We can activate the true and specific image from our organization maybe to maybe the college. 00:28:51:02 - 00:29:21:20 Speaker 2 The college logo, for example, maybe the Rockwell logo or whatnot app. Or maybe if you scan
your surroundings, you will activate that experience when you're in front of their surroundings and you can you can work with it. These are some use cases for for this solution. The solution allows me to be creative and start creating this and start building my air experience from scratch without the need of, of a lot of coding. 00:29:21:20 - 00:29:57:10 Speaker 2 Right. So the next one would be knowledge captured. What if I don't have enough cat models or I don't need to do animations or sequences? What if the only thing I have is the expert? So what if the expert could capture some information through videos and images? Right. Some instructions. And then with the help of a pair of eyewear glasses or maybe my cell phone, I could move around and see what are the the instructions that the that the expert captured.
00:29:57:12 - 00:30:32:20 Speaker 2 Right. Some of the things if I'm using an eye where that can place me, I will do a geolocation. I could have some guiding into which workstation I need to move next to finish my task. Some of the things that we can see here, for example, for medical devices or the life sciences industries, is how can we use these eyewear like the HoloLens, to see what the expert captured and move around my environment to follow the next instruction? 00:30:32:20 - 00:30:58:26 Speaker 2 So we have some instructions that there that the expert just wrote. He placed some videos and images associated with each step and make the solution, identify each step with a series of voice commands, next step and post, etc., etc.. And finally, when I finish one step, I can move it to the next workstation and the same solution will guide me through it.
00:30:59:17 - 00:31:22:05 Speaker 2 There are so many things that we can capture here, or take pictures or have a feedback of what I'm doing in order to better place my information and be safe on what I do without being too distracted. Right. I if I want these services to follow me, that I will have it in front of me. But I can place interesting work in one area so I can focus on what I'm doing. 00:31:22:13 - 00:31:54:16 Speaker 2 But if I have any doubts, I can look at the interface and start and start working. This could be done in many, in many, many, many a devices. Sorry, we could do it with a tablet.
We could do it with some eyewear like the HoloLens. We could do it with real wear for a to the experience. And there, there there are a lot of differences on the way we work with these solutions. 00:31:54:27 - 00:32:16:24 Speaker 2 What I mean is if I'm not in the right environment to use glasses or I'm not in the right environment to use some mobile device, then we need to consider that our air solution needs to be flexible. Our air solution need to be versatile in order for for the user to feel comfortable on what he's seeing, but also what he needs to use to see that information. 00:32:17:03 - 00:32:53:09 Speaker 2 And this is a great example. I'm following the instructions, but using different, different,
different mobile devices, also continuing the way we can acquire a pair of HoloLens or a pair of real work. And that versatility helps us use the use elements that our, our, our team already have, right? Like a cell phone, a tablet, etc.. And, and take advantage of it to see that augmented reality technology solutions are these are some use cases and say, gee, why am I showing this value chain use cases? 00:32:53:28 - 00:33:23:05 Speaker 2 The betas are really exciting, right? But they're just having the technology for the sake of having the technology, something that it's not very useful if we focus that energy. So we're still into that energy that that the benefits of the technology into use cases or areas of opportunity for our teams, then we're moving to the right to right way of digital transformation because this impacts on how we take advantage of how it benefits our businesses and how it better the costs. 00:33:23:05 - 00:33:54:27 Speaker 2 Right. So this is something that we need to consider every time. And if you have any doubts of more use cases, please let me know. I will be glad to to, to, to guide you through it.
And finally for us with the reality, also the quality inspections and based on cat models, but not heavily based on on the on the on the cat modeling, but pleasing that as a as a base for the the the area in which you're going to work. 00:33:55:08 - 00:34:21:15 Speaker 2 We could do some procedures on which we we will scan the physical object. But because of the treaty card element that we used, we can place on points of interest and do some inspections or maybe for maybe an assembly or the way something was built or the way we need to place some some cables or parts of the machine so we can have a pass or fail or an acknowledge that the things were done right. 00:34:22:13 - 00:34:48:13 Speaker 2 And in this case, this is a prebuilt solution. We need to in a need to create the interface or whatnot in a these these elements already exist in order for the for the user to follow instructions and see the quality inspection elements that need to be considered for the task to be finished correctly. The thing here is that the same user could could benefit from having a feedback that meets the user.
00:34:48:19 - 00:35:09:27 Speaker 2 Can see inspection if something is not right or is not exactly the way the instructions are, is telling him they can have some feedback, write some comments, take a picture and said, You know what, we need to check this because you are seeing these instructions. But I saw this slide, so we need to correct it and some other things that can be done. 00:35:09:27 - 00:35:48:18 Speaker 2 We want inspections or we need to consider for an A or a solution is that we need to have at the communication information that tells me which person did what, how long it took for that person to finish that procedure and how long it took to make a specific step from that procedure, etc., etc.. This is this kind of analytics or trends will help me make more efficient the way we we need these inspections or how can we change the way people need to write with these inspection to make it make them feel safe or more efficient? 00:35:48:18 - 00:36:13:15 Speaker 2 Right. So this is another one of the benefits from these, for example, is that we try to
mix augmented reality solutions with artificial intelligence solutions. So if maybe something is out of place, not only I can share the feedback, but at the same system will tell me you know what, this needs to be place or this needs to be closed so we can have a successful quality inspection procedure. 00:36:14:12 - 00:36:45:08 Speaker 2 These are some use cases across the value chain in coming by inspections, feel making, inspections of upskilling, training, etc. and these these, these, these need to be considering
many areas of of abolishing of our industry. Right. And and not only that, as it was telling you, maybe I would say I'm always heavily influenced for augmented reality. But in the case of proper automation, we need to consider that sometimes we need to make everything virtual. 00:36:45:08 - 00:37:25:14 Speaker 2 We need to feel secure in a controlled way. So when we when we take a step into the real area, into the real world, and start doing some commissioning or start doing some implementation of a plant, we are certain that all the virtual simulation were successful and they didn't have any errors. So in this case we are pushing, for example, between the reality technology to consider the digital twins right virtual model of a process and that we can use it to improve the design of the optic of the commissioning in the operation phases of a project.
00:37:25:14 - 00:38:15:26 Speaker 2 And as they would tell you about percentages and whatnot of augmented reality, by 2020 one half of large industry companies will use digital twins or their movie to those tweets. Sorry, resulting in 10% improvement of of effectively they saw the way they do things. So for these digital engineering using virtual reality for commissioning, we could do it throughput analysis, we could do some machine prototyping and operated operated training systems by using real time, real information or images that we already have and some consideration of how the machine spool, how can we place elements into an specific area and some other elements that are moved or created or simulated with real considerations? 00:38:15:26 - 00:38:43:02 Speaker 2 Right. So some of the things we do or the primary applications we, we, we specialize
in for virtual reality are material handling, packaging, CPG and and machine builders, right. What, what do we do with we can create that we can take advantage of CAD models please the elements from from a line the way they move or the way they can they they behave in the real world as well. 00:38:43:10 - 00:39:19:19 Speaker 2 Once we create or use the standard catalogs to create models of model elements, we can connect that this would be the next step, that we can communicate with the tags from our boxes, connect our models into the text, reacting to the way we place and create those models and do some testing, testing of the line and using that real time information that really information from a project in order to, to, to to figure out if what we're doing is correct or what changes need to be made to avoid any catastrophic failures or catastrophic issues. 00:39:20:03 - 00:40:13:28 Speaker 2 Right. All those things look very cool in the computer, but at the end, all those training
on how we did things can be placed into a virtual reality environment. So they will have some that our operators, engineers will have a baby virtual reality training. They will look at how the line is behaving. According of the modeling we did before and we could
do cost effective procedures, cost effective trainings that will be updated and replaced and a a saved into a unique repository so they can and consulted anytime they want or consulted any time a new a new hire needs to add familiarized himself or herself to the the industrial environment. 00:40:14:05 - 00:40:40:16 Speaker 2 They're starting to work it right. So this is an example of what the person is looking with their virtual virtual reality elements, their devices, so they can follow instructions in a safe way, in a secure manner, and eventually they will move into the real environment so they can finish a work in an inappropriate way. Right. So just to finish, let's consider that the innovation is here. 00:40:40:28 - 00:41:17:28 Speaker 2 The innovation it's it's moving and evolving. And we as Rockwell specifically in experience of the company, we have some partners and some strategies. We with the best, one of
the best or or trying to work with with always the best companies and best partners to to choose to offer some projects or, or helping our customers as consultants to choose the best technology or showing them the benefits of augmented reality and virtual reality for commissioning, for training, for knowledge, capturing from the only sharing, etc.. 00:41:18:12 - 00:41:49:03 Speaker 2 So if you if you move forward into a project, you need to consider as well, flexibility and versatility and take it taking consideration that there are a lot of opportunities to to help show the the great potential that augmented reality can can share not only us as the industrial organization, but you assistants, students as teachers, professors. There are elements that we can take advantage for, for our own benefit as well. 00:41:49:15 - 00:42:18:20 Speaker 2 So just to make to summarize this, this presentation, we can address increasing product and process complexity with augmented reality. We can improve workflow safety, efficiency and accuracy. We can reduce cost and improve operational efficiency, and we can enhance customer experiences.
All these on the way, we can be more efficient, on the way we interact with information and the way the information can work for us and make more intelligent and faster decisions. 00:42:18:24 - 00:42:43:19 Speaker 2 Okay. So if you want to be as happy as this character here, if you want to have all these use cases and to be benefited for all these use cases and come along with the augmented reality solutions, whatever they are, and find that when identifying a specific use case or these benefits will present themselves basic. So thank you so much.
00:42:43:19 - 00:42:59:04 Speaker 2 Thank you so much and to everyone and I hope you find these very interesting and there's a lot more information in this conversation today. So I hope you enjoyed. But for myself, it's all I have for for you today. Thank you so much. 00:43:00:28 - 00:43:27:25 Speaker 1 Thank you, Hector. Wow. Great presentation. Very powerful. I did enjoy all of your animations and your videos, by the way. So, yes, great overview and detail information on the digital transformation. I think you hit a lot of the talking points that we have internally here.
So again, thank you very much. We will save our questions here for the end. 00:43:28:21 - 00:43:31:25 Speaker 1 But again, thank you. Thank you. 00:43:32:11 - 00:43:33:15 Speaker 2 Jason. 00:43:33:15 - 00:43:38:14 Speaker 1 You're welcome. I mean, can you hear me? Yes, and we.
00:43:38:15 - 00:43:38:29 Speaker 3 Can hear. 00:43:38:29 - 00:43:46:19 Speaker 1 You. Yes. Awesome. If you would. Go ahead and introduce yourself then. Go ahead. Appreciate it. Thank you.
00:43:47:06 - 00:44:17:08 Speaker 3 Yeah, of course. Hi, everyone. Thank you so much for being here today. My name is Amit Schakowsky, and I'm here to teach you a little bit more about how these extended reality technologies are fitting into the world of Gen Z. So we've all experienced some of the most unique years of history, years where creativity has never been more important, depending on technology, to connect literally everyone and everywhere around us. 00:44:17:24 - 00:44:48:15 Speaker 3 And virtual and extended realities are of the technologies that are trending across the workforce and helping Gen Z use their creativity to transform what is possible both in the classroom and in their future careers. So with the first smartphone coming out in the mid 1990s, Gen Z was the first generation that has had technology embedded into their lives from the beginning, making us the quote unquote digital natives.
00:44:49:00 - 00:45:20:19 Speaker 3 And by 2025, we're going to make up about 27% of the workforce. So why does the workforce need to know about us as we enter this new era of our lives? Mainly a big thing is having an open mindset with everything from social issues like climate change to focusing on collaborative learning. Our constantly changing culture, especially with COVID and all of these new technologies, has led to our generation specific. 00:45:20:19 - 00:46:04:25 Speaker 3 Lee to thrive a lot in fast paced, everchanging environments. All right, so at the beginning of my education journey, this was the technology that I was super pumped about using in my class, a projector where you were using a clear sheet of plastic paper and a marker to make a visual presentation. And as I was walking through the halls of my university at Michigan State, I had to take a second to realize that at our newsstand building were classes that look like this with virtual reality goggles on and everybody around them using it.
00:46:05:12 - 00:46:41:21 Speaker 3 And that in my engineering college, actually virtual reality lectures are taking place right now to teach things like environmental design. So going from best to best in 15 short years, how can we make sure that this technology is actually being used to its full potential when the possibilities are really seem endless from the start? And I think that the key here lies in real goal setting, making sure that we're using this new, shiny, exciting technology to solve struggles of learning. 00:46:41:21 - 00:47:18:08 Speaker 3 Today, 65% of Gen Z students are visual learners. In with X are. This is making this learning experience more hands on and effective than ever before, allowing students to dove into complex topics right at their fingertips in front of them. This means exploration of things
that we never had access to before, things like being able to blow up a microscopic atom to the sides of your desk or viewing internal body structures, being able to interact with those shown in real life proportions. 00:47:19:03 - 00:47:45:23 Speaker 3 This technology is making resources like this and other really rare off campus resources more accessible to students than ever before. Imagine bringing your students on field trips around the world from any time in history. Being able to explore the catacombs in Paris
or allowing ISE into some of the most unique artifacts and Smithsonian museums out there are today. 00:47:45:23 - 00:48:07:20 Speaker 3 What I see as one of the main ways that x r is helping here is by transforming what safe, hands on training looks like and really gave some great examples of that without having to worry about what harmful chemicals you're using in a lab or how you would handle a difficult scenario in an operating room or in a factory. 00:48:08:06 - 00:48:38:09 Speaker 3 This technology is letting people come as close to the real thing as possible, perfecting their skills before they enter the workforce. But like I said, my education didn't look
like this with extended reality all nice and shiny and pretty, so as many of you are probably saying right now. So why should you care about this extended reality, Mark, before entering the workforce and take it from me? 00:48:38:25 - 00:49:05:02 Speaker 3 Since I started my professional career, my sophomore year in college, Erin VR had been at the complete center of focus. So this November I was actually shown this automation bear part. On the left hand side. I was tasked with giving virtual reality tours of Rockwell's actual working assembly line in Milwaukee, which was one of the really big highlights of the fair, which I was super lucky to be able to work. 00:49:05:24 - 00:49:43:25 Speaker 3 My other first internship, which was in the middle, was actually building out a business plan and marketing strategy for an augmented reality called Progress. In my other internship at Bird of a data center, manufacturing company is also giving their customers now an app to view more about the rack enclosures I worked on shown on the right. In my experience of
entering this workforce, in all of these different examples with just a tiny sliver of knowledge about AR and VR, it's not going to be uncommon as Gen Z moves into their careers. 00:49:43:25 - 00:50:19:03 Speaker 3 The extended reality market was 35 billion in 2022, and it is projected to hit 346 billion by 2030. Just let that sink in for a second. Clearly, there is extreme potential and investment happening in this space. So actually in December I was able to work in Cleveland at a manufacturing plant and something that an employee told me is that what keeps them up at night looking around the plant floor is seeing mostly retirement age employees.
00:50:19:13 - 00:50:52:25 Speaker 3 And how are they going to get these new workforce employees excited about working in an area where it really isn't as favorable to them out of the gate? And I think that answers a really good amount of these questions. It actually leads to a 94% higher conversation rate off the get go. But where underlying problem is here is that there's a very large skills gap being formed between this last generation and Gen Z. 00:50:52:25 - 00:51:20:27 Speaker 3 And with X-Art, it is helping take the knowledge out of these previous workers heads and put it right into Gen Z's hands. Training employees with this new technology is bringing much more accuracy to task and is bringing the computer's eyes right onto the plant floor with your workers SO with Gen Z. Why specifically is this focus important education as we know it today? 00:51:21:05 - 00:51:47:00 Speaker 3 Lead students to explore studies with real world problems and projects, which is great, super happy about that. I've gotten to experience really unique projects that have really opened
my eyes to the world's markets. But with the addition of X are now, these students can learn from resources all over the world and sharpen their skills before they even step foot into their careers. 00:51:47:25 - 00:52:16:05 Speaker 3 But at the absolute core and introducing these students to this technology is because it is not going away. Companies are competing in a new space where you could be an early leader in seeing examples of this technology before you enter the workforce is allowing people to view in new industries and application is where this technology can be used in the future. 00:52:16:05 - 00:52:45:10 Speaker 3 I've included a few resources for you to keep the conversation going and learn more about how you could apply these in your future careers. Mindspring and PTC are both really innovative, great companies focused on pushing air into new industries throughout the world. Their
blogs have a ton of great info and examples to keep you really inspired and inspired and up to date with all things XR as well as LinkedIn. 00:52:45:10 - 00:53:13:25 Speaker 3 It is a great resource for exploring new innovative companies and speakers. Following hashtags is a great way to keep up with this. I did mention Michigan State University today. This is a place that is very close to my heart. I just graduated here last spring and I would
just like to say there were some horrific events that happened last night and the Spartan community is here to support you and go green. 00:53:14:16 - 00:53:43:19 Speaker 3 But as our creativity gives us things like the light bulb, the Internet and the whole reason we are here today on Microsoft teams, the real future of this technology in X are lies in the hands of Gen Z. So use your creativity to find out more about what is possible within the classroom and beyond in your careers. Thank you. 00:53:43:19 - 00:54:19:11 Speaker 1 Thank you. I mean, yes, Gen Z. Right. I like the picture of the old overhead projector. I remember that as well. So that dates me a little bit. But yes, these these new technologies
and students and new employees, what a great way to engage the next generation with technology. We find the same thing here at NWT. You see students walk past some of our AR VR labs and they're just there looking in the windows and they want to know what's going on. 00:54:19:11 - 00:54:32:24 Speaker 1 And then when you actually get them to to experience it, it's just something that they remember forever. So thank you very much. Our thoughts here in Wisconsin are also with your colleagues in Michigan State.
00:54:34:19 - 00:54:36:05 Speaker 3 Thank you so much. I appreciate it. 00:54:36:18 - 00:54:37:06 Speaker 2 You're welcome. 00:54:38:18 - 00:54:40:17 Speaker 1 Casey, can you hear me? 00:54:42:05 - 00:54:43:06 Speaker 3 Yes. Can you hear me? 00:54:43:17 - 00:54:45:04 Speaker 1 I sure can. Welcome. 00:54:45:25 - 00:54:47:05 Speaker 3 Thank you for having me here. 00:54:47:13 - 00:54:51:14 Speaker 1 If you would, tell us a little bit about yourself and what you do at Marin.
00:54:52:15 - 00:55:23:20 Speaker 3 Yeah, of course. Let me share my screen so a little bit about my own. We are a general contractor here in the central Wisconsin area. We have about six offices in Wisconsin, one office in Iowa. And I work in the virtual construction department for the last five years in an industry and an industry as a whole, I've worked in virtual construction for about seven and a half years. 00:55:24:24 - 00:55:49:03 Speaker 3 So throughout my time, I had touched a lot of technology. And one of the technologies
that we use here at Myron is the HoloLens, the iPad with augmented reality, and then VR, virtual reality. So I kind of want to give a background on how we're using that here at Myron. So they have back story and why we're using this technology part of the virtual construction department. 00:55:49:13 - 00:56:14:05 Speaker 3 We do a lot of coordination, which is bringing the subcontractors, the experts. So you got your mechanical subconscious actor, your electrical subcontractor, your tag engineers, all those key players that happen behind the scenes, all in a virtual setting. So what we do, we
bring in the models in a 3D environment, and we look through all the models and try to find issues. 00:56:14:16 - 00:56:37:04 Speaker 3 Because if there's an issue in the model, there's going to be an issue on site, and we don't want that. So we try to help the field by capturing those issues ahead of time and resolving it in a virtual setting. And then clearing it up and then sending it to the field with a crash free plans. So we have weekly meetings with the that core team to go through all of these issues.
00:56:37:21 - 00:57:08:21 Speaker 3 So essentially we're saving time and money in ways. So we do a lot of time and coordination in the virtual setting. But how are we getting that information to the field? So they are installing to our coordination efforts? Well, one of those things that we do, how we use virtual reality. So virtual reality right away, everyone thinks it's a video game platform, but in a virtual construction and construction in general, we're using it in a pre-construction. 00:57:08:27 - 00:57:33:21 Speaker 3 So before a shovel hits the ground, we're finding issues in that virtual setting. Again, bringing all those key players in that virtual world. So you can see our little avatars are
right here and we're looking at issues and how to resolve them inside the model. You can see my colleague go down here, Matt. He's in a virtual meeting inside VR with the architect who lives out in New Hampshire. 00:57:33:28 - 00:58:03:26 Speaker 3 So this is a way for us to collaborate and coordinate without having to travel far. After
we're done with coordination, we have the subcontractors re-issue drawings for the field. So again, they are installing to our coordination efforts. So basically we have all this new set of plans that we're sending out to the field. And again, we want to make sure they are taking our efforts and bring it to the field. 00:58:03:26 - 00:58:28:23 Speaker 3 And again, the way we can ensure that's going to happen is with technology. So we do something
called install verification. Here at Micron, one of the technologies that we use, I already mentioned in the Highlands, we can bring augmented reality to overlay the coordinated model in a real world environment to make sure those amps are being installed correctly in the right location. 00:58:29:12 - 00:58:52:27 Speaker 3 So this holds accountability and then verification that everything that we're doing behind the scenes in a virtual setting is also being translated, translated to the physical world. So we do most of it in Howl as well. We can also do an iPad because I iPad is more accessible these days and with the latest my iPad improvements with Wired are built in.
00:58:53:06 - 00:59:16:25 Speaker 3 We're able to do augmented reality with that. So here's a little screenshot of what that looks like in the HoloLens. Again, we can bring that coordinated model into that physical environment and we can ensure that everything is being installed correctly. So in this screenshot
you can see that we have a hangar place right here that is real world. 00:59:16:25 - 00:59:35:28 Speaker 3 And then we have this red pipe right here, which is a fire line that is sitting snugly on that hanger. So this assures me that this is going to be installed correctly if we look further down, we have all these core holes for all the piping and ductwork. You can see the model right here is going through those core elements. 00:59:35:28 - 01:00:05:28 Speaker 3 So again, we're holding accountability to our subcontractors after our coordination efforts. And then we can also use it with the iPad. So my colleague here, Sam, is walking through the site and looking at drainpipes to make sure that the equipment that will be sitting on top of it is going to hit those drainpipes. So before we pour the concrete
and insert the sleeves, we have it marked up on the real world study. 01:00:06:12 - 01:00:41:02 Speaker 3 He is using the model and using the transparency to overlay the digital world over the physical world. So how do we make sure that our subcontractors are holding accountability when we do find an issue or we do something called install verification reports, so we take screenshots whether that's off the iPad or the HoloLens, and then we showcase what is going on that we're seeing first, what the real world setting is seeing, and then we send it to all stakeholders to show that.
01:00:41:21 - 01:01:05:24 Speaker 3 So Contractor X, Y and Z, we need to adjust this or how is this going to affect down the line or domino effect if you have it installed? So in right here, here's a good example. We have a standpipe that's coordinated here, right here. But in the actual setting, the standpipe is a little bit bigger. But further down the line, you can see it's higher elevation. 01:01:06:03 - 01:01:26:21 Speaker 3 We noticed that it was going to hit a piece of pipe further down the line. So this was something that we were able to cache and then we were able to talk to both subcontractors involved in this issue and we were able to adjust it ahead of time prior to them going on site and installing. And then same thing with the hull ends.
01:01:26:21 - 01:02:00:04 Speaker 3 We can do the same thing by taking screenshots, talking about what we're seeing, and then sending it out to all stakeholders that are involved with the issue. So all in all, we have many technology tools, but one of the things that we are using here at Myron, augmented reality, virtual reality and mixed reality store with the HoloLens, the iPad and the VR headset, we're able to collaborate more. 01:02:00:09 - 01:02:32:25 Speaker 3 Were able to catch things you here before things are installed and then we're able to save money save time on the schedule. Construction schedules are continuing to get tighter and tighter and with the use of technology, we're able to help that schedule out and then we're also reducing waste. So in the old times, you're taking a tape measure and you are measuring off the design intent, but oftentimes the design intent doesn't capture everything. 01:02:33:02 - 01:02:58:19 Speaker 3 So then they're constantly taking down equipment and pipes, ductwork, and then reinstalling ordering new pieces if there is a conflict. So that's kind of in a nutshell how we are
using virtual reality, augmented reality and mixed reality. Add to my construction. 01:02:58:19 - 01:03:30:28 Speaker 1 Great. Thank you, Casey. Also coming from the construction industry, I appreciate all of your images as well. I Remember drawing on AutoCAD, AR 13, completely two dimensional right now. That's probably 20 years ago, but what a long ways the industry has come in as well. I see a lot of correlations between what me and Hector were saying, too, when
we talk about new employees, right, helping new and employees visualize how how a particular process needs to be done. 01:03:31:08 - 01:03:52:10 Speaker 1 And the construction industry, I see it the same way, working with building owners. Right. Folks that don't normally take that blueprint and make it into a 3D render type of image.
What a great way to allow potential building owners and investors to see what that end product i
2023-02-22 14:25
