How Apple Silicon Dominates With The M2 Chip!
Today I'm going to be talking with Apple about the Mac and Apple Silicon, specifically the recently released M2 Pro Mac Mini and the M2 Pro and Max MacBook Pros, as well as Apple's approach to designing and developing its chips. Now in my M2 Max MacBook Pro review, I mentioned that it's the best laptop available for pros, so I am super excited for this conversation. I've got Laura Metz, the director of product marketing, Anand Shimpi from Hardware Technologies, and Tuba Yelcin, a 3D FX and Pro workflow expert joining me. So let's jump in. Hey guys, it's great to see you. First of all, I just want to thank you for your time today. Thanks for joining me. Thank you very much for having us. All right, before we jump into some of the details, I want to find out from each of you guys, how did you get into using Apple products or the Mac in particular? What's your origin story there? Well, my first experience using a Mac was in high school and it came. I had to use a Mac that the school provided
to start scholarship applications. And so that was my first experience jumping in on word processing and using a Mac there. And then it actually wasn't until, unfortunately or fortunately, until I started working at Apple nearly 20 years ago that I fully switched to a Mac and made that part of my daily life and of course have never looked back. Yeah, for me, I think early on in school, I was exposed to kind of Apple computers. I had an Apple 2E at home a long, long time ago. But in my adult life, it was kind of college when I really got into the Mac.
I remember I was taking a compiler architecture class and the Mac was disproportionately represented in that auditorium. And I remember looking over at people next to me and they were doing all this really cool stuff on the Mac and that ultimately kind of peak my curiosity and that's how I ended up picking one up in the early 2000s. - And yeah, for me, it was always a MacBook Pro. I really liked what it represented.
It was a device for the creatives. And I felt like having one being a creative was the lifestyle choice I was making committed to my creativity. And I think when the iPhone was launched, I thought like, oh, the iPhone and the Mac, these are the ecosystem, like the Power Tools that will enable me.
- So obviously I'm talking to three different people at Apple from three different teams. And it was probably on purpose that it was set up this way because that's how you guys design products in the first place. Apple doesn't just buy different components from different manufacturers and put them all into one product and then ship it. Instead, it's really different teams that all come together to make and form the final product.
So could you guys tell me how that process works behind the scenes? We really do create our products using a very collaborative approach across many different disciplines, whether that's from design, hardware, software engineering. We've got a non with hardware technologies here and our pro workflow team, which we believe is very unique to Apple. And I wouldn't even say we start a project. It's like the project stone end. We might ship a product, but we're constantly communicating in that those same conversations, they just continue on to the next as we continue to innovate and move things forward.
- I will agree with Laura's comment. As a pro workflow team, we really need to work collaboratively across different teams at Apple because it's everyone coming together and making these changes happen. It's super collaborative and it's really nice to see the efforts of that collaboration. When you know the display team was part of something and then the GPU team was part of something and the OS team was part of it, it really makes a difference and I think that's why some of the features we bring shows that and I think the users also appreciate it that It's not just one thing that's being great. It's everything altogether being child perfectly. - Yeah, the Silicon team does an operation of vacuum, right? Like I think when these products are being envisioned and designed, folks on the architecture team, the design team, they're there.
They're aware of where we're going, what's important. Both from a workload perspective, as well as the things that are most important to enable in all of these designs. And so yeah, no, I'd go the same thing. It is very collaborative. That makes sense. And as a creator of myself, I still remember my first real interaction with the Mac.
This is about 17 years ago, walking into an Apple store. What caught my attention when I was playing with the Mac was I minimized the window and it kind of geneed down into the dock. And I was almost taken aback by that action because it was so different just that interaction felt so different from what I was used to on the PC side of things. And it made me just want to explore the Mac and Mac OS more. So I literally walked out of that Apple store with a Mac mini, the first Mac mini, and I haven't looked back ever since.
So needless to say, I'm a big Mac fan and I'm excited to get into it. Let's start with the design of some of the products that you just launched. Obviously there is the new M2 Mac mini, but I'm focusing more on the MacBook Pro with this question. You just launched the M2 Macs and M2 Pro MacBook Pros, and at the beginning of this design generation, if you will, we saw the return of things like different ports and MagSafe.
Apple in the past has never been a company that shied away from dropping what it considered to be legacy ports or legacy technologies, but here we saw these things return. So could you tell me a little bit about how Apple settled on the designs of the 14 and 16 inch MacBook Pros, as well as the decision to actually bring ports back for its users? - Overall, it was designing the new 14 inch and 16 inch MacBook Pro debuted with the M1 Pro and M1 Max was incredibly exciting because it was the first time we had Apple Silicon going into these Pro products and we knew there was this things we would be able to do and have the vision materialized for products previously we'd only been able to imagine. And I think knowing how well the 16 inch MacBook Pro was received when it was launched, We wanted to be able to bring more screen real estate across the MacBook Pope product line and so excited to bring the 14 and 16 inch together when we launch that product. And I think overall, I mean, you ask specifically about the ports themselves. Of course, we always drive to have the thinnest products that
we can just really that they are easy for you to carry around. Right? It's all about we want you to be able to have this mobile powerhouse with you. And certainly thin and light plays a part of that.
And with with Apple Silicon and this new design, we were able to bring HDMI and SD back. We know having a wide array of ports can certainly benefit pro workflows. So we were excited about that.
And then of course bringing MagSafe back with more support for its capability for charging and fast charging. So we were excited about that. I think we all also have stories about how Mac safe has helped protect our Mac and various scenarios.
- And talking about those two sizes of 14 and 16 inches with Apple Silicon, you're able to provide the same power regardless of which one the user chooses, which is generally not typical. Usually the smaller device you get, the less powerful it is. And that's not even taking the M2 iPad Pro into account, where you just have all this power in a super thin device. Can you give us some insight into how you're putting increasingly more powerful chips into increasingly smaller devices over time. Yeah, so I think part of what you're seeing is this, you know, decade plus long kind of maniacal obsession with power efficient performance and energy efficiency. If you look at the roots of Apple Silicon, it all started with the phone and the iPad.
And there, you know, we're fitting into very, very constrained environments. And so we have to build these building blocks, whether it's our CPU or GPU, media engines, neural engine to fit in something that's way, way smaller from a thermal standpoint and a power delivery standpoint than like a 16 inch MacBook Pro. And so I think the fundamental building blocks are just way more efficient than what you're typically used to seeing in a product like this. I think the other thing that you're noticing is for a lot of tasks that maybe used to be high powered use cases on Apple Silicon, they actually don't consume that much power. If you look at the, you know, compared to what you might find in a competing PC product, depending on the workload, we might be a factor of two or a factor of four times lower power. That allows us to kind of deliver a lot of these workloads that might have been high power use cases on a different product in something that actually is a very quiet and cool and long-lasting sort of use case.
The other thing that you're noticing is that single-threader performance, so the snappiness of your machine. It's really the same high performance core regardless of if you're talking about a MacBook Air 14-inch Pro 16-inch Pro or like the new Mac Mini. And so all of these machines can accommodate one of those cores running full tilt. Again, we've turned
a lot of those usages and use cases into low power workloads. You can't get around physics though, right? So if you light up all the cores, all the GPUs, the 14-inch system just has less thermal capacity than the 16, right? So depending on your workload, that might drive you to a bigger machine. But they're really, the chips are kind of across the board, incredibly efficient.
- Yeah, and when you said you can't beat physics, that's an interesting statement, because it's obviously true. But at the same time, Apple Silicon has been such a revelation in the industry, because while you can't beat physics, no one is coming as close to beating it as Apple has with Apple Silicon. And I think what you just said is a good point. When it comes to single core, whether you buy an M2, M2 Pro, or M2 Max, when it comes to single core performance, you get the same experience.
And that's regardless of which chip you choose, which hasn't been the case in the past. So when you were choosing between a Core i3, i5, i7, or i9, if you went with a Core i3, you might see a delay if you have too many tabs open, or just trying to launch your email app versus going with a higher end chip. Contrast that with Apple Silicon, and you can get a base level M2 and start editing 8K video. But the other side of the coin that you mentioned, I did want to touch on battery efficiency.
So there's all this power there, and at the same time, while these devices are thin and light weight, you're giving us more battery life in the same size chassis with double digit performance gains on both CPU and GPU. So I think the question on a lot of people's minds is, how, how is it possible to ship a Mac with the longest battery life ever while also giving double digit performance gains in the same size computer? - We of course have this incredible chip, and a nod will speak to what we did there to improve the efficiency and get more battery life. In addition to that, we're always working with a number of teams to make many optimizations to get the most out of the hardware that we have. And so that includes working closely with Mac OS and firmware across the system entirely to really optimize things, so we are getting the most out of it. - Yeah, I mean, I think if you look at how a chip design works at Apple, One, you have to remember we're not a merchant silicon vendor. At the end of the day, we ship product.
And so the story for the chip team actually starts at the product. There is a vision that the design team, that the system team has that they want to enable. And the job of the chip is to enable those features, enable that product, and deliver the best performance within the constraints, within the thermal envelope, of that chassis that's humanly possible. And so if you look at what we did going from the M1 family to M2 Pro and M2 Max. At any given PowerPoint, we're able to deliver more performance. If you look at on the CPU, we added two more efficiency cores, two more of our E-cores.
And that allowed us to deliver kind of, it was part of what allowed us to deliver more multi-thread performance. Again, at every single PowerPoint, where the M1 and M2 curves overlap, we're able to deliver more performance at any given PowerPoint. The dynamic range of operations a little bit longer, a little bit wider. So we do have a slight increase in terms of peak power, but in terms of efficiency kind of across the range, it is a step forward versus the M1 family. And that directly translates into battery life.
The same thing is true for the GPU. It's kind of counterintuitive, but a big GPU running at a modest frequency and voltage is actually a very efficient way to fill up the box. And so that's been our philosophy, dating back to phone and for a typhoon and iPad. And it kind of continues in the Mac as well.
But really, the thing that we see, the thing that the iPhone and the iPad have enjoyed over the years is this idea that every generation gets the latest of our IPs, our latest CPU IP, latest GPU, neural engine, media engine, so on and so forth. And so now the Mac gets to be on that cadence too. And if you look at how we've evolved things on the phone and iPad, those IPs tend to get more efficient over time.
There is this relationship, if the fundamental chassis doesn't change, any additional performance you deliver has to be done more efficiently. And so this is the first time the MacBook Pro gets to really enjoy that and be on that same sort of cycle. It is incredible. And I want to bring two buttons on this as well, because I was excited to find out that we were going to have someone from Apple's pro workflows team here. Now, I'm just assuming here, but it seems obvious that a lot of what we're seeing these days from Apple has been at least informed by the pro workflows team, which I believe was announced back in 2018.
Can you give me a rundown of who this team is comprised of and what type of feedback and information Apple gather from it. Absolutely. We have some incredibly talented creatives who are area experts in audio music, video, photography, 3D visual effects, industries, and we are paired with super smart system architects. And together we work on these very complex challenging pro workflows and make them run awesome on the Mac. So it's a fun collaboration between like technology and art and we kind of gather both of them both sides together and make them yeah, run perfect on the Mac. So what are some of the results of the Pro Workflow team? Apple put the team together in conjunction with the announcement that the 2019 Mac Pro would be coming in the future. So the team has been there for a while now. Can you talk about some of the things that
consumers are directly benefiting from and using in Apple products today that maybe we might not that have seen if not for the pro workflow team. - I mean, it's a collective effort. I think as a pro workflow team, we were very closely, cross-functionally across Apple, whether it's hardware or software, and within championing for these pro futures that we want on the platform, and constantly push for more performance. But we also look for the future and see what's coming. And so there's always innovation in our minds, and we kind of trying to keep up the pace when it comes to innovation as well.
Often we'll hear people in the media say that Apple won't make this product as powerful as this other Apple product because then it would cannibalize the sales of the more expensive product. And that kind of flies in the face to what Steve Jobs famously said, and I'm paraphrasing here, that if anything is gonna cannibalize an Apple product, it should be another Apple product. And it really feels like we're seeing that mantra kind of play out with the launch of the M2 Pro Mac Mini.
For the first time you're giving the power of the Mac Book Pro to users of the Mac Mini. And the result here is you no longer need to buy the more expensive MacBook Pro if that's the level of performance you want but don't need the portability. So can you talk a little bit about that philosophy of what the M2 Pro Mac Mini in particular means to the Mac lineup? - I think it was a real exciting announcement and got a very positive reception because it is something new. I think it was somewhat unexpected giving we announced this amazing Mac Studio product just last year. I think it's just exciting to have these options that give users that flexibility, that with Mac Mini, with the M2, the M2 Pro, that really is a broad range of performance based on your user needs. If you need to take it further, you have Mac Studio and then of course, pushing that to the extreme, you have Mac Pro.
I think just again, we want to just serve those customers and their needs and give them that choice and flexibility. So we're really excited to bring M2 Pro to Mac Mini. On the Silicon side, the team doesn't pull any punches. I think the goal across all the IPs is one, make sure you can enable the vision of the product.
So there's new feature, new capability that we have to bring to the table in order for the product to have everything that we envision. That's clearly something that you can't pull back on. And then secondly, it's do the best you can.
get as much down in terms of performance and capability as you can every single generation. And I think the other thing is, you know, at the end of the day, Apple is on a chip company. At the end of the day, we're a product company. So if what we want to deliver, whether it's features, performance, efficiency, if we're not able to deliver something compelling, we won't engage, right? We won't build the chip. And so each generation will be motivated as much as possible to deliver the best that we can. Obviously, as a tech reviewer, I have my own opinion
on what I recommend people buy for their own specific needs. But from Apple's perspective, If you have the range, as you mentioned, the Mac Mini, the iMac MacBook Pro, Mac Pro, do you have a philosophy towards how you would recommend a consumer make a choice when they're looking at the lineup and making a purchase? - Oh, that's an interesting question. I, we really want to put that in the hands of the user based on their needs. And I think, you know, our goal is to make sure if they're looking for that everyday product that they have options for both a desktop and a laptop.
and if they are pushing their creativity and need more performance and going to that pro level, they also have amazing options for desktop and a laptop. - Okay, let's have some fun and move on to the explain it like on five years old section. I think there's some things that people understand for the most part and some things that they might not grasp and I'm hoping you guys can help clarify. So one of the things I think a lot of people don't fully grasp is the neural engine.
I think they understand the CPU and the GP on the RAM, at least for the most part because they understand the direct benefit of each of those things. But the neural engine feels a bit more mysterious. So how would you explain what the neural engine is and how it directly benefits the customer? - Yeah, so I'll take the first half of that and I think Laura can chime in with some of the customer benefits. There are really two things you need to think about, right? The first is this trade off between a general purpose compute engine and something a little more specialized. So if you look at our CPU and GPU, these are big general purpose compute engines. They each have their strengths in terms of the types of applications you'd want to send to the CPU versus the GPU.
Whereas the neural engine is more focused in terms of the types of operations that it's optimized for. But if you have a workload that's supported by the neural engine, then you get the most efficient, highest density place on the chip to execute that workload. And so that's the first part of it.
The second part of it is, well, what kind of workload are we talking about? And our investment in the neural engine dates back years ago, right? So the first time we had a neural engine on an Apple Silicon chip was A11 Bionic, right? So that was five or six years ago on the iPhone. And really it was the result of us realizing that there were these emergent machine learning models where that we wanted to start executing on device. And so we brought this technology to the iPhone and then over the years we've been increasing its capabilities and its performance. And then we made the transition to the Mac to Apple Silicon. It got that IP just like it got the other IPs that we brought, like things like the media engine, our CPU, GPU, secure enclave, so on and so forth. So when you're going to execute these machine learning models, performing inference on these inference-driven models, if the operations that you're executing are supported by the neural engine, if they're fit nicely on that engine, like I said, it's the most efficient way to execute them.
Now, the reality is the entire chip is optimized for machine learning, right? So a lot of models you will see execute on the CPU, the GPU, and the neural engine. and we have frameworks in place that kind of make that possible. But the goal is to always execute it at the highest performance, most efficient place possible on the chip.
And I would just add that the end benefit of that is just more performance. And your system is doing more for you and you're not even aware of it. One great example would be things we do with our image signal processor, that it is taking information from that image coming in and adjusting your image and optimizing your image.
So there's benefits across the board. And I think the magic is, you don't even know it's happening. It's all done for you and highly optimized. - Okay, next, the nanometer process. I think this is another one that the average person doesn't quite fully grasp when they see it mentioned in a keynote. So how would you explain what this is and the importance of decreasing that nanometer process size? - Yeah, so here I think you're referring to the transistor.
These are the building blocks, by which all of our chips are built out of. And the simplest way to think of them is like a little switch. And we integrate tons of these things into our design.
So if you'll get M2 Pro and M2 Max, you're talking about tens of billions of these. And if you think about large collections of them, that's how we build the CPU, the GPU, the neural engine, all the media blocks. Every part of the chip is built out of these transistors. Moving to a new transistor technology is one of the ways in which we deliver more features, more performance, more efficiency, better battery life. So you can imagine if the transistors get smaller, you can cram more of them into a given area. That's how you might add things like additional cores, which is something you get in M2 Pro and M2 Max, yet more CPU cores, more GPU cores, so on and so forth.
If the transistors themselves use less power or they're faster, that's another method in which you might deliver better performance, better battery life, better efficiency. Now I mentioned this is one tool in the toolbox. What you choose to build with them, the underlying architecture, micro architecture, and design of the chip also contribute in terms of delivering that performance, those features and that power efficiency. - Okay, and as we've seen in the past, you can still improve a chip and make it better, even without decreasing the transistor size. - Yeah, so if you look at the M2 Pro and M2 Max family, we talk about that being on a second generation five nanometer process, and as we talked about earlier, right? The chip got more efficient at every single operating point.
The chip is able to deliver more performance at the same amount of power. All right, and next, the media engine. When you look at the afterburner card in the Mac Pro, and then compare it to the size of the media engine on the M2 package, it's just hard for me to wrap my head around these performance gains. How did you take something that was so large and then fit it onto something so tiny and give it more performance? Yeah, and I think that's, you know, going back to the point around transistors, I think taking that IP and integrating it on, the latest highly integrated SOC with the latest transistor technology that lets you run it at a very high speed and you get to extract a lot of performance out of it. And I think the other thing is, this is one of the things that's fairly unique about Apple Silicon, we build these highly integrated SOCs. So if you think about the traditional system architecture in a desktop or a notebook, you might have a CPU from one vendor, a GPU from another vendor, each with their own sort of DRAM.
You might have accelerators kind of built into each one of those chips. You might have add-in cards as additional accelerators. But with Apple Silicon in the Mac, it's all a single chip, all backed by a unified memory system. You get a tremendous amount of memory bandwidth as well as D-RAM capacity, which is unusual, right? In a machine like this, normally, you know, a CPU is used to having a very large capacity low bandwidth D-RAM, and a GPU might have very low capacity high bandwidth D-RAM. But now the CPU gets access to GPU-like memory bandwidth, the GPU gets access to CPU-like capacity. And that really enables things that you couldn't have done before.
Really, if you're trying to build a notebook, these are the types of chips that you want to build it out of. And the Media Engine comes along for the ride, right? This is technology that we'd refined over the years, building for iPhone and iPad. And these are machines that the camera is a key part of that experience.
And being able to bring some of that technology to the Mac was honestly pretty exciting. And it really enabled just a revolution in terms of the video editing and video workflows. - How has the media engine kind of evolved over time? - I think one of the things that was pretty exciting and it goes back to your question around, how do we work with teams like the pro workflows team? I think the addition of pro res as a hardware accelerated and code and decode engine as a part of the media engine, that's one of the things that you can almost trace back directly to working with the pro workflows team, right? This is a codec that it makes sense to accelerate to integrating it to hardware.
It's important for both our customers, the people that we're expecting to buy these machines. And it was something that the team was able to integrate. I think for those workflows, there's nothing like it in the industry on the market. - I feel pretty certain that you've heard some interesting stories of how people push their max to the limit.
So I'm curious if you could share any story about people using their max in a way that impressed or even shocked you. I'll start that off with some more general answers to that. And Tuba may have some specific fun examples, but we've been developing Macs for our pro community for a long, very long time. And we're so inspired by what they do. And that really is what drives us constantly be pushing the capabilities forward. And so when we talked about these latest MacBook Pros with Apple Silicon, we talked about how it's just been a complete game changer.
And we don't just say that. We're hearing these examples of these amazing scenarios of what it truly has enabled for Creative Pros, whether that's a photographer who wants to go out into the wilderness to take photos and used to have to lug and carry all this equipment, who now, because the performance and the amazing battery life is fine to go out on that expedition carrying his latest MacBook Pro to folks creating musical scores that can just tax the system in incredible ways, but they're able to do that all on their notebook and not have to be back at the studio and they can be cross-continent, working with the studio, and able to piece that all together. And so these ideas that you don't have to be in the edit bay in the studio that you can be remote and not only be remote, but you can get that same performance that you would have whether you're plugged in or on battery.
and that's been huge for our prose as well. - Yeah, just to follow Laura's comment, we've seen singer-songwriters recording songs on their MacBook Pro, but the built-in microphone, because they don't have the fan noise interfering anymore, and they can just take that workflow wherever they want, whatever that creative idea comes in, and they can just create, which is really delightful to see. And also, personally, I'm a very outdoorsy person. I go camping all the time, and every time I see a camp prevent park, and you see someone with a camping chair with a MacBook Pro stirring their work on the side of the road.
It's just so great to see that. It feels like we're enabling more people to do their work wherever they want to be. And yeah, it's really great to be part of that transition. - You know, I remember prior to the launch of M1. There was a part of me that was like, oh, you know, I don't know if people are gonna get this until we launch M1 Max and M1 Ultra.
And almost feeling like M1's nice, but it's the small chip, right? like, "Yeah, how excited are people going to be about it?" And we knew how fast it was going to be on paper, but there is a difference, right? When you go and actually use one of these machines, I remember I moved my personal machine at the time to an M1 Mac mini. It feels like alien technology, right? Like it feels so fast. At that time, it was the fastest desktop I had access to, right? Like it was a game changer. And then to be able to have that same sort of snappiness and responsiveness and all of that in a notebook with like a battery that just felt like it lasted forever.
That to me was, even as someone who knew what to expect, it still felt unexpected. - When we first started using NM1 in the MacBook Air, you know, we're testing everything, we're using it as much as we possibly can, and we just noticed that the battery indicator wasn't moving, and we all thought, there's gotta be something amiss here, like what's happening? And so I think to a Dodd's point, that's really interesting, how on paper, We knew it was supposed to deliver these things and the promise of it, but to actually experience it what started to get pretty magical. - Now I'm on the other side as someone who takes in the Apple events and then test the products afterwards. And I remember a lot of us from the initial M1 was announced were like, "There's no way." Like, "What are they talking about? There's no way."
And then we get them in and it's exactly how it was presented. And so many people were blown away. It felt like alien technology. And I'm actually currently using the M2 Max 16-inch MacBook Pro.
and I was on a cross-country flight last week. And for the first two hours, I was doing video editing. And then I started getting worried because I was thinking to myself, "I know they said 22 hours of battery life, but that's video playback and I'm doing video editing. How long is my battery gonna last?" So I glanced up my battery after two hours of editing and I had 92% battery life left.
Like, I'm video editing. So for me, it's still mind-blowing and I can't wait to see what you guys have up your sleeve next. - Yeah, I'm too pro and I'm too maxed. they're really just better versions of what we've shipped before, right? Like it's that same great formula, that same power efficient performance, and you just get more.
>> Yeah, and I think that's the key thing, like with M1 MacBook Pro in 2021, like that laptop was incredible. Like performance was awesome, the power efficiency, and then it came with an HDR display, which is huge for the Pro community. And then with M2, now we have 96 gigs of memory. So if you're a pro that needs that little bit extra you got it and you know we'll keep innovating so It's just very exciting to be part of this journey. I like how you called 96 gigs a little bit. I just a little bit
It's wonderful. Okay, I think that's time. So Laura and Nan Tuba Thank you so much for taking the time and joining me today to talk about the Mac and Apple Silicon I really appreciate it. I hope you guys found that as interesting as I did I've actually been a fan of a nonsense. I started reading a non-tech
way back in 2004, as before joining Apple, he ran a PC hardware review website. As you probably know, Apple hasn't generally been known to do these kinds of on the record interviews that often, so it was definitely an exciting privilege to get this opportunity. If you have any questions on anything you heard, please drop them in the comments below, and I'll do my best to get the answers. Thanks for watching, as always, guys. I appreciate your support.
I'm Andrew Wehrers, and I will catch you in the next video.
2023-02-12 01:49
