Advanced Micro Devices, Inc. (AMD) Earnings Call Transcript & Summary

June 3, 2024

NASDAQ US Information Technology Semiconductors and Semiconductor Equipment special 79 min

Earnings Call Speaker Segments

Operator

operator
#1

Good morning, everyone. Welcome to Computex 2024 Global Press Conference and AMD Opening Keynote. We are thrilled to have you join us today as we dive into the future of computing technology. Every year, the world converges here at Computex to explore the latest computing innovations. You may have noticed the music playing as you entered. This music is made possible by AI powered by advanced computing technology. Now let us take a moment to see how computing powers civilizations. [Presentation]

Operator

operator
#2

Ladies and gentlemen, let us welcome our host, Mr. James Huang, Chairman of Taiwan External Trade Development Council. [Foreign Language] to the stage.

James C.F. Huang

attendee
#3

Good morning, ladies and gentlemen. Last night, Taipei 101 [ lead ] up for Computex 2024, welcoming more than 12,000 CEOs and international professionals, as well as 1,000 journalists from all over the world. At this moment, all eyes are on Computex. And here is why. As the video brilliantly showed, Computex is the gateway to the future of computing technology. This event isn't just a trade show, it's where the future of computing is amended. I would like to thank all our media friends for their continued support of Computex. I would also like to thank all our distinguished guests, industry partners and AMD for being here. Thank you all for coming. At Computex, we have always been at the heart of the global computing revolution since our inception in 1981, from PC to Internet to mobile to cloud to IoT to now Gen AI. Computing has evolved dramatically from ancient Yin and Yang algorithm from the book of changes, I Ching, to today's cutting-edge semiconductors. Our journey reflects humanity's relentless pursuit of computing power. Computing power has come as potential over the past century. Today, AI has reached a significant milestone, breaching the tiering boundary. This isn't just a technical win. It represents a major shift for humanity. For the first time, humans have created another form of intelligence, a master of all trades. This is why we are here today, to dream, create and empower humanity in ways never before possible. Much like Leonardo Da Vinci's paint brush, today's powerful chips enable us to bring our wildest imagination to life. And thanks to our innovative partners, computing is now accessible in many forms for everyone. Computing power is creative power, and it has pushed us into a new technological renaissance. In this new era, every field can be reimagined, turning the impossible into possible. Albert Einstein once said, "logic will get you from A to B, but imagination will take you everywhere." At Computex, we can help you go where you want to go. No dream is too big, and no idea is too small. We are in a monumental shift, transforming every aspect of our lives. The balance in computing is revolutionizing industries from health care and finance to transportation and security. The impact is profound and far reaching. Here in Taiwan, we are at the epicenter of the global computing Renaissance. We play a crucial role in the global technology ecosystem, from the most advanced chip making to hardware, software and services, we support the world's cutting-edge computing solutions. And we are embracing the future with all our leading partners, including AMD, ARM, NVIDIA, Super Micro, Qualcomm, Intel, Google and Amazon. Computex 2024 is your gateway to the future of computing technology. This is where you can connect with industry leaders on AI Advanced Connectivity, Future Mobility, Immersive Reality, Sustainability and Innovations. Let's move on to the highlight events of Computex 2024. First, AI computing takes center stage with leading companies showcasing their innovations. This special exhibit highlights their cutting edge computing solutions that are shaping the future of AI. The CEO key notes have always been the highlight of Computex. And this year is truly unprecedented. Global CEOs and top executives from AMD, Qualcomm, Intel, MediaTek, Super Micro, NXP, ARM and [ NAB ], NVIDIA are all here gathered under one roof at Computex. They will share their latest concepts, visions and solutions. Another must-attend event is our Computex forum. Let's Talk Gen AI is the topic of this year's forum. Our panel of experts will explore the applications, innovations and hardware driving the generative computing revolution. InnoVEX, our show for start-ups returned this year with 400 teams from 30 countries to explore green and computing technology. In the past 8 years, InnoVEX has become one of the best places to meet visionary entrepreneurs and discover potentially game-changing solutions. This year, we've added exciting new feature to make your visit even more enjoyable. So please explore delightful treat throughout the short floor to enrich your Computex experience. Ladies and gentlemen, Computex is more than just a trend show. It is the heartbeat of computing, and we are about to witness a technological renaissance that will open a new chapter for human civilization. We can't wait to share this exciting journey with you. So welcome to the Tech Renaissance. Welcome to Computex 2024. Let's make history together. Thank you.

Operator

operator
#4

Thank you, James. And next, let us welcome our cohost, Mr. Paul Peng, Chairman of Taipei Computing Association, TCA.

Paul Peng

attendee
#5

To our co-organizer, Chairman James Huang from TAITRA; Dr. Lisa Su, Chairman and CEO of AMD; distinguished guests and media friends. Good morning. First of all, on behalf of the co-organizer, Taipei Computer Association, I would like to welcome all of our distinguished guests and media friends from home and abroad to Computex and InnoVEX 2024, building on last year's success as well as the growing trends in the tech ecosystems. Computex 2024 will have 1,500 exhibitors with 4,500 booths in the 2 exhibition halls and will showcase their latest products and innovations. This shows not only how important the AI trend is, but also the recovery of the conventional ICT industry. This year, Computex will feature 6 major topics: AI Computing, Advanced Communications, Future Mobility, Immersive Reality, Green Energy, and Sustainability and Innovation. We are honored to have major ICT companies focusing on these 6 trends, including AMD, [indiscernible], NVIDIA, MediaTek, ARM, RIOTEC, Acer, ASUS, GIGABYTE, MSI, Delta and more who will participate in our event. The focus of Computex and InnoVEX on the AI technology and supply chain attracts major AI tech companies from around the world, placing them among the most important B2B event in a global Gen AI ecosystem. The main theme of Computex, connecting AI, is reflected in not only the exhibition, but also the forums will -- both Computex and InnoVEX, will have more than 50 following sessions related to AI technology and AI applications. The awareness of this year's Best Choice Award reflects the growth of AI trends. The award-winning companies include NVIDIA, ASUS, Acer, MSI, Super Micro, RIOTEC, and more, who launched various AI PCs, AI servers, AI smartphones, Edge AI devices and Gen AI solutions in addition to a number of sustainability- and ESG-focused product. The startup focused event, InnoVEX this year attracts 400 start-up teams from more than 30 countries and regions, about 100 exhibitors focus on AI application and innovations. Other growing technology trends, such as, Semiconductor Applications, Green Tech and EV are also explored in InnoVEX 2024's show grounds as well as the forums. As we know, building Gen AI and LLM solutions need more than just sufficient computing power, but also abundant data storage in the cloud or Edge AI devices. This means it is vital to find reliable and efficient partners, which Taiwan can provide. Taiwan's ICT industry has a proven track record of more than 40 years of R&D experience and professional reputation. International buyers today agree that we are among the most efficient, reliable and trustworthy partner as well as the best choice of building Gen AI solutions globally. Computex is the world's most important procurement platforms for ICT products and digital transformation solutions, while InnoVEX is the innovation hub of Asia. In the next few days, we will come and invite our media friends from around the world to join this celebration of AI technology driven by Taiwan's ICT industry and experience the internationally developed innovations. Together, we witness how AI can make life better and safer in the future. Thank you.

James C.F. Huang

attendee
#6

Now the moment you have been waiting for, as Chair and CEO of AMD, Dr. Lisa Su has led the company's transformation into a powerhouse of high-performance computing. Under her visionary leadership, AMD has achieved remarkable success. Dr. Su was recently named the 2024 Chief Executive of the Year by Chief Executive magazine. Recognized for her role in one of the most spectacular achievements in technology sector. Dr. Su's inference extends beyond AMD. She has been a key advocate for the integration of AI across industries, emphasizing its transformative power. Her commitment to innovation and collaboration is evident in her leadership style, which focuses on the development of cutting-edge solutions while fostering an inclusive and forward-looking company culture. Now on behalf of Computex, I'm very pleased to welcome our old friend, Lisa, but we are going to share a video from AMD first. [Presentation]

James C.F. Huang

attendee
#7

Ladies and gentlemen, please join me in welcoming Dr. Lisa Su, Chair and CEO of AMD. Thank you, Lisa. Thank you so much.

Lisa Su

executive
#8

Thank you so much. Thank You. Thank you. Good morning. [Foreign Language] Thank you, James, for that very, very warm introduction, and welcome to everyone joining us today in Taipei and from around the world as we open Computex 2024. Every year, Computex is such an important event for our industry as we bring together all members of the ecosystem to share new products, to talk about new innovations and really discuss the future of technology. But this year is even more special with the rapid innovation around AI and all of the new technology everywhere. It is actually the biggest and the most important Computex ever, and I'm so honored to be here to open the show. Now we have a lot of new products and news to share today. So let's just go ahead and get started. Now at AMD, we're all about pushing the envelope in high-performance and adaptive computing to help solve the world's most important challenges. From cloud and enterprise data centers to 5G networks to health care, industrial, automotive, PCs, gaming and AI, AMD technology is everywhere, powering the lives of billions of people every day. AI is our #1 priority, and we're at the beginning of an incredibly exciting time for the industry as AI transforms virtually every business, improves our quality of life and reshapes every part of the computing market. AMD is uniquely positioned to power the end-to-end infrastructure that will define the AI computing era from massive cloud servers and enterprise clusters to the next generation of AI-enabled intelligent embedded devices and PCs. Now to deliver all of these leadership AI solutions, we're focused on 3 priorities: first, it's delivering a broad portfolio of high-performance, energy-efficient compute engines for AI training and inference including CPUs, GPUs and NPUs; second, it's about enabling an open and proven and a developer-friendly ecosystem that really ensures that all of the leading AI frameworks, libraries and models are fully enabled on AMD hardware; and third, it's about partnership. It's really about co-innovating with our partners, including the largest cloud, OEM, software and AI companies in the world as we work together to bring the best AI solutions to the market. Now today, we're going to talk about a lot of new technologies and products, including our brand new Zen 5 core, which is the highest performance and most energy-efficient core we've ever built. And our next-generation XDNA 2 NPU core that enables leadership performance and capabilities for AI PCs. And we're also going to be joined by a number of our partners as we launch our new Ryzen notebook and desktop processors and preview our data center CPU and GPU portfolio for this exciting AI world. So let's go ahead and get started with gaming PCs. Now at AMD, we love gaming. Hundreds of millions of gamers everywhere use AMD technology. From the latest Sony and Microsoft consoles to the highest-end gaming PCs to new handheld devices like the Steam Deck, Legion Go and ROG Ally. Today, I'm excited to show you what's next for PC gaming with Ryzen. Our new Ryzen 9000 CPUs are the world's fastest consumer PC processors bringing our newest Zen 5 core to the AM5 platform with support for the latest I/O and memory technologies, including PCIe 5 and DDR5. I'm happy to show you now our brand-new Zen 5 core. Zen 5 is actually the next big step in high-performance CPUs. It's a grounds-up design that's extremely high performance and also incredibly energy efficient. You're going to see Zen 5 everywhere from supercomputers to data centers and PCs. And when you look at the technology behind this, we have so much new technology. We have a new parallel dual pipeline front end. And what this does is it improves branch prediction accuracy and reduces latency. It also enables us to deliver much more performance for every clock cycle. We also designed Zen 5 with a wider CPU engine and instruction window to run more instructions in parallel for leadership compute throughput and efficiency. As a result, compared to Zen 4, we get double the instruction bandwidth, double the data bandwidth between the cash and floating point unit and double the AI performance with full AVX-512 throughput. All of this comes together in the product in Ryzen 9000 series, and we're delivering an average of 16% higher IPC and across a broad range of application benchmarks and games compared to Zen 4. So now let me show you the top of the line Ryzen 9950X for the very first time. There you go. We have 16 Zen 5 cores, 32 threads, up to 5.6 -- 7 gigahertz boost, a large 80-megabyte cache at 170-watt TDP. This is the fastest consumer CPU in the world. Thank you. Okay. So let's take a look at some of the performance. So when you compare it to the competition, the 9950X delivers significantly more compute performance across a broad suite of content creation software. And some of them, you actually see like blender that take advantage of the AVX-512 instruction throughput, we're actually seeing up to 56% faster than the competition. And in 1080p gaming, we know all of our fans love gaming, the 9950X delivers best-in-class gaming performance across a wide range of popular games. Now with desktops, we know that enthusiasts want to have an infrastructure that let you upgrade across multiple product generations. And with Ryzen, we've done just that. Our original Ryzen platform, socket AM4, launched in 2016 and now we're approaching the ninth year, and we have 145 CPUs and APUs across 11 different product families in socket AM4. And we're actually still launching new products. We actually have a few Ryzen 5000 CPUs that are coming next month. And we're taking this exact same strategy with socket AM5, which we now plan on supporting through 2027 and beyond. So you're going to see AM5 processors from us for many, many years to come. Now in addition to the top of the stack, Ryzen 9950X, we're also announcing the 12, 8 and 6 core versions that will bring the leadership performance of Zen 5 to mainstream price points, and all of these go on sale in July. So now let's shift gears from desktops to laptops, and there's going to be a lot of discussion about laptops at Computex this year. AMD has been actually leading the transition to AI PCs since we introduced our first generation of Ryzen AI in January last year. Now AI is actually revolutionizing the way we interact with PCs. It enables more intelligent, personalized experiences that will make the PC an even more a central part of our daily lives. AI PCs enable many new experiences that were simply not possible before. These are things like real-time translations that will allow us to collaborate in new ways, things like generative AI capabilities that accelerate content creation. And also, we each want our own customized digital assistant that really will help us decide what we need to do and what we should do next. So to enable all of this, we actually need much, much better AI hardware. And that's why we're so excited to announce today our third gen Ryzen AI processors. Our news of Ryzen AI series actually is a significant increase in compute and AI performance and sets the bar for what a copilot PC should do. Thank you, Drew. Here we go. This is Strix. Strix is our next-generation processor for ultrathin and premium notebooks and it combines our new Zen 5 CPU, faster RDNA 3.5 graphics and the new XDNA 2 NPU. Thank you. And when you look at what we have, it really is all the best technology on 1 chip. We have a new NPU that delivers an industry-leading 50 TOPS. We're going to talk about TOPS a lot today, 50 TOPS of compute that can power new AI experiences at very low power. We have our new Zen 5 core that enables all the compute performance for ultrathin notebooks. And we have faster RDNA 3.5 graphics that really brings the best-in-class application acceleration as well as console level gaming to notebooks. Now we have a couple of SKUs. The flagship Ryzen 9 HX 370 has 12 Zen 5 cores, 24 threads, 36 megabytes of cache, the industry's most integrated NPU and our latest RDNA graphics. Strix is simply the best mobile CPU. So let me talk a little bit about what's special in this new NPU. NPUs are really new, and they're really there for all of these AI applications and workloads. Now compared to our prior generation, XDNA 2 features a large array of 32 AI tiles with double the multitasking performance. It's also an extremely efficient architecture that delivers up to 2x better energy efficiency of our prior generation when running GenAI workloads. And if you look at the performance of Strix compared to other chips in the market, and there are a lot of chips that are coming out with new NPUs, XDNA delivers the highest performance, leadership, 50 TOPS of INT8 AI performance. And what this means is that third gen Ryzen AI will deliver the best NPU powered experiences in a Copilot+ PC. But let me just go a little bit deeper so you understand the technology. Every NPU is actually not the same when it comes to generative AI capabilities. Different NPUs actually support different data types, and that says something about the accuracy and the performance of the devices. So for generative AI, 16-bit floating point data types are great for accuracy, but they actually sacrifice performance. And the current standard for NPUs is actually 8-bit integer data types. They prioritize performance, but they sacrifice accuracy. And what this means is that developers really have a tough choice to make between offering either a more accurate solution or a more performance solution. Now XDNA 2 is the first NPU to support Block 16-bit floating point. And what that means is Block FP16 actually combines the accuracy of 16-bit data with the performance of 8-bit data. This represents a huge leap forward in AI capability and enables developers to run complex models natively without any quantization steps at full speed. And what that means is with no compromise. And so let me show you what this looks like. When you look at the example, these are 3 images that are generated by the popular Stable Diffusion XL Turbo GenAI model. We use the same prompt with no quantization or retraining for all three. And the only difference is actually the data type. So INT8 is on the left, which is what most NPUs are using. Block FP16 is in the middle, which is what XDNA 2 has. And then FP16 is on the right, which is the more traditional format. And as you can see, the 2 FP16-bit images look much better with no real differences between the two. And it is only because our NPU supports that Block FP16 that Ryzen AI is capable of generating the significantly better images in the same time that it takes to generate the lower quality INT8 images. And this is just an example of why we believe that NPUs with the right data types are the best for the next-generation PCs. And this is why we believe that XDNA 2 is the best NPU in the industry. Now Microsoft is a great partner and is really leading the AI era, and we've been working very, very closely with them to bring Copilot+ PCs to market with Strix. So to hear more about the work we're doing together, I'd like to welcome Pavan Davuluri, Corporate Vice President, Windows Devices at Microsoft to the stage.

Pavan Davuluri

attendee
#9

Lisa, it's a pleasure.

Lisa Su

executive
#10

Pavan, so wonderful to see you. Thank you so much for joining me here in Taipei.

Pavan Davuluri

attendee
#11

Absolutely.

Lisa Su

executive
#12

I know it's been a super busy time for you, guys. So much is going on. Can you tell us a little bit about what's been going on?

Pavan Davuluri

attendee
#13

Thank you, Lisa, for having us here today. It is an honor to be here at Computex with all of you. It has been a really busy couple of weeks for us here at Microsoft. We announced a new category of PCs built for AI, the Copilot+ PCs. To realize the full power of AI in a PC, we reengineered the entire system from chip through every layer of Windows. These are the fastest, most performant, most intelligent PCs. And we are thrilled to partner with AMD on Strix-based Copilot+ PCs.

Lisa Su

executive
#14

Thank you. We are too.

Pavan Davuluri

attendee
#15

Lisa, I truly believe we are at an inflection point here where AI is making computing radically more intelligent and personal. And we've collaborated with AMD since day 1 on this, and I'm very excited about that.

Lisa Su

executive
#16

Look, Pavan, there's no question. Microsoft and you and your team have really led this whole AI PC era. We've always talked about user experiences. Can you talk a little bit about what you were thinking with Copilot PCs and this integration between operating systems, hardware and software?

Pavan Davuluri

attendee
#17

Sure. Absolutely. The first thing I think customers will see with Copilot+ PCs is that they're just simply outstanding PCs. These devices will have leading performance and best-in-class battery life and every app will work great on these machines. Now for those next GenAI experiences, how about we just take a look, Lisa?

Lisa Su

executive
#18

Sounds good. [Presentation]

Lisa Su

executive
#19

Fantastic, Pavan.

Pavan Davuluri

attendee
#20

So what you just saw there, those devices or those experiences have on-device AI that is powerful enough to keep up with all the experiences we want and efficient enough to be always running. For example, you just saw Recall that helps users instantly find anything on their PC, and that's only possible because we could semantically index content in the background, which requires always on high-performance AI. Cocreator lets you generate high-quality images by drawing and paint, and we can do that with fast on-device image generation. We have Live Captions, which will translate your audio in real time on a PC switching automatically between languages in fact. But I truly think what you just saw, Lisa, is just the beginning. We built this thing called Windows Copilot Runtime, which is effectively our library of APIs to let developers access new AI capabilities built into Windows. And those capabilities are also backed by Microsoft's responsibilities around Responsible AI. And I truly think we are going to be blown by what partners build in addition to what Microsoft and AMD is bringing.

Lisa Su

executive
#21

I completely agree. I think this is really bringing the entire ecosystem together. And one of the things, Pavan, that you and I have talked a lot about is the importance of the hardware. And it's all about how do we give you enough power such that you can run these Copilot+ PCs. So can you talk a little bit about your vision there?

Pavan Davuluri

attendee
#22

Sure. Absolutely. With Copilot+ PCs, we want to make it possible to deliver these next GenAI experiences by using on-device capabilities and do that in concert with the cloud. On-device AI really for us means faster response times, better privacy, lower costs. But that means running models that have billions of parameters in them on PC hardware. Compared to traditional PCs even from just a few years ago, we're talking 20x the performance and up to 100x the efficiency for AI workloads. And to make that possible, every Copilot+ PC needs an NPU that's at least capable of 40 TOPS, and we're deeply grateful for the close partnership with AMD. We are thrilled that Strix Point NPU delivers an incredible 50 TOPS. That is super, super powerful for us.

Lisa Su

executive
#23

We wanted to give you more.

Pavan Davuluri

attendee
#24

Always ready. The powerful thing with that, of course, it means we're efficiently delivering these Copilot+ experiences, but also gives us headroom for the next generation of AI and we're at the start of that runway. Of course, the Copilot+ PCs complement that power of the NPU with at least 16 gigabytes of RAM and 256 gigabytes of SSD storage. So I truly think these devices are built for the era of AI that's coming.

Lisa Su

executive
#25

One of the things I can share, Pavan, is as we talk, you guys are always pushing us to give you more. You're always saying more TOPS, Lisa, more TOPS. What are you doing with all those TOPS? What's your vision for the future?

Pavan Davuluri

attendee
#26

Yes. I do remember those conversations, Lisa.

Lisa Su

executive
#27

By the way, it takes a lot of die area, just so you know.

Pavan Davuluri

attendee
#28

I can only imagine we are deeply excited about those commitments. And quite frankly, the deep collaboration across our teams to go bring that to life. For us, these breakthrough experiences require us to run these 1 billion parameter models always running on the device, and that requires high-performance NPUs to power them. And really, thanks to our deep partnership, we've been able to seamlessly cross compile and execute over 40 on-device models on these AMD NPUs, which is very meaningful for us. We took advantage of all of the low-level software and hardware capabilities of the AMD silicon here, so we did not lose any performance nor efficiency. Also, these high-performance NPUs are really the best way to drive overall PC performance. Getting to 50 TOPS, for example, is a quantum leap for us for sure. And it's really much, much more impactful relative to what you could do with just a CPU or GPU alone. And the other thing that excites me really is that these powerful NPUs then free up the GPUs and the NPUs for workloads where they shine. So I'm excited to see what developers will do with us going forward.

Lisa Su

executive
#29

We are super excited as well. Thank you, Pavan, for being here. Thank you for your partnership, and thank you for leading the industry.

Pavan Davuluri

attendee
#30

Thank you. Thank you, Lisa. Thank you.

Lisa Su

executive
#31

So in addition to Microsoft, we're also working with all of the leading software developers, including Adobe, Epic Games, SOLIDWORKS, Sony, Zoom and many others to accelerate the adoption of AI-enabled PC apps. And by the end of 2024, we're on track to have more than 150 ISVs developing for AMD AI platforms across content creation, consumer, gaming and productivity applications. Now to give us a look at some of these upcoming Copilot+ PCs, let me welcome our next guest, a very close partner and good friend, Enrique Lores, HP President and CEO. Enrique, thank you so much for being here. It's always fun to talk about what's next with our teams have been working on.

Enrique Lores

attendee
#32

Actually, thank you for having me here, and congratulations for all the announcements we have made today.

Lisa Su

executive
#33

There's a lot more to come. Now look, Enrique, you and I have talked a lot about the intersection of AI and hybrid work in recent months. What are you seeing in the industry?

Enrique Lores

attendee
#34

I think this is actually what makes many of the announcements that we're making today very exciting. It's not only about the technology improvements that we're going to see, which you have explained extremely well. It's about how they are going to be helping employees and companies to meet their goals. What we see today is a significant tension between all of us as companies that want to continue to improve the productivity of our teams that are looking for increased flexibility, the ability to meet their personnel and private goals. And we think that technology and AI can really help to close that bridge because it can help to improve productivity and at the same time, give the flexibility that our teams are looking for. And we look at AI PCs as the first instantiation of this change. They will be enabling to increase productivity. We are going to talk about some of the new functionalities and you're going to see how unbelievable they are. But at the same time, make sure that employees can deliver on the goals amid their productivity goals.

Lisa Su

executive
#35

Yes. And we've talked a lot about how in this hybrid world, people are really wanting all of these different features. Can you talk a little bit about that?

Enrique Lores

attendee
#36

I think what we have learned during the last years is that what is really critical for all of us that develop the systems that our teams are going to be using is that we co-engineer the solution. It is not any more about someone developing the software, someone developing the operating systems, someone developing the chips, someone developing the hardware. We need to understand what experience we are building and deliver that experience together. And this is something that we started a few years ago, and the teams have been learning how to make that happen and how to co-engineer these solutions. And all the products that we have introduced during the last year especially, for example, a product we introduced 2 weeks ago, the Pavilion Aero show that. And this is going to be even more important as we show the new AI PCs that we are going to be bringing to market because we have made an effort to integrate the new processors, the new chips into the solutions that we are going to be bringing together. And we are incredibly excited about the new family of products we will be launching in a few weeks because...

Lisa Su

executive
#37

So I think you have something to show us. Is that right, Enrique?

Enrique Lores

attendee
#38

I hope so. And this is actually the new generation. Since we have done together, we can show it together.

Lisa Su

executive
#39

That's wonderful.

Enrique Lores

attendee
#40

This is the next generation Omnibook when we integrate the latest Ryzen AI 300 Series, that, as Lisa was saying before, will be the first product that will have 50 TOPS integrated in the device. And performance, as Pavan was saying, is critical because will enable us to continue to deliver incredible experiences to our customers. If you ask me what I'm more excited about is something that is going to be very close to many people in this room. We, HP, have a very large team here in Taipei. And many -- we spent many hours in video conferences and Zoom calls. And as you can notice, I have a strong Spanish accent. And I know that for the team here, understanding my accent sometimes is difficult. So just imagine that you can get real-time translation. So I will speak my fine English.

Lisa Su

executive
#41

That's pretty good. Come on, Enrique.

Enrique Lores

attendee
#42

And then we'll [indiscernible] in Chinese. That's going to make a big difference in productivity.

Lisa Su

executive
#43

No, I think that's -- by the way, I think your English is pretty good, Enrique, but I understand. My Chinese also needs to be better. So I told...

Enrique Lores

attendee
#44

We can help each other.

Lisa Su

executive
#45

Yes. Look, we love it. I mean we love the Omnibook and all the work that we've done together with their Gen Ryzen AI processors. But let's actually give everyone a preview of GenAI running on Omnibook. So let me show you again the popular Stable Diffusion XL Turbo model, which is generating some high-quality images of locations around Taiwan based on some simple text prompts. So starting with the white cliffs of Taroko Gorge National Park, Sun Moon Lake with nice fall colors, Taipei 101 and then finally, the peak of Jade Mountain. All of this is running on the Omnibook. You're seeing it for the first time. And the reason those pictures are so beautiful is because we have a very, very powerful NPU. We've co-engineered the system together. We have the Block FP16 data support that I talked about. And you can see these beautiful photorealistic images almost instantaneously.

Enrique Lores

attendee
#46

Yes. So just imagine the productivity, this is going to provide to product managers, creatives that are going to start creating their designs. And just with this solution, they will really be able to accelerate that work. So unbelievable progress.

Lisa Su

executive
#47

Thank you so much, Enrique. Thank you for your partnership. I can't wait for everything that we're going to bring out together.

Enrique Lores

attendee
#48

Thank you, Lisa. Great to be here. Thank you.

Lisa Su

executive
#49

Thank you. So I told you earlier that third-gen Ryzen AI has the most powerful NPU, but you also need a high-performance CPU and GPU to deliver the best PC experience as possible. So let's take a look at some of that other performance. When we compare Ryzen AI 300 Series to all of the latest x86 and ARM CPUs from our competitors, you can see why we say Strix is really the best notebook CPU in the market. Whether you're looking at single-threaded responsiveness, productivity applications, content creation or multitasking, third-gen Ryzen AI processors deliver significantly more performance, many times often beating the competition by a large double-digit percentage across a broad range of use cases. Now let's welcome another one of AMD's closest partners in the development of Copilot+ PCs. Let's welcome Luca Rossi, President of Lenovo Intelligent Devices Group.

Luca Rossi

attendee
#50

Hey. Good morning, Lisa.

Lisa Su

executive
#51

Wonderful to see you, Luca. Thank you so much for joining us today. We so appreciate the partnership, and Lenovo and AMD are doing so much together.

Luca Rossi

attendee
#52

Yes. So thanks for having me, Lisa, and strong partnerships are core to Lenovo strategy. Our long-term partnership with AMD, as you know, Lisa, spans over 25 years and is a testament to this. Together, I think we have driven incredible innovations across PCs, mobile gaming, servers, tablets, edge computing. And for example, our ThinkStation P620 was the first Threadripper PRO workstation to deliver unprecedented performance and flexibility to power AI renderings and workflows. Beyond hardware, the Lenovo AI Engine+ software use machine learning in our Legion gaming laptops integrates with AMD Ryzen processors to dynamically adjust settings and tailor for epic gaming experiences at the highest performance. Our AMD power devices, ThinkPad, ThinkBook, Yoga, Legion are all well equipped to enter AI applications, accelerate video editing, enhance 3D rendering and elevate gaming to new heights. So Lisa, we are very excited for all the innovation that AMD is introducing, and Lenovo definitely will be a great partner to deliver them to the global markets. We can do this because of our global scale, top-notch engineering and design and then the operational excellence as the world #1 PC maker Lisa.

Lisa Su

executive
#53

Thank you so much, Luca. And Luca, when we think about all the work we're doing together. Today, we're talking about third-gen Ryzen AI devices. And I know your team has done a lot. Our teams have done a lot together. Can you talk a little bit about your lineup and some of the AI experiences that you have?

Luca Rossi

attendee
#54

Yes, with pleasure. So later this year, we are going to launch Lenovo AI laptops with the third-gen Ryzen AI processors for consumers through our Yoga franchisee for commercial with our legendary ThinkPad brand, and for small and medium businesses through our ThinkBook lineup. And no matter if you are a creator, an enterprise professional or a startup entrepreneur, Lenovo will have the perfect Copilot+ laptop with third-gen Ryzen AI, and congratulations operating at the industry-leading over 50 TOPS. Congratulations for that, Lisa.

Lisa Su

executive
#55

Thank you.

Luca Rossi

attendee
#56

So we'll have also some exclusive Lenovo AI experiences coming to the market this year. One is Creator Zone we have co-engineered this with AMD on fine-tuning the AI model, and this is an exclusive Lenovo software tailor made for creators, providing tools and features to boost creativity and productivity. And maybe let's take a look at how the software works. So first, let me introduce Lenovo AI now. That's our native language agent that runs locally on the device. And one of the things that make this so special is its personal knowledge base. With the right permissions, Lenovo AI now can interpret user data to provide faster and personalized output. You have seen now -- AI now going through a script and generating both a thumbnail and a description to post on YouTube and share with the world. So see, it was very easy, right?

Lisa Su

executive
#57

Absolutely.

Luca Rossi

attendee
#58

Now let's say, the user wants to create images of a fish to post on social media. All they have to do is to use Lenovo Creator Zone. That's our other IP. With text to image, Creator Zone can generate an image base off any idea. And if the image needs further refining, the sketch to image function can assist the user. And then all of this, all of these images were created with the same prompt and locally on the device with a built-in responsible AI check feature.

Lisa Su

executive
#59

fantastic.

Luca Rossi

attendee
#60

So we have invested significantly in R&D., as you know, Lisa, and we built a unique Lenovo IPs running on-device AI workload, including LLM compression, performance improvement algorithms, and we know we are confident that our third gen Ryzen AI offering will stand out from the competition. And last, but not least, and then I'm over. We also have created Smart Connect, another Lenovo IP that unifies AI PCs, tablets, smartphones and other IoT into the same Lenovo ecosystem.

Lisa Su

executive
#61

That's fantastic. Just -- it's wonderful to see all of these pieces come together. Now look, you've been holding something. I think you're going to show us what it is. Is that right?

Luca Rossi

attendee
#62

Well, I wasn't supposed to even show this yet since this is something we will not announce until later this year. But Lisa, you're right. I felt it's just too exciting to...

Lisa Su

executive
#63

You look very happy, actually.

Luca Rossi

attendee
#64

I'm very happy. So straight from our R&D, straight from our R&D lab, this is the first-ever sneak peek at our new Yoga laptop powered by third gen Ryzen AI.

Lisa Su

executive
#65

That's beautiful.

Luca Rossi

attendee
#66

Maybe we want to do that. Yes. So I can't share more for today.

Lisa Su

executive
#67

They're very beautiful.

Luca Rossi

attendee
#68

But I can tell you this device represent a significant leap forward in next-generation AI computing, will include some of the Lenovo exclusive IP AI features that I mentioned. And this is just the beginning. We cannot wait together to share more and bring these transformative AI PCs to the world very soon.

Lisa Su

executive
#69

Thank you.

Luca Rossi

attendee
#70

Lisa, thank you for having me, and thanks, everyone. Thank you. Thank you.

Lisa Su

executive
#71

Thank you so much, Luca. Thank you. Thank you. Thank you. You can see we get very excited about our products Next, I'd like to welcome one of the most important visionaries and innovators in the Taiwan ecosystem and a very, very close partner, Jonney Shih, Chairman of ASUS.

Jonney Shih

attendee
#72

Hi, Lisa.

Lisa Su

executive
#73

Hi. Thank you. Thank you so much for being here.

Jonney Shih

attendee
#74

Thank you, Lisa. Yes. I think it's really my great honor to join you on stage, especially since you are now a legend of the computing industry and the pride of Taiwan.

Lisa Su

executive
#75

Thank you. Thank you. Thank you. Jonney, you are actually true visionary. I think we all have so much respect for you. You've shaped this industry for so many years. Can you just tell me a little bit about how the landscape of computing is changing? And how do you see AI?

Jonney Shih

attendee
#76

Yes, Lisa. AI PC will be one of the most disruptive innovations of our lifetime. The ubiquitous AI era is the [ major ] paradigm shift that we have long envisioned at ASUS, and I'm so overjoyed that it's finally becoming a reality. The world will be full of AI brains that come in different forms and sizes, including super, like the 1.8 trillion parameters with MoE. Big, medium, small and even tiny, like less than 1 billion parameters from the cloud to the edge to PCs and devices like phones and robots. AI PC will play a critical -- extremely critical role in this new distributed hybrid AI ecosystem. Imagine an AI PC with small language model types of AI brains capable of acting as a personal agent who can understand and help you with your personal needs, preferences and even work while complementing the super brain in the cloud with local advantages, local latency, high security and personalization, all the while uploading the cloud computing needs, especially for inferencing. Isn't it incredible? This will benefit user productivity like video editing, design work and scientific computing and a lot more. This vision is amplified and possible because of our partnership with AMD and the launch of the third-gen Ryzen AI. We are definitely co-innovating at the forefront of AI PC together.

Lisa Su

executive
#77

It is so inspiring, Jonney, to hear you talk with such passion. I think we all can feel your passion going forward. So can you tell us a little bit about your new portfolio of AI PCs with third-gen Ryzen AI?

Jonney Shih

attendee
#78

Of course, Lisa. I think later today, at 4:00 p.m. we'll be unveiling the range of cutting-edge AI PCs across our portfolio with brand-new Zenbook, ProArt, Vivobook, ASUS TUF and ROG laptops powered by the third-gen AMD Ryzen AI air processors. These new lineups are equipped with the world's most powerful MPU with fliptops and the superior AMD Zen 5 architecture that leads the industry in compute and AI performance. The third-gen Ryzen AI processor is the catalyst to bring in personalized computing to everyone from content creators to gamers and business professionals and empower them like never before. This advancement gives the new Zen book higher AI performance than MacBook while making it thinner and lighter as well. ASUS is so proud and honored to be the first OEM partner to make the third-gen Ryzen AI systems available to consumers. It will be ready for purchase in July. Isn't it incredible? Thank you.

Lisa Su

executive
#79

These are super beautiful systems, Jonney, and it's also about the experiences. And I know that ASUS has also done a lot to create some new experiences for content creation and creativity. Can you tell us a little bit about that?

Jonney Shih

attendee
#80

Sure. We have been working together with AMD to integrate and optimize the incredible power of Ryzen AI processors and our ASUS Copilot+ PC lineups. This enables us to create exclusive and unprecedented AI apps to empower users to be more efficient and creative than ever before. A great example is one of our recently launched AI apps called StoryCube. Content creators who use multiple devices will love it. StoryCube is an AI-powered digital asset management app designed to provide you with a seamless and efficient file-organizing experience. It can act as a handy assistant by automatically identifying your loved ones' faces and even detecting and sorting your media into various things, such as scenic road trips, skiing adventures or adorably puppy moments. With 50 TOPs capability of the Ryzen AI MPU, StoryCube can drastically shorten AI categorization time from the tenths of a second running only on the CPU to just a blink of an eye.

Lisa Su

executive
#81

Thank you. Jonney, look, it's really exciting what we're doing on AI PCs, but AMD and ASUS have also had a very long history of partnering across motherboards, graphics cards and embedded systems. And as we go forward, can you comment about some of that going forward?

Jonney Shih

attendee
#82

Sure. It has been a great history together creating incredible products like the original Crosshair motherboard. ASUS was even the first to push Ryzen gaming system, which received an incredible response from users. Last year, ASUS introduced the first ROG Ally handheld device, which also adopted the AMD Z1 Extreme chip. We have solid leadership in AMD Ryzen 9 segment with 60% market share. And we are excited about expanding our partnership to offer AI solutions for specific industries like health care, education and smart cities with the goal of revolutionizing these sectors with powerful on-device AI applications. That's why we are so excited to work together in the next-gen AI PC space by combining cutting-edge AMD hardware like Ryzen processors and ASUS software expertise, rooted in our design thinking philosophy. We have pushed the boundaries of AI PC innovation and delivering truly groundbreaking AI experience to users.

Lisa Su

executive
#83

Jonney, all I can say is you are an inspiration to us all. Thank you so much for everything that you've done for our industry, and thank you for your partnership with AMD.

Jonney Shih

attendee
#84

Thank you, Lisa. Great partnership. Thank you very much. Thank you.

Lisa Su

executive
#85

Thank you. So I hope you got a feel for all of the customer excitement around third-gen Ryzen AI PCs. I'm very happy to say that the first notebooks will be available in July, and we have more than 100 consumer and commercial notebook design wins with Acer, ASUS, HP, Lenovo, MSI and others. So lots of things to come. So now let's transition from PCs to the edge, where our embedded and adaptive solutions are bringing AI to a diverse set of markets and devices. AMD AI platforms are already broadly deployed at the edge. In health care, AMD chips are improving patient outcomes by enhancing medical imaging analysis, accelerating research and assisting surgeons with precision robotics. In automotive, AMD AI solutions are powering the most advanced safety systems. And in industrial, customers are using AMD technology for AI-assisted robotics and machine vision applications. We are #1 in adaptive computing today and thousands of companies have adopted our XDNA AI adaptive and embedded technologies to power their products and services. Let me just give you a few examples. So Illumina is a global leader in genomics. And they use EPYC and AMD adaptive SoCs with their SpliceAI software to identify previously undetectable mutations in patients with rare genetic diseases. In automotive, Subaru is industry's leading EyeSight ADAS system uses Versal to analyze every frame captured by the front camera and that allows them to identify and alert the driver of possible safety hazards. Hitachi Energy uses AMD adaptive computing products in their widely deployed high-voltage direct current solutions to detect potential electrical issues before they become large problems and cause power outages. And Canon has adopted Versal to power the AI-based Free Viewpoint Video System that captures high-resolution video from over 100 cameras simultaneously, and that allows viewers to experience live events from every angle. Now AI at the edge is actually a hard problem. It requires the ability to do preprocessing, inferencing and post-processing all within the device. And only AMD has all of these pieces needed to accelerate end-to-end AI at the edge. So we combine the adaptive computing engines for preprocessing sensor and other data with AI engines for inferencing and then high-performance embedded compute cores for post-processing decision-making. Now today, when you do this, this requires 3 separate chips. And with our new Versal AI Edge Gen 2 series, we bring all of this leadership compute together to create the first adaptive solution that integrates preprocessing, inferencing and post-processing in a single chip. So today, we're announcing early access for our next-gen Versal platform. More than 30 of our strategic partners are already developing edge AI devices powered by our new single-chip Versal solution. And we are incredibly excited about the opportunity to drive AI at the edge and see significant opportunities to extend our embedded market leadership with these new technologies. Okay, now let's turn to the data center. We've built the industry's broadest portfolio of high-performance CPU, GPU and networking products. And when you look at modern data centers today, they actually run many different workloads. They range from traditional IT applications to smaller enterprise LLMs to large-scale AI applications and you need different compute engines for each of these workloads. And only AMD has the full portfolio of high-performance CPUs and GPUs to address all of these workloads, from our EPYC processors that deliver leadership performance on general purpose and mixed inferencing AI workloads to our industry-leading instinct GPUs that are built for accelerating AI applications at scale. Today, I'm going to share details of our next-generation data center CPU and GPU offerings. So let's start first with CPUs. If you take a look at the CPU market, EPYC is actually the processor of choice for cloud computing, powering internal workloads for all of the largest hyperscalers and more than 900 public instances from all the major cloud providers. Every day, billions of people around the world use cloud services powered by EPYC. That includes Facebook, Instagram, LinkedIn, Microsoft Teams, Zoom, Netflix, WeChat, WhatsApp and many, many more. All of that is on EPYC. Now we launched EPYC in 2017. And with every generation, more and more customers have adopted EPYC because of our leading performance, our leading energy efficiency and our leading total cost of ownership. And I'm very proud to say that we're at 33% share now and growing. Now when you look at today's data centers, most data centers are actually powered by processors that are more than 5 years old. And when you look at the virtualization performance of our latest-generation server CPUs, the new technology is so much better that EPYC delivers 5x more performance compared to those legacy processors. And even comparing to the best processors today from the competition, our performance is 1.5x faster. Many enterprises today are actually looking to modernize their general purpose computing infrastructure and add new AI capabilities, often within the same footprint. And by doing -- by refreshing their data centers with 4th Gen EPYC, you can really accomplish this. You can actually replace 5 legacy servers with a single server that reduces rack space by 80% and consumes 65% less energy. Now many enterprise customers are also wanting to run a combination of general purpose and AI workloads without adding GPUs, and EPYC is again the best option for that. Looking at EPYC, we are 1.7x faster when running the industry standard TPX-AI (sic) [ TPCx-AI ] benchmark that measures end-to-end AI pipeline across different use cases and algorithms. 4th Gen EPYC is clearly the industry's best server CPU, but we're always pushing the envelope to deliver more performance. So I have something to show you today. It's actually the preview of our upcoming 5th Gen EPYC processor codenamed Turin. So please take a look at Turin for the very first time. Turin features 192 cores and 384 threads and has 13 different chiplets built in 3- and 6-nanometer process technology. There's a lot of technology on Turin. It supports all the latest memory and I/O standards and is a drop in replacement for our existing 4th Gen EPYC platforms. Thank you, Drew. Turin will extend EPYC's leadership in general purpose and high-performance computing workloads. So let's take a look at some of that performance. NAMD is a very compute-intensive scientific software that simulates complex molecular systems and structures. When simulating a 20-million atom model, a 128 core version of Turin is more than 3x faster than the competition's best enabling researchers to more quickly complete models that can lead to breakthroughs in drug research, material science and other fields. Now Turin also excels at AI inferencing performance when running smaller large language models. So I want to show you a demo here. Now what this demo compares is the performance of Turin when running a typical enterprise deployment of Llama 2 virtual assistance with a minimum guaranteed latency to ensure a high-quality user experience. Both servers begin by loading multiple Llama 2 instances with each assistant being asked to summarize an uploaded document. Right away, you can see that the Turin server on the right is adding double the number of sessions in the same amount of time while responding to user requests significantly faster than the competition. And while the other server reaches a maximum number of sessions, you'll see it stop soon, it can -- it basically can't support the latency requirements anymore. Turin continued scaling and delivers a sustained throughput of nearly 4x more tokens per second. That means when you use Turin, you need less hardware to do the same work. And in addition to leadership summarization performance, Turin also delivers leadership performance across a number of other different enterprise AI use cases, including 2.5x more performance when translating large documents and more than 5x better performance when running a support chatbot. Our customers are super excited about Turin, and I know many of our partners are actually here in the audience today. And I want to say we're on track to launch in the second half of this year. So now let's turn to data center GPUs and some big updates on our Instinct accelerators. We launched MI300 last December, and it's quickly become the fastest ramping product in AMD history. Microsoft, Meta and Oracle have all adopted MI300. Every major server OEM is offering MI300 platforms. And we have built deep partnerships with a broad ecosystem of CSP and ODM partners, again, many, many thanks to our ODM partners who are here today that are offering Instinct solutions. Now if you look at today's enterprise generative AI workloads, MI300X provides out-of-the-box support for all of the most common models, including GPT, Llama, Mistral, Phi and many more. We've made so much progress in the last year on our ROCm software stack, working very closely with the open source community at every layer of the stack while adding new features and functionality that make it incredibly easy for customers to deploy AMD Instinct in their software environment. Over the last 6 months, we've added support for more AMD AI hardware and operating systems. We've integrated open source libraries like vLLM and frameworks like JAX. We've enabled support for state-of-the-art attention algorithms. We've improved computation and communication libraries. All of which have contributed to significant increases in the Gen AI performance for MI300. Now with all of these latest ROCm updates, MI300X delivered significantly better inferencing performance compared to the competition on some of the industry's most demanding in popular models. That is, we are 1.3x more performance on Meta's latest Llama 3 70B model compared to 100. And we're 1.2x more performance on Mistral's 7B model. We've also expanded our work with the open source AI community. More than 700,000 Hugging Face models now run out of the box using ROCm on MI300X. This is a direct result of all of our investments in development and test environments that ensure a broad range of models work on Instinct. The industry is also making significant progress at raising the level of abstraction at which developers code to GPUs. We want to do this because people want choice in the industry, and we're really happy to say that we've made significant progress with our partners to enable this. For example, our close collaboration with OpenAI is ensuring full support of MI300X with Triton providing a vendor-agnostic option to rapidly develop highly performing LLM kernels. And we've also continued to make excellent progress adding support for AMD AI hardware into the leading frameworks like PyTorch, TensorFlow and JAX. Now we're also working very closely with the leading AI developers to optimize their models for MI300. So I'm very excited to welcome Christian Laforte, CTO and co-CEO of Stability AI, an important AMD partner known for delivering the breakthrough Stable Diffusion open access AI models. Hello, Christian. How are you?

Christian Laforte

attendee
#86

Thank you. I'm great. It's a great honor to be here to represent my colleagues and everyone else who makes Stability AI a really interesting player in the ecosystem.

Lisa Su

executive
#87

Well, we've shown a lot of Stability AI today. You're known for delivering these breakthrough open access AI models that generate images, video, language, code, all of these things. Can you share some insights into how these models are pushing the boundaries of what's possible?

Christian Laforte

attendee
#88

Yes. We're seeing incredible gains in productivity in every industry. And many were made possible because we did a crazy thing and we released our models and our source code for free. And so this allowed millions of developers and enthusiasts and thousands of researchers to adapt their models to make new discoveries at record pace and to create new applications extremely fast. Take, for instance, touching up old family photos to improve their resolution or quality or maybe to remove someone you never ever want to see again in your whole life. Doing this well used to take years of experience and sometimes hours of tedious work for each image. Now applications like Stable Assistant and Stable Artisan and a lot of other applications that leverage Stable Diffusion can allow anyone to create and edit images in seconds. And we're seeing similar gains in productivity, not just in images, but in other research areas that we're involved in, in language, coding, music, speech and 3D. And combining all of those together, we aim to soon boost by at least 10x the productivity of filmmaking and video game creation.

Lisa Su

executive
#89

That's fantastic, Christian. Now I understand you have some big news to tell the audience today.

Christian Laforte

attendee
#90

Yes. So basically, the wait for Stable Diffusion 3 is almost over. We appreciate the community's patience and understanding as we dedicated extra effort to improve its quality and safety. Today, we're announcing that on June 12 we will release the Stable Diffusion 3 Medium model for everyone to download. A lot of work went into this, and we're really excited to see what the community will end up doing with this. One thing that is maybe not obvious to nontechnical people is that like it used to be that the frontier of research led to basically these models like Stable Diffusion. But nowadays, what's happening is that there's like a new -- it's like a natural evolution. Basically like these models are getting combined together in all kinds of novel ways, and by releasing them openly, we basically allow millions of people to help discover the best way to bring those together and unlock new use cases. So this SD3 Medium, it's an optimized version of SD3 that achieves unprecedented visual quality and that the community will be able to improve for their own specific needs to help us discover the next frontier of generative AI. It will, of course, run super fast on the MI300. And it's also compact enough to run on the Ryzen AI laptops that you've just announced. So here's an image produced with Stable Diffusion 3. We challenged it to basically illustrate the famous Taiwan night markets, what it looks like.

Lisa Su

executive
#91

It looks very nice, Christian. Looks very nice.

Christian Laforte

attendee
#92

So if you look really, really closely, you'll notice like it's not quite photorealistic, but I think it captured really well like the different elements of the text prompt. And it's especially impressive when you think that it was generated so much faster than actually typing this long text prompt. So it captured the pedestrians that are walking, the street that is made of stones, the fact that it is during the night, there's the trees and so on. So basically, like SD3 is able to do this using a bunch of new innovations, including the Multimodal Diffusion Transformer architecture that allow it to understand visual concepts and text prompts far better than previous models. It supports both simple prompts. So you don't need to become an expert at these. But you can also use much more complex ones and it will try to bring together all of the different elements of it. And SD3 excels at all kinds of artistic styles and photorealism. So here's an example that is actually a really challenging example, and we're comparing it with our previous version model, Stable Diffusion XL that we released less than a year ago. And it's especially challenging because it involves hands that are notoriously hard for these models to replicate. It involves these repeating patterns like the strings in a guitar and their threads. And these are all really, really challenging for these models to understand and draw accurately. So that is how SD3 generated more realistic details like the shape of the guitar and the hands. And if you look really, really closely, you may notice that there are a few imperfections here and there. So it's still not quite perfect, but it's a big improvement over the previous generation.

Lisa Su

executive
#93

No, it's fantastic, Christian. And I know that your team has been working a lot on SD3. What's your experience been like with MI300?

Christian Laforte

attendee
#94

It's wonderful. 192 gigabytes of HBM, that's really a game changer. It's like having more memory basically is often like it is the way that we can busily unlock new models. And it's often like the #1 factor that will help us to train bigger models faster and more efficiently. And I'll give an example that we've actually just encountered in collaborating with AMD. So we have this creative upscaler feature in our API. And basically, the way it works is that it can take an old photo, an old image that is less than 1 megapixel and really blow out the resolution and improve the quality at the same time. And so this creative upscaler, like we were happy when we were able to reach 30 megapixels on the H100 -- NVIDIA H100. But like once we basically ported their code over to the MI300, which by the way, was like pretty much no effort, we were able to reach 100 megapixels. And content creators, they always want more pixels. So this makes a huge difference. And the fact that we didn't have to really make any effort to actually achieve this, like it's a big step up. So researchers and engineers are really going to love the incredible memory capacity and the bandwidth advantages that the AMD [indiscernible] GPU deliver out of the box. So Lisa, moving forward, we'd really love to collaborate more closely with AMD because we'd like to create a new state-of-the-art video model. We need a lot more memory. We need a lot more compute to do this. And so we'd love to collaborate more closely with your team to achieve this and to release this for the whole world to enjoy.

Lisa Su

executive
#95

That sounds fantastic. It sounds like you need some GPUs.

Christian Laforte

attendee
#96

Yes. We are at the right place for this.

Lisa Su

executive
#97

Thank you so much.

Christian Laforte

attendee
#98

Thank you. Have a great COMPUTEX.

Lisa Su

executive
#99

You can see all of the innovation that's happening in such a short amount of time. Now earlier in the show, I was joined by Microsoft's Pavan Davuluri, who shared the great work that we're doing together on Copilot+ PCs. Microsoft is also one of our most strategic data center partners, and we've been working very closely with them on our EPYC and Instinct road map. To hear more about our partnership and how Microsoft is using MI300X across their infrastructure, here is Microsoft Chairman and CEO, Satya Nadella.

Satya Nadella

attendee
#100

Thank you so much, Lisa. It's great to be with all of you at COMPUTEX. We are in the midst of a massive AI platform shift with the promise to transform how we live and work. We have committed to partnering broadly across the industry to make this vision real. That's why our deep partnership with AMD, which has spanned multiple computing platforms from the PC to custom silicon for Xbox and now to AI, is so important to us. As Pavan highlighted, we are excited to partner with you to deliver these new Ryzen AI-powered Copilot+ PCs. And we're also thrilled to announce last month that we were the first cloud to deliver general availability of virtual machines using AMD's MI300X accelerator. It's a massive milestone for both our companies, and it gives our customers access to very impressive performance and efficiency for their most demanding AI workloads. In fact, it offers today the leading price performance for GPT workloads. This is just the start. We are very committed to our collaboration with AMD, and we'll continue to push AI progress forward together across the cloud and edge to bring new value to our joint customers. Thank you all so very much.

Lisa Su

executive
#101

Thank you so much, Satya. We're so proud of our work with Microsoft. And as you heard from Satya, MI300 delivers the best price performance today for GPT-4 workloads and is being deployed broadly across Microsoft's AI compute infrastructure. Now let me show you one more example of MI300 being used to power OpenAI's Wanderlust travel assistant built on GPT-4. So again, let's start by letting the tool know that we're interested in Taiwan and that we're going to be attending COMPUTEX. And you might ask something about who's the opening keynote? Got it right. Now let's also ask Wanderlust what other interesting sites should we see in Taipei? And you can see almost instantly we get lots of options of things to do near the convention center. But if we want to narrow it down to just a few because we only have a day, we can ask it to plan a day for us. And that day would include things like Elephant Mountain and Taipei 101, and you get the full itinerary. I think it just gives you an example of the power of AI. I mean, Wanderlust on MI 300 looks wonderful, but it really shows the power of these assistive agents and how easily it is for developers to seamlessly integrate GenAI models into their applications so that we can make AI extremely helpful for all of us. Now the customer response to MI300 has been overwhelmingly positive, and it's just so clear that the demand for AI is just accelerating so much going forward. We're really just at the beginning of a decade-long mega cycle for AI. And to address this incredible demand, I have a very exciting road map to show you. We launched MI300X last year with leadership inference performance, memory size and compute capabilities. And we have now expanded our road map, so it's on an annual cadence. That means a new product family every year. Later this year, we plan to launch MI325X with faster and more memory followed by our MI350 series in 2025 that will use our new CDNA 4 architecture. And both the MI325 and 350 series will leverage the same industry standard universal baseboard OCP server design used by MI300. And what that means is that our customers can very quickly adopt this new technology. And then in 2026, we'll deliver another brand-new architecture with CDNA Next in the MI400 series. So let me show you a little bit, starting with MI325. MI325 extends our leadership in generative AI with up to 288 gigabytes of ultrafast HBM3E memory with 6 terabytes per second of memory bandwidth, and it uses the same infrastructure as MI300, which makes it easy for customers to transition. Now let me show you some competitive data. Compared to the competition, MI325 offers twice the memory, 1.3x faster memory bandwidth and 1.3x more peak compute performance. And based on this larger memory capacity, you heard what Christian said about the importance of memory. A single server with 8 MI325 accelerators can run advanced models up to 1 trillion parameters. That's double the size supported by an H200 server. And then moving into 2025, we'll introduce our CDNA 4 architecture, which will deliver the biggest generational leap in AI performance in our history. The MI350 series will be built with advanced 3-nanometer process technology and supports for FP4 and FP6 data types and will again drop into the same infrastructure as MI300 and MI325. We are super excited about the AI performance of CDNA 4. So if you just take a look at that history, when we launched CDNA 3, we were 8x more AI performance compared to our prior generation. And with CDNA 4, we're on track to deliver 35x increase. A 35x increase in performance compared to CDNA 3. And when you compare MI350 series to B200, Instinct supports up to 1.5x more memory and delivers 1.2x more performance overall. We are very excited about our multiyear Instinct and ROCm road maps, and I can't wait to bring all of this new performance to our AI customers. Now I have one more topic I'd like to talk about today. And it's really in addition to our focus on Instinct, we've also made significant progress driving the development of high-performance AI networking infrastructure systems. AI network fabrics need to support fast switching rates with very low latency, and they must scale to connect thousands of accelerator nodes. At AMD, we believe that the future of AI networking must be open. Open to allow everyone in the industry to innovate and drive the best solutions together. So for both inferencing and training, it's actually critical to scale up the performance of hundreds of accelerators, connecting the GPUs in a rack or pod with an incredibly fast, highly resilient interconnect so they can work as a single compute node to run the largest models with the fastest responses. Last week, I'm very happy to say that many of the largest chip, cloud and systems companies came together to announce plans to develop an open standard for a high-performance fabric that can officially connect hundreds of accelerators. We call this Ultra Accelerator Link or UALink, and it's an optimized load store fabric designed to run at high data rates and leverages AMD's proven Infinity Fabric technology. We actually believe UALink will be the best solution for scaling accelerators of all types, not just GPUs, but all accelerators, and will be a great alternative to proprietary options. The UALink 1.0 standard is on track for later this year with chips supporting UALink already well into development from multiple vendors. And now the other part of training large models is also the need for scale-out performance connecting multiple accelerator pods to work together with at-scale installations often spanning hundreds of thousands of GPUs. A broad group of industry leaders formed the Ultra Ethernet Consortium last year to address this challenge. And UEC is the high-performance technology with leading signaling rates. It has extensions such as RoCE for RDMA to efficiently move data between nodes. And it has a new set of innovations developed specifically for AI supercomputers. It's incredibly scalable. It offers the latest switching technology from leading vendors such as Broadcom, Cisco and Marvell. And above all, it's open. Open means that as an industry, we can innovate on top of UEC and solve the needed problems. And the industry can work together to build out the best possible high-performance interconnect for AI and HPC. So when you look ahead, what does this mean? That means we have all the pieces. We have UALink and Ultra Ethernet. And now we have the complete networking solution for highly performing, highly interoperable and highly resilient AI data centers that can run the most advanced frontier models. So I hope you can see now that AMD is the only company that can deliver the full set of CPU, GPU and networking solutions to address all of the needs of the modern data center. And we have accelerated our road maps to deliver even more innovation across both our Instinct and EPYC portfolios while also working with an open ecosystem of other leaders to deliver industry-leading networking solutions. Now it's been a wonderful morning. We have so much that we talked about. So let me just wrap things up. We showed you a lot of new products today from our latest Ryzen 9000 desktops and third-gen Ryzen AI notebook processors with leadership compute and AI performance to our single-chip Versal Gen 2 series that will bring more AI capabilities to the edge, to our next-generation Turin processors that extend the leadership and efficiency of our EPYC portfolio, and our expanded set of Instinct accelerators that will deliver an annual cadence of higher performance. And what I can say is this is an incredible time to be in the technology industry. It's an incredible pace of innovation. And I couldn't be more excited about all of the work that we're going to do together in high performance and AI computing as an industry. So a very, very special thank you to all of our partners who joined us today: Microsoft, HP, ASUS, Lenovo, and Stability.AI. And especially thank you for all of our partners here in Taiwan and around the world. Thank you for being such a great audience, and have a great COMPUTEX 2024. Thank you.

This call discussed

For developers and AI pipelines

Programmatic access to Advanced Micro Devices, Inc. earnings transcripts and 32,000+ others is available through the EarningsCalls.dev REST API. Plans from $24.99/month — full transcripts, speaker segments, full-text search, and the recently-added /api/v1/transcripts/recent polling endpoint for ETL pipelines.