NVIDIA Corporation (NVDA) Earnings Call Transcript & Summary

[Audio Gap] Items with you at the bottom of your screen, there are multiple application widgets that you can use, all of those widgets, they are resizable and movable. If you do have any questions during the webcast, please submit those through the Q&A widget. We're going to save time toward the end of the session, and we're going to do our best to answer as many of your questions as we can. You will find a copy of today's presentation and additional links in the resource list. We do encourage you to check those out and answer and download any of those that you want, a very great list of resources available. And then you're going to find additional answers to some common technical issues. Those are located in the Help widget at the bottom of your screen. Finally, an on-demand version of today's webcast will be available about an hour after we end, and you can access that using the same link that you used to log in today. So with that, let's get started. Raffaello, I'm going to turn things over to you. Thanks very much.

All right. Thank you. Thank you for the introduction. And I don't know many people are here, but it's time to join in this long discussion [indiscernible] really feel free to write me any things, issues you have about Isaac ROS DevOps. Let me start to share my screen. Okay. Perfect. I hope everybody, are seeing my introduction, while I'm taking a marketing engineer for [indiscernible] about Isaac ROS. This is a part of Isaac ROS webinars. There are many webinars we already made. And if a register just now following, you can see -- you already noticed there are other previous subjects we discussed like [indiscernible] speaking about [indiscernible] speaking about Isaac ROS. It is the first time to know about Isaac ROS. Open our website where you will see now, during my representation, some links and maybe there are already some resources. If I remember well, [indiscernible], you should [indiscernible] all things now. But let's start about docker containers and the usual economy when you work with docker. Our logo about Isaac ROS and what we are doing with ROS 2. And today, well, [indiscernible] we should speak about Isaac ROS in this day. What you can do, we can do working with DevOps. This is a good thing, not only speaking about Isaac ROS. So this is a personal point of view, but make a greater application. Inside a container can save time and increase your production for robotics application as well. It's not only for web example of further application. [indiscernible] DevOps can help your production in robotics application. What you can do example, if you have a RAW system file, you can quickly make a docker. This is a docker file, example, you can load RAW system. And after we know there is something before, it's not only to [ file ] or something else, we should understand what is docker and what we need to do. But before to go ahead, let's speak for the people who are really just now joined to our NVIDIA webinars [ about ] what is NVIDIA Isaac ROS. I will be really fast. There is a counter, I don't know where is my window. It will be here or there somewhere where you can see in my presentation, how many pages will spend just for these short introduction. Isaac ROS is a ROS 2 framework, means it's not something else or ROS 2 packages completely standards ROS 2 packages where you can build for your robotics application are optimized for ROS 2 accelerated and scaled with [ AIR ] grids. [ Who ] is made Isaac ROS gems. There are the hardware accelerator libraries where it's based Isaac ROS example, okay? There is a framework with [ Rosetta], all interact these packages with NVIDIA hardware and software. In this case, there are the hardware accelerates, and hardware [indiscernible]. Another layer with the Trident server [indiscernible] we know now. And there are different Isaac ROS [indiscernible], starting [indiscernible] detection, zero-based disparity, zero-based proximity [ Lamandlocks ] segmentation, objective action and others. After that, all these packages are optimized to work on Jackson, on GPO [ oration ] and on server. And this is important now because we know there are many packages ROS 2 packages or Isaac ROS packages, it's the same. GPU accelerated, you can run on [indiscernible] computer, GPR, station and server, maybe [indiscernible]. These packages on my simulation and do exactly the same on [ test ] computer and maybe won't do in the other, and this is a subject of this [ one ]. Another important point is always growing -- how we are taking care about is across making updates, making new software improvements. example, we started in the 2021 on August, releasing the preparer debt. And now we have with avian blocks engine networks better and faster on Amble. We are really working to make much better every release. Another one -- another important point about NVIDIA Isaac, just to have a complete overview about all our robotic solutions for robotics. We are starting from training with models example as a replicator in [indiscernible]. And there are some when near coming soon for immediate alone models you can use these models for simulation, example you can use on Isaac and you can use the powerful capabilities of Isaac [indiscernible] [ 2 ] works in a further realistic view is more a much better as possible what a robot can do and training and network for our biotic solutions. After that, we are on the build stage where we are today or where there are different software like [indiscernible],[ , Isac Jens, DeepStream, Rima ]is not only robotics, but there are other interesting points. [ Spending then ], there is the deployment management with a fleet common Isaac ROS, [indiscernible], metropolis, [ and Dima]. Okay. This part, we are here about Isaac ROS gen. Short disclaimer today. I will not go so deep about what we need. Just have a minimal overview what we are speaking about Ros 2, minimal experience, like it's not your first time and [ Linux ]. About [ Docker ], I hope I can cover all your troubles issues or feel free to write in our inbox -- in our chat area. I don't remember the name. Agenda. We have an introduction. Done. Indeed, [indiscernible]. Isaac ROS can build my Docker and a shorter gap. Okay. First part is done. What is Docker. Docker is a container platform, continuous packages up and dependencies. Example, it's something where you can collect all uninstallation or for all your software in a script. Look like a script. And it looks like a [indiscernible] sandbox for the people already know what is a sandbox. Works with a consistent [indiscernible] across the environment. It is well made, well designed, you can run on ARM, [indiscernible] and everything works. You can testing your development without break your environment. example, you're testing a software. You want [indiscernible] works and maybe you need to make some changes just to stress your [indiscernible]. But overall, you don't want to break your machine. In this case, you can make a docker testers [indiscernible]. And this docker can facilitate management and scaling example, you can quickly use these docker [ remains ] this container to run on multiple robots out of data automatically for each robot [ year-in-year ] overall. Behind the docker -- when you run a docker, there is an engine. This engine have managed only majors. And major, we will see soon is the core all software not running about what you can find inside a container. A container is only the part where the system is running is loaded and the software is running inside is a small word. And this container is connected with the network balance with [indiscernible] access the CPI to connect and know what is going on about Docker on your machine. And finally, there is a [indiscernible], when managed all the stuff. Now okay, introduced many, many, many words as container image what is build, I was speaking in the beginning. All the stuff is the core to make docker [indiscernible] and to run our as across. First of all, we have a docker file. A docker file script -- look like a script, I know it's an improper word, but can understand for the people are starting now with docker. On this file, you have write, example, [indiscernible] something [indiscernible], all these word are collected here. And after that, you have a package and image after the build, and you can run directly this image and obtain a container with all your software running. This is the 3 important stage we should investigate to use [ lines ] across and to design our docker. No worry, I'm not sick. Compared from my previous presentation, I'm fine. What is a docker file. Docker file is a script, like I was telling you before. What is -- it's important to know, you specify the big major, its work, [indiscernible] simple, the syntax. I will not speak in this case which is this index you can find online, there are many tools to write it, but it's really, really simple. [indiscernible] Directly without under -- without [ now ], we can understand what is going on. It's used to build [indiscernible] with a docker build to build an image helps to make an automation on your installation in our case price across. And it is, again, well made with a good part [indiscernible] , you have a good version control. example. You have your eyes across the software, designed [indiscernible] or making a new version for amble and making shorter changes on your docker file, building again with a proper target or people are working can just update target and also [indiscernible]. It's really is simple to share and deploy. Example, we have our server with all our NVIDIA [indiscernible] packages images available. [indiscernible] there are many plant other system to [indiscernible]. Autorun docker image, you can use in this case, like [ Gita ]. You have a docker [indiscernible] image, you can quickly run with a common docker run and adding a different tags, names, the name of the image. You cannot -- you can download pull again, example, another image, in this case, just to have a really complete overview about the software or the software work [indiscernible] sample web user interface for your robot and being another docker image with an example is only for the bug. And after when the year robot is working on our house, you don't need every time a user interface to the bug [indiscernible] robot. After -- when the robot is working -- is not -- is in production, you switch off a docker and the robot works with the same setup. Docker container. This is the end of the story about docker file, docker build and docker container. Docker container is finally an executable stand-alone packages installed from the docker file, where you provide example in the end, we will see soon an example with the common [indiscernible], example for Isaac ROS, for ROS 2, in general. We have a ROS 2 launch file or ROS 2 run script in -- or common. In this case, you can tell to the docker container, in this case on the docker in major when the docker [indiscernible] container start. Okay, please -- when I will write docker run a script, run a [ common]. In this case, ROS 2 launch Isaac ROS something or ROS 2 something as well or my package that they made as well that start my landscape. Another point that is important, we are speaking about Isaac ROS, we are speaking about docker, there is a really cool container toolkit we provide. It's the immediate container toolkit. What enables the docker to use the [indiscernible] GPUs or use order [indiscernible] drivers. Every docker run with this run time are allowed to use the GPU. And this is important for Isaac ROS. An example, you can make different containers, this is another interesting point of view to design a robotics application. You can use a docker container with CUDA for all AI applications. Another Docker container without CUDA, I mean, in this case, it's only a user -- web-user interface, okay? And you can connect all these container on our networks. And all docker are using all hardware and software [ need ] to run. This is an example of an NVIDIA docker file for CUDA application. Really simple, doesn't work [ so ] just have an idea and the first overview about docker file. The first one -- the first line you see is the major where a docker file start, example. If you're working [indiscernible], we specify all software is written below, all script is made below, use [indiscernible]. If you use 100 distribution, you write another distribution. In our case, for this example. I specify -- please use NVIDIA CUDA with 11.4 base and [ 120.04 ]. In this case, all software starting below the line from -- are already working in an environment with CUDA [indiscernible], [ 20.04]. I don't need to take care about the rest of the software. And [indiscernible] again, to reinstall CUDA. Insurance is already there. After that, an example in a script is something that you do imagine when you install ROS 2 on your machine. What you do a [ PC ] update, install resources, all these [indiscernible] are usually written after the world run. In this case, okay, run, [ APK ] update, install of these packages. After that, there are other [ combat ] important that you can -- it's important to know, if it is our first sign, example [indiscernible] a word copy and work [ clear ]. Copy allowed when the docker build start to take some software could file you made outside the build, copied inside the docker file and when the build is starting [indiscernible] is working, use this file to compile example. [ Work ] is another one important. In this case, it's like -- all lines after [ line 13 ] are living inside the folder up. After that example, [indiscernible] we want to run when I [indiscernible], I want the discrete [indiscernible]. We have the first general view about what is Docker and how I can use it. Now okay -- now the first introduction about Docker is done, the [ EBITDA ] CUDA toolkit as well [indiscernible]. And now let's see what is across, again, just to know, in another point of view, if it's -- if you're ready [ nonworkers ] across, please look at what is showing here. In same story, what is Isaac ROS common. First step up, what you can find? You can find on Isaac ROS [ Jenson ] information about all Isaac ROS packages. Second point, NVIDIA Isaac ROS. This is the [indiscernible]. If it's your first sign or you don't know when you open this page, there is a bottom [indiscernible] but in my suggestion is click on follow because when we release an update, updating our software, you can directly see on the GitHub time line, what is going on, on our branch -- general [Indiscernible] really. And this is my suggestion, click on follow that you see on this page. On top -- near the name. This is an older screen shot, but you can find that. This is something that maybe you never noticed about Isaac ROS. Like I was telling the beginning of the story, okay, we released many updates about Isaac ROS version that along there is a link. You can see the changeover for each version. But something that I always notice is okay. I won't use [indiscernible]. It's important to see on this table for each release. Let me -- okay. We have 1 later point now. For each release, all was made Isaac ROS in this case example of this version was made for specific NVIDIA [ jackpot ] was designed [ FireFox ]. Example, if you have [indiscernible] I won't use an old version of Isaac ROS. You can use less capability of the latest. But all -- this version are working -- remember to use the proper [ Jetpak ]. If you want to work with the future, what we are doing now with the whole capabilities about Isaac ROS, you need to work with a Jetpack 5. In this case, which [indiscernible] you can use, all [indiscernible] and all [indiscernible] series. All these packages are working with Jackpot 5 and bigger. And from the Jackpot 5, all Isaac ROS is built for [indiscernible]. Example, if you -- if you read our number, you can directly work with all these merchants. Another package is important in is Isaac ROS common? But today, I don't want to read the Read Me, if you've never seen, please use this [indiscernible] directly typing -- type this link or should be somewhere the resources you can use -- you run the Read Me to run this script. But I don't want [ one ] show in another way, what is behind because now we are more Isaac ROS developers for -- to design a docker file and build a container -- run a container, sorry. What is important to know? When you work with us across common -- there are different packages are -- and is designed for a different machines with different docker files. But this is important when we design our docker. Example are running for [ X86 64 ] with NVIDIA or for [indiscernible] I'm thinking about the latest version. Software are running for [indiscernible] again are using [ Ambu ] are working together with 11.4, are using these VPI 2.16. And the [indiscernible] depends on the Isaac ROS packages you need, not all Isaac ROS packages need these libraries. In this case, you need to check the specification of what you want. Another important point with us across [ common ]and maybe you're already seeing online across many of these packages are working with an interest. This is important because it is your first time to hear about Isaac ROS. This is really a cool package that speed up the communication between topics on Isaac ROS. And this you -- you can note, it's more or less one of the most important ROS 2 Isaac ROS package, you need work to build with the rest of the Isaac ROS packages. In this case, this is always work [indiscernible] I don't want to spend a lot of time really here on this presentation. And when you can download this presentation, you receive an email later with all my presentation. Another point about Isaac ROS common and what weaker [ reviews ], it's important to understand when you define your docker file is always made. In this case, Isaac ROS common start from the ROS 2 services, use the package from the [indiscernible] in this case, from [ 12.04 ] and are [indiscernible] is something that we already provide. You can directly download this image. I use it from a starting reference point. And after that, they only compile Isaac ROS packages or compile your packages. After that, in this image are compiled all sources for [ 12.04. ] This is important if you don't know, but [indiscernible], the binaries are available for [ 12.04 ] but the sources can be compiled for [indiscernible] and compared obviously for [indiscernible]. Same story, if you want to use the base, ROS docker that the paramedics provide, you can use as well, in this case, already built like ours in the [indiscernible] are working with CUDA. Like we know. If our docker file is designed for [ with ] CUDA, these docker run with CUDA. The other one, no, in this case. But maybe you don't need but you can use each [ one ]. And it is important to know that all dockers can run on your [indiscernible] or on your season. Okay. But now we know [indiscernible] docker. Across common, we know some that seem interesting to design our docker and finally, where we [indiscernible]. Okay. Let's go again on design our Isaac ROS docker. Interesting point. Okay. Maybe you have seen when you jump on our immediate jetpack page, all our jetpack available. So an interesting point from the jetpack 5. This is a huge work, really cool that you can, and this is highlighted here, you can install other product instead of [indiscernible] running on your [indiscernible]. And this is an interesting [indiscernible] can use to design [indiscernible] across Docker. There is another point about CUDA and docker for CUDA. If you jump on this on this page, where we provide all our images, we can see that for CUDA, and this is another point [indiscernible] for multi architecture means if I design my CUDA from this image, for sure, it will be cross-platform, interesting. It is interesting to design a well-made dollar. What I need and what you can use in this case, this is another interesting point, and I hope can be helpful for you. If something that work to open ins is open source, I designed to be open and [indiscernible] already feel free. If you need an update, if you have a [indiscernible], feel free. For Isaac ROS base, I designed an example, compared to use for your application, in this case, to design your docker for [indiscernible] or for [indiscernible] application. Another important point that I noticed not many people, in particular, when I open many GitHub repositories and when the people all the people work to this under environments. Now many people know what is the [indiscernible] that I want to highlight for all ROS developers and Isaac ROS developers. This is a tool that you can use to quickly build your workspace for ROS. An example, you have many [ long ] to do example. You need the [indiscernible], you need Isaac ROS [indiscernible], you need enough to -- you need your another GitHub repository package that you design, okay, you can make a list for all these packages. And like we have seen in the beginning, with this ROS [ small ] file, you can directly -- quickly build a workspace where after you can build your ROS 2 environment working with ROS 2 -- with [indiscernible] as an example. Okay. Now we are on the core of this webinar. We have the ROS install example with a list of my packages I want. In this case, Isaac is an example, you can see only the Isaac ROS packages. But example, you can see on [indiscernible] our other projects, [ I ] lease here other packages that I need, example, the real sense because it's a sensor [indiscernible] for my design. My tool to run my launch file, [indiscernible], I hear all or packages that I want and after, we have a dongle. By the way, these tools work as well on your or your system is a works very well. But in the feed where doctor developers, is across locker developers. We designed like this example, derile where first point, we have our major example, this amble based level page. After that, we have seen in the beginning, the common copy. We can copy this install that is my folder. We come inside the container and say, okay, now you are here -- now we see another point that is the run where we run our script. In this case, what is happening we're making our workspace. If you have already made or follow the Ross tutorial, you know we need to do, make our space okay is done. We are moving on disposal. Now we are making and growing all packages we need from this list on our workspace. After that, okay, we cancel to space on our docker. After that, what we should do. We run the script to have all our comments on this stage. After that, we are that example to full all packages we need we do something else if is needed. And okay, here. And after that, we run [indiscernible], in this case, with my arguments, but you can add what you want. This is going to be an example. And on this line, I specify to do, okay, build my made with my Isaac ROS packages, ROS 2 packages in general, and when it's done, I mean I can only write docker [indiscernible] works. An example in the end. Okay, sorry, I forget this page that is more clear, okay? This is what I was already saying before. And here, in the end, with this comment is like more than 3 points we have seen before. I specify like we do on our shell ROS 2 launch, my package and my scripts and [ dollar ]. Every time I will write docker run, I can use for my -- I am -- all my software running on my [ Jetson ] or my [ Almarai ]. What you have seen just record a build, I built on line in media Jackson, the software build only desktop after that, just to quickly see Docker build specified to okay build a file. In this case, I don't specify the name of the file because if you're right, Docker file like the title here is something that automatically do recognize and use. I specify the tag for this version, and they say, use all file are on this folder. And for docker run, another point to highlight, when I say docker run, use this run time, I specify to docker demo, remember, many docker need NVIDIA to use in this case. This specific docker image when the doctor container start to remember to use this rontime. In this case, the container is allowed to use all engines from your NVIDIA discrete board or [indiscernible]. And now finally, we made it we can design a CI because finally it's done. Example, this is -- you can develop your GitHub or your [indiscernible],whatever you're -- your environment somewhere. You can delete your code. You can -- you have your CI that for each clone example, download with a vicious tool or a package need. You can use remotely [ Jetson ] to compile an age or testing your docking made you can run on [ x86 64 ], the same docker image and testing for [indiscernible]. When all is done, you can push and say, okay, it's somewhere, but I want now every robot one [indiscernible] can use this image, an example with the watch tower or something else can be automatically updated every time we release a new update. And for this, we are done. For Jetpack 5, we do really cool, cool, cool stuff, for Isaac ROS and for -- to design your application. Well, what you are seeing for the Docker in [indiscernible] is not only for Isaac ROS, but you can use example for flow or something else for all AI applications that need and cross-platform because finally, I want to use example across with an AI gene and what build in different dockers or your application. Now I must speak really quickly. Just to have a really shorter remind, if you're maybe on Jason, well, honestly, suggest to, first of all, the GTC is coming with news. And -- but okay, I won't use meanwhile now is across with an old version better than nothing. I can do something. In this case, so just a bit different because we don't have the features we have seen it before, and I will speak really fast. In this case, there is an example with trial with another way to make a docker file. In this case, the story is different. We don't have the feature we've seen before. There are different audience in this case. [indiscernible] story is different for a [ 4.5]. In this case, we are on bond [indiscernible]. We are working on Fox. We need another base made for this docker -- you have all EI with less capabilities, but just have another view, okay? Or is made. In this case, to Fox is compiled from the services like Amber we have seen before. After that, we need to do some changes to allow Autobild to build is across. In this case, we need to say they're on time and allow the Jetson if you want to build the Argos came example projection. And after that, you need to eat and in this case, year-over-year in major and all is done for our Jetson now. Another point is the across the plant for. is a tinplate where you can just modify a few lines and you can use it. And there is an example, in this case, was an example with RealSense to set up your docker for Jetpak 4.6 and on onerous. If you like, -- these are across template, 45. Let me know opening an issues or let me understand that you start this repository and I understand it's something that you need to work for work. Recap, okay, recap resources across. Remember, to follow NVIDIAs across to see on your getupimeline what is going on when we're releasing the updates. Another point is the Isaac ROS versions for each Jackpack, which version you should use -- and what you can see inside the stocker and this on the stack example, if you want to use an old version of Isaac ROS, we are [indiscernible] with ambulants and for which Jackson you can use. Another one is Isaac ROS base where you can find a different base for [indiscernible] compiled can be much more as possible across platform. Another point is all to design your docker file. In this case, remember, this is an use the VC tool to list all your packages in it or then you need to compile, sorry. After that, auto make a file -- automate a docker file, auto copy, auto right your build, these lines are really common. You can -- if you have seen other docker 5 from other repository more or less always made on this line when you work with ROS 2. And that's all. Finally, I want to remind you and please join and register for our webinar will be for the end of February. In this case, is how to generate synthetic data for training AI models with as a replicator. The link below or you can use this for CUDA. I remember -- are you with the right one? I don't remember [indiscernible], but there is a link below. And in this case, you can use generic synthetic data to train AI models. And remember what I tell you in the beginning, you can use this training AI models to train a model, you can use this model example with Isaac ROS for -- to detect an example, avoid [indiscernible] detect people and make the robot allowed to travel alone. After that, thank you. We are on the Q&A now. [indiscernible] see what is going on.

Hello, thanks. My name is Aaron, and I will be asked with. Are there specific GPU families that Isaac is supporting?

GPU, as I mentioned, we are speaking about you can try to remember now, but you can check once Isaac ROS come in, which type of graphical you need on your -- on our station.

Okay. Great. How do you actually use it? Can you list concrete purposes for this toolkit?

Well, it's too simple, just explain [indiscernible]. But when the NVIDIA toolkit workstation we are graphing -- [indiscernible] works directly and works directly with the demo -- with a docker demo. You don't need to know nothing this toolkit speech internally with docker demo and allowed your. rely works directly with the demo -- with docker demo. You don't need to know nothing on is right longtime NVIDIA, that's this tool kit speech internally with docker demo and allowed your container to work. But after all, you do need to let nothing for the simple use or otherwise, I don't have experience, but on our documentation, you can find, but for it across I don't think.

Next question. For the [indiscernible], can one run ROS 2 on it?

Yes. Like you have seen in my presentation, remember in this case, you can use an oral version of is across. It started, check which version use, you can set up your environment with these old features, check as well which jetpack are you using or you're just [indiscernible]. And on a specific version of Isaac ROS. I suggest, by the way, to panel and able because we are releasing many, many new features pool.

Okay. How do you update AI models in Jetson Nano? Is there a ready-made mechanism?

The AI models in -- well, speaking about water or, in general, when you can unload the model, train the model and on your Jetson or train it on your desktop and middle out works on Jetson. And you can use this finally the net model on your eyes across, in this case, a check on our ads across on the documentation of the subject is pretty long and out of subject year. But yes, you can do it.

Thank you. If I were to want to test a containerized app across Jetson, a workstation and the server, et cetera, what would be the best base image to start from?

If you want don't spend to make cross-platform I suggest to start from Miapuda. In this case, this image is a designer that will work across platform. Right now, as a cross common, there are 2 dockers in this case, works together, you need to remember which docker you need to run depends on [indiscernible]. With the NVIDIA CUDA, you can use cross-platform. I suggest, by the way, to build on Jetson and build right now on Isaac ROS as well for [indiscernible].

Next question. Can I use a machine with, for example, with [indiscernible] and ROS Humble installed and build a container with [ Ubunt2004 ] and proxy?

Good question. So we are sharing the current usual maybe. In this case using [indiscernible] building an image for [indiscernible] or build -- I didn't try honestly should work, don't trust atonal work you should do. [ We ] really don't trust me.

Okay. Is fleet command free to use? How can we do over-the-air updates for a fleet of robots?

Sorry, I didn't -- which are -- which program or...

Fleet command.

Fleet command. I'm not so expert on Fleet command. I can jump on another question.