NVIDIA NIM Shocks The World at 2024 Computex & Jensen Huang Signs Womans 🍈👀🍈

A lot's been going on in the AI industry especially in regards to Nvidia and some of their recent announcements as well as Jens Singh over here uh apparently making the stock go up by signing a woman's yeah let's dive right into it all right so here we have you know this guy tweeting out saying the market cab of Nvidia is up over 200 billion since the CEO signed a boob and here we have Jensen if you didn't know yeah he's sort

Of like kind of like you know how the maybe a celebrity like uh a rapper or a rock star is like signing a woman's rest here and we uh check this out here it is right here you sure sure is that a good idea are we going to have this all right so that's pretty funny but the main point of this video is to go over some of nvidia's recent announcements there's been a lot going on with Nvidia and I wanted

To make this video a couple days ago but uh you know I've been posting a few different types of videos as well as uh just super super busy I got a lot of cool stuff ready for you guys so uh make sure to smash that subscribe button if you want to stay up to date with our daily uploads and let's dive right into it just last week Google announced that they' put CDF in the cloud and accelerate pandas pandas is the

Most popular data science library in the world many of you in here probably already used pandas it's used by 10 million data scientists in the world downloaded 170 million times each month it is the Excel that is the spreadsheet of data scientists well with just one click you can now use pandas in Co colab which is Google's cloud data centers platform accelerated by qdf the speed up is really incredible let's take a look [Music] that was a great demo right didn't

Take long this is Earth to the idea that we would create a digital twin of the earth that we would go and simulate the Earth so that we could predict the future of our planet to better avert disaster ERS or better understand the impact of climate change so that we can adapt better so that we could change our habits now this sounds like Sim digital twin of Earth is probably one of the most ambitious projects that the world's ever undertaken and

We're taking step large steps every single year and I'll show you results every single year but this year we made some great breakthroughs let's take a look on Monday the storm will via North again and approach Taiwan there are big uncertainties regarding its path different paths will have different levels of impact on Taiwan someday in the near future we will have continuous weather prediction at every at every square kilometer on the planet you will always know what the climate's going to

Be you will always know and this will run continuously because we've trained the AI and the AI requires so little energy in the late 1890s Nicola Tesla invented an AC generator we invented an AI generator the AC generator generated electrons nvidia's AI generator generates tokens both of these things have large Market opportunities it's completely fungible in almost every industry and that's why it's a new Industrial Revolution and now we have a new Factory a new computer and what we will run

On top of this is a new type of software and we call it Nims Nvidia inference microservices now what what happens is the Nim runs inside this Factory and this Nim is a pre-trained model it's an I well this AI is of course quite complex in itself but the the Computing stack that runs AIS are insanely complex when you go and use chat GPT underneath their stack is a whole bunch of software underneath that prompt is a ton of software and

It's incredibly complex because the models are large billions to trillions of parameters it doesn't run on just one computer it runs on multiple computers it has to distrib the workload across multiple gpus tensor parallelism pipeline parallelism data parall all kinds of parallelism expert parallelism all kinds of parallelism Distributing the workload across multiple gpus processing it as fast as possible because if you in a factory if you run a factory your throughput directly correlates to your revenues your throughput directly correlates to

Quality of service and your throughput directly correlates to the number of people who can use your service we are now in a world where data center throughput utilization is vitally important it was important in the past but not vitally important it was important in the past but people don't measure it today every parameter is measured start time uptime utilization throughput idle time you name it because it's a factory when something is a factory it's oper ations directly correlate to the financial

Performance of the company and so we realize that this is incredibly complex for most companies to do so what we did was we created this AI in a box and the containers and incredible AMS of software inside this container is Cuda cudnn tensor RT Triton for inference Services it is cloud native so that you could Auto scale in a kubernetes environment wow it has Management Services and hooks so that you can monitor your AIS it has common apis standard API so

That you could literally chat with this box we now have the ability to create large language models and pre-train models of all kinds and we we have all of these various versions whether it's language based or Vision based or Imaging based or we have versions that are available for healthc care digital biology we have versions that are digital humans that I'll talk to you about and the way you use this just come to ai. nvidia.com and today we uh just posted

Up in hugging face the Llama 3 Nim fully optimized it's available there for you to try and you can even take it with you it's available to you for free and so and finally AI models that reproduce lifelike appearances enabling real-time path traced subsurface scattering to simulate the way light penetrates the skin scatters and exits at various points giving skin its soft and translucent appearance Nvidia Ace is a suite of digital human Technologies packaged as easy to deploy fully optimized microservices

Or Nims developers can integrate a Nims into their existing Frameworks engines and digital human experiences neotron slm and llm Nims to understand our intent and orchestrate other models Reva speech Nims for interactive speech and translation audio to face and gesture Nims for facial and body animation an Omniverse RTX with dlss for neural rendering of skin and hair and so we installed every single RTX GPU with tensor core G tensor core processing and now we have 100 million GeForce RTX AIP CS

In the world and we're shipping 200 and this this compy Tex we're featuring four new amazing laptops all of them are able to run AI your future laptop your future PC will become an AI they'll be constantly helping you assisting you in the background ladies and gentlemen this is Blackwell black black well is in production incredible amounts of Technology this is our production board this is the most complex highest performance computer the world's ever made it's alive this is the gray

CPU and these are you could see each one of these blackw dyes two of them connected together you see that it is the largest D the the largest chip the world makes and then we connect two of them together with a 10 terabyte per second link so this is a dgx Blackwell this has this is air cooled has eight of these gpus inside look at the size of the heat sinks on these gpus about 15 kilowatt 15,000 watts and completely air

Cooled this version supports x86 and it's it goes into the infrastructure that we've been shipping Hoppers into however if you would like to have liquid cooling we have a new system and this new system is based on this board and we call it mgx for modular and this modular system you won't be able to see this this can they see this can you see this you can the are you okay I say and so this is the mgx system and here's

The two uh black Blackwell boards so this one node has four Blackwell chips these four Blackwell chips this is liquid cooled nine of them nine of them uh well 72 of these 72 of these gpus 72 of these G gpus are then connected together with a new MV link this is MV link switch fifth generation and the mvlink switch is a technology Miracle this is the most advanced switch the world's ever made the data rate is insane and these switches connect

Every single one of these black Wells to each other so that we have one giant 72 GPU Blackwell well the benefit the benefit of this is that in one domain one GPU domain this now looks like one GPU this one GPU has 72 versus the last generation of eight so we increased it by nine times the amount of bandwidth we've increased by 18 times the AI flops we've increased by 45 times and yet the amount of power is only 10 times

This is 100 kilow and that is 10 kilow this is one GPU ladies and gentlemen dgx GPU you [Applause] know the back of this GPU is the mvy link spine the mvy link spine is 5,000 wires a two miles and it's right here this is an MV link spine and it connect 702 gpus to each other this is a electrical mechanical Miracle the transceivers makes it possible for us to drive the entire length in Copper what and as a result this

Switch the Envy switch MV link switch driving the EnV link spine in Copper makes it possible for us to save 20 kilowatt in one rack 20 kilowatt could now be used for processing just an incredible achievement so we have code names in our company and we try to keep them very secret uh often times uh most of the employees don't even know but our next Generation platform is it's called Reuben the Reuben platform the Reuben platform um I'm I'm not going

To spend much time on it uh I know what's going to happen you're going to take pictures of it and you're going to go look at the fine prints uh and feel free to do that so we have the Reuben platform and one year later we' have the Reuben um Ultra platform all of these chips that I'm showing you here are all in full development 100% of them and the rhythm is one year at the limits of Technology all 100% architecturally

Compatible so this is this is basically what Nvidia is building a robotic Factory is designed with three computers train the AI on Nvidia AI you have the robot running on the PLC systems uh for orchestrating the the uh the factories and then you of course simulate everything inside Omniverse well the robotic arm the robotic amrs are also the same way three computer systems the difference is the two omniverses will come together so they'll share one virtual space when they share one

Virtual space that robotic arm will become inside the robotic Factory and again three three uh three computers and we provide the computer the acceleration layers and pre-train uh pre-train AI models we've well I think we have um some robots that we like to welcome here go about my size and we have we have some friends to join us so the fut the future of robot robotics is here the next wave of AI and and of course you know Taiwan builds computers

With keyboards you buil computers for your pocket you buil computers for data centers in the cloud in the future you're going to build computers that walk and computers that roll you know around and um so these are all just computers and as as it turns out the technology is very similar to the technology of building um all of the other computers that you already build today so this is going to be a really extraordinary uh Journey For Us wow so really

Interesting stuff there obviously this is a you know clipped up version right um the original keynote is uh about an hour and a half or something like that above that um but really interesting stuff there um it's going to be very interesting to see how this pans out um you know the Omniverse the simulating you know the ver virtual world essentially like it just seems like to me obviously we're making these big improvements you know the robot the the uh the

Gpus the Computing you know I was just pulling up here on my other screen let me just show you nvidia's website ai. nvidia.com instantly deploy generative AI Nvidia NM expore the latest computery buil AI models with API optimized accelerated by Nvidia and deploy any anywhere with Nvidia Nim inference microservices all right so um seamless compatibility with popular libraries here is uh the Nim so like we want like you went over in the video um as well as they were talking about

Obviously the computers you know your AI your computer is going to just be like an AI this is stuff we already know I mean like I already know we've talked about it on this channel you're in the AI industry like this is like the direction we're heading we know this um you know in terms of we just had Microsoft kind of announced their whole uh you know what do you call it their their AI PCS um and this is kind of

Well that part was kind of similar to Microsoft except Nvidia is I mean it's I mean it's Nvidia I mean they're uh they are crushing it with AI so it's definitely if I was to pick one I would probably go with like the well I mean yeah I would probably go with the ones that uh Jensen was showing especially just cuz like I mean who knows it's really hard to say but uh yeah even I was watching some some stuff the

Other day too about uh the Microsoft PCS and the SC that whole screenshot feature the recall feature I mean essentially it's basically like uh if you care about security it's it's it's not it's really not good I mean a hacker could easily access those screenshots that are stored locally on your device and it's a lot easier to do to get sensitive information like what password you're typing in you can literally search that or this or that with something like recall opposed

From not using something like recall but I don't know I I didn't see too much about the Nvidia um devices here I don't know if they're going to have something similar to that or what these AI laptops or devices are going to look like in the future is that just going to be a regular thing to have something like in like the recall method that automatically screenshots everything like once you have these AI devices like it's going to need to like

What's the level of security is it going to scan your face is it going to like how will it know it's you how is this going to relate to you know people hacking stuff or security issues or whatnot um yeah there's a lot there's basically about to be a whole lot of Paradigm shifts rapidly sequentially especially as we start hitting the uh the you know accelerated um you know uh exponential curve and just with what Jensen's talking about here with at

The start with the whole virtualized world thing and and all this where they're able to predict like the future and stuff I mean that's exactly kind of aligned with like simulation Theory and where everything's going you know Singularity and um yeah I mean yeah it's almost seems like it's just a self fulfilling Prof or it's like basically just falling in line with what it uh with kind of those type of predictions but anyways we'll get into more of that later on

I just wanted to give you an update with the whole Nvidia thing is a pretty big um some pretty big announcements here um on Monday if you guys don't know there's going to be I believe the Apple um announcements going on so stay tuned for that I'm going to be covering that we're probably looking at some sort of AI integrated Siri or something on the phone maybe some maybe an open AI partnership who knows speculations but uh that's what some people

Are predicting so other than that let me know what you guys think about the whole Nvidia um announcements what do you guys think about each and everything as well as pretty much everything going on right now in the AI landscape as well as Jensen you know taking some autographs you know but other than that guys um I will see see you in tomorrow's video guys uh hope you've been having a great week it's been crazy in AI space and I know

It's only going to get crazier um so if you want to stay up to date with that make sure to smash that subscribe button smash the like button if you got value from this video also too guys join our free uh Community part of this channel it's R community.com link for that will be in the descri description it's our free Facebook group free Discord Channel also to I make a lot of videos showing you guys how to actually Implement AI into

Your personal life into your business bu if you run a business how to optimize things with automations um and stuff like that so if you want to uh see some of those videos then yeah stay tuned there's going to be a lot more value coming I have some really cool stuff planned for you guys but other than that I will see you in tomorrow's video guys keep hustling keep grinding and of course guys accelerate your stride take care