WEBVTT 00:00:00.000 --> 00:00:09.780 we're at the super micro booth at cs2023 and this bad girl right here is the 00:00:04.940 --> 00:00:12.300 sys751 g-e-t-n-r-t an 80 000 AI 00:00:09.780 --> 00:00:16.320 supercomputer designed to go in your house no seriously people are asking for 00:00:14.400 --> 00:00:21.060 this and trust me I have the same reaction but hear me out the world is 00:00:18.779 --> 00:00:25.380 changing for perspective every workstation that super micro now sells 00:00:23.039 --> 00:00:28.680 is actually purpose built to support Ai and machine learning and bundle that 00:00:26.939 --> 00:00:33.480 with a global shift to working from home and you end up with demand for top tier 00:00:31.260 --> 00:00:38.460 AI Hardware like this the type of stuff that draws thousands of watts of power 00:00:35.520 --> 00:00:45.180 that's somehow quiet enough to be under your desk at home like seriously where's 00:00:41.879 --> 00:00:48.480 the power button oh I missed it 00:00:45.180 --> 00:00:51.300 it's on that's how loud it is and this 00:00:48.480 --> 00:00:56.219 is how a radiator quite literally almost the size of an Xbox series X holy 00:00:56.579 --> 00:01:02.879 but not as holy or as is this segue to our sponsor thanks to Acer for 00:01:00.899 --> 00:01:06.720 sponsoring this video Acer's pushing the limits of 3D gaming with their new 3D 00:01:04.680 --> 00:01:10.280 Ultra mode and spatial Labs true game so stay to the end of the video to find out 00:01:08.040 --> 00:01:10.280 more 00:01:17.180 --> 00:01:24.540 man I can't get over how big this radiator is seriously when we got that 00:01:22.020 --> 00:01:28.380 press email about this I was like ah just a workstation but look at this 00:01:26.640 --> 00:01:32.700 radiator and I can't wait to show you the rest of the water plate but for now 00:01:30.060 --> 00:01:36.479 let's make this back into a complete system of course since this system is 00:01:34.500 --> 00:01:40.860 meant to go you know at someone's house or in a lab under the desk the form 00:01:38.579 --> 00:01:43.860 factor is a talent now it is still rack mountable you can pull off the top here 00:01:42.360 --> 00:01:47.100 and the feet at the bottom and rack mount it but the intended purpose is a 00:01:45.659 --> 00:01:51.240 tower so up front you're going to see things that are like a workstation we 00:01:49.020 --> 00:01:55.140 got headphone jack microphone Jack kind of standard things I don't know if you 00:01:53.100 --> 00:01:59.579 would you know have Windows on this and do your Microsoft team calls on a on an 00:01:57.540 --> 00:02:04.500 AI super computer like this but you could if you wanted to there's also two 00:02:01.439 --> 00:02:08.160 USB ports and one of the stars of the 00:02:04.500 --> 00:02:10.020 show the eight Gen 5 NVMe slots all of 00:02:08.160 --> 00:02:12.780 them are full speed you can see our boot drive right here what is this nothing 00:02:11.280 --> 00:02:16.260 exciting it's just a two terabyte boot drive but you could put up to 00:02:14.459 --> 00:02:20.700 theoretically if you put 30 terabyte drives 00:02:17.480 --> 00:02:22.800 240 terabytes of storage in this system 00:02:20.700 --> 00:02:26.520 and that's before we even get to any of the other cool Hardware now of course 00:02:24.360 --> 00:02:30.000 the best thing up front is the power button because you turn this thing on 00:02:28.020 --> 00:02:35.640 it's like it barely makes noise this computer has 00:02:33.360 --> 00:02:40.319 two 2 000 watt power supplies in it that's the type of heat we're dealing 00:02:37.260 --> 00:02:42.180 with and it barely makes noise now some 00:02:40.319 --> 00:02:46.260 of you are probably saying well you know it's not doing anything yet but they had 00:02:44.459 --> 00:02:52.260 it when we walked in here loaded with I think a 1500 watt load or so still the 00:02:49.620 --> 00:02:55.760 exact same noise level oh there's peels in here that haven't even peeled 00:02:58.200 --> 00:03:04.260 remove film before use nobody read that it never gets old 00:03:02.640 --> 00:03:08.400 peeling plastic off ten thousand dollar graphics cards let alone four of them 00:03:06.239 --> 00:03:12.360 now we'll talk about those later I think the star of the show here is actually 00:03:10.200 --> 00:03:15.540 the CPUs now this isn't an AMD based system this is Intel 00:03:13.800 --> 00:03:20.159 um despite AMD having really really awesome server stuff it's still only 00:03:17.580 --> 00:03:23.879 about 30 of the market share so 70 of the systems they're selling are still 00:03:21.360 --> 00:03:28.260 Intel based this is sapphire Rapids it's actually just come out after God it's 00:03:26.640 --> 00:03:33.120 been like two years of DeLay So this system fully specced out could be up to 00:03:29.879 --> 00:03:35.220 256 core processors or 350 watts per 00:03:33.120 --> 00:03:38.700 socket serious amount of power for memory there's eight sticks per socket 00:03:36.840 --> 00:03:42.840 and while Sapphire Rapids can do up to 16 or two dims per channel it's kind of 00:03:41.280 --> 00:03:46.799 hard to fit it in a configuration like this well you'll see in a lot of dual 00:03:44.340 --> 00:03:49.739 socket servers is the CPUs kind of in the front or they'll be in a 00:03:48.180 --> 00:03:54.180 configuration where they're staggered slightly now this is important primarily 00:03:52.140 --> 00:03:58.140 for airflow yeah if you were to have both of the sockets like this in an air 00:03:55.799 --> 00:04:01.739 cooled system the second CPU here is just going to be getting a straight hot 00:03:59.940 --> 00:04:06.420 air which you don't really want since this is water cooled it doesn't matter 00:04:03.239 --> 00:04:08.220 now it's also weird I've never seen a 00:04:06.420 --> 00:04:12.959 system like this where the sockets are in between the graphics cards especially 00:04:10.860 --> 00:04:16.979 in this configuration now there is an important reason for this because the 00:04:14.760 --> 00:04:21.359 system is PCIe Gen 5 the actual Lane length the physical traces on the 00:04:19.199 --> 00:04:25.620 motherboard the length of those is very important the longer you go the harder 00:04:23.820 --> 00:04:29.699 it is to run that sort of frequency as PCIe Generations get faster and faster 00:04:28.080 --> 00:04:32.820 it's just going to keep getting harder and harder a lot of boards from other 00:04:31.380 --> 00:04:38.400 manufacturers will use something called a retimer which is basically just like a 00:04:35.040 --> 00:04:40.020 a signal booster but super micro doesn't 00:04:38.400 --> 00:04:43.259 use that and because they position the sockets like this they can make those 00:04:41.460 --> 00:04:47.940 physical traces on the board from the PCIe slot to the CPU super short which 00:04:46.020 --> 00:04:52.020 makes it a lot easier to run speeds like that and you don't have to use retimers 00:04:49.800 --> 00:04:55.320 now since the CPUs and the gpus are water cooled naturally the next thing 00:04:54.180 --> 00:05:00.780 you're wondering is what else are they going to water cool and apparently on the next version of the system they're 00:04:58.620 --> 00:05:04.440 going to water cool the dims I mean it's not doing anything right now they don't 00:05:02.400 --> 00:05:10.020 feel particularly hot and there is a good amount of airflow but I guess the 00:05:07.800 --> 00:05:13.919 more dense the dims get you can use up to 256 gig dimms which in the full 00:05:12.180 --> 00:05:18.660 configuration is two terabytes per socket um 00:05:15.720 --> 00:05:21.840 probably a bit more heat than this do you think they get mad if I took one 00:05:20.100 --> 00:05:26.240 of the graphics cards out yes they like us I think I'm just gonna do it what's 00:05:23.460 --> 00:05:30.120 the worst that could happen going to jail you took a graphics card 00:05:28.320 --> 00:05:33.960 out oh there's actually locks on these whoa weird I guess because this is a 00:05:32.400 --> 00:05:37.680 workstation um there is PCI e-locks if you look on 00:05:36.060 --> 00:05:40.759 servers most of the time they don't have it oh 00:05:42.720 --> 00:05:53.120 I think that might be about as far as I can get it to come out oh wait look 00:05:47.960 --> 00:05:53.120 oh more people oh wow there's more 00:05:53.639 --> 00:05:58.860 whoa weird I didn't even realize he's actually used the new 12 pin connectors 00:05:56.940 --> 00:06:02.400 I wonder if they've had any that have caught on fire well regardless of taking 00:06:00.539 --> 00:06:06.419 it out or not these gpus are NVIDIA's a100 80 gig cards which aren't the 00:06:04.979 --> 00:06:10.919 latest generation what you probably get with a system like this are h100s the 00:06:08.759 --> 00:06:15.780 new architecture but they don't really have a stock yet so this is just for 00:06:13.620 --> 00:06:21.240 show a100s they look very similar the idea is the same now they're PCIe based 00:06:18.240 --> 00:06:22.740 so they're not the crazy sxm cards but 00:06:21.240 --> 00:06:26.940 they are water cooled which is crazy look at the end each of them has quick 00:06:24.600 --> 00:06:30.300 disconnects I wonder if I can get one of them off 00:06:28.319 --> 00:06:34.979 I don't know I don't know how these quick disconnects disconnect oh wow 00:06:32.580 --> 00:06:40.259 that's so easy look at that these quick disconnects are 00:06:37.259 --> 00:06:41.759 super nice and so easy to use 00:06:40.259 --> 00:06:45.479 and they don't leak at all some of the ones I've seen you pop it out and like a 00:06:43.680 --> 00:06:48.539 couple drops come out nothing came out of this one at all 00:06:46.740 --> 00:06:53.639 I guess which matters in a server now the reason they'd be on quick disconnects is so you can take a GP out 00:06:51.600 --> 00:06:56.220 to swap or if you wanted to upgrade the system down the road it'll be a lot 00:06:54.720 --> 00:07:01.020 easier than trying to drain the whole Loop change the cards 00:06:58.440 --> 00:07:06.840 nobody wants to do that not all RAM sticks are made equally these ones 00:07:03.419 --> 00:07:10.020 so satisfying just listen 00:07:06.840 --> 00:07:11.460 oh that is wonderful the power 00:07:10.020 --> 00:07:18.780 distribution in this system is very weird we'll see more of it on the other side but each of the graphics cards and 00:07:15.180 --> 00:07:20.759 I think the CPU don't see how it 00:07:18.780 --> 00:07:24.660 connects to the CPU do you see the power connector anyway oh it's down there oh 00:07:23.099 --> 00:07:30.000 interesting okay I get it now there's a PCB inside 00:07:27.599 --> 00:07:33.300 of here with big Power contacts there's a big connector that's plugging into the 00:07:31.500 --> 00:07:38.819 motherboard in the bottom corner and then each of the gpus comes off of this 00:07:35.880 --> 00:07:42.720 part of that board up and over so it's all directly connected to here and then 00:07:41.280 --> 00:07:46.919 just little cables to each of the components but only the graphics cards I 00:07:44.819 --> 00:07:51.539 guess it's very like kind of elegant solution I'm kind of surprised cool 00:07:49.440 --> 00:07:56.580 there's also more PCIe slots there's one extra one here and another two down here 00:07:53.699 --> 00:08:03.000 and all seven of them total run at PCIe Gen 5 16x which is an obnoxious amount 00:08:00.360 --> 00:08:09.240 of PCIe throughput so you could run a 400 gig Nick 200 gig nics whatever you 00:08:05.699 --> 00:08:11.340 want a cxl module it is a lot an 00:08:09.240 --> 00:08:14.880 absolutely Monumental amount of i o especially considering you're gonna put 00:08:13.620 --> 00:08:18.660 this at your house the only other really cool things on 00:08:16.919 --> 00:08:23.879 this side of course the radiator which we talked about before it's absolutely 00:08:21.000 --> 00:08:27.900 massive and of course to feed a radiator like that they have some pretty thick 00:08:25.319 --> 00:08:31.740 fans as well they're not crazy like you would expect I mean given 00:08:30.300 --> 00:08:37.620 that it's quiet it makes sense but they're only 12 volt 0.96 amp fans 00:08:35.279 --> 00:08:42.959 they're 12 watt fans usually systems like this they're like I got my 120 watt 00:08:40.260 --> 00:08:48.899 fan sounds like a jet taking off this this is not that but the craziest thing 00:08:46.260 --> 00:08:52.560 is this looks so cool on this side the other side of this system looks pretty 00:08:50.640 --> 00:08:57.120 much just as cool I don't know if I can move it myself but 00:08:54.839 --> 00:09:03.899 it's apparently 98 pounds or something like that oh my God there's the lines 00:09:00.720 --> 00:09:05.700 from the rad up to the reservoir up here 00:09:03.899 --> 00:09:10.140 um and then it goes from Reservoir to pumps pumps to this big manifold and off 00:09:08.760 --> 00:09:12.959 to everything now the manifold's super cool you got quick disconnects here as 00:09:12.060 --> 00:09:18.000 well so you can pop tubes off just like that 00:09:15.540 --> 00:09:22.200 some of them are hard lined like this is this is like a soldered connection I 00:09:19.860 --> 00:09:25.740 imagine that's probably for the CPU they don't expect people to be taking CPU 00:09:23.820 --> 00:09:28.260 blocks off like you would a graphics card 00:09:27.000 --> 00:09:32.040 but if you want to pull the graphics around 00:09:30.300 --> 00:09:38.100 a little like so easy look at that it's all 00:09:35.880 --> 00:09:41.000 disconnected I'm just gonna put it back on 00:09:41.399 --> 00:09:44.660 oh you hear that click 00:09:44.779 --> 00:09:51.720 the crazy thing is look at these pumps they look like something you would buy 00:09:48.540 --> 00:09:54.360 on like Alibaba for for two dollars like 00:09:51.720 --> 00:09:58.380 this is a a wish water cooling episode but apparently they're really strong 00:09:56.399 --> 00:10:03.480 really durable pumps and I guess if we turn it on when I turn it on they're not 00:10:00.720 --> 00:10:06.899 super loud either which is nice um I don't even know if they're Peter no 00:10:05.160 --> 00:10:10.980 they are pwm they got I got four pins each they're just 00:10:09.120 --> 00:10:13.980 they don't look like they belong in this system there is two of them of course so 00:10:12.540 --> 00:10:17.880 that's going to give you redundant flow and also more flow if one of the pumps 00:10:15.899 --> 00:10:20.820 were to die you'd still have the one pump going of course the system's ipmi 00:10:19.680 --> 00:10:24.500 would let you know that the pumps aren't running it's just 00:10:23.040 --> 00:10:30.000 it's really nice I love the manifold too I think we saw a 00:10:27.600 --> 00:10:33.779 similar thing in like the the EK fluid work system it's nice that it's mounted 00:10:32.339 --> 00:10:36.959 behind and kind of out of the way it keeps it very clean and easily 00:10:35.820 --> 00:10:41.160 serviceable the other cool thing down here look at 00:10:38.820 --> 00:10:45.120 this you never get to see this stuff usually the power supply is in a server 00:10:43.380 --> 00:10:48.000 are plugged directly into the motherboard and all of the Power kind of 00:10:46.920 --> 00:10:56.880 comes off there there's a bunch of cables in the way so you don't really get to see it this is just the like bare 00:10:53.040 --> 00:10:59.579 contacts that's that's 4 000 watts of 12 00:10:56.880 --> 00:11:05.700 volt power right there that's why it's so freaking thick look at the bars on 00:11:03.120 --> 00:11:09.420 here this is crazy you can also see where the contacts are to pass through 00:11:07.980 --> 00:11:13.200 to that board on the other side we were talking about there's probably sort of 00:11:11.339 --> 00:11:17.700 like a socketed connection and they go together so it's easily serviceable this 00:11:15.360 --> 00:11:24.060 system completely specked out dual 56 cores four terabytes of RAM quad gpus is 00:11:21.779 --> 00:11:28.260 around eighty thousand dollars the dgx that it's going to compare to is two 00:11:26.220 --> 00:11:33.420 hundred thousand dollars and they charge you like ten thousand dollars a year 00:11:29.700 --> 00:11:36.300 just for for service contracts 00:11:33.420 --> 00:11:41.279 crazy and that system only has a single power supply it's not even redundant 00:11:37.680 --> 00:11:43.800 power this one is redundant power if you 00:11:41.279 --> 00:11:48.720 have 240 volt power it'll do 2200 Watts if you only have 220 volt it'll do 2100 00:11:46.079 --> 00:11:53.519 Watts so pretty serious power supplies and they're so quiet usually power 00:11:51.300 --> 00:11:58.320 supplies like this are crazy but since super micro manufactures them in-house 00:11:55.399 --> 00:12:01.019 they can control you know this is the chassis it's going to be in we know 00:11:59.579 --> 00:12:04.079 exactly how much cooling it's going to need and they can make it quiet I guess 00:12:02.820 --> 00:12:07.980 we should take a look at the back I haven't really looked at it too much they did tell me that the reservoir 00:12:07.019 --> 00:12:13.200 despite these being like quick disconnect fittings they're not for hooking up to like a central water 00:12:11.279 --> 00:12:16.800 supply it's just for filling and draining you can actually see the 00:12:15.000 --> 00:12:21.600 coolant in there it's like red it looks like rusty water I'm sure it's just like 00:12:19.260 --> 00:12:24.779 some sort of you know anti-corrosion inhibitor sort of thing there's two 00:12:23.519 --> 00:12:28.200 little sights you can see the coolant level and there is a cap there I'm not 00:12:27.120 --> 00:12:33.540 going to open it because I don't want to make a huge mess the i o I believe this 00:12:31.620 --> 00:12:37.260 board is dual 10 gig at the back one port for management there's actually 00:12:34.680 --> 00:12:41.760 type c that's kind of cool three USB type A ports VGA and serial and of 00:12:40.560 --> 00:12:45.360 course since these graphics cards are like AI accelerators there's no display 00:12:43.560 --> 00:12:48.480 output on them that's pretty much it I mean if you wanted to add more i o if 00:12:47.040 --> 00:12:52.800 this was actually a workstation you're going to run Windows on this thing you 00:12:50.220 --> 00:12:57.060 could put a USB card or like a sound card back here if you really wanted I 00:12:55.079 --> 00:13:01.800 don't know if anyone's making a Gen 5 USB card but it would be kind of silly 00:12:59.880 --> 00:13:05.880 if they did we got the system booted up now in Ubuntu and we're running a GPU 00:13:03.660 --> 00:13:09.420 load it's like a python AI script and all of the gpus are loaded which is 00:13:07.260 --> 00:13:15.540 going to put it at about a thousand watt load right now does it sound any louder 00:13:12.300 --> 00:13:18.000 than it did before I feel the heat 00:13:15.540 --> 00:13:20.360 but it sounds literally exactly the same as before 00:13:22.860 --> 00:13:29.639 how quiet this thing is I mean it's large but still 00:13:27.600 --> 00:13:35.160 hold the fans it's it's on a little bit more now overall this is seriously just 00:13:32.880 --> 00:13:39.060 kind of a mind-boggling computer I just I can't wrap my head around the fact 00:13:36.839 --> 00:13:42.180 that people are actually asking them for this they told me this is like one of 00:13:40.440 --> 00:13:46.920 the one of the larger requests that companies have been asking them for they 00:13:43.740 --> 00:13:48.180 want a dgx clone that's way cheaper and 00:13:46.920 --> 00:13:52.019 one that people could have at their house I guess there's Engineers that are important enough to have a hundred 00:13:50.820 --> 00:13:55.320 thousand dollar computer at their house I mean I guess there's equipment that's 00:13:54.060 --> 00:14:00.360 hundreds of thousands of dollars that people use all the time so maybe it's not that crazy 00:13:58.440 --> 00:14:04.860 but you know what's not crazy just segue to our sponsor Acer they're bringing a 00:14:03.000 --> 00:14:08.519 much welcome update to 3D gaming with their stereoscopic 3D technology on 00:14:06.959 --> 00:14:12.240 their spatial Labs true game this feature is best enjoyed with Acer's 00:14:10.139 --> 00:14:17.160 Predator Helios 300 spatial Labs Edition gaming laptop it features a new 3D Ultra 00:14:14.639 --> 00:14:20.519 mode Amplified stereo 3D rendering and newly launched game profiles to be 00:14:18.600 --> 00:14:23.579 enjoyed this allows you to immerse yourself deeper into the world of 3D 00:14:22.019 --> 00:14:27.060 gaming with the addition of 3D plus gaming mode you can customize the stereo 00:14:25.680 --> 00:14:30.300 3D effects based on Visual and performance preferences with its 3D 00:14:28.680 --> 00:14:33.899 sense feature enjoy impressive performance on The Predator Helios 300 00:14:32.040 --> 00:14:39.120 with its built-in 12th gen core I9 processor and GeForce RTX 3080 GPU with 00:14:36.959 --> 00:14:42.839 features such as Wi-Fi 6 fan control and overclocking the Predator Helios will 00:14:40.920 --> 00:14:45.600 make sure you're set up for success in every gaming session so check out the 00:14:44.519 --> 00:14:49.260 links in the description to find out more do it 00:14:47.699 --> 00:14:52.800 CES so thanks for watching I hope you folks 00:14:50.760 --> 00:14:57.060 have been enjoying our CES 2023 coverage I have been having a hell of a lot of 00:14:55.199 --> 00:15:00.899 fun if you did like this video maybe check out how about the Epic Genoa holy 00:14:59.639 --> 00:15:04.800 that was a pretty awesome video those CPUs are seriously fast and they 00:15:03.060 --> 00:15:09.660 did tell me they can make an AMD version of this if there's people that are asking for it it only took them three 00:15:07.800 --> 00:15:15.260 months to design the system from the ground up that's because super micro you 00:15:11.940 --> 00:15:15.260 know super modular