we're at the super micro booth at cs2023 and this bad girl right here is the
sys751 g-e-t-n-r-t an 80 000 AI
supercomputer designed to go in your house no seriously people are asking for
this and trust me I have the same reaction but hear me out the world is
changing for perspective every workstation that super micro now sells
is actually purpose built to support Ai and machine learning and bundle that
with a global shift to working from home and you end up with demand for top tier
AI Hardware like this the type of stuff that draws thousands of watts of power
that's somehow quiet enough to be under your desk at home like seriously where's
the power button oh I missed it
it's on that's how loud it is and this
is how a radiator quite literally almost the size of an Xbox series X holy
but not as holy or as is this segue to our sponsor thanks to Acer for
sponsoring this video Acer's pushing the limits of 3D gaming with their new 3D
Ultra mode and spatial Labs true game so stay to the end of the video to find out
more
man I can't get over how big this radiator is seriously when we got that
press email about this I was like ah just a workstation but look at this
radiator and I can't wait to show you the rest of the water plate but for now
let's make this back into a complete system of course since this system is
meant to go you know at someone's house or in a lab under the desk the form
factor is a talent now it is still rack mountable you can pull off the top here
and the feet at the bottom and rack mount it but the intended purpose is a
tower so up front you're going to see things that are like a workstation we
got headphone jack microphone Jack kind of standard things I don't know if you
would you know have Windows on this and do your Microsoft team calls on a on an
AI super computer like this but you could if you wanted to there's also two
USB ports and one of the stars of the
show the eight Gen 5 NVMe slots all of
them are full speed you can see our boot drive right here what is this nothing
exciting it's just a two terabyte boot drive but you could put up to
theoretically if you put 30 terabyte drives
240 terabytes of storage in this system
and that's before we even get to any of the other cool Hardware now of course
the best thing up front is the power button because you turn this thing on
it's like it barely makes noise this computer has
two 2 000 watt power supplies in it that's the type of heat we're dealing
with and it barely makes noise now some
of you are probably saying well you know it's not doing anything yet but they had
it when we walked in here loaded with I think a 1500 watt load or so still the
exact same noise level oh there's peels in here that haven't even peeled
remove film before use nobody read that it never gets old
peeling plastic off ten thousand dollar graphics cards let alone four of them
now we'll talk about those later I think the star of the show here is actually
the CPUs now this isn't an AMD based system this is Intel
um despite AMD having really really awesome server stuff it's still only
about 30 of the market share so 70 of the systems they're selling are still
Intel based this is sapphire Rapids it's actually just come out after God it's
been like two years of DeLay So this system fully specced out could be up to
256 core processors or 350 watts per
socket serious amount of power for memory there's eight sticks per socket
and while Sapphire Rapids can do up to 16 or two dims per channel it's kind of
hard to fit it in a configuration like this well you'll see in a lot of dual
socket servers is the CPUs kind of in the front or they'll be in a
configuration where they're staggered slightly now this is important primarily
for airflow yeah if you were to have both of the sockets like this in an air
cooled system the second CPU here is just going to be getting a straight hot
air which you don't really want since this is water cooled it doesn't matter
now it's also weird I've never seen a
system like this where the sockets are in between the graphics cards especially
in this configuration now there is an important reason for this because the
system is PCIe Gen 5 the actual Lane length the physical traces on the
motherboard the length of those is very important the longer you go the harder
it is to run that sort of frequency as PCIe Generations get faster and faster
it's just going to keep getting harder and harder a lot of boards from other
manufacturers will use something called a retimer which is basically just like a
a signal booster but super micro doesn't
use that and because they position the sockets like this they can make those
physical traces on the board from the PCIe slot to the CPU super short which
makes it a lot easier to run speeds like that and you don't have to use retimers
now since the CPUs and the gpus are water cooled naturally the next thing
you're wondering is what else are they going to water cool and apparently on the next version of the system they're
going to water cool the dims I mean it's not doing anything right now they don't
feel particularly hot and there is a good amount of airflow but I guess the
more dense the dims get you can use up to 256 gig dimms which in the full
configuration is two terabytes per socket um
probably a bit more heat than this do you think they get mad if I took one
of the graphics cards out yes they like us I think I'm just gonna do it what's
the worst that could happen going to jail you took a graphics card
out oh there's actually locks on these whoa weird I guess because this is a
workstation um there is PCI e-locks if you look on
servers most of the time they don't have it oh
I think that might be about as far as I can get it to come out oh wait look
oh more people oh wow there's more
whoa weird I didn't even realize he's actually used the new 12 pin connectors
I wonder if they've had any that have caught on fire well regardless of taking
it out or not these gpus are NVIDIA's a100 80 gig cards which aren't the
latest generation what you probably get with a system like this are h100s the
new architecture but they don't really have a stock yet so this is just for
show a100s they look very similar the idea is the same now they're PCIe based
so they're not the crazy sxm cards but
they are water cooled which is crazy look at the end each of them has quick
disconnects I wonder if I can get one of them off
I don't know I don't know how these quick disconnects disconnect oh wow
that's so easy look at that these quick disconnects are
super nice and so easy to use
and they don't leak at all some of the ones I've seen you pop it out and like a
couple drops come out nothing came out of this one at all
I guess which matters in a server now the reason they'd be on quick disconnects is so you can take a GP out
to swap or if you wanted to upgrade the system down the road it'll be a lot
easier than trying to drain the whole Loop change the cards
nobody wants to do that not all RAM sticks are made equally these ones
so satisfying just listen
oh that is wonderful the power
distribution in this system is very weird we'll see more of it on the other side but each of the graphics cards and
I think the CPU don't see how it
connects to the CPU do you see the power connector anyway oh it's down there oh
interesting okay I get it now there's a PCB inside
of here with big Power contacts there's a big connector that's plugging into the
motherboard in the bottom corner and then each of the gpus comes off of this
part of that board up and over so it's all directly connected to here and then
just little cables to each of the components but only the graphics cards I
guess it's very like kind of elegant solution I'm kind of surprised cool
there's also more PCIe slots there's one extra one here and another two down here
and all seven of them total run at PCIe Gen 5 16x which is an obnoxious amount
of PCIe throughput so you could run a 400 gig Nick 200 gig nics whatever you
want a cxl module it is a lot an
absolutely Monumental amount of i o especially considering you're gonna put
this at your house the only other really cool things on
this side of course the radiator which we talked about before it's absolutely
massive and of course to feed a radiator like that they have some pretty thick
fans as well they're not crazy like you would expect I mean given
that it's quiet it makes sense but they're only 12 volt 0.96 amp fans
they're 12 watt fans usually systems like this they're like I got my 120 watt
fan sounds like a jet taking off this this is not that but the craziest thing
is this looks so cool on this side the other side of this system looks pretty
much just as cool I don't know if I can move it myself but
it's apparently 98 pounds or something like that oh my God there's the lines
from the rad up to the reservoir up here
um and then it goes from Reservoir to pumps pumps to this big manifold and off
to everything now the manifold's super cool you got quick disconnects here as
well so you can pop tubes off just like that
some of them are hard lined like this is this is like a soldered connection I
imagine that's probably for the CPU they don't expect people to be taking CPU
blocks off like you would a graphics card
but if you want to pull the graphics around
a little like so easy look at that it's all
disconnected I'm just gonna put it back on
oh you hear that click
the crazy thing is look at these pumps they look like something you would buy
on like Alibaba for for two dollars like
this is a a wish water cooling episode but apparently they're really strong
really durable pumps and I guess if we turn it on when I turn it on they're not
super loud either which is nice um I don't even know if they're Peter no
they are pwm they got I got four pins each they're just
they don't look like they belong in this system there is two of them of course so
that's going to give you redundant flow and also more flow if one of the pumps
were to die you'd still have the one pump going of course the system's ipmi
would let you know that the pumps aren't running it's just
it's really nice I love the manifold too I think we saw a
similar thing in like the the EK fluid work system it's nice that it's mounted
behind and kind of out of the way it keeps it very clean and easily
serviceable the other cool thing down here look at
this you never get to see this stuff usually the power supply is in a server
are plugged directly into the motherboard and all of the Power kind of
comes off there there's a bunch of cables in the way so you don't really get to see it this is just the like bare
contacts that's that's 4 000 watts of 12
volt power right there that's why it's so freaking thick look at the bars on
here this is crazy you can also see where the contacts are to pass through
to that board on the other side we were talking about there's probably sort of
like a socketed connection and they go together so it's easily serviceable this
system completely specked out dual 56 cores four terabytes of RAM quad gpus is
around eighty thousand dollars the dgx that it's going to compare to is two
hundred thousand dollars and they charge you like ten thousand dollars a year
just for for service contracts
crazy and that system only has a single power supply it's not even redundant
power this one is redundant power if you
have 240 volt power it'll do 2200 Watts if you only have 220 volt it'll do 2100
Watts so pretty serious power supplies and they're so quiet usually power
supplies like this are crazy but since super micro manufactures them in-house
they can control you know this is the chassis it's going to be in we know
exactly how much cooling it's going to need and they can make it quiet I guess
we should take a look at the back I haven't really looked at it too much they did tell me that the reservoir
despite these being like quick disconnect fittings they're not for hooking up to like a central water
supply it's just for filling and draining you can actually see the
coolant in there it's like red it looks like rusty water I'm sure it's just like
some sort of you know anti-corrosion inhibitor sort of thing there's two
little sights you can see the coolant level and there is a cap there I'm not
going to open it because I don't want to make a huge mess the i o I believe this
board is dual 10 gig at the back one port for management there's actually
type c that's kind of cool three USB type A ports VGA and serial and of
course since these graphics cards are like AI accelerators there's no display
output on them that's pretty much it I mean if you wanted to add more i o if
this was actually a workstation you're going to run Windows on this thing you
could put a USB card or like a sound card back here if you really wanted I
don't know if anyone's making a Gen 5 USB card but it would be kind of silly
if they did we got the system booted up now in Ubuntu and we're running a GPU
load it's like a python AI script and all of the gpus are loaded which is
going to put it at about a thousand watt load right now does it sound any louder
than it did before I feel the heat
but it sounds literally exactly the same as before
how quiet this thing is I mean it's large but still
hold the fans it's it's on a little bit more now overall this is seriously just
kind of a mind-boggling computer I just I can't wrap my head around the fact
that people are actually asking them for this they told me this is like one of
the one of the larger requests that companies have been asking them for they
want a dgx clone that's way cheaper and
one that people could have at their house I guess there's Engineers that are important enough to have a hundred
thousand dollar computer at their house I mean I guess there's equipment that's
hundreds of thousands of dollars that people use all the time so maybe it's not that crazy
but you know what's not crazy just segue to our sponsor Acer they're bringing a
much welcome update to 3D gaming with their stereoscopic 3D technology on
their spatial Labs true game this feature is best enjoyed with Acer's
Predator Helios 300 spatial Labs Edition gaming laptop it features a new 3D Ultra
mode Amplified stereo 3D rendering and newly launched game profiles to be
enjoyed this allows you to immerse yourself deeper into the world of 3D
gaming with the addition of 3D plus gaming mode you can customize the stereo
3D effects based on Visual and performance preferences with its 3D
sense feature enjoy impressive performance on The Predator Helios 300
with its built-in 12th gen core I9 processor and GeForce RTX 3080 GPU with
features such as Wi-Fi 6 fan control and overclocking the Predator Helios will
make sure you're set up for success in every gaming session so check out the
links in the description to find out more do it
CES so thanks for watching I hope you folks
have been enjoying our CES 2023 coverage I have been having a hell of a lot of
fun if you did like this video maybe check out how about the Epic Genoa holy
that was a pretty awesome video those CPUs are seriously fast and they
did tell me they can make an AMD version of this if there's people that are asking for it it only took them three
months to design the system from the ground up that's because super micro you
know super modular