this is the second fastest server we've ever gotten our hands on it's for
scientific applications and machine learning and it might actually be better
in some ways than the fastest one which happens to be the petabyte of flash
project over there why because this one
is freaking water cooled it's got six gpus in it it comes in two flippin
wooden crates that's really all i know about it because it's been stuck at the
border for over a month due to some kind of stupid covid delay so we're gonna
open this puppy up and show you exactly what's going on inside whoa also it's
only four gpus oh i thought it was six yeah sorry that's still pretty good yeah
pretty good just like our sponsor signal RGB with signal RGB you can control and
sync your favorite RGB devices all from one app best of all it's free so
download signal RGB at the link in the video description
these are wooden crates sealed up with torx screws alex has his way but i think
i'm gonna go try my way
no don't use that i can't find a crowbar
there's no way he's getting the crowbar before i'm done
oh well that was no fun
what is in here why do we have two boxes i don't even understand i was gonna say
i don't even understand why there are two boxes are these are gpus this ain't
no ordinary GPU ladies and gentlemen now
there's a big difference between the water cooling that we as
gaming enthusiasts use and what you'll see in
workstation or server or data center applications i think this is all custom
by camino like look at this back memory cooler what boards are these they have
envy link fingers so they must be 30 90 class i think they're all a6000s
yeah i've been trying to figure out the pricing on this i don't know yet it's all just like you
know if you have to ask you can't afford it kind of stuff i didn't think Gigabyte
was a quadro board partner though check out
these quick connects love it so your cold comes in here presumably does some
stuff heats up and comes out here it does look
like they're five grand a pop u.s
that's like msrp they're currently going for like nine grand if we screw up the
packaging enough we might not be able to ship it back
oh wow it really did not make it through there thanks jerry rig everything box
cutter you can tell it's serious when it just does not look performance at all
512 gigabytes of ddr4 3200
six a6000 gpus two xeon platinum 8368qs
two sfxl power supplies why are we opening what the heck is this
it looks like me oh oh my god it's just power cable
well that was wait but how many power cables do we need i'm a little confused
because there are multiple power supplies listed on the bomb
wait what what is this oh that's not power cables this looks like some kind
of handle i think i gave you the lights oh that's heavy yep it's designed to be rack
mounted it comes with rails but i can feel
little nubbins on the bottom i think they're rubber feet i guess
you can kind of use it however i mean that would be a big advantage to
going liquid cooling like this with your compute node is that you wouldn't have
to put it in a server room you could actually ow
have it on your desk and without being super disruptive i mean yeah that
machine out there might be more powerful but it's
obnoxious to be in the same building as let alone room look at this wait this
side's just rad i am really confused and you're about to be confused too
let the camera see your confusion everything's fine it's just a very
durable LTT Store.com water bottle this particular one belonging to alex but
yeah what it's got gpus in it already so what are those they're gpus well
obviously they're gpus it has three power supplies
shout out camino for their custom io sticker that's actually a really smart
way of branding your machine what would we use this for almost doesn't matter
i'm okay well kyle has that thing upcoming he's got that raccoon that's
like pooing in his yard and he wants to train like a machine learning model to
recognize it and like shoot it with an airsoft gun or something apparently it
takes like four days to do the training on his like consumer GPU this
you can fit so much machine learning in here what's the front alex i think this
is the front wait but is it no yeah this must be this has to be the front because
it's got a thermal sensor in front of the radiator so you'd want to know your
intake temps right oh
wow are these ever tight that stripped one could be a problem we could end up
drilling this out alex oh i really don't want to do that
no it's dead and it mangled your torx bit oh great
one power supply uh uh wait why are you doing that i'm
powering it up but i'm about to drill it
i mean that's fine what about we don't do that
until we know that i did oh here it goes
i guess it's on now
uh what it just had a little panic moment and shut off cooling system stand
by wait is it even full of water you can see right here there's a reservoir the
water's right up at the top i think it's fine uh should i just drill this and get
the top off yeah look at that now we're both being productive uh do you want to
get footage of him wait stop alex too late brandon footage don't just pretend
pretend to have the breakthrough moment again
hold both buttons to turn on slash off
cooling system start fan RPM monitoring on here it feels like it's intended to
be up like this hello yeah kind of uh
yeah whoa lots of bubbles
i mean surely if they picture it like this and the text is this way it's
intended to be run this way ah there we go
good thing i didn't stab that that would have been pretty bad
holy crap look at that back plate what are the
gpus that are in here what was the point of those other ones then these have HDMI
ports on them so i do not think that these are a6000s oh wait are those
3090tis they could be 3090 ti's but i
don't understand why they have these crazy 8-pin connector adapter doodads
here then wait i don't think i've actually powered on
the system alex like i don't have any lights on the keyboard this controller
system up here is trippy
here's our temp sensor for the front hanging off of it and then you can see
the 24 pin connector goes into here oh
crap is that usb yeah i don't want to wrench that off too hard and then you
can see fan leads power
presumably there's a coolant flow rate
monitor all that appears to be completely custom
should we take a closer look here before we fire it back up
yeah these guys have come a long way since the last time we checked out one
of their systems i recognized this triple power supply setup from last time
that's super cool we've got three 140 millimeter fans so these are taking
advantage of the full for you height of the chassis and then pushing that air
through what looks like a triple 120 millimeter radiator which i
honestly gotta say feels a little optimistic in terms of cooling we've got
dual xeons and then quad gpus that are
all supposed to be cooled by this single thick
radiator i love this distribution block here for every heat generating device
you can see we've got the cold and hot sides coming into this delrin
distribution plate and then we've got cold coming out to the components these
are all completely custom water blocks and then hot coming back to the
distribution plate all joining together and going back to the radiator which
then goes to our pump reservoir combo unit up here what we don't know is what
the heck these things are there's two pumps in here by the way i'm not sure
where they are but that's pretty oh there they are i think they're ddc variants
on off commands not available just rip out the power just there boom they're
gone uh in other news i checked and we actually have a terabyte of RAM
64 gigs each this single dimm has more RAM than your
workstation i wonder how many people are buying this thing i think it's less
about how many people are buying this thing and more about how many of them
some people are buying is this on or what select the input like i don't even have
keyboard lights interesting well first of all let's talk about
what went wrong yesterday oh yeah let's do that did i screw it up yes you did oh
was it when i pulled this thing off it was yeah so it turns out that the
power switch is like in here so this starts up the cooling checks
everything make sure it's good yeah and then powers on the board yeah power's on
the board so it just didn't yeah because when you did this
the power switch connector you can see a little jumper right in there where you
like really reefed on it cool yeah that was unplugged okay took a call
with the people in austria Jake you spent what like two three hours on this
20 minutes oh only 20 minutes not too bad
20 minutes what it blue screened shut up
i didn't do anything you just have an aura no i don't have an
aura it's working don't touch anything i'm not touching it
stop i'm screwing in a vga look users use keyboards just go to the keyboard
okay do i get to know what gpus they are now
they have the a6000 in there which means those must be 39 dtis then they're
actually 30 90s i talked to them and they sent them
just so we could show them getting swapped and show how easy it is okay
cool what are we going to do now because my understanding is you've spent some
time working on a benchmark that can actually take advantage of all of this
GPU compute how much memory do these freaking things have 48 gigs each we
have 200 gigabytes of video memory like
just the CPU screen even like 76 cores
152 threads i don't i don't know Intel's lineup very well anymore so what these
are each 38 cores yeah are is that good are they fast i don't know should we
test it okay so we're going up against what what do we have here in the
reference ones what was it compared to a 32 core 2990wx i think favorably
thank you for that i want to feel the heat though oh just watch this for a second okay all
right i'll watch okay it was only necessary to watch for
a sec no meaningful heat buildup was
going to occur all right then wow that's fast 71
000. what the hell is an
they 83.68 a 3.7 base 2.6 270 watt TDP
and a maximum memory size of six terabytes each now during cinebench they
reached a maximum temperature of 55 degrees they also weren't running very
long hey what happened to our power meters uh they're right there we only have two
we also have the sketchy one let's use it one more time before we throw it out
cinebench here we go i can pretty much guarantee you that the
eight pin CPU power connectors of each of these two power supplies are going to
the two eight pin inputs on the motherboard so we're sitting at about
850 watts right now shall we do something to the gpus might as well okay
so v-ray cuda sure oh rtx now let's do
cuda i think that will hit it harder here it comes oh my god
holy how is it not crashing it's pulling
over 2 000 watts we have to be on two separate circuits we are yeah i want to
feel the heat yeah what does 2000 watts i'm gonna get a sun pan boys this is
crazy we're already at the point where the incoming air is 22 degrees and the
outgoing air is 44
which is pretty nuts and what's crazier is that if you check
this out this v-ray benchmark only runs for one minute at a time
so we're barely even stressing these gpus i have to manually restart it every
single time which means i think it's time for us to switch over to your
solidworks benchmark okay i'm concerned that it's not really going to work so
i've been having a problem in the past it just like renders a bunch of passes
on this they take such little time that i've been having trouble getting them
all to get fully loaded
to its credit when i'm not unplugging power supplies it appears to be
rock freaking solid stable and in terms of
balancing the load here let's hit it with v-ray again no single one of our
power supplies is doing an outsized amount of the work when you're hitting
the entire system i think the most is around 850 watts and given that these
are 1 000 watt units from silverstone that's not bad i do have concerns about
those poor power supplies drawing in like no it wouldn't even be 40 degree
air because they're on this side
of the radiator so actually they're getting pretty deep exactly this is
weird because if you put your hand behind the radiator it's super hot but
if you put it down where the power supply is it's still nice and cool
solidworks crashed maybe some kind of driver issue we're not sure but
blender's opening i'm curious a lot of my laptop benchmarks take about
one and a half minutes on really fast ones to like three minutes
on like something that's a little bit slower i'm kind of curious what this
will do i'm thinking a lot less than that
holy is it done no
okay wait did we just witness
a sub 8 second blender bmw render
samples 3 000 sure maybe just increase the number of light paths as well yeah
total lots okay
it still did it in 16 seconds this is ridiculous it was 3 000 samples and 10
times as many light paths okay can we do like 10 000 samples though is it even
hitting all of our gpus not even hitting all the gpus is it possible that's
misreporting oh they are all hot it probably is just misreporting i think
it's misreporting because it just did that in 31.8 seconds it's gonna be a
problem trying to stress this classroom
well you saw here first ladies and gentlemen that is a 15 second classroom
benchmark seconds i normally expect that to be
like 10 to 15 minutes who would have thought that the render machine is
incredible at rendering from 300 to 10 000 samples it's still
chewing off 20 seconds at a time of the cta it's definitely using our cores as
for our gpus where yet each one of these is pulling about 280 watts we've been at
in a minute we still have about two minutes and 15 seconds left can confirm
we've managed to fully load down the system 860 watts on that power supply
625 there so that's just shy of 1500
about 2 000 watts total yeah 2100 maybe
a peak oh wow it's really hot now that the coolant's heated up oh that radiator
is hot to the touch i'm amazed at how
reasonably quiet it is though like you could have this in your room yeah and
aside from your room being a billion degrees in like 20 minutes
you could live with it like GPU's been hitting this for a little while but
they're all at like 65 degrees max while drawing 300 watts
and that's on top of the CPU each of which also are doing 300 watts
oh it's done it finished in three minutes and eight seconds it looks
better though well i'd imagine there's ten thousand samples well look i've
never looked at it rendered like that wait
i think you're right yeah i am right there envy link i think they'll run in
four-way sli they will is that even supported that's not even supported on
the 390ti i don't know i don't think so now rendering device wait did you
already click run um okay so there's only one which would seem to suggest
it's going to hit all four of them here we go
here's where we find out if it's running in four-way sli i'm fidgeting
for some context i spent a day and
a chiller and a almost killing a 30-90 to get a score of 12 000 in this 500 456
behold it's hitting the mall so we're sitting at about 1700 watts that's a
little lower than what we saw in blender
but we know okay that the CPU is not going to be hit
too hard during the GPU portion is this running at 120 frames a second yep it's
up to 160 now what we know is that this
will not stress our CPU nearly as much
as that blender render was so that 300 watt discrepancy is just one
of our cpus sitting idle these gpus are
going full grunt i guess we should probably calculate about how much it
would cost 7 500 times 2 there's your
cpus okay use a calculator i give up uh so
about 60 grand 60 grand don't forget
that they just ship you random rtx 3090s
oh i think it did crash it crashed
oh she's done but in fairness to camino
four-way sli has not been like properly supported by NVIDIA in a very long time
and it's probably a driver issue since we're happy with the a6000s in there and
we're not going to swap in the rtx 3090s i might as well just explain why they
included these it was so that we could show you guys just how easy it is to
swap out the cards from your workstation camino will provide these pre-done up
cards so basically it's just a one screw
undoing these quick disconnects slotting in the new GPU i mean i guess you should
also remove your power connectors at some point putting in the new one and
then these actually come pre-filled with coolant so theoretically there's almost
no liquid loss when you go from the old card to the new card and you should
almost never have to top up the coolant which i thought was pretty cool attempt
number two is running a lot slower power usage is
lower it's around thirteen hundred watts
uh crappy oh and it's crashed i don't know if we're getting 3d mark
on this system i don't know if we're getting away without telling the viewers
about our sponsor ting mobile do you like saving money ting mobile is a
low-cost carrier with rates to help you do just that almost every phone on the
market will work with t-mobile and they have the perfect plan for everybody no
matter what your needs are start with unlimited talk and text for 10 bucks a
month or data plans from 15 a month their set 12 plan with 12 gigs of data
is only 35 bucks a month and if you need it unlimited data plans are 45 a month
you can even share your data on a family plan and save even more t-mobile also
offers pay-per-use plans with their flex plans charging just five bucks per
Gigabyte even with those savings you still get nationwide coverage and
award-winning support consumer reports named ting mobile their number one
carrier in america which is a very large place so check them out at
Linus.team.com and receive a 25 credit
and if you guys are looking for another video to watch about a system that's
even more expensive you can check out this thing over here