The Water-Cooled Overclockable Server! What??

Linus Tech Tips ·Linus Tech Tips ·2019-05-06 · 2,900 words · ~14 min read
Floatplane YouTube

Transcript

JSON SRT VTT 220
0:00 is this your static safe CPU storage that is area
0:03 so statically safe what is an insulator unless it's wet in which case it's not
0:10 okay it's only like a thousand dollar CPU
0:14 like realistically you're gonna drop it anyway so like so inside this box is one
0:19 of the most bizarre products to ever land in our inbox i
0:25 think both Jake and i had exactly the same reaction Gigabyte sends out this
0:30 press release and they're like you guys we have water-cooled
0:35 overclockable servers and we were both like we need that
0:40 well no i think the first thing i said was but why
0:43 i definitely just wanted it and if you do have that can we use it to replace
0:48 our networked video transcode server
0:52 so we are going to answer all of those questions and more
1:05 okay uh who's taking it uh well i was just
1:08 gonna here it's all you classic you take it i got it yeah yeah just go for it i
1:12 believe in you okay that's not too bad
1:17 so the first thing we notice about this
1:21 after that it includes some handy toolless rails that's nice is that
1:26 this is a one-u server
1:30 so this is as slim as you would expect something like a like a a router or a
1:35 network switch to be except that this thing can handle do i
1:40 understand this correctly up to a 7900x
1:46 7.7 gigahertz 7980xc or a 7980xe at they
1:52 claim 4.6 gigahertz that
1:55 is a lot of performance to squeeze into a form factor like this
2:01 one so going over the outside of the server the first thing we notice is a
2:05 really thin honeycomb mesh over here that's for pretty obvious reasons this
2:09 thing's going to need some serious airflow we've got four those aren't
2:13 supposed to be switched are these i did that you did that so this is just to
2:16 look cool uh are they all open or some of them
2:20 i think they're all say that yeah they're all satan all right it's so weird it's like they let someone like me
2:25 onto their product team it says 2 times u.2 2 times SATA hot softball SSD base
2:30 well there you go maybe they were color coded the back plane up here it's not
2:33 all plugged in and there isn't enough cables to plug them in so all right well
2:37 we'll have a we'll have a look at it here first we can check out the back so
2:40 we've got one management port two gigabit network ports that was a little
2:44 disappointing 10 gig would have been nice uh serial as well as vga and then
2:48 these these are interesting check this out so if i were a betting
2:52 man and someone said this is a 1500 watt power supply
2:58 how many watts do you think this one is i would probably say something along the
3:03 lines of well this is a per volume calculation i don't know 250 to 300 no
3:08 no no this is an 1100 watt
3:12 80 plus platinum power supply that is
3:15 cooled by this fan and there's two they are
3:19 redundant so in the event that one of them fails the system will continue to
3:23 run and basically um i expect these to be incredibly loud
3:29 wow what the hell
3:32 there's 20 fans there's 20 i think these are like the 23
3:36 000 RPM ones and these might be the trippiest radiators i've ever seen these
3:41 are one new radiators and they're different sizes too this is definitely
3:44 custom this is highly custom so let's have a look then at how this
3:49 closed-loop cooler goes so check this out we can easily see what the flow path
3:53 is going to be so cool water marked blue
3:57 comes into our CPU where the pump is also located and then the hot water
4:01 comes out goes to this radiator comes out of this one and then back around
4:06 here and then cold goes back into the CPU so we're actually using both of
4:11 these rads to cool just the CPU
4:15 in terms of the rest of the specs we've got eight memory slots so that's quad
4:19 channel we've got a single pci express
4:22 slot which there is no obvious way to
4:26 actually plug anything in
4:31 so what we actually end up with is oh that's an interesting one
4:35 another more different pci express slot
4:40 that is broken out to two 16x slots up here
4:46 installed sideways but then also into this 1x slot so wait where's the
4:51 electrical signaling actually coming from is it this one i think it's that
4:54 one yeah it must be this might be like power or just for stability like if
4:58 you're going to build a custom board just for this server right you put the usb header somewhere you can actually
5:02 like the south bridge what about all this space here if you try to put a GPU
5:05 here it might even block yeah see that's so weird because so not only are we
5:09 limited to half height pci express cards
5:12 which is really going to affect our ability to upgrade networking
5:16 or add a GPU to this thing up this is going to severely limit the
5:21 length of the cards we can install as well when it really seems to me as an
5:26 you know a relative lay person like this could have just been put over here like
5:31 can you imagine being the engineer that gets given this assignment i'm sorry you
5:34 want to build what uh yeah so if you could make a pcb that powers over
5:40 twenty twenty three thousand RPM fans that
5:43 would be great thanks excuse me why
5:47 the power draws so gnarly that it has an eight pin is it eps look at this this is an 8-pin eps
5:52 connector that that provides CPU power
5:55 in the desktop systems for mere mortals those are good for 300 watts i think all
5:59 right so what are we going with for CPU choice i think we're going to go with a
6:02 7900 x so our current system has a 6950x
6:06 almost dropped it there and this is also a 10 core so it should be kind of close
6:09 in terms of performance although we're going to get the next generations improvements and then we're also going
6:14 to get our overclock improvements because this is going to overclock
6:17 better than that ugly water cooled now the weirdest thing about this
6:21 configuration is this building a server with like
6:27 Corsair gaming memory normally you would use ecc memory in a server because that
6:32 way if there's a friggin solar flare and a bit flip or whatever it can
6:36 automatically be corrected and the system can keep running without
6:40 interruption but there's a couple of factors at play here one we're planning
6:43 to overclock the bloody thing anyway it wasn't gonna be it wasn't going to be
6:47 have the same kind of stability you'd expect from a normal server and two
6:51 because we're running an overclockable core i9 processor it actually doesn't
6:56 even have support for ecc memory so
7:00 with that said we couldn't just choose any old gaming RAM because it doesn't
7:03 fit it's even on like the exact same plane as this
7:07 bracket here so it oh yeah just barely fits that's nuts i mean the funny thing
7:12 about this too is that you can't see can you find thanks i've wanted
7:16 overclockable servers for as long as i've been a computer enthusiast but now
7:20 that someone actually made one i'm like experienced enough to know that
7:25 it's not worth it not have been the greatest idea uh what is that so this is a 1050 ti had
7:32 to do a little modification we took the shroud off but there's gonna be plenty
7:36 of airflow so it shouldn't be a problem it's even got its own duct like it's
7:39 perfectly fine all right so we're gonna have a slight issue here too so you gotta take this thing out to get it in
7:44 here okay this connector is actually so close that it hits it and i'm going to
7:48 have to bend it down while you stick the card in there it looks ghetto but it's
7:51 really not that ghetto what oh no
7:55 did i catch it i think i'm in no you're cutting oh oh
7:59 but it's in oh god it's good enough it's great all right
8:04 you win so we're gonna put a headless uh HDMI
8:08 thing in here too so when we're remoting in you get the full resolution you know
8:12 honestly i don't even feel that bad about our ghetto-ness here because if
8:16 you look at like how the server was actually designed
8:20 they literally just took like a piece of foam here
8:24 and cut a hole in it i think that's like and put it there to keep the airflow
8:28 going through the radiator that's not that jank it like it's like nice foam at
8:32 least it's not like it's styrofoam yeah that's probably like electrically apple
8:36 wouldn't do it this way oh well man if apple starts making servers again
8:40 they're going to have dongles on their servers you're just going to see like a Thunderbolt hanging out of the front of
8:44 the server with like you get your fiber line and your whatever like
8:50 okay should we plug it in then so that's it yeah let's plug this up the top back
8:54 on because i think the airflow is pretty important do i put this on the right way
8:57 hold on i can do this i believe
9:00 impressive taking your server for a walk yeah all right let's go we got to take
9:04 care of them otherwise they get out of shape stuff
9:07 okay so we just uh found a spare
9:10 spot in our server room we're just gonna let it sit there yeah
9:14 just slide it in there i mean the rails are really only designed for one server but
9:19 like whatever yeah it's not like that's a really heavy one anyway
9:23 that is really really loud like honestly here hold on can we close
9:27 this door for a sec
9:32 you can still hear it yeah even so clearly even with all the sound
9:36 deadening that we put in this room which people mocked me for but actually works
9:39 works phenomenally thank you but that pitch
9:43 yeah it penetrates like i'm over by the green screen now
9:48 that's an actual problem like yeah no i don't know if that's gonna
9:51 okay it just dialed it back a little yeah
9:55 okay right now it's fine so the process of overclocking this thing was actually
9:59 kind of a nightmare but we're there and our CPU is running at a cool 4.7
10:06 gigahertz now it wasn't actually that easy to get it here uh Gigabyte's manual
10:10 for this server doesn't exist yet yeah and there's some extra steps so in
10:16 addition to setting your core voltage and setting your uh CPU multiplier like
10:21 you would overclocking on a desktop board you have to key some
10:25 magic value so let's go ahead and hit it with a
10:28 stress test 65 watts at idle
10:33 not bad oh 69 69 yes not bad all right so let's start a
10:38 stress test make sure she holds 100 utilization 4.7 gigahertz what kind of
10:43 temperatures are we looking at 60 to 70 50 75 degrees
10:48 heck yeah so we loaded some stuff on here we've
10:51 got regular cinebench which we're going to run real quick here and by real quick
10:55 i do mean literally real quick this should be very fast and then
10:59 to address that cinebench has actually gotten to the point where very high-end
11:02 processors run it too fast to
11:06 use it as a reliable benchmark we've got the new unofficial what's it called
11:10 cinebench extreme extreme we're going to try that out as well so kicking things
11:14 off we got ourselves 2500 points
11:19 which is pretty good now let's try extreme
11:24 which is basically just four times the resolution this one first whoa look at
11:28 those temps yeah they're starting to get up there
11:32 that is quite the load
11:35 wow we are above 90 degrees on a handful of
11:41 course here you might say that this benchmark takes a hot minute okay i'll
11:45 give you that one oh we did detect some overheating but our
11:51 throttling percentage is zero and it finished so she seems to be just
11:58 just holding on
12:02 656 which i have no context for because this is a brand new benchmark i've never
12:06 used before so why don't we go ahead and shut all of that down and let's do our
12:11 uh our network network render okay so i got uh just
12:16 down there that is one of adobe's sample files sure so we're just open up final
12:20 one and we're gonna export this like we would in ltte video so the 60 megabit
12:26 per second and then 75. cool at 4k
12:30 and it is fully utilizing our CPU so one
12:34 thing that we observed about our network render server way back when i had
12:38 intended to use like 18 core xeons in it or something was that there's a limit to
12:43 how many threads media encoder can actually use so it's better to have
12:48 fewer higher clock threads than it is to have many many threads in a lot of cases
12:51 which is how we ended up with an overclocked render server in the first
12:55 place so this looks like it could be a viable
12:59 replacement so the results are in and cinebench both cinebench and cinebench
13:04 extreme gave us 20 increases in performance that's actually quite a bit
13:09 more than i was expecting so the increase in clock speed is 17 and a half
13:12 but it's still 20 so we're getting like what three percent increase ipc but then
13:17 in premiere we actually got a 30
13:21 uplift going from what is that thing having it
13:24 a gtx 980 and a 6950x and a 6950x
13:29 not freaking bad but the problem is it's
13:32 loud the other problem is that this whole
13:36 this whole experience still hasn't really enlightened us as to what that
13:41 crap this thing's actually for so Jake intrepidly
13:45 sent an email to Gigabyte asking them
13:49 what is this for why does it exist why did you build an overclockable 1u server
13:54 can't even put a GPU like it doesn't really have networking like what would
13:57 you even use this for and the answer is
14:00 the finance industry high frequency trading so you would take this server
14:05 you need the highest possible frequent performance you need something that's
14:09 air-cooled so it can just be slotted into your existing server room
14:14 you throw one of these puppies in or maybe even a newer one so this is a 100
14:18 gigabit infiniband card so super low latency yeah wire that up to your
14:23 network and the difference in these like what are like
14:27 milliseconds maybe five milliseconds the difference there could be hundreds of
14:30 thousands or millions of dollars in that industry a couple hundred traders over a
14:34 year like it can be a big increase for a small amount of money so the investment
14:38 in one of these servers makes a ton of sense there but for us i'm not running
14:42 out and recommending that everyone go and buy one of these it's just too
14:46 freaking loud it's it's very loud otherwise it'd be pretty sweet though
14:49 yeah like maybe we should just re-insulate the server like a second
14:53 layer or we could even just put like more sound deadening around that box or
14:58 we could just upgrade the server that's in there right now
15:02 so thanks for watching guys if you disliked this video you can hit that button but if you liked it hit like get
15:05 subscribed or maybe consider checking out where to buy the stuff we featured at the link in the video description as
15:09 long as you're in the high frequency trading market portion of the finance
15:14 industry yay also linked in the video description is
15:17 our merch store which has cool shirts oh it's gebo today nope we don't have this
15:21 shirt maybe that jacket this jacket will be coming eventually cool shirts like
15:24 that one
15:28 chill that shill it nick oh wow oh whoa
15:32 ah and i think we're done here
15:36 all right oh join the forum join the forum