WEBVTT

00:00:00.160 --> 00:00:09.920
today is the day we are finally finishing the 100 000-ish

00:00:05.680 --> 00:00:12.880
dollar six editors one CPU machine

00:00:09.920 --> 00:00:16.880
it's been a freaking long time coming oh come on so we won't make you guys wait

00:00:15.280 --> 00:00:22.000
that's all looking peachy

00:00:19.359 --> 00:00:27.680
any longer now this should work and it should show up over here hey

00:00:25.760 --> 00:00:31.199
to hear this word from our sponsor pebble host are you in the market for a

00:00:29.279 --> 00:00:35.760
hosting provider try pebble host they balance price and performance with vps

00:00:33.440 --> 00:00:41.690
hosting starting at 275 a gig and game hosting at one dollar a gig use code LTT

00:00:38.320 --> 00:00:49.760
at the link below to save 15 percent

00:00:49.760 --> 00:00:57.840
at this point those of you who have been keeping up with the 100 000 pc saga

00:00:55.920 --> 00:01:03.520
have probably seen this machine put together and then torn apart again

00:01:00.399 --> 00:01:05.760
four or five times so it's safe to say

00:01:03.520 --> 00:01:09.119
that we've already dry fitted everything and we know it all pretty much works

00:01:08.080 --> 00:01:17.040
together so just like the last video in this series we've stuck with the god tier tie

00:01:13.680 --> 00:01:19.200
end s7 100 ex motherboard

00:01:17.040 --> 00:01:24.159
yes it's a little ugly because aesthetics and RGB aren't exactly top

00:01:21.680 --> 00:01:26.479
priorities for server manufacturers yet

00:01:25.040 --> 00:01:29.840
you give it time but it's got it where it counts because the

00:01:29.040 --> 00:01:37.680
thing just works speaking of working the original cpus

00:01:34.960 --> 00:01:42.799
that Intel supplied for this build are of course no longer working

00:01:40.560 --> 00:01:48.320
i dropped one of them and we weren't able to source a matching retail xeon

00:01:46.000 --> 00:01:54.000
8180 platinum replacement without spending nearly 10 000 us dollars

00:01:51.439 --> 00:01:58.640
remember guys you need to use two of the exact same model in most dual socket

00:01:57.040 --> 00:02:05.360
systems so we turned to ebay and obtained a pair of

00:02:01.200 --> 00:02:07.439
qs or qualification sample 8180s for

00:02:05.360 --> 00:02:14.480
less than half of what we'd have spent for a single retail one now qs chips

00:02:10.959 --> 00:02:17.440
aren't perfect but unlike engineering

00:02:14.480 --> 00:02:22.560
samples which may be less reliable or have significantly lower clock speeds

00:02:20.239 --> 00:02:28.239
qs chips are the ones that are sent out to oems just before a particular model

00:02:25.840 --> 00:02:31.040
launches for their final validation and testing

00:02:29.360 --> 00:02:36.800
what that means is that in many instances they are practically speaking

00:02:33.680 --> 00:02:39.280
or even literally exactly the same as a

00:02:36.800 --> 00:02:43.840
retail chip save for the labeling on the integrated heat spreader

00:02:40.959 --> 00:02:49.519
so we're hoping that these should work perfectly for our little experiment

00:02:46.640 --> 00:02:54.400
especially with an ek annihilator CPU block keeping each one of them cool

00:02:52.080 --> 00:03:01.360
man those are industrial looking for our RAM we stuck with the 384 gigs

00:02:58.000 --> 00:03:03.440
of ecc ddr4 memory running in a six

00:03:01.360 --> 00:03:07.599
channel configuration that our friends from kingston sent over

00:03:05.120 --> 00:03:14.159
almost a year ago so this is going to give us about 60 gigs of memory for each

00:03:10.800 --> 00:03:15.920
of our six virtualized 8k video editing

00:03:14.159 --> 00:03:23.040
workstations with a little bit of leftover RAM for our hypervisor

00:03:18.879 --> 00:03:27.200
now our gpus are of course the same six

00:03:23.040 --> 00:03:29.040
NVIDIA titan v 12 gig hbm2 cards that

00:03:27.200 --> 00:03:32.879
we've been working with since earlier in the project

00:03:30.400 --> 00:03:37.519
each one of our virtual editing stations is going to get one of these fully

00:03:34.879 --> 00:03:43.120
dedicated to it now because we're using GPU passthrough as far as our editor is

00:03:40.640 --> 00:03:47.360
concerned it's like that card is installed directly into their own

00:03:45.120 --> 00:03:51.280
computer now for this video we've done something special with our cards

00:03:49.519 --> 00:03:57.599
each one of them was outfitted with one of these beautiful acetal slash nickel

00:03:54.319 --> 00:04:00.480
ek water blocks and then made it to a

00:03:57.599 --> 00:04:04.400
custom six GPU terminal which might give you guys some of those

00:04:02.080 --> 00:04:09.599
sweet nostalgia feels from all the way back in seven gamers one CPU

00:04:07.680 --> 00:04:13.439
massive thanks to ek by the way for going out of their way to make this

00:04:11.200 --> 00:04:19.280
thing happen because dang this looks awesome

00:04:16.239 --> 00:04:23.120
now to dissipate the up to 2

00:04:19.280 --> 00:04:24.960
000 watts of heat that our cpus and gpus

00:04:23.120 --> 00:04:29.759
will kick out under full load and remember that's without overclocking we

00:04:27.360 --> 00:04:35.759
settled on a full complement of ek waterblox's ultra thick class radiators

00:04:33.199 --> 00:04:41.440
we've got quad 140 millimeter units for both the top and the bottom as well as a

00:04:38.880 --> 00:04:46.560
triple fan model on the front now we did have a bit of trouble mounting our 140

00:04:43.919 --> 00:04:51.440
millimeter Noctua fans as the clearances are just slightly off with these

00:04:48.720 --> 00:04:56.240
radiators but thanks to some space under the top panel we made it work now even

00:04:54.080 --> 00:05:00.400
with this configuration we're not a hundred percent sure that we've got

00:04:58.080 --> 00:05:04.880
enough cooling capacity problem is we kind of had to roll with

00:05:02.400 --> 00:05:09.039
it since case Labs the company that makes this monster chassis

00:05:07.199 --> 00:05:14.240
uh excuse me i misspoke i should have said made this monster chassis because

00:05:12.000 --> 00:05:18.240
they went out of business while we were working on this project

00:05:15.919 --> 00:05:20.400
so we really can't get any more parts for it

00:05:19.280 --> 00:05:25.120
not that i think there would have been anywhere to mount them because i think

00:05:22.800 --> 00:05:31.520
we've managed to build one of the few machines in existence that truly needs a

00:05:28.800 --> 00:05:36.400
case of this magnitude to find out why let's have a look at the crown jewel of

00:05:33.520 --> 00:05:39.840
our build this pci express expansion daughter board courtesy of one stop

00:05:38.560 --> 00:05:45.440
systems so this bad boy or girl whatever it is

00:05:43.120 --> 00:05:52.160
is gonna allow us to take the bottom PCIe 16x slot on our motherboard and

00:05:48.560 --> 00:05:55.680
then break it out into eight more slots

00:05:52.160 --> 00:05:57.360
for a total capacity of up to 14

00:05:55.680 --> 00:06:02.400
expansion cards take that mac pro

00:05:59.600 --> 00:06:06.560
what this gives us is two individually hot pluggable usb ports for each of our

00:06:05.120 --> 00:06:14.479
editing machines and a melanox 100 gigabit Ethernet card

00:06:10.880 --> 00:06:17.120
to pull all that juicy 8k footage off of

00:06:14.479 --> 00:06:20.880
our main editing server which is also equipped with one of melanox's

00:06:18.800 --> 00:06:25.120
high-speed network cards now we're only able to run our cards at 40 gigabit

00:06:23.199 --> 00:06:30.080
because we don't have a 100 gigabit network switch

00:06:26.880 --> 00:06:32.960
or enough pci express bandwidth anyway

00:06:30.080 --> 00:06:38.720
but that should still be plenty for six 8k raw streams so the thing is here that

00:06:35.919 --> 00:06:44.000
the daughter board wasn't necessary per se it's just that without it we would

00:06:41.199 --> 00:06:49.919
have had to use a bunch of usb hubs and assign each usb device individually to

00:06:47.280 --> 00:06:55.280
our editors meaning that any changes would require reconfiguration and unraid

00:06:52.560 --> 00:06:58.880
and a reboot of the virtual machine so

00:06:56.000 --> 00:07:02.960
yeah it's mostly a creature comfort but i think it's super cool because it means

00:07:00.720 --> 00:07:07.520
that for all intents and purposes our editors might as well be sitting at a

00:07:04.960 --> 00:07:11.680
completely normal computer now mounting this thing was a bit hard

00:07:09.759 --> 00:07:16.400
to watch not because Jake doesn't know his way around a dremel or anything but

00:07:13.759 --> 00:07:19.919
it's more just that this is a 500 us dollar case

00:07:17.680 --> 00:07:24.720
and more importantly you straight up can't even buy them anymore

00:07:22.800 --> 00:07:29.280
thankfully it turned out pretty dang clean we actually ended up stealing the

00:07:27.039 --> 00:07:34.479
pci express slots from a thermaltake tower 900 and it worked perfectly for

00:07:32.720 --> 00:07:37.360
the eight cards that we needed to install

00:07:35.759 --> 00:07:41.199
then we mounted the daughter board with some upside down bolts threaded through

00:07:39.199 --> 00:07:45.360
the bottom of the case and it was off to the races

00:07:43.599 --> 00:07:52.240
now as for the rest of the trunk over here we ended up going with dual evga

00:07:48.800 --> 00:07:55.120
1600 watt t2 80 plus titanium power

00:07:52.240 --> 00:07:58.800
supplies with some sexy cable mod cables now i'm one of the first people to point

00:07:57.360 --> 00:08:04.000
out that one power supply of this magnitude is

00:08:01.840 --> 00:08:09.840
totally unnecessary but this is not exactly a normal

00:08:06.400 --> 00:08:13.199
computer remember guys even just the

00:08:09.840 --> 00:08:16.400
gpus in this system could be too much

00:08:13.199 --> 00:08:17.680
for a single power supply 1600 watts or

00:08:16.400 --> 00:08:23.599
otherwise so for us then two of these bad boys

00:08:20.800 --> 00:08:28.560
fits the bill nicely and should even give us plenty of headroom for capacitor

00:08:26.160 --> 00:08:32.080
aging or even overclocking think of it kind of like being that guy at the car

00:08:30.319 --> 00:08:37.039
show with the nitrous bottle in their trunk except the nitrous is a second power

00:08:35.760 --> 00:08:40.959
supply and rather than being outside they're in

00:08:39.440 --> 00:08:45.200
their mom's basement speaking of horsepower adders the eight 10 terabyte

00:08:43.440 --> 00:08:49.200
nas drives that we have installed in the front of the case can be used to assign

00:08:47.279 --> 00:08:56.160
local bulk storage to our virtual machines and we'll be using our dual

00:08:52.000 --> 00:08:59.360
Intel 905p series optane ssds as a right

00:08:56.160 --> 00:09:01.680
cache for our magnetic drives as well as

00:08:59.360 --> 00:09:06.720
for raw high-speed storage for the Windows installs for each of our editor

00:09:04.320 --> 00:09:11.040
now the reason we used optane for this is that when you're hitting a drive with

00:09:09.279 --> 00:09:17.600
six users at a time booting up or launching programs even a

00:09:14.240 --> 00:09:20.480
high-speed NVMe SSD can struggle well

00:09:17.600 --> 00:09:26.000
optane has much faster access times so we're hoping that to our editors this

00:09:23.120 --> 00:09:29.279
entire virtualization experience should be transparent

00:09:27.680 --> 00:09:32.880
although we haven't actually tested that yet now with the build mostly dry

00:09:31.040 --> 00:09:37.519
assembled at this point we could finally get to running our tubes yes we went

00:09:35.440 --> 00:09:42.080
with soft tubing so no it's not the

00:09:39.279 --> 00:09:45.519
sexiest machine in the world but with a good chunk of ek water blocks

00:09:44.000 --> 00:09:50.880
nickel fittings and a little bit of creativity we still think it looks

00:09:47.839 --> 00:09:53.120
pretty good not in a blinged out RGB

00:09:50.880 --> 00:09:56.560
gaming rig kind of way but in more of like a

00:09:54.080 --> 00:10:00.880
this thing does real work kind of way and it has the added benefit of making

00:09:58.560 --> 00:10:05.040
it much easier to reconfigure the system if we ever decide to upgrade it in the

00:10:02.560 --> 00:10:08.000
future so from there just add water and a little bit of

00:10:06.720 --> 00:10:11.680
patience and wa-bam

00:10:10.560 --> 00:10:16.160
finished system

00:10:13.839 --> 00:10:18.560
of course we're not done yet though i've been out of the office for a few days

00:10:17.440 --> 00:10:22.480
while Jake's been getting things together so

00:10:20.640 --> 00:10:27.040
why don't we go check it out all right so for our first power on test we're not

00:10:24.399 --> 00:10:31.200
trying to go full ham virtual machines everything so we've actually unplugged

00:10:29.200 --> 00:10:35.760
our octane drives and our hard drives and just through a simple

00:10:33.200 --> 00:10:38.240
basic SATA SSD with a Windows install on it because

00:10:36.800 --> 00:10:43.440
we want to make sure it's all still working after the assembly ordeal

00:10:41.680 --> 00:10:46.480
we have fan spin hey

00:10:44.720 --> 00:10:53.279
do we have display on the other side nice we want to find out if our cooling

00:10:50.399 --> 00:10:56.160
solution is actually adequate before we start though

00:10:54.320 --> 00:11:03.839
let's do a good old-fashioned cinebench r15 run

00:10:58.839 --> 00:11:03.839
ready there it is boys oh my god

00:11:05.040 --> 00:11:11.519
and you're done seven thousand so something that a lot of people don't

00:11:08.880 --> 00:11:16.000
know is that just because you have two CPU sockets doesn't mean that even a

00:11:14.320 --> 00:11:19.519
heavily multi-threaded application like blender you can see it's using the

00:11:17.440 --> 00:11:24.959
entire first CPU it doesn't necessarily mean that it can

00:11:21.680 --> 00:11:27.040
utilize the second CPU it just doesn't

00:11:24.959 --> 00:11:32.800
quite work that way alright so here we are blender's running our gpus are all

00:11:29.200 --> 00:11:35.120
sitting at 75 80 utilization our CPU is

00:11:32.800 --> 00:11:39.519
at 92 and all we can do is let it cook for a

00:11:38.079 --> 00:11:44.000
bit oh wow

00:11:41.360 --> 00:11:48.320
like just this chassis being made out of aluminum just like feels like a bad idea

00:11:46.079 --> 00:11:52.399
like there's so much flex to it if only it was like a cheese grater

00:11:53.519 --> 00:11:58.880
i don't think you could fit that many cores into cheese grater

00:11:56.880 --> 00:12:03.040
ouch yeah this is twice as many cores as new

00:12:00.560 --> 00:12:06.079
mac pro just saying the highest end mac bro yeah

00:12:04.480 --> 00:12:09.760
that means each one of our editing stations effectively has an eight core

00:12:07.680 --> 00:12:16.160
CPU 60 gigs of memory a 100 gig optane drive

00:12:13.760 --> 00:12:19.360
and its own titan v and wow they actually booted really fast in spite of

00:12:18.240 --> 00:12:25.519
you like starting them rapid fire like that

00:12:21.920 --> 00:12:27.200
that's flipping awesome and we're good

00:12:25.519 --> 00:12:31.680
you know what no for the purposes of today we're just trying to find out if

00:12:29.120 --> 00:12:35.760
it can handle a full load thermally and stability wise so let's forget about

00:12:33.360 --> 00:12:40.000
premiere let's just start loading up stress tests on these things

00:12:37.680 --> 00:12:46.079
what stress test should we do well let's throw like

00:12:41.440 --> 00:12:47.600
i do ida and uh fur mark boom there

00:12:46.079 --> 00:12:52.560
all right so here comes our first set of stress tests we're going stress fpu on

00:12:49.680 --> 00:12:57.440
ida 64 and GPU stress tests at 1600

00:12:55.519 --> 00:13:02.399
by 1200 yep that's better if we don't leave a

00:12:59.360 --> 00:13:04.240
couple of CPU cores for fur mark to grab

00:13:02.399 --> 00:13:08.800
then it throttles the GPU and we don't use up all the power so

00:13:06.399 --> 00:13:12.639
time to do number four i'm having fun

00:13:10.240 --> 00:13:16.880
it's finally done all right i'm ready to go with stress test number four

00:13:15.360 --> 00:13:20.920
not bad is there a reason you didn't put fans in the bottom two here

00:13:21.600 --> 00:13:28.160
no no we could we should yeah because that

00:13:25.200 --> 00:13:32.720
would look more you know symmetrical ish you gotta cool these optane ssds yo

00:13:30.800 --> 00:13:37.519
actually it's not a terrible idea the fan's still not on on the second power

00:13:34.800 --> 00:13:42.320
supply okay so we've had the whole thing running for about five minutes now um

00:13:40.959 --> 00:13:48.160
our block of GPU blocks

00:13:44.800 --> 00:13:50.240
is noticeably warm to the touch not hot

00:13:48.160 --> 00:13:54.800
not uncomfortable but it's warm

00:13:51.760 --> 00:13:56.320
these fans that are blowing down

00:13:54.800 --> 00:13:59.600
like it's kind of like having a space heater blowing at me from under the

00:13:58.079 --> 00:14:03.920
computer same thing up here

00:14:01.440 --> 00:14:08.320
and we've actually got some temperature results as well

00:14:05.360 --> 00:14:12.639
so it looks like our gpus have settled in right around the 55

00:14:11.680 --> 00:14:16.560
to 60 degree mark depending on which ones

00:14:15.120 --> 00:14:21.519
we're looking at and then Jake you've got CPU temps right 48 49 across the

00:14:19.760 --> 00:14:27.040
board now we're not fully loading the CPU

00:14:22.800 --> 00:14:28.320
but i mean we're probably over 80 right

00:14:27.040 --> 00:14:32.959
you tell me that looks not bad

00:14:31.199 --> 00:14:40.320
we're hitting it pretty hard so that's it guys at long last it's finally working

00:14:37.360 --> 00:14:44.560
not only that but our cooling solution is adequate good job Jake

00:14:42.880 --> 00:14:50.959
and the thing actually seems to be stable so all that's left now then

00:14:47.920 --> 00:14:52.000
is to get a nice long 40 gigabit network

00:14:50.959 --> 00:14:57.760
cable plug this thing into our switch and get

00:14:54.720 --> 00:14:58.959
six editors set up with full stations

00:14:57.760 --> 00:15:03.120
around it and to see if we actually can do it

00:15:01.360 --> 00:15:07.360
because this has all been theoretical up until now theoretically if we have eight

00:15:05.120 --> 00:15:10.480
CPU cores and a titan v and 60 gigs of RAM should be fine

00:15:08.880 --> 00:15:17.680
but it's all theoretical up till now let's see if we can do it six times

00:15:13.279 --> 00:15:19.760
ak editing workstations off of a single

00:15:17.680 --> 00:15:24.320
tower i can't believe it's finally working

00:15:22.480 --> 00:15:27.920
speaking of work i've got some work to do too to tell you guys about our

00:15:26.000 --> 00:15:33.279
sponsor for today's video massdrop the massdrop hd6xx headphones is one of the

00:15:31.120 --> 00:15:39.920
most successful collaborations that drop.com has ever done they've sold over

00:15:36.800 --> 00:15:42.320
70 000 units of these things making them

00:15:39.920 --> 00:15:46.720
the all-time best seller on massdrop and it's no wonder they've got a balanced

00:15:44.160 --> 00:15:50.639
mid-range natural sounding bass they're open back they sound absolutely

00:15:48.399 --> 00:15:55.680
fantastic they're actually very similar to my daily driver hd 650s

00:15:53.839 --> 00:15:59.519
they've made a couple of tweaks based on community feedback they've got a 1 8th

00:15:57.839 --> 00:16:05.519
inch plug for everyday use and a one-quarter inch adapter for professional use and sennheiser backs

00:16:03.199 --> 00:16:10.480
these headphones with their support so check out the link below and get your

00:16:07.480 --> 00:16:12.240
hd6xx headphones today

00:16:10.480 --> 00:16:16.800
so thanks for watching guys if you disliked this video hey it's on now

00:16:15.360 --> 00:16:20.720
you can hit that button but if you liked it hit like get subscribed or maybe consider checking out where to buy the

00:16:19.440 --> 00:16:24.720
stuff we featured at the link in the video description also down there is our

00:16:23.040 --> 00:16:29.519
merch store which has cool shirts like the one i'm wearing and our community

00:16:26.720 --> 00:16:33.440
forum which you should totally join i'm a little bit concerned one of our

00:16:31.279 --> 00:16:36.880
displays just went blank um

00:16:35.120 --> 00:16:40.160
hey okay the monitor just went to sleep it's all good yeah

00:16:39.279 --> 00:16:43.440
yeah it's still working good

00:16:42.480 --> 00:16:48.959
so 100 000 computer was based on if we were

00:16:46.639 --> 00:16:52.639
going to load it up completely with top end quadro cards which didn't end up

00:16:51.680 --> 00:16:57.600
happening so we took some artistic

00:16:55.519 --> 00:17:00.240
liberties with the naming of the computer