The $100,000 PC LIVES! - 6 Editors 1 CPU Pt. 5
Linus Tech Tips
·Linus Tech Tips
·2019-05-06
·
3,561 words · ~17 min read
0:00
um six editors one CPU part the
0:03
the fourth fourth part 69 part four okay section four okay try to be less
0:08
annoying there's been a lot of comments now i saw them so here's what went down six
0:12
workstations one CPU was a project that i invested many many
0:18
many hours of my time into trying to
0:22
figure out what it was was it software was it hardware was it firmware was it
0:27
drivers what was causing the crashes
0:31
whenever we tried to load up certain virtual machines in our latest crazy
0:36
virtualization project and the answer
0:39
it was the hardware i love ASUS love them very dearly but what i don't love
0:44
is this slot and this slot because they are dirty
0:49
little slots basically either they just outright don't work or their bifurcation
0:54
which means taking 16 pci express lanes and splitting them out into two 8x lanes
0:59
so you can have two separate devices running at 8x doesn't work but that's
1:03
okay thank you Jake you can uh pack that back up for me because we have
1:07
this so back when i started the project
1:11
this board didn't exist this is a dual lga 3647 socket motherboard from tyen it
1:18
also has support for 12 memory sticks so
1:21
we can put the same 384 gigs of RAM on
1:24
it it also has 10 gig networking on
1:27
board and a bunch it's got u.2 connectors and this one
1:32
look at this is that is that is it is that 11
1:37
11 pci express slots
1:40
so this is going to be fun because today
1:43
we are going to get it working for real hopefully
1:54
thermaltake's a500 has a modern minimalistic design brushed aluminum
1:59
panels and dual hinge swing tempered glass doors check it out today at the
2:03
link in the video description so to be clear ASUS is actually still working on
2:07
a fix for their board by the way massive shout out to wendell for helping us
2:11
figure out the the bifurcation issue but in the meantime we did want to try
2:15
something else because we want this project done and taiyan claimed when we
2:20
contacted them that it would be no problem in fact they actually had a couple of boards that could work this
2:25
one that i showed you which was kind of a lie because we're not going to use
2:28
this one because it doesn't fit in any case and the one that's actually on the test
2:33
bench right behind me here so this is a standard ssi eeb form factor board just
2:39
like that one with the main differences being that it's only got seven pci
2:43
express slots just like the ASUS board that we were
2:47
using it's got three of these u.2
2:50
looking connectors over there more on that in a moment it's got its two m.2s
2:54
and i mean yeah it just doesn't have 11
2:57
slots like it's still got six slots for memory and all of that good stuff so
3:01
we're basically ready to rock and i want to walk you guys through what i have set
3:05
up here for those of you who haven't seen this madness before so in our top
3:09
slot here we've got an external pci
3:13
express like sort of riser card with an extender cable that runs over to this
3:17
daughter board here the reason we want this is that we want each one of our vms
3:22
to have its own dedicated usb 3 controller so that if we had to do say
3:27
for example um a high speed ingest of footage for
3:32
editing or whatever else everyone could do that without running into a system
3:36
bottleneck so right now all of these cards if we were to pin them all at the
3:40
same time it might be a little borderline because this is a PCIe 8x
3:45
link right here but if we went 16x which we may be able to do in the finished one
3:49
i don't imagine that would actually be a problem the last thing over here is a 10
3:53
gigabit networking card but we'd like to go 100 gigabit for the final project so
3:57
we're running the same thermaltake pci express extensions that we were using
4:00
before except Jake actually had the ingenious idea of instead of just
4:05
stacking the cards next to the bench on the table grabbing this old diy mining
4:10
rig that he had lying around and putting all of our titan vs on that so at least
4:16
something good came out of that whole mining craze for the rest of the
4:19
hardware we've got two ax-1500i power supplies just because of the way that
4:23
this whole thing hooks up we'll come up with a better way to do that later and
4:27
then we've got the optane 905 ps that we were planning to use as
4:32
our boot drives with these adapters from udot 2 to pci express 4x
4:38
now one small problem and that is that these while they are physically the same
4:43
connector as NVMe u.2 it's actually
4:47
called um ssfp
4:50
no i don't think so something something something crazy it's a mini sas hd i
4:55
don't know yeah yeah yeah that's that's minis hd so this is meant to be used as
4:58
a breakout into just four like SATA connections or a bunch of things so
5:01
there's no actual pci express backing for this so that's where these m.2
5:05
drives come in and maybe we'll do use adapters to go to these to go to the
5:08
other whatever we'll cross that bridge when we get to it the last change is
5:12
that we're running xeon gold cpus because i actually dropped one of our
5:16
8180 platinums and it's got a dead memory channel and so just for
5:21
troubleshooting purposes we wanted stuff that definitely works
5:26
but there's good news check this out so
5:30
here's workstation one we're gonna grab our top titan v it's
5:35
accompanying sound card we had to apply the same fixes for uh
5:39
pci stubbing so that we can get all these usb cards showing up here as well
5:44
as uh acs override downstream multifunction so
5:49
all that's done just like last time we're going to go ahead and fire this up now this should work
5:55
and it should show up over here
6:00
mind you we had a single vm working just fine on the other one also we need to
6:05
make sure that our daughter board which is some weird weird friggin hardware
6:10
is working correctly as well so it was one of the renaissance ones so it must
6:14
be this one so this one or this one
6:17
our mouse should light up there's a 50 50 chance that our mouse will light up
6:21
it did not but that's okay
6:25
because there is still a 50 50 chance just kidding it should be a hundred
6:28
percent actually it's probably less than 100 because there's just a chance it
6:32
won't work but
6:35
it's setting up a device is it oh i couldn't see that
6:39
cool device is ready the sentinel 3 is ready
6:42
to go
6:48
come on baby anytime mr sentinel or ms sentinel
6:54
okay hold on no no we thought there was a chance this might happen oh it's
6:58
working oh it's working huzzah oh hell yeah i was like less than 50 50
7:03
that this was gonna work well that's great so then now we just proceed
7:07
right adding more yeah should we just like fire up like a game or something so
7:11
here's what we're gonna do for each one we're gonna name it we're gonna go ahead and
7:16
i think that'll do i'm giving it each one of them a three
7:21
core CPU because we don't have a lot of CPU cores right now i need to either buy
7:25
a new one or beg and plead with Intel to send me a new one which i strongly
7:31
suspect they are not going to want to do because
7:34
um that team and i are not on the best of terms right now
7:38
so i saw in there uh the CPU mode is in host pass-through mode
7:44
so we're using that to hide the virtualization from the NVIDIA
7:49
drivers that's yes so they don't give you that weird error and that's right
7:52
because they want you to buy quadros yeah so they specifically bake in a
7:57
specific error just as an fu it's not
8:00
like we cheaped out you know gv100s they're only like 10
8:05
grand right you think they'd send us six of those no
8:09
past few what wait what is that what the hell was that another vm well
8:13
which one is that well you what's going on here which one did you
8:17
just turn on turn on yeah you just turned one on wait
8:20
what is Windows 10 what is this one i don't know so this is great it's
8:24
actually wendell to the rescue again or at least his community over on uh level
8:28
one tech's forum so what it is is that we had assigned the usb device to one of
8:32
the vms then booted that up shut that down tried to assign it to another one
8:37
and then boot that up and some devices have an issue where they like they don't
8:41
get fully let go of uh we had this problem with the um
8:46
Radeon r9 nanos or whatever those things were called from the original seven
8:50
gamers one CPU where if we had a crash in one of the vms we would actually have
8:55
to completely reset the entire host in order to reboot the vm because of just
9:01
the way that AMD's i believe it was a firmware issue and that particular card
9:05
was implemented so we're just going to go one at a time we're going to take it slow baby
9:10
slow hands slow hands okay there's one got my point
9:15
and finger ready it's like twitching you
9:21
wait oh there it is i had my boss that didn't have my pointing finger ready
9:24
anymore okay two this is the wild west be dead
9:30
got him three here comes number four oh i want to back
9:34
up i don't want to get in the way of that shut up too much horsepower ah there it
9:39
is
9:46
oh damn it
9:49
oh it works ah
9:52
because you can see the graphics drivers are loaded like that was our problem we
9:56
were able to light up lots of vms before but now like that they're not crashing
10:02
and the graphics drivers are loaded like they're running at the right resolution
10:05
it's working device manager uh display
10:09
adapters that don't be yeah okay all
10:12
right all right let's get a table uh
10:15
wow that's my toe okay so this is not a great table it's like three quarters of
10:21
a desk had some budget cuts you know it's
10:24
january you know how the youtube ad revenue is
10:28
everything gets slashed uh in all seriousness though we're just using
10:31
these like hobby board pieces we're making our own table tops we think this
10:35
is going to be for the upcoming land center so this is like the first
10:39
prototype we got these uh how did they get uh raising
10:43
cheap what well relatively look at the well no i i mean they were inexpensive
10:48
yeah that's a that's a bad use of words
10:51
isn't this crazy why would you ever need a desk this tall
10:54
maybe if you're like seven feet tall yeah yeah okay can can we i'm putting it back to
10:59
we'll get back on task okay no no
11:02
i'm good let's go ahead and we're leaving yeah we can just put them both here
11:06
oh yeah that sounds fine why don't we want to put them on there cool because
11:09
we're going to cover this in keyboards and nice where are all the keyboards and mice for this project oh also how are we
11:14
going to plug into usb it's way over there uh so i'm saying we unplug all the power
11:18
things because we could just leave that power supply there we just move our board over there yeah
11:23
tell you stop all so kill everything with fire shut her down
11:27
use your pointing finger how do you do that so well
11:31
i don't feel like just talking about there you go that was a little better
11:35
getting the hang of it
11:38
it's not as easy as it looks okay
11:42
my god Windows update no way are they all doing it
11:48
i mean presumably they're all running on the same image this board is so trippy
11:53
like it takes a 24 pin um five and then
11:57
five eight pins are they all eps yeah
12:01
who the hell has five eps connect like what servers see that's the thing though
12:05
what server has a modular power supply and no what server has five eps
12:09
connectors on i don't know but uh i think you have to be purpose built the
12:12
tesla v100s have eps connectors they don't have PCIe
12:16
no they do it's a single eight pin and then you can adapt two
12:20
PCIe eight pins into one eps eight pin that's madness yeah
12:25
okay there you go so you need all your power connectors in there
12:28
and it's like very professionally mounted
12:31
top quality i know how much i love these fans that are just literally in here as
12:35
spacers and not even plugged in yeah man
12:38
gotta use Noctua for everything i can't wait to order the cable mod kit
12:43
for this build thomas is gonna be like what do you need
12:46
1200 of cables for
12:49
okay uh hit it
12:53
with my best shot yeah i love it this these tie-in boards they
12:57
have on-board power buttons for like bench operation so 250 times six is
13:02
1500. wow i think these are aren't these more
13:05
than 250 you don't sound very certain about any
13:09
of this at this point so i'm not really listening anymore i'm googling here let's ask google why don't we go get the
13:13
keyboards and nice that we need how many watts is a titan v
13:18
according to amazon.com NVIDIA titan v has the power of 12
13:22
gigabytes hdm2 memory with 640 tensor
13:25
cores 110 teraflops you wanna
13:29
we have 110 teraflops of watts how many keyboards do we need
13:35
i think four five five where did all the keyboards go
13:39
i can't even hear him it doesn't matter if they're wrecked this is just for
13:43
testing okay all right all right i'm coming what is this you said grab random
13:47
ones oh i can't type on this
13:51
okay this doesn't work oh why is it still a thing it's like i don't know you
13:55
know it's sentimental there was me grabbing actual keyboards no Jake you
14:00
don't need to grab actually hold on these are broken oh it doesn't matter it
14:04
doesn't matter okay just chill looks like the budget cuts are really
14:08
hurting us here we're short on space
14:12
so i um i don't know which is which right now so what i was kind of thinking
14:17
are they actually plugged in properly or no
14:21
hello dennis wild dennis appears
14:25
so um i don't know how but we somehow made this more jank than your setup i
14:30
think
14:34
okay so hold on a second which one's one okay so one
14:38
is the top so let's go one two three four five six oh god
14:43
so wait what is it let's just group them all together just screw it we're just just make sure we have two on each
14:48
oh should i plug in the 10 gig maybe hell yeah
14:52
let's do it yeah somebody's walking past the basketball
14:56
hoop i'm a little confused what
14:59
what's that for okay is this in like some kind of a mode
15:03
where for whatever reason h is volume down
15:06
you do not have enough disk space oh god how big are these disks
15:10
uh oh no not huge
15:13
can i just uninstall premiere you can
15:16
do whatever you want it's a free country yeah wait what no don't uninstall for me
15:20
that's a pain in the ass so theoretically all we have to do is
15:23
pop open disk management now
15:27
and extend volume boom boom boom and bippity
15:32
boppity where's steam big volume
15:35
it's open beautiful so what are we using csgo yeah
15:39
sure so this is why the steam cache is pretty great right cause we got that one
15:42
going at 40. that one going at 40. there's some other ones presumably
15:48
um that's the only one pulling off the steam catch but how do you know well
15:52
because that's the only one i configured to pull up the steam cache why do you need to configure it i thought our our
15:56
dns settings are just i don't think we did that in the router i thought you did
16:00
because it wasn't me it wasn't me hey
16:04
there we go see it was using the cache
16:08
40 40 40. nice oh oh oh
16:13
no this one's at 70
16:16
50. that's looking hot
16:19
oh if you're into that sort of thing
16:23
so when we do put the lance center over there we'll be able to all download
16:26
games at like csgo hell yeah hell yeah
16:30
so now we have updates all these people it's Windows update too
16:34
right you play origin sure
16:38
do you know i don't i don't know people have to have a bad time okay guys come
16:41
on over i have a primo
16:45
primo gaming experience for you guys
16:49
uh six workstations one CPU is officially working
16:52
uh we haven't quite worked out the logistics of the keyboards and mice
16:57
uh these are all bot matches so everyone feel free to um
17:00
find a keyboard and mouse and figure out what the crap screen you're running on
17:06
oh on that one we said it's premium
17:09
we're actually marketing people so we don't know
17:12
yep we're primo this is primo
17:16
oh i gotta the audio is a little bit messed up
17:21
because we don't know uh which source this monitor in
17:24
particular is pulling audio from we can actually have a look at our CPU
17:28
usage here so you can see the cores that i've assigned i left
17:33
core one alone so cores two to 18 are assigned and you
17:37
can see we're sucking up anywhere from 70 50 to as high as 90 usage on these
17:43
cores playing cs go so this is good enough but there would be games that
17:47
would be more demanding where we'd run into trouble so it's working this is
17:52
crazy exciting but the next stage
17:55
is productivity so we need higher end networking we need faster boot drives
18:00
we're going to move to optane and we're going to try to edit 8k video on all six
18:05
of these workstations at once
18:09
but this is a good start it's stable
18:12
it's finally stable
18:16
massdrop's sennheiser hd6xx headphones are some of their best
18:20
selling of all time with over 60 000
18:24
units sold and i can see why because they have an unchanged driver and sound
18:28
structure compared to the hd650s meaning that you get a nice balanced mid-range
18:33
and natural sounding bass they've added a detachable six-foot cable instead of a
18:38
10-foot cable based on community feedback and they come with an eighth
18:42
inch plug that's versatile for everyday use and a quarter inch adapter you also
18:46
get long term support from sennheiser so check out the link today to join the
18:50
drop now so thanks to Jake for getting this working tien for having a
18:55
motherboard that works properly and you guys for watching and dislikes this
18:58
video and wendell hey if you guys dislike this video you can hit that
19:02
button but if you liked it hit like get subscribed or maybe consider checking out where to buy the stuff we featured
19:06
at the link in the video description also down there is our merch store which has cool shirts like this one and our
19:10
community forum which you should totally join
19:14
this is clearly the most ergonomic gaming setup of all
19:23
i'm getting shot time ninjabot