um six editors one CPU part the
the fourth fourth part 69 part four okay section four okay try to be less
annoying there's been a lot of comments now i saw them so here's what went down six
workstations one CPU was a project that i invested many many
many hours of my time into trying to
figure out what it was was it software was it hardware was it firmware was it
drivers what was causing the crashes
whenever we tried to load up certain virtual machines in our latest crazy
virtualization project and the answer
it was the hardware i love ASUS love them very dearly but what i don't love
is this slot and this slot because they are dirty
little slots basically either they just outright don't work or their bifurcation
which means taking 16 pci express lanes and splitting them out into two 8x lanes
so you can have two separate devices running at 8x doesn't work but that's
okay thank you Jake you can uh pack that back up for me because we have
this so back when i started the project
this board didn't exist this is a dual lga 3647 socket motherboard from tyen it
also has support for 12 memory sticks so
we can put the same 384 gigs of RAM on
it it also has 10 gig networking on
board and a bunch it's got u.2 connectors and this one
look at this is that is that is it is that 11
11 pci express slots
so this is going to be fun because today
we are going to get it working for real hopefully
thermaltake's a500 has a modern minimalistic design brushed aluminum
panels and dual hinge swing tempered glass doors check it out today at the
link in the video description so to be clear ASUS is actually still working on
a fix for their board by the way massive shout out to wendell for helping us
figure out the the bifurcation issue but in the meantime we did want to try
something else because we want this project done and taiyan claimed when we
contacted them that it would be no problem in fact they actually had a couple of boards that could work this
one that i showed you which was kind of a lie because we're not going to use
this one because it doesn't fit in any case and the one that's actually on the test
bench right behind me here so this is a standard ssi eeb form factor board just
like that one with the main differences being that it's only got seven pci
express slots just like the ASUS board that we were
using it's got three of these u.2
looking connectors over there more on that in a moment it's got its two m.2s
and i mean yeah it just doesn't have 11
slots like it's still got six slots for memory and all of that good stuff so
we're basically ready to rock and i want to walk you guys through what i have set
up here for those of you who haven't seen this madness before so in our top
slot here we've got an external pci
express like sort of riser card with an extender cable that runs over to this
daughter board here the reason we want this is that we want each one of our vms
to have its own dedicated usb 3 controller so that if we had to do say
for example um a high speed ingest of footage for
editing or whatever else everyone could do that without running into a system
bottleneck so right now all of these cards if we were to pin them all at the
same time it might be a little borderline because this is a PCIe 8x
link right here but if we went 16x which we may be able to do in the finished one
i don't imagine that would actually be a problem the last thing over here is a 10
gigabit networking card but we'd like to go 100 gigabit for the final project so
we're running the same thermaltake pci express extensions that we were using
before except Jake actually had the ingenious idea of instead of just
stacking the cards next to the bench on the table grabbing this old diy mining
rig that he had lying around and putting all of our titan vs on that so at least
something good came out of that whole mining craze for the rest of the
hardware we've got two ax-1500i power supplies just because of the way that
this whole thing hooks up we'll come up with a better way to do that later and
then we've got the optane 905 ps that we were planning to use as
our boot drives with these adapters from udot 2 to pci express 4x
now one small problem and that is that these while they are physically the same
connector as NVMe u.2 it's actually
called um ssfp
no i don't think so something something something crazy it's a mini sas hd i
don't know yeah yeah yeah that's that's minis hd so this is meant to be used as
a breakout into just four like SATA connections or a bunch of things so
there's no actual pci express backing for this so that's where these m.2
drives come in and maybe we'll do use adapters to go to these to go to the
other whatever we'll cross that bridge when we get to it the last change is
that we're running xeon gold cpus because i actually dropped one of our
8180 platinums and it's got a dead memory channel and so just for
troubleshooting purposes we wanted stuff that definitely works
but there's good news check this out so
here's workstation one we're gonna grab our top titan v it's
accompanying sound card we had to apply the same fixes for uh
pci stubbing so that we can get all these usb cards showing up here as well
as uh acs override downstream multifunction so
all that's done just like last time we're going to go ahead and fire this up now this should work
and it should show up over here
mind you we had a single vm working just fine on the other one also we need to
make sure that our daughter board which is some weird weird friggin hardware
is working correctly as well so it was one of the renaissance ones so it must
be this one so this one or this one
our mouse should light up there's a 50 50 chance that our mouse will light up
it did not but that's okay
because there is still a 50 50 chance just kidding it should be a hundred
percent actually it's probably less than 100 because there's just a chance it
won't work but
it's setting up a device is it oh i couldn't see that
cool device is ready the sentinel 3 is ready
to go
come on baby anytime mr sentinel or ms sentinel
okay hold on no no we thought there was a chance this might happen oh it's
working oh it's working huzzah oh hell yeah i was like less than 50 50
that this was gonna work well that's great so then now we just proceed
right adding more yeah should we just like fire up like a game or something so
here's what we're gonna do for each one we're gonna name it we're gonna go ahead and
i think that'll do i'm giving it each one of them a three
core CPU because we don't have a lot of CPU cores right now i need to either buy
a new one or beg and plead with Intel to send me a new one which i strongly
suspect they are not going to want to do because
um that team and i are not on the best of terms right now
so i saw in there uh the CPU mode is in host pass-through mode
so we're using that to hide the virtualization from the NVIDIA
drivers that's yes so they don't give you that weird error and that's right
because they want you to buy quadros yeah so they specifically bake in a
specific error just as an fu it's not
like we cheaped out you know gv100s they're only like 10
grand right you think they'd send us six of those no
past few what wait what is that what the hell was that another vm well
which one is that well you what's going on here which one did you
just turn on turn on yeah you just turned one on wait
what is Windows 10 what is this one i don't know so this is great it's
actually wendell to the rescue again or at least his community over on uh level
one tech's forum so what it is is that we had assigned the usb device to one of
the vms then booted that up shut that down tried to assign it to another one
and then boot that up and some devices have an issue where they like they don't
get fully let go of uh we had this problem with the um
Radeon r9 nanos or whatever those things were called from the original seven
gamers one CPU where if we had a crash in one of the vms we would actually have
to completely reset the entire host in order to reboot the vm because of just
the way that AMD's i believe it was a firmware issue and that particular card
was implemented so we're just going to go one at a time we're going to take it slow baby
slow hands slow hands okay there's one got my point
and finger ready it's like twitching you
wait oh there it is i had my boss that didn't have my pointing finger ready
anymore okay two this is the wild west be dead
got him three here comes number four oh i want to back
up i don't want to get in the way of that shut up too much horsepower ah there it
is
oh damn it
oh it works ah
because you can see the graphics drivers are loaded like that was our problem we
were able to light up lots of vms before but now like that they're not crashing
and the graphics drivers are loaded like they're running at the right resolution
it's working device manager uh display
adapters that don't be yeah okay all
right all right let's get a table uh
wow that's my toe okay so this is not a great table it's like three quarters of
a desk had some budget cuts you know it's
january you know how the youtube ad revenue is
everything gets slashed uh in all seriousness though we're just using
these like hobby board pieces we're making our own table tops we think this
is going to be for the upcoming land center so this is like the first
prototype we got these uh how did they get uh raising
cheap what well relatively look at the well no i i mean they were inexpensive
yeah that's a that's a bad use of words
isn't this crazy why would you ever need a desk this tall
maybe if you're like seven feet tall yeah yeah okay can can we i'm putting it back to
we'll get back on task okay no no
i'm good let's go ahead and we're leaving yeah we can just put them both here
oh yeah that sounds fine why don't we want to put them on there cool because
we're going to cover this in keyboards and nice where are all the keyboards and mice for this project oh also how are we
going to plug into usb it's way over there uh so i'm saying we unplug all the power
things because we could just leave that power supply there we just move our board over there yeah
tell you stop all so kill everything with fire shut her down
use your pointing finger how do you do that so well
i don't feel like just talking about there you go that was a little better
getting the hang of it
it's not as easy as it looks okay
my god Windows update no way are they all doing it
i mean presumably they're all running on the same image this board is so trippy
like it takes a 24 pin um five and then
five eight pins are they all eps yeah
who the hell has five eps connect like what servers see that's the thing though
what server has a modular power supply and no what server has five eps
connectors on i don't know but uh i think you have to be purpose built the
tesla v100s have eps connectors they don't have PCIe
no they do it's a single eight pin and then you can adapt two
PCIe eight pins into one eps eight pin that's madness yeah
okay there you go so you need all your power connectors in there
and it's like very professionally mounted
top quality i know how much i love these fans that are just literally in here as
spacers and not even plugged in yeah man
gotta use Noctua for everything i can't wait to order the cable mod kit
for this build thomas is gonna be like what do you need
1200 of cables for
okay uh hit it
with my best shot yeah i love it this these tie-in boards they
have on-board power buttons for like bench operation so 250 times six is
1500. wow i think these are aren't these more
than 250 you don't sound very certain about any
of this at this point so i'm not really listening anymore i'm googling here let's ask google why don't we go get the
keyboards and nice that we need how many watts is a titan v
according to amazon.com NVIDIA titan v has the power of 12
gigabytes hdm2 memory with 640 tensor
cores 110 teraflops you wanna
we have 110 teraflops of watts how many keyboards do we need
i think four five five where did all the keyboards go
i can't even hear him it doesn't matter if they're wrecked this is just for
testing okay all right all right i'm coming what is this you said grab random
ones oh i can't type on this
okay this doesn't work oh why is it still a thing it's like i don't know you
know it's sentimental there was me grabbing actual keyboards no Jake you
don't need to grab actually hold on these are broken oh it doesn't matter it
doesn't matter okay just chill looks like the budget cuts are really
hurting us here we're short on space
so i um i don't know which is which right now so what i was kind of thinking
are they actually plugged in properly or no
hello dennis wild dennis appears
so um i don't know how but we somehow made this more jank than your setup i
think
okay so hold on a second which one's one okay so one
is the top so let's go one two three four five six oh god
so wait what is it let's just group them all together just screw it we're just just make sure we have two on each
oh should i plug in the 10 gig maybe hell yeah
let's do it yeah somebody's walking past the basketball
hoop i'm a little confused what
what's that for okay is this in like some kind of a mode
where for whatever reason h is volume down
you do not have enough disk space oh god how big are these disks
uh oh no not huge
can i just uninstall premiere you can
do whatever you want it's a free country yeah wait what no don't uninstall for me
that's a pain in the ass so theoretically all we have to do is
pop open disk management now
and extend volume boom boom boom and bippity
boppity where's steam big volume
it's open beautiful so what are we using csgo yeah
sure so this is why the steam cache is pretty great right cause we got that one
going at 40. that one going at 40. there's some other ones presumably
um that's the only one pulling off the steam catch but how do you know well
because that's the only one i configured to pull up the steam cache why do you need to configure it i thought our our
dns settings are just i don't think we did that in the router i thought you did
because it wasn't me it wasn't me hey
there we go see it was using the cache
40 40 40. nice oh oh oh
no this one's at 70
50. that's looking hot
oh if you're into that sort of thing
so when we do put the lance center over there we'll be able to all download
games at like csgo hell yeah hell yeah
so now we have updates all these people it's Windows update too
right you play origin sure
do you know i don't i don't know people have to have a bad time okay guys come
on over i have a primo
primo gaming experience for you guys
uh six workstations one CPU is officially working
uh we haven't quite worked out the logistics of the keyboards and mice
uh these are all bot matches so everyone feel free to um
find a keyboard and mouse and figure out what the crap screen you're running on
oh on that one we said it's premium
we're actually marketing people so we don't know
yep we're primo this is primo
oh i gotta the audio is a little bit messed up
because we don't know uh which source this monitor in
particular is pulling audio from we can actually have a look at our CPU
usage here so you can see the cores that i've assigned i left
core one alone so cores two to 18 are assigned and you
can see we're sucking up anywhere from 70 50 to as high as 90 usage on these
cores playing cs go so this is good enough but there would be games that
would be more demanding where we'd run into trouble so it's working this is
crazy exciting but the next stage
is productivity so we need higher end networking we need faster boot drives
we're going to move to optane and we're going to try to edit 8k video on all six
of these workstations at once
but this is a good start it's stable
it's finally stable
massdrop's sennheiser hd6xx headphones are some of their best
selling of all time with over 60 000
units sold and i can see why because they have an unchanged driver and sound
structure compared to the hd650s meaning that you get a nice balanced mid-range
and natural sounding bass they've added a detachable six-foot cable instead of a
10-foot cable based on community feedback and they come with an eighth
inch plug that's versatile for everyday use and a quarter inch adapter you also
get long term support from sennheiser so check out the link today to join the
drop now so thanks to Jake for getting this working tien for having a
motherboard that works properly and you guys for watching and dislikes this
video and wendell hey if you guys dislike this video you can hit that
button but if you liked it hit like get subscribed or maybe consider checking out where to buy the stuff we featured
at the link in the video description also down there is our merch store which has cool shirts like this one and our
community forum which you should totally join
this is clearly the most ergonomic gaming setup of all
i'm getting shot time ninjabot