WEBVTT

00:00:00.160 --> 00:00:08.160
so you might have noticed it's been a while since i've talked about the oh

00:00:05.520 --> 00:00:11.759
the hundred thousand dollar pc and i'm approximating the cost because i

00:00:09.760 --> 00:00:16.160
actually don't know exactly how much it's going to end up coming to yet

00:00:13.920 --> 00:00:22.400
because they're still a few things that are to be determined

00:00:19.039 --> 00:00:23.920
about the final configuration

00:00:22.400 --> 00:00:28.400
but there's a good reason for all of that i've been waiting on some really

00:00:26.400 --> 00:00:33.200
important hardware to continue my testing so right now we've got a problem

00:00:31.279 --> 00:00:39.680
with the current configuration this motherboard can accept a measly

00:00:36.480 --> 00:00:41.680
seven pci express 16x devices i mean

00:00:39.680 --> 00:00:46.879
what kind of chump nonsense is that for a hundred thousand

00:00:44.079 --> 00:00:52.160
dollar computer that i aim to have six video editors editing 8k footage off of

00:00:50.320 --> 00:00:56.879
at the same time so i got in touch with uh actually a

00:00:54.640 --> 00:01:01.359
couple of really special companies one of them is thermaltake who

00:00:59.120 --> 00:01:06.560
sent over a bunch of their pci express extenders i'm going to use these

00:01:04.799 --> 00:01:09.680
to test running a bunch of graphics cards off of this thing without water

00:01:08.000 --> 00:01:13.200
blocking them all up beforehand which is what i did last time

00:01:11.600 --> 00:01:17.520
which was super stupid because then when i had issues it was it was a nightmare

00:01:15.680 --> 00:01:20.720
and this this

00:01:18.720 --> 00:01:25.040
is actually a bunch of boxes from a company called one stop systems who if

00:01:23.280 --> 00:01:28.159
you're not in the enterprise space you've probably never heard of but if

00:01:27.200 --> 00:01:35.680
you are even then you might not have heard of them and they make

00:01:32.159 --> 00:01:38.640
pci express extension solutions

00:01:35.680 --> 00:01:43.280
allowing you to take a single slot and adapt it to in this case

00:01:42.320 --> 00:01:48.640
eight slots how does that work

00:01:46.479 --> 00:01:58.399
well we're gonna find out not cheaply though

00:01:58.399 --> 00:02:02.880
thanks to videoblocks for sponsoring this video they're a great

00:02:01.439 --> 00:02:08.160
subscription-based resource for downloading stock footage video and more

00:02:05.680 --> 00:02:13.280
check out the link below to learn more so the funny thing about these guys was

00:02:10.479 --> 00:02:17.520
when i got in touch with them um the bloke that i spoke with was actually

00:02:15.440 --> 00:02:21.280
a fan of the channel he was like super into working with us and he was like

00:02:19.120 --> 00:02:27.200
yeah let me let me carry this up the chain and then i i spoke with his

00:02:24.239 --> 00:02:31.599
manager and she wasn't as familiar personally but then her husband was

00:02:29.520 --> 00:02:34.879
apparently super into Linus tech tips and she was like okay yeah no you know

00:02:33.360 --> 00:02:38.640
this sounds this sounds great we'd love to work with you and then

00:02:37.200 --> 00:02:43.519
i followed up and they basically said yeah everything's shipped

00:02:41.920 --> 00:02:48.239
but i hadn't actually worked out what i needed or really talked to them about it

00:02:45.280 --> 00:02:51.120
much yet so i'm not a hundred percent sure

00:02:49.280 --> 00:02:55.519
what's here yet so we're gonna find out together

00:02:53.200 --> 00:03:00.239
i did know this board was coming so they've actually got a bunch of

00:02:57.440 --> 00:03:04.640
different pci express expansion products even you can get like chassis that allow

00:03:02.319 --> 00:03:08.640
you to plug something from the back of one computer into the back of another

00:03:07.040 --> 00:03:12.640
one that looks like a computer but it's actually just a box full of pci express

00:03:10.959 --> 00:03:17.599
expansion or you can get a bare bones board which

00:03:16.319 --> 00:03:24.080
it would appear is what they've sent to me but i'm not a

00:03:20.400 --> 00:03:27.200
hundred percent sure how or if

00:03:24.080 --> 00:03:30.640
any of it is going to work so this guy

00:03:27.200 --> 00:03:33.599
right here is their hiv 35 x4 this is a

00:03:30.640 --> 00:03:35.680
pci express x4 2

00:03:34.640 --> 00:03:39.519
cable adapter so this is going to go into our

00:03:38.560 --> 00:03:46.560
system and is going to adapt a pci express slot

00:03:43.680 --> 00:03:50.959
to a cable that we can plug into the back of the system this is pci express

00:03:49.040 --> 00:03:57.040
over a cable i'm not talking like you know Thunderbolt i'm talking pure full

00:03:53.519 --> 00:03:58.480
capability pci express trippy stuff

00:03:57.040 --> 00:04:01.840
right look at this connector

00:04:02.239 --> 00:04:09.280
oh that feels good we're turning the one pci express slot

00:04:06.959 --> 00:04:14.959
on the other end here into one two three four four eight more

00:04:11.840 --> 00:04:18.400
eight more pci express slots five eight

00:04:14.959 --> 00:04:20.079
pin power connectors and a 24 pin what

00:04:18.400 --> 00:04:24.720
are they expecting you to plug into this thing honestly what they're doing

00:04:23.120 --> 00:04:30.240
is not that unusual

00:04:26.960 --> 00:04:32.560
in fact your motherboard you watching

00:04:30.240 --> 00:04:35.520
right now your motherboard probably has similar technology because you're

00:04:34.000 --> 00:04:41.120
probably aware already if you've followed our CPU reviews that especially

00:04:37.919 --> 00:04:43.520
mainstream cpus don't have a ton of pci

00:04:41.120 --> 00:04:46.639
express lanes on them so then how exactly is it that you end up with you

00:04:45.919 --> 00:04:53.040
know four 16x slots and a bunch of PCIe 4x

00:04:50.080 --> 00:04:56.160
slots when your CPU only has like 20 to 24 lanes

00:04:54.400 --> 00:04:59.759
well the way that they do that is using what's called a plx chip so these are

00:04:58.000 --> 00:05:03.759
effectively think of them as kind of like a network switch where you take one

00:05:02.160 --> 00:05:08.880
Ethernet connection and you split it out to eight computers for pci express so

00:05:06.479 --> 00:05:12.080
this is going to be a very high end pci express switcher chip and then you're

00:05:10.720 --> 00:05:17.759
going to find those same kinds of adapters on here so that allows all of

00:05:14.720 --> 00:05:18.880
this traffic to share this one interface

00:05:17.759 --> 00:05:23.680
now to be clear you're not going to be able to connect eight 16x

00:05:21.840 --> 00:05:26.880
graphics cards and get the full performance out of all them at exactly

00:05:25.120 --> 00:05:30.720
the same time but i'm planning to use it for usb 3. something where with six

00:05:29.120 --> 00:05:38.039
editors not everyone's going to be slamming it at exactly the same moment

00:05:33.759 --> 00:05:38.039
so it should work fine

00:05:38.160 --> 00:05:43.759
and just knock on wood till you until your knuckles are raw

00:05:42.880 --> 00:05:49.919
right there was another piece of hardware that i needed to continue my testing so we

00:05:47.360 --> 00:05:54.639
only have a couple of optane pci express ssds in the building so what i wanted

00:05:51.759 --> 00:06:00.160
was to swap out my 750s for these and have a look at what vm performance looks

00:05:56.639 --> 00:06:02.240
like running on optane raid1 the other

00:06:00.160 --> 00:06:07.120
thing i was waiting for cable mods sent over some pci express power

00:06:04.160 --> 00:06:10.160
connectors that i'm going to need to extend the cables for these graphics

00:06:08.960 --> 00:06:15.039
cards that i'm going to be running on extensions

00:06:12.240 --> 00:06:19.039
i just found the most perfect spot for it you guys never would have believed

00:06:17.280 --> 00:06:22.560
that i didn't know exactly what i was doing here so

00:06:20.800 --> 00:06:26.800
i've got the the host adapter installed on the other

00:06:24.400 --> 00:06:31.280
side i throw in a second power supply here and then check this out

00:06:29.360 --> 00:06:36.000
oh no

00:06:33.520 --> 00:06:39.440
now that could work man we'd have to like pull this panel

00:06:37.680 --> 00:06:43.600
off and maybe like laser cut them or something but we could have all our usb

00:06:41.840 --> 00:06:48.240
ports right on the back of the system like that anyway for today though this

00:06:45.680 --> 00:06:53.199
is just this is just a dry dry run i'm going to bring it around the other side

00:06:50.240 --> 00:06:56.960
so with this expansion daughter board we're going to have a total of

00:06:55.360 --> 00:07:02.479
six remaining because i'm going to take up one of the PCIe slots with the host

00:06:58.720 --> 00:07:04.639
card plus eight so that is 14 pci

00:07:02.479 --> 00:07:10.400
express slots plus all the ones that i am adapting

00:07:06.960 --> 00:07:12.639
from the u.2 plugs on the motherboard so

00:07:10.400 --> 00:07:12.639
uh

00:07:13.440 --> 00:07:18.080
is 18 pci express slots

00:07:18.080 --> 00:07:23.280
just the right number creep 100 okay

00:07:21.680 --> 00:07:26.880
let's get our PCIe power

00:07:25.280 --> 00:07:30.160
and then let's hook up some graphics cards here

00:07:28.479 --> 00:07:35.280
shall we we're just gonna do four graphics cards for today so some of the

00:07:32.400 --> 00:07:39.199
editors are gonna get full 16x slots for their graphics cards and others are

00:07:37.199 --> 00:07:43.520
going to be stuck with a little bit less but for the purposes of what we're doing

00:07:41.840 --> 00:07:46.800
that's not going to affect performance in any meaningful way

00:07:45.360 --> 00:07:51.120
so we're just going to pick some random slots here

00:07:48.479 --> 00:07:54.479
and install some gpus baby so those will go there

00:07:53.120 --> 00:07:58.400
sure so that'll go there

00:07:56.840 --> 00:08:02.639
sure yeah um

00:08:00.960 --> 00:08:08.160
i mean is it there does that work is that kind of reasonable we never claimed this video

00:08:06.080 --> 00:08:12.479
wasn't gonna be madness you knew what you were clicking on

00:08:10.840 --> 00:08:15.919
okay leaning tower of titans uh right

00:08:15.120 --> 00:08:19.479
yeah what could go wrong

00:08:27.360 --> 00:08:33.519
oh there we go okay that's one

00:08:31.759 --> 00:08:35.839
i mean should we do a quick test to make sure this even works before we go any

00:08:34.959 --> 00:08:42.479
further yeah okay all right

00:08:38.320 --> 00:08:44.080
all right let's do it is this on

00:08:42.479 --> 00:08:48.160
what the heck oh it turned off

00:08:46.480 --> 00:08:52.160
let's give it one more try because if there's one slot that doesn't like a

00:08:50.160 --> 00:08:55.360
graphics card or something like that being in it that's going to be a big

00:08:53.600 --> 00:09:01.519
problem because i need to fill all of them with graphics cards ee

00:08:59.360 --> 00:09:05.279
you know what i think it might be is our one stop systems expansion card

00:09:03.680 --> 00:09:08.640
because i don't have the power supply plugged into the

00:09:06.800 --> 00:09:12.240
target end of it yet so it might not like something about

00:09:10.720 --> 00:09:16.080
what's going on here so let's try it with just the graphics card so we're not

00:09:13.920 --> 00:09:18.560
changing too many variables at once here there it is

00:09:18.640 --> 00:09:24.000
okay all right so while this is booting up

00:09:22.640 --> 00:09:30.480
we need to go get ourselves another power supply and it can't be like some

00:09:27.360 --> 00:09:31.760
wussy power supply it's got to have

00:09:30.480 --> 00:09:35.360
i got to find out what kind of connectors these are these pci express

00:09:34.000 --> 00:09:39.120
or the uh oh

00:09:37.200 --> 00:09:44.240
oh crap they're not PCIe

00:09:42.080 --> 00:09:49.279
oh man it's gonna be ghetto

00:09:46.399 --> 00:09:53.360
so this is interesting of our five ax 1500 eyes

00:09:51.120 --> 00:09:57.920
i apparently have three of them and then we also have a 1600i that Jake

00:09:55.680 --> 00:10:01.920
apparently has checked out long term what does he what does he need a 1600 on

00:09:59.920 --> 00:10:07.040
his test bench for okay let's go let's go

00:10:03.680 --> 00:10:09.279
get one of the three axis that Jake has

00:10:07.040 --> 00:10:12.240
so i have one on my bench i have one we have like five so yeah so i have one in

00:10:11.519 --> 00:10:18.160
my no no i have one in my rig at home i have one in the desk pc

00:10:16.079 --> 00:10:21.519
why would i not because it's so stupid you're stupid why do you have so much

00:10:19.519 --> 00:10:24.880
crap here can you clean this up i mean it's working out for me right now

00:10:22.959 --> 00:10:27.360
but in general okay

00:10:27.519 --> 00:10:34.000
what did he do can you believe what Jake did to this

00:10:31.760 --> 00:10:37.600
power supply you see this is why this is why i rage out at people for

00:10:36.240 --> 00:10:42.720
like the way that they treat the hardware around here sometimes

00:10:40.000 --> 00:10:45.680
what the whoa

00:10:44.160 --> 00:10:50.560
you say this like you've never seen it before you're literally the only person

00:10:47.519 --> 00:10:50.560
who's ever used it

00:10:51.120 --> 00:10:58.000
and naturally the eps connectors aren't even in here thanks Jake

00:10:56.160 --> 00:11:02.079
should i just fire him let me know in the comments

00:11:00.399 --> 00:11:07.360
new plan Jake did find another 1500i

00:11:05.120 --> 00:11:11.360
so we're just gonna use that this is the beauty of modular power

00:11:08.959 --> 00:11:15.680
supplies because like how else would you have ended up being able to

00:11:13.519 --> 00:11:20.160
frankenstein a regular desktop power supply to power this

00:11:18.800 --> 00:11:26.519
weird board all we got to do is uh

00:11:22.240 --> 00:11:26.519
what the hell is this

00:11:28.399 --> 00:11:35.279
Jake just peel it off well i mean it makes it

00:11:33.200 --> 00:11:40.560
look like there's something wrong with it

00:11:36.800 --> 00:11:43.200
why did you put so much tape on it

00:11:40.560 --> 00:11:43.200
it's fine

00:11:45.360 --> 00:11:51.760
now i have no idea

00:11:48.720 --> 00:11:53.600
what triggers this thing to turn on

00:11:51.760 --> 00:11:57.320
here we go yeah let's get a bit of a better look at whoa

00:12:04.720 --> 00:12:12.000
all right that's all looking peachy

00:12:10.000 --> 00:12:15.600
uh editor don't include that these guys were very gracious to send us this stuff

00:12:14.000 --> 00:12:19.279
and i don't want them to see that the bloke that i spoke with was actually a

00:12:17.519 --> 00:12:24.639
fan of the channel now i do want to know if it's working so

00:12:22.320 --> 00:12:28.160
here why don't we grab our octane drives and throw those on there and see what

00:12:26.000 --> 00:12:31.200
happens obviously with something like a high-speed storage device we're not

00:12:29.680 --> 00:12:33.760
expecting to get our full performance out of it in this kind of a situation

00:12:32.959 --> 00:12:39.440
but i just want to know if it's working at all this is terrifying everything about this

00:12:38.240 --> 00:12:43.839
is wrong let's take a picture for instagram

00:12:41.440 --> 00:12:48.240
there they are there's the optane ssds just like that

00:12:46.480 --> 00:12:52.720
basically plug and play you just have to make sure you actually plug all the

00:12:50.000 --> 00:12:56.320
things may not look like much but she's got it where it counts kid right

00:12:55.040 --> 00:13:00.200
gorgeous so our optane drives are being picked up

00:12:58.639 --> 00:13:04.320
by the os nvme0n1 and

00:13:02.000 --> 00:13:07.519
this is what i really need to know this is going to tell me if this whole thing

00:13:05.680 --> 00:13:12.560
is going to work or not because if i can't pass through the controllers

00:13:09.760 --> 00:13:15.279
individually then there's i'm not going to be able to get everything hot

00:13:14.160 --> 00:13:21.440
pluggable look at all of these plx bridges here

00:13:20.240 --> 00:13:26.079
that is madness

00:13:23.279 --> 00:13:31.120
so the update is mostly bad news there is what's called an acs override

00:13:28.560 --> 00:13:34.399
patch that you can enable to try to break

00:13:32.079 --> 00:13:39.839
individual items that are in a single i o mmu group out into their own iomu

00:13:37.360 --> 00:13:43.600
groups but as far as unraid knows the the code for the patch has been broken

00:13:41.680 --> 00:13:48.320
since Intel sky lake and it doesn't seem to be working here

00:13:46.480 --> 00:13:52.959
obviously this is much newer than sky lake but they have suggested that if we

00:13:50.880 --> 00:13:58.240
shut this baby down pull the card out and put it in a

00:13:54.800 --> 00:13:59.199
haswell or older system and see if that

00:13:58.240 --> 00:14:03.120
works that maybe they could try fixing the

00:14:01.360 --> 00:14:08.000
patch to work on sky lake and then it might work in this system so

00:14:05.360 --> 00:14:11.839
that's our that's our first step here uh

00:14:10.000 --> 00:14:17.199
well we're not running this for very long so we're just gonna

00:14:14.720 --> 00:14:21.839
put that there yeah

00:14:18.399 --> 00:14:24.160
okay yeah that seems pretty stable

00:14:21.839 --> 00:14:30.880
all right so this is where we find out if the hack will potentially work with

00:14:28.320 --> 00:14:33.920
our pci express splitter device one thing that's nice is how plug and play

00:14:32.320 --> 00:14:38.399
this thing's been these ssds are both showing up perfectly just plugged into a

00:14:36.240 --> 00:14:42.240
consumer board so that's pretty cool and honestly we

00:14:40.480 --> 00:14:46.800
should still get some use out of it even if it just means that all of our usb

00:14:44.560 --> 00:14:51.199
cards that we have plugged into it can't be passed through the vms it'll still be

00:14:48.959 --> 00:14:55.760
nice to have all of those ports okay so i can't reach my contact at unread so

00:14:53.199 --> 00:15:00.560
what i'm gonna do then is just throw some usb cards in here and see if

00:14:58.560 --> 00:15:07.199
we can pass one through to something everything continues to get more ghetto

00:15:04.079 --> 00:15:09.120
now we have ssds hanging off here

00:15:07.199 --> 00:15:13.279
aren't they beautiful our renaissas usb controller is showing

00:15:12.240 --> 00:15:20.160
up here that's one of the ones that's plugged into the daughter board but we still

00:15:17.519 --> 00:15:24.880
don't know if the override worked so let's go ahead and let this populate

00:15:22.320 --> 00:15:30.320
remember this doesn't tell us if we can get it working this tells us if maybe

00:15:28.880 --> 00:15:35.760
we could get it working oh

00:15:32.560 --> 00:15:38.160
this looks like a very big group so this

00:15:35.760 --> 00:15:43.760
is all the plx style no they're all in the same group

00:15:41.199 --> 00:15:47.120
damn it okay

00:15:45.600 --> 00:15:52.720
it's not all bad we still get the benefits of using

00:15:50.000 --> 00:15:57.759
a pci express switch for all our usb devices so everything that we do hook up

00:15:56.399 --> 00:16:01.759
will be better managed and the whole thing does

00:15:59.920 --> 00:16:06.560
work really seamlessly i had just really hoped for hot plug

00:16:04.639 --> 00:16:11.160
and it looks like that might be out of my grasp however cool this hardware

00:16:09.440 --> 00:16:12.720
might be

00:16:12.720 --> 00:16:19.279
have you ever needed a beautiful shot of like mountains or wild animals or even

00:16:17.360 --> 00:16:23.199
something like an astronaut in space for your video but you didn't have the time

00:16:21.120 --> 00:16:27.199
or budget to get it yourself well videoblocks has you covered with

00:16:25.199 --> 00:16:34.079
unlimited downloads through their member library that contains over 115

00:16:30.320 --> 00:16:36.320
000 hd and 4k clips along with after

00:16:34.079 --> 00:16:39.279
effects templates motion backgrounds and more

00:16:37.199 --> 00:16:43.199
an additional marketplace for other footage is also available so if you're a

00:16:41.199 --> 00:16:46.480
member you say 40 and you get to support the artists

00:16:44.720 --> 00:16:49.759
because videoblocks doesn't take a single cent all the footage on

00:16:47.920 --> 00:16:53.839
videoblocks is royalty free which means you can keep and use the clip as many

00:16:52.160 --> 00:16:57.600
times as you want forever and new footage gets added regularly so you'll

00:16:55.680 --> 00:17:01.360
always have fresh new content to check out and use get all of this with an

00:16:59.680 --> 00:17:05.600
unlimited member planet videoblocks today at the link below

00:17:03.600 --> 00:17:09.199
so thanks for watching guys hopefully you enjoyed coming along for

00:17:07.520 --> 00:17:13.919
what would normally be like a behind the scenes type of

00:17:11.600 --> 00:17:17.199
troubleshooting for a project like this if you guys disliked this video you can

00:17:15.600 --> 00:17:20.400
hit that button but if you liked it hit like get subscribed maybe consider

00:17:19.120 --> 00:17:26.400
checking out where to buy the stuff we featured at the link in the video description as long as you don't plan to

00:17:23.839 --> 00:17:32.160
use pci passthrough for the individual things you have

00:17:27.839 --> 00:17:34.720
plugged into it for each one of your vms

00:17:32.160 --> 00:17:38.720
just had a new thought wait

00:17:35.919 --> 00:17:44.720
what if every single slot got its own daughter board with the GPU

00:17:42.240 --> 00:17:48.000
and the usb on that okay that's probably a project for

00:17:46.240 --> 00:17:52.240
another day let's just get the video editing working off this one system

00:17:49.760 --> 00:17:55.120
anyway uh subscribe and check out our merch

00:17:53.120 --> 00:17:59.200
and uh we have that linked below and also our forum you should join that