1
00:00:00,000 --> 00:00:08,080
now this is the part where we do six video editors with six

2
00:00:05,520 --> 00:00:12,960
graphics cards but we don't have six graphics cards

3
00:00:09,920 --> 00:00:14,080
i don't know what accent that is

4
00:00:12,960 --> 00:00:19,520
now it's not often around here that we have

5
00:00:16,720 --> 00:00:24,560
a project that's so big we don't even have enough hardware to validate if it's

6
00:00:21,600 --> 00:00:29,359
going to work but that's what six video editors one CPU has been like

7
00:00:26,960 --> 00:00:32,559
but the good news is that even though some of the final hardware isn't quite

8
00:00:31,439 --> 00:00:39,440
here yet we have enough to know for sure if it's

9
00:00:36,079 --> 00:00:41,120
gonna work so we've got all six monitors

10
00:00:39,440 --> 00:00:46,480
and the keyboards and mice that go with them for all of our stations we've got

11
00:00:43,680 --> 00:00:50,239
our pile of high-end graphics cards over here i don't know if you guys can even

12
00:00:47,760 --> 00:00:55,520
see this but i want one per system over here we've got oh this

13
00:00:53,199 --> 00:01:01,520
is really cool where is it ah oh yeah here it is we've got the

14
00:00:57,760 --> 00:01:03,680
replacement for that PCIe 4x interface

15
00:01:01,520 --> 00:01:07,680
to our daughter board so i believe this is either 8x or 16x which means we

16
00:01:06,159 --> 00:01:13,200
shouldn't run into bottlenecks for all of our usb controllers and

17
00:01:11,439 --> 00:01:18,720
we've got Intel optane along with the cards to go

18
00:01:16,000 --> 00:01:22,640
with that and better coolers for our 28 core cpus

19
00:01:21,680 --> 00:01:30,180
so today is the acid test does it actually work

20
00:01:28,479 --> 00:01:34,989
we're going to find out

21
00:01:37,840 --> 00:01:44,079
smart deploy allows it departments to re-image unlimited computer models from

22
00:01:42,159 --> 00:01:47,680
one golden image search their library and grab your exclusive free licenses

23
00:01:46,159 --> 00:01:51,840
worth over six hundred dollars at smartdeploy.com

24
00:01:49,360 --> 00:01:57,600
Linus so first order of business is to kind of reconstruct what's going

25
00:01:55,759 --> 00:02:02,479
on in here because we've had to tear apart a lot of it uh over the last

26
00:02:00,079 --> 00:02:06,799
little while due to other projects like that crazy thing with the four titan v's

27
00:02:04,880 --> 00:02:12,000
and all that nonsense so let's go ahead and get back to a

28
00:02:09,920 --> 00:02:16,879
functioning state and then we will go from there now because a big part of the

29
00:02:14,160 --> 00:02:20,879
goal today is eliminating all of the hypotheticals

30
00:02:18,400 --> 00:02:26,720
we're gonna do away with things like our gigantic split

31
00:02:24,239 --> 00:02:31,520
screen 4-way monitor and we're going to actually set up each workstation

32
00:02:29,440 --> 00:02:35,120
as it is intended to be used with a single monitor and keyboard and mouse

33
00:02:33,760 --> 00:02:38,959
although it should be noted that we could easily run dual monitors since

34
00:02:37,680 --> 00:02:44,720
we're just passing through entire graphics cards i gotta get this passenger here sorry

35
00:02:42,560 --> 00:02:48,640
david we're not quite going back to the

36
00:02:46,480 --> 00:02:52,080
previous state though one thing that we are going to change

37
00:02:50,560 --> 00:02:58,879
is this so now instead of a half height like low

38
00:02:56,400 --> 00:03:01,280
profile card that passes through pci express

39
00:02:59,840 --> 00:03:04,640
4x we have got this

40
00:03:03,360 --> 00:03:09,920
honkin sucka that we're gonna go ahead and uh

41
00:03:07,200 --> 00:03:14,800
i'm not sure which one's the host side and which one is the target side but uh

42
00:03:12,879 --> 00:03:17,920
we're gonna go ahead and install one of them

43
00:03:16,000 --> 00:03:22,560
into here you know what i think it actually has dip switches so that you

44
00:03:20,080 --> 00:03:25,760
can configure it they're both configured the same way

45
00:03:23,920 --> 00:03:28,959
maybe it doesn't uh

46
00:03:27,680 --> 00:03:33,920
so on

47
00:03:30,840 --> 00:03:37,200
on oh my god like it doesn't indicate

48
00:03:33,920 --> 00:03:38,879
what for six just one two four

49
00:03:37,200 --> 00:03:43,599
ah we'll figure it out

50
00:03:40,879 --> 00:03:48,959
okay so i think i figured it out uh these little switches we just need them

51
00:03:45,440 --> 00:03:50,959
in on on off for this guy and then

52
00:03:48,959 --> 00:03:55,680
uh hold on off on on for one two and four

53
00:03:54,720 --> 00:04:03,280
and uh oh okay

54
00:03:59,360 --> 00:04:04,319
but then six is labeled backplane type

55
00:04:03,280 --> 00:04:09,920
what it looks like we are running PCIe 8x

56
00:04:08,720 --> 00:04:18,400
although if we got our hands on another one of these cables we could run 16x

57
00:04:14,879 --> 00:04:20,799
by using uh dual host

58
00:04:18,400 --> 00:04:24,320
i think or something anyway

59
00:04:21,759 --> 00:04:28,800
8x should be enough to start this thing is just ridiculous like this

60
00:04:26,240 --> 00:04:32,080
connector look at it so even compared to the 4x connector we had last time which

61
00:04:30,800 --> 00:04:37,600
looks ba that's the 8x connector this is great i

62
00:04:35,520 --> 00:04:42,800
found the card from last time so instead of this card now we need this card

63
00:04:40,880 --> 00:04:45,600
so it's basically exactly

64
00:04:44,240 --> 00:04:48,240
this doubled up

65
00:04:48,400 --> 00:04:54,800
sheesh now we got to get the other side

66
00:04:51,759 --> 00:04:54,800
installed in our system here

67
00:04:55,120 --> 00:05:01,199
that's the only configurable thing on here let's go ahead and install it

68
00:05:00,000 --> 00:05:07,840
here these are all in

69
00:05:03,280 --> 00:05:07,840
i've got my NVMe drives here

70
00:05:09,600 --> 00:05:15,440
so the next thing i need ah there we go

71
00:05:12,960 --> 00:05:20,400
is the test cart hooked up to the back of the system here

72
00:05:17,919 --> 00:05:24,320
and then while i do that Yvonne is setting up all the stations

73
00:05:22,479 --> 00:05:29,919
with their monitors keyboards and mice though it will be a little bit until

74
00:05:26,960 --> 00:05:33,840
we're actually quite ready for that can i get that big yep

75
00:05:32,080 --> 00:05:38,000
exactly that and i think

76
00:05:36,160 --> 00:05:41,680
we should be ready to fire up the system i hooked up the power button this time

77
00:05:39,520 --> 00:05:44,960
to make my life a little bit easier so i guess we find out if that works right

78
00:05:43,120 --> 00:05:49,840
now uh-oh

79
00:05:47,039 --> 00:05:49,840
oh what the crap

80
00:05:50,479 --> 00:05:56,960
put the motherboard back in without actually hooking the

81
00:05:54,160 --> 00:06:01,360
motherboard power back up woo okay

82
00:05:58,800 --> 00:06:05,440
it's a little better so ridiculous

83
00:06:03,039 --> 00:06:10,960
you have to sign up for an account to get a user manual

84
00:06:07,360 --> 00:06:14,080
for this card and it wasn't working so

85
00:06:10,960 --> 00:06:16,960
fine i'm signed up and here we go

86
00:06:14,080 --> 00:06:22,080
okay i think i did it entirely wrong but i'm not sure why

87
00:06:19,280 --> 00:06:27,120
because their diagram here doesn't actually correspond

88
00:06:24,800 --> 00:06:30,720
to the number of dip switches that's on here

89
00:06:28,080 --> 00:06:34,880
on for one and two off for three and four that is completely different from

90
00:06:32,720 --> 00:06:37,680
what it says here as far as i can tell on

91
00:06:36,000 --> 00:06:42,720
for one and two off for three and four i really hope

92
00:06:40,160 --> 00:06:42,720
this works

93
00:06:44,080 --> 00:06:49,360
so i think it's configured right now what we should see is this fan spin when

94
00:06:47,680 --> 00:06:53,360
i power up and

95
00:06:51,120 --> 00:06:57,919
we got nothing and i don't know why

96
00:06:55,600 --> 00:07:02,160
okay there's another dip for black backplane type and that's just labeled

97
00:06:59,680 --> 00:07:06,319
directly on here so let's try selecting a different backplane type shall we

98
00:07:04,479 --> 00:07:10,160
nothing no power to it at all maybe we have to do the same thing on the other

99
00:07:07,599 --> 00:07:14,000
side wait oh no i turned this off while i was

100
00:07:11,360 --> 00:07:14,000
troubleshooting

101
00:07:14,720 --> 00:07:18,880
this is what happens when you hurry

102
00:07:18,960 --> 00:07:25,360
not that that fixed it okay now hold on a minute i think i get

103
00:07:23,280 --> 00:07:28,960
it oh boy

104
00:07:26,800 --> 00:07:35,680
okay whatever that is probably isn't good stop stop stop stop

105
00:07:32,080 --> 00:07:35,680
okay so off on off on

106
00:07:41,440 --> 00:07:47,039
so whatever mode you're using now you have

107
00:07:44,639 --> 00:07:50,319
to go from the bottom port out into

108
00:07:48,479 --> 00:07:55,280
the top port and it yeah i don't know it's on so uh maybe

109
00:07:54,080 --> 00:08:01,840
it's working there it is they have flashing lights on their slots but they're detected so

110
00:07:59,520 --> 00:08:05,440
presumably they're working uh one way we can tell for sure is just plugging this

111
00:08:03,520 --> 00:08:12,400
mouse into into one of them wait no i think i already have them stubbed

112
00:08:09,759 --> 00:08:14,639
yeah i do okay that that's fine that's fine

113
00:08:14,720 --> 00:08:22,080
oh snap oh crap

114
00:08:19,440 --> 00:08:26,879
oh shoot i just unplugged this uh that's really bad probably

115
00:08:24,639 --> 00:08:30,080
oh shoot oh i hope this still works

116
00:08:32,800 --> 00:08:38,159
don't smell burning it's turning back on and everything

117
00:08:36,000 --> 00:08:42,640
looks normal hopefully that's fine what just happened there so the next stage

118
00:08:40,959 --> 00:08:48,640
assuming that we're still past getting this to work stage

119
00:08:44,399 --> 00:08:48,640
is 10 gig networking for the whole thing

120
00:08:49,360 --> 00:08:54,560
still works that's good

121
00:08:52,880 --> 00:09:00,240
oh there it is we're 10 gig all right now i just just

122
00:08:56,800 --> 00:09:02,480
need to copy our install images off or

123
00:09:00,240 --> 00:09:07,640
at least one of them because it's time for us to put optane in

124
00:09:08,160 --> 00:09:14,640
that's how everyone does it that's industry standard

125
00:09:12,160 --> 00:09:20,800
so i actually only had five usb cards in here before i found another one that

126
00:09:16,720 --> 00:09:20,800
gives us the full complement of six

127
00:09:20,839 --> 00:09:28,959
and it's happening i'm swapping out these peasant

128
00:09:26,080 --> 00:09:34,000
750 series drives for optane the reason we care about

129
00:09:31,920 --> 00:09:39,600
running optane for our boot drives is that these handle random i o much better

130
00:09:37,360 --> 00:09:43,360
than traditional ssds and when we're going to have six operating systems

131
00:09:41,360 --> 00:09:47,920
running off them at the same time that becomes really important

132
00:09:45,760 --> 00:09:51,600
oh shoot i totally forgot i got to put all the graphics cards in

133
00:09:50,000 --> 00:09:57,360
let's see x little p

134
00:09:53,920 --> 00:09:59,120
titan x okay so titan x titan xp 1060

135
00:09:57,360 --> 00:10:02,480
1070 and

136
00:10:00,800 --> 00:10:08,240
maybe we'll put another quadro in there i don't know now we've yet to actually boot

137
00:10:06,320 --> 00:10:12,560
this motherboard with six graphics cards

138
00:10:10,560 --> 00:10:18,200
so we're in uncharted territory right now this could be the thing that kills

139
00:10:14,640 --> 00:10:18,200
the entire project

140
00:10:18,480 --> 00:10:24,000
let's do that one so jank

141
00:10:24,720 --> 00:10:28,160
jankness is real

142
00:10:31,279 --> 00:10:37,760
all right let's throw that on there okay

143
00:10:34,959 --> 00:10:40,480
this last card is our jankiest

144
00:10:39,120 --> 00:10:44,160
i think it's gonna have to kind of hang out right there

145
00:10:42,800 --> 00:10:49,519
okay should be fine

146
00:10:46,640 --> 00:10:49,519
now we fire it up

147
00:10:51,279 --> 00:10:55,440
and we have a display out so that's a good sign

148
00:10:55,920 --> 00:11:02,399
that's not a good sign i know we're asking for a lot here

149
00:11:00,240 --> 00:11:05,279
motherboard but if you could come through for me

150
00:11:07,519 --> 00:11:14,800
what the hell i don't think i have ever heard a

151
00:11:11,200 --> 00:11:18,480
hardcore sounding error code like that

152
00:11:14,800 --> 00:11:19,839
followed by the system just booting

153
00:11:18,480 --> 00:11:25,279
oh in order to display this message some

154
00:11:21,600 --> 00:11:26,959
pci devices were set to a disabled state

155
00:11:25,279 --> 00:11:30,480
oh maybe above 4g decoding will solve this

156
00:11:29,120 --> 00:11:35,760
problem okay let's see if above 4g decoding is going

157
00:11:33,279 --> 00:11:38,959
to help us boom there it is i think we're booting

158
00:11:38,160 --> 00:11:47,760
now did it just turn off now why didn't it pick up my boot device

159
00:11:44,800 --> 00:11:53,680
well that's interesting our usb key is just not even in here anymore

160
00:11:51,040 --> 00:11:58,079
okay so uh the only thing i changed was disabling the boot option rom from all

161
00:11:56,160 --> 00:12:02,720
of our pci express devices which i can't imagine mattered and then i moved our

162
00:12:00,399 --> 00:12:06,800
usb boot device into a different usb port i wonder if one of our onboard usb

163
00:12:04,800 --> 00:12:10,399
controllers isn't working because now it's showing up although maybe it

164
00:12:08,480 --> 00:12:15,760
was just a fluke last time i i don't know so it's here now

165
00:12:13,680 --> 00:12:18,480
let's see all right

166
00:12:16,959 --> 00:12:22,399
so now we're going optane on our cache

167
00:12:22,720 --> 00:12:28,880
and starting the array there's our titan xp

168
00:12:26,480 --> 00:12:35,120
there's our titan there's our gtx 1060

169
00:12:31,920 --> 00:12:37,040
there's our quadro gv100

170
00:12:35,120 --> 00:12:40,959
there's another one and there's our 1070. all six graphics

171
00:12:39,920 --> 00:12:47,440
cards are here and

172
00:12:43,440 --> 00:12:49,839
six usb controllers at least

173
00:12:47,440 --> 00:12:53,920
beautiful and there's our 10 gig card i think we've got everything we need here

174
00:12:52,160 --> 00:13:00,560
i should go duban show so update time lancho is now complete

175
00:12:57,279 --> 00:13:02,639
and we can start to dig in and make sure

176
00:13:00,560 --> 00:13:08,800
everything's working the way we expected now i still only have my four vms set up

177
00:13:06,560 --> 00:13:15,760
from the last test but this is as simple as making some

178
00:13:12,279 --> 00:13:18,160
reconfigurations to the CPU assignments

179
00:13:15,760 --> 00:13:21,440
the GPU assignments and the usb card assignments and bippity boppity we

180
00:13:19,839 --> 00:13:25,200
should be off to the races so theoretically

181
00:13:23,040 --> 00:13:28,320
we are going to just fire this bad boy up

182
00:13:27,040 --> 00:13:32,240
and and go now once we know everything's

183
00:13:30,560 --> 00:13:34,480
working and it's time to performance optimize we're going to want to do

184
00:13:33,600 --> 00:13:41,760
things like make sure that none of the vms have

185
00:13:37,360 --> 00:13:43,440
CPU cores that cross from one CPU socket

186
00:13:41,760 --> 00:13:47,920
to another because then we're going to take a performance hit there and we're

187
00:13:46,240 --> 00:13:51,600
also going to want to make sure that every vm

188
00:13:49,279 --> 00:13:57,440
has a graphics card that's in a slot that is actually also directly connected

189
00:13:54,480 --> 00:14:01,970
to the CPU that those cores are physically present on that's going to be

190
00:13:59,600 --> 00:14:07,440
really important

191
00:14:07,440 --> 00:14:12,399
i think i might have bumped that stupid cable again

192
00:14:10,720 --> 00:14:16,560
the whole system we started when i bumped that external pci express cable

193
00:14:15,040 --> 00:14:19,680
well i don't think it's because i bumped the cable i think it's because i don't

194
00:14:18,240 --> 00:14:23,920
really have the cards screwed in

195
00:14:22,399 --> 00:14:28,959
okay well while we wait for that we can do the

196
00:14:26,800 --> 00:14:31,600
uh totally safe

197
00:14:30,639 --> 00:14:35,199
um plugging in of display cables

198
00:14:34,399 --> 00:14:40,880
so oh can i just take a moment to point out

199
00:14:38,480 --> 00:14:45,079
how good i am at plugging in monitor cables without looking

200
00:14:45,279 --> 00:14:51,519
that no scope monitor plugging in david can i get an HDMI cable from down

201
00:14:50,240 --> 00:14:55,920
there sorry it's just hard for me to get down

202
00:14:53,440 --> 00:14:55,920
it's all good

203
00:14:56,720 --> 00:15:03,600
do you ever just like picture the engineers at Intel and NVIDIA

204
00:15:00,880 --> 00:15:06,800
watching something like this oh

205
00:15:04,560 --> 00:15:10,880
okay let's make sure all of our usb doodads are still in here

206
00:15:08,639 --> 00:15:15,680
one two three and four are up number five's not

207
00:15:12,959 --> 00:15:19,760
not doing anything did that one fail

208
00:15:17,600 --> 00:15:24,560
execution error could not find device all right

209
00:15:22,399 --> 00:15:28,320
we're just gonna do yield reboot and reseed all that stuff

210
00:15:26,560 --> 00:15:32,320
crap now let's try

211
00:15:30,399 --> 00:15:35,920
firing this up again and it should be fine so i think what happened was the

212
00:15:33,839 --> 00:15:40,399
usb controller for this one uh disconnected from the system

213
00:15:38,800 --> 00:15:44,320
when i bumped the cable and then the one for this one took the

214
00:15:42,560 --> 00:15:49,040
fifth slot so neither of them was able to start also

215
00:15:46,480 --> 00:15:54,399
what we can do now is we can come around here and see if

216
00:15:51,839 --> 00:15:58,399
any of these monitors are lighting up this one just turned blue

217
00:15:56,800 --> 00:16:02,880
so i think that means it's about to light up

218
00:16:00,480 --> 00:16:05,360
hey there we go there's one okay we got

219
00:16:04,320 --> 00:16:11,680
hey one this is not working

220
00:16:10,399 --> 00:16:16,320
uh do you want to let me know when you see a a pop-up over there

221
00:16:15,040 --> 00:16:19,600
on the like i'm going to plug in a mouse

222
00:16:20,240 --> 00:16:26,800
oh that's it yeah now we should be able to figure out which vm is supposed to be

223
00:16:25,040 --> 00:16:32,560
on all of the other monitors here theoretically this is ws1 but my display

224
00:16:29,279 --> 00:16:32,560
isn't lit up so

225
00:16:33,040 --> 00:16:39,839
what i'm hoping is that i'll like move the mouse and it will wake up

226
00:16:41,199 --> 00:16:46,320
honestly i don't even know what's going on right now

227
00:16:44,399 --> 00:16:48,880
also the name of this didn't change what is going on here

228
00:16:47,839 --> 00:16:51,839
yo hey

229
00:16:52,800 --> 00:16:59,279
wake up like this one just went from having a

230
00:16:57,120 --> 00:17:04,160
blue light to having no signal and a yellow light as i'm shutting down vms so

231
00:17:02,000 --> 00:17:09,360
what we can do in the meantime i guess is uh unraid has a new version or two

232
00:17:07,439 --> 00:17:15,039
actually since uh i installed this so why don't we update

233
00:17:12,240 --> 00:17:20,319
that and see if everything magically resolves itself the

234
00:17:17,439 --> 00:17:24,160
plot thickens now that we're rebooting the system to

235
00:17:21,919 --> 00:17:27,039
apply our update we have power to this keyboard

236
00:17:25,360 --> 00:17:31,280
my level of pissed off right now is pretty high

237
00:17:28,559 --> 00:17:34,240
now i've seen monitors that have a bit of a hard time

238
00:17:34,559 --> 00:17:41,280
picking up signals i have a hard time believing that

239
00:17:39,440 --> 00:17:44,840
six monitors here all have the same problem but i just say

240
00:17:43,760 --> 00:17:51,039
no signal so my theory

241
00:17:48,000 --> 00:17:52,400
about those cards being in order

242
00:17:51,039 --> 00:17:54,680
whenever it works we're going to label it as quickly as we

243
00:17:54,080 --> 00:17:58,880
can yeah

244
00:17:57,360 --> 00:18:01,840
all right next up

245
00:18:01,919 --> 00:18:08,320
is this guy that's not what i was expecting

246
00:18:06,080 --> 00:18:11,840
so this is the 1060. which one is that

247
00:18:10,640 --> 00:18:16,400
who knows so the little game we're playing is

248
00:18:14,000 --> 00:18:20,240
called find the patterns and so far the only one that has managed a successful

249
00:18:19,120 --> 00:18:25,600
reboot is number five i believe

250
00:18:23,440 --> 00:18:30,640
that's the one that i assigned the sound card to

251
00:18:28,799 --> 00:18:35,200
wouldn't that be funny okay that's actually booting there's four so

252
00:18:33,840 --> 00:18:39,360
it lit up but has not actually managed to start

253
00:18:36,960 --> 00:18:44,799
loading Windows yet oh there it goes now one thing john from unraid suggested

254
00:18:42,480 --> 00:18:48,720
was that we ended up screwing up where our v disks were some of them are on the

255
00:18:46,640 --> 00:18:52,880
array and some of them are on the cache and he had said he's run into some weird

256
00:18:50,559 --> 00:18:56,960
i o bottlenecking nonsense with the way that storage devices are virtualized

257
00:18:55,120 --> 00:19:00,160
that might be explaining some of the finicky behavior

258
00:18:58,720 --> 00:19:04,160
so we need to make sure all of those are on the octane drives

259
00:19:01,760 --> 00:19:09,440
number five came up so this one's now consistent which is good to see

260
00:19:06,320 --> 00:19:12,240
this is getting very interesting

261
00:19:09,440 --> 00:19:16,720
so six and two are the ones we haven't seen yet

262
00:19:13,360 --> 00:19:18,000
so everything that we've had working so

263
00:19:16,720 --> 00:19:23,600
far is working right now

264
00:19:21,280 --> 00:19:27,840
is six gonna light up for me so six should be this one theoretically

265
00:19:26,240 --> 00:19:32,640
all right so let's try moving those v discs and

266
00:19:29,919 --> 00:19:36,960
see if that solves it yeah neither of those are coming up okay

267
00:19:35,360 --> 00:19:41,520
okay we have some material to work with here i'm gonna shut her down for now

268
00:19:39,360 --> 00:19:45,280
pia hides your true ip address and allows you to bypass geo restrictions

269
00:19:43,360 --> 00:19:50,160
and censorship by making you appear as though you're connecting from somewhere

270
00:19:47,039 --> 00:19:52,320
else and you can use up to five devices

271
00:19:50,160 --> 00:19:56,240
at once it also helps prevent attacks by blocking unwanted connections it

272
00:19:54,000 --> 00:19:59,679
autoblocks all traffic if the vpn disconnects and it keeps your data out

273
00:19:58,000 --> 00:20:04,080
of the hands of advertisers and other activity tracking snoops so go try it

274
00:20:02,320 --> 00:20:10,559
out at the link in the video description today it's affordable and it works

275
00:20:10,559 --> 00:20:18,370
you bet you might as well eat some for a bit

276
00:20:15,039 --> 00:20:23,510
like don't don't die over this project