1
00:00:00,000 --> 00:00:09,780
we're at the super micro booth at cs2023 and this bad girl right here is the

2
00:00:04,940 --> 00:00:12,300
sys751 g-e-t-n-r-t an 80 000 AI

3
00:00:09,780 --> 00:00:16,320
supercomputer designed to go in your house no seriously people are asking for

4
00:00:14,400 --> 00:00:21,060
this and trust me I have the same reaction but hear me out the world is

5
00:00:18,779 --> 00:00:25,380
changing for perspective every workstation that super micro now sells

6
00:00:23,039 --> 00:00:28,680
is actually purpose built to support Ai and machine learning and bundle that

7
00:00:26,939 --> 00:00:33,480
with a global shift to working from home and you end up with demand for top tier

8
00:00:31,260 --> 00:00:38,460
AI Hardware like this the type of stuff that draws thousands of watts of power

9
00:00:35,520 --> 00:00:45,180
that's somehow quiet enough to be under your desk at home like seriously where's

10
00:00:41,879 --> 00:00:48,480
the power button oh I missed it

11
00:00:45,180 --> 00:00:51,300
it's on that's how loud it is and this

12
00:00:48,480 --> 00:00:56,219
is how a radiator quite literally almost the size of an Xbox series X holy

13
00:00:56,579 --> 00:01:02,879
but not as holy or as is this segue to our sponsor thanks to Acer for

14
00:01:00,899 --> 00:01:06,720
sponsoring this video Acer's pushing the limits of 3D gaming with their new 3D

15
00:01:04,680 --> 00:01:10,280
Ultra mode and spatial Labs true game so stay to the end of the video to find out

16
00:01:08,040 --> 00:01:10,280
more

17
00:01:17,180 --> 00:01:24,540
man I can't get over how big this radiator is seriously when we got that

18
00:01:22,020 --> 00:01:28,380
press email about this I was like ah just a workstation but look at this

19
00:01:26,640 --> 00:01:32,700
radiator and I can't wait to show you the rest of the water plate but for now

20
00:01:30,060 --> 00:01:36,479
let's make this back into a complete system of course since this system is

21
00:01:34,500 --> 00:01:40,860
meant to go you know at someone's house or in a lab under the desk the form

22
00:01:38,579 --> 00:01:43,860
factor is a talent now it is still rack mountable you can pull off the top here

23
00:01:42,360 --> 00:01:47,100
and the feet at the bottom and rack mount it but the intended purpose is a

24
00:01:45,659 --> 00:01:51,240
tower so up front you're going to see things that are like a workstation we

25
00:01:49,020 --> 00:01:55,140
got headphone jack microphone Jack kind of standard things I don't know if you

26
00:01:53,100 --> 00:01:59,579
would you know have Windows on this and do your Microsoft team calls on a on an

27
00:01:57,540 --> 00:02:04,500
AI super computer like this but you could if you wanted to there's also two

28
00:02:01,439 --> 00:02:08,160
USB ports and one of the stars of the

29
00:02:04,500 --> 00:02:10,020
show the eight Gen 5 NVMe slots all of

30
00:02:08,160 --> 00:02:12,780
them are full speed you can see our boot drive right here what is this nothing

31
00:02:11,280 --> 00:02:16,260
exciting it's just a two terabyte boot drive but you could put up to

32
00:02:14,459 --> 00:02:20,700
theoretically if you put 30 terabyte drives

33
00:02:17,480 --> 00:02:22,800
240 terabytes of storage in this system

34
00:02:20,700 --> 00:02:26,520
and that's before we even get to any of the other cool Hardware now of course

35
00:02:24,360 --> 00:02:30,000
the best thing up front is the power button because you turn this thing on

36
00:02:28,020 --> 00:02:35,640
it's like it barely makes noise this computer has

37
00:02:33,360 --> 00:02:40,319
two 2 000 watt power supplies in it that's the type of heat we're dealing

38
00:02:37,260 --> 00:02:42,180
with and it barely makes noise now some

39
00:02:40,319 --> 00:02:46,260
of you are probably saying well you know it's not doing anything yet but they had

40
00:02:44,459 --> 00:02:52,260
it when we walked in here loaded with I think a 1500 watt load or so still the

41
00:02:49,620 --> 00:02:55,760
exact same noise level oh there's peels in here that haven't even peeled

42
00:02:58,200 --> 00:03:04,260
remove film before use nobody read that it never gets old

43
00:03:02,640 --> 00:03:08,400
peeling plastic off ten thousand dollar graphics cards let alone four of them

44
00:03:06,239 --> 00:03:12,360
now we'll talk about those later I think the star of the show here is actually

45
00:03:10,200 --> 00:03:15,540
the CPUs now this isn't an AMD based system this is Intel

46
00:03:13,800 --> 00:03:20,159
um despite AMD having really really awesome server stuff it's still only

47
00:03:17,580 --> 00:03:23,879
about 30 of the market share so 70 of the systems they're selling are still

48
00:03:21,360 --> 00:03:28,260
Intel based this is sapphire Rapids it's actually just come out after God it's

49
00:03:26,640 --> 00:03:33,120
been like two years of DeLay So this system fully specced out could be up to

50
00:03:29,879 --> 00:03:35,220
256 core processors or 350 watts per

51
00:03:33,120 --> 00:03:38,700
socket serious amount of power for memory there's eight sticks per socket

52
00:03:36,840 --> 00:03:42,840
and while Sapphire Rapids can do up to 16 or two dims per channel it's kind of

53
00:03:41,280 --> 00:03:46,799
hard to fit it in a configuration like this well you'll see in a lot of dual

54
00:03:44,340 --> 00:03:49,739
socket servers is the CPUs kind of in the front or they'll be in a

55
00:03:48,180 --> 00:03:54,180
configuration where they're staggered slightly now this is important primarily

56
00:03:52,140 --> 00:03:58,140
for airflow yeah if you were to have both of the sockets like this in an air

57
00:03:55,799 --> 00:04:01,739
cooled system the second CPU here is just going to be getting a straight hot

58
00:03:59,940 --> 00:04:06,420
air which you don't really want since this is water cooled it doesn't matter

59
00:04:03,239 --> 00:04:08,220
now it's also weird I've never seen a

60
00:04:06,420 --> 00:04:12,959
system like this where the sockets are in between the graphics cards especially

61
00:04:10,860 --> 00:04:16,979
in this configuration now there is an important reason for this because the

62
00:04:14,760 --> 00:04:21,359
system is PCIe Gen 5 the actual Lane length the physical traces on the

63
00:04:19,199 --> 00:04:25,620
motherboard the length of those is very important the longer you go the harder

64
00:04:23,820 --> 00:04:29,699
it is to run that sort of frequency as PCIe Generations get faster and faster

65
00:04:28,080 --> 00:04:32,820
it's just going to keep getting harder and harder a lot of boards from other

66
00:04:31,380 --> 00:04:38,400
manufacturers will use something called a retimer which is basically just like a

67
00:04:35,040 --> 00:04:40,020
a signal booster but super micro doesn't

68
00:04:38,400 --> 00:04:43,259
use that and because they position the sockets like this they can make those

69
00:04:41,460 --> 00:04:47,940
physical traces on the board from the PCIe slot to the CPU super short which

70
00:04:46,020 --> 00:04:52,020
makes it a lot easier to run speeds like that and you don't have to use retimers

71
00:04:49,800 --> 00:04:55,320
now since the CPUs and the gpus are water cooled naturally the next thing

72
00:04:54,180 --> 00:05:00,780
you're wondering is what else are they going to water cool and apparently on the next version of the system they're

73
00:04:58,620 --> 00:05:04,440
going to water cool the dims I mean it's not doing anything right now they don't

74
00:05:02,400 --> 00:05:10,020
feel particularly hot and there is a good amount of airflow but I guess the

75
00:05:07,800 --> 00:05:13,919
more dense the dims get you can use up to 256 gig dimms which in the full

76
00:05:12,180 --> 00:05:18,660
configuration is two terabytes per socket um

77
00:05:15,720 --> 00:05:21,840
probably a bit more heat than this do you think they get mad if I took one

78
00:05:20,100 --> 00:05:26,240
of the graphics cards out yes they like us I think I'm just gonna do it what's

79
00:05:23,460 --> 00:05:30,120
the worst that could happen going to jail you took a graphics card

80
00:05:28,320 --> 00:05:33,960
out oh there's actually locks on these whoa weird I guess because this is a

81
00:05:32,400 --> 00:05:37,680
workstation um there is PCI e-locks if you look on

82
00:05:36,060 --> 00:05:40,759
servers most of the time they don't have it oh

83
00:05:42,720 --> 00:05:53,120
I think that might be about as far as I can get it to come out oh wait look

84
00:05:47,960 --> 00:05:53,120
oh more people oh wow there's more

85
00:05:53,639 --> 00:05:58,860
whoa weird I didn't even realize he's actually used the new 12 pin connectors

86
00:05:56,940 --> 00:06:02,400
I wonder if they've had any that have caught on fire well regardless of taking

87
00:06:00,539 --> 00:06:06,419
it out or not these gpus are NVIDIA's a100 80 gig cards which aren't the

88
00:06:04,979 --> 00:06:10,919
latest generation what you probably get with a system like this are h100s the

89
00:06:08,759 --> 00:06:15,780
new architecture but they don't really have a stock yet so this is just for

90
00:06:13,620 --> 00:06:21,240
show a100s they look very similar the idea is the same now they're PCIe based

91
00:06:18,240 --> 00:06:22,740
so they're not the crazy sxm cards but

92
00:06:21,240 --> 00:06:26,940
they are water cooled which is crazy look at the end each of them has quick

93
00:06:24,600 --> 00:06:30,300
disconnects I wonder if I can get one of them off

94
00:06:28,319 --> 00:06:34,979
I don't know I don't know how these quick disconnects disconnect oh wow

95
00:06:32,580 --> 00:06:40,259
that's so easy look at that these quick disconnects are

96
00:06:37,259 --> 00:06:41,759
super nice and so easy to use

97
00:06:40,259 --> 00:06:45,479
and they don't leak at all some of the ones I've seen you pop it out and like a

98
00:06:43,680 --> 00:06:48,539
couple drops come out nothing came out of this one at all

99
00:06:46,740 --> 00:06:53,639
I guess which matters in a server now the reason they'd be on quick disconnects is so you can take a GP out

100
00:06:51,600 --> 00:06:56,220
to swap or if you wanted to upgrade the system down the road it'll be a lot

101
00:06:54,720 --> 00:07:01,020
easier than trying to drain the whole Loop change the cards

102
00:06:58,440 --> 00:07:06,840
nobody wants to do that not all RAM sticks are made equally these ones

103
00:07:03,419 --> 00:07:10,020
so satisfying just listen

104
00:07:06,840 --> 00:07:11,460
oh that is wonderful the power

105
00:07:10,020 --> 00:07:18,780
distribution in this system is very weird we'll see more of it on the other side but each of the graphics cards and

106
00:07:15,180 --> 00:07:20,759
I think the CPU don't see how it

107
00:07:18,780 --> 00:07:24,660
connects to the CPU do you see the power connector anyway oh it's down there oh

108
00:07:23,099 --> 00:07:30,000
interesting okay I get it now there's a PCB inside

109
00:07:27,599 --> 00:07:33,300
of here with big Power contacts there's a big connector that's plugging into the

110
00:07:31,500 --> 00:07:38,819
motherboard in the bottom corner and then each of the gpus comes off of this

111
00:07:35,880 --> 00:07:42,720
part of that board up and over so it's all directly connected to here and then

112
00:07:41,280 --> 00:07:46,919
just little cables to each of the components but only the graphics cards I

113
00:07:44,819 --> 00:07:51,539
guess it's very like kind of elegant solution I'm kind of surprised cool

114
00:07:49,440 --> 00:07:56,580
there's also more PCIe slots there's one extra one here and another two down here

115
00:07:53,699 --> 00:08:03,000
and all seven of them total run at PCIe Gen 5 16x which is an obnoxious amount

116
00:08:00,360 --> 00:08:09,240
of PCIe throughput so you could run a 400 gig Nick 200 gig nics whatever you

117
00:08:05,699 --> 00:08:11,340
want a cxl module it is a lot an

118
00:08:09,240 --> 00:08:14,880
absolutely Monumental amount of i o especially considering you're gonna put

119
00:08:13,620 --> 00:08:18,660
this at your house the only other really cool things on

120
00:08:16,919 --> 00:08:23,879
this side of course the radiator which we talked about before it's absolutely

121
00:08:21,000 --> 00:08:27,900
massive and of course to feed a radiator like that they have some pretty thick

122
00:08:25,319 --> 00:08:31,740
fans as well they're not crazy like you would expect I mean given

123
00:08:30,300 --> 00:08:37,620
that it's quiet it makes sense but they're only 12 volt 0.96 amp fans

124
00:08:35,279 --> 00:08:42,959
they're 12 watt fans usually systems like this they're like I got my 120 watt

125
00:08:40,260 --> 00:08:48,899
fan sounds like a jet taking off this this is not that but the craziest thing

126
00:08:46,260 --> 00:08:52,560
is this looks so cool on this side the other side of this system looks pretty

127
00:08:50,640 --> 00:08:57,120
much just as cool I don't know if I can move it myself but

128
00:08:54,839 --> 00:09:03,899
it's apparently 98 pounds or something like that oh my God there's the lines

129
00:09:00,720 --> 00:09:05,700
from the rad up to the reservoir up here

130
00:09:03,899 --> 00:09:10,140
um and then it goes from Reservoir to pumps pumps to this big manifold and off

131
00:09:08,760 --> 00:09:12,959
to everything now the manifold's super cool you got quick disconnects here as

132
00:09:12,060 --> 00:09:18,000
well so you can pop tubes off just like that

133
00:09:15,540 --> 00:09:22,200
some of them are hard lined like this is this is like a soldered connection I

134
00:09:19,860 --> 00:09:25,740
imagine that's probably for the CPU they don't expect people to be taking CPU

135
00:09:23,820 --> 00:09:28,260
blocks off like you would a graphics card

136
00:09:27,000 --> 00:09:32,040
but if you want to pull the graphics around

137
00:09:30,300 --> 00:09:38,100
a little like so easy look at that it's all

138
00:09:35,880 --> 00:09:41,000
disconnected I'm just gonna put it back on

139
00:09:41,399 --> 00:09:44,660
oh you hear that click

140
00:09:44,779 --> 00:09:51,720
the crazy thing is look at these pumps they look like something you would buy

141
00:09:48,540 --> 00:09:54,360
on like Alibaba for for two dollars like

142
00:09:51,720 --> 00:09:58,380
this is a a wish water cooling episode but apparently they're really strong

143
00:09:56,399 --> 00:10:03,480
really durable pumps and I guess if we turn it on when I turn it on they're not

144
00:10:00,720 --> 00:10:06,899
super loud either which is nice um I don't even know if they're Peter no

145
00:10:05,160 --> 00:10:10,980
they are pwm they got I got four pins each they're just

146
00:10:09,120 --> 00:10:13,980
they don't look like they belong in this system there is two of them of course so

147
00:10:12,540 --> 00:10:17,880
that's going to give you redundant flow and also more flow if one of the pumps

148
00:10:15,899 --> 00:10:20,820
were to die you'd still have the one pump going of course the system's ipmi

149
00:10:19,680 --> 00:10:24,500
would let you know that the pumps aren't running it's just

150
00:10:23,040 --> 00:10:30,000
it's really nice I love the manifold too I think we saw a

151
00:10:27,600 --> 00:10:33,779
similar thing in like the the EK fluid work system it's nice that it's mounted

152
00:10:32,339 --> 00:10:36,959
behind and kind of out of the way it keeps it very clean and easily

153
00:10:35,820 --> 00:10:41,160
serviceable the other cool thing down here look at

154
00:10:38,820 --> 00:10:45,120
this you never get to see this stuff usually the power supply is in a server

155
00:10:43,380 --> 00:10:48,000
are plugged directly into the motherboard and all of the Power kind of

156
00:10:46,920 --> 00:10:56,880
comes off there there's a bunch of cables in the way so you don't really get to see it this is just the like bare

157
00:10:53,040 --> 00:10:59,579
contacts that's that's 4 000 watts of 12

158
00:10:56,880 --> 00:11:05,700
volt power right there that's why it's so freaking thick look at the bars on

159
00:11:03,120 --> 00:11:09,420
here this is crazy you can also see where the contacts are to pass through

160
00:11:07,980 --> 00:11:13,200
to that board on the other side we were talking about there's probably sort of

161
00:11:11,339 --> 00:11:17,700
like a socketed connection and they go together so it's easily serviceable this

162
00:11:15,360 --> 00:11:24,060
system completely specked out dual 56 cores four terabytes of RAM quad gpus is

163
00:11:21,779 --> 00:11:28,260
around eighty thousand dollars the dgx that it's going to compare to is two

164
00:11:26,220 --> 00:11:33,420
hundred thousand dollars and they charge you like ten thousand dollars a year

165
00:11:29,700 --> 00:11:36,300
just for for service contracts

166
00:11:33,420 --> 00:11:41,279
crazy and that system only has a single power supply it's not even redundant

167
00:11:37,680 --> 00:11:43,800
power this one is redundant power if you

168
00:11:41,279 --> 00:11:48,720
have 240 volt power it'll do 2200 Watts if you only have 220 volt it'll do 2100

169
00:11:46,079 --> 00:11:53,519
Watts so pretty serious power supplies and they're so quiet usually power

170
00:11:51,300 --> 00:11:58,320
supplies like this are crazy but since super micro manufactures them in-house

171
00:11:55,399 --> 00:12:01,019
they can control you know this is the chassis it's going to be in we know

172
00:11:59,579 --> 00:12:04,079
exactly how much cooling it's going to need and they can make it quiet I guess

173
00:12:02,820 --> 00:12:07,980
we should take a look at the back I haven't really looked at it too much they did tell me that the reservoir

174
00:12:07,019 --> 00:12:13,200
despite these being like quick disconnect fittings they're not for hooking up to like a central water

175
00:12:11,279 --> 00:12:16,800
supply it's just for filling and draining you can actually see the

176
00:12:15,000 --> 00:12:21,600
coolant in there it's like red it looks like rusty water I'm sure it's just like

177
00:12:19,260 --> 00:12:24,779
some sort of you know anti-corrosion inhibitor sort of thing there's two

178
00:12:23,519 --> 00:12:28,200
little sights you can see the coolant level and there is a cap there I'm not

179
00:12:27,120 --> 00:12:33,540
going to open it because I don't want to make a huge mess the i o I believe this

180
00:12:31,620 --> 00:12:37,260
board is dual 10 gig at the back one port for management there's actually

181
00:12:34,680 --> 00:12:41,760
type c that's kind of cool three USB type A ports VGA and serial and of

182
00:12:40,560 --> 00:12:45,360
course since these graphics cards are like AI accelerators there's no display

183
00:12:43,560 --> 00:12:48,480
output on them that's pretty much it I mean if you wanted to add more i o if

184
00:12:47,040 --> 00:12:52,800
this was actually a workstation you're going to run Windows on this thing you

185
00:12:50,220 --> 00:12:57,060
could put a USB card or like a sound card back here if you really wanted I

186
00:12:55,079 --> 00:13:01,800
don't know if anyone's making a Gen 5 USB card but it would be kind of silly

187
00:12:59,880 --> 00:13:05,880
if they did we got the system booted up now in Ubuntu and we're running a GPU

188
00:13:03,660 --> 00:13:09,420
load it's like a python AI script and all of the gpus are loaded which is

189
00:13:07,260 --> 00:13:15,540
going to put it at about a thousand watt load right now does it sound any louder

190
00:13:12,300 --> 00:13:18,000
than it did before I feel the heat

191
00:13:15,540 --> 00:13:20,360
but it sounds literally exactly the same as before

192
00:13:22,860 --> 00:13:29,639
how quiet this thing is I mean it's large but still

193
00:13:27,600 --> 00:13:35,160
hold the fans it's it's on a little bit more now overall this is seriously just

194
00:13:32,880 --> 00:13:39,060
kind of a mind-boggling computer I just I can't wrap my head around the fact

195
00:13:36,839 --> 00:13:42,180
that people are actually asking them for this they told me this is like one of

196
00:13:40,440 --> 00:13:46,920
the one of the larger requests that companies have been asking them for they

197
00:13:43,740 --> 00:13:48,180
want a dgx clone that's way cheaper and

198
00:13:46,920 --> 00:13:52,019
one that people could have at their house I guess there's Engineers that are important enough to have a hundred

199
00:13:50,820 --> 00:13:55,320
thousand dollar computer at their house I mean I guess there's equipment that's

200
00:13:54,060 --> 00:14:00,360
hundreds of thousands of dollars that people use all the time so maybe it's not that crazy

201
00:13:58,440 --> 00:14:04,860
but you know what's not crazy just segue to our sponsor Acer they're bringing a

202
00:14:03,000 --> 00:14:08,519
much welcome update to 3D gaming with their stereoscopic 3D technology on

203
00:14:06,959 --> 00:14:12,240
their spatial Labs true game this feature is best enjoyed with Acer's

204
00:14:10,139 --> 00:14:17,160
Predator Helios 300 spatial Labs Edition gaming laptop it features a new 3D Ultra

205
00:14:14,639 --> 00:14:20,519
mode Amplified stereo 3D rendering and newly launched game profiles to be

206
00:14:18,600 --> 00:14:23,579
enjoyed this allows you to immerse yourself deeper into the world of 3D

207
00:14:22,019 --> 00:14:27,060
gaming with the addition of 3D plus gaming mode you can customize the stereo

208
00:14:25,680 --> 00:14:30,300
3D effects based on Visual and performance preferences with its 3D

209
00:14:28,680 --> 00:14:33,899
sense feature enjoy impressive performance on The Predator Helios 300

210
00:14:32,040 --> 00:14:39,120
with its built-in 12th gen core I9 processor and GeForce RTX 3080 GPU with

211
00:14:36,959 --> 00:14:42,839
features such as Wi-Fi 6 fan control and overclocking the Predator Helios will

212
00:14:40,920 --> 00:14:45,600
make sure you're set up for success in every gaming session so check out the

213
00:14:44,519 --> 00:14:49,260
links in the description to find out more do it

214
00:14:47,699 --> 00:14:52,800
CES so thanks for watching I hope you folks

215
00:14:50,760 --> 00:14:57,060
have been enjoying our CES 2023 coverage I have been having a hell of a lot of

216
00:14:55,199 --> 00:15:00,899
fun if you did like this video maybe check out how about the Epic Genoa holy

217
00:14:59,639 --> 00:15:04,800
that was a pretty awesome video those CPUs are seriously fast and they

218
00:15:03,060 --> 00:15:09,660
did tell me they can make an AMD version of this if there's people that are asking for it it only took them three

219
00:15:07,800 --> 00:15:15,260
months to design the system from the ground up that's because super micro you

220
00:15:11,940 --> 00:15:15,260
know super modular