{"video_id":"r1plpx8JsYg","title":"The Fastest Storage EVER – HOLY $H!T Ep 14","channel":"Linus Tech Tips","show":"Linus Tech Tips","published_at":"2017-05-06T14:53:29Z","duration_s":628,"segments":[{"start_s":4.0,"end_s":8.96,"text":"They're finally here. Just","speaker":null,"is_sponsor":0},{"start_s":11.8,"end_s":23.89,"text":"wait. I got my 24 PCIe SSDs for my new storage","speaker":null,"is_sponsor":0},{"start_s":19.52,"end_s":33.6,"text":"server. Come on, let's go build it.","speaker":null,"is_sponsor":0},{"start_s":33.6,"end_s":40.6,"text":"If you haven't seen Nerd Sports yet, check it out. All the episodes are","speaker":null,"is_sponsor":0},{"start_s":38.16,"end_s":45.68,"text":"available now for free over at youtube.com/ channels","speaker":null,"is_sponsor":0},{"start_s":43.239,"end_s":52.76,"text":"superfund. But before we begin, we are going to need some supplies. First, a","speaker":null,"is_sponsor":0},{"start_s":49.12,"end_s":57.2,"text":"barebones server from Super Micro, the","speaker":null,"is_sponsor":0},{"start_s":52.76,"end_s":60.259,"text":"SSG 2028 AR NR48N.","speaker":null,"is_sponsor":0},{"start_s":60.48,"end_s":63.84,"text":"I guess we'll just roll it","speaker":null,"is_sponsor":0},{"start_s":65.32,"end_s":75.36,"text":"there. Quad 10 GB network","speaker":null,"is_sponsor":0},{"start_s":68.84,"end_s":77.68,"text":"card, 64 gigs of RAM, dual 2699 V422","speaker":null,"is_sponsor":0},{"start_s":75.36,"end_s":83.28,"text":"core CPUs. Time for boring inventory","speaker":null,"is_sponsor":0},{"start_s":81.159,"end_s":89.72,"text":"reconciliation. Oh, I've had that in the wrong field. Damn it. I was scanning the","speaker":null,"is_sponsor":0},{"start_s":86.759,"end_s":95.36,"text":"wrong barcodes. And time for fun again.","speaker":null,"is_sponsor":0},{"start_s":92.24,"end_s":97.36,"text":"Everybody on board the insane train.","speaker":null,"is_sponsor":0},{"start_s":95.36,"end_s":105.04,"text":"What better place to build this new machine than our shiny new B-roll set.","speaker":null,"is_sponsor":0},{"start_s":102.079,"end_s":111.0,"text":"All I'll need is a screwdriver and maybe a table. Time for my favorite","speaker":null,"is_sponsor":0},{"start_s":108.36,"end_s":116.32,"text":"activity. Shocking drives. Oh, this is going to take a","speaker":null,"is_sponsor":0},{"start_s":113.52,"end_s":116.32,"text":"while.","speaker":null,"is_sponsor":0},{"start_s":116.84,"end_s":127.72,"text":"24 NVMe PCIe","speaker":null,"is_sponsor":0},{"start_s":121.399,"end_s":131.52,"text":"SSDs, each rated at a theoretical up to","speaker":null,"is_sponsor":0},{"start_s":127.72,"end_s":134.48,"text":"250 with another zero, 2500 megabytes","speaker":null,"is_sponsor":0},{"start_s":131.52,"end_s":138.16,"text":"per second reads and 1,200 megabytes per second writes. And we are going to take","speaker":null,"is_sponsor":0},{"start_s":136.72,"end_s":145.239,"text":"all these bad boys and we're going to put them in a gigantic RAID","speaker":null,"is_sponsor":0},{"start_s":140.92,"end_s":145.239,"text":"array. Oh no.","speaker":null,"is_sponsor":0},{"start_s":150.28,"end_s":159.04,"text":"cut. But how on earth do you run NVMe","speaker":null,"is_sponsor":0},{"start_s":153.64,"end_s":162.239,"text":"drives in RAID? The answer is this very","speaker":null,"is_sponsor":0},{"start_s":159.04,"end_s":166.8,"text":"special barebones machine from Super","speaker":null,"is_sponsor":0},{"start_s":162.239,"end_s":172.16,"text":"Micro. In fact, this box can handle not","speaker":null,"is_sponsor":0},{"start_s":166.8,"end_s":175.04,"text":"just 24, but 48 NVMe drives, giving us","speaker":null,"is_sponsor":0},{"start_s":172.16,"end_s":182.48,"text":"the capacity to, without changing the model of drives that we're using, have","speaker":null,"is_sponsor":0},{"start_s":177.76,"end_s":188.12,"text":"up to about 50 terabytes of solidstate","speaker":null,"is_sponsor":0},{"start_s":182.48,"end_s":192.0,"text":"storage in a single box. And did I even","speaker":null,"is_sponsor":0},{"start_s":188.12,"end_s":194.319,"text":"mention that it's all in a 2U form","speaker":null,"is_sponsor":0},{"start_s":192.0,"end_s":198.64,"text":"factor? Now that we've got everything we need for assembly, it's time to open","speaker":null,"is_sponsor":0},{"start_s":196.239,"end_s":204.08,"text":"this sucker up, peel off the oh so satisfying protective plastic, and take","speaker":null,"is_sponsor":0},{"start_s":201.04,"end_s":207.599,"text":"a closer look. At the back are expansion","speaker":null,"is_sponsor":0},{"start_s":204.08,"end_s":209.84,"text":"slots, a 1,000W 80 Plus titanium power","speaker":null,"is_sponsor":0},{"start_s":207.599,"end_s":214.72,"text":"supply with an extra in case the first one dies, and a couple regular SATA 2","speaker":null,"is_sponsor":0},{"start_s":212.72,"end_s":219.04,"text":"and 1/2 in drive bays cuz you know you're a badass when all of your drives","speaker":null,"is_sponsor":0},{"start_s":216.64,"end_s":227.04,"text":"don't fit in the front of your case. Back at the front, we've got 24 NVMe","speaker":null,"is_sponsor":0},{"start_s":222.68,"end_s":231.92,"text":"slots, but this machine supports 48.","speaker":null,"is_sponsor":0},{"start_s":227.04,"end_s":234.72,"text":"Where do the other 24 go? Ah, that right","speaker":null,"is_sponsor":0},{"start_s":231.92,"end_s":241.519,"text":"there is the secret of Super Micros simply double enclosures, a whole","speaker":null,"is_sponsor":0},{"start_s":238.08,"end_s":244.4,"text":"additional bank. But how do you feed 48","speaker":null,"is_sponsor":0},{"start_s":241.519,"end_s":248.72,"text":"PCI Expressbased drives? Here's where the magic happens. One of the three","speaker":null,"is_sponsor":0},{"start_s":246.64,"end_s":256.959,"text":"expansion slots that runs off of the second CPU is occupied by a PCIe x16","speaker":null,"is_sponsor":0},{"start_s":253.599,"end_s":259.199,"text":"quad U.2 card. And there are four native","speaker":null,"is_sponsor":0},{"start_s":256.959,"end_s":264.8,"text":"ports that use a different connector on the motherboard itself that run off the","speaker":null,"is_sponsor":0},{"start_s":261.28,"end_s":268.88,"text":"first CPU. Then both of these go to back","speaker":null,"is_sponsor":0},{"start_s":264.8,"end_s":270.639,"text":"planes behind the banks of drives.","speaker":null,"is_sponsor":0},{"start_s":268.88,"end_s":274.88,"text":"Since we're in here, this seems like a good time to show how the quad 10 GB","speaker":null,"is_sponsor":0},{"start_s":272.96,"end_s":279.28,"text":"network card that we showed before goes in. This can be upgraded in the future,","speaker":null,"is_sponsor":0},{"start_s":277.28,"end_s":285.12,"text":"though I don't see myself needing anything like that for a while. And we","speaker":null,"is_sponsor":0},{"start_s":281.6,"end_s":288.8,"text":"can throw in our 22 core CPUs and our","speaker":null,"is_sponsor":0},{"start_s":285.12,"end_s":290.639,"text":"relatively pedestrian 64 gigs of DDR4","speaker":null,"is_sponsor":0},{"start_s":288.8,"end_s":295.28,"text":"RAM. I think I'll have to steal some memory from the server this is","speaker":null,"is_sponsor":0},{"start_s":292.759,"end_s":299.84,"text":"replacing. And that's pretty much it for assembly. Time to install the drives.","speaker":null,"is_sponsor":0},{"start_s":300.56,"end_s":305.759,"text":"Oh, there go all the drives. Well, who didn't see that one","speaker":null,"is_sponsor":0},{"start_s":313.8,"end_s":323.72,"text":"coming? Finally done. Why is every single one of these","speaker":null,"is_sponsor":0},{"start_s":320.56,"end_s":325.32,"text":"attached with four","speaker":null,"is_sponsor":0},{"start_s":323.72,"end_s":331.8,"text":"screws? Anyway, let's take it over to the test","speaker":null,"is_sponsor":0},{"start_s":328.0,"end_s":335.639,"text":"bench. So, I have all the SSDs plugged","speaker":null,"is_sponsor":0},{"start_s":331.8,"end_s":338.28,"text":"into this card right now, which means a","speaker":null,"is_sponsor":0},{"start_s":335.639,"end_s":346.8,"text":"theoretical 16 gigabytes per second of total bandwidth","speaker":null,"is_sponsor":0},{"start_s":342.32,"end_s":346.8,"text":"using 16x PCIe Gen","speaker":null,"is_sponsor":0},{"start_s":348.52,"end_s":355.0,"text":"3. Let's go find out how that theoretically translates into the real","speaker":null,"is_sponsor":0},{"start_s":352.72,"end_s":359.759,"text":"world. Oh, it's heavy.","speaker":null,"is_sponsor":0},{"start_s":356.52,"end_s":363.84,"text":"Okay, let's get some network connections","speaker":null,"is_sponsor":0},{"start_s":359.759,"end_s":366.68,"text":"here. Let's get some Oh, yeah. VGA. You","speaker":null,"is_sponsor":0},{"start_s":363.84,"end_s":370.639,"text":"know it's performance when it has VGA connectivity. Got this all set up. You'd","speaker":null,"is_sponsor":0},{"start_s":368.8,"end_s":375.039,"text":"think I plug in servers here every once in a while, right? All right, let's","speaker":null,"is_sponsor":0},{"start_s":372.88,"end_s":381.93,"text":"press the button and listen for the sweet sound of performance.","speaker":null,"is_sponsor":0},{"start_s":385.84,"end_s":388.96,"text":"That's not bad for a","speaker":null,"is_sponsor":0},{"start_s":390.36,"end_s":396.96,"text":"2U. So, fast forward half an hour. We","speaker":null,"is_sponsor":0},{"start_s":394.479,"end_s":403.319,"text":"have got everything set up. So, disc management, we have created a RAID zero.","speaker":null,"is_sponsor":0},{"start_s":401.759,"end_s":409.44,"text":"You're going to device manager disc drives. Oh, look. Look at","speaker":null,"is_sponsor":0},{"start_s":406.4,"end_s":411.84,"text":"them all. Obviously, we would never run","speaker":null,"is_sponsor":0},{"start_s":409.44,"end_s":416.24,"text":"a RAID zero. I am still looking into what will be the best way to configure","speaker":null,"is_sponsor":0},{"start_s":414.56,"end_s":422.039,"text":"them all with a good balance of performance and redundancy. But this","speaker":null,"is_sponsor":0},{"start_s":419.12,"end_s":428.8,"text":"video is all about taking it to the extremes. So, we're going to run ADO","speaker":null,"is_sponsor":0},{"start_s":424.4,"end_s":433.479,"text":"with a QEP of 10 on our Z drive here and","speaker":null,"is_sponsor":0},{"start_s":428.8,"end_s":437.68,"text":"find out just how fast it can","speaker":null,"is_sponsor":0},{"start_s":433.479,"end_s":441.759,"text":"go. Whoa. So, now we're talking. That's","speaker":null,"is_sponsor":0},{"start_s":437.68,"end_s":444.599,"text":"like 2800 megs per second, right? It's","speaker":null,"is_sponsor":0},{"start_s":441.759,"end_s":452.28,"text":"like play by play. Wow. Oh, it's over","speaker":null,"is_sponsor":0},{"start_s":448.199,"end_s":458.72,"text":"9,000. We did it. We cracked 10","speaker":null,"is_sponsor":0},{"start_s":452.28,"end_s":458.72,"text":"gigabytes per second right speeds at","speaker":null,"is_sponsor":0},{"start_s":458.759,"end_s":470.319,"text":"512K. Wow. Of a theoretical 16 or 15 or so.","speaker":null,"is_sponsor":0},{"start_s":466.72,"end_s":473.12,"text":"Look at that. Over 11 gigabytes per","speaker":null,"is_sponsor":0},{"start_s":470.319,"end_s":479.199,"text":"second rights. Over 1 Gigabyte per second reads for 8 megs. I can't imagine","speaker":null,"is_sponsor":0},{"start_s":476.479,"end_s":484.8,"text":"it getting much higher than that. So there you have it folks. Past 4 to 8","speaker":null,"is_sponsor":0},{"start_s":482.16,"end_s":490.479,"text":"megabytes. We're looking at read and write speeds in the neighborhood of 10","speaker":null,"is_sponsor":0},{"start_s":487.0,"end_s":493.759,"text":"GB per second with our highest peak at","speaker":null,"is_sponsor":0},{"start_s":490.479,"end_s":497.4,"text":"around 12.7 coming close to the","speaker":null,"is_sponsor":0},{"start_s":493.759,"end_s":502.0,"text":"theoretical maximum of our PCI Express","speaker":null,"is_sponsor":0},{"start_s":497.4,"end_s":504.0,"text":"X16 link here. Pretty freaking bananas","speaker":null,"is_sponsor":0},{"start_s":502.0,"end_s":509.28,"text":"if you ask me. And we should be able to easily, even once we work some par or","speaker":null,"is_sponsor":0},{"start_s":506.8,"end_s":514.56,"text":"redundancy into the equation, saturate our four 10 GB network connections at","speaker":null,"is_sponsor":0},{"start_s":512.64,"end_s":517.279,"text":"the back here once we get all of those bonded","speaker":null,"is_sponsor":0},{"start_s":517.399,"end_s":526.16,"text":"together. Oh, hey, it's another Blue Apron spot and it's a new year. Maybe","speaker":null,"is_sponsor":0},{"start_s":523.36,"end_s":531.12,"text":"eating healthy and cooking in more instead of eating out is a resolution","speaker":null,"is_sponsor":0},{"start_s":528.64,"end_s":535.76,"text":"for you. Blue Apron allows you to create delicious chef designed recipes at home.","speaker":null,"is_sponsor":0},{"start_s":534.32,"end_s":539.2,"text":"They deliver all the ingredients you need right to your doorstep in exactly","speaker":null,"is_sponsor":0},{"start_s":537.76,"end_s":543.36,"text":"the right proportions so you don't have to go to the grocery store and you don't","speaker":null,"is_sponsor":0},{"start_s":541.279,"end_s":547.279,"text":"have to waste any food and it's delivered in a refrigerated box so","speaker":null,"is_sponsor":0},{"start_s":545.12,"end_s":552.16,"text":"everything stays fresh even if you're not at home when your delivery arrives.","speaker":null,"is_sponsor":0},{"start_s":550.399,"end_s":556.399,"text":"Everything is sourced from quality suppliers. They offer two different","speaker":null,"is_sponsor":0},{"start_s":554.16,"end_s":561.04,"text":"types of plan, the twoerson plan and the family plan. And there is no commitment.","speaker":null,"is_sponsor":0},{"start_s":558.399,"end_s":565.279,"text":"You can skip or cancel the service anytime you want. All meals can be","speaker":null,"is_sponsor":0},{"start_s":563.68,"end_s":568.48,"text":"prepared in 40 minutes or less, so you'll actually save time compared to","speaker":null,"is_sponsor":0},{"start_s":567.04,"end_s":574.399,"text":"going out if your family is anything like mine. And they're adding new dishes","speaker":null,"is_sponsor":0},{"start_s":570.72,"end_s":576.56,"text":"to their menu every week. So try it out.","speaker":null,"is_sponsor":0},{"start_s":574.399,"end_s":580.2,"text":"And for the first 100 people, you'll get three free meals using the link in our","speaker":null,"is_sponsor":0},{"start_s":579.04,"end_s":585.76,"text":"video description. So thank you guys very much","speaker":null,"is_sponsor":0},{"start_s":583.92,"end_s":588.959,"text":"for tuning into this video. If you disliked it, well, that's what that","speaker":null,"is_sponsor":0},{"start_s":587.12,"end_s":592.64,"text":"button's there for, isn't it? But if you liked it, hit that like button, get","speaker":null,"is_sponsor":0},{"start_s":590.8,"end_s":597.36,"text":"subscribed, maybe check out the link to where to buy a cool, fast SSD, maybe","speaker":null,"is_sponsor":0},{"start_s":594.959,"end_s":600.16,"text":"just one if you're not into buying 24 of them at Amazon in the link in the video","speaker":null,"is_sponsor":0},{"start_s":598.959,"end_s":604.0,"text":"description. Also, down there is our merch store and our community forum. And","speaker":null,"is_sponsor":0},{"start_s":602.8,"end_s":609.48,"text":"don't forget to check out our other channels, which you'll find a video of","speaker":null,"is_sponsor":0},{"start_s":606.08,"end_s":611.839,"text":"up here. I will see you guys again next","speaker":null,"is_sponsor":0},{"start_s":609.48,"end_s":616.24,"text":"time. What's he going to do next time? Nobody knows. Maybe he's going to rip","speaker":null,"is_sponsor":0},{"start_s":613.2,"end_s":620.44,"text":"out a fan. Ah, while it's running, hot","speaker":null,"is_sponsor":0},{"start_s":616.24,"end_s":620.44,"text":"swap fans, [ __ ]","speaker":null,"is_sponsor":0}],"full_text":"They're finally here. Just wait. I got my 24 PCIe SSDs for my new storage server. Come on, let's go build it. If you haven't seen Nerd Sports yet, check it out. All the episodes are available now for free over at youtube.com/ channels superfund. But before we begin, we are going to need some supplies. First, a barebones server from Super Micro, the SSG 2028 AR NR48N. I guess we'll just roll it there. Quad 10 GB network card, 64 gigs of RAM, dual 2699 V422 core CPUs. Time for boring inventory reconciliation. Oh, I've had that in the wrong field. Damn it. I was scanning the wrong barcodes. And time for fun again. Everybody on board the insane train. What better place to build this new machine than our shiny new B-roll set. All I'll need is a screwdriver and maybe a table. Time for my favorite activity. Shocking drives. Oh, this is going to take a while. 24 NVMe PCIe SSDs, each rated at a theoretical up to 250 with another zero, 2500 megabytes per second reads and 1,200 megabytes per second writes. And we are going to take all these bad boys and we're going to put them in a gigantic RAID array. Oh no. cut. But how on earth do you run NVMe drives in RAID? The answer is this very special barebones machine from Super Micro. In fact, this box can handle not just 24, but 48 NVMe drives, giving us the capacity to, without changing the model of drives that we're using, have up to about 50 terabytes of solidstate storage in a single box. And did I even mention that it's all in a 2U form factor? Now that we've got everything we need for assembly, it's time to open this sucker up, peel off the oh so satisfying protective plastic, and take a closer look. At the back are expansion slots, a 1,000W 80 Plus titanium power supply with an extra in case the first one dies, and a couple regular SATA 2 and 1/2 in drive bays cuz you know you're a badass when all of your drives don't fit in the front of your case. Back at the front, we've got 24 NVMe slots, but this machine supports 48. Where do the other 24 go? Ah, that right there is the secret of Super Micros simply double enclosures, a whole additional bank. But how do you feed 48 PCI Expressbased drives? Here's where the magic happens. One of the three expansion slots that runs off of the second CPU is occupied by a PCIe x16 quad U.2 card. And there are four native ports that use a different connector on the motherboard itself that run off the first CPU. Then both of these go to back planes behind the banks of drives. Since we're in here, this seems like a good time to show how the quad 10 GB network card that we showed before goes in. This can be upgraded in the future, though I don't see myself needing anything like that for a while. And we can throw in our 22 core CPUs and our relatively pedestrian 64 gigs of DDR4 RAM. I think I'll have to steal some memory from the server this is replacing. And that's pretty much it for assembly. Time to install the drives. Oh, there go all the drives. Well, who didn't see that one coming? Finally done. Why is every single one of these attached with four screws? Anyway, let's take it over to the test bench. So, I have all the SSDs plugged into this card right now, which means a theoretical 16 gigabytes per second of total bandwidth using 16x PCIe Gen 3. Let's go find out how that theoretically translates into the real world. Oh, it's heavy. Okay, let's get some network connections here. Let's get some Oh, yeah. VGA. You know it's performance when it has VGA connectivity. Got this all set up. You'd think I plug in servers here every once in a while, right? All right, let's press the button and listen for the sweet sound of performance. That's not bad for a 2U. So, fast forward half an hour. We have got everything set up. So, disc management, we have created a RAID zero. You're going to device manager disc drives. Oh, look. Look at them all. Obviously, we would never run a RAID zero. I am still looking into what will be the best way to configure them all with a good balance of performance and redundancy. But this video is all about taking it to the extremes. So, we're going to run ADO with a QEP of 10 on our Z drive here and find out just how fast it can go. Whoa. So, now we're talking. That's like 2800 megs per second, right? It's like play by play. Wow. Oh, it's over 9,000. We did it. We cracked 10 gigabytes per second right speeds at 512K. Wow. Of a theoretical 16 or 15 or so. Look at that. Over 11 gigabytes per second rights. Over 1 Gigabyte per second reads for 8 megs. I can't imagine it getting much higher than that. So there you have it folks. Past 4 to 8 megabytes. We're looking at read and write speeds in the neighborhood of 10 GB per second with our highest peak at around 12.7 coming close to the theoretical maximum of our PCI Express X16 link here. Pretty freaking bananas if you ask me. And we should be able to easily, even once we work some par or redundancy into the equation, saturate our four 10 GB network connections at the back here once we get all of those bonded together. Oh, hey, it's another Blue Apron spot and it's a new year. Maybe eating healthy and cooking in more instead of eating out is a resolution for you. Blue Apron allows you to create delicious chef designed recipes at home. They deliver all the ingredients you need right to your doorstep in exactly the right proportions so you don't have to go to the grocery store and you don't have to waste any food and it's delivered in a refrigerated box so everything stays fresh even if you're not at home when your delivery arrives. Everything is sourced from quality suppliers. They offer two different types of plan, the twoerson plan and the family plan. And there is no commitment. You can skip or cancel the service anytime you want. All meals can be prepared in 40 minutes or less, so you'll actually save time compared to going out if your family is anything like mine. And they're adding new dishes to their menu every week. So try it out. And for the first 100 people, you'll get three free meals using the link in our video description. So thank you guys very much for tuning into this video. If you disliked it, well, that's what that button's there for, isn't it? But if you liked it, hit that like button, get subscribed, maybe check out the link to where to buy a cool, fast SSD, maybe just one if you're not into buying 24 of them at Amazon in the link in the video description. Also, down there is our merch store and our community forum. And don't forget to check out our other channels, which you'll find a video of up here. I will see you guys again next time. What's he going to do next time? Nobody knows. Maybe he's going to rip out a fan. Ah, while it's running, hot swap fans, [ __ ]"}