{"video_id":"Al93JD5GExY","title":"I forgot to make a video about this $150,000 server","channel":"Linus Tech Tips","show":"Linus Tech Tips","published_at":"2024-05-04T14:53:29Z","duration_s":1134,"segments":[{"start_s":0.04,"end_s":8.12,"text":"we just kicked off Spring cleaning at our studio which wouldn't normally be a","speaker":null,"is_sponsor":0},{"start_s":3.439,"end_s":12.599,"text":"video except we came across this a","speaker":null,"is_sponsor":0},{"start_s":8.12,"end_s":14.679,"text":"$15,000 server with two CPUs eight ssds","speaker":null,"is_sponsor":0},{"start_s":12.599,"end_s":21.08,"text":"and a whopping 6.3 terabytes of RAM when we got this","speaker":null,"is_sponsor":0},{"start_s":18.64,"end_s":25.84,"text":"from Intel 3 years ago we did a quick unboxing promising a deeper dive into","speaker":null,"is_sponsor":0},{"start_s":23.56,"end_s":30.88,"text":"some of its more exotic features and then promptly forgot about it well that","speaker":null,"is_sponsor":0},{"start_s":28.519,"end_s":36.2,"text":"RAM I showed you guys is is n RAM at all but optain persistent memory modules you","speaker":null,"is_sponsor":0},{"start_s":34.16,"end_s":41.079,"text":"might know that Intel's optain business was sadly shuttered in June of 2022","speaker":null,"is_sponsor":0},{"start_s":38.84,"end_s":47.76,"text":"which means the contacts who originally sent us this have sadly moved on we on","speaker":null,"is_sponsor":0},{"start_s":44.44,"end_s":50.039,"text":"the other hand haven't so all these","speaker":null,"is_sponsor":0},{"start_s":47.76,"end_s":54.84,"text":"years later I am finally going to do what I said I was going to do and finish","speaker":null,"is_sponsor":0},{"start_s":52.32,"end_s":60.84,"text":"building the rer piece I mean sorry I mean digging into what made optain so","speaker":null,"is_sponsor":0},{"start_s":58.559,"end_s":65.799,"text":"special and cool and what ultimately killed it just like I'm","speaker":null,"is_sponsor":0},{"start_s":63.239,"end_s":69.56,"text":"going to kill this segue to our sponsor ug green they're getting into the Nas","speaker":null,"is_sponsor":1},{"start_s":67.72,"end_s":75.479,"text":"Game and they claimed their new Nas sync dxp 4800 plus is the most powerful Nas","speaker":null,"is_sponsor":1},{"start_s":72.68,"end_s":81.0,"text":"under $500 it's got four Bays for storage a 12th Gen 5 Core Intel","speaker":null,"is_sponsor":1},{"start_s":78.24,"end_s":86.079,"text":"processor 8 gigs of ddr5 memory that's expandable and more check it out at the","speaker":null,"is_sponsor":1},{"start_s":83.56,"end_s":86.079,"text":"link down","speaker":null,"is_sponsor":1},{"start_s":88.92,"end_s":91.92,"text":"below","speaker":null,"is_sponsor":0},{"start_s":93.799,"end_s":100.28,"text":"before we go any further some of you probably need a refresher isn't Intel","speaker":null,"is_sponsor":0},{"start_s":97.52,"end_s":105.759,"text":"optain and SSD what's it doing in a RAM slot well optane was more of a family","speaker":null,"is_sponsor":0},{"start_s":103.72,"end_s":109.88,"text":"than an individual product ranging from inexpensive hard drive accelerators for","speaker":null,"is_sponsor":0},{"start_s":107.88,"end_s":115.079,"text":"pre-builts where the manufacturer was too cheap to install a real SSD to","speaker":null,"is_sponsor":0},{"start_s":112.56,"end_s":119.92,"text":"incredibly low latency not to mention expensive storage for the fastest","speaker":null,"is_sponsor":0},{"start_s":117.64,"end_s":124.2,"text":"servers in existence what all of these uses had in common though was they","speaker":null,"is_sponsor":0},{"start_s":122.039,"end_s":130.28,"text":"looked like conventional memory and storage devices but functioned somewhere","speaker":null,"is_sponsor":0},{"start_s":127.2,"end_s":132.8,"text":"in between and that's exactly what we're","speaker":null,"is_sponsor":0},{"start_s":130.28,"end_s":139.44,"text":"looking at here this appears to be a normal SSD but the 3D Cross Point chips","speaker":null,"is_sponsor":0},{"start_s":135.959,"end_s":142.4,"text":"inside it have just 100th the latency of","speaker":null,"is_sponsor":0},{"start_s":139.44,"end_s":147.56,"text":"regular Nan flash as for this guy well it looks like a stick of ddr4 memory but","speaker":null,"is_sponsor":0},{"start_s":145.12,"end_s":153.92,"text":"it's actually an Intel optain persistent memory series 100 module with a whopping","speaker":null,"is_sponsor":0},{"start_s":150.64,"end_s":157.599,"text":"512 gigs of storage on it and this","speaker":null,"is_sponsor":0},{"start_s":153.92,"end_s":160.4,"text":"server has 12 of them for a total of 6","speaker":null,"is_sponsor":0},{"start_s":157.599,"end_s":165.04,"text":"tabes that's enough to fit nearly 12 High bit rate Floatplane exclusives","speaker":null,"is_sponsor":0},{"start_s":162.2,"end_s":170.36,"text":"solely in system memory wait a second lus memory I thought you just said it","speaker":null,"is_sponsor":1},{"start_s":167.2,"end_s":172.72,"text":"was storage I did but the simplest way","speaker":null,"is_sponsor":0},{"start_s":170.36,"end_s":177.8,"text":"to take advantage of it is in memory mode where your optain modules just show","speaker":null,"is_sponsor":0},{"start_s":175.319,"end_s":183.4,"text":"up to your operating system as a whole whack load of RAM now the bad thing","speaker":null,"is_sponsor":0},{"start_s":180.879,"end_s":189.68,"text":"about this mode is that it forces optane to have one of the big downsides of RAM","speaker":null,"is_sponsor":0},{"start_s":186.56,"end_s":191.4,"text":"for security reasons every time an","speaker":null,"is_sponsor":0},{"start_s":189.68,"end_s":196.04,"text":"optain module in memory mode gets restarted it generates a new","speaker":null,"is_sponsor":0},{"start_s":193.48,"end_s":201.319,"text":"cryptographic key effectively wiping all of the data that it contained the good","speaker":null,"is_sponsor":0},{"start_s":198.12,"end_s":204.48,"text":"news is that optane can handle many more","speaker":null,"is_sponsor":0},{"start_s":201.319,"end_s":207.2,"text":"wipes than regular ssds so this is","speaker":null,"is_sponsor":0},{"start_s":204.48,"end_s":211.879,"text":"unlikely to harm it and what's also cool is that no special coding is needed to","speaker":null,"is_sponsor":0},{"start_s":209.799,"end_s":216.92,"text":"immediately use memory mode and the CPU's memory controller will even","speaker":null,"is_sponsor":0},{"start_s":213.879,"end_s":219.319,"text":"automatically move colder data off of","speaker":null,"is_sponsor":0},{"start_s":216.92,"end_s":224.2,"text":"the memory onto the optain and vice versa let me show you how this would","speaker":null,"is_sponsor":0},{"start_s":221.48,"end_s":229.12,"text":"work in a demanding professional application right now you're looking at","speaker":null,"is_sponsor":0},{"start_s":226.159,"end_s":233.36,"text":"solid works flow simulator but we aren't simulating anything at the moment","speaker":null,"is_sponsor":0},{"start_s":230.64,"end_s":239.879,"text":"because first we need to generate a mesh which is essentially a 3D Space full of","speaker":null,"is_sponsor":0},{"start_s":236.68,"end_s":242.4,"text":"data sampling points where some fluid","speaker":null,"is_sponsor":0},{"start_s":239.879,"end_s":248.72,"text":"let's say air is going to interact with some object say this heat sink it's not","speaker":null,"is_sponsor":0},{"start_s":245.799,"end_s":254.239,"text":"using that much RAM though what 45 gigs 48 gigs that's a lot of RAM okay it's a","speaker":null,"is_sponsor":0},{"start_s":251.56,"end_s":258.88,"text":"lot of RAM but it's 2% of what we have the issue is that it just takes hours","speaker":null,"is_sponsor":0},{"start_s":256.28,"end_s":264.36,"text":"for the CPU to process a large enough mesh like this for it to fill up all of","speaker":null,"is_sponsor":0},{"start_s":261.519,"end_s":269.88,"text":"that RAM let alone the optain that's in there and this is a really silly way of","speaker":null,"is_sponsor":0},{"start_s":266.56,"end_s":271.639,"text":"doing this so what you're saying is flow","speaker":null,"is_sponsor":0},{"start_s":269.88,"end_s":277.919,"text":"doesn't need that much RAM obtaine is pointless no no no Flo Sim does need","speaker":null,"is_sponsor":0},{"start_s":274.639,"end_s":280.039,"text":"heaps and heaps of RAM just a model like","speaker":null,"is_sponsor":0},{"start_s":277.919,"end_s":284.0,"text":"this doesn't necessarily if we were trying to run something that's super","speaker":null,"is_sponsor":0},{"start_s":281.68,"end_s":287.28,"text":"complex like crashing a car into a barrier having terabytes of memory could","speaker":null,"is_sponsor":0},{"start_s":285.84,"end_s":291.36,"text":"be the difference between a finishing in a day and a finishing in a week of","speaker":null,"is_sponsor":0},{"start_s":289.68,"end_s":295.68,"text":"course though this isn't memory its latency is several times higher which","speaker":null,"is_sponsor":0},{"start_s":293.56,"end_s":302.8,"text":"would obviously impact performance the question is though how much to find out","speaker":null,"is_sponsor":0},{"start_s":299.039,"end_s":305.639,"text":"we came up with a rather terrible idea","speaker":null,"is_sponsor":0},{"start_s":302.8,"end_s":310.28,"text":"why don't we just remove a bunch of the actual RAM so that the system has no","speaker":null,"is_sponsor":0},{"start_s":307.88,"end_s":313.44,"text":"choice but to use the obtaine and then we can do a before and","speaker":null,"is_sponsor":0},{"start_s":316.639,"end_s":325.84,"text":"after it's not going to do anything is it","speaker":null,"is_sponsor":0},{"start_s":320.8,"end_s":331.12,"text":"nope oh jeez there goes the alarm wait","speaker":null,"is_sponsor":0},{"start_s":325.84,"end_s":333.319,"text":"maybe there's no way no sadly Intel","speaker":null,"is_sponsor":0},{"start_s":331.12,"end_s":337.72,"text":"thought of that and requires each stick of obtain pm to be paired with a stick","speaker":null,"is_sponsor":0},{"start_s":336.0,"end_s":342.639,"text":"of RAM in order for the system to function at all and they have a","speaker":null,"is_sponsor":0},{"start_s":339.28,"end_s":346.56,"text":"recommended ratio of 4 to1 optained to","speaker":null,"is_sponsor":0},{"start_s":342.639,"end_s":349.039,"text":"RAM for Optimal Performance ours however","speaker":null,"is_sponsor":0},{"start_s":346.56,"end_s":355.319,"text":"it's more like a 16 to1 ratio and the server came straight from Intel","speaker":null,"is_sponsor":0},{"start_s":352.24,"end_s":358.4,"text":"so what do we do with the rest of it as","speaker":null,"is_sponsor":0},{"start_s":355.319,"end_s":361.28,"text":"it turns out many customers simply used","speaker":null,"is_sponsor":0},{"start_s":358.4,"end_s":366.68,"text":"higher ratios but there are some other ways to take advantage of the persistent","speaker":null,"is_sponsor":0},{"start_s":363.6,"end_s":369.8,"text":"part of our persistent memory app direct","speaker":null,"is_sponsor":0},{"start_s":366.68,"end_s":372.479,"text":"mode and storage mode which Alex is","speaker":null,"is_sponsor":0},{"start_s":369.8,"end_s":376.24,"text":"showing us now yes app direct mode exposes the optain directly to the","speaker":null,"is_sponsor":0},{"start_s":374.68,"end_s":382.08,"text":"application which can use it like storage RAM or somewhere in between","speaker":null,"is_sponsor":0},{"start_s":380.24,"end_s":386.319,"text":"unfortunately we aren't able to show this off because doing so would require","speaker":null,"is_sponsor":0},{"start_s":383.8,"end_s":390.4,"text":"us to code our own program that explicitly takes advantage of it and","speaker":null,"is_sponsor":0},{"start_s":388.16,"end_s":393.96,"text":"this is a task that almost no company's worth billions of dollars found to be","speaker":null,"is_sponsor":0},{"start_s":392.12,"end_s":398.84,"text":"worthwhile so doing it for a YouTube video would have a dubious Roi to say","speaker":null,"is_sponsor":0},{"start_s":396.36,"end_s":403.36,"text":"the least what we can show you is storage mode have you ever wondered what","speaker":null,"is_sponsor":0},{"start_s":401.199,"end_s":409.039,"text":"would happen if you could plug your SSD into a high-speed memory slot well","speaker":null,"is_sponsor":0},{"start_s":406.4,"end_s":414.319,"text":"basically this storage mode presents the obtained tier operating system much like","speaker":null,"is_sponsor":0},{"start_s":411.36,"end_s":418.919,"text":"an SSD just with super low latency compared to traditional Mand flash","speaker":null,"is_sponsor":0},{"start_s":416.759,"end_s":422.759,"text":"setting this bit up though was what caused this project to be stalled for","speaker":null,"is_sponsor":0},{"start_s":420.759,"end_s":428.28,"text":"months because we just couldn't figure out how to do it not because Alex is","speaker":null,"is_sponsor":0},{"start_s":425.319,"end_s":431.84,"text":"dumb or because I'm dumb but rather because the BIOS on this Intel","speaker":null,"is_sponsor":0},{"start_s":429.599,"end_s":435.199,"text":"motherboard is so poorly organized now okay okay sorry this is going to be a","speaker":null,"is_sponsor":0},{"start_s":433.52,"end_s":439.4,"text":"bit of a tangent but motherboard manufactures can you please figure your","speaker":null,"is_sponsor":0},{"start_s":437.599,"end_s":444.08,"text":"shiz out I mean we have this industrywide problem where every single","speaker":null,"is_sponsor":0},{"start_s":441.879,"end_s":447.759,"text":"motherboard maker calls the exact same setting something ever so slightly","speaker":null,"is_sponsor":0},{"start_s":446.16,"end_s":453.16,"text":"different and then puts it in a different place meaning even if you are","speaker":null,"is_sponsor":0},{"start_s":450.56,"end_s":456.919,"text":"quite knowledgeable and not dumb and you know exactly what you're looking for","speaker":null,"is_sponsor":0},{"start_s":454.879,"end_s":463.24,"text":"there's a solid chance you won't be able to find it we were easily able to figure","speaker":null,"is_sponsor":0},{"start_s":460.039,"end_s":466.0,"text":"out how to use app direct mode on Dell","speaker":null,"is_sponsor":0},{"start_s":463.24,"end_s":470.68,"text":"super micro Lenovo and HP server boards since they had decent documentation but","speaker":null,"is_sponsor":0},{"start_s":468.039,"end_s":474.52,"text":"no not the Intel one we even called up Patrick from serve the home who","speaker":null,"is_sponsor":0},{"start_s":472.4,"end_s":479.199,"text":"literally wrote the guide on how to do this and he couldn't figure it out","speaker":null,"is_sponsor":0},{"start_s":476.24,"end_s":483.28,"text":"either okay look at this Lis I'm going to go back to the main","speaker":null,"is_sponsor":0},{"start_s":480.639,"end_s":491.36,"text":"menu we're looking for the memory controller spot where do you think that","speaker":null,"is_sponsor":0},{"start_s":487.96,"end_s":494.0,"text":"is well I would go to Advanced and then","speaker":null,"is_sponsor":0},{"start_s":491.36,"end_s":498.56,"text":"I would probably go to memory configuration so this is why we needed","speaker":null,"is_sponsor":0},{"start_s":495.96,"end_s":504.199,"text":"Emily to help us find it yes it is under PCI configuration um option ROM","speaker":null,"is_sponsor":0},{"start_s":501.84,"end_s":511.24,"text":"controller and that's where the memory controller is of course I can't believe","speaker":null,"is_sponsor":0},{"start_s":507.199,"end_s":513.44,"text":"we didn't think of that Anyway by using","speaker":null,"is_sponsor":0},{"start_s":511.24,"end_s":517.839,"text":"storage mode we're able to select how much of the optain we want to be","speaker":null,"is_sponsor":0},{"start_s":515.12,"end_s":522.039,"text":"presented as an SSD and we can create volumes with it much like with a raid","speaker":null,"is_sponsor":0},{"start_s":520.039,"end_s":526.12,"text":"array with the maximum performance occurring when you interleave across","speaker":null,"is_sponsor":0},{"start_s":524.159,"end_s":531.12,"text":"multiple optained dims that are operating on the same CPU which","speaker":null,"is_sponsor":0},{"start_s":528.2,"end_s":536.959,"text":"essentially creates a raid zero array on opan now as you might have guessed this","speaker":null,"is_sponsor":0},{"start_s":534.0,"end_s":540.079,"text":"does come with the risk of data loss so if you don't care as much about","speaker":null,"is_sponsor":0},{"start_s":538.2,"end_s":544.44,"text":"performance you might want to mirror the data across both CPUs or I don't know","speaker":null,"is_sponsor":0},{"start_s":543.0,"end_s":550.92,"text":"maybe just buy an SSD but all of that aside the coolest","speaker":null,"is_sponsor":0},{"start_s":548.079,"end_s":555.2,"text":"configuration is mixed mode this allows you to set a target for how much of your","speaker":null,"is_sponsor":0},{"start_s":553.04,"end_s":560.36,"text":"optain will be storage and how much will be RAM creating a Best of Both Worlds","speaker":null,"is_sponsor":0},{"start_s":558.24,"end_s":566.0,"text":"situation where the BIOS handles all of the complex bits and you get both cheap","speaker":null,"is_sponsor":0},{"start_s":563.0,"end_s":568.0,"text":"RAM and super low latency storage all","speaker":null,"is_sponsor":0},{"start_s":566.0,"end_s":572.32,"text":"right what's your memory percentage goal what do you mean goal it's doesn't","speaker":null,"is_sponsor":0},{"start_s":569.76,"end_s":576.56,"text":"really do exact it just kind of gets close to the percentage that you want I","speaker":null,"is_sponsor":0},{"start_s":574.92,"end_s":581.279,"text":"think we all know the answer to that nice so we","speaker":null,"is_sponsor":0},{"start_s":578.92,"end_s":587.519,"text":"reboot need sorry seemed","speaker":null,"is_sponsor":0},{"start_s":584.399,"end_s":588.68,"text":"mad okay all right no you don't seem mad","speaker":null,"is_sponsor":0},{"start_s":587.519,"end_s":593.88,"text":"you seem rightfully like we need to discuss","speaker":null,"is_sponsor":0},{"start_s":591.6,"end_s":600.36,"text":"this come on come on create name space here we go there we go how about now","speaker":null,"is_sponsor":0},{"start_s":598.04,"end_s":605.04,"text":"there we go I love how surprised it is it's making a","speaker":null,"is_sponsor":0},{"start_s":602.6,"end_s":608.56,"text":"YouTube thumbnail face speaking of which we're working on a really cool video now","speaker":null,"is_sponsor":0},{"start_s":606.76,"end_s":614.279,"text":"that YouTube has AB testing for thumbnails Maria is creating a like","speaker":null,"is_sponsor":0},{"start_s":612.44,"end_s":618.6,"text":"cringe YouTuber face version of every thumbnail for a little bit and then just","speaker":null,"is_sponsor":0},{"start_s":616.2,"end_s":622.48,"text":"like a nice relaxed one and then we're going to make a video about which ones","speaker":null,"is_sponsor":0},{"start_s":620.279,"end_s":626.24,"text":"people actually prefer whatever they say they prefer it could change our","speaker":null,"is_sponsor":0},{"start_s":624.16,"end_s":630.92,"text":"thumbnail practices there we go all right okay what we're looking at right","speaker":null,"is_sponsor":0},{"start_s":628.24,"end_s":637.36,"text":"now is our G Drive which is a conventional nbme SSD and our o Drive","speaker":null,"is_sponsor":0},{"start_s":634.44,"end_s":642.88,"text":"which is our optain drive and this measure is seconds per transfer which is","speaker":null,"is_sponsor":0},{"start_s":640.2,"end_s":645.44,"text":"essentially the latency of each operation on the drive now what we're","speaker":null,"is_sponsor":0},{"start_s":644.2,"end_s":649.519,"text":"going to do is we're going to run Crystal disc mark on both of these","speaker":null,"is_sponsor":0},{"start_s":647.399,"end_s":656.519,"text":"drives at the same time and","speaker":null,"is_sponsor":0},{"start_s":651.959,"end_s":664.12,"text":"theoretically yes yep the regular NVMe","speaker":null,"is_sponsor":0},{"start_s":656.519,"end_s":666.639,"text":"is way more which is bad o is opan opan","speaker":null,"is_sponsor":0},{"start_s":664.12,"end_s":670.92,"text":"which makes sense because it barely even appears that's how low the latency of","speaker":null,"is_sponsor":0},{"start_s":669.04,"end_s":674.92,"text":"this is which doesn't matter for everything and in fact if we have a look","speaker":null,"is_sponsor":0},{"start_s":672.959,"end_s":680.76,"text":"at our Crystal dis Mark results it's not that fast in terms of","speaker":null,"is_sponsor":0},{"start_s":678.519,"end_s":686.44,"text":"sequential transfer speeds it's just that it's really really responsive wow","speaker":null,"is_sponsor":0},{"start_s":684.24,"end_s":693.0,"text":"we've done it we go okay we can actually see what the crap we're looking at now","speaker":null,"is_sponsor":0},{"start_s":689.0,"end_s":696.0,"text":"here we go this is what we expect to see","speaker":null,"is_sponsor":0},{"start_s":693.0,"end_s":700.24,"text":"all three tests are running right now","speaker":null,"is_sponsor":0},{"start_s":696.0,"end_s":702.04,"text":"there we go yes and our SATA is much","speaker":null,"is_sponsor":0},{"start_s":700.24,"end_s":705.639,"text":"higher in terms of latency not to mention that it can be very inconsistent","speaker":null,"is_sponsor":0},{"start_s":703.88,"end_s":712.36,"text":"see that initial Spike when we first hit it that's a yikes and while NVMe is a","speaker":null,"is_sponsor":0},{"start_s":708.88,"end_s":714.959,"text":"lot better it doesn't have that super","speaker":null,"is_sponsor":0},{"start_s":712.36,"end_s":719.04,"text":"super flat line when all of them are running the same test that we see with","speaker":null,"is_sponsor":0},{"start_s":716.56,"end_s":724.44,"text":"optane where the latency is negligible which which can be a huge benefit for","speaker":null,"is_sponsor":0},{"start_s":721.2,"end_s":728.0,"text":"certain applications and not terribly","speaker":null,"is_sponsor":0},{"start_s":724.44,"end_s":731.2,"text":"important for others which is cool in","speaker":null,"is_sponsor":0},{"start_s":728.0,"end_s":732.76,"text":"some cases really cool so then why does","speaker":null,"is_sponsor":0},{"start_s":731.2,"end_s":739.199,"text":"optain no longer exist the answer is many many reasons","speaker":null,"is_sponsor":0},{"start_s":736.68,"end_s":745.24,"text":"the first and biggest problem is that optin arrived 2 years late it was","speaker":null,"is_sponsor":0},{"start_s":742.24,"end_s":748.72,"text":"supposed to come with Skylake in 2017","speaker":null,"is_sponsor":0},{"start_s":745.24,"end_s":749.959,"text":"with speeds that matched the ddr4 2666","speaker":null,"is_sponsor":0},{"start_s":748.72,"end_s":756.079,"text":"that would be paired with those processors but obtaine didn't arrive","speaker":null,"is_sponsor":0},{"start_s":752.36,"end_s":758.839,"text":"until Cascade Lake which used 2933 megat","speaker":null,"is_sponsor":0},{"start_s":756.079,"end_s":764.92,"text":"transfer per second dims that meant that by choosing optain you would be giving","speaker":null,"is_sponsor":0},{"start_s":761.399,"end_s":767.76,"text":"up memory bandwidth to every application","speaker":null,"is_sponsor":0},{"start_s":764.92,"end_s":774.92,"text":"that doesn't need the extra capacity that is not ideal also in 2017 there was","speaker":null,"is_sponsor":0},{"start_s":772.24,"end_s":782.04,"text":"a global drram shortage as phones like the Samsung Galaxy S6 Google pixel and","speaker":null,"is_sponsor":0},{"start_s":777.839,"end_s":784.079,"text":"HTC1 M9 started using ddr4 while Samsung","speaker":null,"is_sponsor":0},{"start_s":782.04,"end_s":788.92,"text":"and Micron were struggling to ramp up production 16 gigs of RAM hit prices of","speaker":null,"is_sponsor":0},{"start_s":787.199,"end_s":794.199,"text":"over $200 that would have been a perfect","speaker":null,"is_sponsor":0},{"start_s":791.32,"end_s":800.24,"text":"opportunity for an almost RAM product at a lower price except that by 2019 that","speaker":null,"is_sponsor":0},{"start_s":797.72,"end_s":805.36,"text":"same 16 gigs of RAM was down to more like a hundo also remember how we","speaker":null,"is_sponsor":0},{"start_s":802.6,"end_s":809.639,"text":"mentioned that each stick of obtained PM requires a stick of RAM to pair with it","speaker":null,"is_sponsor":0},{"start_s":807.56,"end_s":814.44,"text":"in order for it to work well yeah so companies that were looking","speaker":null,"is_sponsor":0},{"start_s":812.279,"end_s":820.32,"text":"into optain they weren't just comparing the price of opan versus RAM they had to","speaker":null,"is_sponsor":0},{"start_s":816.88,"end_s":822.519,"text":"look at the cost of an optain module and","speaker":null,"is_sponsor":0},{"start_s":820.32,"end_s":827.639,"text":"a stick of RAM compared to just getting two sticks of RAM that uh oh by the way","speaker":null,"is_sponsor":0},{"start_s":825.16,"end_s":833.199,"text":"are going to run faster Tom's Hardware has an article from 2019 about the","speaker":null,"is_sponsor":0},{"start_s":830.0,"end_s":837.48,"text":"pricing quoting a single stick of this","speaker":null,"is_sponsor":0},{"start_s":833.199,"end_s":840.639,"text":"512 gig optain at a cool","speaker":null,"is_sponsor":0},{"start_s":837.48,"end_s":844.399,"text":"$675 meaning that this server that we","speaker":null,"is_sponsor":0},{"start_s":840.639,"end_s":847.8,"text":"casually lost when it was new had","speaker":null,"is_sponsor":0},{"start_s":844.399,"end_s":851.36,"text":"$81,000 worth of optane in it that","speaker":null,"is_sponsor":0},{"start_s":847.8,"end_s":855.24,"text":"sounds like a lot because it is but in","speaker":null,"is_sponsor":0},{"start_s":851.36,"end_s":856.68,"text":"2019 a single stick of 128 gigs of ECC","speaker":null,"is_sponsor":0},{"start_s":855.24,"end_s":861.959,"text":"memory was roughly $4500 meaning optain was only about","speaker":null,"is_sponsor":0},{"start_s":859.56,"end_s":866.839,"text":"onethird of the price so wait hold on a second that was in 2019 that still","speaker":null,"is_sponsor":0},{"start_s":864.279,"end_s":872.24,"text":"sounds pretty good I mean the demo we just did looked pretty good optained for","speaker":null,"is_sponsor":0},{"start_s":869.199,"end_s":874.759,"text":"the win right well I do love your","speaker":null,"is_sponsor":0},{"start_s":872.24,"end_s":879.88,"text":"optimism remember guys we spoiled the ending earlier and everyone dies but it","speaker":null,"is_sponsor":0},{"start_s":877.6,"end_s":886.399,"text":"doesn't have to be a total loss there's maybe a valuable lesson here for the","speaker":null,"is_sponsor":0},{"start_s":881.88,"end_s":888.56,"text":"industry to maybe learn this time Intel","speaker":null,"is_sponsor":0},{"start_s":886.399,"end_s":895.16,"text":"if you're listening and everyone you need to stop locking your products","speaker":null,"is_sponsor":0},{"start_s":891.92,"end_s":898.44,"text":"because I didn't buy enough of your","speaker":null,"is_sponsor":0},{"start_s":895.16,"end_s":900.68,"text":"products the Cascade Lake CPUs that did","speaker":null,"is_sponsor":0},{"start_s":898.44,"end_s":906.199,"text":"eventually sh with obtaine had two variants a standard version and a large","speaker":null,"is_sponsor":0},{"start_s":903.88,"end_s":911.0,"text":"memory footprint version in the case of the Zeon plattinum 8260 that we've got","speaker":null,"is_sponsor":0},{"start_s":908.839,"end_s":916.36,"text":"in this server The Standard Version supported only 1 tab of RAM a number","speaker":null,"is_sponsor":0},{"start_s":914.16,"end_s":920.8,"text":"that's pretty easy to hit with regular old Dam meaning that if you wanted to","speaker":null,"is_sponsor":0},{"start_s":918.72,"end_s":926.959,"text":"really take advantage of optane you needed the zeeon Platinum 8260 L well I","speaker":null,"is_sponsor":0},{"start_s":925.0,"end_s":933.16,"text":"mean that's no problem right I mean how much more could it","speaker":null,"is_sponsor":0},{"start_s":930.56,"end_s":939.959,"text":"$3,400 oh yeah and since you're buying two of them it's an extra","speaker":null,"is_sponsor":0},{"start_s":936.44,"end_s":943.399,"text":"$6800 before you buy a single flipping","speaker":null,"is_sponsor":0},{"start_s":939.959,"end_s":946.44,"text":"optane module can see why they used L as","speaker":null,"is_sponsor":0},{"start_s":943.399,"end_s":948.12,"text":"the suffix for those adding insult to","speaker":null,"is_sponsor":0},{"start_s":946.44,"end_s":953.72,"text":"injury you know what also happened between 2017 and 2019 while Intel was","speaker":null,"is_sponsor":0},{"start_s":951.279,"end_s":959.6,"text":"struggling to get optane out of the door AMD launched epic Rome and then epic","speaker":null,"is_sponsor":0},{"start_s":956.56,"end_s":963.04,"text":"Milan featuring more cores more memory","speaker":null,"is_sponsor":0},{"start_s":959.6,"end_s":965.279,"text":"channels support for four ttes of RAM","speaker":null,"is_sponsor":0},{"start_s":963.04,"end_s":971.6,"text":"without a silly large memory footprint tax oh and by the way they were also","speaker":null,"is_sponsor":0},{"start_s":968.079,"end_s":974.199,"text":"cheaper this added up to not a whole lot","speaker":null,"is_sponsor":0},{"start_s":971.6,"end_s":977.959,"text":"of people buying optane and Micron who owned the Fab where all the optane was","speaker":null,"is_sponsor":0},{"start_s":975.92,"end_s":983.839,"text":"being built finally said you know what enough is enough it was and still is a","speaker":null,"is_sponsor":0},{"start_s":980.92,"end_s":989.48,"text":"very cool technology but in 2021 Micron figured you know it be a lot cooler how","speaker":null,"is_sponsor":0},{"start_s":986.6,"end_s":996.079,"text":"about not losing 400 million ion dollar a year so one year later Intel killed","speaker":null,"is_sponsor":0},{"start_s":993.079,"end_s":999.279,"text":"optain which um raises one interesting","speaker":null,"is_sponsor":0},{"start_s":996.079,"end_s":1001.44,"text":"question why can you still buy it well","speaker":null,"is_sponsor":0},{"start_s":999.279,"end_s":1007.36,"text":"about that even though there hasn't been a Fab making the stuff for years now in","speaker":null,"is_sponsor":0},{"start_s":1004.6,"end_s":1013.48,"text":"20122 Intel revealed that they still had over half a billion dollars of inventory","speaker":null,"is_sponsor":0},{"start_s":1010.8,"end_s":1018.12,"text":"left over and they haven't exactly been pushing it that hard I mean what is this","speaker":null,"is_sponsor":0},{"start_s":1015.6,"end_s":1021.88,"text":"pricing Intel do you want this on your books forever","speaker":null,"is_sponsor":0},{"start_s":1019.759,"end_s":1028.28,"text":"there are some awesome closeout deals out there these 16 gig accelerators are","speaker":null,"is_sponsor":0},{"start_s":1024.76,"end_s":1030.4,"text":"amazing there are go-to drives for a DIY","speaker":null,"is_sponsor":0},{"start_s":1028.28,"end_s":1035.6,"text":"Network Appliance or a NZ because they're literally five bucks and opan","speaker":null,"is_sponsor":0},{"start_s":1033.4,"end_s":1040.12,"text":"features substantially more right endurance than nand which is great if","speaker":null,"is_sponsor":0},{"start_s":1037.959,"end_s":1044.919,"text":"you want to constantly retain and overwrite comprehensive system logs and","speaker":null,"is_sponsor":0},{"start_s":1042.76,"end_s":1049.88,"text":"this one on new egg is still among if not the best drive on the market even if","speaker":null,"is_sponsor":0},{"start_s":1047.76,"end_s":1054.32,"text":"it is starting to show its age in some ways for example it'll have outstanding","speaker":null,"is_sponsor":0},{"start_s":1052.2,"end_s":1060.16,"text":"latency like we talked about before but it runs at a quarter the maximum speed","speaker":null,"is_sponsor":0},{"start_s":1057.48,"end_s":1065.6,"text":"of a modern Gen 5 Drive which is a bit of a yikes so in","speaker":null,"is_sponsor":0},{"start_s":1063.12,"end_s":1070.6,"text":"conclusion Intel do you want this thing back we uh honestly really don't know","speaker":null,"is_sponsor":0},{"start_s":1068.4,"end_s":1076.0,"text":"what to do with it but I do know how to segue to our sponsor delete me at LMG we","speaker":null,"is_sponsor":0},{"start_s":1074.12,"end_s":1079.28,"text":"generally believe that unless it gets you in trouble with the law what you do","speaker":null,"is_sponsor":1},{"start_s":1077.72,"end_s":1084.44,"text":"on the Internet is your your business and yours alone no judgment yes that","speaker":null,"is_sponsor":1},{"start_s":1081.919,"end_s":1088.36,"text":"means you too Ralph you're safe this time and delete me thinks the same so","speaker":null,"is_sponsor":1},{"start_s":1086.88,"end_s":1092.52,"text":"that's why they make it their mission to keep your information from falling into","speaker":null,"is_sponsor":1},{"start_s":1090.48,"end_s":1096.799,"text":"the wrong hands their software and expert squads scour the internet looking","speaker":null,"is_sponsor":1},{"start_s":1094.84,"end_s":1101.64,"text":"for your data and can sweep it away in a heartbeat your phone number popping up","speaker":null,"is_sponsor":1},{"start_s":1098.64,"end_s":1103.88,"text":"in a cold caller list deleted your email","speaker":null,"is_sponsor":1},{"start_s":1101.64,"end_s":1109.12,"text":"cced in a copypaste template telling you to click this link to lock your bank","speaker":null,"is_sponsor":1},{"start_s":1105.88,"end_s":1111.679,"text":"account deleted delete me averages over","speaker":null,"is_sponsor":1},{"start_s":1109.12,"end_s":1115.24,"text":"2,000 data pieces gone for a customer in their first 2 years imagine doing all","speaker":null,"is_sponsor":1},{"start_s":1113.919,"end_s":1119.559,"text":"that manually yeah no thanks I I won't so","speaker":null,"is_sponsor":1},{"start_s":1117.679,"end_s":1124.84,"text":"head on over to the link below use code LT for 20% off a subscription and start","speaker":null,"is_sponsor":1},{"start_s":1122.679,"end_s":1127.84,"text":"locking your personal data down if you guys enjoyed this video maybe you","speaker":null,"is_sponsor":1},{"start_s":1126.4,"end_s":1132.919,"text":"watched the old one where we originally unboxed this Beast it was a lot newer","speaker":null,"is_sponsor":0},{"start_s":1131.48,"end_s":1135.919,"text":"and less dead then","speaker":null,"is_sponsor":0}],"full_text":"we just kicked off Spring cleaning at our studio which wouldn't normally be a video except we came across this a $15,000 server with two CPUs eight ssds and a whopping 6.3 terabytes of RAM when we got this from Intel 3 years ago we did a quick unboxing promising a deeper dive into some of its more exotic features and then promptly forgot about it well that RAM I showed you guys is is n RAM at all but optain persistent memory modules you might know that Intel's optain business was sadly shuttered in June of 2022 which means the contacts who originally sent us this have sadly moved on we on the other hand haven't so all these years later I am finally going to do what I said I was going to do and finish building the rer piece I mean sorry I mean digging into what made optain so special and cool and what ultimately killed it just like I'm going to kill this segue to our sponsor ug green they're getting into the Nas Game and they claimed their new Nas sync dxp 4800 plus is the most powerful Nas under $500 it's got four Bays for storage a 12th Gen 5 Core Intel processor 8 gigs of ddr5 memory that's expandable and more check it out at the link down below before we go any further some of you probably need a refresher isn't Intel optain and SSD what's it doing in a RAM slot well optane was more of a family than an individual product ranging from inexpensive hard drive accelerators for pre-builts where the manufacturer was too cheap to install a real SSD to incredibly low latency not to mention expensive storage for the fastest servers in existence what all of these uses had in common though was they looked like conventional memory and storage devices but functioned somewhere in between and that's exactly what we're looking at here this appears to be a normal SSD but the 3D Cross Point chips inside it have just 100th the latency of regular Nan flash as for this guy well it looks like a stick of ddr4 memory but it's actually an Intel optain persistent memory series 100 module with a whopping 512 gigs of storage on it and this server has 12 of them for a total of 6 tabes that's enough to fit nearly 12 High bit rate Floatplane exclusives solely in system memory wait a second lus memory I thought you just said it was storage I did but the simplest way to take advantage of it is in memory mode where your optain modules just show up to your operating system as a whole whack load of RAM now the bad thing about this mode is that it forces optane to have one of the big downsides of RAM for security reasons every time an optain module in memory mode gets restarted it generates a new cryptographic key effectively wiping all of the data that it contained the good news is that optane can handle many more wipes than regular ssds so this is unlikely to harm it and what's also cool is that no special coding is needed to immediately use memory mode and the CPU's memory controller will even automatically move colder data off of the memory onto the optain and vice versa let me show you how this would work in a demanding professional application right now you're looking at solid works flow simulator but we aren't simulating anything at the moment because first we need to generate a mesh which is essentially a 3D Space full of data sampling points where some fluid let's say air is going to interact with some object say this heat sink it's not using that much RAM though what 45 gigs 48 gigs that's a lot of RAM okay it's a lot of RAM but it's 2% of what we have the issue is that it just takes hours for the CPU to process a large enough mesh like this for it to fill up all of that RAM let alone the optain that's in there and this is a really silly way of doing this so what you're saying is flow doesn't need that much RAM obtaine is pointless no no no Flo Sim does need heaps and heaps of RAM just a model like this doesn't necessarily if we were trying to run something that's super complex like crashing a car into a barrier having terabytes of memory could be the difference between a finishing in a day and a finishing in a week of course though this isn't memory its latency is several times higher which would obviously impact performance the question is though how much to find out we came up with a rather terrible idea why don't we just remove a bunch of the actual RAM so that the system has no choice but to use the obtaine and then we can do a before and after it's not going to do anything is it nope oh jeez there goes the alarm wait maybe there's no way no sadly Intel thought of that and requires each stick of obtain pm to be paired with a stick of RAM in order for the system to function at all and they have a recommended ratio of 4 to1 optained to RAM for Optimal Performance ours however it's more like a 16 to1 ratio and the server came straight from Intel so what do we do with the rest of it as it turns out many customers simply used higher ratios but there are some other ways to take advantage of the persistent part of our persistent memory app direct mode and storage mode which Alex is showing us now yes app direct mode exposes the optain directly to the application which can use it like storage RAM or somewhere in between unfortunately we aren't able to show this off because doing so would require us to code our own program that explicitly takes advantage of it and this is a task that almost no company's worth billions of dollars found to be worthwhile so doing it for a YouTube video would have a dubious Roi to say the least what we can show you is storage mode have you ever wondered what would happen if you could plug your SSD into a high-speed memory slot well basically this storage mode presents the obtained tier operating system much like an SSD just with super low latency compared to traditional Mand flash setting this bit up though was what caused this project to be stalled for months because we just couldn't figure out how to do it not because Alex is dumb or because I'm dumb but rather because the BIOS on this Intel motherboard is so poorly organized now okay okay sorry this is going to be a bit of a tangent but motherboard manufactures can you please figure your shiz out I mean we have this industrywide problem where every single motherboard maker calls the exact same setting something ever so slightly different and then puts it in a different place meaning even if you are quite knowledgeable and not dumb and you know exactly what you're looking for there's a solid chance you won't be able to find it we were easily able to figure out how to use app direct mode on Dell super micro Lenovo and HP server boards since they had decent documentation but no not the Intel one we even called up Patrick from serve the home who literally wrote the guide on how to do this and he couldn't figure it out either okay look at this Lis I'm going to go back to the main menu we're looking for the memory controller spot where do you think that is well I would go to Advanced and then I would probably go to memory configuration so this is why we needed Emily to help us find it yes it is under PCI configuration um option ROM controller and that's where the memory controller is of course I can't believe we didn't think of that Anyway by using storage mode we're able to select how much of the optain we want to be presented as an SSD and we can create volumes with it much like with a raid array with the maximum performance occurring when you interleave across multiple optained dims that are operating on the same CPU which essentially creates a raid zero array on opan now as you might have guessed this does come with the risk of data loss so if you don't care as much about performance you might want to mirror the data across both CPUs or I don't know maybe just buy an SSD but all of that aside the coolest configuration is mixed mode this allows you to set a target for how much of your optain will be storage and how much will be RAM creating a Best of Both Worlds situation where the BIOS handles all of the complex bits and you get both cheap RAM and super low latency storage all right what's your memory percentage goal what do you mean goal it's doesn't really do exact it just kind of gets close to the percentage that you want I think we all know the answer to that nice so we reboot need sorry seemed mad okay all right no you don't seem mad you seem rightfully like we need to discuss this come on come on create name space here we go there we go how about now there we go I love how surprised it is it's making a YouTube thumbnail face speaking of which we're working on a really cool video now that YouTube has AB testing for thumbnails Maria is creating a like cringe YouTuber face version of every thumbnail for a little bit and then just like a nice relaxed one and then we're going to make a video about which ones people actually prefer whatever they say they prefer it could change our thumbnail practices there we go all right okay what we're looking at right now is our G Drive which is a conventional nbme SSD and our o Drive which is our optain drive and this measure is seconds per transfer which is essentially the latency of each operation on the drive now what we're going to do is we're going to run Crystal disc mark on both of these drives at the same time and theoretically yes yep the regular NVMe is way more which is bad o is opan opan which makes sense because it barely even appears that's how low the latency of this is which doesn't matter for everything and in fact if we have a look at our Crystal dis Mark results it's not that fast in terms of sequential transfer speeds it's just that it's really really responsive wow we've done it we go okay we can actually see what the crap we're looking at now here we go this is what we expect to see all three tests are running right now there we go yes and our SATA is much higher in terms of latency not to mention that it can be very inconsistent see that initial Spike when we first hit it that's a yikes and while NVMe is a lot better it doesn't have that super super flat line when all of them are running the same test that we see with optane where the latency is negligible which which can be a huge benefit for certain applications and not terribly important for others which is cool in some cases really cool so then why does optain no longer exist the answer is many many reasons the first and biggest problem is that optin arrived 2 years late it was supposed to come with Skylake in 2017 with speeds that matched the ddr4 2666 that would be paired with those processors but obtaine didn't arrive until Cascade Lake which used 2933 megat transfer per second dims that meant that by choosing optain you would be giving up memory bandwidth to every application that doesn't need the extra capacity that is not ideal also in 2017 there was a global drram shortage as phones like the Samsung Galaxy S6 Google pixel and HTC1 M9 started using ddr4 while Samsung and Micron were struggling to ramp up production 16 gigs of RAM hit prices of over $200 that would have been a perfect opportunity for an almost RAM product at a lower price except that by 2019 that same 16 gigs of RAM was down to more like a hundo also remember how we mentioned that each stick of obtained PM requires a stick of RAM to pair with it in order for it to work well yeah so companies that were looking into optain they weren't just comparing the price of opan versus RAM they had to look at the cost of an optain module and a stick of RAM compared to just getting two sticks of RAM that uh oh by the way are going to run faster Tom's Hardware has an article from 2019 about the pricing quoting a single stick of this 512 gig optain at a cool $675 meaning that this server that we casually lost when it was new had $81,000 worth of optane in it that sounds like a lot because it is but in 2019 a single stick of 128 gigs of ECC memory was roughly $4500 meaning optain was only about onethird of the price so wait hold on a second that was in 2019 that still sounds pretty good I mean the demo we just did looked pretty good optained for the win right well I do love your optimism remember guys we spoiled the ending earlier and everyone dies but it doesn't have to be a total loss there's maybe a valuable lesson here for the industry to maybe learn this time Intel if you're listening and everyone you need to stop locking your products because I didn't buy enough of your products the Cascade Lake CPUs that did eventually sh with obtaine had two variants a standard version and a large memory footprint version in the case of the Zeon plattinum 8260 that we've got in this server The Standard Version supported only 1 tab of RAM a number that's pretty easy to hit with regular old Dam meaning that if you wanted to really take advantage of optane you needed the zeeon Platinum 8260 L well I mean that's no problem right I mean how much more could it $3,400 oh yeah and since you're buying two of them it's an extra $6800 before you buy a single flipping optane module can see why they used L as the suffix for those adding insult to injury you know what also happened between 2017 and 2019 while Intel was struggling to get optane out of the door AMD launched epic Rome and then epic Milan featuring more cores more memory channels support for four ttes of RAM without a silly large memory footprint tax oh and by the way they were also cheaper this added up to not a whole lot of people buying optane and Micron who owned the Fab where all the optane was being built finally said you know what enough is enough it was and still is a very cool technology but in 2021 Micron figured you know it be a lot cooler how about not losing 400 million ion dollar a year so one year later Intel killed optain which um raises one interesting question why can you still buy it well about that even though there hasn't been a Fab making the stuff for years now in 20122 Intel revealed that they still had over half a billion dollars of inventory left over and they haven't exactly been pushing it that hard I mean what is this pricing Intel do you want this on your books forever there are some awesome closeout deals out there these 16 gig accelerators are amazing there are go-to drives for a DIY Network Appliance or a NZ because they're literally five bucks and opan features substantially more right endurance than nand which is great if you want to constantly retain and overwrite comprehensive system logs and this one on new egg is still among if not the best drive on the market even if it is starting to show its age in some ways for example it'll have outstanding latency like we talked about before but it runs at a quarter the maximum speed of a modern Gen 5 Drive which is a bit of a yikes so in conclusion Intel do you want this thing back we uh honestly really don't know what to do with it but I do know how to segue to our sponsor delete me at LMG we generally believe that unless it gets you in trouble with the law what you do on the Internet is your your business and yours alone no judgment yes that means you too Ralph you're safe this time and delete me thinks the same so that's why they make it their mission to keep your information from falling into the wrong hands their software and expert squads scour the internet looking for your data and can sweep it away in a heartbeat your phone number popping up in a cold caller list deleted your email cced in a copypaste template telling you to click this link to lock your bank account deleted delete me averages over 2,000 data pieces gone for a customer in their first 2 years imagine doing all that manually yeah no thanks I I won't so head on over to the link below use code LT for 20% off a subscription and start locking your personal data down if you guys enjoyed this video maybe you watched the old one where we originally unboxed this Beast it was a lot newer and less dead then"}