{"video_id":"uHAfTty9UWY","title":"I've never seen anything like this... - 6TB of RAM in one PC!","channel":"Linus Tech Tips","show":"Linus Tech Tips","published_at":"2021-05-05T14:53:29Z","duration_s":1041,"segments":[{"start_s":0.08,"end_s":6.96,"text":"that right there is a 512","speaker":null,"is_sponsor":0},{"start_s":4.88,"end_s":11.36,"text":"Gigabyte dim inside this box","speaker":null,"is_sponsor":0},{"start_s":9.36,"end_s":14.48,"text":"is a server with somewhere in the neighborhood","speaker":null,"is_sponsor":0},{"start_s":12.559,"end_s":19.199,"text":"of three to six terabytes of memory","speaker":null,"is_sponsor":0},{"start_s":16.64,"end_s":24.16,"text":"sort of this gives it the capability to run workloads like simulations with","speaker":null,"is_sponsor":0},{"start_s":21.84,"end_s":29.359,"text":"never-before-seen complexity without suffering large performance penalties","speaker":null,"is_sponsor":0},{"start_s":26.16,"end_s":30.56,"text":"for swapping data in and out of its bulk","speaker":null,"is_sponsor":0},{"start_s":29.359,"end_s":35.2,"text":"storage mostly now they're really savvy among","speaker":null,"is_sponsor":0},{"start_s":32.48,"end_s":39.92,"text":"you probably already have an idea of what's in here but for everyone else","speaker":null,"is_sponsor":0},{"start_s":38.48,"end_s":45.36,"text":"let me tell you something what if i said that you could take an","speaker":null,"is_sponsor":0},{"start_s":42.559,"end_s":49.68,"text":"SSD and put it right into your system memory slot instead of RAM","speaker":null,"is_sponsor":0},{"start_s":57.36,"end_s":63.039,"text":"today's video is brought to you by pulseway those guys are always all over","speaker":null,"is_sponsor":0},{"start_s":60.64,"end_s":66.799,"text":"our server content and why not pulseway is a great way to remotely manage your","speaker":null,"is_sponsor":0},{"start_s":64.799,"end_s":70.24,"text":"servers and other it infrastructure check them out at the link below to","speaker":null,"is_sponsor":0},{"start_s":68.4,"end_s":74.0,"text":"learn more now i'm not really expecting this thing","speaker":null,"is_sponsor":0},{"start_s":72.4,"end_s":80.08,"text":"to look unusual but","speaker":null,"is_sponsor":0},{"start_s":76.24,"end_s":83.04,"text":"it is a very very unusual","speaker":null,"is_sponsor":0},{"start_s":80.08,"end_s":83.04,"text":"accessory kit","speaker":null,"is_sponsor":0},{"start_s":83.68,"end_s":90.96,"text":"whatever this is what the hell is this","speaker":null,"is_sponsor":0},{"start_s":88.88,"end_s":96.159,"text":"on the one end it looks like a little tiny pci express six pin and on the","speaker":null,"is_sponsor":0},{"start_s":93.759,"end_s":98.84,"text":"other end it looks like a little tiny zeta connector","speaker":null,"is_sponsor":0},{"start_s":97.6,"end_s":104.0,"text":"what the heck it's labeled odd so optical drive","speaker":null,"is_sponsor":0},{"start_s":102.479,"end_s":107.04,"text":"what does this thing have an optical drive you're gonna be kidding me","speaker":null,"is_sponsor":0},{"start_s":107.52,"end_s":111.92,"text":"oh wow it's a skinny boy","speaker":null,"is_sponsor":0},{"start_s":112.479,"end_s":120.96,"text":"it's a 1u so this is a super slim server designed to be rack mounted with very","speaker":null,"is_sponsor":0},{"start_s":118.079,"end_s":124.399,"text":"high densities oh it's heavier than it looks uh one second","speaker":null,"is_sponsor":0},{"start_s":123.119,"end_s":132.239,"text":"all right is there anything else important in here let's go with no sweet ah","speaker":null,"is_sponsor":0},{"start_s":131.12,"end_s":137.599,"text":"okay oh somebody voided the warranty before i","speaker":null,"is_sponsor":0},{"start_s":135.36,"end_s":142.319,"text":"got to it you know i was wondering why it comes with a safety data sheet and a","speaker":null,"is_sponsor":0},{"start_s":139.599,"end_s":147.04,"text":"big warning label on the side turns out it's got a lithium battery","speaker":null,"is_sponsor":0},{"start_s":144.72,"end_s":150.48,"text":"a cr whatever you know one of those little button cells for making sure the","speaker":null,"is_sponsor":0},{"start_s":148.959,"end_s":154.0,"text":"BIOS doesn't lose its data while the system is powered off","speaker":null,"is_sponsor":0},{"start_s":152.0,"end_s":158.08,"text":"naturally a server has a very different port configuration compared to a desktop","speaker":null,"is_sponsor":0},{"start_s":156.08,"end_s":161.28,"text":"or a workstation so back here we've got a couple pci express slots what looks","speaker":null,"is_sponsor":0},{"start_s":160.0,"end_s":166.72,"text":"like some kind of mezzanine car will have to pop it open three usb 3s that's","speaker":null,"is_sponsor":0},{"start_s":164.4,"end_s":171.2,"text":"it and then four network ports one of which is for management so you can","speaker":null,"is_sponsor":0},{"start_s":168.56,"end_s":174.72,"text":"actually perform BIOS updates install operating systems all that kind of low","speaker":null,"is_sponsor":0},{"start_s":173.519,"end_s":179.12,"text":"level stuff monitor temperatures and fans and all","speaker":null,"is_sponsor":0},{"start_s":176.959,"end_s":182.239,"text":"that good stuff over the network rather than being plugged in directly if you do","speaker":null,"is_sponsor":0},{"start_s":180.48,"end_s":187.76,"text":"need to plug in directly of course it's got vga out so you can get that graphics","speaker":null,"is_sponsor":0},{"start_s":186.08,"end_s":191.28,"text":"you know connection on there","speaker":null,"is_sponsor":0},{"start_s":189.76,"end_s":194.48,"text":"for storage what are we looking at here oh wow","speaker":null,"is_sponsor":0},{"start_s":193.12,"end_s":199.519,"text":"oh they went and they put some good stuff in here neat","speaker":null,"is_sponsor":0},{"start_s":197.36,"end_s":205.44,"text":"well we've got at least two of Intel's dc p46 10 NVMe ssds","speaker":null,"is_sponsor":0},{"start_s":203.2,"end_s":210.239,"text":"so that's cool that answers my question as to whether","speaker":null,"is_sponsor":0},{"start_s":207.36,"end_s":214.4,"text":"these were NVMe or SATA base more envy oh","speaker":null,"is_sponsor":0},{"start_s":212.879,"end_s":219.519,"text":"no so these are higher capacity lower","speaker":null,"is_sponsor":0},{"start_s":216.799,"end_s":224.319,"text":"performance 4610s these are SATA","speaker":null,"is_sponsor":0},{"start_s":222.319,"end_s":228.48,"text":"it has taken all of my self-control to not open this thing up yet i actually","speaker":null,"is_sponsor":0},{"start_s":226.0,"end_s":230.959,"text":"don't even know exactly what CPU is in this freaking thing","speaker":null,"is_sponsor":0},{"start_s":229.84,"end_s":236.08,"text":"in fact okay that's interesting i didn't know","speaker":null,"is_sponsor":0},{"start_s":233.04,"end_s":239.439,"text":"that there were two cpus in this thing","speaker":null,"is_sponsor":0},{"start_s":236.08,"end_s":241.48,"text":"we requested a demo unit back in july so","speaker":null,"is_sponsor":0},{"start_s":239.439,"end_s":246.879,"text":"i'm thinking they are probably","speaker":null,"is_sponsor":0},{"start_s":243.2,"end_s":249.04,"text":"cascade lake cpus with barlow pass dimms","speaker":null,"is_sponsor":0},{"start_s":246.879,"end_s":253.28,"text":"but they could also be first gen apache pass dimms which are about 80 percent as","speaker":null,"is_sponsor":0},{"start_s":251.439,"end_s":257.759,"text":"performant to be clear they're still going to be pretty flipping high","speaker":null,"is_sponsor":0},{"start_s":254.48,"end_s":260.079,"text":"performance and i'm expecting them to be","speaker":null,"is_sponsor":0},{"start_s":257.759,"end_s":262.4,"text":"pretty high capacity let's have a look here","speaker":null,"is_sponsor":0},{"start_s":261.199,"end_s":271.44,"text":"oh oh my check this out ladies and gentlemen","speaker":null,"is_sponsor":0},{"start_s":266.56,"end_s":274.4,"text":"that right there is a 512","speaker":null,"is_sponsor":0},{"start_s":271.44,"end_s":280.0,"text":"Gigabyte dim but notice that i didn't say 512","speaker":null,"is_sponsor":0},{"start_s":277.6,"end_s":285.12,"text":"Gigabyte memory module if you look closely at all the memory","speaker":null,"is_sponsor":0},{"start_s":282.72,"end_s":290.8,"text":"that's stacked up in this thing well do the math if all of these were 512 gigs","speaker":null,"is_sponsor":0},{"start_s":288.56,"end_s":294.08,"text":"that would be 12 terabytes of memory that's more than these xeon cpus even","speaker":null,"is_sponsor":0},{"start_s":292.96,"end_s":301.04,"text":"support so if you look closely check this out","speaker":null,"is_sponsor":0},{"start_s":297.84,"end_s":304.08,"text":"half of them are traditional ddr4 memory","speaker":null,"is_sponsor":0},{"start_s":301.04,"end_s":307.759,"text":"modules so these ones right here 32 gig","speaker":null,"is_sponsor":0},{"start_s":304.08,"end_s":309.12,"text":"ecc registered dimms from micron and the","speaker":null,"is_sponsor":0},{"start_s":307.759,"end_s":318.16,"text":"other half are this this is Intel's dc pmm or data center","speaker":null,"is_sponsor":0},{"start_s":314.16,"end_s":320.479,"text":"persistent memory module and on these","speaker":null,"is_sponsor":0},{"start_s":318.16,"end_s":324.16,"text":"it is not dram there's no memory on them i mean there's","speaker":null,"is_sponsor":0},{"start_s":322.639,"end_s":329.919,"text":"memory in the sense that you can like store things on them and the system can","speaker":null,"is_sponsor":0},{"start_s":326.479,"end_s":332.24,"text":"work with that data but no dram memory","speaker":null,"is_sponsor":0},{"start_s":329.919,"end_s":337.199,"text":"so it actually uses the same optane chips that you would find in something","speaker":null,"is_sponsor":0},{"start_s":334.16,"end_s":339.199,"text":"like a high performance storage drive or","speaker":null,"is_sponsor":0},{"start_s":337.199,"end_s":346.16,"text":"one of those little obtain memory modules that Intel sells as like a nitro","speaker":null,"is_sponsor":0},{"start_s":342.24,"end_s":346.16,"text":"boost for your mechanical hard drive","speaker":null,"is_sponsor":0},{"start_s":346.88,"end_s":350.24,"text":"oh dear lord no","speaker":null,"is_sponsor":0},{"start_s":351.199,"end_s":359.68,"text":"oh my god how much does it cost wow what a good question um well i think i found","speaker":null,"is_sponsor":0},{"start_s":357.039,"end_s":364.0,"text":"a four pack of these modules for nine grand","speaker":null,"is_sponsor":0},{"start_s":360.96,"end_s":366.639,"text":"uh so we have 12 of them","speaker":null,"is_sponsor":0},{"start_s":364.0,"end_s":370.639,"text":"just under 30 dollars for the optane modules alone got probably","speaker":null,"is_sponsor":0},{"start_s":368.72,"end_s":374.639,"text":"another couple grand in regular memory let's call it 30 grand total in memory","speaker":null,"is_sponsor":0},{"start_s":373.039,"end_s":378.639,"text":"depending on what cpus these are they could be anywhere from you know five to","speaker":null,"is_sponsor":0},{"start_s":376.96,"end_s":381.919,"text":"ten grand each i think it's pretty safe to say that","speaker":null,"is_sponsor":0},{"start_s":380.319,"end_s":386.479,"text":"this whole thing is somewhere in the neighborhood of 40 to 60 000 us dollars","speaker":null,"is_sponsor":0},{"start_s":384.88,"end_s":390.16,"text":"so no Intel will not be leaving it with us but we get to play with it","speaker":null,"is_sponsor":0},{"start_s":388.639,"end_s":396.4,"text":"it's just trippy you know like it's not that often that i encounter hardware so","speaker":null,"is_sponsor":0},{"start_s":393.199,"end_s":396.4,"text":"high end that i'm just like","speaker":null,"is_sponsor":0},{"start_s":397.12,"end_s":404.56,"text":"but like look at this these are pci express 24x slots ever seen one of those","speaker":null,"is_sponsor":0},{"start_s":402.479,"end_s":409.12,"text":"unless you're in the server space stop probably not i mean they've got them","speaker":null,"is_sponsor":0},{"start_s":406.08,"end_s":412.319,"text":"just adapted to 16x slots but these","speaker":null,"is_sponsor":0},{"start_s":409.12,"end_s":414.24,"text":"expansion slots right here or this ocp","speaker":null,"is_sponsor":0},{"start_s":412.319,"end_s":419.84,"text":"mezzanine spot right here could be used for like super high speed networking um","speaker":null,"is_sponsor":0},{"start_s":418.4,"end_s":424.08,"text":"what else we got oh i answered my question from earlier it looks like","speaker":null,"is_sponsor":0},{"start_s":422.0,"end_s":427.28,"text":"these four slots are actually configured for SATA only based on the connectors","speaker":null,"is_sponsor":0},{"start_s":425.919,"end_s":430.72,"text":"that are in them but i'm","speaker":null,"is_sponsor":0},{"start_s":429.44,"end_s":434.16,"text":"not sure if yeah if you had another board or used a pci express slot it","speaker":null,"is_sponsor":0},{"start_s":432.479,"end_s":440.16,"text":"looks like the backplane does support NVMe just uh it's a universal backplane","speaker":null,"is_sponsor":0},{"start_s":437.44,"end_s":444.0,"text":"but it's not u.3 so you can't just plug in either kind of drive regardless","speaker":null,"is_sponsor":0},{"start_s":442.16,"end_s":447.759,"text":"of what it's hooked up to okay should we power it on","speaker":null,"is_sponsor":0},{"start_s":446.08,"end_s":452.8,"text":"no we shouldn't actually what we should talk about is","speaker":null,"is_sponsor":0},{"start_s":449.599,"end_s":454.319,"text":"how these memory modules are used so","speaker":null,"is_sponsor":0},{"start_s":452.8,"end_s":459.36,"text":"there's a couple of different ways that they can be configured either in app","speaker":null,"is_sponsor":0},{"start_s":457.12,"end_s":466.16,"text":"direct mode where the system actually recognizes the dim as persistent storage","speaker":null,"is_sponsor":0},{"start_s":462.72,"end_s":468.479,"text":"just like a regular SSD but connected to","speaker":null,"is_sponsor":0},{"start_s":466.16,"end_s":472.8,"text":"a high-speed memory interface directly to the CPU","speaker":null,"is_sponsor":0},{"start_s":469.919,"end_s":478.479,"text":"or they can operate in memory mode where the system recognizes them as very very","speaker":null,"is_sponsor":0},{"start_s":475.84,"end_s":483.479,"text":"high capacity memory modules and uses them in exactly the same way now as you","speaker":null,"is_sponsor":0},{"start_s":481.52,"end_s":490.08,"text":"guys can imagine intercompatibility of a memory slot","speaker":null,"is_sponsor":0},{"start_s":485.84,"end_s":491.84,"text":"between dram and storage chips is not","speaker":null,"is_sponsor":0},{"start_s":490.08,"end_s":495.919,"text":"the kind of thing that happens overnight it was actually three and a half years","speaker":null,"is_sponsor":0},{"start_s":493.68,"end_s":501.52,"text":"ago that i first attended an octane briefing at Intel's folsom campus the","speaker":null,"is_sponsor":0},{"start_s":498.479,"end_s":504.0,"text":"idea seemed pretty sound optane comes in","speaker":null,"is_sponsor":0},{"start_s":501.52,"end_s":508.56,"text":"here with lower capacities and higher cost than the nand that's traditionally","speaker":null,"is_sponsor":0},{"start_s":506.16,"end_s":513.76,"text":"found in solid state drives but then higher capacities and lower cost","speaker":null,"is_sponsor":0},{"start_s":511.36,"end_s":517.919,"text":"relative to dram which is what you would normally find on a memory module as for","speaker":null,"is_sponsor":0},{"start_s":516.0,"end_s":523.76,"text":"performance they projected latencies somewhere in between the two but closer","speaker":null,"is_sponsor":0},{"start_s":520.399,"end_s":526.399,"text":"to dram than to nand and the pricing at","speaker":null,"is_sponsor":0},{"start_s":523.76,"end_s":532.08,"text":"least has somewhat held true in the real world i found that it's a little under","speaker":null,"is_sponsor":0},{"start_s":528.64,"end_s":533.6,"text":"half the price of a memory module and","speaker":null,"is_sponsor":0},{"start_s":532.08,"end_s":539.839,"text":"definitely available at higher capacities it should be noted though that these you know retail online prices","speaker":null,"is_sponsor":0},{"start_s":538.0,"end_s":543.2,"text":"are rarely what would be paid by an actual enterprise or a data center","speaker":null,"is_sponsor":0},{"start_s":541.68,"end_s":546.08,"text":"customer oh i didn't really think of this before we fire this up i'm kind of","speaker":null,"is_sponsor":0},{"start_s":544.88,"end_s":550.16,"text":"going to need a boot drive so i'll have to run and grab an m.2 to throw in here","speaker":null,"is_sponsor":0},{"start_s":548.399,"end_s":554.48,"text":"and that's not as crazy as it sounds i mean yes i know Linus this thing is full","speaker":null,"is_sponsor":0},{"start_s":552.8,"end_s":559.2,"text":"of storage why don't you just install an os on it and off you go well","speaker":null,"is_sponsor":0},{"start_s":557.279,"end_s":563.839,"text":"that's not really how a device like this is intended to be used i know it does","speaker":null,"is_sponsor":0},{"start_s":561.04,"end_s":569.839,"text":"have terabytes of storage in both the bays at the front and the memory slots","speaker":null,"is_sponsor":0},{"start_s":566.72,"end_s":572.16,"text":"but this is more of a compute node and","speaker":null,"is_sponsor":0},{"start_s":569.839,"end_s":576.64,"text":"all these tiers of storage are meant to keep the CPU chock full of data to","speaker":null,"is_sponsor":0},{"start_s":574.959,"end_s":581.519,"text":"crunch so that it can run at peak efficiency so you've actually got five","speaker":null,"is_sponsor":0},{"start_s":579.279,"end_s":585.92,"text":"tiers of storage in here you've got the sram so that's your cache on the CPU","speaker":null,"is_sponsor":0},{"start_s":584.0,"end_s":590.08,"text":"you've got your dram which is in half of these memory slots you've got your","speaker":null,"is_sponsor":0},{"start_s":588.0,"end_s":595.44,"text":"octane memory so that's in the other half you've got your NVMe ssds over here","speaker":null,"is_sponsor":0},{"start_s":593.76,"end_s":601.12,"text":"and then finally you've got your SATA ssds over here so whatever the CPU needs","speaker":null,"is_sponsor":0},{"start_s":598.399,"end_s":606.64,"text":"the quickest access to stays closest to it and whatever is less important falls","speaker":null,"is_sponsor":0},{"start_s":603.68,"end_s":609.44,"text":"away onto these slower tiers oh wait","speaker":null,"is_sponsor":0},{"start_s":607.68,"end_s":613.519,"text":"it's not that loud because it's not actually on","speaker":null,"is_sponsor":0},{"start_s":611.68,"end_s":617.29,"text":"fans are powered up even before you turn it on","speaker":null,"is_sponsor":0},{"start_s":614.8,"end_s":622.44,"text":"here we go","speaker":null,"is_sponsor":0},{"start_s":629.04,"end_s":634.8,"text":"that's actually quieter than i expected","speaker":null,"is_sponsor":0},{"start_s":633.04,"end_s":638.399,"text":"it's pretty good oh there it goes","speaker":null,"is_sponsor":0},{"start_s":637.36,"end_s":642.0,"text":"hey it survived","speaker":null,"is_sponsor":0},{"start_s":640.64,"end_s":647.2,"text":"dropping into the BIOS we're running xeon platinum 8260ls and this poor thing","speaker":null,"is_sponsor":0},{"start_s":645.6,"end_s":651.519,"text":"has no idea what's going on with the memory here it's like oh yeah you got uh","speaker":null,"is_sponsor":0},{"start_s":649.6,"end_s":657.92,"text":"three terabytes of RAM except that if we pop in here ah yes","speaker":null,"is_sponsor":0},{"start_s":654.72,"end_s":660.48,"text":"these are the real numbers 384 gigs of","speaker":null,"is_sponsor":0},{"start_s":657.92,"end_s":666.88,"text":"dram and six terabytes of Intel's optane persistent","speaker":null,"is_sponsor":0},{"start_s":663.519,"end_s":669.36,"text":"memory modules now BIOS optimizations to","speaker":null,"is_sponsor":0},{"start_s":666.88,"end_s":673.519,"text":"make this work are important both your settings","speaker":null,"is_sponsor":0},{"start_s":670.56,"end_s":681.04,"text":"and your vendor firmware lenovo seems to recommend anywhere from a 1 to 4 to 1 to","speaker":null,"is_sponsor":0},{"start_s":677.279,"end_s":682.48,"text":"16 ratio of dram to persistent memory","speaker":null,"is_sponsor":0},{"start_s":681.04,"end_s":687.279,"text":"depending on what you're doing and as for Intel's guidance they say that","speaker":null,"is_sponsor":0},{"start_s":684.72,"end_s":692.8,"text":"applications like redis imdb run well with an eight to one config while legacy","speaker":null,"is_sponsor":0},{"start_s":689.68,"end_s":694.959,"text":"databases like microsoft sql runs ideal","speaker":null,"is_sponsor":0},{"start_s":692.8,"end_s":698.72,"text":"in like a four to one config there's also times where two to one works best","speaker":null,"is_sponsor":0},{"start_s":696.88,"end_s":703.519,"text":"if you want to minimize cache misses so that's times when the CPU is trying to","speaker":null,"is_sponsor":0},{"start_s":701.6,"end_s":707.68,"text":"find something in dram but it's already been demoted to persistent memory","speaker":null,"is_sponsor":0},{"start_s":706.56,"end_s":712.64,"text":"i mean this is mind-blowing to me like my mind","speaker":null,"is_sponsor":0},{"start_s":710.079,"end_s":718.0,"text":"was already blown way back in the athlon xp days when i found out that you could","speaker":null,"is_sponsor":0},{"start_s":714.8,"end_s":720.399,"text":"run dual channel with three sticks","speaker":null,"is_sponsor":0},{"start_s":718.0,"end_s":724.32,"text":"if you have one high capacity stick and then two half capacity sticks i was like","speaker":null,"is_sponsor":0},{"start_s":723.04,"end_s":729.44,"text":"what this another level of mind blown totally","speaker":null,"is_sponsor":0},{"start_s":727.44,"end_s":733.68,"text":"different capacities and not even the same kinds of chips on the dimms that's","speaker":null,"is_sponsor":0},{"start_s":732.16,"end_s":739.04,"text":"hilarious this thing is so not designed to boot","speaker":null,"is_sponsor":0},{"start_s":735.839,"end_s":741.839,"text":"off of a local drive my m.2 showed up as","speaker":null,"is_sponsor":0},{"start_s":739.04,"end_s":746.16,"text":"UEFI miscellaneous device in the boot options it was configured to boot from","speaker":null,"is_sponsor":0},{"start_s":743.6,"end_s":749.76,"text":"network which makes way more sense but hopefully it'll do it my poor SSD is","speaker":null,"is_sponsor":0},{"start_s":748.72,"end_s":752.639,"text":"like what is this stuff","speaker":null,"is_sponsor":0},{"start_s":752.8,"end_s":758.959,"text":"we might have to do a fresh install i've got some drivers on this thing that are","speaker":null,"is_sponsor":0},{"start_s":755.92,"end_s":761.04,"text":"not playing nicely AMD ryzen","speaker":null,"is_sponsor":0},{"start_s":758.959,"end_s":766.16,"text":"masterdriver.sis crashed","speaker":null,"is_sponsor":0},{"start_s":763.44,"end_s":771.92,"text":"it was on an AMD system before just installed chipset drivers","speaker":null,"is_sponsor":0},{"start_s":769.279,"end_s":775.44,"text":"so everything is picking up correctly now","speaker":null,"is_sponsor":0},{"start_s":773.12,"end_s":780.56,"text":"here's what i want to know though when i open up task manager","speaker":null,"is_sponsor":0},{"start_s":777.6,"end_s":780.56,"text":"what am i going to see","speaker":null,"is_sponsor":0},{"start_s":781.04,"end_s":789.279,"text":"aha okay so we got 48 CPU cores yeah that's","speaker":null,"is_sponsor":0},{"start_s":786.32,"end_s":793.76,"text":"all as expected pretty sweet and we got","speaker":null,"is_sponsor":0},{"start_s":790.48,"end_s":796.399,"text":"two terabytes apparently of memory","speaker":null,"is_sponsor":0},{"start_s":793.76,"end_s":799.68,"text":"with 4.3 terabytes hardware reserved","speaker":null,"is_sponsor":0},{"start_s":798.48,"end_s":804.16,"text":"for 6.3 terabytes how does this math work","speaker":null,"is_sponsor":0},{"start_s":802.48,"end_s":809.279,"text":"from what i can glean our persistent memory modules seem to be just operating","speaker":null,"is_sponsor":0},{"start_s":806.56,"end_s":814.0,"text":"as expanded system memory but even within that mode there are multiple","speaker":null,"is_sponsor":0},{"start_s":811.44,"end_s":818.639,"text":"modes so there's a bandwidth optimized mode and a latency optimized mode and","speaker":null,"is_sponsor":0},{"start_s":816.88,"end_s":823.2,"text":"then Intel actually came out with a balanced mode after launch that they","speaker":null,"is_sponsor":0},{"start_s":820.8,"end_s":828.8,"text":"said works pretty darn well where it uses the dram as a cache and then the","speaker":null,"is_sponsor":0},{"start_s":826.16,"end_s":833.44,"text":"optane persistent memory as like a large dumping ground giving you dram like","speaker":null,"is_sponsor":0},{"start_s":831.36,"end_s":838.48,"text":"performance depending on the workload even though optane is an order of","speaker":null,"is_sponsor":0},{"start_s":835.44,"end_s":841.04,"text":"magnitude slower in terms of latency","speaker":null,"is_sponsor":0},{"start_s":838.48,"end_s":846.16,"text":"now obviously benchmarking something like this isn't as simple as firing up","speaker":null,"is_sponsor":0},{"start_s":843.6,"end_s":850.079,"text":"cinebench and being like yeah you know","speaker":null,"is_sponsor":0},{"start_s":848.24,"end_s":855.76,"text":"it's really good it's really fast or it's not very good so guys stay tuned","speaker":null,"is_sponsor":0},{"start_s":853.12,"end_s":860.8,"text":"this is just the unboxing making sure it works oh my gosh this thing's crazy and","speaker":null,"is_sponsor":0},{"start_s":858.959,"end_s":864.24,"text":"Anthony or Jake is probably going to end up putting this thing through its paces","speaker":null,"is_sponsor":0},{"start_s":862.32,"end_s":867.92,"text":"over the next little while which raises the question what kind of benchmarks","speaker":null,"is_sponsor":0},{"start_s":866.16,"end_s":873.6,"text":"would they even run who's the audience for this well if you had a very large database","speaker":null,"is_sponsor":0},{"start_s":871.44,"end_s":877.68,"text":"that you wanted to run in memory for extreme performance you could run it in","speaker":null,"is_sponsor":0},{"start_s":875.519,"end_s":883.519,"text":"memory mode if for whatever reason you needed extremely fast storage like a","speaker":null,"is_sponsor":0},{"start_s":881.44,"end_s":887.279,"text":"really fast storage device you could run it in storage mode or block mode","speaker":null,"is_sponsor":0},{"start_s":886.399,"end_s":892.16,"text":"i mean yeah you could also just use optane in","speaker":null,"is_sponsor":0},{"start_s":890.16,"end_s":896.079,"text":"an NVMe device like what we've actually got installed on the front here but the","speaker":null,"is_sponsor":0},{"start_s":894.32,"end_s":900.32,"text":"advantage in this case is that instead of contending with pci express","speaker":null,"is_sponsor":0},{"start_s":898.399,"end_s":905.04,"text":"which is going to be a bottleneck depending what you're doing and an NVMe","speaker":null,"is_sponsor":0},{"start_s":902.8,"end_s":910.24,"text":"protocol that was designed first and foremost for nand you're communicating","speaker":null,"is_sponsor":0},{"start_s":907.6,"end_s":915.199,"text":"with your storage over the much faster memory interface that's built right into","speaker":null,"is_sponsor":0},{"start_s":912.16,"end_s":918.16,"text":"the CPU but get this it's not all boring","speaker":null,"is_sponsor":0},{"start_s":915.199,"end_s":922.72,"text":"stuff like that in 2019 you can see we're just running Windows 10 here guys","speaker":null,"is_sponsor":0},{"start_s":920.639,"end_s":926.399,"text":"microsoft rolled support for this product into Windows 10 allowing it to","speaker":null,"is_sponsor":0},{"start_s":925.279,"end_s":932.24,"text":"be used for rendering simulation and scientific","speaker":null,"is_sponsor":0},{"start_s":929.199,"end_s":935.12,"text":"tasks that are certainly heavy but not","speaker":null,"is_sponsor":0},{"start_s":932.24,"end_s":939.68,"text":"necessarily in the data center so workstations with multiple terabytes of","speaker":null,"is_sponsor":0},{"start_s":938.24,"end_s":943.04,"text":"RAM that could be very interesting for a lot","speaker":null,"is_sponsor":0},{"start_s":941.76,"end_s":950.079,"text":"of people now dims with persistent storage already","speaker":null,"is_sponsor":0},{"start_s":947.36,"end_s":954.8,"text":"exist they're called envy dim but the difference is that instead of having","speaker":null,"is_sponsor":0},{"start_s":952.16,"end_s":957.519,"text":"high speed dram and then slower nand that it can flush to when it's powered","speaker":null,"is_sponsor":0},{"start_s":956.72,"end_s":963.6,"text":"off this is just all optane all the time thanks to its much higher","speaker":null,"is_sponsor":0},{"start_s":962.079,"end_s":969.279,"text":"rate endurance so that's it for today that's the","speaker":null,"is_sponsor":0},{"start_s":966.399,"end_s":973.199,"text":"introduction to this tech holy is it ever cool and we're gonna have a follow","speaker":null,"is_sponsor":0},{"start_s":971.199,"end_s":977.44,"text":"up for you guys where we really put it through its paces and this video is","speaker":null,"is_sponsor":0},{"start_s":975.68,"end_s":983.68,"text":"brought to you of course by the real-time remote monitoring and management software that we use for our","speaker":null,"is_sponsor":0},{"start_s":980.72,"end_s":987.12,"text":"servers pulseway it works for not just servers you can deploy it on","speaker":null,"is_sponsor":0},{"start_s":985.04,"end_s":991.12,"text":"workstations laptops anything it helps you fix problems on the go by sending","speaker":null,"is_sponsor":0},{"start_s":989.199,"end_s":995.279,"text":"commands from any mobile device it's compatible with Windows mac and Linux","speaker":null,"is_sponsor":0},{"start_s":993.68,"end_s":999.44,"text":"and their single app gives you remote desktop functionality you can get","speaker":null,"is_sponsor":0},{"start_s":997.199,"end_s":1003.12,"text":"real-time status monitor system resources check logged in users and","speaker":null,"is_sponsor":0},{"start_s":1001.36,"end_s":1006.32,"text":"network performance you can manage Windows updates their endpoint","speaker":null,"is_sponsor":0},{"start_s":1004.959,"end_s":1009.68,"text":"protection function allows you to install pulseway antivirus across","speaker":null,"is_sponsor":0},{"start_s":1008.399,"end_s":1014.0,"text":"systems and ensure they're fully protected at all times and you can","speaker":null,"is_sponsor":0},{"start_s":1011.839,"end_s":1017.68,"text":"create deploy and automate custom scripts to automate your it tasks like","speaker":null,"is_sponsor":0},{"start_s":1016.32,"end_s":1024.16,"text":"deployments patching security backups reports and","speaker":null,"is_sponsor":0},{"start_s":1020.639,"end_s":1025.52,"text":"more so try it for free at pulseway.com","speaker":null,"is_sponsor":0},{"start_s":1024.16,"end_s":1029.52,"text":"or through our link in the video description if you guys enjoyed this","speaker":null,"is_sponsor":0},{"start_s":1027.439,"end_s":1034.0,"text":"video maybe check out our last big server upgrade series petabyte project","speaker":null,"is_sponsor":0},{"start_s":1032.079,"end_s":1038.72,"text":"who where we rolled out a petabyte of storage in a single 4u enclosure that's","speaker":null,"is_sponsor":0},{"start_s":1037.12,"end_s":1042.559,"text":"just four times the thickness of this one and we did it twice","speaker":null,"is_sponsor":0}],"full_text":"that right there is a 512 Gigabyte dim inside this box is a server with somewhere in the neighborhood of three to six terabytes of memory sort of this gives it the capability to run workloads like simulations with never-before-seen complexity without suffering large performance penalties for swapping data in and out of its bulk storage mostly now they're really savvy among you probably already have an idea of what's in here but for everyone else let me tell you something what if i said that you could take an SSD and put it right into your system memory slot instead of RAM today's video is brought to you by pulseway those guys are always all over our server content and why not pulseway is a great way to remotely manage your servers and other it infrastructure check them out at the link below to learn more now i'm not really expecting this thing to look unusual but it is a very very unusual accessory kit whatever this is what the hell is this on the one end it looks like a little tiny pci express six pin and on the other end it looks like a little tiny zeta connector what the heck it's labeled odd so optical drive what does this thing have an optical drive you're gonna be kidding me oh wow it's a skinny boy it's a 1u so this is a super slim server designed to be rack mounted with very high densities oh it's heavier than it looks uh one second all right is there anything else important in here let's go with no sweet ah okay oh somebody voided the warranty before i got to it you know i was wondering why it comes with a safety data sheet and a big warning label on the side turns out it's got a lithium battery a cr whatever you know one of those little button cells for making sure the BIOS doesn't lose its data while the system is powered off naturally a server has a very different port configuration compared to a desktop or a workstation so back here we've got a couple pci express slots what looks like some kind of mezzanine car will have to pop it open three usb 3s that's it and then four network ports one of which is for management so you can actually perform BIOS updates install operating systems all that kind of low level stuff monitor temperatures and fans and all that good stuff over the network rather than being plugged in directly if you do need to plug in directly of course it's got vga out so you can get that graphics you know connection on there for storage what are we looking at here oh wow oh they went and they put some good stuff in here neat well we've got at least two of Intel's dc p46 10 NVMe ssds so that's cool that answers my question as to whether these were NVMe or SATA base more envy oh no so these are higher capacity lower performance 4610s these are SATA it has taken all of my self-control to not open this thing up yet i actually don't even know exactly what CPU is in this freaking thing in fact okay that's interesting i didn't know that there were two cpus in this thing we requested a demo unit back in july so i'm thinking they are probably cascade lake cpus with barlow pass dimms but they could also be first gen apache pass dimms which are about 80 percent as performant to be clear they're still going to be pretty flipping high performance and i'm expecting them to be pretty high capacity let's have a look here oh oh my check this out ladies and gentlemen that right there is a 512 Gigabyte dim but notice that i didn't say 512 Gigabyte memory module if you look closely at all the memory that's stacked up in this thing well do the math if all of these were 512 gigs that would be 12 terabytes of memory that's more than these xeon cpus even support so if you look closely check this out half of them are traditional ddr4 memory modules so these ones right here 32 gig ecc registered dimms from micron and the other half are this this is Intel's dc pmm or data center persistent memory module and on these it is not dram there's no memory on them i mean there's memory in the sense that you can like store things on them and the system can work with that data but no dram memory so it actually uses the same optane chips that you would find in something like a high performance storage drive or one of those little obtain memory modules that Intel sells as like a nitro boost for your mechanical hard drive oh dear lord no oh my god how much does it cost wow what a good question um well i think i found a four pack of these modules for nine grand uh so we have 12 of them just under 30 dollars for the optane modules alone got probably another couple grand in regular memory let's call it 30 grand total in memory depending on what cpus these are they could be anywhere from you know five to ten grand each i think it's pretty safe to say that this whole thing is somewhere in the neighborhood of 40 to 60 000 us dollars so no Intel will not be leaving it with us but we get to play with it it's just trippy you know like it's not that often that i encounter hardware so high end that i'm just like but like look at this these are pci express 24x slots ever seen one of those unless you're in the server space stop probably not i mean they've got them just adapted to 16x slots but these expansion slots right here or this ocp mezzanine spot right here could be used for like super high speed networking um what else we got oh i answered my question from earlier it looks like these four slots are actually configured for SATA only based on the connectors that are in them but i'm not sure if yeah if you had another board or used a pci express slot it looks like the backplane does support NVMe just uh it's a universal backplane but it's not u.3 so you can't just plug in either kind of drive regardless of what it's hooked up to okay should we power it on no we shouldn't actually what we should talk about is how these memory modules are used so there's a couple of different ways that they can be configured either in app direct mode where the system actually recognizes the dim as persistent storage just like a regular SSD but connected to a high-speed memory interface directly to the CPU or they can operate in memory mode where the system recognizes them as very very high capacity memory modules and uses them in exactly the same way now as you guys can imagine intercompatibility of a memory slot between dram and storage chips is not the kind of thing that happens overnight it was actually three and a half years ago that i first attended an octane briefing at Intel's folsom campus the idea seemed pretty sound optane comes in here with lower capacities and higher cost than the nand that's traditionally found in solid state drives but then higher capacities and lower cost relative to dram which is what you would normally find on a memory module as for performance they projected latencies somewhere in between the two but closer to dram than to nand and the pricing at least has somewhat held true in the real world i found that it's a little under half the price of a memory module and definitely available at higher capacities it should be noted though that these you know retail online prices are rarely what would be paid by an actual enterprise or a data center customer oh i didn't really think of this before we fire this up i'm kind of going to need a boot drive so i'll have to run and grab an m.2 to throw in here and that's not as crazy as it sounds i mean yes i know Linus this thing is full of storage why don't you just install an os on it and off you go well that's not really how a device like this is intended to be used i know it does have terabytes of storage in both the bays at the front and the memory slots but this is more of a compute node and all these tiers of storage are meant to keep the CPU chock full of data to crunch so that it can run at peak efficiency so you've actually got five tiers of storage in here you've got the sram so that's your cache on the CPU you've got your dram which is in half of these memory slots you've got your octane memory so that's in the other half you've got your NVMe ssds over here and then finally you've got your SATA ssds over here so whatever the CPU needs the quickest access to stays closest to it and whatever is less important falls away onto these slower tiers oh wait it's not that loud because it's not actually on fans are powered up even before you turn it on here we go that's actually quieter than i expected it's pretty good oh there it goes hey it survived dropping into the BIOS we're running xeon platinum 8260ls and this poor thing has no idea what's going on with the memory here it's like oh yeah you got uh three terabytes of RAM except that if we pop in here ah yes these are the real numbers 384 gigs of dram and six terabytes of Intel's optane persistent memory modules now BIOS optimizations to make this work are important both your settings and your vendor firmware lenovo seems to recommend anywhere from a 1 to 4 to 1 to 16 ratio of dram to persistent memory depending on what you're doing and as for Intel's guidance they say that applications like redis imdb run well with an eight to one config while legacy databases like microsoft sql runs ideal in like a four to one config there's also times where two to one works best if you want to minimize cache misses so that's times when the CPU is trying to find something in dram but it's already been demoted to persistent memory i mean this is mind-blowing to me like my mind was already blown way back in the athlon xp days when i found out that you could run dual channel with three sticks if you have one high capacity stick and then two half capacity sticks i was like what this another level of mind blown totally different capacities and not even the same kinds of chips on the dimms that's hilarious this thing is so not designed to boot off of a local drive my m.2 showed up as UEFI miscellaneous device in the boot options it was configured to boot from network which makes way more sense but hopefully it'll do it my poor SSD is like what is this stuff we might have to do a fresh install i've got some drivers on this thing that are not playing nicely AMD ryzen masterdriver.sis crashed it was on an AMD system before just installed chipset drivers so everything is picking up correctly now here's what i want to know though when i open up task manager what am i going to see aha okay so we got 48 CPU cores yeah that's all as expected pretty sweet and we got two terabytes apparently of memory with 4.3 terabytes hardware reserved for 6.3 terabytes how does this math work from what i can glean our persistent memory modules seem to be just operating as expanded system memory but even within that mode there are multiple modes so there's a bandwidth optimized mode and a latency optimized mode and then Intel actually came out with a balanced mode after launch that they said works pretty darn well where it uses the dram as a cache and then the optane persistent memory as like a large dumping ground giving you dram like performance depending on the workload even though optane is an order of magnitude slower in terms of latency now obviously benchmarking something like this isn't as simple as firing up cinebench and being like yeah you know it's really good it's really fast or it's not very good so guys stay tuned this is just the unboxing making sure it works oh my gosh this thing's crazy and Anthony or Jake is probably going to end up putting this thing through its paces over the next little while which raises the question what kind of benchmarks would they even run who's the audience for this well if you had a very large database that you wanted to run in memory for extreme performance you could run it in memory mode if for whatever reason you needed extremely fast storage like a really fast storage device you could run it in storage mode or block mode i mean yeah you could also just use optane in an NVMe device like what we've actually got installed on the front here but the advantage in this case is that instead of contending with pci express which is going to be a bottleneck depending what you're doing and an NVMe protocol that was designed first and foremost for nand you're communicating with your storage over the much faster memory interface that's built right into the CPU but get this it's not all boring stuff like that in 2019 you can see we're just running Windows 10 here guys microsoft rolled support for this product into Windows 10 allowing it to be used for rendering simulation and scientific tasks that are certainly heavy but not necessarily in the data center so workstations with multiple terabytes of RAM that could be very interesting for a lot of people now dims with persistent storage already exist they're called envy dim but the difference is that instead of having high speed dram and then slower nand that it can flush to when it's powered off this is just all optane all the time thanks to its much higher rate endurance so that's it for today that's the introduction to this tech holy is it ever cool and we're gonna have a follow up for you guys where we really put it through its paces and this video is brought to you of course by the real-time remote monitoring and management software that we use for our servers pulseway it works for not just servers you can deploy it on workstations laptops anything it helps you fix problems on the go by sending commands from any mobile device it's compatible with Windows mac and Linux and their single app gives you remote desktop functionality you can get real-time status monitor system resources check logged in users and network performance you can manage Windows updates their endpoint protection function allows you to install pulseway antivirus across systems and ensure they're fully protected at all times and you can create deploy and automate custom scripts to automate your it tasks like deployments patching security backups reports and more so try it for free at pulseway.com or through our link in the video description if you guys enjoyed this video maybe check out our last big server upgrade series petabyte project who where we rolled out a petabyte of storage in a single 4u enclosure that's just four times the thickness of this one and we did it twice"}