{"video_id":"coShLkCriXc","title":"We Finally Did it Properly - \"Linux\" Whonnock Upgrade","channel":"Linus Tech Tips","show":"Linus Tech Tips","published_at":"2022-05-05T14:53:29Z","duration_s":1267,"segments":[{"start_s":0.16,"end_s":8.08,"text":"after months of performance hiccups several blue screens and us literally","speaker":null,"is_sponsor":0},{"start_s":5.759,"end_s":12.16,"text":"being able to bring down the entire core of our operation","speaker":null,"is_sponsor":0},{"start_s":9.599,"end_s":17.44,"text":"just by ingesting video footage to our storage server i'm finally ready for a","speaker":null,"is_sponsor":0},{"start_s":15.28,"end_s":21.359,"text":"change admittedly maybe","speaker":null,"is_sponsor":0},{"start_s":18.48,"end_s":27.68,"text":"running new new wanik our main video editing server on Windows","speaker":null,"is_sponsor":0},{"start_s":24.0,"end_s":30.0,"text":"was a mistake i had my reasons some of","speaker":null,"is_sponsor":0},{"start_s":27.68,"end_s":35.52,"text":"which were valid but it's clear at this point that you guys were right the","speaker":null,"is_sponsor":0},{"start_s":32.96,"end_s":40.8,"text":"advantages of running Windows are far outweighed by the problems that we've","speaker":null,"is_sponsor":0},{"start_s":37.92,"end_s":44.96,"text":"encountered so it is finally the day so many of you have been waiting for when","speaker":null,"is_sponsor":0},{"start_s":42.64,"end_s":50.64,"text":"we remove the last Windows machine from our server room","speaker":null,"is_sponsor":0},{"start_s":48.399,"end_s":54.399,"text":"we're going Linux baby we're doing it right thanks cablemod for sponsoring","speaker":null,"is_sponsor":0},{"start_s":52.559,"end_s":58.559,"text":"this video cablemod allows you to personalize the look of your pc with","speaker":null,"is_sponsor":0},{"start_s":56.16,"end_s":61.92,"text":"custom colored sleeved cables try out their configurator and build your cables","speaker":null,"is_sponsor":0},{"start_s":60.32,"end_s":67.4,"text":"exactly how you want them with their realistic cable preview we're gonna have","speaker":null,"is_sponsor":0},{"start_s":63.76,"end_s":67.4,"text":"it linked down below","speaker":null,"is_sponsor":0},{"start_s":74.0,"end_s":80.159,"text":"this should be easy i've got my Linux install usb right here all we got to do","speaker":null,"is_sponsor":0},{"start_s":77.52,"end_s":85.119,"text":"is slap it into wanik's server and boom we're off to the races right","speaker":null,"is_sponsor":0},{"start_s":82.56,"end_s":88.799,"text":"you see the thing is unlike most of our videos where the hardware is just going","speaker":null,"is_sponsor":0},{"start_s":86.72,"end_s":94.0,"text":"to get torn down immediately afterward wanik server is our one and only","speaker":null,"is_sponsor":0},{"start_s":91.759,"end_s":98.479,"text":"production network editing server we can't just shut it down format it and","speaker":null,"is_sponsor":0},{"start_s":96.159,"end_s":104.32,"text":"reinstall anytime we want because a we wouldn't have anything to store our","speaker":null,"is_sponsor":0},{"start_s":100.88,"end_s":106.32,"text":"videos on or or edit off of and b we","speaker":null,"is_sponsor":0},{"start_s":104.32,"end_s":109.92,"text":"would lose all of the work we've done on our active projects that means we either","speaker":null,"is_sponsor":0},{"start_s":108.32,"end_s":116.159,"text":"have to do this whole process on a weekend or we have to migrate at least","speaker":null,"is_sponsor":0},{"start_s":112.88,"end_s":117.92,"text":"temporarily to a different server as you","speaker":null,"is_sponsor":0},{"start_s":116.159,"end_s":122.64,"text":"can see it is not the weekend so the plan is to use my home nas machine as a","speaker":null,"is_sponsor":0},{"start_s":120.24,"end_s":127.759,"text":"test bed and then eventually migrate what we've done over to new new wanick","speaker":null,"is_sponsor":0},{"start_s":125.759,"end_s":131.92,"text":"one three new pneumonic my intention is for this to eventually end up at my","speaker":null,"is_sponsor":0},{"start_s":129.599,"end_s":136.16,"text":"house but that may not end up happening for a number of reasons not the least of","speaker":null,"is_sponsor":0},{"start_s":133.76,"end_s":140.48,"text":"which is that Jake has become very enamored with the kind of performance","speaker":null,"is_sponsor":0},{"start_s":138.08,"end_s":144.239,"text":"that we get out of these gen four keoxia NVMe drives he and i are gonna have to","speaker":null,"is_sponsor":0},{"start_s":142.879,"end_s":148.48,"text":"fight that out a little bit later in the meantime","speaker":null,"is_sponsor":0},{"start_s":146.56,"end_s":152.8,"text":"let's uh let's build up a server shall we actually that's a bit of a lie this","speaker":null,"is_sponsor":0},{"start_s":150.8,"end_s":156.879,"text":"server is already built so what we need to do is we need to","speaker":null,"is_sponsor":0},{"start_s":154.879,"end_s":162.08,"text":"upgrade it we'll start by taking out this epic 7402","speaker":null,"is_sponsor":0},{"start_s":159.519,"end_s":165.92,"text":"i got it 24 cores is plenty for what i'll be doing at home but as we learned","speaker":null,"is_sponsor":0},{"start_s":163.68,"end_s":170.4,"text":"the hard way you basically can't have enough CPU performance if you","speaker":null,"is_sponsor":0},{"start_s":168.319,"end_s":174.16,"text":"want to get the most out of these gen 4 NVMe drives oh and if another 8 cores","speaker":null,"is_sponsor":0},{"start_s":173.04,"end_s":179.04,"text":"doesn't end up alleviating the bottlenecks we've found we've got a 7742","speaker":null,"is_sponsor":0},{"start_s":176.959,"end_s":181.36,"text":"64 core that we can play around with later","speaker":null,"is_sponsor":0},{"start_s":180.0,"end_s":186.56,"text":"another thing you can't have enough of in a storage server like this is RAM and","speaker":null,"is_sponsor":0},{"start_s":184.239,"end_s":190.4,"text":"i mean that both in terms of capacity and in terms of speed when we were","speaker":null,"is_sponsor":0},{"start_s":188.48,"end_s":195.28,"text":"deploying this at my house we put the smallest crappiest kit that we possibly","speaker":null,"is_sponsor":0},{"start_s":193.519,"end_s":202.56,"text":"could i mean obviously without compromising on reliability so this is","speaker":null,"is_sponsor":0},{"start_s":197.76,"end_s":204.0,"text":"64 gigs of 2666 ddr4 truthfully the","speaker":null,"is_sponsor":0},{"start_s":202.56,"end_s":208.159,"text":"sticks i'm putting in now aren't really ideal either they're running at 26.66","speaker":null,"is_sponsor":0},{"start_s":206.4,"end_s":214.08,"text":"mega transfers per second compared to epic's maximum of 3200","speaker":null,"is_sponsor":0},{"start_s":210.959,"end_s":216.08,"text":"but we're gonna have 256 gigs rather","speaker":null,"is_sponsor":0},{"start_s":214.08,"end_s":221.44,"text":"than 64 gigs which is going to make a big difference especially for using zfs","speaker":null,"is_sponsor":0},{"start_s":219.12,"end_s":226.959,"text":"which we are as much as there might be some kind of GPU accelerated","speaker":null,"is_sponsor":0},{"start_s":224.319,"end_s":230.879,"text":"storage something uh i've never heard of it so we're gonna pull this 1050 ti out","speaker":null,"is_sponsor":0},{"start_s":229.28,"end_s":234.879,"text":"here that was supposed to be for plex transcoding and we're gonna replace it","speaker":null,"is_sponsor":0},{"start_s":233.28,"end_s":242.0,"text":"with this gorgeous melanox connect x6 100 gigabit","speaker":null,"is_sponsor":0},{"start_s":239.28,"end_s":246.959,"text":"per second network card uh do we really need these one terabyte drives for boot","speaker":null,"is_sponsor":0},{"start_s":244.08,"end_s":250.72,"text":"we have like a dozen of those uh those octane m.2s that are like 32 gigs and","speaker":null,"is_sponsor":0},{"start_s":249.439,"end_s":253.36,"text":"they're perfect there's actually not that many left server boot drives oh","speaker":null,"is_sponsor":0},{"start_s":252.56,"end_s":258.72,"text":"really oh all right well i guess i keep using them for stuff like this where it just","speaker":null,"is_sponsor":0},{"start_s":257.04,"end_s":263.919,"text":"really doesn't matter how much capacity you have and you just want something reliable speaking of our installation","speaker":null,"is_sponsor":0},{"start_s":261.919,"end_s":269.68,"text":"media there was a fair bit of deliberation when it came to choosing an","speaker":null,"is_sponsor":0},{"start_s":266.08,"end_s":271.84,"text":"operating system ubuntu server seemed","speaker":null,"is_sponsor":0},{"start_s":269.68,"end_s":277.12,"text":"good except that the current long-term supported version or lts for short","speaker":null,"is_sponsor":0},{"start_s":274.4,"end_s":281.28,"text":"doesn't have open zfs 2.0 which features a bunch of performance improvements for","speaker":null,"is_sponsor":0},{"start_s":278.8,"end_s":287.36,"text":"zfs which is the file system we intend to use and then db and 11 sounded good","speaker":null,"is_sponsor":0},{"start_s":284.08,"end_s":289.68,"text":"it has open cfs 2.0 and a version of","speaker":null,"is_sponsor":0},{"start_s":287.36,"end_s":294.84,"text":"samba the software used to host Windows compatible smb network shares from this","speaker":null,"is_sponsor":0},{"start_s":292.0,"end_s":298.88,"text":"year which is great except it's from march um which is not great so the","speaker":null,"is_sponsor":0},{"start_s":297.36,"end_s":303.919,"text":"beginning of this video ended up being a bit of a lie because while we could have","speaker":null,"is_sponsor":0},{"start_s":301.28,"end_s":309.039,"text":"still gone with Linux just find a distro that's got a new enough kernel uh","speaker":null,"is_sponsor":0},{"start_s":305.759,"end_s":311.919,"text":"potentially build open zfs 2.0 and samba","speaker":null,"is_sponsor":0},{"start_s":309.039,"end_s":316.479,"text":"from scratch there is an easier option trueness it's got opencfs 2.0 a very","speaker":null,"is_sponsor":0},{"start_s":314.72,"end_s":322.24,"text":"recent samba and a really nice web interface for managing your storage it's","speaker":null,"is_sponsor":0},{"start_s":318.72,"end_s":325.28,"text":"not Linux but it is based on a unix-like","speaker":null,"is_sponsor":0},{"start_s":322.24,"end_s":327.84,"text":"operating system called freebsd so we're","speaker":null,"is_sponsor":0},{"start_s":325.28,"end_s":332.479,"text":"we're back on the used to be free nas now truenas train i don't know what it","speaker":null,"is_sponsor":0},{"start_s":330.0,"end_s":336.4,"text":"is about their product but pretty much every time i go to use it something","speaker":null,"is_sponsor":0},{"start_s":334.56,"end_s":340.88,"text":"blows up in a way that is totally inexplicable i've ended up escalated to","speaker":null,"is_sponsor":0},{"start_s":338.4,"end_s":344.72,"text":"like directors and vps of engineering multiple times with nobody ever able to","speaker":null,"is_sponsor":0},{"start_s":343.039,"end_s":349.44,"text":"explain why the product just won't work properly for me but hey fifth time's a","speaker":null,"is_sponsor":0},{"start_s":347.84,"end_s":353.919,"text":"charm works properly for Jake yeah as long as","speaker":null,"is_sponsor":0},{"start_s":351.84,"end_s":358.24,"text":"it works properly for Jake you know our backup servers are running truenast for","speaker":null,"is_sponsor":0},{"start_s":356.16,"end_s":361.84,"text":"like a year now i i know i know it's a good product i've recommended it to","speaker":null,"is_sponsor":0},{"start_s":360.16,"end_s":366.319,"text":"countless people i've just never been able to get it working the way that i","speaker":null,"is_sponsor":0},{"start_s":363.919,"end_s":370.4,"text":"need it to work did it just turn on do you have it set to just restore power on","speaker":null,"is_sponsor":0},{"start_s":368.16,"end_s":374.08,"text":"ac probably okay let's just give it a sec here that's what servers are","speaker":null,"is_sponsor":0},{"start_s":371.68,"end_s":377.12,"text":"supposed to do okay where's that usb we don't need it oh we're gonna do it","speaker":null,"is_sponsor":0},{"start_s":375.6,"end_s":382.0,"text":"properly i thought you told me we need a usb uh just for just for visuals are we","speaker":null,"is_sponsor":0},{"start_s":379.52,"end_s":385.28,"text":"gonna go ipmi af and use an image and everything yeah look at us doing things","speaker":null,"is_sponsor":0},{"start_s":383.759,"end_s":389.039,"text":"properly today yeah i didn't download truenast but i","speaker":null,"is_sponsor":0},{"start_s":387.12,"end_s":391.919,"text":"will now wait what happened to my laptop i put it away you don't need it oh you","speaker":null,"is_sponsor":0},{"start_s":390.639,"end_s":396.8,"text":"told me to bring it i didn't realize there was a keyboard here ah the problem","speaker":null,"is_sponsor":0},{"start_s":394.24,"end_s":400.56,"text":"with mac ipmi is i can't like press f10 properly like doesn't work press f10 to","speaker":null,"is_sponsor":0},{"start_s":398.72,"end_s":405.28,"text":"pay respect doesn't work i can screen record on this thing for","speaker":null,"is_sponsor":0},{"start_s":402.639,"end_s":409.919,"text":"like an hour and only use like 30 battery and its touch pad is the","speaker":null,"is_sponsor":0},{"start_s":407.039,"end_s":413.12,"text":"equivalent of being hung like a horse it is look at it","speaker":null,"is_sponsor":0},{"start_s":411.68,"end_s":417.599,"text":"look at this let me show you my touch pad okay look oh okay it's a touch pad","speaker":null,"is_sponsor":0},{"start_s":416.16,"end_s":423.12,"text":"actually what i was really going to show you was my underwear from lttstore.com","speaker":null,"is_sponsor":0},{"start_s":421.52,"end_s":427.44,"text":"store lttstore.com it comes with cat hair comes no it doesn't that's from","speaker":null,"is_sponsor":0},{"start_s":425.28,"end_s":432.4,"text":"your cat i just walk out in the hallway and she's like what's up bro","speaker":null,"is_sponsor":0},{"start_s":429.52,"end_s":435.28,"text":"virtual cd-rom enter here we go boys this is the smart way to do it you","speaker":null,"is_sponsor":0},{"start_s":433.759,"end_s":441.199,"text":"shouldn't actually ever have to plug a monitor into a server you ready install","speaker":null,"is_sponsor":0},{"start_s":438.56,"end_s":444.8,"text":"wow wow that was inspirational look at it go okay hold on hold on pick our door","speaker":null,"is_sponsor":0},{"start_s":443.599,"end_s":449.52,"text":"hold on yeah we don't want to install the wrong drive now this is cool even","speaker":null,"is_sponsor":0},{"start_s":446.639,"end_s":454.4,"text":"though AMD epic servers do not have any innate support for raid that means you","speaker":null,"is_sponsor":0},{"start_s":451.84,"end_s":459.36,"text":"can't even install two boot drives like we did and then just configured in the","speaker":null,"is_sponsor":0},{"start_s":456.16,"end_s":461.919,"text":"BIOS to run raid freaking simple one","speaker":null,"is_sponsor":0},{"start_s":459.36,"end_s":466.08,"text":"trueness has a quick and easy way for you to install your operating system to","speaker":null,"is_sponsor":0},{"start_s":464.0,"end_s":469.28,"text":"two drives so in the event of a hardware failure you're just","speaker":null,"is_sponsor":0},{"start_s":467.919,"end_s":473.919,"text":"ready to go again immediately yeah it literally just shows up as a separate boot entry you can just pick which one","speaker":null,"is_sponsor":0},{"start_s":472.08,"end_s":478.639,"text":"to boot from okay time to go to lunch see you later i'm asking if i can turn it on well","speaker":null,"is_sponsor":0},{"start_s":476.639,"end_s":483.28,"text":"that's too bad because i already did ah roasted","speaker":null,"is_sponsor":0},{"start_s":481.039,"end_s":487.44,"text":"yeah what's up now what are you gonna hard power it off yeah","speaker":null,"is_sponsor":0},{"start_s":485.039,"end_s":490.08,"text":"what's up no ha got him now who turned it on","speaker":null,"is_sponsor":0},{"start_s":488.879,"end_s":496.319,"text":"this guy wanna turn it off again","speaker":null,"is_sponsor":0},{"start_s":493.199,"end_s":496.319,"text":"i'm turning it off first","speaker":null,"is_sponsor":0},{"start_s":497.28,"end_s":503.039,"text":"this is bad hardware practices hey wait mother","speaker":null,"is_sponsor":0},{"start_s":500.96,"end_s":506.4,"text":"man it's not plugged in all the way oh my god snapped out must have been when","speaker":null,"is_sponsor":0},{"start_s":505.039,"end_s":511.28,"text":"you unplug the power i'm turning it off first","speaker":null,"is_sponsor":0},{"start_s":509.52,"end_s":514.88,"text":"why is there is there blinking on the port ip","speaker":null,"is_sponsor":0},{"start_s":513.279,"end_s":519.919,"text":"no we have to take it to the server room later anyways let's just take it there now this is the way to do it i mean did","speaker":null,"is_sponsor":0},{"start_s":518.32,"end_s":524.08,"text":"we say we were gonna do everything properly today","speaker":null,"is_sponsor":0},{"start_s":521.44,"end_s":527.12,"text":"uh no okay cool because that's definitely not what's happening hey i","speaker":null,"is_sponsor":0},{"start_s":525.76,"end_s":531.12,"text":"got 100 gig you won't believe how much gigabytes you","speaker":null,"is_sponsor":0},{"start_s":529.12,"end_s":534.399,"text":"can put in this bad boy there's a bunch of hard drives under there stop slapping","speaker":null,"is_sponsor":0},{"start_s":532.959,"end_s":539.92,"text":"it let's go back around i don't want to wait okay let's create a pool","speaker":null,"is_sponsor":0},{"start_s":537.2,"end_s":543.04,"text":"name name it's called lambo so do i click them in order to add the","speaker":null,"is_sponsor":0},{"start_s":541.68,"end_s":546.8,"text":"video no you don't um just click all and then unselect that","speaker":null,"is_sponsor":0},{"start_s":545.12,"end_s":551.04,"text":"oh yeah we don't want this dao i think that's the virtual","speaker":null,"is_sponsor":0},{"start_s":548.88,"end_s":555.12,"text":"thing from ipmi 12 selected just click over okay so i did a little bit of testing","speaker":null,"is_sponsor":0},{"start_s":553.279,"end_s":560.08,"text":"beforehand it doesn't seem like it makes a difference between having one v dev or","speaker":null,"is_sponsor":0},{"start_s":557.519,"end_s":564.64,"text":"two for our workload okay raid z is fine yeah raid z is going to give us one","speaker":null,"is_sponsor":0},{"start_s":562.64,"end_s":568.399,"text":"failed drive before we actually start to lose data i'm not expecting to lose a","speaker":null,"is_sponsor":0},{"start_s":566.72,"end_s":572.88,"text":"ton of these drives and this data is going to be replicated using our snapshot to another server that's over","speaker":null,"is_sponsor":0},{"start_s":571.279,"end_s":577.2,"text":"in unit 101 yeah and then it'll be replicated again off-site to kamloops","speaker":null,"is_sponsor":0},{"start_s":575.04,"end_s":581.519,"text":"once Jake gets around to fixing the new kamloops server yeah there we go oh","speaker":null,"is_sponsor":0},{"start_s":579.76,"end_s":585.92,"text":"that's 72 terabytes that's not bad that's not bad usable okay so we got to","speaker":null,"is_sponsor":0},{"start_s":583.36,"end_s":591.279,"text":"make a oh here first thing go to that yeah we have to turn auto trim on pool","speaker":null,"is_sponsor":0},{"start_s":588.839,"end_s":596.8,"text":"options oh why is that not by default well most people don't use ssds with","speaker":null,"is_sponsor":0},{"start_s":593.12,"end_s":599.04,"text":"trueness that's fair we got to make a","speaker":null,"is_sponsor":0},{"start_s":596.8,"end_s":603.2,"text":"new data set add data set and then let's call this a z drive turn","speaker":null,"is_sponsor":0},{"start_s":601.279,"end_s":606.24,"text":"compression off we don't need that pretty much all the data we're going to","speaker":null,"is_sponsor":0},{"start_s":604.48,"end_s":609.519,"text":"write to this thing is incompressible video footage so there's just no benefit","speaker":null,"is_sponsor":0},{"start_s":608.24,"end_s":612.72,"text":"we could turn it on later because there are other things like word files but for","speaker":null,"is_sponsor":0},{"start_s":611.68,"end_s":617.839,"text":"now because we're going to do some performance testing too let's leave it off turn a time off we don't need that","speaker":null,"is_sponsor":0},{"start_s":615.76,"end_s":621.2,"text":"either that's like the access time is that a festival store the last time a","speaker":null,"is_sponsor":0},{"start_s":619.519,"end_s":626.32,"text":"file is accessed you might use that to see if your kids have been looking at your","speaker":null,"is_sponsor":0},{"start_s":624.56,"end_s":631.36,"text":"share type smb that's gonna set it to be case insensitive okay um we're gonna","speaker":null,"is_sponsor":0},{"start_s":628.959,"end_s":634.72,"text":"leave the record size at 128 kb now you could theoretically change it to one","speaker":null,"is_sponsor":0},{"start_s":633.2,"end_s":637.76,"text":"megabyte that might be better if you're like have a plex server because those","speaker":null,"is_sponsor":0},{"start_s":636.32,"end_s":641.279,"text":"are bigger chunks which means less overhead i mean our chunks are pretty","speaker":null,"is_sponsor":0},{"start_s":639.36,"end_s":643.76,"text":"big but for whatever reason when i was playing with","speaker":null,"is_sponsor":0},{"start_s":642.56,"end_s":647.76,"text":"premiere it seemed like it was a little worse so at least in scrubbing","speaker":null,"is_sponsor":0},{"start_s":646.64,"end_s":651.44,"text":"yeah because it will increase your latency stuff oh we gotta do some zfs","speaker":null,"is_sponsor":0},{"start_s":649.92,"end_s":655.36,"text":"tuning yeah because why would you want things to just like work immediately","speaker":null,"is_sponsor":0},{"start_s":653.44,"end_s":661.36,"text":"look it's not made for NVMe we're kind of doing it dirty right now primary","speaker":null,"is_sponsor":0},{"start_s":657.76,"end_s":662.959,"text":"cache all one word equals","speaker":null,"is_sponsor":0},{"start_s":661.36,"end_s":666.0,"text":"metadata and then we'll do","speaker":null,"is_sponsor":0},{"start_s":664.72,"end_s":669.279,"text":"space lambo slash z drive","speaker":null,"is_sponsor":0},{"start_s":669.6,"end_s":675.12,"text":"okay enter aha okay","speaker":null,"is_sponsor":0},{"start_s":672.839,"end_s":678.48,"text":"okay that just means our RAM now stores only metadata yes","speaker":null,"is_sponsor":0},{"start_s":676.72,"end_s":682.48,"text":"which makes sense because our storage is so fast","speaker":null,"is_sponsor":0},{"start_s":680.079,"end_s":687.12,"text":"that there's pretty much no point using our system RAM as a more conventional","speaker":null,"is_sponsor":0},{"start_s":684.959,"end_s":689.92,"text":"cache for it for most use cases though i haven't actually played with it in","speaker":null,"is_sponsor":0},{"start_s":688.32,"end_s":693.76,"text":"premiere it might actually like the lower latency and when we deploy to","speaker":null,"is_sponsor":0},{"start_s":692.16,"end_s":697.6,"text":"actual wanik we'll have a terabyte of RAM so maybe","speaker":null,"is_sponsor":0},{"start_s":696.079,"end_s":703.279,"text":"it might actually make sense but for now we're just gonna leave it off okay wow it's really poorly formatted but","speaker":null,"is_sponsor":0},{"start_s":700.959,"end_s":709.04,"text":"lambo z drive users metadata on the next line cool it worked all right now we got","speaker":null,"is_sponsor":0},{"start_s":706.0,"end_s":710.88,"text":"a tomb samba so on truenast smb","speaker":null,"is_sponsor":0},{"start_s":709.04,"end_s":714.88,"text":"samba is not really configured for the type of performance that we're going for","speaker":null,"is_sponsor":0},{"start_s":712.72,"end_s":720.0,"text":"we're talking like 20 30 40 gigabit on our 100 gig card not you know gigabit or","speaker":null,"is_sponsor":0},{"start_s":717.44,"end_s":723.279,"text":"10 gig so we have to make a few changes now by default for some reason at least","speaker":null,"is_sponsor":0},{"start_s":722.079,"end_s":726.88,"text":"according to this dude on the internet that has this article about trueness and","speaker":null,"is_sponsor":0},{"start_s":725.2,"end_s":733.12,"text":"the testing that i've done it seems like they set the the default threads for smb","speaker":null,"is_sponsor":0},{"start_s":730.88,"end_s":737.04,"text":"multi-channel to like one read one right whereas like the default in samba is","speaker":null,"is_sponsor":0},{"start_s":734.88,"end_s":740.399,"text":"like a hundred right there's probably a reason for this and maybe they've","speaker":null,"is_sponsor":0},{"start_s":738.32,"end_s":743.76,"text":"changed it back but from testing before changing it to testing after it was a","speaker":null,"is_sponsor":0},{"start_s":742.32,"end_s":747.839,"text":"huge difference i wonder if it's one of those things where for the average home","speaker":null,"is_sponsor":0},{"start_s":745.68,"end_s":751.519,"text":"user repurposing an old machine and just like throwing a couple hard drives in","speaker":null,"is_sponsor":0},{"start_s":749.2,"end_s":756.32,"text":"which closet yeah yeah maybe it like overwhelms you know that the athlon xp","speaker":null,"is_sponsor":0},{"start_s":754.639,"end_s":760.079,"text":"then this is also like the community edition right so if you were to buy a","speaker":null,"is_sponsor":0},{"start_s":758.8,"end_s":764.079,"text":"machine from truenas one of their pre-built i imagine they would already configure this stuff for you anyways","speaker":null,"is_sponsor":0},{"start_s":762.959,"end_s":767.839,"text":"we're just going to copy paste this stuff into our config","speaker":null,"is_sponsor":0},{"start_s":766.16,"end_s":774.0,"text":"just need one more zero in there a lot of bytes yep now the thing is these","speaker":null,"is_sponsor":0},{"start_s":771.36,"end_s":777.44,"text":"drives are capable of like tens of gigabytes a second of raw reads and","speaker":null,"is_sponsor":0},{"start_s":776.48,"end_s":783.04,"text":"writes but as soon as you start trying to run a","speaker":null,"is_sponsor":0},{"start_s":779.839,"end_s":785.519,"text":"file system on them like zfs performance","speaker":null,"is_sponsor":0},{"start_s":783.04,"end_s":788.32,"text":"takes a bit of a kick in the balls especially when you have to calculate","speaker":null,"is_sponsor":0},{"start_s":786.8,"end_s":791.68,"text":"parity which is a whole other thing that's why we upgraded the CPU hopefully","speaker":null,"is_sponsor":0},{"start_s":790.16,"end_s":795.839,"text":"we can get a little more parody in let's see where we end up okay","speaker":null,"is_sponsor":0},{"start_s":794.639,"end_s":801.839,"text":"we're going to do a right test first 50. here we go 12 jobs because we have 12 drives laying","speaker":null,"is_sponsor":0},{"start_s":799.76,"end_s":806.48,"text":"out some files that's pretty good wow","speaker":null,"is_sponsor":0},{"start_s":804.079,"end_s":810.48,"text":"that's more than 100 gig it kind of fluctuates a bit","speaker":null,"is_sponsor":0},{"start_s":808.16,"end_s":814.8,"text":"but that's pretty damn good that is not bad as long as we're above 100 gig yeah","speaker":null,"is_sponsor":0},{"start_s":813.12,"end_s":818.079,"text":"then we can't possibly be bottlenecked by the drives and","speaker":null,"is_sponsor":0},{"start_s":816.48,"end_s":821.6,"text":"i think we're at bottleneck by CPU right now too i bet if we go look at the CPU","speaker":null,"is_sponsor":0},{"start_s":819.92,"end_s":826.72,"text":"oh yeah it's probably getting absolutely crashed 100","speaker":null,"is_sponsor":0},{"start_s":824.079,"end_s":830.48,"text":"41 you know it's probably a little bit slower in terms of writing then i bet","speaker":null,"is_sponsor":0},{"start_s":828.72,"end_s":835.76,"text":"you if we do a read test it'll be 100 oh okay but i think it's just because it's calculating parity and whatnot true nas","speaker":null,"is_sponsor":0},{"start_s":833.519,"end_s":840.079,"text":"is not built for these speeds we're using them for these speeds","speaker":null,"is_sponsor":0},{"start_s":837.839,"end_s":843.279,"text":"but properly yeah all right read eight gigabytes a second you know i was","speaker":null,"is_sponsor":0},{"start_s":841.68,"end_s":848.24,"text":"getting a little higher than this before i'm a little surprised i wonder if the","speaker":null,"is_sponsor":0},{"start_s":845.279,"end_s":852.16,"text":"CPU is slower so far beyond good enough now something to note is that when","speaker":null,"is_sponsor":0},{"start_s":849.76,"end_s":857.519,"text":"you're benchmarking your desktop system changing the queue depth to get like","speaker":null,"is_sponsor":0},{"start_s":854.639,"end_s":861.519,"text":"massive numbers is not representative of the real world because an individual","speaker":null,"is_sponsor":0},{"start_s":859.519,"end_s":867.44,"text":"user sitting in front of a computer could never use it hard enough to reach","speaker":null,"is_sponsor":0},{"start_s":864.399,"end_s":870.399,"text":"q depths of you know eight probably let","speaker":null,"is_sponsor":0},{"start_s":867.44,"end_s":875.199,"text":"alone 16 or 32 which you might do in benchmarking however for a machine like","speaker":null,"is_sponsor":0},{"start_s":873.04,"end_s":880.079,"text":"this where literally dozens of people are accessing it that is conceivable and","speaker":null,"is_sponsor":0},{"start_s":878.24,"end_s":883.12,"text":"that is a reasonable way to test it but we were only testing with two yeah so","speaker":null,"is_sponsor":0},{"start_s":881.519,"end_s":886.8,"text":"that's why i said it's turning it up is not it's not a hack to just show you","speaker":null,"is_sponsor":0},{"start_s":884.8,"end_s":890.399,"text":"guys a bigger number it actually is applicable to this user i wonder if we","speaker":null,"is_sponsor":0},{"start_s":888.24,"end_s":894.399,"text":"try more threads we have more threads so let's try 24 2","speaker":null,"is_sponsor":0},{"start_s":892.399,"end_s":896.72,"text":"give me all the threads 20.","speaker":null,"is_sponsor":0},{"start_s":896.88,"end_s":900.48,"text":"give me more threads i want a bigger number","speaker":null,"is_sponsor":0},{"start_s":900.88,"end_s":908.32,"text":"whoa hey there it is","speaker":null,"is_sponsor":0},{"start_s":905.519,"end_s":911.04,"text":"18 gb bytes per second interestingly CPU usage doesn't really","speaker":null,"is_sponsor":0},{"start_s":910.16,"end_s":915.839,"text":"go up tldr it's very fast very fast it's way","speaker":null,"is_sponsor":0},{"start_s":914.079,"end_s":919.76,"text":"faster than we ever need and it's way faster than one so let's","speaker":null,"is_sponsor":0},{"start_s":918.0,"end_s":924.399,"text":"try fishy you know it's good that we actually left the one terabyte in there","speaker":null,"is_sponsor":0},{"start_s":921.92,"end_s":928.639,"text":"because of those ingest issues so that was another problem that","speaker":null,"is_sponsor":0},{"start_s":926.399,"end_s":932.959,"text":"actually that was what really prompted me to go okay yeah forget it we're done","speaker":null,"is_sponsor":0},{"start_s":930.72,"end_s":937.759,"text":"with this because when we would ingest footage from the stations over there","speaker":null,"is_sponsor":0},{"start_s":935.36,"end_s":942.079,"text":"if it was greater than one terabyte it would fill up less than that is it it","speaker":null,"is_sponsor":0},{"start_s":940.399,"end_s":946.639,"text":"basically like when you write to storage spaces it just goes to RAM and then it","speaker":null,"is_sponsor":0},{"start_s":944.56,"end_s":950.24,"text":"flushes to disk slowly and when we had the ursas those drives could do like one","speaker":null,"is_sponsor":0},{"start_s":948.56,"end_s":953.68,"text":"and a half gigabytes a second you know times a few if you ingested fast enough","speaker":null,"is_sponsor":0},{"start_s":952.24,"end_s":956.32,"text":"you'd fill up the RAM and storage spaces only lets itself use half of your system","speaker":null,"is_sponsor":0},{"start_s":955.279,"end_s":961.759,"text":"memory right and then at that point it would just crash the network share like for","speaker":null,"is_sponsor":0},{"start_s":959.6,"end_s":966.0,"text":"everyone and there's no evident way to turn it off yeah because","speaker":null,"is_sponsor":0},{"start_s":964.48,"end_s":972.0,"text":"our disks are fast enough we could just go straight to the disks but we couldn't","speaker":null,"is_sponsor":0},{"start_s":968.56,"end_s":973.68,"text":"turn off the stupid round caching","speaker":null,"is_sponsor":0},{"start_s":972.0,"end_s":976.519,"text":"and especially when you've got an os that blue screens every once in a while","speaker":null,"is_sponsor":0},{"start_s":975.6,"end_s":984.88,"text":"having 500 gigabytes of data potentially in a","speaker":null,"is_sponsor":0},{"start_s":979.839,"end_s":984.88,"text":"RAM cache yeah one does not simply","speaker":null,"is_sponsor":0},{"start_s":986.0,"end_s":990.56,"text":"so this is kind of dog poo what we need to do is go into one of the editors","speaker":null,"is_sponsor":0},{"start_s":989.36,"end_s":996.8,"text":"stations that is not Windows server running storage spaces and like copy these files","speaker":null,"is_sponsor":0},{"start_s":994.32,"end_s":1001.279,"text":"or something okay so i actually oh my god i didn't touch it","speaker":null,"is_sponsor":0},{"start_s":999.6,"end_s":1006.16,"text":"i'm sorry it's been a stressful week","speaker":null,"is_sponsor":0},{"start_s":1004.24,"end_s":1010.639,"text":"what's up can i borrow this of course okay let me drive for a sec here","speaker":null,"is_sponsor":0},{"start_s":1008.32,"end_s":1016.72,"text":"okay so i want to copy this to my local drive","speaker":null,"is_sponsor":0},{"start_s":1013.279,"end_s":1016.72,"text":"huh that is not very good","speaker":null,"is_sponsor":0},{"start_s":1017.68,"end_s":1020.079,"text":"Jake","speaker":null,"is_sponsor":0},{"start_s":1021.36,"end_s":1026.88,"text":"it's possible that the issue is just Windows file transfer being Windows file","speaker":null,"is_sponsor":0},{"start_s":1025.12,"end_s":1032.319,"text":"transfer so we're pulling out the big guns here bringing out show easy copy","speaker":null,"is_sponsor":0},{"start_s":1029.76,"end_s":1035.12,"text":"look at that 20 gigabit oh well that's better","speaker":null,"is_sponsor":0},{"start_s":1035.439,"end_s":1042.88,"text":"uh where are you going to and from right now i'm going from wanik to","speaker":null,"is_sponsor":0},{"start_s":1040.799,"end_s":1047.76,"text":"to the other the test one yeah and i'm sure we open this","speaker":null,"is_sponsor":0},{"start_s":1044.72,"end_s":1047.76,"text":"lots of blinky lights","speaker":null,"is_sponsor":0},{"start_s":1047.839,"end_s":1051.28,"text":"so there are okay","speaker":null,"is_sponsor":0},{"start_s":1051.36,"end_s":1057.52,"text":"yeah there's your CPU right there okay","speaker":null,"is_sponsor":0},{"start_s":1054.4,"end_s":1058.559,"text":"i'm copying over a red mag","speaker":null,"is_sponsor":0},{"start_s":1057.52,"end_s":1063.84,"text":"boom pinned to 495 megabytes a second which","speaker":null,"is_sponsor":0},{"start_s":1061.679,"end_s":1069.28,"text":"is the speed of a red meg okay what else we got red map brandon is","speaker":null,"is_sponsor":0},{"start_s":1066.4,"end_s":1069.28,"text":"what's yours going at","speaker":null,"is_sponsor":0},{"start_s":1069.76,"end_s":1076.0,"text":"499 okay so we've got a total of a Gigabyte a second heading over there i","speaker":null,"is_sponsor":0},{"start_s":1074.08,"end_s":1079.6,"text":"need to find some more media to copy here what you'll see is sometimes it'll","speaker":null,"is_sponsor":0},{"start_s":1077.6,"end_s":1083.28,"text":"slow down when it's going between clips red footage is a bunch of clips so yeah","speaker":null,"is_sponsor":0},{"start_s":1081.52,"end_s":1086.32,"text":"between each clip Windows file transfer will like dip for a bit yeah we're","speaker":null,"is_sponsor":0},{"start_s":1084.88,"end_s":1091.919,"text":"definitely running into some kind of bottleneck on this system where it's maxing out at 500 megabytes a second no","speaker":null,"is_sponsor":0},{"start_s":1089.6,"end_s":1096.32,"text":"matter what we plug into but still overall the ingestations are","speaker":null,"is_sponsor":0},{"start_s":1093.76,"end_s":1101.84,"text":"performing better than with old wanik which is new 1-3 so this will be new new","speaker":null,"is_sponsor":0},{"start_s":1099.28,"end_s":1105.12,"text":"new wanik anyway the point is i paused all the transfers and we're","speaker":null,"is_sponsor":0},{"start_s":1103.44,"end_s":1110.0,"text":"going to have three or four editors now try to edit and then i'm going to start these again and make sure everyone's","speaker":null,"is_sponsor":0},{"start_s":1108.96,"end_s":1113.52,"text":"smooth our guinea pigs are going to be ed mark","speaker":null,"is_sponsor":0},{"start_s":1112.48,"end_s":1117.679,"text":"and emily over here and you guys are","speaker":null,"is_sponsor":0},{"start_s":1115.679,"end_s":1119.84,"text":"pretending to edit right i mean that's basically all everyone in here does","speaker":null,"is_sponsor":0},{"start_s":1119.039,"end_s":1124.799,"text":"right if everyone a prime pretending to edit what are you","speaker":null,"is_sponsor":0},{"start_s":1123.44,"end_s":1128.64,"text":"pretending to edit right now i'm not pretending you know oh okay well we've","speaker":null,"is_sponsor":0},{"start_s":1126.799,"end_s":1133.679,"text":"got at least okay we got at least one editor actually editing fantastic","speaker":null,"is_sponsor":0},{"start_s":1132.16,"end_s":1137.36,"text":"hoffman that's a beautiful picture of david all right so guys keep pretending","speaker":null,"is_sponsor":0},{"start_s":1135.6,"end_s":1141.2,"text":"to edit andy you stay here i'm gonna go turn on all those file copies just like","speaker":null,"is_sponsor":0},{"start_s":1139.28,"end_s":1144.64,"text":"before we got about 10 gig on the one on the right five gig on the one on the","speaker":null,"is_sponsor":0},{"start_s":1142.559,"end_s":1148.88,"text":"left and how are your projects going it seemed fairly normal or very normal or","speaker":null,"is_sponsor":0},{"start_s":1146.96,"end_s":1152.64,"text":"better than normal it's not better but it's normal not better but normal yeah","speaker":null,"is_sponsor":0},{"start_s":1150.799,"end_s":1157.919,"text":"it's pretty much exactly exactly the same all right thanks teddy yeah it's","speaker":null,"is_sponsor":0},{"start_s":1155.52,"end_s":1161.36,"text":"good it's acceptable is it it's not worse","speaker":null,"is_sponsor":0},{"start_s":1159.52,"end_s":1165.2,"text":"that's good but it's not better it's","speaker":null,"is_sponsor":0},{"start_s":1162.559,"end_s":1169.52,"text":"it's hard to say to be honest okay yeah okay it's it's","speaker":null,"is_sponsor":0},{"start_s":1167.52,"end_s":1172.64,"text":"i could i could have it with this yeah okay","speaker":null,"is_sponsor":0},{"start_s":1170.96,"end_s":1177.28,"text":"really wasn't the goal today the goal today was hey this is going to be perfect and amazing you guys are going","speaker":null,"is_sponsor":0},{"start_s":1175.2,"end_s":1180.96,"text":"to love it so uh is it no no","speaker":null,"is_sponsor":0},{"start_s":1178.799,"end_s":1184.96,"text":"the goal was the same okay ed how's yours doing","speaker":null,"is_sponsor":0},{"start_s":1183.28,"end_s":1190.16,"text":"um i think this is doing well historically i think it's about on par","speaker":null,"is_sponsor":0},{"start_s":1187.36,"end_s":1195.2,"text":"with uh what performance was like before but as of late this is a lot better um i","speaker":null,"is_sponsor":0},{"start_s":1194.32,"end_s":1200.64,"text":"used to have runaway footage pretty pretty often","speaker":null,"is_sponsor":0},{"start_s":1198.64,"end_s":1204.559,"text":"in the last uh little bit for those of you not familiar that means when you","speaker":null,"is_sponsor":0},{"start_s":1202.88,"end_s":1208.799,"text":"stop the playhead it like keeps going for a bit or yeah yeah okay like the","speaker":null,"is_sponsor":0},{"start_s":1207.039,"end_s":1212.24,"text":"last couple weeks right yeah the last couple weeks when i would play back","speaker":null,"is_sponsor":0},{"start_s":1210.4,"end_s":1216.0,"text":"footage especially uh the footage from the sony's it would","speaker":null,"is_sponsor":0},{"start_s":1213.76,"end_s":1219.12,"text":"just like run away for me for a few seconds it's hard to make an accurate","speaker":null,"is_sponsor":0},{"start_s":1217.44,"end_s":1223.28,"text":"car that way yeah okay now it seems fine","speaker":null,"is_sponsor":0},{"start_s":1221.2,"end_s":1226.72,"text":"okay all right confirmed we're gonna move ahead with it and confirmed we're","speaker":null,"is_sponsor":0},{"start_s":1225.2,"end_s":1231.6,"text":"gonna tell you about our sponsor thanks to current for sponsoring this video current is a mobile app and debit card","speaker":null,"is_sponsor":0},{"start_s":1229.84,"end_s":1235.36,"text":"that helps you spend and save better so you have the freedom to do you their app","speaker":null,"is_sponsor":0},{"start_s":1233.6,"end_s":1239.919,"text":"makes it easy to see where your money is going and set different savings goals to","speaker":null,"is_sponsor":0},{"start_s":1238.0,"end_s":1245.2,"text":"keep you on track you can withdraw your money without fees across all 40 000 all","speaker":null,"is_sponsor":0},{"start_s":1242.96,"end_s":1249.2,"text":"point atms in the u.s and there are no overdraft fees up to a hundred dollars","speaker":null,"is_sponsor":0},{"start_s":1247.52,"end_s":1253.36,"text":"you can send money easily to friends and sign up takes less than two minutes so","speaker":null,"is_sponsor":0},{"start_s":1251.039,"end_s":1257.039,"text":"head to current.com Linus tech tips and sign up for current today if you guys","speaker":null,"is_sponsor":0},{"start_s":1255.28,"end_s":1261.52,"text":"enjoyed this video maybe check out of some of our previous server vlogs it's","speaker":null,"is_sponsor":0},{"start_s":1260.24,"end_s":1266.24,"text":"the last time we tried to deploy this server how about that yeah","speaker":null,"is_sponsor":0},{"start_s":1264.72,"end_s":1268.32,"text":"someday we'll get it right maybe this is it","speaker":null,"is_sponsor":0}],"full_text":"after months of performance hiccups several blue screens and us literally being able to bring down the entire core of our operation just by ingesting video footage to our storage server i'm finally ready for a change admittedly maybe running new new wanik our main video editing server on Windows was a mistake i had my reasons some of which were valid but it's clear at this point that you guys were right the advantages of running Windows are far outweighed by the problems that we've encountered so it is finally the day so many of you have been waiting for when we remove the last Windows machine from our server room we're going Linux baby we're doing it right thanks cablemod for sponsoring this video cablemod allows you to personalize the look of your pc with custom colored sleeved cables try out their configurator and build your cables exactly how you want them with their realistic cable preview we're gonna have it linked down below this should be easy i've got my Linux install usb right here all we got to do is slap it into wanik's server and boom we're off to the races right you see the thing is unlike most of our videos where the hardware is just going to get torn down immediately afterward wanik server is our one and only production network editing server we can't just shut it down format it and reinstall anytime we want because a we wouldn't have anything to store our videos on or or edit off of and b we would lose all of the work we've done on our active projects that means we either have to do this whole process on a weekend or we have to migrate at least temporarily to a different server as you can see it is not the weekend so the plan is to use my home nas machine as a test bed and then eventually migrate what we've done over to new new wanick one three new pneumonic my intention is for this to eventually end up at my house but that may not end up happening for a number of reasons not the least of which is that Jake has become very enamored with the kind of performance that we get out of these gen four keoxia NVMe drives he and i are gonna have to fight that out a little bit later in the meantime let's uh let's build up a server shall we actually that's a bit of a lie this server is already built so what we need to do is we need to upgrade it we'll start by taking out this epic 7402 i got it 24 cores is plenty for what i'll be doing at home but as we learned the hard way you basically can't have enough CPU performance if you want to get the most out of these gen 4 NVMe drives oh and if another 8 cores doesn't end up alleviating the bottlenecks we've found we've got a 7742 64 core that we can play around with later another thing you can't have enough of in a storage server like this is RAM and i mean that both in terms of capacity and in terms of speed when we were deploying this at my house we put the smallest crappiest kit that we possibly could i mean obviously without compromising on reliability so this is 64 gigs of 2666 ddr4 truthfully the sticks i'm putting in now aren't really ideal either they're running at 26.66 mega transfers per second compared to epic's maximum of 3200 but we're gonna have 256 gigs rather than 64 gigs which is going to make a big difference especially for using zfs which we are as much as there might be some kind of GPU accelerated storage something uh i've never heard of it so we're gonna pull this 1050 ti out here that was supposed to be for plex transcoding and we're gonna replace it with this gorgeous melanox connect x6 100 gigabit per second network card uh do we really need these one terabyte drives for boot we have like a dozen of those uh those octane m.2s that are like 32 gigs and they're perfect there's actually not that many left server boot drives oh really oh all right well i guess i keep using them for stuff like this where it just really doesn't matter how much capacity you have and you just want something reliable speaking of our installation media there was a fair bit of deliberation when it came to choosing an operating system ubuntu server seemed good except that the current long-term supported version or lts for short doesn't have open zfs 2.0 which features a bunch of performance improvements for zfs which is the file system we intend to use and then db and 11 sounded good it has open cfs 2.0 and a version of samba the software used to host Windows compatible smb network shares from this year which is great except it's from march um which is not great so the beginning of this video ended up being a bit of a lie because while we could have still gone with Linux just find a distro that's got a new enough kernel uh potentially build open zfs 2.0 and samba from scratch there is an easier option trueness it's got opencfs 2.0 a very recent samba and a really nice web interface for managing your storage it's not Linux but it is based on a unix-like operating system called freebsd so we're we're back on the used to be free nas now truenas train i don't know what it is about their product but pretty much every time i go to use it something blows up in a way that is totally inexplicable i've ended up escalated to like directors and vps of engineering multiple times with nobody ever able to explain why the product just won't work properly for me but hey fifth time's a charm works properly for Jake yeah as long as it works properly for Jake you know our backup servers are running truenast for like a year now i i know i know it's a good product i've recommended it to countless people i've just never been able to get it working the way that i need it to work did it just turn on do you have it set to just restore power on ac probably okay let's just give it a sec here that's what servers are supposed to do okay where's that usb we don't need it oh we're gonna do it properly i thought you told me we need a usb uh just for just for visuals are we gonna go ipmi af and use an image and everything yeah look at us doing things properly today yeah i didn't download truenast but i will now wait what happened to my laptop i put it away you don't need it oh you told me to bring it i didn't realize there was a keyboard here ah the problem with mac ipmi is i can't like press f10 properly like doesn't work press f10 to pay respect doesn't work i can screen record on this thing for like an hour and only use like 30 battery and its touch pad is the equivalent of being hung like a horse it is look at it look at this let me show you my touch pad okay look oh okay it's a touch pad actually what i was really going to show you was my underwear from lttstore.com store lttstore.com it comes with cat hair comes no it doesn't that's from your cat i just walk out in the hallway and she's like what's up bro virtual cd-rom enter here we go boys this is the smart way to do it you shouldn't actually ever have to plug a monitor into a server you ready install wow wow that was inspirational look at it go okay hold on hold on pick our door hold on yeah we don't want to install the wrong drive now this is cool even though AMD epic servers do not have any innate support for raid that means you can't even install two boot drives like we did and then just configured in the BIOS to run raid freaking simple one trueness has a quick and easy way for you to install your operating system to two drives so in the event of a hardware failure you're just ready to go again immediately yeah it literally just shows up as a separate boot entry you can just pick which one to boot from okay time to go to lunch see you later i'm asking if i can turn it on well that's too bad because i already did ah roasted yeah what's up now what are you gonna hard power it off yeah what's up no ha got him now who turned it on this guy wanna turn it off again i'm turning it off first this is bad hardware practices hey wait mother man it's not plugged in all the way oh my god snapped out must have been when you unplug the power i'm turning it off first why is there is there blinking on the port ip no we have to take it to the server room later anyways let's just take it there now this is the way to do it i mean did we say we were gonna do everything properly today uh no okay cool because that's definitely not what's happening hey i got 100 gig you won't believe how much gigabytes you can put in this bad boy there's a bunch of hard drives under there stop slapping it let's go back around i don't want to wait okay let's create a pool name name it's called lambo so do i click them in order to add the video no you don't um just click all and then unselect that oh yeah we don't want this dao i think that's the virtual thing from ipmi 12 selected just click over okay so i did a little bit of testing beforehand it doesn't seem like it makes a difference between having one v dev or two for our workload okay raid z is fine yeah raid z is going to give us one failed drive before we actually start to lose data i'm not expecting to lose a ton of these drives and this data is going to be replicated using our snapshot to another server that's over in unit 101 yeah and then it'll be replicated again off-site to kamloops once Jake gets around to fixing the new kamloops server yeah there we go oh that's 72 terabytes that's not bad that's not bad usable okay so we got to make a oh here first thing go to that yeah we have to turn auto trim on pool options oh why is that not by default well most people don't use ssds with trueness that's fair we got to make a new data set add data set and then let's call this a z drive turn compression off we don't need that pretty much all the data we're going to write to this thing is incompressible video footage so there's just no benefit we could turn it on later because there are other things like word files but for now because we're going to do some performance testing too let's leave it off turn a time off we don't need that either that's like the access time is that a festival store the last time a file is accessed you might use that to see if your kids have been looking at your share type smb that's gonna set it to be case insensitive okay um we're gonna leave the record size at 128 kb now you could theoretically change it to one megabyte that might be better if you're like have a plex server because those are bigger chunks which means less overhead i mean our chunks are pretty big but for whatever reason when i was playing with premiere it seemed like it was a little worse so at least in scrubbing yeah because it will increase your latency stuff oh we gotta do some zfs tuning yeah because why would you want things to just like work immediately look it's not made for NVMe we're kind of doing it dirty right now primary cache all one word equals metadata and then we'll do space lambo slash z drive okay enter aha okay okay that just means our RAM now stores only metadata yes which makes sense because our storage is so fast that there's pretty much no point using our system RAM as a more conventional cache for it for most use cases though i haven't actually played with it in premiere it might actually like the lower latency and when we deploy to actual wanik we'll have a terabyte of RAM so maybe it might actually make sense but for now we're just gonna leave it off okay wow it's really poorly formatted but lambo z drive users metadata on the next line cool it worked all right now we got a tomb samba so on truenast smb samba is not really configured for the type of performance that we're going for we're talking like 20 30 40 gigabit on our 100 gig card not you know gigabit or 10 gig so we have to make a few changes now by default for some reason at least according to this dude on the internet that has this article about trueness and the testing that i've done it seems like they set the the default threads for smb multi-channel to like one read one right whereas like the default in samba is like a hundred right there's probably a reason for this and maybe they've changed it back but from testing before changing it to testing after it was a huge difference i wonder if it's one of those things where for the average home user repurposing an old machine and just like throwing a couple hard drives in which closet yeah yeah maybe it like overwhelms you know that the athlon xp then this is also like the community edition right so if you were to buy a machine from truenas one of their pre-built i imagine they would already configure this stuff for you anyways we're just going to copy paste this stuff into our config just need one more zero in there a lot of bytes yep now the thing is these drives are capable of like tens of gigabytes a second of raw reads and writes but as soon as you start trying to run a file system on them like zfs performance takes a bit of a kick in the balls especially when you have to calculate parity which is a whole other thing that's why we upgraded the CPU hopefully we can get a little more parody in let's see where we end up okay we're going to do a right test first 50. here we go 12 jobs because we have 12 drives laying out some files that's pretty good wow that's more than 100 gig it kind of fluctuates a bit but that's pretty damn good that is not bad as long as we're above 100 gig yeah then we can't possibly be bottlenecked by the drives and i think we're at bottleneck by CPU right now too i bet if we go look at the CPU oh yeah it's probably getting absolutely crashed 100 41 you know it's probably a little bit slower in terms of writing then i bet you if we do a read test it'll be 100 oh okay but i think it's just because it's calculating parity and whatnot true nas is not built for these speeds we're using them for these speeds but properly yeah all right read eight gigabytes a second you know i was getting a little higher than this before i'm a little surprised i wonder if the CPU is slower so far beyond good enough now something to note is that when you're benchmarking your desktop system changing the queue depth to get like massive numbers is not representative of the real world because an individual user sitting in front of a computer could never use it hard enough to reach q depths of you know eight probably let alone 16 or 32 which you might do in benchmarking however for a machine like this where literally dozens of people are accessing it that is conceivable and that is a reasonable way to test it but we were only testing with two yeah so that's why i said it's turning it up is not it's not a hack to just show you guys a bigger number it actually is applicable to this user i wonder if we try more threads we have more threads so let's try 24 2 give me all the threads 20. give me more threads i want a bigger number whoa hey there it is 18 gb bytes per second interestingly CPU usage doesn't really go up tldr it's very fast very fast it's way faster than we ever need and it's way faster than one so let's try fishy you know it's good that we actually left the one terabyte in there because of those ingest issues so that was another problem that actually that was what really prompted me to go okay yeah forget it we're done with this because when we would ingest footage from the stations over there if it was greater than one terabyte it would fill up less than that is it it basically like when you write to storage spaces it just goes to RAM and then it flushes to disk slowly and when we had the ursas those drives could do like one and a half gigabytes a second you know times a few if you ingested fast enough you'd fill up the RAM and storage spaces only lets itself use half of your system memory right and then at that point it would just crash the network share like for everyone and there's no evident way to turn it off yeah because our disks are fast enough we could just go straight to the disks but we couldn't turn off the stupid round caching and especially when you've got an os that blue screens every once in a while having 500 gigabytes of data potentially in a RAM cache yeah one does not simply so this is kind of dog poo what we need to do is go into one of the editors stations that is not Windows server running storage spaces and like copy these files or something okay so i actually oh my god i didn't touch it i'm sorry it's been a stressful week what's up can i borrow this of course okay let me drive for a sec here okay so i want to copy this to my local drive huh that is not very good Jake it's possible that the issue is just Windows file transfer being Windows file transfer so we're pulling out the big guns here bringing out show easy copy look at that 20 gigabit oh well that's better uh where are you going to and from right now i'm going from wanik to to the other the test one yeah and i'm sure we open this lots of blinky lights so there are okay yeah there's your CPU right there okay i'm copying over a red mag boom pinned to 495 megabytes a second which is the speed of a red meg okay what else we got red map brandon is what's yours going at 499 okay so we've got a total of a Gigabyte a second heading over there i need to find some more media to copy here what you'll see is sometimes it'll slow down when it's going between clips red footage is a bunch of clips so yeah between each clip Windows file transfer will like dip for a bit yeah we're definitely running into some kind of bottleneck on this system where it's maxing out at 500 megabytes a second no matter what we plug into but still overall the ingestations are performing better than with old wanik which is new 1-3 so this will be new new new wanik anyway the point is i paused all the transfers and we're going to have three or four editors now try to edit and then i'm going to start these again and make sure everyone's smooth our guinea pigs are going to be ed mark and emily over here and you guys are pretending to edit right i mean that's basically all everyone in here does right if everyone a prime pretending to edit what are you pretending to edit right now i'm not pretending you know oh okay well we've got at least okay we got at least one editor actually editing fantastic hoffman that's a beautiful picture of david all right so guys keep pretending to edit andy you stay here i'm gonna go turn on all those file copies just like before we got about 10 gig on the one on the right five gig on the one on the left and how are your projects going it seemed fairly normal or very normal or better than normal it's not better but it's normal not better but normal yeah it's pretty much exactly exactly the same all right thanks teddy yeah it's good it's acceptable is it it's not worse that's good but it's not better it's it's hard to say to be honest okay yeah okay it's it's i could i could have it with this yeah okay really wasn't the goal today the goal today was hey this is going to be perfect and amazing you guys are going to love it so uh is it no no the goal was the same okay ed how's yours doing um i think this is doing well historically i think it's about on par with uh what performance was like before but as of late this is a lot better um i used to have runaway footage pretty pretty often in the last uh little bit for those of you not familiar that means when you stop the playhead it like keeps going for a bit or yeah yeah okay like the last couple weeks right yeah the last couple weeks when i would play back footage especially uh the footage from the sony's it would just like run away for me for a few seconds it's hard to make an accurate car that way yeah okay now it seems fine okay all right confirmed we're gonna move ahead with it and confirmed we're gonna tell you about our sponsor thanks to current for sponsoring this video current is a mobile app and debit card that helps you spend and save better so you have the freedom to do you their app makes it easy to see where your money is going and set different savings goals to keep you on track you can withdraw your money without fees across all 40 000 all point atms in the u.s and there are no overdraft fees up to a hundred dollars you can send money easily to friends and sign up takes less than two minutes so head to current.com Linus tech tips and sign up for current today if you guys enjoyed this video maybe check out of some of our previous server vlogs it's the last time we tried to deploy this server how about that yeah someday we'll get it right maybe this is it"}