way back before the Big Move I built a
100 plus terabyte storage server to
replace the awful store data on
disconnected drives on a shelf in the bathroom system that we were rocking
before thanks Seagate for the awesome drives and thanks 45 drives.com for the
Rock and personalized storinator server but some of you may have noticed that I
never followed up on the performance testing that I promised to do on that
machine I was supposed to be showing off
1 Gigabyte per second transfers with the
10 GB network setup what gives well
today we finally get the whole
story the master case 5 by Cooler Master gives you the freedom to truly make your
midtower PC case your own with a variety of modular parts and access
check out the link in the video description to learn more so the short
version is this in spite of 45 drives
telling me that they had customers with similar configs saturating a 10 GB link
or more I couldn't even get half of that
and it made no sense really I did a lot of tinkering with this box before
eventually deploying it different network cards different Drive
configurations and finally got to the point where it was whether freas
Hardware or pbac I had to roll it out
because we needed to put our data somewhere and I was just going to have
to live with the results that I got I mean I know I know poor lonus only has
300 to 350 megabyte per second speeds to
his over 100 terabytes of safe storage
boohoo but this disrupted my plans for
our storage infrastructure in a bigger way than you might think in addition to
archiving old stuff to the server my intention was to have our daily use NZ
the SSD one that you probably remember from this video doing nightly syncs or
even hourly checkpoints if we could get away with it so we'd have two full
copies of all of our mission critical data so I wanted the magnetic NZ to be
fast enough to handle that and any
random data that our editors needed to read from it from old projects which we
were not able to do so while I've had
four months to diagnose this and Ponder what could be wrong because it's had up
to 60 terabytes of important data on it
with nowhere else to offload that I've had no choice but to just Lim along at
300 350 megabytes per second until
today Seagate sent us 35 of their new 8
terabyte Enterprise capacity drives and no these are not the shingled platter
archival ones these are rocking ass capable of well in excessive 200
megabytes per second transfer speeds rated at 2 million hours meantime
between failure and with a 5year warranty to back it up proper Enterprise
capacity drives so I immediately tore
them out of their packaging and began building pyramids that no just kidding
well actually okay I did build pyramids but but what I actually built with them
after the pyramids was two additional servers each to hold a copy of our 60
terabytes of data while I worked on the
Vault so one of those machines is actually eventually going to be a Nas
unit at my house and the other one is going to be an off-site backup server
for this puppy but each of those will get their own videos later so with the
data safely stored on a hardware raid 6 and on a software butter FS raid 5 each
of those transfers took over a day by the way I wiped the frez and be began
trying things so first I tried six Drive
vevs since that's a more optimal number for ZFS 2 nope still shoddy transfer
speeds next I tried 10 Drive vevs no
difference again finally in desperation
I tried a 27 Drive raid zero an
experimental class configuration that no one should trust to hold any data no
matter how amazing the drives are and
same thing which after talking to the folks at 45 drives about my findings
revealed that the issue is probably a
software one because they've seen NFS shares just fly in a similar
configuration to mine which doesn't do me any good because this is a Windows
environment and we need SMB shares and
so I had to keep investigating because if I'm going to be running around saying
this Nas unit in these drives are capable of over a Gigabyte per second of
transfer speed we use them here at l Media Group I mean I'm basically
endorsing the things it's not good enough to me for 45 drives to see it in
their lab I need to see it so I've been
chatting a lot with the unraid guys ever since they helped us do the two Gamers
one CPU project which you should definitely check out if you haven't
already and they offered to spend some time configuring an experimental raid
five butter FS array in un raid and
tuning both the network settings as well
as the SMB share settings so our initial
test on a vanilla unraid server was frankly pretty ho hum actually fairly
similar there's that poor SMB optimization outside of Windows
platforms rearing its ugly head again
some 4 kilobyte packet and jumbo frame tuning to the network card tuning of
unraid networking configuration and boom
that my friends is the cleanest 10 gigabit transfer that I've actually ever
seen now not a lot of lime Tech
customers are running 10 gig e but from their perspective I guess it's just
valuable R&D for down the road when that gear becomes more common but I mean even
then this is not the kind of config that most people will encounter even on
unrated I actually don't intend to continue to run it like this uh butter
FS raid five and raid six are both in the experimental stage but the good news
here is that what I realized after running the slow freas configuration for
so long was that generally speaking I don't need
more than the 200 to 220 megabyte pers
second transfer speeds that my individual drives are capable of in a
normal unraid array and that the only
thing that needs to be lightning fast performance-wise is the new footage and
projects that we offload to it relatively little of which is created on
a daily basis so we devised a new plan
and to help us realize the new plan Kingston stepped up and offered to send
us eight of their e50 Enterprise grade 480 gig ssds with power loss protection
these drives will act as a 2 tbte RAID
10 right cache that will be capable of the full 10 gbit transfer rate for fast
updates throughout the day and that then flushes nightly to the hard drives when
no one is using them all of this can be completely transparent to the user so
the only time we'll ever see sub 1 GB
per second transfers is when we're accessing cold data or when doing a
massive dump of over 2 terabytes at a
time another cool side note is that this might turn out to be a better way to
leverage the extra horsepower that this op server is leaving on the table anyway
because she never touches more than about 20% CPU usage so I could take a
couple of cores and turn them into a network rendering box or game server or
something else and on the subject then
of our server being op I guess that brings us to the conclusion it turns out
that the hardware is but SMB shares on
non Windows platforms take some tuning and optimization that if you're willing
to endure the dense documentation and condescending attitude of the freenas
community you could probably achieve there but instead I ended up working
directly with lime Tech to have baked into an upcoming release of unraid 6 and
I'm super happy with the new
config if you're building a mobile app and searching for a simple payment
solution you might want to check out brain tree with the brain tree v.0 SDK
which is just one small snippet of code you can be all set up and ready in less
than 10 minutes to take online payments and if you're having any trouble they
have support staff ready to walk you through the process over the phone if
you need them their code supports Android iOS and JavaScript clients and
they have sdks in in seven programming languages and it makes it easy to offer
multiple Mobile payment types including PayPal Apple pay Bitcoin venmo cards and
more all with a simple integration they've got quick knowledgeable
developer support if you have any questions and to learn more all you got
to do is go over to Braintree payments.com Linus and if you use that link you can
also get your first $50,000 in transactions with no fees
whatsoever so check it out today at the link in the video description so thanks
for watching guys if this video sucked you know what to do but if it was
awesome get subscribed hit the like button like button hit the like button
or even consider supporting us directly by using our affiliate code to shop at
Amazon instructions for which we're up here buying a cool shirt like this one
or with a direct monthly contribution through our form it gets you a little contributor tag now that you're done
doing all that stuff you're probably wondering what to watch next so click that little button in the top right
corner to check out the ultimate showdown between AMD's 8 core CPU and
Intel's 8 core server anyway it's complicated you guys should check it out
the video is there