while AMD endured a relatively lackluster ryzen 7000 launch thanks to
Fierce competition from everyone's favorite budget offering Intel in the
data center AMD is pulling no punches
with today's announcement of Epic Genoa they're bringing double-digit IPC
improvements a maximum of 96 cores per
socket a whopping 12 channels of ddr5
memory I don't even have that many fingers and so much more
we're going to tell you what's new and why Intel's upcoming Sapphire Rapids
probably won't be able to compete with this
spicy salami Mamma Mia oh quasi Picante comic questo
sponsor Segway build Redux build Redux makes it easy to configure your new
build with support guides and competitive pricing compared to building
a PC yourself head to build redux.com Linus and start your new build today for
those that haven't been paying attention let's get you up to speed AMD has been
releasing their epic line of server processors based on the Zen architecture
since 2017 with the first generation dubbed Naples
not until the more recent epic Rome in 2019 in Milan in 2021 however did AMD
actually manage to compete and then beat
Intel taking the performance Crown this
is in part due to core count Intel's monolithic style processors capped out
at a measly 40 chorus per socket
compared to AMD's 64 core chiplet designs back in 2021 Intel hoped to
compete against epic Milan with their own chiplet-based design codenamed
Sapphire Rapids but ended up delaying due to technical difficulties and poor
yields to a now confirmed January 2023
launch and they're still on 10 nanometer
or Intel 7 now they call it Intel seven we don't don't say nanometer come on
things are not looking great for Intel's Enterprise sector right now because
honestly Genoa looks awesome the most obvious
change with the latest generation is the New Zen 4 architecture running on tsmc's
five nanometer process zenfor is more of a refinement of Zen 3
rather than a complete redesign but while much of the micro architecture
layout is the same improvements have been sprinkled all over a big chunk of
the clean 14 IPC uplift comes from optimizations to the architecture front
end with improved Branch prediction that can predict two branches per cycle
rather than just one and a hefty bump to L2 cache they also introduced AVX 512
support which is going to be a huge help for machine learning and AI workloads in
the data center speaking of which the other major
upgrade this time around is core counts across the 18 total skus launching for
Genoa the max cores per socket has increased by a whopping 50 percent from
64 to 96 cores with the minimum core
count seeing a bump from 8 to 16 cores
on the lowest end skus despite the power efficiency
improvements of the new architecture maximum socket power consumption is
jumping from 280 Watts on the last generation to a whopping 400 watts per
socket a level that AMD's high performance compute customers have
actually been asking for though the company tells us they don't expect the
power envelope to climb much Beyond this point and don't expect to get much
further into this video without a mention of our beanies on ltdstore.com
uh they put LOL in there but you know what it's actually getting colder
unfortunately with great power draw comes great socket demands and Genoa is
no exception gone are the days of rectangular oppression say hello to our
new Square overlords Jokes Aside genoa's new sp5 socket packs
a whopping 6096 pins nice more like a like a nice
backwards it's a similar trade design to the previous sp3 socket but it's now
heatsink actuated rather than socket actuated that's fancy speak for the
cooler providing the necessary pressure to ensure proper contact between the CPU
and the socket's pins it's not dissimilar to the approach Intel has
been taking for a few years now except AMD thoughtfully included the lockdown
plate for the CPU to prevent you from accidentally dropping a chip into the
socket which you wouldn't want to do since
6096 nice pins are tiny head expensive
however they are not as expensive as the
copious amounts of memory this thing supports across 12 channels we're
talking up to six terabytes of ddr5
running at 4 800 Mega transfer per second allowing for a theoretical Peak
throughput it a 480 gigabytes per second across the whole thing six terabytes all
without taking too big of a hit in total latency oh and if that isn't enough fast
memory for you AMD is introducing support for cxl
wait what the hell cxl cxl is short for
compute express link and it could very well be a game changer in the service
space and potentially for Consumer Tech in the future it's a cash coherent
interconnect standard built on top of PCI Express 5 that allows for huge
increases to i o memory and storage flexibility
in the same way that AMD uses PCI Express Lanes as Infinity Fabric in
their dual socket servers cxl uses PCI
Express Lanes as low latency high bandwidth interconnects allowing the
system to pool or expand memory and
improve the performance of various types of Hardware accelerators like gpus or
network cards maybe you need an extra four terabytes of RAM for more
virtualization I know I do slap in a cxl memory card and you are good to go and
cxl lets you allocate that extra RAM to other devices if you want to generos
supports cxl 1.1 plus type 3 which is
the catchiest name I've read all week and is primarily focused on memory
expansion rather than accelerators cxl
is only just coming to the server Market but is primed to be a very important
technology for the future of our computers so keep an eye on it it might
come to Consumer Hardware sooner than you think if you're worried that you
won't have enough PCIe lanes for all this stuff then don't be a single CPU
provides you with 128 PCI Express Gen 5
lanes and up to 160 in two CPU systems
providing ample flexibility in terms of expansion and if you want to see just
how much you can fit into these things super micro let us unveil their new h13
Genoa Suite check out the link in the description to see some Hands-On
Hardware content and last but certainly not least AMD introduced a few
improvements to their security such as support for over a thousand encrypted
virtualizations that is pretty neat especially for vps's what kind of
perform from all of these slick new feature
enhancements though for starters more than double the performance in integer
arithmetic over Intel's 40 core Xeon 8380 Flagship which is expected
considering AMD has more than double the cores and ends up being just an eight
percent increase per core but the
customer is buying 96 core CPUs like this one
they would probably actually just want the more cores rather than faster cores
so does AMD's dominance then carry over
to the rest of the product stack according to AMD yes very yes
but before we get too far please note that AMD has been pretty liberal with
the scaling in their performance graphs so try to focus on the numbers
themselves rather than the pictures AMD claims that their 24 core epic 9274f
will compete with that same 40 core Intel CPU at least in integer operations
calling integer operations general purpose computing
is a bit of a stretch but
technically assume that all of these CPUs will perform 25 percent worse than
AMD promises you'll still see comparably cord AMD skus competing with Intel's
flagships maybe you shouldn't be quite so cynical because the way AMD tested
their CPUs for this could be leaving performance on the table let me explain
AMD has embraced the Silicon Lottery with their new power management feature
called determinism wow just like gonna take a philosophy there
well it comes in two flavors performance and power oh it is philosophy it's kind
of like AMD's Precision boost found on their ryzen chips and allows you to bump
up your performance within spec if you have the thermal or power Headroom to do
so in the performance determinism mode
the CPU will Target the maximum performance at a given TDP with power
varying to maintain stable performance power determinism is flipped with the
CPU targeting the highest frequencies while maintaining stable power drop
while a consumer might want more performance at all times Well if you run
servers that vary and load having a constant power draw can actually improve
efficiency and reduce stress on the components increasing the lifetime of
your server now back to the graphs for these reported benchmarks AMD didn't use
their determinism modes which means that customers could end up seeing extra
performance on their chips should they decide to take advantage of this feature
and even without that extra Edge AMD still claims massive per core increases
over Intel's lineup promising as much as twice the performance per core in high
performance Computing which makes them an obvious choice for simulation
workloads AMD has far faster cores which
helps them win an HPC and they have way
more cores which gives them the upper hand virtualization and hyperscaling but
here is the most damning comparison this
performance per server chart AMD can fit the same number of cores in
60 percent fewer servers using just half
the power despite the extra socket draw at this point Intel isn't even competing
they're sitting on the bench but all this performance of course means nothing
if the price isn't right is AMD leveraging their performance leadership
and charging through the nose well their Flagship
9654 that I'm holding in my hand right here is coming in at effectively 12 000
US Dollars which means the price per core remains virtually identical to
their Milan Flagship but they are charging around a 10 premium on most of
the product stack compared to Zen 3 which is a bit of a bump considering
customers are likely going to need all new servers in addition to all new Chips
thanks to the socket change and probably also all new RAM yeah it's gonna get
pricey but with the ever increasing amount of computing being done in the
cloud I'm sure that major players like AWS and
Google will happily pay the premium or you know just have their own CPUs like
you do and what's coming in the future well we know that we'll be seeing 3D V
cash verses of these chips with the upcoming Genoa X lineup and that the
Bergamo lineup will max out at 128 cores
on a single die while we've yet to see
what kind of upgrades Intel will bring with sapphire Rapids
it's clear that AMD isn't resting on its Laurels employing every trick in the
book to maintain the massive growth they've seen in the past couple of years
in the server space and with the ever-growing presence and threat of
ARM-based servers it's going to be tough for Intel to keep up now just make me
some non-pro Zen 4 threadrippers and
I'll be really happy almost as happy as I am to tell you about our sponsor MSI
the holidays are coming quickly but MSI has you covered for gifts this year
MSI's holiday deals are on now where you can save on their 12th gen laptops
desktops peripherals and components do the kids need a new laptop for school or
maybe your partner needs an upgrade to their outdated gaming rig there's
something for everyone on sale now and for those of you in the US there's the
hashtag timsi holiday giveaway tell MSI
what you're thankful for and enter to win gift cards apparel and more so what
are you waiting for check out MSI's deals and the hashtag Ty MSI holiday
giveaway at the link below to start saving today thanks for watching guys
obviously we haven't had a chance to put this guy through its Paces yet but maybe
if you want to see some epic action we have our holy on the Epic Milan
which was wow 2021
how time flies