{"video_id":"1vaEBgceqdA","title":"Can You Have TOO Many CPU Cores?","channel":"Techquickie","show":"Techquickie","published_at":"2020-05-05T14:58:16Z","duration_s":374,"segments":[{"start_s":0.08,"end_s":5.68,"text":"whether we're talking dollars in your bank account items on a seafood buffet","speaker":null,"is_sponsor":0},{"start_s":3.36,"end_s":10.48,"text":"or dates you've got lined up on tinder more is generally considered to be","speaker":null,"is_sponsor":0},{"start_s":8.24,"end_s":14.88,"text":"better a sentiment that also seems to hold true with the number of cores in","speaker":null,"is_sponsor":0},{"start_s":12.4,"end_s":19.199,"text":"your computer CPU at least if you buy into the marketing hold on even though","speaker":null,"is_sponsor":0},{"start_s":17.039,"end_s":24.48,"text":"having many cores definitely gives you a boost in multi-threaded applications","speaker":null,"is_sponsor":0},{"start_s":21.279,"end_s":26.8,"text":"like rendering 3d animations there are","speaker":null,"is_sponsor":0},{"start_s":24.48,"end_s":32.48,"text":"actually situations where more cores gives no benefit whatsoever or can even","speaker":null,"is_sponsor":0},{"start_s":29.359,"end_s":34.559,"text":"actually hurt your system's performance","speaker":null,"is_sponsor":0},{"start_s":32.48,"end_s":39.12,"text":"but how could this be well to start off with the more cores","speaker":null,"is_sponsor":0},{"start_s":36.559,"end_s":43.44,"text":"you pack onto a CPU the more power they need and the more heat they generate and","speaker":null,"is_sponsor":0},{"start_s":41.44,"end_s":48.48,"text":"remember that because CPU cores are crammed into a relatively small space","speaker":null,"is_sponsor":0},{"start_s":46.32,"end_s":53.039,"text":"manufacturers end up working against some serious limits when it comes to","speaker":null,"is_sponsor":0},{"start_s":50.399,"end_s":57.44,"text":"thermal design power or TDP this means that to prevent the CPU from","speaker":null,"is_sponsor":0},{"start_s":55.44,"end_s":61.92,"text":"drawing too much power and producing too much heat the individual cores have","speaker":null,"is_sponsor":0},{"start_s":60.399,"end_s":68.0,"text":"traditionally run their clock frequencies lower to improve efficiency","speaker":null,"is_sponsor":0},{"start_s":65.439,"end_s":72.4,"text":"and even if the advertised boost clock for a CPU with lots and lots of course","speaker":null,"is_sponsor":0},{"start_s":70.56,"end_s":76.479,"text":"can appear to be high it's often the case that they cannot","speaker":null,"is_sponsor":0},{"start_s":74.24,"end_s":81.119,"text":"maintain these clocks for long periods of time or that they only do it when","speaker":null,"is_sponsor":0},{"start_s":78.88,"end_s":85.52,"text":"you're running very light applications so if you're using your computer mostly","speaker":null,"is_sponsor":0},{"start_s":83.6,"end_s":92.88,"text":"for applications where single threaded performance matters more such as games","speaker":null,"is_sponsor":0},{"start_s":88.4,"end_s":95.439,"text":"that super expensive 18 core CPU might","speaker":null,"is_sponsor":0},{"start_s":92.88,"end_s":99.84,"text":"actually yield you a worse experience than something cheaper","speaker":null,"is_sponsor":0},{"start_s":97.2,"end_s":104.96,"text":"and if you go with a really high core count CPU there's another wrinkle with","speaker":null,"is_sponsor":0},{"start_s":102.4,"end_s":110.32,"text":"how processors with that many cores access the system memory you see in some","speaker":null,"is_sponsor":0},{"start_s":107.6,"end_s":116.159,"text":"cases these larger cpus need to have their core split into two groups or","speaker":null,"is_sponsor":0},{"start_s":113.52,"end_s":120.96,"text":"nodes of course with each group getting its own memory controller and segment of","speaker":null,"is_sponsor":0},{"start_s":118.719,"end_s":125.2,"text":"the physical memory in a scheme called non-uniform memory access or pneuma","speaker":null,"is_sponsor":0},{"start_s":125.2,"end_s":132.319,"text":"this is generally quicker than the opposite solution called uniform memory","speaker":null,"is_sponsor":0},{"start_s":129.28,"end_s":135.04,"text":"access or yuma where all the cores share","speaker":null,"is_sponsor":0},{"start_s":132.319,"end_s":139.52,"text":"one big pool of memory but here's the thing a CPU that uses pneuma which is","speaker":null,"is_sponsor":0},{"start_s":137.92,"end_s":144.48,"text":"better for latency sensitive applications can often struggle when","speaker":null,"is_sponsor":0},{"start_s":142.16,"end_s":148.08,"text":"running a single program that uses tons of threads","speaker":null,"is_sponsor":0},{"start_s":146.319,"end_s":151.76,"text":"because of the different memory access times between the nodes and the fact","speaker":null,"is_sponsor":0},{"start_s":150.16,"end_s":155.84,"text":"that each node would have to wait on the other one to finish working on the same","speaker":null,"is_sponsor":0},{"start_s":153.36,"end_s":160.48,"text":"data highly multi-threaded programs like these often don't want to cross nodes","speaker":null,"is_sponsor":0},{"start_s":158.72,"end_s":165.28,"text":"even if it would mean being able to take advantage of the entire CPU","speaker":null,"is_sponsor":0},{"start_s":162.8,"end_s":168.64,"text":"so back to yuma then right no","speaker":null,"is_sponsor":0},{"start_s":166.4,"end_s":173.84,"text":"because one controller manages all the memory accesses to give every program","speaker":null,"is_sponsor":0},{"start_s":171.2,"end_s":180.239,"text":"equal time rather than allowing access to the memory more directly as in numa","speaker":null,"is_sponsor":0},{"start_s":177.12,"end_s":182.879,"text":"yuma has a built-in performance penalty","speaker":null,"is_sponsor":0},{"start_s":180.239,"end_s":186.959,"text":"that increases the more nodes your system has to manage","speaker":null,"is_sponsor":0},{"start_s":184.48,"end_s":191.36,"text":"so using a CPU with separate groups of cores means you're going to be subjected","speaker":null,"is_sponsor":0},{"start_s":189.04,"end_s":195.04,"text":"to one of these drawbacks and you're going to take a performance hit either","speaker":null,"is_sponsor":0},{"start_s":193.599,"end_s":199.68,"text":"way and these are problems that you simply don't run into on smaller chips","speaker":null,"is_sponsor":0},{"start_s":197.599,"end_s":203.68,"text":"with fewer cores because you're not dealing with multiple nodes","speaker":null,"is_sponsor":0},{"start_s":201.76,"end_s":208.08,"text":"but getting away from memory access sometimes the cores themselves are even","speaker":null,"is_sponsor":0},{"start_s":206.159,"end_s":212.799,"text":"designed in a way that bottlenecks them the more of them you slap onto a chip do","speaker":null,"is_sponsor":0},{"start_s":210.4,"end_s":217.519,"text":"you remember how before ryzen AMD processors seemed to be significantly","speaker":null,"is_sponsor":0},{"start_s":215.12,"end_s":220.319,"text":"slower than Intel despite having more cores","speaker":null,"is_sponsor":0},{"start_s":218.48,"end_s":225.36,"text":"well a big reason for this was that those old bulldozer fx processors didn't","speaker":null,"is_sponsor":0},{"start_s":223.36,"end_s":231.2,"text":"use full cores instead an fx CPU advertised as having a","speaker":null,"is_sponsor":0},{"start_s":229.04,"end_s":235.76,"text":"cores would in reality have eight integer units but only four floating","speaker":null,"is_sponsor":0},{"start_s":233.68,"end_s":238.879,"text":"point units that were shared between the eight cores so if you don't know what a","speaker":null,"is_sponsor":0},{"start_s":237.599,"end_s":243.519,"text":"floating point unit is you can learn more about that right up here but the point is you could think of these cpus","speaker":null,"is_sponsor":0},{"start_s":242.4,"end_s":248.159,"text":"as having four half cores that were missing which","speaker":null,"is_sponsor":0},{"start_s":246.319,"end_s":253.519,"text":"severely hampered their single threaded performance in some key applications","speaker":null,"is_sponsor":0},{"start_s":251.12,"end_s":256.88,"text":"now this design allowed AMD processors to handle more threads for a cheaper","speaker":null,"is_sponsor":0},{"start_s":255.12,"end_s":261.359,"text":"price but it also meant that their real-world performance legged way behind","speaker":null,"is_sponsor":0},{"start_s":259.28,"end_s":265.84,"text":"Intel and the only way AMD could try and compensate was to increase clock speeds","speaker":null,"is_sponsor":0},{"start_s":263.919,"end_s":270.56,"text":"which increased heat output and contributed to AMD's reputation for hot","speaker":null,"is_sponsor":0},{"start_s":267.919,"end_s":275.12,"text":"running cpus for many years so what's our bottom line then although both AMD","speaker":null,"is_sponsor":0},{"start_s":273.12,"end_s":279.759,"text":"and Intel are using much wiser strategies for their many core cpus and","speaker":null,"is_sponsor":0},{"start_s":277.919,"end_s":284.24,"text":"clever boosting techniques to give them similar single threaded performance to","speaker":null,"is_sponsor":0},{"start_s":281.68,"end_s":288.8,"text":"their less costly brethren if the best sales pitch for a super","speaker":null,"is_sponsor":0},{"start_s":286.479,"end_s":292.96,"text":"premium product is that it doesn't suffer a performance penalty in the","speaker":null,"is_sponsor":0},{"start_s":291.199,"end_s":297.6,"text":"applications that you use well you'd better make sure you've got a use","speaker":null,"is_sponsor":0},{"start_s":295.6,"end_s":304.24,"text":"case for it before spending your hard earned cash and no playing fortnight and","speaker":null,"is_sponsor":0},{"start_s":300.639,"end_s":306.56,"text":"watching techwiki definitely don't count","speaker":null,"is_sponsor":0},{"start_s":304.24,"end_s":311.44,"text":"and neither does using brilliant because you can kind of do it anywhere effective","speaker":null,"is_sponsor":1},{"start_s":308.56,"end_s":316.24,"text":"learning guys is active not passive so learning from lectures and videos is","speaker":null,"is_sponsor":1},{"start_s":313.759,"end_s":320.96,"text":"just not as fast as diving in and doing things yourself and brilliant is a","speaker":null,"is_sponsor":1},{"start_s":318.72,"end_s":325.759,"text":"problem-solving based website and app with a hands-on approach with over 60","speaker":null,"is_sponsor":1},{"start_s":323.44,"end_s":329.759,"text":"interactive courses in math science and computer science brilliant lets you","speaker":null,"is_sponsor":1},{"start_s":327.68,"end_s":333.84,"text":"master concepts by solving fun challenging problems for yourself rather","speaker":null,"is_sponsor":1},{"start_s":332.24,"end_s":337.919,"text":"than by watching someone else do it and this is really useful if you're in a","speaker":null,"is_sponsor":1},{"start_s":335.84,"end_s":342.479,"text":"stem course their courses have storytelling code writing interactive","speaker":null,"is_sponsor":1},{"start_s":340.08,"end_s":346.56,"text":"challenges and problems to solve and you can check out great courses like the one","speaker":null,"is_sponsor":1},{"start_s":344.24,"end_s":350.8,"text":"on search engines so you can learn how it is that google answers a question in","speaker":null,"is_sponsor":1},{"start_s":348.8,"end_s":354.08,"text":"a fraction of a second even though there are so many billions of sites to search","speaker":null,"is_sponsor":1},{"start_s":353.199,"end_s":359.44,"text":"through so check it out now because the first 200 of you to head to brilliant.org","speaker":null,"is_sponsor":1},{"start_s":357.84,"end_s":363.759,"text":"techwiki we're going to have that linked below are going to get 20 off their","speaker":null,"is_sponsor":1},{"start_s":361.84,"end_s":367.919,"text":"annual premium subscription so thanks for watching guys like dislike","speaker":null,"is_sponsor":1},{"start_s":365.44,"end_s":375.0,"text":"check out our other videos and don't forget to subscribe","speaker":null,"is_sponsor":0},{"start_s":370.639,"end_s":375.0,"text":"that wouldn't be brilliant would it","speaker":null,"is_sponsor":0}],"full_text":"whether we're talking dollars in your bank account items on a seafood buffet or dates you've got lined up on tinder more is generally considered to be better a sentiment that also seems to hold true with the number of cores in your computer CPU at least if you buy into the marketing hold on even though having many cores definitely gives you a boost in multi-threaded applications like rendering 3d animations there are actually situations where more cores gives no benefit whatsoever or can even actually hurt your system's performance but how could this be well to start off with the more cores you pack onto a CPU the more power they need and the more heat they generate and remember that because CPU cores are crammed into a relatively small space manufacturers end up working against some serious limits when it comes to thermal design power or TDP this means that to prevent the CPU from drawing too much power and producing too much heat the individual cores have traditionally run their clock frequencies lower to improve efficiency and even if the advertised boost clock for a CPU with lots and lots of course can appear to be high it's often the case that they cannot maintain these clocks for long periods of time or that they only do it when you're running very light applications so if you're using your computer mostly for applications where single threaded performance matters more such as games that super expensive 18 core CPU might actually yield you a worse experience than something cheaper and if you go with a really high core count CPU there's another wrinkle with how processors with that many cores access the system memory you see in some cases these larger cpus need to have their core split into two groups or nodes of course with each group getting its own memory controller and segment of the physical memory in a scheme called non-uniform memory access or pneuma this is generally quicker than the opposite solution called uniform memory access or yuma where all the cores share one big pool of memory but here's the thing a CPU that uses pneuma which is better for latency sensitive applications can often struggle when running a single program that uses tons of threads because of the different memory access times between the nodes and the fact that each node would have to wait on the other one to finish working on the same data highly multi-threaded programs like these often don't want to cross nodes even if it would mean being able to take advantage of the entire CPU so back to yuma then right no because one controller manages all the memory accesses to give every program equal time rather than allowing access to the memory more directly as in numa yuma has a built-in performance penalty that increases the more nodes your system has to manage so using a CPU with separate groups of cores means you're going to be subjected to one of these drawbacks and you're going to take a performance hit either way and these are problems that you simply don't run into on smaller chips with fewer cores because you're not dealing with multiple nodes but getting away from memory access sometimes the cores themselves are even designed in a way that bottlenecks them the more of them you slap onto a chip do you remember how before ryzen AMD processors seemed to be significantly slower than Intel despite having more cores well a big reason for this was that those old bulldozer fx processors didn't use full cores instead an fx CPU advertised as having a cores would in reality have eight integer units but only four floating point units that were shared between the eight cores so if you don't know what a floating point unit is you can learn more about that right up here but the point is you could think of these cpus as having four half cores that were missing which severely hampered their single threaded performance in some key applications now this design allowed AMD processors to handle more threads for a cheaper price but it also meant that their real-world performance legged way behind Intel and the only way AMD could try and compensate was to increase clock speeds which increased heat output and contributed to AMD's reputation for hot running cpus for many years so what's our bottom line then although both AMD and Intel are using much wiser strategies for their many core cpus and clever boosting techniques to give them similar single threaded performance to their less costly brethren if the best sales pitch for a super premium product is that it doesn't suffer a performance penalty in the applications that you use well you'd better make sure you've got a use case for it before spending your hard earned cash and no playing fortnight and watching techwiki definitely don't count and neither does using brilliant because you can kind of do it anywhere effective learning guys is active not passive so learning from lectures and videos is just not as fast as diving in and doing things yourself and brilliant is a problem-solving based website and app with a hands-on approach with over 60 interactive courses in math science and computer science brilliant lets you master concepts by solving fun challenging problems for yourself rather than by watching someone else do it and this is really useful if you're in a stem course their courses have storytelling code writing interactive challenges and problems to solve and you can check out great courses like the one on search engines so you can learn how it is that google answers a question in a fraction of a second even though there are so many billions of sites to search through so check it out now because the first 200 of you to head to brilliant.org techwiki we're going to have that linked below are going to get 20 off their annual premium subscription so thanks for watching guys like dislike check out our other videos and don't forget to subscribe that wouldn't be brilliant would it"}