{"video_id":"cHtNJngtS1I","title":"Benchmarks as Fast As Possible","channel":"Techquickie","show":"Techquickie","published_at":"2015-05-07T14:58:16Z","duration_s":322,"segments":[{"start_s":0.399,"end_s":7.16,"text":"life used to be so simple when we wanted to know how computer a compared to","speaker":null,"is_sponsor":0},{"start_s":4.88,"end_s":11.32,"text":"computer B all we had to do was look at the little tag under it and if you know","speaker":null,"is_sponsor":0},{"start_s":9.12,"end_s":15.2,"text":"number a was 20% more than number B we knew that give or take computer a was","speaker":null,"is_sponsor":0},{"start_s":13.12,"end_s":20.84,"text":"going to be 20% faster than computer B but then as architectural designs of","speaker":null,"is_sponsor":0},{"start_s":17.72,"end_s":23.56,"text":"different processors diverged and a CPU","speaker":null,"is_sponsor":0},{"start_s":20.84,"end_s":28.279,"text":"that ran at 2 GHz could suddenly be as fast at performing a given real world","speaker":null,"is_sponsor":0},{"start_s":25.8,"end_s":34.36,"text":"task is another one that ran at 3 GHz we needed a new way to measure performance","speaker":null,"is_sponsor":0},{"start_s":31.84,"end_s":38.2,"text":"benchmarks no I'm not talking about those kinds of benchmarks I'm talking","speaker":null,"is_sponsor":0},{"start_s":35.879,"end_s":43.0,"text":"about software programs designed to evaluate the performance of PC","speaker":null,"is_sponsor":0},{"start_s":40.399,"end_s":48.68,"text":"components or complete systems they fall into two main categories the first main","speaker":null,"is_sponsor":0},{"start_s":45.719,"end_s":53.64,"text":"type is synthetic benchmarks examples of these include ID to 64's cach and memory","speaker":null,"is_sponsor":0},{"start_s":51.16,"end_s":58.879,"text":"speed testing module and super pie a small lightweight program that tests how","speaker":null,"is_sponsor":0},{"start_s":55.84,"end_s":61.199,"text":"quickly a processor can calculate pi to","speaker":null,"is_sponsor":0},{"start_s":58.879,"end_s":65.119,"text":"a predetermined number of decimal places now synthetic benchmarks are great for","speaker":null,"is_sponsor":0},{"start_s":63.12,"end_s":68.72,"text":"certain things because their creators are focused on obtaining results with","speaker":null,"is_sponsor":0},{"start_s":66.84,"end_s":72.479,"text":"maximum repeatability a key characteristic of any test that is to be","speaker":null,"is_sponsor":0},{"start_s":70.32,"end_s":77.4,"text":"used for scientific style comparisons and minimal potential bottlenecks","speaker":null,"is_sponsor":0},{"start_s":75.24,"end_s":81.56,"text":"elsewhere in the system to simplify comparisons across different test","speaker":null,"is_sponsor":0},{"start_s":79.479,"end_s":86.0,"text":"benches and prevent a situation where say you're trying to I don't know test","speaker":null,"is_sponsor":0},{"start_s":83.96,"end_s":91.439,"text":"the speed of your shiny new Lightning Fast SSD by copying data from a hard","speaker":null,"is_sponsor":0},{"start_s":89.28,"end_s":96.64,"text":"drive a much slower device in the first place which would make all ssds appear","speaker":null,"is_sponsor":0},{"start_s":94.2,"end_s":101.72,"text":"to perform identically to each other the same speed as a hard drive the problems","speaker":null,"is_sponsor":0},{"start_s":99.68,"end_s":106.399,"text":"with synthetic benchmarks are several though first up is that because they","speaker":null,"is_sponsor":0},{"start_s":103.759,"end_s":110.92,"text":"work to ignore system bottlenecks they often deliver results that don't reflect","speaker":null,"is_sponsor":0},{"start_s":108.52,"end_s":114.88,"text":"the end user's experience because just because one component is getting twice","speaker":null,"is_sponsor":0},{"start_s":113.2,"end_s":120.119,"text":"as fast doesn't mean that the rest of the system improved in any tangible way","speaker":null,"is_sponsor":0},{"start_s":117.399,"end_s":124.479,"text":"and second because benchmarks Run High specialized workloads they are","speaker":null,"is_sponsor":0},{"start_s":121.759,"end_s":129.64,"text":"notoriously misused by Hardware manufacturers who might manipulate their","speaker":null,"is_sponsor":0},{"start_s":126.759,"end_s":134.599,"text":"Hardware or drivers to perform better in Industry standard benchmarks even if","speaker":null,"is_sponsor":0},{"start_s":131.959,"end_s":139.8,"text":"this comes with no day-to-day benefit or even with reduced performance in real","speaker":null,"is_sponsor":0},{"start_s":137.16,"end_s":144.599,"text":"world tasks which leads us to the other main type of benchmarks realworld","speaker":null,"is_sponsor":0},{"start_s":142.319,"end_s":149.92,"text":"benchmarks simple versions of these like cinebench or The Benchmark drop down","speaker":null,"is_sponsor":0},{"start_s":146.84,"end_s":152.239,"text":"built into szip take a predetermined but","speaker":null,"is_sponsor":0},{"start_s":149.92,"end_s":156.319,"text":"otherwise totally real workload in these cases 3D rendering or file compression","speaker":null,"is_sponsor":0},{"start_s":154.239,"end_s":160.319,"text":"and decompression and have the computer process it as fast as possible then spit","speaker":null,"is_sponsor":0},{"start_s":158.879,"end_s":164.8,"text":"out a number to tell you how well it went while more complicated real world","speaker":null,"is_sponsor":0},{"start_s":162.879,"end_s":169.879,"text":"benchmarks often need to be custom developed by PC Hardware Publications","speaker":null,"is_sponsor":0},{"start_s":167.319,"end_s":174.159,"text":"like aanch with their storage Benchmark Suite that was created by recording the","speaker":null,"is_sponsor":0},{"start_s":172.239,"end_s":179.159,"text":"actions of a user performing everyday tasks on a computer than running that IO","speaker":null,"is_sponsor":0},{"start_s":176.959,"end_s":183.959,"text":"trace on every new drive that enters the lab but some benchmarks don't really","speaker":null,"is_sponsor":0},{"start_s":181.64,"end_s":189.519,"text":"fall cleanly into either of these two categories future marks PC Mark and 3D","speaker":null,"is_sponsor":0},{"start_s":186.92,"end_s":193.68,"text":"Mark series are great examples here they feature components that are purely","speaker":null,"is_sponsor":0},{"start_s":191.92,"end_s":198.799,"text":"synthetic like measurements of in-game physics performance on a CPU components","speaker":null,"is_sponsor":0},{"start_s":196.4,"end_s":203.4,"text":"that are real world based like webpage loading times and then they spit out a","speaker":null,"is_sponsor":0},{"start_s":200.959,"end_s":209.2,"text":"score that in theory quantifies the performance of the machine all right","speaker":null,"is_sponsor":0},{"start_s":206.08,"end_s":211.64,"text":"lonus then so which one should I believe","speaker":null,"is_sponsor":0},{"start_s":209.2,"end_s":217.0,"text":"synthetic or real world or like the hybrid model and the answer is kind of","speaker":null,"is_sponsor":0},{"start_s":214.159,"end_s":222.48,"text":"all three if a real world Benchmark is available for your exact given workload","speaker":null,"is_sponsor":0},{"start_s":219.519,"end_s":226.76,"text":"let's say 4K video editing then go with that first but if it's not available or","speaker":null,"is_sponsor":0},{"start_s":225.12,"end_s":231.239,"text":"you're planning for a future hypothetical workload a hybrid or","speaker":null,"is_sponsor":0},{"start_s":229.28,"end_s":235.319,"text":"synthetic Benchmark may be your only choice so just make sure that you","speaker":null,"is_sponsor":0},{"start_s":233.159,"end_s":239.84,"text":"educate yourself about what the numbers you're looking at mean before making a","speaker":null,"is_sponsor":0},{"start_s":237.72,"end_s":244.0,"text":"purchasing decision and speaking of educating yourself about numbers before","speaker":null,"is_sponsor":0},{"start_s":241.48,"end_s":248.04,"text":"making a purchasing decision dollarshaveclub.com you got to educate","speaker":null,"is_sponsor":0},{"start_s":245.879,"end_s":252.56,"text":"yourself about the numbers in this case price tags before you make a purchasing","speaker":null,"is_sponsor":0},{"start_s":250.04,"end_s":257.079,"text":"decision in this case razors Dollar Shave Club delivers high quality razors","speaker":null,"is_sponsor":0},{"start_s":254.56,"end_s":259.959,"text":"straight to your door for much less and it's amazing because they're actually","speaker":null,"is_sponsor":0},{"start_s":258.239,"end_s":264.4,"text":"like it includes shipping in the fact that they cost less than the ones that","speaker":null,"is_sponsor":0},{"start_s":261.959,"end_s":269.72,"text":"you actually have to get off your butt go to the store get them to unlock the","speaker":null,"is_sponsor":0},{"start_s":266.479,"end_s":271.199,"text":"stupid cabinet and buy in person I mean","speaker":null,"is_sponsor":0},{"start_s":269.72,"end_s":275.96,"text":"this is more work for you and you're spending more money great little program","speaker":null,"is_sponsor":0},{"start_s":273.52,"end_s":280.6,"text":"there save money and save time actually I think their slogan is shave time shave","speaker":null,"is_sponsor":0},{"start_s":278.32,"end_s":283.919,"text":"money which is very funny they're funny guys and those funny guys also have","speaker":null,"is_sponsor":0},{"start_s":282.56,"end_s":287.32,"text":"other products they've got their Dr Carver shave butter which goes on clear","speaker":null,"is_sponsor":0},{"start_s":285.8,"end_s":292.039,"text":"so you can see what you're doing while you're shaving they've got their one wipe Charlie which also help you see","speaker":null,"is_sponsor":0},{"start_s":290.479,"end_s":297.36,"text":"what you're doing when you're wiping your butt with peppermint scented wipes","speaker":null,"is_sponsor":0},{"start_s":294.8,"end_s":301.16,"text":"and uh get over to dollarshaveclub.com Linus to join the club and start looking","speaker":null,"is_sponsor":0},{"start_s":299.8,"end_s":304.68,"text":"good without having to go out of the house looking like a scrub in the first","speaker":null,"is_sponsor":0},{"start_s":302.88,"end_s":308.8,"text":"place to get the supplies you need to look good when you leave the house","speaker":null,"is_sponsor":0},{"start_s":307.4,"end_s":312.68,"text":"thanks for watching this episode as fast as possible guys like this video if you liked it dislike it if you disliked it","speaker":null,"is_sponsor":0},{"start_s":311.479,"end_s":318.08,"text":"leave a comment letting me know if you have suggestions for future fastest possibles and as always if you aren't","speaker":null,"is_sponsor":0},{"start_s":315.88,"end_s":322.84,"text":"already don't forget to subscribe and share this video if you thought it was","speaker":null,"is_sponsor":0},{"start_s":319.319,"end_s":322.84,"text":"helpful in somewhere","speaker":null,"is_sponsor":0}],"full_text":"life used to be so simple when we wanted to know how computer a compared to computer B all we had to do was look at the little tag under it and if you know number a was 20% more than number B we knew that give or take computer a was going to be 20% faster than computer B but then as architectural designs of different processors diverged and a CPU that ran at 2 GHz could suddenly be as fast at performing a given real world task is another one that ran at 3 GHz we needed a new way to measure performance benchmarks no I'm not talking about those kinds of benchmarks I'm talking about software programs designed to evaluate the performance of PC components or complete systems they fall into two main categories the first main type is synthetic benchmarks examples of these include ID to 64's cach and memory speed testing module and super pie a small lightweight program that tests how quickly a processor can calculate pi to a predetermined number of decimal places now synthetic benchmarks are great for certain things because their creators are focused on obtaining results with maximum repeatability a key characteristic of any test that is to be used for scientific style comparisons and minimal potential bottlenecks elsewhere in the system to simplify comparisons across different test benches and prevent a situation where say you're trying to I don't know test the speed of your shiny new Lightning Fast SSD by copying data from a hard drive a much slower device in the first place which would make all ssds appear to perform identically to each other the same speed as a hard drive the problems with synthetic benchmarks are several though first up is that because they work to ignore system bottlenecks they often deliver results that don't reflect the end user's experience because just because one component is getting twice as fast doesn't mean that the rest of the system improved in any tangible way and second because benchmarks Run High specialized workloads they are notoriously misused by Hardware manufacturers who might manipulate their Hardware or drivers to perform better in Industry standard benchmarks even if this comes with no day-to-day benefit or even with reduced performance in real world tasks which leads us to the other main type of benchmarks realworld benchmarks simple versions of these like cinebench or The Benchmark drop down built into szip take a predetermined but otherwise totally real workload in these cases 3D rendering or file compression and decompression and have the computer process it as fast as possible then spit out a number to tell you how well it went while more complicated real world benchmarks often need to be custom developed by PC Hardware Publications like aanch with their storage Benchmark Suite that was created by recording the actions of a user performing everyday tasks on a computer than running that IO trace on every new drive that enters the lab but some benchmarks don't really fall cleanly into either of these two categories future marks PC Mark and 3D Mark series are great examples here they feature components that are purely synthetic like measurements of in-game physics performance on a CPU components that are real world based like webpage loading times and then they spit out a score that in theory quantifies the performance of the machine all right lonus then so which one should I believe synthetic or real world or like the hybrid model and the answer is kind of all three if a real world Benchmark is available for your exact given workload let's say 4K video editing then go with that first but if it's not available or you're planning for a future hypothetical workload a hybrid or synthetic Benchmark may be your only choice so just make sure that you educate yourself about what the numbers you're looking at mean before making a purchasing decision and speaking of educating yourself about numbers before making a purchasing decision dollarshaveclub.com you got to educate yourself about the numbers in this case price tags before you make a purchasing decision in this case razors Dollar Shave Club delivers high quality razors straight to your door for much less and it's amazing because they're actually like it includes shipping in the fact that they cost less than the ones that you actually have to get off your butt go to the store get them to unlock the stupid cabinet and buy in person I mean this is more work for you and you're spending more money great little program there save money and save time actually I think their slogan is shave time shave money which is very funny they're funny guys and those funny guys also have other products they've got their Dr Carver shave butter which goes on clear so you can see what you're doing while you're shaving they've got their one wipe Charlie which also help you see what you're doing when you're wiping your butt with peppermint scented wipes and uh get over to dollarshaveclub.com Linus to join the club and start looking good without having to go out of the house looking like a scrub in the first place to get the supplies you need to look good when you leave the house thanks for watching this episode as fast as possible guys like this video if you liked it dislike it if you disliked it leave a comment letting me know if you have suggestions for future fastest possibles and as always if you aren't already don't forget to subscribe and share this video if you thought it was helpful in somewhere"}