{"video_id":"tlkKgH70fP4","title":"How to Pick Good Benchmarks & Why They Matter - CES 2015","channel":"Linus Tech Tips","show":"Linus Tech Tips","published_at":"2015-05-07T14:53:29Z","duration_s":331,"segments":[{"start_s":0.08,"end_s":7.2,"text":"Lionus Tech Tips coverage of CES 2015 is brought to you by Phantom Glass. Visit","speaker":null,"is_sponsor":0},{"start_s":5.319,"end_s":12.32,"text":"store.fantom.glass for the best darn screen protectors out there as well as","speaker":null,"is_sponsor":0},{"start_s":9.96,"end_s":17.199,"text":"HyperX. All right, so before we were so rudely interrupted there, we were trying","speaker":null,"is_sponsor":0},{"start_s":14.16,"end_s":18.88,"text":"to start a video here in the Intel PR","speaker":null,"is_sponsor":0},{"start_s":17.199,"end_s":23.199,"text":"suite. Now, this is the first time I've ever actually managed to get in touch","speaker":null,"is_sponsor":0},{"start_s":20.4,"end_s":28.48,"text":"with Intel's PR folks. a uh an error that both sides are we're sort of quick","speaker":null,"is_sponsor":0},{"start_s":25.84,"end_s":31.439,"text":"to hug it out over and uh you know make up and we're going to work together","speaker":null,"is_sponsor":0},{"start_s":29.679,"end_s":36.48,"text":"moving forward in the future. But the whole point of what they're showing here","speaker":null,"is_sponsor":0},{"start_s":33.68,"end_s":40.399,"text":"is the importance of benchmarks and not just benchmarks but benchmarks that can","speaker":null,"is_sponsor":0},{"start_s":38.16,"end_s":43.52,"text":"be validated and that can be trusted. So there's three basic types of benchmarks","speaker":null,"is_sponsor":0},{"start_s":42.16,"end_s":47.2,"text":"in the world. There's going to be your consortium benchmarks where there's a","speaker":null,"is_sponsor":0},{"start_s":45.36,"end_s":50.879,"text":"group of large companies that all work together to keep each other in check and","speaker":null,"is_sponsor":0},{"start_s":49.52,"end_s":55.44,"text":"make sure that everything is fair and balanced in the results. There's going to be your open- source benchmarks that","speaker":null,"is_sponsor":0},{"start_s":53.92,"end_s":59.92,"text":"are going to have communities behind them that are going to I mean sometimes maybe you got to pay 20 bucks like the","speaker":null,"is_sponsor":0},{"start_s":58.399,"end_s":64.479,"text":"one that's over to my right there in order to have a peek at the source code, make sure there's no tom foolery. We'll","speaker":null,"is_sponsor":0},{"start_s":63.199,"end_s":69.92,"text":"talk about that one in a minute. Then there's your closed benchmarks which often you'll have to pay an exorbitant","speaker":null,"is_sponsor":0},{"start_s":67.84,"end_s":74.24,"text":"fee in order to get access to the source code and poke at it. So really there's","speaker":null,"is_sponsor":0},{"start_s":71.84,"end_s":78.24,"text":"no community moderation. So the point of all this was they're showing off Tablet","speaker":null,"is_sponsor":0},{"start_s":76.24,"end_s":81.68,"text":"Mark. Why do they care about Tablet Mark? Well, Tablet Mark's from Bapco.","speaker":null,"is_sponsor":0},{"start_s":80.159,"end_s":87.52,"text":"And the reason they care about it is because for the first time in a while,","speaker":null,"is_sponsor":0},{"start_s":84.159,"end_s":89.68,"text":"Intel has what they feel is a clear and","speaker":null,"is_sponsor":0},{"start_s":87.52,"end_s":95.439,"text":"solid lead in the tablet. Excuse me. Sorry, did I say tablet? I meant PC","speaker":null,"is_sponsor":0},{"start_s":92.159,"end_s":97.6,"text":"space. Uh PCs that are extremely thin,","speaker":null,"is_sponsor":0},{"start_s":95.439,"end_s":100.4,"text":"have screens on one side, backings on the other, not a ton of IO. Okay, I'm","speaker":null,"is_sponsor":0},{"start_s":99.119,"end_s":104.24,"text":"just going to call them tablets. I'm sorry guys. So they have a the a","speaker":null,"is_sponsor":0},{"start_s":102.64,"end_s":109.36,"text":"position in the tablet space that puts them in a well a very very strong","speaker":null,"is_sponsor":0},{"start_s":107.52,"end_s":113.52,"text":"position moving forward. So here they're showing off some pretty crazy stuff.","speaker":null,"is_sponsor":0},{"start_s":111.2,"end_s":119.68,"text":"This right here is a CoreM5y70. This is a Broadwell based chip that turbos up to","speaker":null,"is_sponsor":0},{"start_s":116.36,"end_s":120.96,"text":"2.6 GHz. So the kinds of use cases that","speaker":null,"is_sponsor":0},{"start_s":119.68,"end_s":127.36,"text":"they want to show off with tablet Mark are going to be your typical tablet things. So adding filters to a photo,","speaker":null,"is_sponsor":0},{"start_s":125.439,"end_s":131.84,"text":"web browsing, video playback, stuff like that. And this one in particular is a","speaker":null,"is_sponsor":0},{"start_s":130.08,"end_s":135.68,"text":"consortium benchmark. So there's a group a large group of companies very large","speaker":null,"is_sponsor":0},{"start_s":133.599,"end_s":139.44,"text":"companies that are trying to make it so that well it's in it's important for","speaker":null,"is_sponsor":0},{"start_s":137.84,"end_s":143.52,"text":"them to validate on their side but also so that consumers know what to look for","speaker":null,"is_sponsor":0},{"start_s":141.28,"end_s":148.16,"text":"when they're shopping for a tablet. Now, moving over here, we've got an example","speaker":null,"is_sponsor":0},{"start_s":145.76,"end_s":151.52,"text":"of this is a this is just an open completely open benchmark. And this","speaker":null,"is_sponsor":0},{"start_s":149.68,"end_s":155.92,"text":"one's really different from that one in that it's called CR Expert. And unlike","speaker":null,"is_sponsor":0},{"start_s":153.84,"end_s":162.8,"text":"that one, which is actually Android, iOS, and Windows crossplatform, allowing","speaker":null,"is_sponsor":0},{"start_s":158.879,"end_s":164.64,"text":"us to finally actually know how the iPad","speaker":null,"is_sponsor":0},{"start_s":162.8,"end_s":168.4,"text":"compares to an Android tablet compared to a Windows table. Excuse me, PC.","speaker":null,"is_sponsor":0},{"start_s":166.64,"end_s":173.04,"text":"Sorry, did I say tablet again? compared to a very slim Windows PC with a screen","speaker":null,"is_sponsor":0},{"start_s":170.72,"end_s":176.239,"text":"on one side. This one only runs on Chrome OS. It does the same kind of","speaker":null,"is_sponsor":0},{"start_s":174.64,"end_s":179.36,"text":"stuff. So, it's going to run through your, you know, your typical web","speaker":null,"is_sponsor":0},{"start_s":177.68,"end_s":182.56,"text":"browsing, look up your stock portfolio, whatever else the case may be. But the","speaker":null,"is_sponsor":0},{"start_s":181.2,"end_s":186.319,"text":"reason this one came about was because we didn't really have a way of knowing","speaker":null,"is_sponsor":0},{"start_s":184.48,"end_s":190.56,"text":"aside from, I don't know, like click refresh with like a stopwatch and see if","speaker":null,"is_sponsor":0},{"start_s":188.4,"end_s":194.08,"text":"you can figure out like how fast the page loaded. We didn't really have a way","speaker":null,"is_sponsor":0},{"start_s":192.08,"end_s":198.879,"text":"to quantify, well, who makes the best Chromebook? And here they've got some","speaker":null,"is_sponsor":0},{"start_s":195.519,"end_s":202.0,"text":"solutions from, you know, Intel and","speaker":null,"is_sponsor":0},{"start_s":198.879,"end_s":203.36,"text":"brand N or brand A. Actually, they did.","speaker":null,"is_sponsor":0},{"start_s":202.0,"end_s":207.84,"text":"They put labels right on it. I guess it's cuz this is a press suite and not necessarily meant to have people running","speaker":null,"is_sponsor":0},{"start_s":206.48,"end_s":211.36,"text":"around in here videoing. But the idea was to quantify, well, which Chromebook","speaker":null,"is_sponsor":0},{"start_s":209.84,"end_s":215.28,"text":"actually is the best and gives you the best battery life after all. And it's","speaker":null,"is_sponsor":0},{"start_s":213.28,"end_s":219.44,"text":"not an Intel benchmark. This is an open benchmark. So, so the point of working","speaker":null,"is_sponsor":0},{"start_s":217.28,"end_s":223.599,"text":"with these guys is it's going to enable a new types of projects that we not","speaker":null,"is_sponsor":0},{"start_s":221.76,"end_s":226.64,"text":"couldn't necessarily tackle in the past. So, you guys have loved seeing stuff","speaker":null,"is_sponsor":0},{"start_s":225.12,"end_s":230.08,"text":"like our whole room liquid cooling thing. Well, we've had a lot of people","speaker":null,"is_sponsor":0},{"start_s":228.48,"end_s":233.12,"text":"ask us for stuff like, \"Hey, it's back to school. I got to buy a notebook. How","speaker":null,"is_sponsor":0},{"start_s":231.76,"end_s":238.08,"text":"do I determine which one's the best one?\" Well, with with some assistance on","speaker":null,"is_sponsor":0},{"start_s":236.0,"end_s":241.36,"text":"streamlining the process, we want to hear from you guys what type of content","speaker":null,"is_sponsor":0},{"start_s":240.08,"end_s":244.879,"text":"you want to see from us in terms of stuff that's more roundup oriented","speaker":null,"is_sponsor":0},{"start_s":243.28,"end_s":248.56,"text":"because we don't have a team of, you know, 16 people to run around and, you","speaker":null,"is_sponsor":0},{"start_s":246.879,"end_s":253.439,"text":"know, benchmark Chromebooks all day. So if these guys are pointing us in the right direction, providing us with a","speaker":null,"is_sponsor":0},{"start_s":251.28,"end_s":256.4,"text":"bunch of stuff from Intel, we go and we find stuff from competitors. We get some","speaker":null,"is_sponsor":0},{"start_s":255.2,"end_s":264.0,"text":"feedback from those guys as well. Make sure we're presenting the most balanced suite possible. That gives us way a way","speaker":null,"is_sponsor":0},{"start_s":261.199,"end_s":267.919,"text":"more authoritative voice on this kind of what should you buy type content. So","speaker":null,"is_sponsor":0},{"start_s":266.0,"end_s":272.96,"text":"leave comments on this video. I will be checking them out. Let us know what you","speaker":null,"is_sponsor":0},{"start_s":270.08,"end_s":278.32,"text":"want us to benchmark particularly on the mobile side. So guys, thanks for","speaker":null,"is_sponsor":0},{"start_s":274.96,"end_s":281.12,"text":"watching this video uh in the Intel like","speaker":null,"is_sponsor":0},{"start_s":278.32,"end_s":285.52,"text":"PR suite that I've never been present for before. They have so much cool stuff","speaker":null,"is_sponsor":0},{"start_s":282.96,"end_s":288.88,"text":"here. Guys, don't forget to subscribe to Linus Tech Tips so you don't miss any of","speaker":null,"is_sponsor":0},{"start_s":286.72,"end_s":293.4,"text":"our CES coverage. Also, check out our sponsors. So, a huge thanks to Phantom","speaker":null,"is_sponsor":0},{"start_s":291.04,"end_s":296.479,"text":"Glass. You can visit them over at store.fantom.glass. They make the best","speaker":null,"is_sponsor":0},{"start_s":294.96,"end_s":300.08,"text":"iron screen protectors that we've ever seen for mobile devices. They're Gorilla","speaker":null,"is_sponsor":0},{"start_s":298.4,"end_s":304.32,"text":"Glass, so they're perfectly clear. They're Gorilla Glass, so they're scratch resistant. and they have a nano","speaker":null,"is_sponsor":0},{"start_s":303.199,"end_s":308.16,"text":"coating on the bottom that makes it virtually impossible to apply them with","speaker":null,"is_sponsor":0},{"start_s":306.4,"end_s":311.84,"text":"bubbles underneath them. So, thanks to those guys for sending us here and also","speaker":null,"is_sponsor":0},{"start_s":309.52,"end_s":314.28,"text":"a shout out to HyperX. Those guys have great content over on their YouTube","speaker":null,"is_sponsor":0},{"start_s":313.12,"end_s":319.199,"text":"channel. It's youtube.com/hyperex. Lots of gaming oriented stuff and they are a huge part","speaker":null,"is_sponsor":0},{"start_s":317.6,"end_s":323.36,"text":"of the reason we're able to be here as well. Thanks again for watching and uh","speaker":null,"is_sponsor":0},{"start_s":321.28,"end_s":327.68,"text":"I'll see you at the next video where we'll be showing off Skull Trail. Wait,","speaker":null,"is_sponsor":0},{"start_s":325.6,"end_s":331.68,"text":"that's from 2008. Hold on. Where's he going with this? Watch on to find out.","speaker":null,"is_sponsor":0}],"full_text":"Lionus Tech Tips coverage of CES 2015 is brought to you by Phantom Glass. Visit store.fantom.glass for the best darn screen protectors out there as well as HyperX. All right, so before we were so rudely interrupted there, we were trying to start a video here in the Intel PR suite. Now, this is the first time I've ever actually managed to get in touch with Intel's PR folks. a uh an error that both sides are we're sort of quick to hug it out over and uh you know make up and we're going to work together moving forward in the future. But the whole point of what they're showing here is the importance of benchmarks and not just benchmarks but benchmarks that can be validated and that can be trusted. So there's three basic types of benchmarks in the world. There's going to be your consortium benchmarks where there's a group of large companies that all work together to keep each other in check and make sure that everything is fair and balanced in the results. There's going to be your open- source benchmarks that are going to have communities behind them that are going to I mean sometimes maybe you got to pay 20 bucks like the one that's over to my right there in order to have a peek at the source code, make sure there's no tom foolery. We'll talk about that one in a minute. Then there's your closed benchmarks which often you'll have to pay an exorbitant fee in order to get access to the source code and poke at it. So really there's no community moderation. So the point of all this was they're showing off Tablet Mark. Why do they care about Tablet Mark? Well, Tablet Mark's from Bapco. And the reason they care about it is because for the first time in a while, Intel has what they feel is a clear and solid lead in the tablet. Excuse me. Sorry, did I say tablet? I meant PC space. Uh PCs that are extremely thin, have screens on one side, backings on the other, not a ton of IO. Okay, I'm just going to call them tablets. I'm sorry guys. So they have a the a position in the tablet space that puts them in a well a very very strong position moving forward. So here they're showing off some pretty crazy stuff. This right here is a CoreM5y70. This is a Broadwell based chip that turbos up to 2.6 GHz. So the kinds of use cases that they want to show off with tablet Mark are going to be your typical tablet things. So adding filters to a photo, web browsing, video playback, stuff like that. And this one in particular is a consortium benchmark. So there's a group a large group of companies very large companies that are trying to make it so that well it's in it's important for them to validate on their side but also so that consumers know what to look for when they're shopping for a tablet. Now, moving over here, we've got an example of this is a this is just an open completely open benchmark. And this one's really different from that one in that it's called CR Expert. And unlike that one, which is actually Android, iOS, and Windows crossplatform, allowing us to finally actually know how the iPad compares to an Android tablet compared to a Windows table. Excuse me, PC. Sorry, did I say tablet again? compared to a very slim Windows PC with a screen on one side. This one only runs on Chrome OS. It does the same kind of stuff. So, it's going to run through your, you know, your typical web browsing, look up your stock portfolio, whatever else the case may be. But the reason this one came about was because we didn't really have a way of knowing aside from, I don't know, like click refresh with like a stopwatch and see if you can figure out like how fast the page loaded. We didn't really have a way to quantify, well, who makes the best Chromebook? And here they've got some solutions from, you know, Intel and brand N or brand A. Actually, they did. They put labels right on it. I guess it's cuz this is a press suite and not necessarily meant to have people running around in here videoing. But the idea was to quantify, well, which Chromebook actually is the best and gives you the best battery life after all. And it's not an Intel benchmark. This is an open benchmark. So, so the point of working with these guys is it's going to enable a new types of projects that we not couldn't necessarily tackle in the past. So, you guys have loved seeing stuff like our whole room liquid cooling thing. Well, we've had a lot of people ask us for stuff like, \"Hey, it's back to school. I got to buy a notebook. How do I determine which one's the best one?\" Well, with with some assistance on streamlining the process, we want to hear from you guys what type of content you want to see from us in terms of stuff that's more roundup oriented because we don't have a team of, you know, 16 people to run around and, you know, benchmark Chromebooks all day. So if these guys are pointing us in the right direction, providing us with a bunch of stuff from Intel, we go and we find stuff from competitors. We get some feedback from those guys as well. Make sure we're presenting the most balanced suite possible. That gives us way a way more authoritative voice on this kind of what should you buy type content. So leave comments on this video. I will be checking them out. Let us know what you want us to benchmark particularly on the mobile side. So guys, thanks for watching this video uh in the Intel like PR suite that I've never been present for before. They have so much cool stuff here. Guys, don't forget to subscribe to Linus Tech Tips so you don't miss any of our CES coverage. Also, check out our sponsors. So, a huge thanks to Phantom Glass. You can visit them over at store.fantom.glass. They make the best iron screen protectors that we've ever seen for mobile devices. They're Gorilla Glass, so they're perfectly clear. They're Gorilla Glass, so they're scratch resistant. and they have a nano coating on the bottom that makes it virtually impossible to apply them with bubbles underneath them. So, thanks to those guys for sending us here and also a shout out to HyperX. Those guys have great content over on their YouTube channel. It's youtube.com/hyperex. Lots of gaming oriented stuff and they are a huge part of the reason we're able to be here as well. Thanks again for watching and uh I'll see you at the next video where we'll be showing off Skull Trail. Wait, that's from 2008. Hold on. Where's he going with this? Watch on to find out."}