How to Pick Good Benchmarks & Why They Matter - CES 2015
Linus Tech Tips
·Linus Tech Tips
·2015-05-07
·
1,256 words · ~6 min read
0:00
Lionus Tech Tips coverage of CES 2015 is brought to you by Phantom Glass. Visit
0:05
store.fantom.glass for the best darn screen protectors out there as well as
0:09
HyperX. All right, so before we were so rudely interrupted there, we were trying
0:14
to start a video here in the Intel PR
0:17
suite. Now, this is the first time I've ever actually managed to get in touch
0:20
with Intel's PR folks. a uh an error that both sides are we're sort of quick
0:25
to hug it out over and uh you know make up and we're going to work together
0:29
moving forward in the future. But the whole point of what they're showing here
0:33
is the importance of benchmarks and not just benchmarks but benchmarks that can
0:38
be validated and that can be trusted. So there's three basic types of benchmarks
0:42
in the world. There's going to be your consortium benchmarks where there's a
0:45
group of large companies that all work together to keep each other in check and
0:49
make sure that everything is fair and balanced in the results. There's going to be your open- source benchmarks that
0:53
are going to have communities behind them that are going to I mean sometimes maybe you got to pay 20 bucks like the
0:58
one that's over to my right there in order to have a peek at the source code, make sure there's no tom foolery. We'll
1:03
talk about that one in a minute. Then there's your closed benchmarks which often you'll have to pay an exorbitant
1:07
fee in order to get access to the source code and poke at it. So really there's
1:11
no community moderation. So the point of all this was they're showing off Tablet
1:16
Mark. Why do they care about Tablet Mark? Well, Tablet Mark's from Bapco.
1:20
And the reason they care about it is because for the first time in a while,
1:24
Intel has what they feel is a clear and
1:27
solid lead in the tablet. Excuse me. Sorry, did I say tablet? I meant PC
1:32
space. Uh PCs that are extremely thin,
1:35
have screens on one side, backings on the other, not a ton of IO. Okay, I'm
1:39
just going to call them tablets. I'm sorry guys. So they have a the a
1:42
position in the tablet space that puts them in a well a very very strong
1:47
position moving forward. So here they're showing off some pretty crazy stuff.
1:51
This right here is a CoreM5y70. This is a Broadwell based chip that turbos up to
1:56
2.6 GHz. So the kinds of use cases that
1:59
they want to show off with tablet Mark are going to be your typical tablet things. So adding filters to a photo,
2:05
web browsing, video playback, stuff like that. And this one in particular is a
2:10
consortium benchmark. So there's a group a large group of companies very large
2:13
companies that are trying to make it so that well it's in it's important for
2:17
them to validate on their side but also so that consumers know what to look for
2:21
when they're shopping for a tablet. Now, moving over here, we've got an example
2:25
of this is a this is just an open completely open benchmark. And this
2:29
one's really different from that one in that it's called CR Expert. And unlike
2:33
that one, which is actually Android, iOS, and Windows crossplatform, allowing
2:38
us to finally actually know how the iPad
2:42
compares to an Android tablet compared to a Windows table. Excuse me, PC.
2:46
Sorry, did I say tablet again? compared to a very slim Windows PC with a screen
2:50
on one side. This one only runs on Chrome OS. It does the same kind of
2:54
stuff. So, it's going to run through your, you know, your typical web
2:57
browsing, look up your stock portfolio, whatever else the case may be. But the
3:01
reason this one came about was because we didn't really have a way of knowing
3:04
aside from, I don't know, like click refresh with like a stopwatch and see if
3:08
you can figure out like how fast the page loaded. We didn't really have a way
3:12
to quantify, well, who makes the best Chromebook? And here they've got some
3:15
solutions from, you know, Intel and
3:18
brand N or brand A. Actually, they did.
3:22
They put labels right on it. I guess it's cuz this is a press suite and not necessarily meant to have people running
3:26
around in here videoing. But the idea was to quantify, well, which Chromebook
3:29
actually is the best and gives you the best battery life after all. And it's
3:33
not an Intel benchmark. This is an open benchmark. So, so the point of working
3:37
with these guys is it's going to enable a new types of projects that we not
3:41
couldn't necessarily tackle in the past. So, you guys have loved seeing stuff
3:45
like our whole room liquid cooling thing. Well, we've had a lot of people
3:48
ask us for stuff like, "Hey, it's back to school. I got to buy a notebook. How
3:51
do I determine which one's the best one?" Well, with with some assistance on
3:56
streamlining the process, we want to hear from you guys what type of content
4:00
you want to see from us in terms of stuff that's more roundup oriented
4:03
because we don't have a team of, you know, 16 people to run around and, you
4:06
know, benchmark Chromebooks all day. So if these guys are pointing us in the right direction, providing us with a
4:11
bunch of stuff from Intel, we go and we find stuff from competitors. We get some
4:15
feedback from those guys as well. Make sure we're presenting the most balanced suite possible. That gives us way a way
4:21
more authoritative voice on this kind of what should you buy type content. So
4:26
leave comments on this video. I will be checking them out. Let us know what you
4:30
want us to benchmark particularly on the mobile side. So guys, thanks for
4:34
watching this video uh in the Intel like
4:38
PR suite that I've never been present for before. They have so much cool stuff
4:42
here. Guys, don't forget to subscribe to Linus Tech Tips so you don't miss any of
4:46
our CES coverage. Also, check out our sponsors. So, a huge thanks to Phantom
4:51
Glass. You can visit them over at store.fantom.glass. They make the best
4:54
iron screen protectors that we've ever seen for mobile devices. They're Gorilla
4:58
Glass, so they're perfectly clear. They're Gorilla Glass, so they're scratch resistant. and they have a nano
5:03
coating on the bottom that makes it virtually impossible to apply them with
5:06
bubbles underneath them. So, thanks to those guys for sending us here and also
5:09
a shout out to HyperX. Those guys have great content over on their YouTube
5:13
channel. It's youtube.com/hyperex. Lots of gaming oriented stuff and they are a huge part
5:17
of the reason we're able to be here as well. Thanks again for watching and uh
5:21
I'll see you at the next video where we'll be showing off Skull Trail. Wait,
5:25
that's from 2008. Hold on. Where's he going with this? Watch on to find out.