1
00:00:00,000 --> 00:00:07,120
we've already made some big investments into our testing lab a new building new

2
00:00:04,560 --> 00:00:10,559
talent and some crazy new equipment and we are finally ready to start talking

3
00:00:08,800 --> 00:00:15,440
about it see these two heads they're called hats or head and torso simulators

4
00:00:13,840 --> 00:00:19,199
they're for testing personal audio products and the ones in front of me

5
00:00:17,039 --> 00:00:24,080
cost a combined 80 000 us dollars which is why we

6
00:00:21,439 --> 00:00:28,640
definitely cannot afford to keep both of them what lies no please i'll do

7
00:00:27,039 --> 00:00:33,760
anything anything uh

8
00:00:30,800 --> 00:00:38,079
crucial's ddr5 RAM is engineered to load transfer and download files faster with

9
00:00:35,920 --> 00:00:42,480
less lag time and more efficiency get your crucial ddr5 RAM today using the

10
00:00:40,640 --> 00:00:46,399
link down in the description below the keynote among you might notice that our

11
00:00:44,000 --> 00:00:51,200
hats happen to be missing the uh torso part but that's okay because that

12
00:00:49,280 --> 00:00:55,199
only really matters for speaker testing and we're gonna be focused on headphones

13
00:00:53,039 --> 00:01:01,120
and microphones for the time being also the torso is a plastic tub that adds

14
00:00:57,840 --> 00:01:03,520
twenty thousand dollars to the cost so

15
00:01:01,120 --> 00:01:07,840
i'll pass now understandably you might actually feel the same way about the has

16
00:01:05,760 --> 00:01:12,960
part couldn't we just use any plastic head the answer is

17
00:01:10,159 --> 00:01:17,759
no there is a method to the madness here this form of hearing simulator was first

18
00:01:15,439 --> 00:01:22,080
created in the 1980s to accommodate the testing of phones and hearing aids you

19
00:01:20,080 --> 00:01:26,320
see the thing about hearing devices is that depending on the conditions they

20
00:01:23,680 --> 00:01:30,450
can perform dramatically differently you can try this for yourself lift your

21
00:01:28,159 --> 00:01:34,320
headphones off your ear like this

22
00:01:34,320 --> 00:01:41,439
sounds pretty different right so these state-of-the-art hats models from

23
00:01:38,960 --> 00:01:46,320
just a couple of years ago both claim to better represent a headphones real world

24
00:01:43,600 --> 00:01:51,520
performance by simulating not just the shape of a human head so you get a good

25
00:01:48,320 --> 00:01:52,960
seal but also even the ear canal both of

26
00:01:51,520 --> 00:01:57,360
them are also equipped with high performance microphones allowing us to

27
00:01:54,960 --> 00:02:02,399
test the full range of human hearing with both of them costing about as much

28
00:01:59,759 --> 00:02:07,600
as an actual human head don't ask me how i know so why not just hire trusted

29
00:02:04,960 --> 00:02:11,200
listeners to evaluate headphones for us it's because listening is a subjective

30
00:02:09,599 --> 00:02:17,200
experience that can be influenced by your mood your biases and even your um

31
00:02:14,800 --> 00:02:21,040
state of mind man that means that any product review that relies solely on a

32
00:02:18,959 --> 00:02:25,760
human evaluator will be inherently unreliable now we could look at the spec

33
00:02:23,360 --> 00:02:30,000
sheet but a shocking number of audio manufacturers seem to be pretty much

34
00:02:27,599 --> 00:02:35,920
copy pasting the same performance numbers alongside vague posting nonsense

35
00:02:33,120 --> 00:02:40,879
like next level listening or we retain the emotion of the sound

36
00:02:38,480 --> 00:02:44,640
so i guess we can't trust them either what do if you've ever read or watched

37
00:02:43,120 --> 00:02:48,560
headphone reviews you might have seen something like this before it's called a

38
00:02:46,640 --> 00:02:53,280
frequency response graph and it's meant to help us visualize the sound signature

39
00:02:50,959 --> 00:02:58,480
of an audio device the left end of the x-axis represents the lowest bass sounds

40
00:02:55,760 --> 00:03:02,560
that humans can hear about 20 hertz and the right end represents the highest

41
00:03:00,480 --> 00:03:08,239
treble frequencies that humans can hear around 20 000 hertz with these we can

42
00:03:06,080 --> 00:03:12,640
chew through manufacturer claims like a hot head chews through butter some might

43
00:03:10,879 --> 00:03:16,840
claim to have a neutral sound for example but actually they have the base

44
00:03:14,800 --> 00:03:20,720
cranked up so high it would wake up your neighbors to measure these numbers

45
00:03:18,720 --> 00:03:26,000
though we need to start with the right gear let's get acquainted with our potential

46
00:03:23,519 --> 00:03:32,159
suitors here then bachelor number one is the b k 5128 type b and aside from

47
00:03:29,920 --> 00:03:38,879
having obviously better microphones it improves upon its 1981 predecessor in a

48
00:03:35,440 --> 00:03:41,920
few ways for the ear canal bnk averaged

49
00:03:38,879 --> 00:03:45,280
mri scans of 40 test subjects to give it

50
00:03:41,920 --> 00:03:47,680
a longer more human-like shape and

51
00:03:45,280 --> 00:03:52,640
instead of using purely soft rubber they added plastic components to the inner

52
00:03:50,239 --> 00:03:57,040
parts to represent the acoustic effect of the bonier inner ear

53
00:03:54,959 --> 00:04:05,360
now for bachelor number two sort of the hms 2.3 ln hec aka the super

54
00:04:02,400 --> 00:04:10,799
hms comes from head acoustics and by their own admission it is

55
00:04:07,280 --> 00:04:13,599
actually based on the b k 5128

56
00:04:10,799 --> 00:04:17,519
but simplified it has a shorter ear canal and is made of just rubber

57
00:04:15,519 --> 00:04:22,800
resulting in slightly looser tolerances for acoustic impedance both below 80

58
00:04:20,000 --> 00:04:28,240
hertz and above 12 kilohertz not ideal but the larger diaphragm of

59
00:04:26,000 --> 00:04:32,160
the super hms's microphone results in a lower noise floor which means slightly

60
00:04:30,400 --> 00:04:37,120
improved performance in certain other tests like distortion now there was a

61
00:04:34,479 --> 00:04:40,479
bachelor number three right here but our headphone test engineer has actually

62
00:04:38,639 --> 00:04:45,680
worked with that model before and thinks that it is crap so we didn't even bother

63
00:04:43,520 --> 00:04:50,000
renting one now at this point at least on paper it seems like the 5128 is the

64
00:04:48,479 --> 00:04:55,840
obvious choice but a lot of that is based on manufacturer claims which

65
00:04:53,360 --> 00:05:00,479
is not how our lab is supposed to work so we spent the last few weeks which

66
00:04:58,479 --> 00:05:05,040
cost us thousands of dollars in rentals by the way validating those claims and

67
00:05:02,960 --> 00:05:08,840
searching for potential flaws while looking fabulous of course wan

68
00:05:07,280 --> 00:05:13,440
hoodies now in stock lttstore.com as for why it took so long

69
00:05:11,199 --> 00:05:18,479
to test i'm really glad you asked we needed to run two sets of tests one

70
00:05:16,320 --> 00:05:23,759
comparing the heads to each other head to head you might say and the other

71
00:05:20,880 --> 00:05:27,919
comparing the heads to 25 of our own fleshy guinea pigs i mean excuse me

72
00:05:25,840 --> 00:05:31,919
employees that's for a human to machine comparison now the demographics of our

73
00:05:30,000 --> 00:05:37,199
company are not representative of the general public got a lot of default

74
00:05:34,400 --> 00:05:40,639
character creation screen dudes here but after some adjustments to our

75
00:05:38,400 --> 00:05:46,320
calculations to compensate we were ready to measure the base of eight different

76
00:05:43,039 --> 00:05:48,479
headphones on each of our human subjects

77
00:05:46,320 --> 00:05:52,720
why only bass okay we wanted to measure treble as well but

78
00:05:50,639 --> 00:05:57,039
because treble sound waves are very short a 15 kilohertz wave is actually

79
00:05:55,120 --> 00:06:01,919
less than an inch the microphone position needs to be very precise across

80
00:05:59,759 --> 00:06:04,960
all of the test subjects which we didn't have time to deal with during our

81
00:06:03,039 --> 00:06:10,639
short-term headlones bass waves on the other hand are very long a 20 hertz

82
00:06:07,680 --> 00:06:14,639
sound wave is 55 feet in length so microphone placement doesn't require the

83
00:06:12,560 --> 00:06:19,759
same level of precision across our human subjects to acquire comparable results

84
00:06:17,520 --> 00:06:23,520
and besides in our head-to-head testing data we found only small differences in

85
00:06:21,840 --> 00:06:27,759
the treble range between the two heads so we proceeded with our human testing

86
00:06:26,240 --> 00:06:31,440
which oh apparently i'm next let's go

87
00:06:31,520 --> 00:06:37,919
step one is our subject gets to place microphones into their ears like

88
00:06:36,960 --> 00:06:42,479
how i don't know how so the first step would

89
00:06:40,479 --> 00:06:46,319
be to sanitize your hands and also sanitize your ears that makes sense even

90
00:06:44,639 --> 00:06:51,520
in not covered times when you're talking like ear goop

91
00:06:48,960 --> 00:06:57,440
look at it go this is for the inside of your ears

92
00:06:55,280 --> 00:07:00,639
now we have to place the microphones this is the left ear okay here you do

93
00:06:59,280 --> 00:07:05,919
the left one then i'll do the right one okay it goes inside your ears like this

94
00:07:03,360 --> 00:07:10,080
it does not necessarily fit everyone for some it's a bit too small and it just

95
00:07:08,000 --> 00:07:13,759
keeps coming out something you might be familiar with this is cool there's a

96
00:07:11,919 --> 00:07:17,759
microphone right here they look right and then this little guy sits in your

97
00:07:15,599 --> 00:07:22,479
ear a little something like i guess it goes kind of like that

98
00:07:19,759 --> 00:07:27,440
okay and then this goes here okay so then put the headphones on the

99
00:07:24,720 --> 00:07:31,120
way you normally would okay then i'm going to play a noise

100
00:07:29,199 --> 00:07:34,479
our headphone test engineer just played pink noise through the headphones for me

101
00:07:32,800 --> 00:07:38,479
which you could think of kind of like pink noise is tuned more for human

102
00:07:36,400 --> 00:07:41,759
hearing so it doesn't sound so harsh to us now i take them off i put them back

103
00:07:40,319 --> 00:07:45,599
on yeah every time we put on our headphones we do it a little differently

104
00:07:43,680 --> 00:07:51,840
maybe the band is here or maybe it's more like here or maybe our kids are

105
00:07:48,319 --> 00:07:51,840
playing around with all the adjustments

106
00:07:53,680 --> 00:07:59,120
and that's the second pass okay and we do that five times with every subject

107
00:07:57,919 --> 00:08:03,919
yeah now these are open-backed headphones is it a problem that people are clicking their mouses and stuff

108
00:08:02,080 --> 00:08:08,720
again we're not in a controlled lab environment so that's expected they will

109
00:08:06,400 --> 00:08:12,800
not miss an opportunity to remind me that the current conditions are not

110
00:08:09,840 --> 00:08:16,000
perfect i know over 1 000 measurements later the resulting average looked like

111
00:08:15,120 --> 00:08:20,240
this so how does that match up to our heads

112
00:08:18,319 --> 00:08:24,479
the quick and dirty version is that with open back headphones we found a

113
00:08:22,000 --> 00:08:28,400
measurable but minor variance between the two units and between our human test

114
00:08:26,879 --> 00:08:33,680
subjects but both of these are within what we'd consider to be an acceptable range

115
00:08:32,159 --> 00:08:36,880
our engineer isn't ready for video appearances yet but he will be

116
00:08:35,200 --> 00:08:40,560
publishing a more detailed write-up on flow plane for those of you who want to

117
00:08:38,479 --> 00:08:45,120
dig a little bit deeper into why we consider that okay shifting gears to a

118
00:08:42,800 --> 00:08:50,080
popular closed back headphone we see a much different story look at this

119
00:08:47,360 --> 00:08:53,680
variance in humans at 40 hertz 14 decibels

120
00:08:52,160 --> 00:08:58,320
that means that some people would be perceiving more than twice as much bass

121
00:08:56,080 --> 00:09:02,560
compared to others completely changing the listening experience this is because

122
00:09:00,320 --> 00:09:08,880
closed back headphones rely on a proper seal to create their base comparing our

123
00:09:05,200 --> 00:09:12,240
heads however again they're pretty close

124
00:09:08,880 --> 00:09:14,640
but the 5128 measured slightly closer to

125
00:09:12,240 --> 00:09:19,360
our humans than the super hms so both heads get a pass here but the 5128 it

126
00:09:17,680 --> 00:09:23,200
gets a gold star we also tested some in-ears that are

127
00:09:21,360 --> 00:09:27,600
known to cause problems for hats in general and found that this issue was

128
00:09:25,360 --> 00:09:33,760
present in both of our models meaning that these had struggled to get a good

129
00:09:29,839 --> 00:09:35,839
seal on some larger iems two more passes

130
00:09:33,760 --> 00:09:39,360
but this time with unhappy stickers because it means no matter which way we

131
00:09:37,440 --> 00:09:42,160
go i'll eventually have to replace this darn thing really

132
00:09:42,240 --> 00:09:47,839
anyhoo i guess it kind of makes sense that our results have been so close

133
00:09:45,839 --> 00:09:52,560
given that both of these models are based on the same design and that both

134
00:09:50,480 --> 00:09:57,200
are considered industry standard testing equipment

135
00:09:53,600 --> 00:09:57,200
we do however have a winner

136
00:09:58,160 --> 00:10:04,959
the bnk 5128 some may disagree with our assessment

137
00:10:03,200 --> 00:10:09,360
some might not think it's worthwhile to get any head and torso simulator because

138
00:10:07,600 --> 00:10:12,320
the greater body of academic headphone research has been done on older

139
00:10:10,720 --> 00:10:16,560
simulators and is therefore less applicable to this new hardware but we

140
00:10:14,880 --> 00:10:20,800
feel that we can take the current knowledge base and adapt it to the newer

141
00:10:18,720 --> 00:10:25,680
models to get the best of both worlds the best research and the best tech to

142
00:10:23,600 --> 00:10:29,760
be clear the super hms is still an excellent product and a major

143
00:10:27,519 --> 00:10:33,279
improvement over its predecessor but the things that pushed us toward the bnk

144
00:10:31,519 --> 00:10:37,760
where it's ease of use improved durability and better reputation i'm

145
00:10:36,000 --> 00:10:42,160
happy with our choices but there's a big but here i want to make it

146
00:10:40,399 --> 00:10:46,320
clear that our results here are not the be-all and end-all of audio testing at

147
00:10:44,240 --> 00:10:50,560
all and the testing that we end up doing in the future with the bnk 5128 it's not

148
00:10:49,360 --> 00:10:57,760
going to be the be all and end all either for one thing this simulator by design

149
00:10:54,480 --> 00:11:00,480
represents the average person and no one

150
00:10:57,760 --> 00:11:04,000
person is average especially not you as an LTT viewer you're decidedly above

151
00:11:02,240 --> 00:11:08,000
average so what that means is that the response curves that we get from this

152
00:11:05,680 --> 00:11:12,480
head will not directly reflect what you hear in your ears

153
00:11:09,839 --> 00:11:16,079
it's just that by adding some objective knowledge to your toolkit you can become

154
00:11:14,320 --> 00:11:20,640
a more informed consumer who can find the best headphones for your needs

155
00:11:17,760 --> 00:11:24,560
faster also at our lab the goal is to never be satisfied with good enough

156
00:11:22,399 --> 00:11:27,519
we're gonna spare no expense i mean really if i'm not putting my money where

157
00:11:25,760 --> 00:11:31,440
my mouth is at this point come on guys but there is always going to be room for

158
00:11:29,600 --> 00:11:35,760
improvement we know that our tests weren't perfect here for many reasons

159
00:11:34,000 --> 00:11:38,959
and no one is more critical about our testing protocols than the very people

160
00:11:37,519 --> 00:11:43,600
that we've hired to create them but our lab is still under construction and achieving our goal of industry-leading

161
00:11:41,920 --> 00:11:47,519
testing is going to take some time there's also just much more that we'd

162
00:11:45,680 --> 00:11:51,839
love to test outside of just the frequency response of headphones like

163
00:11:49,440 --> 00:11:56,079
the microphones noise cancelling distortion testing even trying to find

164
00:11:53,760 --> 00:12:00,079
ways to apply response curve data to the human perceptual system so if there are

165
00:11:58,320 --> 00:12:04,079
tests you guys would like to see let us know in the comments because this

166
00:12:02,160 --> 00:12:07,279
is just the beginning the beginning of this message

167
00:12:05,200 --> 00:12:11,360
from our sponsor who's going to help me pay for this enlisted is a free-to-play

168
00:12:09,519 --> 00:12:18,240
world war two multiplayer shooter available on pc ps5 ps4 xbox series x

169
00:12:15,519 --> 00:12:21,839
and s and xbox one with crossplay it is a focus on historical authenticity and

170
00:12:20,560 --> 00:12:28,399
gameplay that always keep you in the middle of the action you'll be placed in large-scale combat alongside dozens of

171
00:12:25,600 --> 00:12:32,000
soldiers vehicles and aircraft directly in famous historical campaigns like the

172
00:12:30,399 --> 00:12:35,680
invasion of normandy there's hundreds of firearms and specialized weapons from

173
00:12:33,920 --> 00:12:39,440
common ones seen throughout the war to rare prototypes you hardly see in other

174
00:12:37,680 --> 00:12:43,440
games there's even building construction and destructible items in the environment and if you use our link

175
00:12:42,000 --> 00:12:47,040
you'll get a free bonus just for signing up including three days of premium time

176
00:12:45,519 --> 00:12:51,279
and several orders for troops and weapons so head to the link in the description and start playing enlisted

177
00:12:49,839 --> 00:12:56,399
for free today thanks for watching if you're interested in more headphone content check out our

178
00:12:54,320 --> 00:13:01,920
video where we did some subjective testing of 35 knockoff airpods spoiler

179
00:13:00,240 --> 00:13:05,680
um our staff by and large actually preferred them to the real thing