{"video_id":"J5oW7r-2dlM","title":"The Tech that's Saving VR: Inside-out Tracking","channel":"Techquickie","show":"Techquickie","published_at":"2020-05-05T14:58:16Z","duration_s":432,"segments":[{"start_s":0.0,"end_s":4.24,"text":"Virtual reality enjoyed hype levels over 9,000!","speaker":null,"is_sponsor":0},{"start_s":4.24,"end_s":10.68,"text":"Just a few short years ago only, to have a lot of the fanfare die down shortly thereafter.","speaker":null,"is_sponsor":0},{"start_s":10.68,"end_s":15.16,"text":"And justifiably so, a lot of people had understandable misgivings","speaker":null,"is_sponsor":0},{"start_s":15.16,"end_s":19.68,"text":"about things like comfort, cables, and the cost of entry.","speaker":null,"is_sponsor":0},{"start_s":19.68,"end_s":24.24,"text":"If only there was a technology that would make it possible to create a cheap,","speaker":null,"is_sponsor":0},{"start_s":24.24,"end_s":30.44,"text":"easy, and wireless platform that provides all the benefits of enthusiast-grade VR","speaker":null,"is_sponsor":0},{"start_s":30.44,"end_s":33.68,"text":"without the drawbacks. Well, that is exactly what","speaker":null,"is_sponsor":0},{"start_s":33.68,"end_s":37.64,"text":"Markerless Inside Out Tracking promises to provide.","speaker":null,"is_sponsor":0},{"start_s":37.64,"end_s":41.76,"text":"Now, although it's true that devices like the Windows Mixed Reality headsets","speaker":null,"is_sponsor":0},{"start_s":41.76,"end_s":47.44,"text":"and Lenovo's Mirage Solo have used Markerless Inside Out Tracking for a while,","speaker":null,"is_sponsor":0},{"start_s":47.44,"end_s":50.96,"text":"they've never achieved the status of the more premium offerings","speaker":null,"is_sponsor":0},{"start_s":50.96,"end_s":54.76,"text":"from companies like HTC, Oculus, or Sony.","speaker":null,"is_sponsor":0},{"start_s":54.76,"end_s":58.84,"text":"Fortunately, for VR lovers, things are changing as late-model headsets","speaker":null,"is_sponsor":0},{"start_s":58.84,"end_s":63.16,"text":"with this technology, like the Oculus Quest and Oculus Rift S,","speaker":null,"is_sponsor":0},{"start_s":63.16,"end_s":69.28,"text":"have almost completely closed the gap, and HTC revealed at CES this year","speaker":null,"is_sponsor":0},{"start_s":69.28,"end_s":75.36,"text":"that the Vive Cosmos will be taking advantage of Markerless Inside Out Tracking as well.","speaker":null,"is_sponsor":0},{"start_s":75.36,"end_s":79.08,"text":"So it's safe to say then that the heavyweights have entered the ring.","speaker":null,"is_sponsor":0},{"start_s":79.08,"end_s":84.36,"text":"But what exactly is Inside Out Tracking, and specifically Markerless Inside Out Tracking,","speaker":null,"is_sponsor":0},{"start_s":84.44,"end_s":88.8,"text":"and why is everybody jumping on the bandwagon? Well, put simply, Inside Out Tracking","speaker":null,"is_sponsor":0},{"start_s":88.8,"end_s":94.52,"text":"is a way to track the position of a head-mounted display or HMD in three-dimensional space.","speaker":null,"is_sponsor":0},{"start_s":94.52,"end_s":98.6,"text":"Up until recently, the biggest six degrees of freedom VR platforms,","speaker":null,"is_sponsor":0},{"start_s":98.6,"end_s":104.24,"text":"the Rift and the PSVR, have been using either Inside Out Tracking with Markers","speaker":null,"is_sponsor":0},{"start_s":104.24,"end_s":107.72,"text":"or even the opposite approach outside in tracking,","speaker":null,"is_sponsor":0},{"start_s":107.72,"end_s":113.16,"text":"which uses external sensors or cameras to determine where the headset is located.","speaker":null,"is_sponsor":0},{"start_s":113.16,"end_s":116.56,"text":"And while these methods are very accurate","speaker":null,"is_sponsor":0},{"start_s":116.56,"end_s":120.68,"text":"and some with very minimal latency, they're not without problems.","speaker":null,"is_sponsor":0},{"start_s":120.68,"end_s":126.72,"text":"So the sensor towers require a line of sight with the HMD and controllers at all times,","speaker":null,"is_sponsor":0},{"start_s":126.72,"end_s":131.84,"text":"meaning that if you don't have a clear play space or you haven't set up the sensors properly,","speaker":null,"is_sponsor":0},{"start_s":131.84,"end_s":137.8,"text":"they could get occluded and lose tracking. And what's more, setup can be a total hassle","speaker":null,"is_sponsor":0},{"start_s":137.8,"end_s":142.2,"text":"if you don't have a dedicated VR area where you can just set it and forget it.","speaker":null,"is_sponsor":0},{"start_s":142.2,"end_s":145.84,"text":"You gotta push away your furniture, mount your sensors, define your play space,","speaker":null,"is_sponsor":0},{"start_s":145.84,"end_s":149.2,"text":"and finally step into the virtual world.","speaker":null,"is_sponsor":0},{"start_s":149.2,"end_s":152.34,"text":"But even if you have plenty of space and you don't mind the setup time,","speaker":null,"is_sponsor":0},{"start_s":152.34,"end_s":159.32,"text":"you will still need external sensors and either a PlayStation 4 or a VR-capable PC,","speaker":null,"is_sponsor":0},{"start_s":159.32,"end_s":163.68,"text":"each of which drive up the cost of entry. Markerless Inside Out Tracking on the other hand","speaker":null,"is_sponsor":0},{"start_s":163.68,"end_s":166.84,"text":"has all of the required sensors embedded","speaker":null,"is_sponsor":0},{"start_s":166.84,"end_s":172.12,"text":"within the headset itself, allowing the HMD to track its own position,","speaker":null,"is_sponsor":0},{"start_s":172.12,"end_s":177.2,"text":"resulting in a simpler, quicker, and generally cheaper way to get immersed in VR.","speaker":null,"is_sponsor":0},{"start_s":177.2,"end_s":182.14,"text":"So it sounds great, right? But how does all this Inside Out trickery work?","speaker":null,"is_sponsor":0},{"start_s":182.14,"end_s":185.94,"text":"The answer, of course, is SLAM tech.","speaker":null,"is_sponsor":0},{"start_s":185.94,"end_s":193.32,"text":"I'm serious, actually. It's called SLAM technology. You see, SLAM stands for Simultaneous Localization and Mapping,","speaker":null,"is_sponsor":0},{"start_s":193.32,"end_s":197.56,"text":"which describes the problem that the head-mounted display has to solve.","speaker":null,"is_sponsor":0},{"start_s":197.56,"end_s":200.56,"text":"That is, creating and constantly updating","speaker":null,"is_sponsor":0},{"start_s":200.56,"end_s":205.6,"text":"a map of the environment that it's in while simultaneously tracking its own location","speaker":null,"is_sponsor":0},{"start_s":205.6,"end_s":210.4,"text":"within that map. It does this by using a combination of physical sensors,","speaker":null,"is_sponsor":0},{"start_s":210.4,"end_s":214.2,"text":"like cameras, accelerometers, and gyroscopes","speaker":null,"is_sponsor":0},{"start_s":214.2,"end_s":217.94,"text":"to continuously detect information about itself","speaker":null,"is_sponsor":0},{"start_s":217.94,"end_s":222.44,"text":"and the world around it. This data is then passed over to the software","speaker":null,"is_sponsor":0},{"start_s":222.44,"end_s":227.96,"text":"that's responsible for processing it and generating a 3D mapping of the environment.","speaker":null,"is_sponsor":0},{"start_s":227.96,"end_s":232.12,"text":"Now, while solutions to SLAM were originally developed for other applications,","speaker":null,"is_sponsor":0},{"start_s":232.12,"end_s":237.68,"text":"like robotics and self-driving cars, it's now being used for hardcore VR gaming.","speaker":null,"is_sponsor":0},{"start_s":237.68,"end_s":241.0,"text":"Like, who cares about the advancements of collective human knowledge when you could be playing?","speaker":null,"is_sponsor":0},{"start_s":241.0,"end_s":244.96,"text":"Super hot, super hot.","speaker":null,"is_sponsor":0},{"start_s":244.96,"end_s":249.08,"text":"But it's no guarantee that super hot or any VR experience for that matter","speaker":null,"is_sponsor":0},{"start_s":249.08,"end_s":252.88,"text":"will be better with Inside Out tracking. Like I said before,","speaker":null,"is_sponsor":0},{"start_s":252.88,"end_s":258.88,"text":"the reason that anyone would care about all of this at all is if they want a cheap, easy, and wireless VR platform","speaker":null,"is_sponsor":0},{"start_s":258.88,"end_s":262.04,"text":"that has all or almost all of the benefits","speaker":null,"is_sponsor":0},{"start_s":262.04,"end_s":267.16,"text":"of an enthusiast-grade experience. The issue here is that in order to make it wireless,","speaker":null,"is_sponsor":0},{"start_s":267.16,"end_s":273.32,"text":"everything has to run on mobile hardware. So if you're a member of the glorious PC gaming master race","speaker":null,"is_sponsor":0},{"start_s":273.32,"end_s":277.64,"text":"or even an ordinary PS4 gamer, VR games running on mobile hardware","speaker":null,"is_sponsor":0},{"start_s":277.64,"end_s":280.68,"text":"is gonna be a step down for both of you","speaker":null,"is_sponsor":0},{"start_s":280.68,"end_s":286.48,"text":"in terms of both fidelity and immersion. Plus, both the Mirage Solo and Oculus Quest","speaker":null,"is_sponsor":0},{"start_s":286.52,"end_s":289.76,"text":"feature piddly refresh rates in the mid-70 Hertz","speaker":null,"is_sponsor":0},{"start_s":289.76,"end_s":292.8,"text":"with the Rift S at 80 Hertz, the original Vive at 90,","speaker":null,"is_sponsor":0},{"start_s":292.8,"end_s":296.16,"text":"and the Valve Index at a whopping 120 Hertz","speaker":null,"is_sponsor":0},{"start_s":296.16,"end_s":301.08,"text":"or even 144 in its experimental mode. So if you suffer from simulation sickness","speaker":null,"is_sponsor":0},{"start_s":301.08,"end_s":304.52,"text":"at reduced refresh rates, you might not wanna buy into the marker list","speaker":null,"is_sponsor":0},{"start_s":304.52,"end_s":309.88,"text":"inside out hype just yet. Making matters worse, occlusion is still a problem","speaker":null,"is_sponsor":0},{"start_s":309.88,"end_s":313.92,"text":"when it comes to Inside Out tracking. The difference here is that instead of stuff","speaker":null,"is_sponsor":0},{"start_s":313.92,"end_s":317.56,"text":"getting between the sensors and the headset,","speaker":null,"is_sponsor":0},{"start_s":317.56,"end_s":321.68,"text":"Inside Out occlusion happens when the sensors on the HMD get blocked.","speaker":null,"is_sponsor":0},{"start_s":321.68,"end_s":325.64,"text":"For example, you might be aiming down the sights of a rifle with one of your hands","speaker":null,"is_sponsor":0},{"start_s":325.64,"end_s":330.2,"text":"right up against your headset. Or if you simply look away from the controllers","speaker":null,"is_sponsor":0},{"start_s":330.2,"end_s":333.76,"text":"or put them behind you to grab an arrow out of your quiver,","speaker":null,"is_sponsor":0},{"start_s":333.76,"end_s":337.2,"text":"the controller will try to continue tracking","speaker":null,"is_sponsor":0},{"start_s":337.2,"end_s":341.76,"text":"based on their last known position, but it might be with lower resolution data.","speaker":null,"is_sponsor":0},{"start_s":341.76,"end_s":346.04,"text":"So the longer the disruption, the more out of sync with reality things can become.","speaker":null,"is_sponsor":0},{"start_s":346.04,"end_s":352.08,"text":"Plus, the image processing that's done on captured footage while impressive isn't perfect.","speaker":null,"is_sponsor":0},{"start_s":352.08,"end_s":355.16,"text":"And Inside Out tracking doesn't really work outdoors","speaker":null,"is_sponsor":0},{"start_s":355.16,"end_s":358.8,"text":"because sunlight can interfere with the sensors. These issues though,","speaker":null,"is_sponsor":0},{"start_s":358.8,"end_s":361.84,"text":"do not amount to a death sentence for Inside Out tracking.","speaker":null,"is_sponsor":0},{"start_s":361.84,"end_s":366.28,"text":"As processing power, sensor performance, and slam tech","speaker":null,"is_sponsor":0},{"start_s":366.28,"end_s":371.32,"text":"continue to improve, we'll see a lot of these early problems become less and less pervasive.","speaker":null,"is_sponsor":0},{"start_s":371.32,"end_s":376.16,"text":"And there's also room for software to make more efficient use of the processing power","speaker":null,"is_sponsor":0},{"start_s":376.16,"end_s":380.36,"text":"that we have using still in development techniques like foveated rendering","speaker":null,"is_sponsor":0},{"start_s":380.36,"end_s":383.54,"text":"to get heavier games running on lighter hardware.","speaker":null,"is_sponsor":0},{"start_s":383.54,"end_s":387.32,"text":"So with all that in mind, there is still absolutely hope for VR","speaker":null,"is_sponsor":0},{"start_s":387.32,"end_s":391.44,"text":"to go truly mainstream once they make headsets","speaker":null,"is_sponsor":0},{"start_s":391.44,"end_s":396.02,"text":"that don't make you look like an idiot. So thanks for watching guys. Like, dislike, check out our other videos","speaker":null,"is_sponsor":0},{"start_s":396.02,"end_s":397.52,"text":"and don't forget to subscribe.","speaker":null,"is_sponsor":1}],"full_text":"Virtual reality enjoyed hype levels over 9,000! Just a few short years ago only, to have a lot of the fanfare die down shortly thereafter. And justifiably so, a lot of people had understandable misgivings about things like comfort, cables, and the cost of entry. If only there was a technology that would make it possible to create a cheap, easy, and wireless platform that provides all the benefits of enthusiast-grade VR without the drawbacks. Well, that is exactly what Markerless Inside Out Tracking promises to provide. Now, although it's true that devices like the Windows Mixed Reality headsets and Lenovo's Mirage Solo have used Markerless Inside Out Tracking for a while, they've never achieved the status of the more premium offerings from companies like HTC, Oculus, or Sony. Fortunately, for VR lovers, things are changing as late-model headsets with this technology, like the Oculus Quest and Oculus Rift S, have almost completely closed the gap, and HTC revealed at CES this year that the Vive Cosmos will be taking advantage of Markerless Inside Out Tracking as well. So it's safe to say then that the heavyweights have entered the ring. But what exactly is Inside Out Tracking, and specifically Markerless Inside Out Tracking, and why is everybody jumping on the bandwagon? Well, put simply, Inside Out Tracking is a way to track the position of a head-mounted display or HMD in three-dimensional space. Up until recently, the biggest six degrees of freedom VR platforms, the Rift and the PSVR, have been using either Inside Out Tracking with Markers or even the opposite approach outside in tracking, which uses external sensors or cameras to determine where the headset is located. And while these methods are very accurate and some with very minimal latency, they're not without problems. So the sensor towers require a line of sight with the HMD and controllers at all times, meaning that if you don't have a clear play space or you haven't set up the sensors properly, they could get occluded and lose tracking. And what's more, setup can be a total hassle if you don't have a dedicated VR area where you can just set it and forget it. You gotta push away your furniture, mount your sensors, define your play space, and finally step into the virtual world. But even if you have plenty of space and you don't mind the setup time, you will still need external sensors and either a PlayStation 4 or a VR-capable PC, each of which drive up the cost of entry. Markerless Inside Out Tracking on the other hand has all of the required sensors embedded within the headset itself, allowing the HMD to track its own position, resulting in a simpler, quicker, and generally cheaper way to get immersed in VR. So it sounds great, right? But how does all this Inside Out trickery work? The answer, of course, is SLAM tech. I'm serious, actually. It's called SLAM technology. You see, SLAM stands for Simultaneous Localization and Mapping, which describes the problem that the head-mounted display has to solve. That is, creating and constantly updating a map of the environment that it's in while simultaneously tracking its own location within that map. It does this by using a combination of physical sensors, like cameras, accelerometers, and gyroscopes to continuously detect information about itself and the world around it. This data is then passed over to the software that's responsible for processing it and generating a 3D mapping of the environment. Now, while solutions to SLAM were originally developed for other applications, like robotics and self-driving cars, it's now being used for hardcore VR gaming. Like, who cares about the advancements of collective human knowledge when you could be playing? Super hot, super hot. But it's no guarantee that super hot or any VR experience for that matter will be better with Inside Out tracking. Like I said before, the reason that anyone would care about all of this at all is if they want a cheap, easy, and wireless VR platform that has all or almost all of the benefits of an enthusiast-grade experience. The issue here is that in order to make it wireless, everything has to run on mobile hardware. So if you're a member of the glorious PC gaming master race or even an ordinary PS4 gamer, VR games running on mobile hardware is gonna be a step down for both of you in terms of both fidelity and immersion. Plus, both the Mirage Solo and Oculus Quest feature piddly refresh rates in the mid-70 Hertz with the Rift S at 80 Hertz, the original Vive at 90, and the Valve Index at a whopping 120 Hertz or even 144 in its experimental mode. So if you suffer from simulation sickness at reduced refresh rates, you might not wanna buy into the marker list inside out hype just yet. Making matters worse, occlusion is still a problem when it comes to Inside Out tracking. The difference here is that instead of stuff getting between the sensors and the headset, Inside Out occlusion happens when the sensors on the HMD get blocked. For example, you might be aiming down the sights of a rifle with one of your hands right up against your headset. Or if you simply look away from the controllers or put them behind you to grab an arrow out of your quiver, the controller will try to continue tracking based on their last known position, but it might be with lower resolution data. So the longer the disruption, the more out of sync with reality things can become. Plus, the image processing that's done on captured footage while impressive isn't perfect. And Inside Out tracking doesn't really work outdoors because sunlight can interfere with the sensors. These issues though, do not amount to a death sentence for Inside Out tracking. As processing power, sensor performance, and slam tech continue to improve, we'll see a lot of these early problems become less and less pervasive. And there's also room for software to make more efficient use of the processing power that we have using still in development techniques like foveated rendering to get heavier games running on lighter hardware. So with all that in mind, there is still absolutely hope for VR to go truly mainstream once they make headsets that don't make you look like an idiot. So thanks for watching guys. Like, dislike, check out our other videos and don't forget to subscribe."}