Mixed Reality Streaming Setup - How To: Advanced
Linus Tech Tips
·Linus Tech Tips
·2017-05-06
·
1,708 words · ~8 min read
0:00
welcome to another episode of how to here on lineus Tech tips today we'll be
0:04
doing something that's a little bit more complicated but we'll give you a truly
0:08
awesome results if it is done correctly what I'm talking about is streaming
0:12
mixed reality footage what's that well if you have a VR headset such as the HTC
0:17
Vive that we have here in the office you can actually stream footage of yourself
0:21
doing things in a virtual game environment so to the viewer it will
0:25
look like you're walking around in a Fantastical World instead of just your
0:30
living room it does this by transposing the in-game environment onto a green
0:43
screen cooler Master's new master keys Pro L and pro s keyboards feature 16.7
0:49
million color RGB back lighting genuine Cherry MX switches and an
0:53
industry-leading ARM cortex processor learn more at the link in the video
0:56
description today we'll be showing you how to do this in fantastic Contraption
1:01
a game from Northway games we'd also like to take this opportunity to give
1:05
Northway a shout out as we base this guide on the mixed reality information
1:10
that they provided on their website you can find a link in the video description
1:13
down below all you need to get started other than a VR headset and a gaming rig
1:18
is a green screen an HDMI camcorder and either an internal or external capture
1:23
card with an HDMI port we'll be using an a media live gamer portable in our
1:28
demonstration today also make sure you have an HDMI cord long enough to reach
1:32
from your capture card to your camcorder as this will allow you to move your
1:36
camcorder to different places around the room so that you can adjust how your
1:40
stream will end up looking this is especially important if you're getting a
1:44
friend to act as a camera person instead of just putting your camera on a tripod
1:48
to get started go ahead and set up your HTC Vive according to the manufacturer's
1:53
instructions then get your capture card installed although external capture
1:57
cards are generally connected with a simple USB cord there are also internal
2:01
capture cards that slot into a PCI Express 1X slot if you'd like to keep
2:06
things a little bit tidier after you've gotten your Vive and your capture card
2:09
ready go ahead and start setting up your green screen green screens come in lots
2:14
of different sizes so you want to get something that can surround your play
2:18
area on at least two sides as well as something to cover the floor green
2:22
screen fabric actually works pretty well for this and it's not that bad to adjust
2:26
but you will need something to hang it on make sure your lighting is adequate
2:29
as well well generally bright light is better as it will allow your camera and
2:34
your software to more easily separate the green screen from everything else
2:38
next you'll want to set up your camcorder if you don't have one don't worry about buying something super
2:43
expensive as realistic effects can be achieved with many fairly inexpensive
2:48
models such as a Sony handicam just make
2:51
sure you aren't using something like a webcam or a phone camera as it probably
2:55
won't be good enough place your camera in a spot that will capture as much of
2:58
the play area as possible possible without placing areas outside of your
3:02
green screen setup in the frame you don't want to have your stream or
3:06
recording ruined because it looks like some far away world is directly bordered
3:11
by your living room couch connect your camera to your capture card's HDMI input
3:16
and you're ready to go at least on the hardware side next is the software setup
3:21
not all games support mixed reality but the Vive does have a number of games in
3:25
its library that do such as fantastic Contraption which has a setting that
3:29
enables multiple virtual cameras within the game this allows your capture
3:34
software to use depth information to combine the VR graphics and the feed
3:39
from your real life camcorder accurately
3:42
just open the settings menu in game make sure toggle depth camera is checked and
3:46
enter all zeros in the field labeled foreground color key you'll need to set
3:51
up your capture software next which can be a little bit more complicated as it
3:55
needs to combine three layers the game foreground The Game background and the
4:00
feed from your camcorder we're going to use open broadcasting software or OBS
4:06
download install it open it then hit the plus sign underneath sources and pick
4:11
window capture name this layer VR background and select fantastic
4:16
Contraption turn off cursor capture then enter the correct streaming resolution
4:21
for fantastic Contraption since the depth camera option splits the screen
4:25
into four quadrants you can only stream at one quarter of your computer
4:29
computer's resolution so if you're running a monitor at 1080p you'll need
4:33
to enter a resolution of 960x 540 but if
4:37
you have a 4K display you can stream at 1920 by 1080 once you've done this make
4:41
sure that you grab the corner of the layer and expand it to fill the entire
4:45
canvas next under sources add the webcam
4:49
layer by picking video capture device and then name it camcorder or honestly
4:54
whatever you'd like fill the whole cameras with the camera layer like you
4:57
did in the previous step then select color key under effects filters so that
5:02
your computer will process the green screen properly play with the similarity
5:07
and smoothness settings until things look good the last layer is the VR
5:11
foreground which you should now add by following a similar procedure to the
5:15
background however this time deselect the capture any full screen application
5:20
option and select allow transparency
5:23
make sure again to deselect capture cursor to enter a proper resolution and
5:29
to expand the layer to fill up the canvas the last step is to sync up your
5:33
camcorder with what's going on in the game make sure both the game and OBS are
5:37
open then adjust the virtual camera with the w a s d q and E keys this is a lot
5:43
easier if you can get a friend to stand in the play area with the controllers in
5:48
hand so you'll have a point of reference but this can be done by just placing the
5:53
controllers on something as well this will allow you to match up the in-game
5:57
camera system and your camcorder precisely so that the stream will look
6:01
realistic also be sure to adjust the feel the view settings by dragging the
6:06
third person fov slider in the in-game settings until the in-game virtual
6:11
controllers match up with wherever your friend is holding the real ones however
6:15
if you want to use a moving camera you can do this by taping a third Vive
6:19
controller to your camcorder which will cause the game to track its position
6:23
making for an even more interesting visual presentation just select handheld
6:28
mode in the in-game settings menu and sync the cameras using the previous
6:32
steps so after you've done all of this you're finally ready to stream or record
6:37
or whatever you want to do although there are a lot of steps involved the
6:40
result should make it look like you're firmly in the middle of a virtual world
6:44
it won't look exactly James Cameron like but you will be able to give your
6:48
viewers a really cool experience that can set your channel apart don't stop
6:52
don't stop don't stop oh my God I just killed the cat
6:55
what happens dude I literally just threw the
6:58
cat off the platform what happens now the Squarespace you know and love
7:03
now has a new feature Squarespace domains a new fast and easy way to
7:07
search over 200 top level domain types and manage them after you buy them
7:11
directly through Squarespace they still have 24/7 live chat and email support
7:16
like they did before and a standard account is still only eight bucks a
7:20
month and if you buy it for a year you do get a free domain there's still
7:23
responsive design and cover pages so that you can have professionall looking
7:28
single page websites for stuff like a resume or whatever or multi-page
7:32
websites if that's what you want and the responsive design makes us that it will
7:36
look great on a wide variety of basically every single device that can
7:40
look at web pages so to trial with no credit card required and start building
7:44
your website today and when you decide to sign up for Squarespace make sure to
7:47
use offer code Linus to save 10% off
7:51
your first purchase all right guys thank you for
7:54
watching if you like the video like it if you dislike the video dislike it if
7:57
you want to see more of them get subscribed if you have ideas for future
8:01
howto episodes either let me know at Twitter at Luke LFR or let John know at
8:06
Twitter at Jmart 604 or just post it in
8:10
the comments down below we would love to hear your suggestions if you want a
8:13
shirt description down below if you want to like help us out by buying things
8:17
Amazon affiliate code should be in the description down below if you want to
8:21
become a forum member it's Linus tips.com but it's also probably in the
8:25
video description down below you can become a contributor there which helps us financially or you can just become a
8:29
member which helps us awesomely if you want to see other
8:34
how-to episodes cook up here there will be one of them not sure which one
8:37
mystery video but there's only two other ones or maybe one other one depending
8:41
when this one comes out so it might not be that
8:45
surprising