WEBVTT

00:00:00.000 --> 00:00:08.179
you guys are not going to believe we just got the RTX 5090 and I'm about to

00:00:05.940 --> 00:00:14.700
risk it up to unbox this product that looks really

00:00:12.540 --> 00:00:21.240
interesting and I wait a second where am I oh oh I know

00:00:18.480 --> 00:00:25.320
this is the new set for GameLinked this looks amazing we're doing a gaming News

00:00:23.820 --> 00:00:30.300
Channel guys we've got all these lights and we got the big G and

00:00:28.019 --> 00:00:36.059
this is huge we afford all of this a lot more easily

00:00:33.360 --> 00:00:41.280
than you would think in fact this entire setup is so cheap that I'm starting to

00:00:39.120 --> 00:00:46.320
wonder if I even need a big Studio like this that I'm not even standing in front

00:00:43.920 --> 00:00:50.219
of now these days anyone can key out a background with pretty good results but

00:00:48.840 --> 00:00:55.140
the key night among you might have noticed something that is more than just

00:00:52.140 --> 00:00:58.620
pretty good how on Earth did we manage

00:00:55.140 --> 00:01:01.739
to move the camera around inside of our

00:00:58.620 --> 00:01:03.480
new set follow me and I'll show you the

00:01:01.739 --> 00:01:08.939
tech is just on the other side of this tunnel let's go

00:01:07.040 --> 00:01:14.939
oh look at all the pretty Segways

00:01:11.760 --> 00:01:17.820
to our sponsor hetzner Hester is now

00:01:14.939 --> 00:01:22.380
offering brand new ARM 64 Cloud servers you can discover ampere's efficient and

00:01:20.100 --> 00:01:26.100
robust arm64 architecture and be ready to be blown away by its performance

00:01:24.119 --> 00:01:30.180
deploy yours now by clicking the link down below we're finally launching our

00:01:28.140 --> 00:01:35.460
new gaming News Channel GameLinked but we have two big problems to solve the

00:01:32.880 --> 00:01:41.340
first is space to give the channel a clear identity we wanted it to have its

00:01:37.560 --> 00:01:43.259
own set but look around we don't have

00:01:41.340 --> 00:01:46.560
space for another large set like we built for TechLink I mean we could just

00:01:45.119 --> 00:01:52.680
use the green screen that we already have but that leads to our second issue

00:01:49.439 --> 00:01:54.420
time we want to solve a long-standing

00:01:52.680 --> 00:01:59.340
problem minus Line stop it's tackling time for TechLinked

00:01:57.079 --> 00:02:01.920
what is this doing here where we can't shoot anything there while they're

00:02:00.780 --> 00:02:08.399
shooting there and we can't shoot anything here while they're shooting there it's infuriating all right just

00:02:05.939 --> 00:02:12.180
cut brake protect linked this is the kind of thing that wastes a ton of

00:02:10.140 --> 00:02:17.280
production time around here and the issues compounded by the fact

00:02:14.700 --> 00:02:21.360
that adding green screens creates a lot of extra work for our editors our Tech

00:02:19.379 --> 00:02:25.800
news show techlinked is produced entirely in a single day and the current

00:02:23.760 --> 00:02:31.020
workflow often requires the team to work into the evening to get it out on time

00:02:28.440 --> 00:02:37.680
the solution moving our green screen over here or well more accurately adding

00:02:34.680 --> 00:02:39.660
a second green screen now TechLinked

00:02:37.680 --> 00:02:44.280
and GameLinked never have to wait for our other videos or vice versa and we

00:02:42.300 --> 00:02:48.720
get to maintain Clear Channel identities without acquiring more expensive

00:02:46.200 --> 00:02:54.060
Vancouver real estate nice except for one small problem quality

00:02:51.360 --> 00:02:58.860
green screen work is still more complex than simply taking out the green and

00:02:57.000 --> 00:03:02.700
putting in the other stuff you can end up with all sorts of wonky artifacts

00:03:01.140 --> 00:03:07.140
that will make your composite look like crap for example any green in your

00:03:04.920 --> 00:03:11.640
clothing can end up being keyed out like this news Anchor's dress or you can have

00:03:09.360 --> 00:03:16.019
color spilled from the reflected green light on the set that makes your subject

00:03:13.500 --> 00:03:21.420
look anemic blocky cutouts can eliminate fine details like FlyAway hairs and you

00:03:18.840 --> 00:03:26.220
can end up with weird unnatural blur as the key struggles to compensate for the

00:03:23.400 --> 00:03:30.060
motion blur on a moving subject and of course if there are any Shadows on the

00:03:28.080 --> 00:03:34.080
set then the color filter might not be able to select the key and that's just

00:03:31.980 --> 00:03:38.099
the basic problems all of these need to be fixed after the fact by a video

00:03:36.060 --> 00:03:42.060
editor meaning that any time we gained from shooting simultaneously gets thrown

00:03:40.500 --> 00:03:47.879
out the window later on in the production pipeline is what I used to

00:03:44.700 --> 00:03:49.920
say see here's the thing big TV stations

00:03:47.879 --> 00:03:55.980
and production houses have had tools like this one for whoa God that's on

00:03:52.319 --> 00:03:57.599
Wheels cool as I was saying big TV

00:03:55.980 --> 00:04:02.099
stations and production houses have had tools like this for decades but it's

00:03:59.940 --> 00:04:08.760
only recently that boxes like this one have gotten affordable meet the

00:04:04.739 --> 00:04:10.739
Blackmagic ultimat 4K this little Wonder

00:04:08.760 --> 00:04:16.199
costs less than an apple Vision Pro headset and allows us to live composite

00:04:13.500 --> 00:04:21.000
our video footage which takes all of the extra post-production work out of the

00:04:18.299 --> 00:04:24.840
process how well let me tell you actually let me show you because I think

00:04:23.460 --> 00:04:30.860
that's going to be an easier way of understanding as we explore the software

00:04:26.820 --> 00:04:30.860
and give you some examples hi Ed

00:04:32.820 --> 00:04:39.660
cool one moment please this looks so

00:04:37.020 --> 00:04:44.940
mind-blowingly good look at these little hairs there's no green around them if I

00:04:42.540 --> 00:04:49.520
wasn't looking at this right now I would have no idea that okay how does this

00:04:47.340 --> 00:04:55.440
work okay how is it doing this no for real

00:04:53.340 --> 00:05:00.860
though screen it takes out the grain yes I know

00:04:58.380 --> 00:05:05.520
it takes out the green but the the the reflections internally on that thing

00:05:03.419 --> 00:05:10.979
whatever Hardware accelerated trickery they're using the base concept is like

00:05:07.800 --> 00:05:13.259
any other green screen so we look at the

00:05:10.979 --> 00:05:18.660
raw input coming out of the camera we select a color value that we want to

00:05:15.540 --> 00:05:20.520
remove or key out and then using the

00:05:18.660 --> 00:05:24.900
power of compositing we put our lovely host into a virtual set that's kind of

00:05:23.280 --> 00:05:28.620
the easy part these days I mean even your smartphone can make fake

00:05:26.520 --> 00:05:32.940
backgrounds for tick tock filters the cool part is remember all those issues I

00:05:30.660 --> 00:05:38.639
mentioned before like color spill and sloppy cutouts we can resolve them right

00:05:35.520 --> 00:05:41.220
on device before it ever gets recorded

00:05:38.639 --> 00:05:47.100
can you show me raw because this looks pretty good right now all right so let's

00:05:43.500 --> 00:05:51.000
start from the beginning we will capture

00:05:47.100 --> 00:05:54.479
Andy hold on don't move there's a lot of

00:05:51.000 --> 00:05:56.220
green or like uh like noise why is that

00:05:54.479 --> 00:05:59.400
because those parts so the green screen are not perfectly lit and don't quite

00:05:58.199 --> 00:06:05.160
match our Green Valley it's either hotter than the rest of the green screen

00:06:01.560 --> 00:06:07.139
or darker okay that's bad yeah I mean

00:06:05.160 --> 00:06:12.720
that's bad it's uh you're gonna run into that without uh spending a ton of time

00:06:09.600 --> 00:06:15.000
and money with more lights every time

00:06:12.720 --> 00:06:21.660
I'm always on about the budget now we've got this noise but using a setting

00:06:17.759 --> 00:06:23.460
called Veil we can just tell it see

00:06:21.660 --> 00:06:26.940
y'all later buddy yeah and this is essentially in a normal green screen

00:06:25.259 --> 00:06:31.860
process you were saying it's like black clipping or white clipping yeah it's

00:06:29.039 --> 00:06:37.199
essentially crushing the lights or blacks so that there's no in between the

00:06:34.319 --> 00:06:42.240
fuzz that you were seeing were gray so we don't want this gray we want a clean

00:06:39.419 --> 00:06:48.300
all black on Andy all white on the green screen yeah so if I turn off the veil

00:06:46.080 --> 00:06:53.340
settings here you can see that you got in and out of uh gray there the tricky

00:06:51.000 --> 00:06:59.819
part about chroma keying and this has existed forever is that it's a balance

00:06:57.120 --> 00:07:04.800
of taking things away but also keeping the things that you want in there right

00:07:02.240 --> 00:07:10.620
and when you adjust something like Veil it's flipping the lights are blacks when

00:07:08.039 --> 00:07:18.419
something is in the gray here naturally like hair that can get lost yeah okay

00:07:14.100 --> 00:07:20.699
but we can fix that yes good I mean like

00:07:18.419 --> 00:07:27.360
right now it's looking pretty good we have some Buzz because we've taken a bit

00:07:24.240 --> 00:07:29.940
too much your hair is the worst to

00:07:27.360 --> 00:07:33.479
handle for this so what I'm looking for is

00:07:31.199 --> 00:07:40.440
different angles to see if there aren't any issues uh cropping up especially on

00:07:37.380 --> 00:07:42.780
the edges of his head where the hair you

00:07:40.440 --> 00:07:49.500
know likes to be wispy and stick out they're very likely to get cut out and

00:07:47.039 --> 00:07:54.780
look just blocky that's actually really good yeah I'm convinced what else do we

00:07:52.139 --> 00:07:58.319
need to adjust realistically with what this is looking like right now we don't

00:07:56.819 --> 00:08:03.539
have to change anything yeah play around with some stuff to change though we want to show off the software one thing we

00:08:01.199 --> 00:08:08.340
can adjust here because our screen is actually not perfect it's wrinkly and

00:08:06.180 --> 00:08:14.460
it's not perfectly lit in the corners you can see that here showing up yeah

00:08:10.860 --> 00:08:18.240
and we would use Shadow threshold to get

00:08:14.460 --> 00:08:21.120
rid of that what that's doing is oh up

00:08:18.240 --> 00:08:25.620
Shadow compensation it's very similar to Veil it's just setting a point where

00:08:23.280 --> 00:08:29.940
anything that's Brighter Than This the white but if we were to overdo that

00:08:27.660 --> 00:08:34.260
could we end up with um you know a reflection off of of

00:08:31.500 --> 00:08:39.419
Andy's skin turning background color too much and it turns like that yeah that's

00:08:36.719 --> 00:08:43.080
really yucky yeah let's bring back 30s Andy there's a vast number of other

00:08:41.640 --> 00:08:46.080
parameters that we can adjust here depending on the complexity of our

00:08:44.760 --> 00:08:50.940
production you can see Ed's doing a little bit of skin tone correction a little bit of color correction it can do

00:08:49.140 --> 00:08:55.320
that in Hardware it can also handle spill correction so if Andy was standing

00:08:52.800 --> 00:08:59.100
on a green floor as well he'd obviously have a lot more green light reflecting

00:08:56.880 --> 00:09:04.800
on him we can compensate for that it can even add his shadow back in so it can

00:09:02.459 --> 00:09:08.820
find where his shadow would be from the studio Lighting on the green floor key

00:09:06.959 --> 00:09:12.300
out the green floor but leave that shadow in place on the final composite

00:09:10.800 --> 00:09:16.860
now once the settings are dialed in what's great about this is we can just

00:09:14.459 --> 00:09:20.760
shoot and send the composite off to the editor who edits it as if it wasn't shot

00:09:19.380 --> 00:09:27.240
on a green screen in the first place that is super cool and could save us a

00:09:24.540 --> 00:09:32.820
ton of time like even with with lighting changes it should work pretty well

00:09:30.120 --> 00:09:39.420
because it has a feature where it captures just the background so that

00:09:36.000 --> 00:09:41.279
anything that isn't the background you

00:09:39.420 --> 00:09:45.360
know gets left in you might think hey and what's the point I'm chroma keying

00:09:43.740 --> 00:09:49.080
I'm not sure because they don't really explain that

00:09:46.860 --> 00:09:53.399
okay so what's happening now so what's happening is it took that capture right

00:09:52.560 --> 00:09:58.980
yeah and is saying okay this is the green

00:09:55.680 --> 00:10:01.800
screen so anything not this is supposed

00:09:58.980 --> 00:10:06.720
to be keyed out you basically get a plate of your green screen and tell it

00:10:05.459 --> 00:10:14.160
hey that's what it's supposed to look like yeah that is amazing using the

00:10:11.100 --> 00:10:16.860
green screen capture and then using a

00:10:14.160 --> 00:10:21.360
difference mode right yeah and go on okay so this is the difference don't wow

00:10:19.320 --> 00:10:25.640
don't cute so if you're on a static background actually your background

00:10:22.560 --> 00:10:25.640
could be just about anything

00:10:29.160 --> 00:10:35.279
I mean can we try it can you just turn that camera a few degrees to me does it

00:10:33.600 --> 00:10:39.959
need to be locked off okay yeah so just turn it over here oh my goodness okay so

00:10:37.800 --> 00:10:45.600
then yeah I'll move and then do the thing and then I go back in

00:10:43.019 --> 00:10:49.100
okay that does not work very well the other like it works better than I

00:10:47.459 --> 00:10:55.700
thought it would but that doesn't explain how we moved

00:10:52.680 --> 00:10:59.100
around inside of our virtual set earlier

00:10:55.700 --> 00:11:01.680
this is super cool instead of building a

00:10:59.100 --> 00:11:06.480
set and then shooting a plate or a static 2D shot to put our host in front

00:11:04.200 --> 00:11:11.579
of the game link set was designed in Unreal Engine meaning that like in a

00:11:09.240 --> 00:11:16.800
video game you can render it from any angle simply by moving your virtual

00:11:13.920 --> 00:11:21.420
camera the big trick then is to match the movement of the virtual camera to

00:11:19.320 --> 00:11:25.500
the real one now in the past this required meticulous planning and

00:11:23.399 --> 00:11:29.700
choreography between the film Crews and the post-production teams but recent

00:11:27.720 --> 00:11:35.279
advancements allow us to track our camera motion and then export that 3D

00:11:32.640 --> 00:11:40.079
movement data directly into Unreal Engine the baller way to do this is with

00:11:37.380 --> 00:11:44.760
a giant high resolution video wall like on the Mandalorian but ain't nobody got

00:11:42.420 --> 00:11:50.100
money for that fortunately virtual production has blown up into a massive

00:11:47.579 --> 00:11:53.700
market and the leftover Chum from the sharks at the top starting to trickle

00:11:51.959 --> 00:11:58.740
down to us little deep sea Guppies instead of requiring a massive high

00:11:55.800 --> 00:12:02.760
resolution screen we can use their Unreal Engine tricks to make a high-tech

00:12:01.500 --> 00:12:06.480
set that can pack away into an LTT backpack

00:12:05.040 --> 00:12:11.459
but how do we get the camera movement from

00:12:08.880 --> 00:12:15.660
The Real World translated into our virtual world

00:12:13.079 --> 00:12:20.700
did you spot these QR code looking things earlier they're alignment markers

00:12:18.180 --> 00:12:24.899
to make a convincing composite it's imperative that you match the camera's

00:12:22.560 --> 00:12:29.100
movement with the backdrop perfectly and to do that you have to establish an

00:12:26.760 --> 00:12:33.120
exact starting position then from there there are a number of different ways to

00:12:31.320 --> 00:12:38.339
track the physical camera's movement from that starting position the ideal

00:12:36.180 --> 00:12:42.899
solution would be to make use of five Mars trackers these are essentially the

00:12:40.680 --> 00:12:46.380
third generation Vive body trackers that folks have been using for full body

00:12:44.220 --> 00:12:50.160
tracking and applications like VR chat what makes these ones special is that

00:12:48.420 --> 00:12:54.899
they hook up to a special transmitter that sends data to a monitor and allows

00:12:53.100 --> 00:12:59.160
you to sync time code with your camera so that your motion data and your shots

00:12:56.700 --> 00:13:03.959
are temporally and physically aligned the downside is the kit costs five

00:13:01.740 --> 00:13:08.459
thousand dollars fortunately there are cheaper Solutions in fact you might even

00:13:06.300 --> 00:13:14.579
be holding one in your hand right now Apple's AR kit allows us to use the

00:13:11.100 --> 00:13:17.279
Myriad sensors on the iPhone to lamb or

00:13:14.579 --> 00:13:21.720
simultaneous localization and mapping in a nutshell by attaching this to our

00:13:19.620 --> 00:13:25.500
camera rig we can collect accurate motion data for our camera if you're an

00:13:23.519 --> 00:13:28.980
Android User you may also be able to take advantage of AR core but we can't

00:13:27.480 --> 00:13:33.240
speak to how well that works we ended up using an iPhone now that we have our

00:13:30.660 --> 00:13:37.560
tracking data we can export that and import it into Unreal Engine as movement

00:13:35.399 --> 00:13:41.700
for our virtual camera to really sell the illusion you also need to match all

00:13:40.019 --> 00:13:45.180
of your camera settings so your focal length your lens size

00:13:43.260 --> 00:13:49.260
Etc you line up the movement with your set and then you end up with what we

00:13:47.040 --> 00:13:55.079
showed off in our intro not gonna lie while this 3D camera position matching

00:13:52.380 --> 00:13:59.279
can be done in real time we set out to build a workflow for a bi-weekly YouTube

00:13:57.060 --> 00:14:03.480
news show so everything you're seeing now was done in post but we just wanted

00:14:01.620 --> 00:14:08.700
to show off what could be done on a budget of a sheet of green cloth an

00:14:06.000 --> 00:14:12.000
iPhone and a computer but even though we'll be sticking with a static camera

00:14:10.019 --> 00:14:16.920
for game length at least for now I'm sure we're going to find some opportunity opportunities to use these

00:14:14.519 --> 00:14:21.120
new capabilities and who knows maybe you will too like how cool would it be if we

00:14:19.079 --> 00:14:26.220
wanted to film at Sunrise whenever we wanted to oh speaking of widgets day

00:14:23.940 --> 00:14:30.240
that it is which means game length will be posted soon quick go subscribe to the

00:14:28.740 --> 00:14:36.720
new channel everyone's going to be there like James and Riley and rush and me and

00:14:33.839 --> 00:14:40.100
our sponsor ground news as an LTT viewer you probably know about the effect that

00:14:38.279 --> 00:14:44.399
algorithms have on what you see online outrage gets clicks and it can crowd out

00:14:42.899 --> 00:14:47.519
the information that actually matters like where's the coverage of Linus's

00:14:46.199 --> 00:14:54.480
social post about which smart home company is screwing them over currently this is bull spit enter ground news

00:14:52.019 --> 00:14:58.320
their app and website gather thousands of sources from across the political

00:14:55.980 --> 00:15:01.680
spectrum and the globe in one place so you can compare coverage it's real

00:15:00.060 --> 00:15:06.420
simple here's a story about the Reddit CEO's response to mods leading a

00:15:03.839 --> 00:15:10.620
blackout to protest API changes the story was covered by just 12 sources and

00:15:08.699 --> 00:15:13.860
most of them lean left with absolutely no coverage on the right it's

00:15:12.180 --> 00:15:18.000
interesting to see how different Outlets frame the same issue by simply comparing

00:15:16.079 --> 00:15:21.660
the headlines it's also great at finding International perspectives and stories

00:15:19.680 --> 00:15:25.560
that media outlets in the US don't give as much coverage to you can use their

00:15:23.399 --> 00:15:29.220
map feature to see the major events taking place around the globe ground

00:15:27.360 --> 00:15:32.579
news is a really cool platform that puts you in the driver's seat instead of an

00:15:30.899 --> 00:15:37.680
algorithm so you can make informed decisions about what to read watch and

00:15:34.860 --> 00:15:41.339
share go to ground.new slash Linus to sign up for free or subscribe on the

00:15:39.360 --> 00:15:45.300
ground News website using our link to get 30 off unlimited access if you

00:15:43.980 --> 00:15:48.779
enjoyed this video go check out GameLinked or if you're more into the tech

00:15:47.160 --> 00:15:53.909
side of things check out the time we shot a 500 megapixel photo