{"video_id":"wTh5zE4oTM4","title":"Ultimate Robot Companion? - Anki Cozmo Showcase","channel":"Linus Tech Tips","show":"Linus Tech Tips","published_at":"2017-05-06T14:53:29Z","duration_s":382,"segments":[{"start_s":0.08,"end_s":5.2,"text":"We're here at Ani to check out their new Cosmo, a fun and highly interactive","speaker":null,"is_sponsor":0},{"start_s":3.6,"end_s":9.2,"text":"little robot that functions both as a toy and a pet. Heard that before and","speaker":null,"is_sponsor":0},{"start_s":7.68,"end_s":12.639,"text":"been disappointed? I think you'll be pleasantly surprised this time as they","speaker":null,"is_sponsor":0},{"start_s":10.719,"end_s":16.48,"text":"didn't just use a team of highly skilled engineers, but they also worked with","speaker":null,"is_sponsor":0},{"start_s":14.719,"end_s":20.32,"text":"people that used to work at DreamWorks and Pixar to do the animations and game","speaker":null,"is_sponsor":0},{"start_s":18.96,"end_s":24.24,"text":"design. This creates a dynamic combination of","speaker":null,"is_sponsor":0},{"start_s":22.08,"end_s":28.64,"text":"artificial intelligence, interactive content, animatronics, along with vision","speaker":null,"is_sponsor":0},{"start_s":26.72,"end_s":33.84,"text":"and sensing technologies that create not just an awesome robot, but a personality","speaker":null,"is_sponsor":0},{"start_s":31.599,"end_s":39.76,"text":"or a character. Now, let's go meet Cosmo. This is Cosmo. And he's not","speaker":null,"is_sponsor":0},{"start_s":37.2,"end_s":44.879,"text":"perfect, but he isn't intended to be. He's designed after a flawed but lovable","speaker":null,"is_sponsor":0},{"start_s":42.0,"end_s":49.2,"text":"little hero. R2-D2 and BB-8 aren't the most advanced droids in the Star Wars","speaker":null,"is_sponsor":0},{"start_s":47.039,"end_s":54.719,"text":"universe, but you love them because they have character like Cosmo. Cozmo can","speaker":null,"is_sponsor":0},{"start_s":52.239,"end_s":57.719,"text":"detect who you are and greet you like this.","speaker":null,"is_sponsor":0},{"start_s":58.16,"end_s":67.04,"text":"And he has emotions like confidence, excitement, happiness, bravery, and","speaker":null,"is_sponsor":0},{"start_s":63.28,"end_s":68.96,"text":"more. Sometimes he will fail and he will","speaker":null,"is_sponsor":0},{"start_s":67.04,"end_s":72.72,"text":"complain about that. or you'll be playing a game with him and he will","speaker":null,"is_sponsor":0},{"start_s":70.159,"end_s":77.119,"text":"respond happily or sadly depending on if he is winning or losing. He gets","speaker":null,"is_sponsor":0},{"start_s":75.28,"end_s":83.28,"text":"surprised when he encounters new people or objects or even the ever dreaded","speaker":null,"is_sponsor":0},{"start_s":79.68,"end_s":85.2,"text":"table ledge. He feels real. It's kind of","speaker":null,"is_sponsor":0},{"start_s":83.28,"end_s":89.439,"text":"like playing with a dog. Sure, playing the game. Like throwing a stick or ball","speaker":null,"is_sponsor":0},{"start_s":87.119,"end_s":94.4,"text":"is somewhat entertaining, but the really fun part is interacting with the dog.","speaker":null,"is_sponsor":0},{"start_s":92.079,"end_s":98.56,"text":"The best part of Cosmo is well interacting with Cosmo. and the games","speaker":null,"is_sponsor":0},{"start_s":96.72,"end_s":102.96,"text":"are mostly a facilitator for that. Although I must say I did get a little","speaker":null,"is_sponsor":0},{"start_s":100.64,"end_s":106.0,"text":"competitive with the quicktap game. As you're just screwing around or","speaker":null,"is_sponsor":0},{"start_s":104.24,"end_s":110.799,"text":"completing daily goals, you will earn bits to upgrade Cosmo or unlock new","speaker":null,"is_sponsor":0},{"start_s":108.72,"end_s":115.6,"text":"games. And by the way, you'll never have to pay for these with real money, just","speaker":null,"is_sponsor":0},{"start_s":113.04,"end_s":119.52,"text":"easily acquirable in-game currency. And there should be a lot of them as the","speaker":null,"is_sponsor":0},{"start_s":117.119,"end_s":123.92,"text":"Anki team claims they have a multi-year road map for future upgrades. And along","speaker":null,"is_sponsor":0},{"start_s":121.92,"end_s":128.399,"text":"with that, you also get sparks, which are kind of like dog treats. They can be","speaker":null,"is_sponsor":0},{"start_s":125.84,"end_s":133.44,"text":"used to prompt Cosmo to show off and do a little trick. But as we were saying","speaker":null,"is_sponsor":0},{"start_s":130.879,"end_s":137.68,"text":"before, sometimes Cozmo will fail at these tasks that you have given him.","speaker":null,"is_sponsor":0},{"start_s":135.44,"end_s":142.879,"text":"Instead of acting like you might expect a robot to act by just repeatedly trying","speaker":null,"is_sponsor":0},{"start_s":140.08,"end_s":147.28,"text":"over and over again, Cozmo will get sad and lose confidence, resulting in him","speaker":null,"is_sponsor":0},{"start_s":145.36,"end_s":152.0,"text":"possibly trying the task in a different way or maybe even switching tasks","speaker":null,"is_sponsor":0},{"start_s":149.599,"end_s":157.599,"text":"altogether, yet again, making him feel more real. say he screws up big time and","speaker":null,"is_sponsor":0},{"start_s":154.959,"end_s":162.879,"text":"fails to recognize a table ledge causing him to fall off. First off, he's rather","speaker":null,"is_sponsor":0},{"start_s":160.64,"end_s":167.44,"text":"durable and should be fine. Secondly, however, he will express major","speaker":null,"is_sponsor":0},{"start_s":165.2,"end_s":172.319,"text":"displeasure. He will lack bravery and confidence for a while, just like a","speaker":null,"is_sponsor":0},{"start_s":169.28,"end_s":174.8,"text":"non-rootic being. On the flip side, when","speaker":null,"is_sponsor":0},{"start_s":172.319,"end_s":178.319,"text":"Cozmo is excitedly doing fun things and succeeding, he will check in with you","speaker":null,"is_sponsor":0},{"start_s":176.56,"end_s":182.56,"text":"from time to time, making eye contact, calling your name just like a happy kid","speaker":null,"is_sponsor":0},{"start_s":180.48,"end_s":186.959,"text":"would, and he'll go around and do a bunch of different things. Lots of what","speaker":null,"is_sponsor":0},{"start_s":184.4,"end_s":191.76,"text":"gives Cosmo this great personality, is subtle, as it should be. the emotional","speaker":null,"is_sponsor":0},{"start_s":189.44,"end_s":197.04,"text":"algorithms, huge library of animations, dynamic interaction, incredibly awesome","speaker":null,"is_sponsor":0},{"start_s":194.4,"end_s":201.44,"text":"eyes if you haven't noticed, and even a soundtrack. They aren't necessarily","speaker":null,"is_sponsor":0},{"start_s":199.84,"end_s":205.599,"text":"things you would actively think about, but together they make a wonderful","speaker":null,"is_sponsor":0},{"start_s":203.44,"end_s":209.68,"text":"experience. Now, let's look more in depth at what's happening under the","speaker":null,"is_sponsor":0},{"start_s":207.2,"end_s":214.319,"text":"hood. Most of the computational power for Cosmo, including AI, computer","speaker":null,"is_sponsor":0},{"start_s":211.84,"end_s":219.04,"text":"vision, etc., is done through your phone, meaning you need to be connected","speaker":null,"is_sponsor":0},{"start_s":216.239,"end_s":223.28,"text":"at all times to Cosmo's Wi-Fi network. So, just as a note, this does mean you","speaker":null,"is_sponsor":0},{"start_s":221.599,"end_s":228.64,"text":"won't be connected to the internet on your phone. While this does sort of suck","speaker":null,"is_sponsor":0},{"start_s":226.0,"end_s":233.44,"text":"to be honest, this is good for another reason, which is very possibly more","speaker":null,"is_sponsor":0},{"start_s":230.959,"end_s":238.4,"text":"important to you. You're always offline, meaning that no pictures or video are","speaker":null,"is_sponsor":0},{"start_s":235.599,"end_s":243.04,"text":"taken. No voice is recorded. Your private conversations with Cosmo or","speaker":null,"is_sponsor":0},{"start_s":240.319,"end_s":247.76,"text":"things that he sees and hears are yours and don't go anywhere else. This also","speaker":null,"is_sponsor":0},{"start_s":245.439,"end_s":252.159,"text":"means that as your phone becomes better, Cosmo can too. With various software","speaker":null,"is_sponsor":0},{"start_s":250.239,"end_s":257.28,"text":"upgrades, you can enhance Cosmo's activities, behaviors, and interactions.","speaker":null,"is_sponsor":0},{"start_s":255.2,"end_s":261.28,"text":"Anki has a multi-year road map, as we mentioned earlier, for future upgrades.","speaker":null,"is_sponsor":0},{"start_s":259.28,"end_s":265.68,"text":"But if you want to make your own or rely on other people's creations, they offer","speaker":null,"is_sponsor":0},{"start_s":263.28,"end_s":269.68,"text":"an extensive Python SDK with great documentation available at","speaker":null,"is_sponsor":0},{"start_s":267.28,"end_s":273.68,"text":"developer.onkey.com. Robotics programming has a crazy","speaker":null,"is_sponsor":0},{"start_s":271.6,"end_s":278.24,"text":"learning curve. Computer vision, path planning, 3D world modeling. All these","speaker":null,"is_sponsor":0},{"start_s":276.0,"end_s":282.479,"text":"things are highly difficult and this API can make them easy with simple imports","speaker":null,"is_sponsor":0},{"start_s":280.4,"end_s":286.16,"text":"and function calls. And if you're more interested in the artsy animation side","speaker":null,"is_sponsor":0},{"start_s":284.16,"end_s":292.639,"text":"of things, however, do not fear. There will be a Maya animation kit with JSON","speaker":null,"is_sponsor":0},{"start_s":289.04,"end_s":296.24,"text":"output available later on. Now, Cosmo is","speaker":null,"is_sponsor":0},{"start_s":292.639,"end_s":298.88,"text":"made up of 320 individual components,","speaker":null,"is_sponsor":0},{"start_s":296.24,"end_s":303.919,"text":"and it took 45 entire mechanical iterations to achieve his final form. In","speaker":null,"is_sponsor":0},{"start_s":302.16,"end_s":308.96,"text":"the end, for computer vision, they ended up with a forward-facing camera and a","speaker":null,"is_sponsor":0},{"start_s":306.4,"end_s":314.24,"text":"cliff sensor. The cliff sensor is on the bottom of Cosmo and will mainly be used","speaker":null,"is_sponsor":0},{"start_s":311.52,"end_s":319.36,"text":"to keep him from falling off of tables. The camera is used to detect faces and","speaker":null,"is_sponsor":0},{"start_s":316.639,"end_s":323.919,"text":"familiar objects with QR code style identifiable images on them. Having a","speaker":null,"is_sponsor":0},{"start_s":321.759,"end_s":328.8,"text":"standard size for these images enables Cosmo to detect how far away they are","speaker":null,"is_sponsor":0},{"start_s":326.24,"end_s":333.12,"text":"and if they're on an angle, which is great, but for things he doesn't know","speaker":null,"is_sponsor":0},{"start_s":330.88,"end_s":337.6,"text":"about, he can use the camera to map them into his environment so he knows to stay","speaker":null,"is_sponsor":0},{"start_s":335.12,"end_s":342.479,"text":"away lest he bump into them. A lot of this tech is in place to avoid what is","speaker":null,"is_sponsor":0},{"start_s":339.84,"end_s":345.84,"text":"called robot kidnapping or the idea of picking up Cosmo and putting him","speaker":null,"is_sponsor":0},{"start_s":344.24,"end_s":350.479,"text":"somewhere else, screwing up his carefully constructed map. He will then","speaker":null,"is_sponsor":0},{"start_s":348.08,"end_s":354.88,"text":"be able to find objects that he is used to seeing, like one of the boxes that","speaker":null,"is_sponsor":0},{"start_s":352.56,"end_s":358.72,"text":"has a QR code on it, map its position in the space, and then try to figure out","speaker":null,"is_sponsor":0},{"start_s":356.4,"end_s":363.919,"text":"where he's at. It's a smart little way to make him not be constantly constantly","speaker":null,"is_sponsor":0},{"start_s":362.16,"end_s":367.919,"text":"confused while you're interacting with him. Now, put all of that together into","speaker":null,"is_sponsor":0},{"start_s":366.16,"end_s":370.96,"text":"a cute little robot along with all the things I mentioned earlier, and you've","speaker":null,"is_sponsor":0},{"start_s":369.36,"end_s":374.24,"text":"got a gifted little guy with a huge amount of tricks under his sleeve. He's","speaker":null,"is_sponsor":0},{"start_s":372.56,"end_s":378.72,"text":"mischievous and a lot of fun, and I'm excited to check them out when they start shipping to Canada and other","speaker":null,"is_sponsor":0},{"start_s":376.639,"end_s":382.039,"text":"places outside the US. If you are too, go to an.com/cosmo.","speaker":null,"is_sponsor":0}],"full_text":"We're here at Ani to check out their new Cosmo, a fun and highly interactive little robot that functions both as a toy and a pet. Heard that before and been disappointed? I think you'll be pleasantly surprised this time as they didn't just use a team of highly skilled engineers, but they also worked with people that used to work at DreamWorks and Pixar to do the animations and game design. This creates a dynamic combination of artificial intelligence, interactive content, animatronics, along with vision and sensing technologies that create not just an awesome robot, but a personality or a character. Now, let's go meet Cosmo. This is Cosmo. And he's not perfect, but he isn't intended to be. He's designed after a flawed but lovable little hero. R2-D2 and BB-8 aren't the most advanced droids in the Star Wars universe, but you love them because they have character like Cosmo. Cozmo can detect who you are and greet you like this. And he has emotions like confidence, excitement, happiness, bravery, and more. Sometimes he will fail and he will complain about that. or you'll be playing a game with him and he will respond happily or sadly depending on if he is winning or losing. He gets surprised when he encounters new people or objects or even the ever dreaded table ledge. He feels real. It's kind of like playing with a dog. Sure, playing the game. Like throwing a stick or ball is somewhat entertaining, but the really fun part is interacting with the dog. The best part of Cosmo is well interacting with Cosmo. and the games are mostly a facilitator for that. Although I must say I did get a little competitive with the quicktap game. As you're just screwing around or completing daily goals, you will earn bits to upgrade Cosmo or unlock new games. And by the way, you'll never have to pay for these with real money, just easily acquirable in-game currency. And there should be a lot of them as the Anki team claims they have a multi-year road map for future upgrades. And along with that, you also get sparks, which are kind of like dog treats. They can be used to prompt Cosmo to show off and do a little trick. But as we were saying before, sometimes Cozmo will fail at these tasks that you have given him. Instead of acting like you might expect a robot to act by just repeatedly trying over and over again, Cozmo will get sad and lose confidence, resulting in him possibly trying the task in a different way or maybe even switching tasks altogether, yet again, making him feel more real. say he screws up big time and fails to recognize a table ledge causing him to fall off. First off, he's rather durable and should be fine. Secondly, however, he will express major displeasure. He will lack bravery and confidence for a while, just like a non-rootic being. On the flip side, when Cozmo is excitedly doing fun things and succeeding, he will check in with you from time to time, making eye contact, calling your name just like a happy kid would, and he'll go around and do a bunch of different things. Lots of what gives Cosmo this great personality, is subtle, as it should be. the emotional algorithms, huge library of animations, dynamic interaction, incredibly awesome eyes if you haven't noticed, and even a soundtrack. They aren't necessarily things you would actively think about, but together they make a wonderful experience. Now, let's look more in depth at what's happening under the hood. Most of the computational power for Cosmo, including AI, computer vision, etc., is done through your phone, meaning you need to be connected at all times to Cosmo's Wi-Fi network. So, just as a note, this does mean you won't be connected to the internet on your phone. While this does sort of suck to be honest, this is good for another reason, which is very possibly more important to you. You're always offline, meaning that no pictures or video are taken. No voice is recorded. Your private conversations with Cosmo or things that he sees and hears are yours and don't go anywhere else. This also means that as your phone becomes better, Cosmo can too. With various software upgrades, you can enhance Cosmo's activities, behaviors, and interactions. Anki has a multi-year road map, as we mentioned earlier, for future upgrades. But if you want to make your own or rely on other people's creations, they offer an extensive Python SDK with great documentation available at developer.onkey.com. Robotics programming has a crazy learning curve. Computer vision, path planning, 3D world modeling. All these things are highly difficult and this API can make them easy with simple imports and function calls. And if you're more interested in the artsy animation side of things, however, do not fear. There will be a Maya animation kit with JSON output available later on. Now, Cosmo is made up of 320 individual components, and it took 45 entire mechanical iterations to achieve his final form. In the end, for computer vision, they ended up with a forward-facing camera and a cliff sensor. The cliff sensor is on the bottom of Cosmo and will mainly be used to keep him from falling off of tables. The camera is used to detect faces and familiar objects with QR code style identifiable images on them. Having a standard size for these images enables Cosmo to detect how far away they are and if they're on an angle, which is great, but for things he doesn't know about, he can use the camera to map them into his environment so he knows to stay away lest he bump into them. A lot of this tech is in place to avoid what is called robot kidnapping or the idea of picking up Cosmo and putting him somewhere else, screwing up his carefully constructed map. He will then be able to find objects that he is used to seeing, like one of the boxes that has a QR code on it, map its position in the space, and then try to figure out where he's at. It's a smart little way to make him not be constantly constantly confused while you're interacting with him. Now, put all of that together into a cute little robot along with all the things I mentioned earlier, and you've got a gifted little guy with a huge amount of tricks under his sleeve. He's mischievous and a lot of fun, and I'm excited to check them out when they start shipping to Canada and other places outside the US. If you are too, go to an.com/cosmo."}