[Script Info] Title: [Events] Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text Dialogue: 0,0:00:00.63,0:00:03.09,Default,,0000,0000,0000,,My job is to design, build and study Dialogue: 0,0:00:03.09,0:00:05.08,Default,,0000,0000,0000,,robots that communicate with people. Dialogue: 0,0:00:05.08,0:00:06.64,Default,,0000,0000,0000,,But this story doesn't start with robotics at all, Dialogue: 0,0:00:06.64,0:00:08.53,Default,,0000,0000,0000,,it starts with animation. Dialogue: 0,0:00:08.53,0:00:11.12,Default,,0000,0000,0000,,When I first saw Pixar's Luxo Jr., Dialogue: 0,0:00:11.12,0:00:13.10,Default,,0000,0000,0000,,I was amazed by how much emotion Dialogue: 0,0:00:13.10,0:00:14.86,Default,,0000,0000,0000,,they could put into something Dialogue: 0,0:00:14.86,0:00:17.45,Default,,0000,0000,0000,,as trivial as a desk lamp. Dialogue: 0,0:00:17.45,0:00:19.28,Default,,0000,0000,0000,,I mean look at them -- at the end of this movie, Dialogue: 0,0:00:19.28,0:00:21.79,Default,,0000,0000,0000,,you actually feel something for two pieces of furniture. Dialogue: 0,0:00:21.79,0:00:23.62,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:00:23.62,0:00:25.74,Default,,0000,0000,0000,,And I said, I have to learn how to do this. Dialogue: 0,0:00:25.74,0:00:29.27,Default,,0000,0000,0000,,So I made a really bad career decision. (Laughter) Dialogue: 0,0:00:29.27,0:00:31.68,Default,,0000,0000,0000,,And that's what my mom was like when I did it. Dialogue: 0,0:00:31.68,0:00:33.69,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:00:33.69,0:00:35.87,Default,,0000,0000,0000,,I left a very quasi-tech job in Israel Dialogue: 0,0:00:35.87,0:00:38.47,Default,,0000,0000,0000,,with an iSoftware company and I moved to New York Dialogue: 0,0:00:38.47,0:00:39.48,Default,,0000,0000,0000,,to study animation. Dialogue: 0,0:00:39.48,0:00:40.64,Default,,0000,0000,0000,,And there I lived Dialogue: 0,0:00:40.64,0:00:43.64,Default,,0000,0000,0000,,in a collapsing apartment building\Nin Harlem with roommates. Dialogue: 0,0:00:43.64,0:00:45.00,Default,,0000,0000,0000,,I'm not using this phrase metaphorically, Dialogue: 0,0:00:45.00,0:00:46.96,Default,,0000,0000,0000,,the ceiling actually collapsed one day Dialogue: 0,0:00:46.96,0:00:48.27,Default,,0000,0000,0000,,in our living room. (Laughter) Dialogue: 0,0:00:48.27,0:00:50.94,Default,,0000,0000,0000,,Whenever they did those news stories \Nabout building violations in New York,\N Dialogue: 0,0:00:50.94,0:00:53.18,Default,,0000,0000,0000,,they would put the report in front of our building. \N(Laughter) Dialogue: 0,0:00:53.18,0:00:56.78,Default,,0000,0000,0000,,As kind of like a backdrop \Nto show how bad things are. Dialogue: 0,0:00:56.78,0:00:58.73,Default,,0000,0000,0000,,Anyway, during the day I went to school and at night Dialogue: 0,0:00:58.73,0:01:02.25,Default,,0000,0000,0000,,I would sit and draw frame-by-frame \Nof pencil animation. Dialogue: 0,0:01:02.25,0:01:04.52,Default,,0000,0000,0000,,And I learned two surprising lessons -- Dialogue: 0,0:01:04.52,0:01:07.08,Default,,0000,0000,0000,,one of them was that Dialogue: 0,0:01:07.08,0:01:09.04,Default,,0000,0000,0000,,when you want to arouse emotions, Dialogue: 0,0:01:09.04,0:01:10.76,Default,,0000,0000,0000,,it doesn't matter so much how something looks, \N Dialogue: 0,0:01:10.76,0:01:13.11,Default,,0000,0000,0000,,it's all in the motion -- it's in the timing Dialogue: 0,0:01:13.11,0:01:14.72,Default,,0000,0000,0000,,of how the thing moves. Dialogue: 0,0:01:14.72,0:01:17.94,Default,,0000,0000,0000,,And the second, was something \None of our teachers told us. Dialogue: 0,0:01:17.94,0:01:20.35,Default,,0000,0000,0000,,He actually did the weasel in Ice Age. Dialogue: 0,0:01:20.35,0:01:21.74,Default,,0000,0000,0000,,And he said: Dialogue: 0,0:01:21.74,0:01:24.90,Default,,0000,0000,0000,,"As an animator you are not a director, you're an actor." Dialogue: 0,0:01:24.90,0:01:27.88,Default,,0000,0000,0000,,So, if you want to find the right motion for a character, Dialogue: 0,0:01:27.88,0:01:30.23,Default,,0000,0000,0000,,don't think about it, go use your body to find it -- Dialogue: 0,0:01:30.23,0:01:31.86,Default,,0000,0000,0000,,stand in front of a mirror, act it out Dialogue: 0,0:01:31.86,0:01:33.56,Default,,0000,0000,0000,,in front of a camera -- whatever you need. Dialogue: 0,0:01:33.56,0:01:36.46,Default,,0000,0000,0000,,And then put it back in your character. Dialogue: 0,0:01:36.46,0:01:38.62,Default,,0000,0000,0000,,A year later I found myself at MIT Dialogue: 0,0:01:38.62,0:01:40.77,Default,,0000,0000,0000,,in the robotic life group, it was one of the first groups Dialogue: 0,0:01:40.77,0:01:43.41,Default,,0000,0000,0000,,researching the relationships \Nbetween humans and robots. Dialogue: 0,0:01:43.41,0:01:45.35,Default,,0000,0000,0000,,And I still had this dream to make Dialogue: 0,0:01:45.35,0:01:48.06,Default,,0000,0000,0000,,an actual, physical Luxo Jr. lamp. Dialogue: 0,0:01:48.06,0:01:49.63,Default,,0000,0000,0000,,But I found that robots didn't move at all Dialogue: 0,0:01:49.63,0:01:50.91,Default,,0000,0000,0000,,in this engaging way that I was used to Dialogue: 0,0:01:50.91,0:01:52.54,Default,,0000,0000,0000,,for my animation studies. Dialogue: 0,0:01:52.54,0:01:54.76,Default,,0000,0000,0000,,Instead, they were all -- Dialogue: 0,0:01:54.76,0:01:57.26,Default,,0000,0000,0000,,how should I put it, they were all kind of robotic. Dialogue: 0,0:01:57.26,0:01:59.15,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:01:59.15,0:02:02.79,Default,,0000,0000,0000,,And I thought what if I took whatever \NI learned in animation school, Dialogue: 0,0:02:02.79,0:02:05.46,Default,,0000,0000,0000,,and used that to design my robotic desk lamp. Dialogue: 0,0:02:05.46,0:02:07.54,Default,,0000,0000,0000,,So I went and designed frame-by-frame Dialogue: 0,0:02:07.54,0:02:09.39,Default,,0000,0000,0000,,to try to make this robot Dialogue: 0,0:02:09.39,0:02:12.05,Default,,0000,0000,0000,,as graceful and engaging as possible. Dialogue: 0,0:02:12.05,0:02:14.09,Default,,0000,0000,0000,,And here when you see the robot interacting with me Dialogue: 0,0:02:14.09,0:02:15.72,Default,,0000,0000,0000,,on a desktop. Dialogue: 0,0:02:15.72,0:02:17.93,Default,,0000,0000,0000,,And I'm actually really [unclear] the robot so, Dialogue: 0,0:02:17.93,0:02:19.73,Default,,0000,0000,0000,,unbenounced to itself, Dialogue: 0,0:02:19.73,0:02:22.42,Default,,0000,0000,0000,,it's kind of digging its own grave by helping me. Dialogue: 0,0:02:22.42,0:02:24.45,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:02:24.45,0:02:26.42,Default,,0000,0000,0000,,I wanted it to be less of a mechanical structure Dialogue: 0,0:02:26.42,0:02:27.71,Default,,0000,0000,0000,,giving me light, Dialogue: 0,0:02:27.71,0:02:30.75,Default,,0000,0000,0000,,and more of a helpful, kind of quiet apprentice Dialogue: 0,0:02:30.75,0:02:33.95,Default,,0000,0000,0000,,that's always there when you need \Nit and doesn't really interfere. Dialogue: 0,0:02:33.95,0:02:35.62,Default,,0000,0000,0000,,And when, for example, I'm looking for a battery Dialogue: 0,0:02:35.62,0:02:37.16,Default,,0000,0000,0000,,that I can't find, Dialogue: 0,0:02:37.16,0:02:41.75,Default,,0000,0000,0000,,in a subtle way, it will show me where the battery is. Dialogue: 0,0:02:41.75,0:02:44.32,Default,,0000,0000,0000,,So you can see my confusion here. Dialogue: 0,0:02:44.32,0:02:48.58,Default,,0000,0000,0000,,I'm not an actor. Dialogue: 0,0:02:48.58,0:02:50.03,Default,,0000,0000,0000,,And I want you to notice how the same Dialogue: 0,0:02:50.03,0:02:52.00,Default,,0000,0000,0000,,mechanical structure can at one point, Dialogue: 0,0:02:52.00,0:02:55.00,Default,,0000,0000,0000,,just by the way it moves seem gentle and caring -- Dialogue: 0,0:02:55.00,0:02:58.24,Default,,0000,0000,0000,,and the other case, seem violent and confrontational. Dialogue: 0,0:02:58.24,0:03:01.55,Default,,0000,0000,0000,,And it's the same structure, \Njust the motion is different. Dialogue: 0,0:03:07.03,0:03:12.01,Default,,0000,0000,0000,,Actor: "You want to know something? \NWell, you want to know something? Dialogue: 0,0:03:12.01,0:03:13.84,Default,,0000,0000,0000,,He was already dead! Dialogue: 0,0:03:13.84,0:03:17.85,Default,,0000,0000,0000,,Just lay there, eyes glazed over!" Dialogue: 0,0:03:17.85,0:03:18.86,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:03:18.86,0:03:22.76,Default,,0000,0000,0000,,But, moving in graceful ways is just one \Nbuilding block of this whole structure Dialogue: 0,0:03:22.76,0:03:24.34,Default,,0000,0000,0000,,called human-robot interaction. Dialogue: 0,0:03:24.34,0:03:25.83,Default,,0000,0000,0000,,I was at the time doing my PHD, Dialogue: 0,0:03:25.83,0:03:27.100,Default,,0000,0000,0000,,I was working on human robot teamwork; Dialogue: 0,0:03:27.100,0:03:30.00,Default,,0000,0000,0000,,teams of humans and robots working together. Dialogue: 0,0:03:30.00,0:03:31.33,Default,,0000,0000,0000,,I was studying the engineering, Dialogue: 0,0:03:31.33,0:03:34.12,Default,,0000,0000,0000,,the psychology, the philosophy of teamwork. Dialogue: 0,0:03:34.12,0:03:35.58,Default,,0000,0000,0000,,And at the same time I found myself Dialogue: 0,0:03:35.58,0:03:37.44,Default,,0000,0000,0000,,in my own kind of teamwork situation Dialogue: 0,0:03:37.44,0:03:39.66,Default,,0000,0000,0000,,with a good friend of mine who is actually here. Dialogue: 0,0:03:39.66,0:03:42.27,Default,,0000,0000,0000,,And in that situation we can easily imagine robots Dialogue: 0,0:03:42.27,0:03:44.37,Default,,0000,0000,0000,,in the near future being there with us. Dialogue: 0,0:03:44.37,0:03:46.21,Default,,0000,0000,0000,,It was after Passover Seder. Dialogue: 0,0:03:46.21,0:03:48.05,Default,,0000,0000,0000,,We were folding up a lot of folding chairs, Dialogue: 0,0:03:48.05,0:03:50.99,Default,,0000,0000,0000,,and I was amazed at how quickly \Nwe found our own rhythm. Dialogue: 0,0:03:50.99,0:03:52.55,Default,,0000,0000,0000,,Everybody did their own part. Dialogue: 0,0:03:52.55,0:03:54.18,Default,,0000,0000,0000,,We didn't have to divide our tasks. Dialogue: 0,0:03:54.18,0:03:56.28,Default,,0000,0000,0000,,We didn't have to communicate verbally about this. Dialogue: 0,0:03:56.28,0:03:57.89,Default,,0000,0000,0000,,It all just happened. Dialogue: 0,0:03:57.89,0:03:58.78,Default,,0000,0000,0000,,And I thought, Dialogue: 0,0:03:58.78,0:04:00.63,Default,,0000,0000,0000,,humans and robots don't look at all like this. Dialogue: 0,0:04:00.63,0:04:02.30,Default,,0000,0000,0000,,When humans and robots interact, Dialogue: 0,0:04:02.30,0:04:03.50,Default,,0000,0000,0000,,it's much more like a chess game. Dialogue: 0,0:04:03.50,0:04:04.76,Default,,0000,0000,0000,,The human does a thing, Dialogue: 0,0:04:04.76,0:04:06.64,Default,,0000,0000,0000,,the robot analyzes whatever the human did, Dialogue: 0,0:04:06.64,0:04:08.17,Default,,0000,0000,0000,,then the robot decides what to do next, Dialogue: 0,0:04:08.17,0:04:09.34,Default,,0000,0000,0000,,plans it and does it. Dialogue: 0,0:04:09.34,0:04:11.48,Default,,0000,0000,0000,,And then the human waits, until its their turn again. Dialogue: 0,0:04:11.48,0:04:12.66,Default,,0000,0000,0000,,So, it's much more like a chess game Dialogue: 0,0:04:12.66,0:04:14.58,Default,,0000,0000,0000,,and that makes sense because chess is great Dialogue: 0,0:04:14.58,0:04:16.40,Default,,0000,0000,0000,,for mathematicians and computer scientists. Dialogue: 0,0:04:16.40,0:04:18.65,Default,,0000,0000,0000,,It's all about information analysis, Dialogue: 0,0:04:18.65,0:04:21.50,Default,,0000,0000,0000,,decision making and planning. Dialogue: 0,0:04:21.50,0:04:25.19,Default,,0000,0000,0000,,But I wanted my robots to be less of a chess player, Dialogue: 0,0:04:25.19,0:04:26.86,Default,,0000,0000,0000,,and more like -- you know -- like a doer Dialogue: 0,0:04:26.86,0:04:29.18,Default,,0000,0000,0000,,that just clicks and works together. Dialogue: 0,0:04:29.18,0:04:32.57,Default,,0000,0000,0000,,So I made my second horrible career choice: Dialogue: 0,0:04:32.57,0:04:35.23,Default,,0000,0000,0000,,I decided to study acting for a semester. Dialogue: 0,0:04:35.23,0:04:38.09,Default,,0000,0000,0000,,I took off from a PHD, I went to acting classes. Dialogue: 0,0:04:38.09,0:04:40.04,Default,,0000,0000,0000,,I actually participated in a play, Dialogue: 0,0:04:40.04,0:04:43.34,Default,,0000,0000,0000,,I hope theres no video of that around still. (Laughter) Dialogue: 0,0:04:43.34,0:04:45.97,Default,,0000,0000,0000,,And I got every book I could find about acting. Dialogue: 0,0:04:45.97,0:04:47.94,Default,,0000,0000,0000,,Including one from the 19th century Dialogue: 0,0:04:47.94,0:04:49.01,Default,,0000,0000,0000,,that I got from the library. Dialogue: 0,0:04:49.01,0:04:52.47,Default,,0000,0000,0000,,And I was really amazed because \Nmy name was the second on the list -- Dialogue: 0,0:04:52.47,0:04:55.29,Default,,0000,0000,0000,,the previous name was in 1889. (Laughter) Dialogue: 0,0:04:55.29,0:04:57.00,Default,,0000,0000,0000,,And this book was kind of waiting for 100 years Dialogue: 0,0:04:57.00,0:05:00.19,Default,,0000,0000,0000,,to be rediscovered for robotics. Dialogue: 0,0:05:00.19,0:05:01.67,Default,,0000,0000,0000,,And this book shows actors Dialogue: 0,0:05:01.67,0:05:04.03,Default,,0000,0000,0000,,how to move every muscle in the body Dialogue: 0,0:05:04.03,0:05:06.74,Default,,0000,0000,0000,,to match every kind of emotion \Nthat they want to express. Dialogue: 0,0:05:06.74,0:05:08.57,Default,,0000,0000,0000,,But the real relevation was Dialogue: 0,0:05:08.57,0:05:09.91,Default,,0000,0000,0000,,when I learned about method acting. Dialogue: 0,0:05:09.91,0:05:12.19,Default,,0000,0000,0000,,It became very popular in the 20th century. Dialogue: 0,0:05:12.19,0:05:14.83,Default,,0000,0000,0000,,And method acting said, you don't have \Nto plan every muscle in your body. Dialogue: 0,0:05:14.83,0:05:17.50,Default,,0000,0000,0000,,Instead you have to use your body \Nto find the right movement. Dialogue: 0,0:05:17.50,0:05:19.68,Default,,0000,0000,0000,,You have to use your sense memory Dialogue: 0,0:05:19.68,0:05:21.54,Default,,0000,0000,0000,,to reconstruct the emotions and kind of Dialogue: 0,0:05:21.54,0:05:24.04,Default,,0000,0000,0000,,think with your body to find the right expression. Dialogue: 0,0:05:24.04,0:05:26.46,Default,,0000,0000,0000,,Improvise, play off yor scene partner. Dialogue: 0,0:05:26.46,0:05:29.71,Default,,0000,0000,0000,,And this came at the same time \Nas I was reading about this trend Dialogue: 0,0:05:29.71,0:05:32.80,Default,,0000,0000,0000,,in cognitive psychology called embodied cognition. Dialogue: 0,0:05:32.80,0:05:34.88,Default,,0000,0000,0000,,Which also talks about the same ideas -- Dialogue: 0,0:05:34.88,0:05:35.79,Default,,0000,0000,0000,,We use our bodies to think, Dialogue: 0,0:05:35.79,0:05:38.21,Default,,0000,0000,0000,,we don't just think with our brains \Nand use our bodies to move. Dialogue: 0,0:05:38.21,0:05:40.62,Default,,0000,0000,0000,,but our bodies feed back into our brain Dialogue: 0,0:05:40.62,0:05:42.96,Default,,0000,0000,0000,,to generate the way that we behave. Dialogue: 0,0:05:42.96,0:05:44.12,Default,,0000,0000,0000,,And it was like a lightning bolt. Dialogue: 0,0:05:44.12,0:05:45.36,Default,,0000,0000,0000,,I went back to my office. Dialogue: 0,0:05:45.36,0:05:48.08,Default,,0000,0000,0000,,I wrote this paper -- which I never really published Dialogue: 0,0:05:48.08,0:05:50.84,Default,,0000,0000,0000,,called "Acting Lessons for Artificial Intelligence." Dialogue: 0,0:05:50.84,0:05:52.23,Default,,0000,0000,0000,,And I even took another month Dialogue: 0,0:05:52.23,0:05:54.84,Default,,0000,0000,0000,,to do what was then the first theater play Dialogue: 0,0:05:54.84,0:05:56.70,Default,,0000,0000,0000,,with a human and a robot acting together. Dialogue: 0,0:05:56.70,0:06:00.49,Default,,0000,0000,0000,,That's what you say before with an actress. Dialogue: 0,0:06:00.49,0:06:01.69,Default,,0000,0000,0000,,And I thought: Dialogue: 0,0:06:01.69,0:06:04.60,Default,,0000,0000,0000,,How can we make an artificial intelligence model -- Dialogue: 0,0:06:04.60,0:06:06.46,Default,,0000,0000,0000,,computer, computational model -- Dialogue: 0,0:06:06.46,0:06:08.78,Default,,0000,0000,0000,,that will model some of these ideas of improvisation? Dialogue: 0,0:06:08.78,0:06:10.94,Default,,0000,0000,0000,,Of taking risks of taking chances. Dialogue: 0,0:06:10.94,0:06:12.51,Default,,0000,0000,0000,,Even of making mistakes. Dialogue: 0,0:06:12.51,0:06:15.28,Default,,0000,0000,0000,,Maybe it can make for better robotic teammates. Dialogue: 0,0:06:15.28,0:06:17.91,Default,,0000,0000,0000,,So I worked for quite a long time on these models Dialogue: 0,0:06:17.91,0:06:20.26,Default,,0000,0000,0000,,and I implemented them on a number of robots. Dialogue: 0,0:06:20.26,0:06:22.27,Default,,0000,0000,0000,,Here you can see a very early example Dialogue: 0,0:06:22.27,0:06:25.98,Default,,0000,0000,0000,,with the robots trying to use this \Nembodied artificial intelligence, Dialogue: 0,0:06:25.98,0:06:28.74,Default,,0000,0000,0000,,to try to match my movements as closely as possible. Dialogue: 0,0:06:28.74,0:06:30.23,Default,,0000,0000,0000,,It's sort of like a game. Dialogue: 0,0:06:30.23,0:06:32.09,Default,,0000,0000,0000,,Let's look at it. Dialogue: 0,0:06:35.59,0:06:39.70,Default,,0000,0000,0000,,You can see when I psych it out, it gets fooled. Dialogue: 0,0:06:39.70,0:06:41.90,Default,,0000,0000,0000,,And it's a little bit like what you might see actors do Dialogue: 0,0:06:41.90,0:06:43.79,Default,,0000,0000,0000,,when they try to mirror each other Dialogue: 0,0:06:43.79,0:06:46.30,Default,,0000,0000,0000,,to find the right synchrony between them. Dialogue: 0,0:06:46.30,0:06:48.02,Default,,0000,0000,0000,,And then, I did another experiment, Dialogue: 0,0:06:48.02,0:06:52.30,Default,,0000,0000,0000,,and I got people off the street \Nto use the robotic desk lamp, Dialogue: 0,0:06:52.30,0:06:55.92,Default,,0000,0000,0000,,and try out this idea of embodied artificial intelligence. Dialogue: 0,0:06:55.92,0:06:57.18,Default,,0000,0000,0000,,So, Dialogue: 0,0:06:57.18,0:07:00.45,Default,,0000,0000,0000,,I actually used two kinds of brains for the same robot. Dialogue: 0,0:07:00.45,0:07:01.86,Default,,0000,0000,0000,,The robot is the same lamp that you saw, Dialogue: 0,0:07:01.86,0:07:03.79,Default,,0000,0000,0000,,and I put in it two brains. Dialogue: 0,0:07:03.79,0:07:05.63,Default,,0000,0000,0000,,For one half of the people, Dialogue: 0,0:07:05.63,0:07:08.46,Default,,0000,0000,0000,,I put in a brain that's kind of the traditional, Dialogue: 0,0:07:08.46,0:07:09.71,Default,,0000,0000,0000,,calculated robotic brain. Dialogue: 0,0:07:09.71,0:07:12.06,Default,,0000,0000,0000,,It waits for its turn, it analyzes everything, it plans -- Dialogue: 0,0:07:12.06,0:07:13.92,Default,,0000,0000,0000,,let's call is the call it the calculated brain. Dialogue: 0,0:07:13.92,0:07:17.55,Default,,0000,0000,0000,,The other, got more the stage actor, risk taker brain. Dialogue: 0,0:07:17.55,0:07:19.63,Default,,0000,0000,0000,,Let's call it the adventurous brain. Dialogue: 0,0:07:19.63,0:07:22.59,Default,,0000,0000,0000,,It sometimes acts without knowing \Neverything it has to know. Dialogue: 0,0:07:22.59,0:07:24.77,Default,,0000,0000,0000,,It sometimes makes mistakes and corrects them. Dialogue: 0,0:07:24.77,0:07:27.35,Default,,0000,0000,0000,,And I had them do this very tedious task Dialogue: 0,0:07:27.35,0:07:28.85,Default,,0000,0000,0000,,that took almost 20 minutes Dialogue: 0,0:07:28.85,0:07:30.35,Default,,0000,0000,0000,,and they had to work together. Dialogue: 0,0:07:30.35,0:07:32.63,Default,,0000,0000,0000,,Somehow simulating like a factory job Dialogue: 0,0:07:32.63,0:07:35.30,Default,,0000,0000,0000,,of repetitively doing the same thing. Dialogue: 0,0:07:35.30,0:07:37.20,Default,,0000,0000,0000,,And what I found was that people actually loved Dialogue: 0,0:07:37.20,0:07:38.72,Default,,0000,0000,0000,,the adventurous robot. Dialogue: 0,0:07:38.72,0:07:40.10,Default,,0000,0000,0000,,And they thought it was more intelligent, Dialogue: 0,0:07:40.10,0:07:42.80,Default,,0000,0000,0000,,more committed, a better member of the team, Dialogue: 0,0:07:42.80,0:07:44.48,Default,,0000,0000,0000,,contributed to the success of the team more. Dialogue: 0,0:07:44.48,0:07:46.17,Default,,0000,0000,0000,,They even called it 'he' and 'she', Dialogue: 0,0:07:46.17,0:07:49.00,Default,,0000,0000,0000,,whereas people with the calculated brain called it 'it'. Dialogue: 0,0:07:49.00,0:07:51.88,Default,,0000,0000,0000,,And nobody ever called it 'he' or 'she'. Dialogue: 0,0:07:51.88,0:07:55.54,Default,,0000,0000,0000,,When they talked about it after the task \Nwith adventurous brain, they said, Dialogue: 0,0:07:55.54,0:07:59.02,Default,,0000,0000,0000,,"by the end we were good \Nfriends and high-fived mentally." Dialogue: 0,0:07:59.02,0:08:00.50,Default,,0000,0000,0000,,Whatever that means. Dialogue: 0,0:08:00.50,0:08:04.13,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:08:04.13,0:08:06.72,Default,,0000,0000,0000,,Whereas the people with the calculated brain Dialogue: 0,0:08:06.72,0:08:09.24,Default,,0000,0000,0000,,said it was just like a lazy apprentice. Dialogue: 0,0:08:09.24,0:08:11.84,Default,,0000,0000,0000,,It only did what it was supposed \Nto do, and nothing more. Dialogue: 0,0:08:11.84,0:08:14.31,Default,,0000,0000,0000,,Which is almost what people expect robots to do, Dialogue: 0,0:08:14.31,0:08:16.84,Default,,0000,0000,0000,,so I was surprised that people had higher expectations Dialogue: 0,0:08:16.84,0:08:21.13,Default,,0000,0000,0000,,of robots, than what anybody in robotics \Nthought robots should be doing. Dialogue: 0,0:08:21.13,0:08:24.02,Default,,0000,0000,0000,,And in a way, I thought, maybe it's time -- Dialogue: 0,0:08:24.02,0:08:28.28,Default,,0000,0000,0000,,just like method acting changed the way people \Nthought about acting in the 19th century, Dialogue: 0,0:08:28.28,0:08:31.43,Default,,0000,0000,0000,,from going from the very calculated, \Nplanned way of behaving, Dialogue: 0,0:08:31.43,0:08:35.30,Default,,0000,0000,0000,,to a more intuitive, risk-taking, \Nembodied?-well behaving. Dialogue: 0,0:08:35.30,0:08:36.70,Default,,0000,0000,0000,,Maybe it's time for robots Dialogue: 0,0:08:36.70,0:08:39.97,Default,,0000,0000,0000,,to have the same kind of revolution. Dialogue: 0,0:08:39.97,0:08:41.09,Default,,0000,0000,0000,,A few years later, Dialogue: 0,0:08:41.09,0:08:43.67,Default,,0000,0000,0000,,I was at my next research job at Georgia Tech in Atlanta, Dialogue: 0,0:08:43.67,0:08:44.82,Default,,0000,0000,0000,,and I was working in a group Dialogue: 0,0:08:44.82,0:08:45.96,Default,,0000,0000,0000,,dealing with robotic musicians. Dialogue: 0,0:08:45.96,0:08:48.63,Default,,0000,0000,0000,,And I thought -- music -- that's the perfect place Dialogue: 0,0:08:48.63,0:08:53.01,Default,,0000,0000,0000,,to look at teamwork, coordination, \Ntiming, improvisation -- Dialogue: 0,0:08:53.01,0:08:55.48,Default,,0000,0000,0000,,and we just got this robot playing marimba. Dialogue: 0,0:08:55.48,0:08:57.98,Default,,0000,0000,0000,,Marimba, for everybody [unclear] like me, \Nit was this huge, wooden xylophone. Dialogue: 0,0:08:57.98,0:09:02.59,Default,,0000,0000,0000,,And, when I was looking at this, Dialogue: 0,0:09:02.59,0:09:05.63,Default,,0000,0000,0000,,I looked at other works in human-robot improvisation. Dialogue: 0,0:09:05.63,0:09:08.09,Default,,0000,0000,0000,,Yes, there are other works in \Nhuman-robot improvisation, Dialogue: 0,0:09:08.09,0:09:10.38,Default,,0000,0000,0000,,and they were also a little bit like a chess game. Dialogue: 0,0:09:10.38,0:09:14.12,Default,,0000,0000,0000,,The human would play, the robot \Nwould analyze what was played, Dialogue: 0,0:09:14.12,0:09:14.54,Default,,0000,0000,0000,,would improvise their own part. Dialogue: 0,0:09:14.54,0:09:20.06,Default,,0000,0000,0000,,So, this is what musicians called a [unclear] interaction, Dialogue: 0,0:09:20.06,0:09:23.19,Default,,0000,0000,0000,,and it also fits very well, robots \Nand artificial intelligence. Dialogue: 0,0:09:23.19,0:09:28.21,Default,,0000,0000,0000,,But I thought, if I use the same ideas I used in the theater play and in the teamwork studies, Dialogue: 0,0:09:28.21,0:09:32.33,Default,,0000,0000,0000,,maybe I can make the robots \Njam together like a band -- Dialogue: 0,0:09:32.33,0:09:36.20,Default,,0000,0000,0000,,Everybody's riffing off each other, \Nnobody is stopping it for a moment. Dialogue: 0,0:09:36.20,0:09:38.91,Default,,0000,0000,0000,,And so, I tried to do the same \Nthings this time with music, Dialogue: 0,0:09:38.91,0:09:40.53,Default,,0000,0000,0000,,where the robot doesn't really know Dialogue: 0,0:09:40.53,0:09:41.73,Default,,0000,0000,0000,,what it's about to play Dialogue: 0,0:09:41.73,0:09:44.99,Default,,0000,0000,0000,,it just sort of moves its body \Nand uses opportunities to play, Dialogue: 0,0:09:44.99,0:09:47.49,Default,,0000,0000,0000,,And does what my chess teacher, \Nwhen I was 17, taught me. Dialogue: 0,0:09:47.49,0:09:48.91,Default,,0000,0000,0000,,She said, when you improvise, Dialogue: 0,0:09:48.91,0:09:51.49,Default,,0000,0000,0000,,sometimes you don't know what \Nyou're doing and you're still doing it. Dialogue: 0,0:09:51.49,0:09:54.85,Default,,0000,0000,0000,,And so I try to make a robot that doesn't \Nknow what it's doing, but it's still doing it. Dialogue: 0,0:09:54.85,0:09:55.87,Default,,0000,0000,0000,,but it's still doing it. Dialogue: 0,0:09:55.87,0:09:57.75,Default,,0000,0000,0000,,So let's look at a few seconds from this performance. Dialogue: 0,0:09:57.75,0:10:00.69,Default,,0000,0000,0000,,Where the robot listens to the human musician -- Dialogue: 0,0:10:00.69,0:10:02.57,Default,,0000,0000,0000,,and improvises. Dialogue: 0,0:10:02.57,0:10:06.32,Default,,0000,0000,0000,,And then, look how the human musician \Nalso responds to what the robot is doing. Dialogue: 0,0:10:06.32,0:10:09.59,Default,,0000,0000,0000,,And picking up from its behavior. Dialogue: 0,0:10:09.59,0:10:14.40,Default,,0000,0000,0000,,And at some point can even be surprised \Nby what the robot came up with. Dialogue: 0,0:10:14.40,0:11:04.19,Default,,0000,0000,0000,,(Music is played by the musician and the robot) Dialogue: 0,0:11:04.19,0:11:07.23,Default,,0000,0000,0000,,Being musician is not just about making notes, Dialogue: 0,0:11:07.23,0:11:09.46,Default,,0000,0000,0000,,otherwise no one would every go see a live show. Dialogue: 0,0:11:09.46,0:11:11.46,Default,,0000,0000,0000,,Musicians also communicate with their bodies, Dialogue: 0,0:11:11.46,0:11:15.53,Default,,0000,0000,0000,,with other band members, with the audience, \Nthey use their bodies to express the music. Dialogue: 0,0:11:15.53,0:11:17.87,Default,,0000,0000,0000,,And I thought, we already have \Na robot musician on stage, Dialogue: 0,0:11:17.87,0:11:20.85,Default,,0000,0000,0000,,why not make it be a full-fledged musician. Dialogue: 0,0:11:20.85,0:11:23.41,Default,,0000,0000,0000,,And I started designing a socially expressive head Dialogue: 0,0:11:23.41,0:11:25.44,Default,,0000,0000,0000,,for the robot. Dialogue: 0,0:11:25.44,0:11:26.93,Default,,0000,0000,0000,,The head does't actually touch the marimba, Dialogue: 0,0:11:26.93,0:11:28.46,Default,,0000,0000,0000,,it just expresses what the music is like. Dialogue: 0,0:11:28.46,0:11:31.55,Default,,0000,0000,0000,,These are some napkin sketches from a bar in Atlanta -- Dialogue: 0,0:11:31.55,0:11:35.76,Default,,0000,0000,0000,,That was dangerously located exactly halfway \Nbetween my lab and my home. (Laughter) Dialogue: 0,0:11:35.76,0:11:40.40,Default,,0000,0000,0000,,So I would spend, I would say on average \Nthree to four hours a day there -- I think -- Dialogue: 0,0:11:40.40,0:11:43.10,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:11:43.10,0:11:45.80,Default,,0000,0000,0000,,And I went back to my animation tools and tried to figure out Dialogue: 0,0:11:45.80,0:11:48.14,Default,,0000,0000,0000,,not just what a robotic musician would look like, Dialogue: 0,0:11:48.14,0:11:50.76,Default,,0000,0000,0000,,but especially what a robotic musician would move like. Dialogue: 0,0:11:50.76,0:11:54.15,Default,,0000,0000,0000,,To sort of show that it doesn't like what \Nthe other person is playing -- (laughter) Dialogue: 0,0:11:54.15,0:11:58.22,Default,,0000,0000,0000,,and maybe show whatever beat it \Nis feeling at the moment. (Laughter) Dialogue: 0,0:11:58.22,0:12:02.19,Default,,0000,0000,0000,,So we ended up actually getting the money \Nto build this robot which was nice. Dialogue: 0,0:12:02.19,0:12:04.86,Default,,0000,0000,0000,,I'm going to show you now the \Nsame kind of performance, Dialogue: 0,0:12:04.86,0:12:07.34,Default,,0000,0000,0000,,this time with a socially expressive head. Dialogue: 0,0:12:07.34,0:12:09.18,Default,,0000,0000,0000,,And notice one thing -- Dialogue: 0,0:12:09.18,0:12:10.88,Default,,0000,0000,0000,,how the robot is really showing us Dialogue: 0,0:12:10.88,0:12:12.74,Default,,0000,0000,0000,,the beat it's picking up from the human. Dialogue: 0,0:12:12.74,0:12:16.76,Default,,0000,0000,0000,,When also giving the human a sense, \Nlike the robot knows what it's doing, Dialogue: 0,0:12:16.76,0:12:18.26,Default,,0000,0000,0000,,and also how it changes the way it moves\N Dialogue: 0,0:12:18.26,0:12:21.76,Default,,0000,0000,0000,,as soon as it starts its own solo. Dialogue: 0,0:12:21.76,0:12:49.28,Default,,0000,0000,0000,,(Robot interacting with music played by musician) Dialogue: 0,0:12:49.28,0:12:52.34,Default,,0000,0000,0000,,And now look at the final chord of the piece again, Dialogue: 0,0:12:52.34,0:12:55.16,Default,,0000,0000,0000,,and this time the robot communicates with its body Dialogue: 0,0:12:55.16,0:12:57.33,Default,,0000,0000,0000,,when its busy doing its own thing. Dialogue: 0,0:12:57.33,0:12:58.82,Default,,0000,0000,0000,,And when its ready Dialogue: 0,0:12:58.82,0:13:02.17,Default,,0000,0000,0000,,to coordinate the final chord with me. Dialogue: 0,0:13:02.17,0:13:14.33,Default,,0000,0000,0000,,(Musician and robot playing music together) Dialogue: 0,0:13:14.33,0:13:17.09,Default,,0000,0000,0000,,(Robot and musician play final chord in synchrony) Dialogue: 0,0:13:17.09,0:13:20.91,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:13:20.91,0:13:25.43,Default,,0000,0000,0000,,Thanks. I hope you see how much this, Dialogue: 0,0:13:25.43,0:13:28.13,Default,,0000,0000,0000,,how much this part of the body \Nthat doesn't touch the instrument Dialogue: 0,0:13:28.13,0:13:32.50,Default,,0000,0000,0000,,actually helps with the musical performance. Dialogue: 0,0:13:32.50,0:13:36.57,Default,,0000,0000,0000,,We are in Atlanta, so obviously some rapper \Nwill come into the lab at some point. (Laughter) Dialogue: 0,0:13:36.57,0:13:38.72,Default,,0000,0000,0000,,And we had this rapper come in Dialogue: 0,0:13:38.72,0:13:41.30,Default,,0000,0000,0000,,and do a little jam with the robot. Dialogue: 0,0:13:41.30,0:13:43.34,Default,,0000,0000,0000,,And here you can see the robot Dialogue: 0,0:13:43.34,0:13:45.11,Default,,0000,0000,0000,,basically responding to the beat. Dialogue: 0,0:13:45.11,0:13:50.06,Default,,0000,0000,0000,,And notice two things: One, how irresistible it \Nis to join the robot while it's moving its head -- Dialogue: 0,0:13:50.06,0:13:52.51,Default,,0000,0000,0000,,and you kind of want to move \Nyour own head when it does it. Dialogue: 0,0:13:52.51,0:13:56.45,Default,,0000,0000,0000,,And second, even though the rapper \Nis really focused on his iPhone, Dialogue: 0,0:13:56.45,0:13:59.48,Default,,0000,0000,0000,,as soon as the robot turns to him, he turns back. Dialogue: 0,0:13:59.48,0:14:02.33,Default,,0000,0000,0000,,So even though it's just in the peripheral of \Nhis vision, it's just in the corner of his eye, Dialogue: 0,0:14:02.33,0:14:04.07,Default,,0000,0000,0000,,it's very powerful. Dialogue: 0,0:14:04.07,0:14:07.69,Default,,0000,0000,0000,,And the reason is that we can't ignore \Nphysical things moving our environment. Dialogue: 0,0:14:07.69,0:14:12.82,Default,,0000,0000,0000,,So you have a problem with maybe your partners Dialogue: 0,0:14:12.82,0:14:15.75,Default,,0000,0000,0000,,looking at the iPhone too much \Nor their smartphone too much, Dialogue: 0,0:14:15.75,0:14:19.81,Default,,0000,0000,0000,,you might want to have a robot \Nthere to get their attention. Dialogue: 0,0:14:19.81,0:14:39.10,Default,,0000,0000,0000,,(Man raps to music playing) Dialogue: 0,0:14:39.10,0:14:43.20,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:14:43.20,0:14:47.69,Default,,0000,0000,0000,,Just to introduce the last robot Dialogue: 0,0:14:47.69,0:14:49.93,Default,,0000,0000,0000,,that we've worked on -- Dialogue: 0,0:14:49.93,0:14:51.76,Default,,0000,0000,0000,,that came out of something kind \Nof surprising the we found -- Dialogue: 0,0:14:51.76,0:14:54.68,Default,,0000,0000,0000,,at some point people didn't care anymore \Nabout the robot being so intelligent, Dialogue: 0,0:14:54.68,0:14:56.20,Default,,0000,0000,0000,,and can improvise and listen, Dialogue: 0,0:14:56.20,0:15:01.06,Default,,0000,0000,0000,,and do all these embodied intelligence things \Nthat I spent years on developing. (Laughter) Dialogue: 0,0:15:01.06,0:15:05.42,Default,,0000,0000,0000,,They really like that the robot \Nwas enjoying the music. Dialogue: 0,0:15:05.42,0:15:06.76,Default,,0000,0000,0000,,And they didn't say that the robot was moving to the music, Dialogue: 0,0:15:06.76,0:15:08.52,Default,,0000,0000,0000,,they said that the robot was enjoying the music. Dialogue: 0,0:15:08.52,0:15:10.88,Default,,0000,0000,0000,,And we thought, why don't we take this idea, Dialogue: 0,0:15:10.88,0:15:13.75,Default,,0000,0000,0000,,and I designed a new piece of furniture. Dialogue: 0,0:15:13.75,0:15:15.86,Default,,0000,0000,0000,,This time it wasn't a desk \Nlamp it was a speaker dock. Dialogue: 0,0:15:15.86,0:15:18.83,Default,,0000,0000,0000,,It was one of those things you \Nplug your smartphone in. Dialogue: 0,0:15:18.83,0:15:20.54,Default,,0000,0000,0000,,And I thought, what would happen Dialogue: 0,0:15:20.54,0:15:23.15,Default,,0000,0000,0000,,if your speaker dock didn't \Njust play the music for you, Dialogue: 0,0:15:23.15,0:15:25.66,Default,,0000,0000,0000,,but it would actually enjoy it to. (Laughter) Dialogue: 0,0:15:25.66,0:15:27.43,Default,,0000,0000,0000,,And so again, here are some animation tests Dialogue: 0,0:15:27.43,0:15:31.96,Default,,0000,0000,0000,,from an early stage. (Laughter) Dialogue: 0,0:15:31.96,0:15:47.22,Default,,0000,0000,0000,,And this is what the final product looked like. Dialogue: 0,0:15:47.22,0:16:09.62,Default,,0000,0000,0000,,(Music playing in synchrony \Nwith the robot's movements) Dialogue: 0,0:16:09.62,0:16:12.10,Default,,0000,0000,0000,,So, a lot of bobbing head. Dialogue: 0,0:16:12.10,0:16:15.76,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:16:15.76,0:16:17.34,Default,,0000,0000,0000,,A lot of bobbing heads in the audience, Dialogue: 0,0:16:17.34,0:16:20.39,Default,,0000,0000,0000,,so we can still see robots influence people. Dialogue: 0,0:16:20.39,0:16:23.14,Default,,0000,0000,0000,,And it's not just fun and games. Dialogue: 0,0:16:23.14,0:16:27.38,Default,,0000,0000,0000,,I think one of the reasons [unclear] that \Nrobots use their body to communicate Dialogue: 0,0:16:27.38,0:16:29.07,Default,,0000,0000,0000,,and use their body to move -- Dialogue: 0,0:16:29.07,0:16:32.64,Default,,0000,0000,0000,,and I'm going to let you in on a little \Nsecret we roboticists are hiding -- Dialogue: 0,0:16:32.64,0:16:35.33,Default,,0000,0000,0000,,is that every one of you is \Ngoing to be living with a robot Dialogue: 0,0:16:35.33,0:16:36.89,Default,,0000,0000,0000,,at some point in their life. (Laughter) Dialogue: 0,0:16:36.89,0:16:39.55,Default,,0000,0000,0000,,Somewhere in your future there's \Ngoing to be a robot in your life. Dialogue: 0,0:16:39.55,0:16:41.68,Default,,0000,0000,0000,,And if not in yours, then in your children's life. Dialogue: 0,0:16:41.68,0:16:43.47,Default,,0000,0000,0000,,And I want these robots to be -- Dialogue: 0,0:16:43.47,0:16:47.08,Default,,0000,0000,0000,,to be more fluent, more engaging, more graceful Dialogue: 0,0:16:47.08,0:16:48.90,Default,,0000,0000,0000,,than currently they seem to be. Dialogue: 0,0:16:48.90,0:16:50.67,Default,,0000,0000,0000,,And for that I think that maybe robots Dialogue: 0,0:16:50.67,0:16:52.20,Default,,0000,0000,0000,,need to be less like chess players Dialogue: 0,0:16:52.20,0:16:54.74,Default,,0000,0000,0000,,and more like stage actors and more like musicians. Dialogue: 0,0:16:54.74,0:16:57.08,Default,,0000,0000,0000,,Maybe they should be able to \Ntake chances and improvise. Dialogue: 0,0:16:57.08,0:17:00.18,Default,,0000,0000,0000,,And maybe they should be able to \Nanticipate what you're about to do. Dialogue: 0,0:17:00.18,0:17:02.76,Default,,0000,0000,0000,,And maybe they need to be able to make mistakes Dialogue: 0,0:17:02.76,0:17:04.15,Default,,0000,0000,0000,,and correct them, Dialogue: 0,0:17:04.15,0:17:06.02,Default,,0000,0000,0000,,because in the end we are human. Dialogue: 0,0:17:06.02,0:17:09.54,Default,,0000,0000,0000,,And maybe as humans, robots \Nthat are a little less than perfect Dialogue: 0,0:17:09.54,0:17:11.25,Default,,0000,0000,0000,,are just perfect for us. Dialogue: 0,0:17:11.25,0:17:12.77,Default,,0000,0000,0000,,Thank you. Dialogue: 0,0:17:12.77,0:17:16.19,Default,,0000,0000,0000,,(Applause)