[Script Info] Title: [Events] Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text Dialogue: 0,0:00:00.56,0:00:03.09,Default,,0000,0000,0000,,My job is to design, build and study Dialogue: 0,0:00:03.09,0:00:05.84,Default,,0000,0000,0000,,robots that communicate with people. Dialogue: 0,0:00:05.84,0:00:06.64,Default,,0000,0000,0000,,But this story doesn't start with robotics at all, Dialogue: 0,0:00:06.64,0:00:08.53,Default,,0000,0000,0000,,it starts with animation. Dialogue: 0,0:00:08.53,0:00:11.12,Default,,0000,0000,0000,,When I first saw Pixar's Luxo Jr., Dialogue: 0,0:00:11.12,0:00:13.10,Default,,0000,0000,0000,,I was amazed by how much emotion Dialogue: 0,0:00:13.10,0:00:14.86,Default,,0000,0000,0000,,they could put into something Dialogue: 0,0:00:14.86,0:00:17.45,Default,,0000,0000,0000,,as trivial as a desk lamp. Dialogue: 0,0:00:17.45,0:00:19.28,Default,,0000,0000,0000,,I mean look at them -- at the end of this movie, Dialogue: 0,0:00:19.28,0:00:21.79,Default,,0000,0000,0000,,you actually feel something for two pieces of furniture. Dialogue: 0,0:00:21.79,0:00:23.62,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:00:23.62,0:00:25.74,Default,,0000,0000,0000,,And I said, I have to learn how to do this. Dialogue: 0,0:00:25.74,0:00:29.27,Default,,0000,0000,0000,,So I made a really bad career decision. (Laughter) Dialogue: 0,0:00:29.27,0:00:31.68,Default,,0000,0000,0000,,And that's what my mom was like when I did it. Dialogue: 0,0:00:31.68,0:00:33.69,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:00:33.69,0:00:35.87,Default,,0000,0000,0000,,I left a very quasi-tech job in Israel Dialogue: 0,0:00:35.87,0:00:38.47,Default,,0000,0000,0000,,with an iSoftware company and I moved to New York Dialogue: 0,0:00:38.47,0:00:39.48,Default,,0000,0000,0000,,to study animation. Dialogue: 0,0:00:39.48,0:00:40.64,Default,,0000,0000,0000,,And there I lived Dialogue: 0,0:00:40.64,0:00:43.64,Default,,0000,0000,0000,,in a collapsing apartment building\Nin Harlem with roommates. Dialogue: 0,0:00:43.64,0:00:45.00,Default,,0000,0000,0000,,I'm not using this phrase metaphorically, Dialogue: 0,0:00:45.00,0:00:46.96,Default,,0000,0000,0000,,the ceiling actually collapsed one day Dialogue: 0,0:00:46.96,0:00:48.27,Default,,0000,0000,0000,,in our living room. (Laughter) Dialogue: 0,0:00:48.27,0:00:50.94,Default,,0000,0000,0000,,Whenever they did those news stories \Nabout building violations in New York,\N Dialogue: 0,0:00:50.94,0:00:53.18,Default,,0000,0000,0000,,they would put the report in front of our building. \N(Laughter) Dialogue: 0,0:00:53.18,0:00:56.78,Default,,0000,0000,0000,,As kind of like a backdrop \Nto show how bad things are. Dialogue: 0,0:00:56.78,0:00:58.73,Default,,0000,0000,0000,,Anyway, during the day I went to school and at night Dialogue: 0,0:00:58.73,0:01:02.25,Default,,0000,0000,0000,,I would sit and draw frame-by-frame \Nof pencil animation. Dialogue: 0,0:01:02.25,0:01:04.52,Default,,0000,0000,0000,,And I learned two surprising lessons -- Dialogue: 0,0:01:04.52,0:01:07.08,Default,,0000,0000,0000,,one of them was that Dialogue: 0,0:01:07.08,0:01:09.04,Default,,0000,0000,0000,,when you want to arouse emotions, Dialogue: 0,0:01:09.04,0:01:10.76,Default,,0000,0000,0000,,it doesn't matter so much how something looks, \N Dialogue: 0,0:01:10.76,0:01:13.11,Default,,0000,0000,0000,,it's all in the motion -- it's in the timing Dialogue: 0,0:01:13.11,0:01:14.72,Default,,0000,0000,0000,,of how the thing moves. Dialogue: 0,0:01:14.72,0:01:17.94,Default,,0000,0000,0000,,And the second, was something \None of our teachers told us. Dialogue: 0,0:01:17.94,0:01:20.35,Default,,0000,0000,0000,,He actually did the weasel in Ice Age. Dialogue: 0,0:01:20.35,0:01:21.74,Default,,0000,0000,0000,,And he said: Dialogue: 0,0:01:21.74,0:01:24.90,Default,,0000,0000,0000,,"As an animator you are not a director, you're an actor." Dialogue: 0,0:01:24.90,0:01:27.88,Default,,0000,0000,0000,,So, if you want to find the right motion for a character, Dialogue: 0,0:01:27.88,0:01:30.23,Default,,0000,0000,0000,,don't think about it, go use your body to find it -- Dialogue: 0,0:01:30.23,0:01:31.86,Default,,0000,0000,0000,,stand in front of a mirror, act it out Dialogue: 0,0:01:31.86,0:01:33.56,Default,,0000,0000,0000,,in front of a camera -- whatever you need. Dialogue: 0,0:01:33.56,0:01:36.46,Default,,0000,0000,0000,,And then put it back in your character. Dialogue: 0,0:01:36.46,0:01:38.62,Default,,0000,0000,0000,,A year later I found myself at MIT Dialogue: 0,0:01:38.62,0:01:40.77,Default,,0000,0000,0000,,in the robotic life group, it was one of the first groups Dialogue: 0,0:01:40.77,0:01:43.41,Default,,0000,0000,0000,,researching the relationships \Nbetween humans and robots. Dialogue: 0,0:01:43.41,0:01:45.35,Default,,0000,0000,0000,,And I still had this dream to make Dialogue: 0,0:01:45.35,0:01:48.06,Default,,0000,0000,0000,,an actual, physical Luxo Jr. lamp. Dialogue: 0,0:01:48.06,0:01:49.63,Default,,0000,0000,0000,,But I found that robots didn't move at all Dialogue: 0,0:01:49.63,0:01:50.91,Default,,0000,0000,0000,,in this engaging way that I was used to Dialogue: 0,0:01:50.91,0:01:52.54,Default,,0000,0000,0000,,for my animation studies. Dialogue: 0,0:01:52.54,0:01:54.76,Default,,0000,0000,0000,,Instead, they were all -- Dialogue: 0,0:01:54.76,0:01:57.26,Default,,0000,0000,0000,,how should I put it, they were all kind of robotic. Dialogue: 0,0:01:57.26,0:01:59.15,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:01:59.15,0:02:02.79,Default,,0000,0000,0000,,And I thought what if I took whatever \NI learned in animation school, Dialogue: 0,0:02:02.79,0:02:05.46,Default,,0000,0000,0000,,and used that to design my robotic desk lamp. Dialogue: 0,0:02:05.46,0:02:07.54,Default,,0000,0000,0000,,So I went and designed frame-by-frame Dialogue: 0,0:02:07.54,0:02:09.39,Default,,0000,0000,0000,,to try to make this robot Dialogue: 0,0:02:09.39,0:02:12.05,Default,,0000,0000,0000,,as graceful and engaging as possible. Dialogue: 0,0:02:12.05,0:02:14.09,Default,,0000,0000,0000,,And here when you see the robot interacting with me Dialogue: 0,0:02:14.09,0:02:15.72,Default,,0000,0000,0000,,on a desktop. Dialogue: 0,0:02:15.72,0:02:17.93,Default,,0000,0000,0000,,And I'm actually really [unclear] the robot so, Dialogue: 0,0:02:17.93,0:02:19.73,Default,,0000,0000,0000,,unbenounced to itself, Dialogue: 0,0:02:19.73,0:02:22.42,Default,,0000,0000,0000,,it's kind of digging its own grave by helping me. Dialogue: 0,0:02:22.42,0:02:24.45,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:02:24.45,0:02:26.42,Default,,0000,0000,0000,,I wanted it to be less of a mechanical structure Dialogue: 0,0:02:26.42,0:02:27.71,Default,,0000,0000,0000,,giving me light, Dialogue: 0,0:02:27.71,0:02:30.75,Default,,0000,0000,0000,,and more of a helpful, kind of quiet apprentice Dialogue: 0,0:02:30.75,0:02:33.95,Default,,0000,0000,0000,,that's always there when you need \Nit and doesn't really interfere. Dialogue: 0,0:02:33.95,0:02:35.62,Default,,0000,0000,0000,,And when, for example, I'm looking for a battery Dialogue: 0,0:02:35.62,0:02:37.16,Default,,0000,0000,0000,,that I can't find, Dialogue: 0,0:02:37.16,0:02:41.75,Default,,0000,0000,0000,,in a subtle way, it will show me where the battery is. Dialogue: 0,0:02:41.75,0:02:44.32,Default,,0000,0000,0000,,So you can see my confusion here. Dialogue: 0,0:02:44.32,0:02:48.58,Default,,0000,0000,0000,,I'm not an actor. Dialogue: 0,0:02:48.58,0:02:50.03,Default,,0000,0000,0000,,And I want you to notice how the same Dialogue: 0,0:02:50.03,0:02:52.00,Default,,0000,0000,0000,,mechanical structure can at one point, Dialogue: 0,0:02:52.00,0:02:55.00,Default,,0000,0000,0000,,just by the way it moves seem gentle and caring -- Dialogue: 0,0:02:55.00,0:02:58.24,Default,,0000,0000,0000,,and the other case, seem violent and confrontational. Dialogue: 0,0:02:58.24,0:03:01.55,Default,,0000,0000,0000,,And it's the same structure, \Njust the motion is different. Dialogue: 0,0:03:07.03,0:03:12.90,Default,,0000,0000,0000,,Actor: "You want to know something? \NWell, you want to know something? Dialogue: 0,0:03:12.90,0:03:13.84,Default,,0000,0000,0000,,He was already dead! Dialogue: 0,0:03:13.84,0:03:17.85,Default,,0000,0000,0000,,Just lay there, eyes glazed over!" Dialogue: 0,0:03:17.85,0:03:18.86,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:03:18.86,0:03:22.76,Default,,0000,0000,0000,,But, moving in graceful ways is just one \Nbuilding block of this whole structure Dialogue: 0,0:03:22.76,0:03:24.34,Default,,0000,0000,0000,,called human-robot interaction. Dialogue: 0,0:03:24.34,0:03:25.83,Default,,0000,0000,0000,,I was at the time doing my PHD, Dialogue: 0,0:03:25.83,0:03:27.100,Default,,0000,0000,0000,,I was working on human robot teamwork; Dialogue: 0,0:03:27.100,0:03:30.00,Default,,0000,0000,0000,,teams of humans and robots working together. Dialogue: 0,0:03:30.00,0:03:31.33,Default,,0000,0000,0000,,I was studying the engineering, Dialogue: 0,0:03:31.33,0:03:34.12,Default,,0000,0000,0000,,the psychology, the philosophy of teamwork. Dialogue: 0,0:03:34.12,0:03:35.58,Default,,0000,0000,0000,,And at the same time I found myself Dialogue: 0,0:03:35.58,0:03:37.44,Default,,0000,0000,0000,,in my own kind of teamwork situation Dialogue: 0,0:03:37.44,0:03:39.66,Default,,0000,0000,0000,,with a good friend of mine who is actually here. Dialogue: 0,0:03:39.66,0:03:42.27,Default,,0000,0000,0000,,And in that situation we can easily imagine robots Dialogue: 0,0:03:42.27,0:03:44.37,Default,,0000,0000,0000,,in the near future being there with us. Dialogue: 0,0:03:44.37,0:03:46.21,Default,,0000,0000,0000,,It was after Passover Seder. Dialogue: 0,0:03:46.21,0:03:48.05,Default,,0000,0000,0000,,We were folding up a lot of folding chairs, Dialogue: 0,0:03:48.05,0:03:50.99,Default,,0000,0000,0000,,and I was amazed at how quickly \Nwe found our own rhythm. Dialogue: 0,0:03:50.99,0:03:52.55,Default,,0000,0000,0000,,Everybody did their own part. Dialogue: 0,0:03:52.55,0:03:54.18,Default,,0000,0000,0000,,We didn't have to divide our tasks. Dialogue: 0,0:03:54.18,0:03:56.28,Default,,0000,0000,0000,,We didn't have to communicate verbally about this. Dialogue: 0,0:03:56.28,0:03:57.89,Default,,0000,0000,0000,,It all just happened. Dialogue: 0,0:03:57.89,0:03:58.78,Default,,0000,0000,0000,,And I thought, Dialogue: 0,0:03:58.78,0:04:00.63,Default,,0000,0000,0000,,humans and robots don't look at all like this. Dialogue: 0,0:04:00.63,0:04:02.30,Default,,0000,0000,0000,,When humans and robots interact, Dialogue: 0,0:04:02.30,0:04:03.50,Default,,0000,0000,0000,,it's much more like a chess game. Dialogue: 0,0:04:03.50,0:04:04.76,Default,,0000,0000,0000,,The human does a thing, Dialogue: 0,0:04:04.76,0:04:06.64,Default,,0000,0000,0000,,the robot analyzes whatever the human did, Dialogue: 0,0:04:06.64,0:04:08.17,Default,,0000,0000,0000,,then the robot decides what to do next, Dialogue: 0,0:04:08.17,0:04:09.34,Default,,0000,0000,0000,,plans it and does it. Dialogue: 0,0:04:09.34,0:04:11.48,Default,,0000,0000,0000,,And then the human waits, until its their turn again. Dialogue: 0,0:04:11.48,0:04:12.66,Default,,0000,0000,0000,,So, it's much more like a chess game Dialogue: 0,0:04:12.66,0:04:14.58,Default,,0000,0000,0000,,and that makes sense because chess is great Dialogue: 0,0:04:14.58,0:04:16.40,Default,,0000,0000,0000,,for mathematicians and computer scientists. Dialogue: 0,0:04:16.40,0:04:18.65,Default,,0000,0000,0000,,It's all about information analysis, Dialogue: 0,0:04:18.65,0:04:21.50,Default,,0000,0000,0000,,decision making and planning. Dialogue: 0,0:04:21.50,0:04:25.19,Default,,0000,0000,0000,,But I wanted my robots to be less of a chess player, Dialogue: 0,0:04:25.19,0:04:26.86,Default,,0000,0000,0000,,and more like -- you know -- like a doer Dialogue: 0,0:04:26.86,0:04:29.18,Default,,0000,0000,0000,,that just clicks and works together. Dialogue: 0,0:04:29.18,0:04:32.57,Default,,0000,0000,0000,,So I made my second horrible career choice: Dialogue: 0,0:04:32.57,0:04:35.23,Default,,0000,0000,0000,,I decided to study acting for a semester. Dialogue: 0,0:04:35.23,0:04:38.09,Default,,0000,0000,0000,,I took off from a PHD, I went to acting classes. Dialogue: 0,0:04:38.09,0:04:40.04,Default,,0000,0000,0000,,I actually participated in a play, Dialogue: 0,0:04:40.04,0:04:43.34,Default,,0000,0000,0000,,I hope theres no video of that around still. (Laughter) Dialogue: 0,0:04:43.34,0:04:45.97,Default,,0000,0000,0000,,And I got every book I could find about acting. Dialogue: 0,0:04:45.97,0:04:47.94,Default,,0000,0000,0000,,Including one from the 19th century Dialogue: 0,0:04:47.94,0:04:49.01,Default,,0000,0000,0000,,that I got from the library. Dialogue: 0,0:04:49.01,0:04:52.47,Default,,0000,0000,0000,,And I was really amazed because \Nmy name was the second on the list -- Dialogue: 0,0:04:52.47,0:04:55.29,Default,,0000,0000,0000,,the previous name was in 1889. (Laughter) Dialogue: 0,0:04:55.29,0:04:57.00,Default,,0000,0000,0000,,And this book was kind of waiting for 100 years Dialogue: 0,0:04:57.00,0:05:00.19,Default,,0000,0000,0000,,to be rediscovered for robotics. Dialogue: 0,0:05:00.19,0:05:01.67,Default,,0000,0000,0000,,And this book shows actors Dialogue: 0,0:05:01.67,0:05:04.03,Default,,0000,0000,0000,,how to move every muscle in the body Dialogue: 0,0:05:04.03,0:05:06.74,Default,,0000,0000,0000,,to match every kind of emotion \Nthat they want to express. Dialogue: 0,0:05:06.74,0:05:08.57,Default,,0000,0000,0000,,But the real relevation was Dialogue: 0,0:05:08.57,0:05:09.91,Default,,0000,0000,0000,,when I learned about method acting. Dialogue: 0,0:05:09.91,0:05:12.19,Default,,0000,0000,0000,,It became very popular in the 20th century. Dialogue: 0,0:05:12.19,0:05:14.83,Default,,0000,0000,0000,,And method acting said, you don't have \Nto plan every muscle in your body. Dialogue: 0,0:05:14.83,0:05:17.50,Default,,0000,0000,0000,,Instead you have to use your body \Nto find the right movement. Dialogue: 0,0:05:17.50,0:05:19.68,Default,,0000,0000,0000,,You have to use your sense memory Dialogue: 0,0:05:19.68,0:05:21.54,Default,,0000,0000,0000,,to reconstruct the emotions and kind of Dialogue: 0,0:05:21.54,0:05:24.44,Default,,0000,0000,0000,,think with your body to find the right expression. Dialogue: 0,0:05:24.44,0:05:26.46,Default,,0000,0000,0000,,Improvise, play off yor scene partner. Dialogue: 0,0:05:26.46,0:05:29.71,Default,,0000,0000,0000,,And this came at the same time \Nas I was reading about this trend Dialogue: 0,0:05:29.71,0:05:32.80,Default,,0000,0000,0000,,in cognitive psychology called embodied cognition. Dialogue: 0,0:05:32.80,0:05:34.88,Default,,0000,0000,0000,,Which also talks about the same ideas -- Dialogue: 0,0:05:34.88,0:05:35.79,Default,,0000,0000,0000,,We use our bodies to think, Dialogue: 0,0:05:35.79,0:05:38.21,Default,,0000,0000,0000,,we don't just think with our brains \Nand use our bodies to move. Dialogue: 0,0:05:38.21,0:05:40.62,Default,,0000,0000,0000,,but our bodies feed back into our brain Dialogue: 0,0:05:40.62,0:05:42.96,Default,,0000,0000,0000,,to generate the way that we behave. Dialogue: 0,0:05:42.96,0:05:44.12,Default,,0000,0000,0000,,And it was like a lightning bolt. Dialogue: 0,0:05:44.12,0:05:45.36,Default,,0000,0000,0000,,I went back to my office. Dialogue: 0,0:05:45.36,0:05:48.84,Default,,0000,0000,0000,,I wrote this paper -- which I never really published Dialogue: 0,0:05:48.84,0:05:50.84,Default,,0000,0000,0000,,called "Acting Lessons for Artificial Intelligence." Dialogue: 0,0:05:50.84,0:05:52.23,Default,,0000,0000,0000,,And I even took another month Dialogue: 0,0:05:52.23,0:05:54.84,Default,,0000,0000,0000,,to do what was then the first theater play Dialogue: 0,0:05:54.84,0:05:56.70,Default,,0000,0000,0000,,with a human and a robot acting together. Dialogue: 0,0:05:56.70,0:06:00.49,Default,,0000,0000,0000,,That's what you say before with an actress. Dialogue: 0,0:06:00.49,0:06:01.69,Default,,0000,0000,0000,,And I thought: Dialogue: 0,0:06:01.69,0:06:04.60,Default,,0000,0000,0000,,How can we make an artificial intelligence model -- Dialogue: 0,0:06:04.60,0:06:06.46,Default,,0000,0000,0000,,computer, computational model -- Dialogue: 0,0:06:06.46,0:06:08.78,Default,,0000,0000,0000,,that will model some of these ideas of improvisation? Dialogue: 0,0:06:08.78,0:06:10.94,Default,,0000,0000,0000,,Of taking risks of taking chances. Dialogue: 0,0:06:10.94,0:06:12.51,Default,,0000,0000,0000,,Even of making mistakes. Dialogue: 0,0:06:12.51,0:06:15.28,Default,,0000,0000,0000,,Maybe it can make for better robotic teammates. Dialogue: 0,0:06:15.28,0:06:17.91,Default,,0000,0000,0000,,So I worked for quite a long time on these models Dialogue: 0,0:06:17.91,0:06:20.26,Default,,0000,0000,0000,,and I implemented them on a number of robots. Dialogue: 0,0:06:20.26,0:06:22.27,Default,,0000,0000,0000,,Here you can see a very early example Dialogue: 0,0:06:22.27,0:06:25.98,Default,,0000,0000,0000,,with the robots trying to use this \Nembodied artificial intelligence, Dialogue: 0,0:06:25.98,0:06:28.74,Default,,0000,0000,0000,,to try to match my movements as closely as possible. Dialogue: 0,0:06:28.74,0:06:30.23,Default,,0000,0000,0000,,It's sort of like a game. Dialogue: 0,0:06:30.23,0:06:32.09,Default,,0000,0000,0000,,Let's look at it. Dialogue: 0,0:06:35.59,0:06:39.70,Default,,0000,0000,0000,,You can see when I psych it out, it gets fooled. Dialogue: 0,0:06:39.70,0:06:41.90,Default,,0000,0000,0000,,And it's a little bit like what you might see actors do Dialogue: 0,0:06:41.90,0:06:43.79,Default,,0000,0000,0000,,when they try to mirror each other Dialogue: 0,0:06:43.79,0:06:46.30,Default,,0000,0000,0000,,to find the right synchrony between them. Dialogue: 0,0:06:46.30,0:06:48.22,Default,,0000,0000,0000,,And then, I did another experiment, Dialogue: 0,0:06:48.22,0:06:52.30,Default,,0000,0000,0000,,and I got people off the street \Nto use the robotic desk lamp, Dialogue: 0,0:06:52.30,0:06:55.92,Default,,0000,0000,0000,,and try out this idea of embodied artificial intelligence. Dialogue: 0,0:06:55.92,0:06:57.18,Default,,0000,0000,0000,,So, Dialogue: 0,0:06:57.18,0:07:00.45,Default,,0000,0000,0000,,I actually used two kinds of brains for the same robot. Dialogue: 0,0:07:00.45,0:07:01.86,Default,,0000,0000,0000,,The robot is the same lamp that you saw, Dialogue: 0,0:07:01.86,0:07:03.79,Default,,0000,0000,0000,,and I put in it two brains. Dialogue: 0,0:07:03.79,0:07:05.63,Default,,0000,0000,0000,,For one half of the people, Dialogue: 0,0:07:05.63,0:07:08.46,Default,,0000,0000,0000,,I put in a brain that's kind of the traditional, Dialogue: 0,0:07:08.46,0:07:09.71,Default,,0000,0000,0000,,calculated robotic brain. Dialogue: 0,0:07:09.71,0:07:12.65,Default,,0000,0000,0000,,It waits for its turn, it analyzes everything, it plans -- Dialogue: 0,0:07:12.65,0:07:13.92,Default,,0000,0000,0000,,let's call is the call it the calculated brain. Dialogue: 0,0:07:13.92,0:07:17.55,Default,,0000,0000,0000,,The other, got more the stage actor, risk taker brain. Dialogue: 0,0:07:17.55,0:07:19.63,Default,,0000,0000,0000,,Let's call it the adventurous brain. Dialogue: 0,0:07:19.63,0:07:22.59,Default,,0000,0000,0000,,It sometimes acts without knowing \Neverything it has to know. Dialogue: 0,0:07:22.59,0:07:24.77,Default,,0000,0000,0000,,It sometimes makes mistakes and corrects them. Dialogue: 0,0:07:24.77,0:07:27.35,Default,,0000,0000,0000,,And I had them do this very tedious task Dialogue: 0,0:07:27.35,0:07:28.85,Default,,0000,0000,0000,,that took almost 20 minutes Dialogue: 0,0:07:28.85,0:07:30.35,Default,,0000,0000,0000,,and they had to work together. Dialogue: 0,0:07:30.35,0:07:32.63,Default,,0000,0000,0000,,Somehow simulating like a factory job Dialogue: 0,0:07:32.63,0:07:35.30,Default,,0000,0000,0000,,of repetitively doing the same thing. Dialogue: 0,0:07:35.30,0:07:37.07,Default,,0000,0000,0000,,And what I found was that people actually loved Dialogue: 0,0:07:37.07,0:07:38.72,Default,,0000,0000,0000,,the adventurous robot. Dialogue: 0,0:07:38.72,0:07:40.10,Default,,0000,0000,0000,,And they thought it was more intelligent, Dialogue: 0,0:07:40.10,0:07:42.17,Default,,0000,0000,0000,,more committed, a better member of the team, Dialogue: 0,0:07:42.17,0:07:44.27,Default,,0000,0000,0000,,contributed to the success of the team more. Dialogue: 0,0:07:44.27,0:07:45.98,Default,,0000,0000,0000,,They even called it 'he' and 'she', Dialogue: 0,0:07:45.98,0:07:48.90,Default,,0000,0000,0000,,whereas people with the calculated brain called it 'it'. Dialogue: 0,0:07:48.90,0:07:51.65,Default,,0000,0000,0000,,And nobody ever called it 'he' or 'she'. Dialogue: 0,0:07:51.65,0:07:53.50,Default,,0000,0000,0000,,When they talked about it after the task Dialogue: 0,0:07:53.50,0:07:55.19,Default,,0000,0000,0000,,with adventurous brain, (laughter) Dialogue: 0,0:07:55.19,0:07:59.28,Default,,0000,0000,0000,,they said,"by the end we were good \Nfriends and high-fived mentally." Dialogue: 0,0:07:59.28,0:08:00.71,Default,,0000,0000,0000,,Whatever that means. Dialogue: 0,0:08:00.71,0:08:03.96,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:08:03.96,0:08:06.68,Default,,0000,0000,0000,,Whereas the people with the calculated brain Dialogue: 0,0:08:06.68,0:08:09.05,Default,,0000,0000,0000,,said it was just like a lazy apprentice. Dialogue: 0,0:08:09.05,0:08:11.75,Default,,0000,0000,0000,,It only did what it was supposed \Nto do and nothing more. Dialogue: 0,0:08:11.75,0:08:14.31,Default,,0000,0000,0000,,Which is almost what people expect robots to do, Dialogue: 0,0:08:14.31,0:08:16.74,Default,,0000,0000,0000,,so I was surprised that people \Nhad higher expectations Dialogue: 0,0:08:16.74,0:08:21.89,Default,,0000,0000,0000,,of robots, than what anybody in robotics \Nthought robots should be doing. Dialogue: 0,0:08:21.89,0:08:23.86,Default,,0000,0000,0000,,And in a way, I thought, maybe it's time -- Dialogue: 0,0:08:23.86,0:08:26.72,Default,,0000,0000,0000,,just like method acting changed the way Dialogue: 0,0:08:26.72,0:08:28.15,Default,,0000,0000,0000,,people thought about acting in the 19th century, Dialogue: 0,0:08:28.15,0:08:29.99,Default,,0000,0000,0000,,from going from the very calculated, Dialogue: 0,0:08:29.99,0:08:31.77,Default,,0000,0000,0000,,planned way of behaving, Dialogue: 0,0:08:31.77,0:08:35.30,Default,,0000,0000,0000,,to a more intuitive, risk-taking, \Nembodied way of behaving. Dialogue: 0,0:08:35.30,0:08:36.70,Default,,0000,0000,0000,,Maybe it's time for robots Dialogue: 0,0:08:36.70,0:08:39.84,Default,,0000,0000,0000,,to have the same kind of revolution. Dialogue: 0,0:08:39.84,0:08:40.97,Default,,0000,0000,0000,,A few years later, Dialogue: 0,0:08:40.97,0:08:43.47,Default,,0000,0000,0000,,I was at my next research job \Nat Georgia Tech in Atlanta, Dialogue: 0,0:08:43.47,0:08:44.54,Default,,0000,0000,0000,,and I was working in a group Dialogue: 0,0:08:44.54,0:08:45.82,Default,,0000,0000,0000,,dealing with robotic musicians. Dialogue: 0,0:08:45.82,0:08:48.66,Default,,0000,0000,0000,,And I thought -- music -- that's the perfect place Dialogue: 0,0:08:48.66,0:08:51.06,Default,,0000,0000,0000,,to look at teamwork, coordination, Dialogue: 0,0:08:51.06,0:08:52.95,Default,,0000,0000,0000,,timing, improvisation -- Dialogue: 0,0:08:52.95,0:08:55.48,Default,,0000,0000,0000,,and we just got this robot playing marimba. Dialogue: 0,0:08:55.48,0:08:57.50,Default,,0000,0000,0000,,Marimba, for everybody [unclear] like me, Dialogue: 0,0:08:57.50,0:09:00.34,Default,,0000,0000,0000,,it was this huge, wooden xylophone. Dialogue: 0,0:09:00.34,0:09:03.04,Default,,0000,0000,0000,,And, when I was looking at this, Dialogue: 0,0:09:03.04,0:09:05.63,Default,,0000,0000,0000,,I looked at other works in \Nhuman-robot improvisation. Dialogue: 0,0:09:05.63,0:09:08.01,Default,,0000,0000,0000,,Yes, there are other works in \Nhuman-robot improvisation, Dialogue: 0,0:09:08.01,0:09:10.10,Default,,0000,0000,0000,,and they were also a little bit like a chess game. Dialogue: 0,0:09:10.10,0:09:11.41,Default,,0000,0000,0000,,The human would play, Dialogue: 0,0:09:11.41,0:09:13.99,Default,,0000,0000,0000,,the robot would analyze what was played -- Dialogue: 0,0:09:13.99,0:09:16.20,Default,,0000,0000,0000,,would improvise their own part. Dialogue: 0,0:09:16.20,0:09:17.87,Default,,0000,0000,0000,,So, this is what musicians called Dialogue: 0,0:09:17.87,0:09:19.35,Default,,0000,0000,0000,,a call and response interaction, Dialogue: 0,0:09:19.35,0:09:23.19,Default,,0000,0000,0000,,and it also fits very well, robots \Nand artificial intelligence. Dialogue: 0,0:09:23.19,0:09:25.68,Default,,0000,0000,0000,,But I thought, if I use the same ideas I used in the Dialogue: 0,0:09:25.68,0:09:28.23,Default,,0000,0000,0000,,theater play and in the teamwork studies, Dialogue: 0,0:09:28.23,0:09:30.99,Default,,0000,0000,0000,,maybe I can make the robots jam together Dialogue: 0,0:09:30.99,0:09:32.30,Default,,0000,0000,0000,,like a band. Dialogue: 0,0:09:32.30,0:09:36.12,Default,,0000,0000,0000,,Everybody's riffing off each other, \Nnobody is stopping it for a moment. Dialogue: 0,0:09:36.12,0:09:38.91,Default,,0000,0000,0000,,And so, I tried to do the same \Nthings, this time with music, Dialogue: 0,0:09:38.91,0:09:40.30,Default,,0000,0000,0000,,where the robot doesn't really know Dialogue: 0,0:09:40.30,0:09:41.27,Default,,0000,0000,0000,,what it's about to play. Dialogue: 0,0:09:41.27,0:09:42.54,Default,,0000,0000,0000,,It just sort of moves its body Dialogue: 0,0:09:42.54,0:09:44.77,Default,,0000,0000,0000,,and uses opportunities to play, Dialogue: 0,0:09:44.77,0:09:47.49,Default,,0000,0000,0000,,And does what my chess teacher, \Nwhen I was 17, taught me. Dialogue: 0,0:09:47.49,0:09:48.76,Default,,0000,0000,0000,,She said, when you improvise, Dialogue: 0,0:09:48.76,0:09:50.42,Default,,0000,0000,0000,,sometimes you don't know what you're doing Dialogue: 0,0:09:50.42,0:09:51.43,Default,,0000,0000,0000,,and you're still doing it. Dialogue: 0,0:09:51.43,0:09:52.86,Default,,0000,0000,0000,,And so I tried to make a robot that doesn't actually Dialogue: 0,0:09:52.86,0:09:54.81,Default,,0000,0000,0000,,know what it's doing, but it's still doing it. Dialogue: 0,0:09:54.81,0:09:57.75,Default,,0000,0000,0000,,So let's look at a few seconds \Nfrom this performance. Dialogue: 0,0:09:57.75,0:10:00.67,Default,,0000,0000,0000,,Where the robot listens to the human musician Dialogue: 0,0:10:00.67,0:10:02.47,Default,,0000,0000,0000,,and improvises. Dialogue: 0,0:10:02.47,0:10:04.85,Default,,0000,0000,0000,,And then, look how the human musician also Dialogue: 0,0:10:04.85,0:10:06.63,Default,,0000,0000,0000,,responds to what the robot is doing, and picking up Dialogue: 0,0:10:06.63,0:10:09.45,Default,,0000,0000,0000,,from its behavior. Dialogue: 0,0:10:09.45,0:10:13.98,Default,,0000,0000,0000,,And at some point can even be surprised \Nby what the robot came up with. Dialogue: 0,0:10:13.98,0:11:00.06,Default,,0000,0000,0000,,(Music is played by the musician and the robot) Dialogue: 0,0:11:00.06,0:11:05.38,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:11:05.38,0:11:07.07,Default,,0000,0000,0000,,Being a musician is not just about making notes, Dialogue: 0,0:11:07.07,0:11:09.46,Default,,0000,0000,0000,,otherwise nobody would every go see a live show. Dialogue: 0,0:11:09.46,0:11:11.38,Default,,0000,0000,0000,,Musicians also communicate with their bodies, Dialogue: 0,0:11:11.38,0:11:13.33,Default,,0000,0000,0000,,with other band members, with the audience, Dialogue: 0,0:11:13.33,0:11:15.49,Default,,0000,0000,0000,,they use their bodies to express the music. Dialogue: 0,0:11:15.49,0:11:17.87,Default,,0000,0000,0000,,And I thought, we already have \Na robot musician on stage, Dialogue: 0,0:11:17.87,0:11:20.82,Default,,0000,0000,0000,,why not make it be a full-fledged musician. Dialogue: 0,0:11:20.82,0:11:23.34,Default,,0000,0000,0000,,And I started designing a socially expressive head Dialogue: 0,0:11:23.34,0:11:24.88,Default,,0000,0000,0000,,for the robot. Dialogue: 0,0:11:24.88,0:11:26.71,Default,,0000,0000,0000,,The head does't actually touch the marimba, Dialogue: 0,0:11:26.71,0:11:28.35,Default,,0000,0000,0000,,it just expresses what the music is like. Dialogue: 0,0:11:28.35,0:11:31.43,Default,,0000,0000,0000,,These are some napkin sketches \Nfrom a bar in Atlanta, Dialogue: 0,0:11:31.43,0:11:34.05,Default,,0000,0000,0000,,that was dangerously located exactly halfway Dialogue: 0,0:11:34.05,0:11:35.50,Default,,0000,0000,0000,,between my lab and my home. (Laughter) Dialogue: 0,0:11:35.50,0:11:36.92,Default,,0000,0000,0000,,So I spent, I would say on average, Dialogue: 0,0:11:36.92,0:11:39.85,Default,,0000,0000,0000,,three to four hours a day there. Dialogue: 0,0:11:39.85,0:11:42.74,Default,,0000,0000,0000,,I think. (Laughter) Dialogue: 0,0:11:42.74,0:11:45.72,Default,,0000,0000,0000,,And I went back to my animation \Ntools and tried to figure out Dialogue: 0,0:11:45.72,0:11:47.90,Default,,0000,0000,0000,,not just what a robotic musician would look like, Dialogue: 0,0:11:47.90,0:11:50.71,Default,,0000,0000,0000,,but especially what a robotic \Nmusician would move like. Dialogue: 0,0:11:50.71,0:11:54.01,Default,,0000,0000,0000,,To sort of show that it doesn't like \Nwhat the other person is playing -- Dialogue: 0,0:11:54.01,0:11:56.49,Default,,0000,0000,0000,,and maybe show whatever beat it's feeling Dialogue: 0,0:11:56.49,0:11:58.14,Default,,0000,0000,0000,,at the moment. (Laughter) Dialogue: 0,0:11:58.14,0:12:02.67,Default,,0000,0000,0000,,So we ended up actually getting the money \Nto build this robot which was nice. Dialogue: 0,0:12:02.67,0:12:04.65,Default,,0000,0000,0000,,I'm going to show you now the \Nsame kind of performance -- Dialogue: 0,0:12:04.65,0:12:07.22,Default,,0000,0000,0000,,this time with a socially expressive head. Dialogue: 0,0:12:07.22,0:12:09.18,Default,,0000,0000,0000,,And notice one thing -- Dialogue: 0,0:12:09.18,0:12:10.88,Default,,0000,0000,0000,,how the robot is really showing us Dialogue: 0,0:12:10.88,0:12:12.74,Default,,0000,0000,0000,,the beat it's picking up from the human. Dialogue: 0,0:12:12.74,0:12:16.76,Default,,0000,0000,0000,,When also giving the human a sense, \Nlike the robot knows what it's doing. Dialogue: 0,0:12:16.76,0:12:18.14,Default,,0000,0000,0000,,And also how it changes the way it moves\N Dialogue: 0,0:12:18.14,0:12:21.82,Default,,0000,0000,0000,,as soon as it starts its own solo. Dialogue: 0,0:12:21.82,0:12:49.06,Default,,0000,0000,0000,,(Robot interacting with music played by musician) Dialogue: 0,0:12:49.06,0:12:52.23,Default,,0000,0000,0000,,And now look at the final chord of the piece again, Dialogue: 0,0:12:52.23,0:12:55.07,Default,,0000,0000,0000,,and this time the robot communicates with its body Dialogue: 0,0:12:55.07,0:12:57.20,Default,,0000,0000,0000,,when it's busy doing its own thing. Dialogue: 0,0:12:57.20,0:12:58.82,Default,,0000,0000,0000,,And when its ready Dialogue: 0,0:12:58.82,0:13:02.17,Default,,0000,0000,0000,,to coordinate the final chord with me. Dialogue: 0,0:13:02.17,0:13:14.33,Default,,0000,0000,0000,,(Musician and robot playing music together) Dialogue: 0,0:13:14.33,0:13:17.89,Default,,0000,0000,0000,,(Robot and musician play final chord in synchrony) Dialogue: 0,0:13:17.89,0:13:20.91,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:13:20.91,0:13:25.26,Default,,0000,0000,0000,,Thanks. I hope you see how much this, Dialogue: 0,0:13:25.26,0:13:27.94,Default,,0000,0000,0000,,how much this part of the body \Nthat doesn't touch the instrument Dialogue: 0,0:13:27.94,0:13:32.14,Default,,0000,0000,0000,,actually helps with the musical performance. Dialogue: 0,0:13:32.14,0:13:34.53,Default,,0000,0000,0000,,We are in Atlanta, so obviously some rapper Dialogue: 0,0:13:34.53,0:13:36.40,Default,,0000,0000,0000,,will come into our lab at some point. (Laughter) Dialogue: 0,0:13:36.40,0:13:38.64,Default,,0000,0000,0000,,And we had this rapper come in Dialogue: 0,0:13:38.64,0:13:41.21,Default,,0000,0000,0000,,and do a little jam with the robot. Dialogue: 0,0:13:41.21,0:13:43.91,Default,,0000,0000,0000,,And here you can see the robot Dialogue: 0,0:13:43.91,0:13:45.14,Default,,0000,0000,0000,,basically responding to the beat and -- Dialogue: 0,0:13:45.14,0:13:47.100,Default,,0000,0000,0000,,notice two things. One, how irresistible it is Dialogue: 0,0:13:47.100,0:13:50.51,Default,,0000,0000,0000,,to join the robot while it's moving its head. Dialogue: 0,0:13:50.05,0:13:52.03,Default,,0000,0000,0000,,and you kind of want to move \Nyour own head when it does it. Dialogue: 0,0:13:52.03,0:13:56.21,Default,,0000,0000,0000,,And second, even though the rapper \Nis really focused on his iPhone, Dialogue: 0,0:13:56.21,0:13:59.12,Default,,0000,0000,0000,,as soon as the robot turns to him, he turns back. Dialogue: 0,0:13:59.12,0:14:01.20,Default,,0000,0000,0000,,So even though it's just in \Nthe periphery of his vision -- Dialogue: 0,0:14:01.20,0:14:03.77,Default,,0000,0000,0000,,it's just in the corner of his eye -- \Nit's very powerful. Dialogue: 0,0:14:03.77,0:14:05.82,Default,,0000,0000,0000,,And the reason is that we can't ignore Dialogue: 0,0:14:05.82,0:14:07.52,Default,,0000,0000,0000,,physical things moving our environment. Dialogue: 0,0:14:07.52,0:14:09.29,Default,,0000,0000,0000,,We are wired for that. Dialogue: 0,0:14:09.29,0:14:12.62,Default,,0000,0000,0000,,So, if you have a problem with maybe your partners Dialogue: 0,0:14:12.62,0:14:15.81,Default,,0000,0000,0000,,looking at the iPhone too much \Nor their smartphone too much, Dialogue: 0,0:14:15.81,0:14:16.85,Default,,0000,0000,0000,,you might want to have a robot there Dialogue: 0,0:14:16.85,0:14:18.64,Default,,0000,0000,0000,,to get their attention. (Laughter) Dialogue: 0,0:14:18.64,0:14:36.89,Default,,0000,0000,0000,,(Rapping to music) Dialogue: 0,0:14:36.89,0:14:39.01,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:14:39.01,0:14:45.61,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:14:45.61,0:14:48.17,Default,,0000,0000,0000,,Just to introduce the last robot Dialogue: 0,0:14:48.17,0:14:49.74,Default,,0000,0000,0000,,that we've worked on -- Dialogue: 0,0:14:49.74,0:14:51.35,Default,,0000,0000,0000,,that came out of something kind \Nof surprising that we found -- Dialogue: 0,0:14:51.35,0:14:54.48,Default,,0000,0000,0000,,at some point people didn't care anymore \Nabout the robot being so intelligent, Dialogue: 0,0:14:54.48,0:14:56.04,Default,,0000,0000,0000,,and can improvise and listen, Dialogue: 0,0:14:56.04,0:15:00.75,Default,,0000,0000,0000,,and do all these embodied intelligence \Nthings that I spent years on developing. Dialogue: 0,0:15:00.75,0:15:04.26,Default,,0000,0000,0000,,They really like that the robot \Nwas enjoying the music. Dialogue: 0,0:15:04.26,0:15:06.32,Default,,0000,0000,0000,,And they didn't say that the \Nrobot was moving to the music, Dialogue: 0,0:15:06.32,0:15:08.34,Default,,0000,0000,0000,,they said that the robot was enjoying the music. Dialogue: 0,0:15:08.34,0:15:10.74,Default,,0000,0000,0000,,And we thought, why don't we take this idea, Dialogue: 0,0:15:10.74,0:15:13.63,Default,,0000,0000,0000,,and I designed a new piece of furniture. Dialogue: 0,0:15:13.63,0:15:15.72,Default,,0000,0000,0000,,This time it wasn't a desk \Nlamp it was a speaker dock. Dialogue: 0,0:15:15.72,0:15:18.83,Default,,0000,0000,0000,,It was one of those things you \Nplug your smartphone in. Dialogue: 0,0:15:18.83,0:15:20.54,Default,,0000,0000,0000,,And I thought, what would happen Dialogue: 0,0:15:20.54,0:15:23.15,Default,,0000,0000,0000,,if your speaker dock didn't \Njust play the music for you, Dialogue: 0,0:15:23.15,0:15:25.66,Default,,0000,0000,0000,,but it would actually enjoy it to. (Laughter) Dialogue: 0,0:15:25.66,0:15:27.43,Default,,0000,0000,0000,,And so again, here are some animation tests Dialogue: 0,0:15:27.43,0:15:31.84,Default,,0000,0000,0000,,from an early stage. (Laughter) Dialogue: 0,0:15:31.84,0:15:36.00,Default,,0000,0000,0000,,And this is what the final product looked like. Dialogue: 0,0:15:47.22,0:16:09.46,Default,,0000,0000,0000,,(Music playing in synchrony \Nwith the robot's movements) Dialogue: 0,0:16:09.46,0:16:12.10,Default,,0000,0000,0000,,So, a lot of bobbing head. Dialogue: 0,0:16:12.10,0:16:15.70,Default,,0000,0000,0000,,(Applause) Dialogue: 0,0:16:15.70,0:16:17.23,Default,,0000,0000,0000,,A lot of bobbing heads in the audience, Dialogue: 0,0:16:17.23,0:16:20.39,Default,,0000,0000,0000,,so we can still see robots influence people. Dialogue: 0,0:16:20.39,0:16:23.03,Default,,0000,0000,0000,,And it's not just fun and games. Dialogue: 0,0:16:23.03,0:16:25.13,Default,,0000,0000,0000,,I think one of the reasons I care so much Dialogue: 0,0:16:25.13,0:16:27.21,Default,,0000,0000,0000,,about robots that use their body to communicate Dialogue: 0,0:16:27.21,0:16:29.41,Default,,0000,0000,0000,,and use their body to move -- Dialogue: 0,0:16:29.41,0:16:32.64,Default,,0000,0000,0000,,and I'm going to let you in on a little \Nsecret we roboticists are hiding -- Dialogue: 0,0:16:32.64,0:16:34.63,Default,,0000,0000,0000,,is that every one of you is \Ngoing to be living with a robot Dialogue: 0,0:16:34.63,0:16:37.25,Default,,0000,0000,0000,,at some point in their life. (Laughter) Dialogue: 0,0:16:37.25,0:16:39.55,Default,,0000,0000,0000,,Somewhere in your future there's \Ngoing to be a robot in your life. Dialogue: 0,0:16:39.55,0:16:41.68,Default,,0000,0000,0000,,And if not in yours, then in your children's life. Dialogue: 0,0:16:41.68,0:16:43.47,Default,,0000,0000,0000,,And I want these robots to be -- Dialogue: 0,0:16:43.47,0:16:46.96,Default,,0000,0000,0000,,to be more fluent, more engaging, more graceful Dialogue: 0,0:16:46.96,0:16:48.75,Default,,0000,0000,0000,,than currently they seem to be. Dialogue: 0,0:16:48.75,0:16:50.67,Default,,0000,0000,0000,,And for that I think that maybe robots Dialogue: 0,0:16:50.67,0:16:52.03,Default,,0000,0000,0000,,need to be less like chess players Dialogue: 0,0:16:52.03,0:16:54.74,Default,,0000,0000,0000,,and more like stage actors and more like musicians. Dialogue: 0,0:16:54.74,0:16:57.68,Default,,0000,0000,0000,,Maybe they should be able to \Ntake chances and improvise. Dialogue: 0,0:16:57.68,0:17:00.18,Default,,0000,0000,0000,,And maybe they should be able to \Nanticipate what you're about to do. Dialogue: 0,0:17:00.18,0:17:02.76,Default,,0000,0000,0000,,And maybe they need to be able to make mistakes Dialogue: 0,0:17:02.76,0:17:03.98,Default,,0000,0000,0000,,and correct them, Dialogue: 0,0:17:03.98,0:17:06.02,Default,,0000,0000,0000,,because in the end we are human. Dialogue: 0,0:17:06.02,0:17:09.39,Default,,0000,0000,0000,,And maybe as humans, robots \Nthat are a little less than perfect Dialogue: 0,0:17:09.39,0:17:11.25,Default,,0000,0000,0000,,are just perfect for us. Dialogue: 0,0:17:11.25,0:17:12.77,Default,,0000,0000,0000,,Thank you. Dialogue: 0,0:17:12.77,0:17:16.19,Default,,0000,0000,0000,,(Applause)