[Script Info] Title: [Events] Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text Dialogue: 0,0:00:13.30,0:00:17.15,Default,,0000,0000,0000,,The rise of the machines! Dialogue: 0,0:00:17.93,0:00:22.75,Default,,0000,0000,0000,,Who here is scared of killer robots? Dialogue: 0,0:00:23.14,0:00:25.25,Default,,0000,0000,0000,,(Laughter) Dialogue: 0,0:00:25.61,0:00:27.21,Default,,0000,0000,0000,,I am! Dialogue: 0,0:00:28.23,0:00:31.90,Default,,0000,0000,0000,,I used to work in UAVs -\NUnmanned Aerial Vehicles - Dialogue: 0,0:00:31.90,0:00:36.74,Default,,0000,0000,0000,,and all I could think seeing\Nthese things is that someday, Dialogue: 0,0:00:37.13,0:00:40.90,Default,,0000,0000,0000,,somebody is going to strap\Na machine-gun to these things, Dialogue: 0,0:00:40.90,0:00:43.85,Default,,0000,0000,0000,,and they're going\Nto hunt me down in swarms. Dialogue: 0,0:00:44.69,0:00:49.85,Default,,0000,0000,0000,,I work in robotics at Brown University\Nand I'm scared of robots. Dialogue: 0,0:00:50.54,0:00:53.28,Default,,0000,0000,0000,,Actually, I'm kind of terrified, Dialogue: 0,0:00:53.76,0:00:55.81,Default,,0000,0000,0000,,but, can you blame me? Dialogue: 0,0:00:55.81,0:00:59.50,Default,,0000,0000,0000,,Ever since I was a kid,\Nall I've seen are movies Dialogue: 0,0:00:59.50,0:01:03.01,Default,,0000,0000,0000,,that portrayed the ascendance\Nof Artificial Intelligence Dialogue: 0,0:01:03.01,0:01:05.81,Default,,0000,0000,0000,,and our inevitable conflict with it - Dialogue: 0,0:01:05.81,0:01:11.04,Default,,0000,0000,0000,,2001 Space Odyssey,\NThe Terminator, The Matrix - Dialogue: 0,0:01:11.80,0:01:16.20,Default,,0000,0000,0000,,and the stories they tell are pretty scary: Dialogue: 0,0:01:16.20,0:01:20.92,Default,,0000,0000,0000,,rogue bands of humans running away\Nfrom super intelligent machines. Dialogue: 0,0:01:21.94,0:01:26.80,Default,,0000,0000,0000,,That scares me. From the hands, \Nit seems like it scares you as well. Dialogue: 0,0:01:26.80,0:01:30.24,Default,,0000,0000,0000,,I know it is scary to Elon Musk. Dialogue: 0,0:01:30.82,0:01:35.24,Default,,0000,0000,0000,,But, you know, we have a little bit\Nof time before the robots rise up. Dialogue: 0,0:01:35.24,0:01:38.57,Default,,0000,0000,0000,,Robots like the PR2\Nthat I have at my initiative, Dialogue: 0,0:01:38.57,0:01:41.38,Default,,0000,0000,0000,,they can't even open the door yet. Dialogue: 0,0:01:42.19,0:01:46.71,Default,,0000,0000,0000,,So in my mind, this discussion\Nof super intelligent robots Dialogue: 0,0:01:46.71,0:01:51.100,Default,,0000,0000,0000,,is a little bit of a distraction\Nfrom something far more insidious Dialogue: 0,0:01:51.100,0:01:56.22,Default,,0000,0000,0000,,that is going on with AI systems\Nacross the country. Dialogue: 0,0:01:56.92,0:02:00.07,Default,,0000,0000,0000,,You see, right now,\Nthere are people - Dialogue: 0,0:02:00.07,0:02:04.23,Default,,0000,0000,0000,,doctors, judges, accountants - Dialogue: 0,0:02:04.23,0:02:07.96,Default,,0000,0000,0000,,who are getting information\Nfrom an AI system Dialogue: 0,0:02:07.96,0:02:12.72,Default,,0000,0000,0000,,and treating it as if it is information\Nfrom a trusted colleague. Dialogue: 0,0:02:13.93,0:02:16.90,Default,,0000,0000,0000,,It's this trust that bothers me Dialogue: 0,0:02:17.14,0:02:20.18,Default,,0000,0000,0000,,not because of how often\NAI gets it wrong. Dialogue: 0,0:02:20.18,0:02:24.40,Default,,0000,0000,0000,,AI researchers pride themselves\Nin accuracy on results. Dialogue: 0,0:02:24.87,0:02:27.85,Default,,0000,0000,0000,,It's how badly it gets it wrong\Nwhen it makes a mistake Dialogue: 0,0:02:27.85,0:02:29.78,Default,,0000,0000,0000,,that has me worried. Dialogue: 0,0:02:29.78,0:02:33.58,Default,,0000,0000,0000,,These systems do not fail gracefully. Dialogue: 0,0:02:34.24,0:02:36.96,Default,,0000,0000,0000,,So, let's take a look\Nat what this looks like. Dialogue: 0,0:02:37.12,0:02:42.56,Default,,0000,0000,0000,,This is a dog that has been misidentified\Nas a wolf by an AI algorithm. Dialogue: 0,0:02:43.23,0:02:45.24,Default,,0000,0000,0000,,The researchers wanted to know: Dialogue: 0,0:02:45.24,0:02:49.51,Default,,0000,0000,0000,,why did this particular husky\Nget misidentified as a wolf? Dialogue: 0,0:02:49.75,0:02:52.72,Default,,0000,0000,0000,,So they rewrote the algorithm\Nto explain to them Dialogue: 0,0:02:52.72,0:02:55.65,Default,,0000,0000,0000,,the parts of the picture\Nit was paying attention to Dialogue: 0,0:02:55.65,0:02:58.50,Default,,0000,0000,0000,,when the AI algorithm made its decision. Dialogue: 0,0:02:59.04,0:03:02.75,Default,,0000,0000,0000,,In this picture, what do you\Nthink it paid attention to? Dialogue: 0,0:03:02.87,0:03:05.10,Default,,0000,0000,0000,,What would you pay attention to? Dialogue: 0,0:03:05.36,0:03:10.48,Default,,0000,0000,0000,,Maybe the eyes,\Nmaybe the ears, the snout ... Dialogue: 0,0:03:13.04,0:03:16.53,Default,,0000,0000,0000,,This is what it paid attention to: Dialogue: 0,0:03:16.98,0:03:20.39,Default,,0000,0000,0000,,mostly the snow\Nand the background of the picture. Dialogue: 0,0:03:21.00,0:03:25.85,Default,,0000,0000,0000,,You see, there was bias in the data set\Nthat was fed to this algorithm. Dialogue: 0,0:03:26.29,0:03:30.37,Default,,0000,0000,0000,,Most of the pictures of wolves were in snow, Dialogue: 0,0:03:30.57,0:03:34.78,Default,,0000,0000,0000,,so the AI algorithm conflated\Nthe presence or absence of snow Dialogue: 0,0:03:34.78,0:03:38.37,Default,,0000,0000,0000,,for the presence or absence of a wolf. Dialogue: 0,0:03:39.91,0:03:42.03,Default,,0000,0000,0000,,The scary thing about this Dialogue: 0,0:03:42.03,0:03:46.29,Default,,0000,0000,0000,,is the researchers had\Nno idea this was happening Dialogue: 0,0:03:46.29,0:03:50.11,Default,,0000,0000,0000,,until they rewrote\Nthe algorithm to explain itself. Dialogue: 0,0:03:50.84,0:03:55.33,Default,,0000,0000,0000,,And that's the thing with AI algorithms,\Ndeep learning, machine learning. Dialogue: 0,0:03:55.33,0:03:59.35,Default,,0000,0000,0000,,Even the developers who work on this stuff Dialogue: 0,0:03:59.35,0:04:02.40,Default,,0000,0000,0000,,have no idea what it's doing. Dialogue: 0,0:04:03.00,0:04:07.59,Default,,0000,0000,0000,,So, that might be\Na great example for a research, Dialogue: 0,0:04:07.59,0:04:10.28,Default,,0000,0000,0000,,but what does this mean in the real world? Dialogue: 0,0:04:10.61,0:04:15.84,Default,,0000,0000,0000,,The Compas Criminal Sentencing\Nalgorithm is used in 13 states Dialogue: 0,0:04:15.84,0:04:17.99,Default,,0000,0000,0000,,to determine criminal recidivism Dialogue: 0,0:04:17.99,0:04:22.47,Default,,0000,0000,0000,,or the risk of committing\Na crime again after you're released. Dialogue: 0,0:04:23.20,0:04:26.96,Default,,0000,0000,0000,,ProPublica found\Nthat if you're African-American, Dialogue: 0,0:04:26.96,0:04:32.02,Default,,0000,0000,0000,,Compas was 77% more likely to qualify\Nyou as a potentially violent offender Dialogue: 0,0:04:32.02,0:04:34.12,Default,,0000,0000,0000,,than if you're a Caucasian. Dialogue: 0,0:04:34.78,0:04:39.40,Default,,0000,0000,0000,,This is a real system being used\Nin the real world by real judges Dialogue: 0,0:04:39.40,0:04:42.43,Default,,0000,0000,0000,,to make decisions about real people's lives. Dialogue: 0,0:04:44.12,0:04:48.82,Default,,0000,0000,0000,,Why would the judges trust it\Nif it seems to exhibit bias? Dialogue: 0,0:04:49.87,0:04:55.18,Default,,0000,0000,0000,,Well, the reason they use Compas\Nis because it is a model for efficiency. Dialogue: 0,0:04:55.62,0:05:00.07,Default,,0000,0000,0000,,Compas lets them go\Nthrough caseloads much faster Dialogue: 0,0:05:00.07,0:05:02.99,Default,,0000,0000,0000,,in a backlogged criminal justice system. Dialogue: 0,0:05:04.88,0:05:07.30,Default,,0000,0000,0000,,Why would they question\Ntheir own software? Dialogue: 0,0:05:07.30,0:05:10.96,Default,,0000,0000,0000,,It's been requisitioned by the State,\Napproved by their IT Department. Dialogue: 0,0:05:10.96,0:05:13.36,Default,,0000,0000,0000,,Why would they question it? Dialogue: 0,0:05:13.36,0:05:16.51,Default,,0000,0000,0000,,Well, the people sentenced\Nby Compas have questioned it, Dialogue: 0,0:05:16.51,0:05:18.85,Default,,0000,0000,0000,,and their lawsuits should chill us all. Dialogue: 0,0:05:19.24,0:05:22.12,Default,,0000,0000,0000,,The Wisconsin State Supreme Court ruled Dialogue: 0,0:05:22.12,0:05:25.64,Default,,0000,0000,0000,,that compass did not deny\Na defendant due process Dialogue: 0,0:05:25.64,0:05:28.43,Default,,0000,0000,0000,,provided it was used "properly." Dialogue: 0,0:05:28.96,0:05:30.69,Default,,0000,0000,0000,,In the same set of rulings, they ruled Dialogue: 0,0:05:30.69,0:05:34.76,Default,,0000,0000,0000,,that the defendant could not inspect\Nthe source code of Compass. Dialogue: 0,0:05:35.70,0:05:39.99,Default,,0000,0000,0000,,It has to be used properly\Nbut you can't inspect the source code? Dialogue: 0,0:05:40.42,0:05:43.42,Default,,0000,0000,0000,,This is a disturbing set of rulings\Nwhen taken together Dialogue: 0,0:05:43.42,0:05:46.18,Default,,0000,0000,0000,,for anyone facing criminal sentencing. Dialogue: 0,0:05:46.62,0:05:50.70,Default,,0000,0000,0000,,You may not care about this because\Nyou're not facing criminal sentencing, Dialogue: 0,0:05:51.06,0:05:55.06,Default,,0000,0000,0000,,but what if I told you\Nthat black box AI algorithms like this Dialogue: 0,0:05:55.06,0:05:59.38,Default,,0000,0000,0000,,are being used to decide whether or not\Nyou can get a loan for your house, Dialogue: 0,0:06:00.14,0:06:02.84,Default,,0000,0000,0000,,whether you get a job interview, Dialogue: 0,0:06:03.36,0:06:05.86,Default,,0000,0000,0000,,whether you get Medicaid, Dialogue: 0,0:06:05.95,0:06:10.43,Default,,0000,0000,0000,,and are even driving cars \Nand trucks down the highway. Dialogue: 0,0:06:10.83,0:06:14.53,Default,,0000,0000,0000,,Would you want the public\Nto be able to inspect the algorithm Dialogue: 0,0:06:14.53,0:06:17.24,Default,,0000,0000,0000,,that's trying to make a decisiom\Nbetween a shopping cart \N Dialogue: 0,0:06:17.24,0:06:20.90,Default,,0000,0000,0000,,and a baby carriage\Nin a self-driving truck, Dialogue: 0,0:06:20.90,0:06:23.68,Default,,0000,0000,0000,,in the same way the dog/wolf\Nalgorithm was trying to decide Dialogue: 0,0:06:23.68,0:06:26.07,Default,,0000,0000,0000,,between a dog or a wolf? Dialogue: 0,0:06:26.28,0:06:31.46,Default,,0000,0000,0000,,Are you potentially a metaphorical dog\Nwho's been misidentified as a wolf Dialogue: 0,0:06:31.46,0:06:34.26,Default,,0000,0000,0000,,by somebody's AI algorithm? Dialogue: 0,0:06:34.87,0:06:38.72,Default,,0000,0000,0000,,Considering the complexity\Nof people, it's possible. Dialogue: 0,0:06:38.81,0:06:42.03,Default,,0000,0000,0000,,Is there anything\Nyou can do about it now? Dialogue: 0,0:06:42.03,0:06:46.84,Default,,0000,0000,0000,,Probably not, and that's\Nwhat we need to focus on. Dialogue: 0,0:06:47.49,0:06:50.57,Default,,0000,0000,0000,,We need to demand\Nstandards of accountability, Dialogue: 0,0:06:50.57,0:06:55.40,Default,,0000,0000,0000,,transparency and recourse in AI systems. Dialogue: 0,0:06:56.46,0:07:01.03,Default,,0000,0000,0000,,ISO, the International Standards\NOrganization, just formed a committee Dialogue: 0,0:07:01.03,0:07:04.50,Default,,0000,0000,0000,,to make decisions about\Nwhat to do for AI standards. Dialogue: 0,0:07:04.92,0:07:08.74,Default,,0000,0000,0000,,They're about five years out\Nfrom coming up with a standard. Dialogue: 0,0:07:08.99,0:07:12.48,Default,,0000,0000,0000,,These systems are being used now, Dialogue: 0,0:07:13.67,0:07:19.36,Default,,0000,0000,0000,,not just in loans, but they're being\Nused in vehicles like I was saying. Dialogue: 0,0:07:20.84,0:07:25.27,Default,,0000,0000,0000,,They're being used in things like\NCooperative Adaptive Cruise Control. Dialogue: 0,0:07:25.27,0:07:27.97,Default,,0000,0000,0000,,It's funny that they call that "cruise control" Dialogue: 0,0:07:27.97,0:07:32.70,Default,,0000,0000,0000,,because the type of controller used\Nin cruise control, a PID controller, Dialogue: 0,0:07:32.70,0:07:38.32,Default,,0000,0000,0000,,was used for 30 years in chemical plants\Nbefore it ever made into a car. Dialogue: 0,0:07:39.14,0:07:41.14,Default,,0000,0000,0000,,The type of controller that's used\N Dialogue: 0,0:07:41.14,0:07:44.63,Default,,0000,0000,0000,,to drive a self-driving car\Nand a machine learning, Dialogue: 0,0:07:44.63,0:07:48.88,Default,,0000,0000,0000,,that's only been used\Nin research since 2007. Dialogue: 0,0:07:49.68,0:07:52.23,Default,,0000,0000,0000,,These are new technologies. Dialogue: 0,0:07:52.47,0:07:56.43,Default,,0000,0000,0000,,We need to demand the standards\Nand we need to demand regulation Dialogue: 0,0:07:56.43,0:08:00.34,Default,,0000,0000,0000,,so that we don't get snake oil \Nin the marketplace. Dialogue: 0,0:08:00.82,0:08:05.06,Default,,0000,0000,0000,,And we also have to have\Na little bit of skepticism. Dialogue: 0,0:08:05.86,0:08:07.87,Default,,0000,0000,0000,,The experiments in Authority Dialogue: 0,0:08:07.87,0:08:11.12,Default,,0000,0000,0000,,done by Stanley Milgram\Nafter World War II, Dialogue: 0,0:08:11.12,0:08:16.03,Default,,0000,0000,0000,,showed that your average person\Nwould follow an authority figures orders Dialogue: 0,0:08:16.03,0:08:19.74,Default,,0000,0000,0000,,even if it meant harming their fellow citizen. Dialogue: 0,0:08:20.46,0:08:22.85,Default,,0000,0000,0000,,In this experiment, Dialogue: 0,0:08:22.85,0:08:27.13,Default,,0000,0000,0000,,every day Americans would shock an actor Dialogue: 0,0:08:27.69,0:08:31.27,Default,,0000,0000,0000,,past the point of him\Ncomplaining about her trouble, Dialogue: 0,0:08:31.58,0:08:35.43,Default,,0000,0000,0000,,past the point of him screaming in pain, Dialogue: 0,0:08:35.93,0:08:40.89,Default,,0000,0000,0000,,past the point of him\Ngoing silent in simulated death, Dialogue: 0,0:08:41.61,0:08:44.10,Default,,0000,0000,0000,,all because somebody Dialogue: 0,0:08:44.10,0:08:47.97,Default,,0000,0000,0000,,with no credentials, in a lab coat, Dialogue: 0,0:08:47.97,0:08:50.80,Default,,0000,0000,0000,,was saying some variation of the phrase Dialogue: 0,0:08:50.80,0:08:54.48,Default,,0000,0000,0000,,"The experiment must continue." Dialogue: 0,0:08:56.94,0:09:02.40,Default,,0000,0000,0000,,In AI, we have Milgram's\Nultimate authority figure. Dialogue: 0,0:09:03.66,0:09:08.37,Default,,0000,0000,0000,,We have a dispassionate\Nsystem that can't reflect, Dialogue: 0,0:09:09.37,0:09:12.64,Default,,0000,0000,0000,,that can't make another decision, Dialogue: 0,0:09:12.92,0:09:14.90,Default,,0000,0000,0000,,that there is no recourse to, Dialogue: 0,0:09:15.07,0:09:20.45,Default,,0000,0000,0000,,that will always say "The system\Nor "The process must continue." Dialogue: 0,0:09:23.31,0:09:25.88,Default,,0000,0000,0000,,Now, I'm going to tell you a little story. Dialogue: 0,0:09:25.88,0:09:29.72,Default,,0000,0000,0000,,It's about a car trip I took\Ndriving across country. Dialogue: 0,0:09:30.79,0:09:34.69,Default,,0000,0000,0000,,I was coming into Salt Lake City\Nand it started raining. Dialogue: 0,0:09:35.21,0:09:39.90,Default,,0000,0000,0000,,As I climbed into the mountains,\Nthat rain turned into snow, Dialogue: 0,0:09:40.38,0:09:42.58,Default,,0000,0000,0000,,and pretty soon that snow was whiteout. Dialogue: 0,0:09:42.58,0:09:45.72,Default,,0000,0000,0000,,I couldn't see the taillights\Nof the car in front of me. Dialogue: 0,0:09:46.15,0:09:48.02,Default,,0000,0000,0000,,I started skidding. Dialogue: 0,0:09:48.02,0:09:51.03,Default,,0000,0000,0000,,I went 360 one way,\NI went 360 the other way. Dialogue: 0,0:09:51.03,0:09:52.77,Default,,0000,0000,0000,,I went off the highway.\N Dialogue: 0,0:09:52.77,0:09:54.95,Default,,0000,0000,0000,,Mud-coated my windows,\NI couldn't see a thing. Dialogue: 0,0:09:54.95,0:09:59.10,Default,,0000,0000,0000,,I was terrified some car was going\Nto come crashing into me. Dialogue: 0,0:09:59.92,0:10:03.86,Default,,0000,0000,0000,,Now, I'm telling you this story\Nto get you thinking Dialogue: 0,0:10:03.86,0:10:07.32,Default,,0000,0000,0000,,about how something small \Nand seemingly mundane Dialogue: 0,0:10:07.32,0:10:10.09,Default,,0000,0000,0000,,like a little bit precipitation, Dialogue: 0,0:10:10.09,0:10:14.58,Default,,0000,0000,0000,,can easily grow\Ninto something very dangerous. Dialogue: 0,0:10:15.41,0:10:19.79,Default,,0000,0000,0000,,We are driving in the rain\Nwith AI right now, Dialogue: 0,0:10:20.44,0:10:23.40,Default,,0000,0000,0000,,and that rain will turn to snow, Dialogue: 0,0:10:23.89,0:10:27.46,Default,,0000,0000,0000,,and that snow could become a blizzard. Dialogue: 0,0:10:28.10,0:10:30.35,Default,,0000,0000,0000,,We need to pause, Dialogue: 0,0:10:30.54,0:10:32.86,Default,,0000,0000,0000,,check the conditions, Dialogue: 0,0:10:33.00,0:10:35.50,Default,,0000,0000,0000,,put in place safety standards, Dialogue: 0,0:10:35.64,0:10:41.23,Default,,0000,0000,0000,,and ask ourselves\Nhow far do we want to go, Dialogue: 0,0:10:42.27,0:10:46.44,Default,,0000,0000,0000,,because the economic incentives\Nfor AI and automation Dialogue: 0,0:10:46.44,0:10:48.36,Default,,0000,0000,0000,,to replace human labor Dialogue: 0,0:10:48.36,0:10:53.31,Default,,0000,0000,0000,,will be beyond anything we have seen\Nsince the Industrial Revolution. Dialogue: 0,0:10:54.04,0:10:58.04,Default,,0000,0000,0000,,Human salary demands can't compete Dialogue: 0,0:10:58.04,0:11:01.65,Default,,0000,0000,0000,,with the base cost of electricity. Dialogue: 0,0:11:02.48,0:11:07.92,Default,,0000,0000,0000,,AIs and robots will replace\Nfry cooks and fast-food joints Dialogue: 0,0:11:07.92,0:11:10.42,Default,,0000,0000,0000,,and radiologists in hospitals. Dialogue: 0,0:11:11.14,0:11:14.33,Default,,0000,0000,0000,,Someday, the AI will diagnose your cancer, Dialogue: 0,0:11:14.33,0:11:17.43,Default,,0000,0000,0000,,and a robot will perform the surgery. Dialogue: 0,0:11:17.96,0:11:22.42,Default,,0000,0000,0000,,Only a healthy skepticism of these systems Dialogue: 0,0:11:22.42,0:11:25.98,Default,,0000,0000,0000,,is going to help keep people in the loop. Dialogue: 0,0:11:26.29,0:11:31.47,Default,,0000,0000,0000,,And I'm confident, if we can\Nkeep people in the loop, Dialogue: 0,0:11:31.47,0:11:36.39,Default,,0000,0000,0000,,if we can build transparent\NAI systems like the dog/wolf example Dialogue: 0,0:11:36.39,0:11:39.66,Default,,0000,0000,0000,,where the AI explained\Nwhat it was doing to people, Dialogue: 0,0:11:39.66,0:11:42.59,Default,,0000,0000,0000,,and people were able to spot-check it, Dialogue: 0,0:11:42.59,0:11:47.03,Default,,0000,0000,0000,,we can create new jobs\Nfor people partnering with AI. Dialogue: 0,0:11:48.57,0:11:51.04,Default,,0000,0000,0000,,If we work together with AI, Dialogue: 0,0:11:51.04,0:11:55.56,Default,,0000,0000,0000,,we will probably be able to solve\Nsome of our greatest challenges. Dialogue: 0,0:11:56.76,0:12:01.35,Default,,0000,0000,0000,,But to do that, we need\Nto lead and not follow. Dialogue: 0,0:12:01.80,0:12:05.49,Default,,0000,0000,0000,,We need to choose to be less like robots,\N Dialogue: 0,0:12:05.49,0:12:10.13,Default,,0000,0000,0000,,and we need to build the robots\Nto be more like people, Dialogue: 0,0:12:11.02,0:12:13.35,Default,,0000,0000,0000,,because ultimately, Dialogue: 0,0:12:13.35,0:12:18.16,Default,,0000,0000,0000,,the only thing we need to fear\Nis not killer robots, Dialogue: 0,0:12:18.70,0:12:21.64,Default,,0000,0000,0000,,it's our own intellectual laziness. Dialogue: 0,0:12:22.22,0:12:26.66,Default,,0000,0000,0000,,The only thing we need\Nto fear is ourselves. Dialogue: 0,0:12:26.99,0:12:28.44,Default,,0000,0000,0000,,Thank you. Dialogue: 0,0:12:28.44,0:12:29.83,Default,,0000,0000,0000,,(Applause)