[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:00.88,0:00:02.03,Default,,0000,0000,0000,,Look at these images.
Dialogue: 0,0:00:02.05,0:00:04.68,Default,,0000,0000,0000,,Now, tell me which Obama here is real.
Dialogue: 0,0:00:04.71,0:00:07.57,Default,,0000,0000,0000,,(Video) Barack Obama: To help families\Nrefinance their homes,
Dialogue: 0,0:00:07.60,0:00:10.24,Default,,0000,0000,0000,,to invest in things\Nlike high-tech manufacturing,
Dialogue: 0,0:00:10.27,0:00:11.42,Default,,0000,0000,0000,,clean energy,
Dialogue: 0,0:00:11.45,0:00:14.23,Default,,0000,0000,0000,,and the infrastructure\Nthat creates good new jobs.
Dialogue: 0,0:00:14.65,0:00:16.13,Default,,0000,0000,0000,,Supasorn Suwajanakorn: Anyone?
Dialogue: 0,0:00:16.16,0:00:18.03,Default,,0000,0000,0000,,The answer is none of them.
Dialogue: 0,0:00:18.05,0:00:19.17,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:00:19.19,0:00:20.98,Default,,0000,0000,0000,,None of these is actually real.
Dialogue: 0,0:00:21.00,0:00:22.84,Default,,0000,0000,0000,,So let me tell you how we got here.
Dialogue: 0,0:00:23.85,0:00:28.06,Default,,0000,0000,0000,,My inspiration for this work\Nwas a project meant to preserve
Dialogue: 0,0:00:28.13,0:00:31.91,Default,,0000,0000,0000,,our last chance for learning\Nabout the Holocaust from the survivors.
Dialogue: 0,0:00:32.77,0:00:35.38,Default,,0000,0000,0000,,It's called New Dimensions in Testimony,
Dialogue: 0,0:00:35.42,0:00:38.54,Default,,0000,0000,0000,,and it allows you to have\Ninteractive conversations
Dialogue: 0,0:00:38.57,0:00:41.13,Default,,0000,0000,0000,,with a hologram\Nof a real Holocaust survivor.
Dialogue: 0,0:00:41.79,0:00:43.76,Default,,0000,0000,0000,,(Video) Question: How did you\Nsurvive the Holocaust?
Dialogue: 0,0:00:43.78,0:00:45.45,Default,,0000,0000,0000,,(Video) Answer: How did I survive?
Dialogue: 0,0:00:45.91,0:00:47.72,Default,,0000,0000,0000,,I survived,
Dialogue: 0,0:00:48.42,0:00:49.91,Default,,0000,0000,0000,,I believe,
Dialogue: 0,0:00:49.97,0:00:52.99,Default,,0000,0000,0000,,because providence watched over me.
Dialogue: 0,0:00:53.57,0:00:57.03,Default,,0000,0000,0000,,SS: Turns out these answers\Nwere pre-recorded in a studio.
Dialogue: 0,0:00:57.05,0:00:59.41,Default,,0000,0000,0000,,Yet the effect is astounding.
Dialogue: 0,0:00:59.53,0:01:03.15,Default,,0000,0000,0000,,You feel so connected to his story\Nand to him as a person.
Dialogue: 0,0:01:04.01,0:01:07.30,Default,,0000,0000,0000,,I think there is something special\Nabout human interaction
Dialogue: 0,0:01:07.34,0:01:09.100,Default,,0000,0000,0000,,that makes it much more profound
Dialogue: 0,0:01:10.12,0:01:11.46,Default,,0000,0000,0000,,and personal
Dialogue: 0,0:01:11.48,0:01:15.82,Default,,0000,0000,0000,,than what books or lectures\Nor movies could ever teach us.
Dialogue: 0,0:01:16.27,0:01:18.60,Default,,0000,0000,0000,,So I saw this and began to wonder,
Dialogue: 0,0:01:18.72,0:01:21.53,Default,,0000,0000,0000,,can we create a model\Nlike this for anyone?
Dialogue: 0,0:01:21.55,0:01:24.52,Default,,0000,0000,0000,,A model that looks, talks,\Nand acts just like them?
Dialogue: 0,0:01:25.57,0:01:27.58,Default,,0000,0000,0000,,So I set out to see if this could be done,
Dialogue: 0,0:01:27.60,0:01:29.86,Default,,0000,0000,0000,,and eventually came up with a new solution
Dialogue: 0,0:01:29.94,0:01:33.16,Default,,0000,0000,0000,,that can build a model of a person\Nusing nothing but these:
Dialogue: 0,0:01:33.75,0:01:35.96,Default,,0000,0000,0000,,existing photos and videos of a person.
Dialogue: 0,0:01:36.70,0:01:39.29,Default,,0000,0000,0000,,If you can leverage this kind\Nof passive information,
Dialogue: 0,0:01:39.34,0:01:41.33,Default,,0000,0000,0000,,just photos and video that are out there,
Dialogue: 0,0:01:41.37,0:01:43.43,Default,,0000,0000,0000,,that's the key to scaling to anyone.
Dialogue: 0,0:01:44.12,0:01:45.90,Default,,0000,0000,0000,,By the way, here's Richard Feynman,
Dialogue: 0,0:01:45.92,0:01:49.32,Default,,0000,0000,0000,,who in addition to being\Na Nobel Prize Winner in physics
Dialogue: 0,0:01:49.36,0:01:51.81,Default,,0000,0000,0000,,was also known as a legendary teacher.
Dialogue: 0,0:01:53.08,0:01:55.27,Default,,0000,0000,0000,,Wouldn't it be great\Nif we could bring him back
Dialogue: 0,0:01:55.30,0:01:58.57,Default,,0000,0000,0000,,to give his lectures\Nand inspire millions of kids,
Dialogue: 0,0:01:58.59,0:02:01.58,Default,,0000,0000,0000,,perhaps not just in English\Nbut in any language?
Dialogue: 0,0:02:02.44,0:02:07.02,Default,,0000,0000,0000,,Or if you could ask our grandparents\Nfor advice and hear those comforting words
Dialogue: 0,0:02:07.07,0:02:08.84,Default,,0000,0000,0000,,even if they are no longer with us?
Dialogue: 0,0:02:09.68,0:02:12.99,Default,,0000,0000,0000,,Or maybe using this tool,\Nbooks authors, alive or not,
Dialogue: 0,0:02:13.10,0:02:16.04,Default,,0000,0000,0000,,could read aloud all of their books\Nfor anyone interested.
Dialogue: 0,0:02:17.20,0:02:19.64,Default,,0000,0000,0000,,The creative possibilities\Nhere are endless,
Dialogue: 0,0:02:19.66,0:02:21.37,Default,,0000,0000,0000,,and to me that's very exciting.
Dialogue: 0,0:02:22.60,0:02:24.60,Default,,0000,0000,0000,,And here's how it's working so far.
Dialogue: 0,0:02:24.62,0:02:26.29,Default,,0000,0000,0000,,First, we introduce a new technique
Dialogue: 0,0:02:26.31,0:02:29.76,Default,,0000,0000,0000,,that can reconstruct\Na high-detailed 3D face model
Dialogue: 0,0:02:29.78,0:02:30.94,Default,,0000,0000,0000,,from any image
Dialogue: 0,0:02:30.99,0:02:33.10,Default,,0000,0000,0000,,without ever 3D-scanning the person.
Dialogue: 0,0:02:33.89,0:02:36.53,Default,,0000,0000,0000,,And here's the same output model\Nfrom different views.
Dialogue: 0,0:02:37.97,0:02:39.47,Default,,0000,0000,0000,,This also works on videos
Dialogue: 0,0:02:39.50,0:02:42.26,Default,,0000,0000,0000,,by running the same algorithm\Non each video frame
Dialogue: 0,0:02:42.28,0:02:44.84,Default,,0000,0000,0000,,and generating a moving 3D model.
Dialogue: 0,0:02:45.50,0:02:48.31,Default,,0000,0000,0000,,And here's the same\Noutput model from different angles.
Dialogue: 0,0:02:49.93,0:02:52.43,Default,,0000,0000,0000,,It turns out this problem\Nis very challenging,
Dialogue: 0,0:02:52.49,0:02:56.27,Default,,0000,0000,0000,,but the key trick is that we are going\Nto analyze a large photo collection
Dialogue: 0,0:02:56.29,0:02:57.85,Default,,0000,0000,0000,,of the person beforehand.
Dialogue: 0,0:02:58.65,0:03:01.19,Default,,0000,0000,0000,,For George W. Bush,\Nwe can just search on Google,
Dialogue: 0,0:03:02.31,0:03:04.79,Default,,0000,0000,0000,,and from that, we are able\Nto build an average model,
Dialogue: 0,0:03:04.83,0:03:07.89,Default,,0000,0000,0000,,an iterative, refined model\Nto recover the expression
Dialogue: 0,0:03:07.97,0:03:10.30,Default,,0000,0000,0000,,in fine details,\Nlike creases and wrinkles.
Dialogue: 0,0:03:11.33,0:03:12.73,Default,,0000,0000,0000,,What's fascinating about this
Dialogue: 0,0:03:12.75,0:03:16.05,Default,,0000,0000,0000,,is that the photo collection\Ncan come from your typical photos.
Dialogue: 0,0:03:16.20,0:03:18.80,Default,,0000,0000,0000,,It doesn't really matter\Nwhat expression you're making
Dialogue: 0,0:03:18.83,0:03:20.58,Default,,0000,0000,0000,,or where you took those photos.
Dialogue: 0,0:03:20.74,0:03:23.14,Default,,0000,0000,0000,,What matters is that\Nthere are a lot of them.
Dialogue: 0,0:03:23.16,0:03:24.90,Default,,0000,0000,0000,,And we are still missing color here,
Dialogue: 0,0:03:24.92,0:03:27.20,Default,,0000,0000,0000,,so next we develop\Na new blending technique
Dialogue: 0,0:03:27.29,0:03:30.07,Default,,0000,0000,0000,,that improves upon\Na single averaging method
Dialogue: 0,0:03:30.15,0:03:32.97,Default,,0000,0000,0000,,and produces sharp\Nfacial textures and colors.
Dialogue: 0,0:03:33.78,0:03:36.55,Default,,0000,0000,0000,,And this can be done for any expression.
Dialogue: 0,0:03:37.48,0:03:39.91,Default,,0000,0000,0000,,Now we have a control\Nof a model of a person,
Dialogue: 0,0:03:40.01,0:03:43.56,Default,,0000,0000,0000,,and the way it's controlled now\Nis by a sequence of static photos.
Dialogue: 0,0:03:43.83,0:03:46.95,Default,,0000,0000,0000,,Notice how the wrinkles come and go\Ndepending on the expression.
Dialogue: 0,0:03:48.11,0:03:50.86,Default,,0000,0000,0000,,We can also use a video\Nto drive the model.
Dialogue: 0,0:03:50.88,0:03:54.49,Default,,0000,0000,0000,,(Video) Daniel Craig: Rory, but somehow\Nwe've managed to attract
Dialogue: 0,0:03:54.51,0:03:57.27,Default,,0000,0000,0000,,some more amazing people.
Dialogue: 0,0:03:58.02,0:03:59.66,Default,,0000,0000,0000,,SS: And here's another fun demo.
Dialogue: 0,0:03:59.69,0:04:01.85,Default,,0000,0000,0000,,So what you see here\Nare controllable models
Dialogue: 0,0:04:01.96,0:04:04.23,Default,,0000,0000,0000,,of people I built\Nfrom their internet photos.
Dialogue: 0,0:04:04.42,0:04:07.16,Default,,0000,0000,0000,,Now, if you transfer the motion\Nfrom the input video,
Dialogue: 0,0:04:07.35,0:04:09.50,Default,,0000,0000,0000,,we can actually drive the entire party.
Dialogue: 0,0:04:09.53,0:04:11.60,Default,,0000,0000,0000,,(Video) George W. Bush:\NIt's a difficult bill to pass,
Dialogue: 0,0:04:11.62,0:04:13.98,Default,,0000,0000,0000,,because there's a lot of moving parts,
Dialogue: 0,0:04:14.05,0:04:19.17,Default,,0000,0000,0000,,and the legislative process can be ugly.
Dialogue: 0,0:04:19.31,0:04:20.89,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:04:20.96,0:04:22.75,Default,,0000,0000,0000,,SS: So coming back a little bit,
Dialogue: 0,0:04:22.77,0:04:26.01,Default,,0000,0000,0000,,our ultimate goal, rather,\Nis to capture their mannerisms
Dialogue: 0,0:04:26.04,0:04:29.04,Default,,0000,0000,0000,,or the unique way each\Nof these people talks and smiles.
Dialogue: 0,0:04:29.11,0:04:31.42,Default,,0000,0000,0000,,So to do that, can we\Nactually teach the computer
Dialogue: 0,0:04:31.44,0:04:33.62,Default,,0000,0000,0000,,to imitate the way someone talks
Dialogue: 0,0:04:33.69,0:04:36.11,Default,,0000,0000,0000,,by only showing it\Nvideo footage of the person?
Dialogue: 0,0:04:36.90,0:04:39.47,Default,,0000,0000,0000,,And what I did exactly was,\NI let a computer watch
Dialogue: 0,0:04:39.50,0:04:42.78,Default,,0000,0000,0000,,14 hours of pure Barack Obama\Ngiving addresses.
Dialogue: 0,0:04:43.44,0:04:46.88,Default,,0000,0000,0000,,And here's what we can produce\Ngiven only his audio.
Dialogue: 0,0:04:46.98,0:04:48.70,Default,,0000,0000,0000,,(Video) BO: The results are clear.
Dialogue: 0,0:04:48.78,0:04:53.05,Default,,0000,0000,0000,,America's business have created\N14.5 million new jobs
Dialogue: 0,0:04:53.16,0:04:55.93,Default,,0000,0000,0000,,over 75 straight months.
Dialogue: 0,0:04:55.96,0:04:58.86,Default,,0000,0000,0000,,SS: So what's being synthesized here\Nis only the mouth region,
Dialogue: 0,0:04:58.88,0:05:00.42,Default,,0000,0000,0000,,and here's how we do it.
Dialogue: 0,0:05:00.76,0:05:02.59,Default,,0000,0000,0000,,Our pipeline uses a neural network
Dialogue: 0,0:05:02.61,0:05:05.55,Default,,0000,0000,0000,,to convert and input audio\Ninto these mouth points.
Dialogue: 0,0:05:06.55,0:05:10.65,Default,,0000,0000,0000,,(Video) BO: We get it through our job\Nor through Medicare or Medicaid.
Dialogue: 0,0:05:10.80,0:05:14.16,Default,,0000,0000,0000,,SS: Then we synthesize the texture,\Nenhance details and teeth,
Dialogue: 0,0:05:14.24,0:05:17.31,Default,,0000,0000,0000,,and blend it into the head\Nand background from a source video.
Dialogue: 0,0:05:17.34,0:05:19.24,Default,,0000,0000,0000,,(Video) BO: Women can get free checkups,
Dialogue: 0,0:05:19.27,0:05:22.24,Default,,0000,0000,0000,,and you can't get charged more\Njust for being a woman.
Dialogue: 0,0:05:22.97,0:05:26.28,Default,,0000,0000,0000,,Young people can stay\Non a parent's plan until they turn 26.
Dialogue: 0,0:05:27.27,0:05:30.17,Default,,0000,0000,0000,,SS: I think these results\Nseem very realistic and intriguing,
Dialogue: 0,0:05:30.24,0:05:33.29,Default,,0000,0000,0000,,but at the same time\Nfrightening, even to me.
Dialogue: 0,0:05:33.44,0:05:37.46,Default,,0000,0000,0000,,Our goal was to build an accurate model\Nof a person, not to misrepresent them.
Dialogue: 0,0:05:37.96,0:05:41.07,Default,,0000,0000,0000,,But one thing that concerns me\Nis its potential for misuse.
Dialogue: 0,0:05:41.96,0:05:44.93,Default,,0000,0000,0000,,People have been thinking\Nabout this problem for a long time,
Dialogue: 0,0:05:44.95,0:05:47.33,Default,,0000,0000,0000,,since the days when Photoshop\Nfirst hit the market.
Dialogue: 0,0:05:47.86,0:05:51.62,Default,,0000,0000,0000,,As a researcher, I'm also working\Non countermeasure technology,
Dialogue: 0,0:05:51.69,0:05:54.57,Default,,0000,0000,0000,,and I'm part of an ongoing\Neffort at AI Foundation
Dialogue: 0,0:05:54.65,0:05:58.05,Default,,0000,0000,0000,,which uses a combination\Nof machine learning and human moderators
Dialogue: 0,0:05:58.07,0:06:00.22,Default,,0000,0000,0000,,to detect fake images and videos,
Dialogue: 0,0:06:00.24,0:06:01.76,Default,,0000,0000,0000,,fighting against my own work.
Dialogue: 0,0:06:02.68,0:06:05.87,Default,,0000,0000,0000,,And one of the tools we plan to release\Nis called Reality Defender,
Dialogue: 0,0:06:05.89,0:06:09.88,Default,,0000,0000,0000,,which is a web browser plugin\Nthat can flag potentially fake content
Dialogue: 0,0:06:09.95,0:06:12.42,Default,,0000,0000,0000,,automatically right in the browser.
Dialogue: 0,0:06:12.51,0:06:16.72,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:06:16.76,0:06:18.21,Default,,0000,0000,0000,,Despite all this, though,
Dialogue: 0,0:06:18.24,0:06:20.08,Default,,0000,0000,0000,,fake videos could do a lot of damage,
Dialogue: 0,0:06:20.10,0:06:23.36,Default,,0000,0000,0000,,even before anyone has a chance to verify,
Dialogue: 0,0:06:23.42,0:06:26.14,Default,,0000,0000,0000,,so it's very important\Nthat we make everyone aware
Dialogue: 0,0:06:26.17,0:06:28.16,Default,,0000,0000,0000,,of what's currently possible
Dialogue: 0,0:06:28.20,0:06:31.57,Default,,0000,0000,0000,,so we can have the right assumption\Nand be critical about what we see.
Dialogue: 0,0:06:32.42,0:06:37.40,Default,,0000,0000,0000,,There's still a long way to go before\Nwe can fully model individual people
Dialogue: 0,0:06:37.45,0:06:40.24,Default,,0000,0000,0000,,and before we can ensure\Nthe safety of this technology,
Dialogue: 0,0:06:41.10,0:06:42.63,Default,,0000,0000,0000,,but I'm excited and hopeful
Dialogue: 0,0:06:42.71,0:06:46.24,Default,,0000,0000,0000,,because if we use it right and carefully,
Dialogue: 0,0:06:46.27,0:06:50.54,Default,,0000,0000,0000,,this tool can allow any individual's\Npositive impact on the world
Dialogue: 0,0:06:50.60,0:06:52.75,Default,,0000,0000,0000,,to be massively scaled
Dialogue: 0,0:06:52.82,0:06:55.56,Default,,0000,0000,0000,,and really help shape our future\Nthe way we want it to be.
Dialogue: 0,0:06:55.58,0:06:56.73,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:06:56.76,0:07:01.85,Default,,0000,0000,0000,,(Applause)