[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:01.08,0:00:02.28,Default,,0000,0000,0000,,Look at these images.
Dialogue: 0,0:00:02.28,0:00:04.94,Default,,0000,0000,0000,,Now, tell me which Obama here is real.
Dialogue: 0,0:00:04.94,0:00:07.32,Default,,0000,0000,0000,,(Video) Barack Obama: To help families\Nrefinance their homes,
Dialogue: 0,0:00:07.32,0:00:10.12,Default,,0000,0000,0000,,to invest in things\Nlike high-tech manufacturing,
Dialogue: 0,0:00:10.12,0:00:11.86,Default,,0000,0000,0000,,clean energy,
Dialogue: 0,0:00:11.86,0:00:14.66,Default,,0000,0000,0000,,and the infrastructure\Nthat creates good new jobs.
Dialogue: 0,0:00:14.66,0:00:16.03,Default,,0000,0000,0000,,Supasorn Suwajanakorn: Anyone?
Dialogue: 0,0:00:16.03,0:00:18.31,Default,,0000,0000,0000,,The answer is none of them.
Dialogue: 0,0:00:18.31,0:00:19.45,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:00:19.45,0:00:21.26,Default,,0000,0000,0000,,None of these is actually real.
Dialogue: 0,0:00:21.26,0:00:24.11,Default,,0000,0000,0000,,So let me tell you how we got here.
Dialogue: 0,0:00:24.11,0:00:28.21,Default,,0000,0000,0000,,My inspiration for this work\Nwas a project meant to preserve
Dialogue: 0,0:00:28.21,0:00:32.57,Default,,0000,0000,0000,,our last chance for learning\Nabout the Holocaust from the survivors.
Dialogue: 0,0:00:32.57,0:00:35.22,Default,,0000,0000,0000,,It's called New Dimensions in Testimony,
Dialogue: 0,0:00:35.22,0:00:38.18,Default,,0000,0000,0000,,and it allows you to have\Ninteractive conversations
Dialogue: 0,0:00:38.18,0:00:41.59,Default,,0000,0000,0000,,with a hologram\Nof a real Holocaust survivor.
Dialogue: 0,0:00:41.59,0:00:44.01,Default,,0000,0000,0000,,(Video) Question: How did you\Nsurvive the Holocaust?
Dialogue: 0,0:00:44.01,0:00:46.13,Default,,0000,0000,0000,,(Video) Answer: How did I survive?
Dialogue: 0,0:00:46.13,0:00:48.00,Default,,0000,0000,0000,,I survived,
Dialogue: 0,0:00:48.00,0:00:49.74,Default,,0000,0000,0000,,I believe,
Dialogue: 0,0:00:49.74,0:00:53.64,Default,,0000,0000,0000,,because providence watched over me.
Dialogue: 0,0:00:53.64,0:00:57.31,Default,,0000,0000,0000,,SS: Turns out these answers\Nwere pre-recorded in a studio.
Dialogue: 0,0:00:57.31,0:00:59.40,Default,,0000,0000,0000,,Yet the effect is astounding.
Dialogue: 0,0:00:59.40,0:01:03.97,Default,,0000,0000,0000,,You feel so connected to his story\Nand to him as a person.
Dialogue: 0,0:01:03.97,0:01:07.35,Default,,0000,0000,0000,,I think there is something special\Nabout human interaction
Dialogue: 0,0:01:07.35,0:01:09.93,Default,,0000,0000,0000,,that makes it much more profound
Dialogue: 0,0:01:09.93,0:01:11.36,Default,,0000,0000,0000,,and personal
Dialogue: 0,0:01:11.36,0:01:16.11,Default,,0000,0000,0000,,than what books or lectures\Nor movies could ever teach us.
Dialogue: 0,0:01:16.11,0:01:18.27,Default,,0000,0000,0000,,So I saw this and began to wonder,
Dialogue: 0,0:01:18.27,0:01:21.81,Default,,0000,0000,0000,,can we create a model\Nlike this for anyone?
Dialogue: 0,0:01:21.81,0:01:25.12,Default,,0000,0000,0000,,A model that looks, talks,\Nand acts just like them?
Dialogue: 0,0:01:25.12,0:01:27.67,Default,,0000,0000,0000,,So I set out to see if this could be done,
Dialogue: 0,0:01:27.67,0:01:30.04,Default,,0000,0000,0000,,and eventually came up\Nwith a new solution
Dialogue: 0,0:01:30.04,0:01:31.62,Default,,0000,0000,0000,,that can build a model of a person
Dialogue: 0,0:01:31.62,0:01:33.35,Default,,0000,0000,0000,,using nothing but these:
Dialogue: 0,0:01:34.06,0:01:36.96,Default,,0000,0000,0000,,existing photos and videos of a person.
Dialogue: 0,0:01:36.96,0:01:39.38,Default,,0000,0000,0000,,If you can leverage this kind\Nof passive information,
Dialogue: 0,0:01:39.38,0:01:41.52,Default,,0000,0000,0000,,just photos and video that are out there,
Dialogue: 0,0:01:41.52,0:01:44.23,Default,,0000,0000,0000,,that's the key to scaling to anyone.
Dialogue: 0,0:01:44.23,0:01:46.18,Default,,0000,0000,0000,,By the way, here's Richard Feynman,
Dialogue: 0,0:01:46.18,0:01:49.06,Default,,0000,0000,0000,,who in addition to being\Na Nobel Prize Winner in physics
Dialogue: 0,0:01:49.06,0:01:52.48,Default,,0000,0000,0000,,was also known as a legendary teacher.
Dialogue: 0,0:01:52.48,0:01:55.13,Default,,0000,0000,0000,,Wouldn't it be great\Nif we could bring him back
Dialogue: 0,0:01:55.13,0:01:58.85,Default,,0000,0000,0000,,to give his lectures\Nand inspire millions of kids,
Dialogue: 0,0:01:58.85,0:02:02.70,Default,,0000,0000,0000,,perhaps not just in English\Nbut in any language?
Dialogue: 0,0:02:02.70,0:02:07.30,Default,,0000,0000,0000,,Or if you could ask our grandparents\Nfor advice and hear those comforting words
Dialogue: 0,0:02:07.30,0:02:09.58,Default,,0000,0000,0000,,even if they are no longer with us?
Dialogue: 0,0:02:09.58,0:02:13.28,Default,,0000,0000,0000,,Or maybe using this tool,\Nbooks authors, alive or not,
Dialogue: 0,0:02:13.28,0:02:17.58,Default,,0000,0000,0000,,could read aloud all of their books\Nfor anyone interested.
Dialogue: 0,0:02:17.58,0:02:20.30,Default,,0000,0000,0000,,The creative possibilities\Nhere are endless,
Dialogue: 0,0:02:20.30,0:02:22.66,Default,,0000,0000,0000,,and to me that's very exciting.
Dialogue: 0,0:02:22.66,0:02:24.88,Default,,0000,0000,0000,,And here's how it's working so far.
Dialogue: 0,0:02:24.88,0:02:26.54,Default,,0000,0000,0000,,First, we introduce a new technique
Dialogue: 0,0:02:26.54,0:02:30.04,Default,,0000,0000,0000,,that can reconstruct\Na high-detailed 3D face model
Dialogue: 0,0:02:30.04,0:02:31.15,Default,,0000,0000,0000,,from any image
Dialogue: 0,0:02:31.15,0:02:33.77,Default,,0000,0000,0000,,without ever 3D-scanning the person.
Dialogue: 0,0:02:33.77,0:02:37.42,Default,,0000,0000,0000,,And here's the same output model\Nfrom different views.
Dialogue: 0,0:02:37.42,0:02:39.76,Default,,0000,0000,0000,,This also works on videos
Dialogue: 0,0:02:39.76,0:02:42.54,Default,,0000,0000,0000,,by running the same algorithm\Non each video frame
Dialogue: 0,0:02:42.54,0:02:45.12,Default,,0000,0000,0000,,and generating a moving 3D model.
Dialogue: 0,0:02:45.12,0:02:49.67,Default,,0000,0000,0000,,And here's the same\Noutput model from different angles.
Dialogue: 0,0:02:50.19,0:02:52.54,Default,,0000,0000,0000,,It turns out, this problem\Nis very challenging,
Dialogue: 0,0:02:52.54,0:02:56.55,Default,,0000,0000,0000,,but the key trick is that we are going\Nto analyze a large photo collection
Dialogue: 0,0:02:56.55,0:02:58.86,Default,,0000,0000,0000,,of the person beforehand.
Dialogue: 0,0:02:58.86,0:03:02.57,Default,,0000,0000,0000,,For George W. Bush,\Nwe can just search on Google,
Dialogue: 0,0:03:02.57,0:03:05.06,Default,,0000,0000,0000,,and from that, we are able\Nto build an average model,
Dialogue: 0,0:03:05.06,0:03:08.11,Default,,0000,0000,0000,,an iterative, refined model\Nto recover the expression
Dialogue: 0,0:03:08.11,0:03:10.56,Default,,0000,0000,0000,,in fine details like creases and wrinkles.
Dialogue: 0,0:03:11.59,0:03:14.36,Default,,0000,0000,0000,,What's fascinating about this\Nis that the photo collection
Dialogue: 0,0:03:14.36,0:03:16.34,Default,,0000,0000,0000,,can come from your typical photos.
Dialogue: 0,0:03:16.34,0:03:18.85,Default,,0000,0000,0000,,It doesn't really matter\Nwhat expression you're making
Dialogue: 0,0:03:18.85,0:03:20.86,Default,,0000,0000,0000,,or where you took those photos.
Dialogue: 0,0:03:20.86,0:03:23.42,Default,,0000,0000,0000,,What matters is that\Nthere are a lot of them.
Dialogue: 0,0:03:23.42,0:03:25.35,Default,,0000,0000,0000,,And we are still missing color here,
Dialogue: 0,0:03:25.35,0:03:27.47,Default,,0000,0000,0000,,so next we develop\Na new blending technique
Dialogue: 0,0:03:27.47,0:03:30.36,Default,,0000,0000,0000,,that improves upon\Na single averaging method
Dialogue: 0,0:03:30.36,0:03:33.51,Default,,0000,0000,0000,,and produces sharp\Nfacial textures and colors.
Dialogue: 0,0:03:33.51,0:03:36.83,Default,,0000,0000,0000,,And this can be done for any expression.
Dialogue: 0,0:03:36.83,0:03:40.04,Default,,0000,0000,0000,,Now we have a control\Nof a model of a person,
Dialogue: 0,0:03:40.04,0:03:43.84,Default,,0000,0000,0000,,and the way it's controlled now\Nis by a sequence of static photos.
Dialogue: 0,0:03:43.84,0:03:47.96,Default,,0000,0000,0000,,Notice how the wrinkles come and go\Ndepending on the expression.
Dialogue: 0,0:03:48.37,0:03:51.14,Default,,0000,0000,0000,,We can also use a video\Nto drive the model.
Dialogue: 0,0:03:51.14,0:03:54.77,Default,,0000,0000,0000,,(Video) Daniel Craig: Rory, but somehow\Nwe've managed to attract
Dialogue: 0,0:03:54.77,0:03:58.04,Default,,0000,0000,0000,,more amazing people.
Dialogue: 0,0:03:58.04,0:03:59.95,Default,,0000,0000,0000,,SS: And here's another fun demo.
Dialogue: 0,0:03:59.95,0:04:02.13,Default,,0000,0000,0000,,So what you see here\Nare controllable models
Dialogue: 0,0:04:02.13,0:04:04.51,Default,,0000,0000,0000,,of people I built\Nfrom their internet photos.
Dialogue: 0,0:04:04.51,0:04:07.45,Default,,0000,0000,0000,,Now, if you transfer the motion\Nfrom the input video,
Dialogue: 0,0:04:07.45,0:04:09.69,Default,,0000,0000,0000,,we can actually drive the entire party.
Dialogue: 0,0:04:09.88,0:04:11.98,Default,,0000,0000,0000,,(Video) George W. Bush:\NIt's a very difficult bill to pass,
Dialogue: 0,0:04:11.98,0:04:13.99,Default,,0000,0000,0000,,because there's a lot of moving parts,
Dialogue: 0,0:04:13.99,0:04:17.71,Default,,0000,0000,0000,,and the legislative process can be ugly.
Dialogue: 0,0:04:18.88,0:04:20.90,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:04:20.90,0:04:23.03,Default,,0000,0000,0000,,SS: So coming back a little bit,
Dialogue: 0,0:04:23.03,0:04:26.34,Default,,0000,0000,0000,,our ultimate goal, rather,\Nis to capture their mannerisms
Dialogue: 0,0:04:26.34,0:04:29.37,Default,,0000,0000,0000,,or the unique way each\Nof these people talks and smiles.
Dialogue: 0,0:04:29.37,0:04:31.70,Default,,0000,0000,0000,,So to do that, can we\Nactually teach the computer
Dialogue: 0,0:04:31.70,0:04:33.72,Default,,0000,0000,0000,,to imitate the way someone talks
Dialogue: 0,0:04:33.72,0:04:37.16,Default,,0000,0000,0000,,by only showing it\Nvideo footage of the person?
Dialogue: 0,0:04:37.16,0:04:40.54,Default,,0000,0000,0000,,And what I did exactly was,\NI let a computer watch
Dialogue: 0,0:04:40.54,0:04:43.42,Default,,0000,0000,0000,,14 hours of pure Barack Obama\Ngiving addresses.
Dialogue: 0,0:04:43.42,0:04:46.75,Default,,0000,0000,0000,,And here's what we can produce\Ngiven only his audio.
Dialogue: 0,0:04:46.75,0:04:48.89,Default,,0000,0000,0000,,(Video) BO: The results are clear.
Dialogue: 0,0:04:48.89,0:04:53.34,Default,,0000,0000,0000,,America's business have created\N14.5 million new jobs
Dialogue: 0,0:04:53.34,0:04:56.22,Default,,0000,0000,0000,,over 75 straight months.
Dialogue: 0,0:04:56.22,0:04:59.11,Default,,0000,0000,0000,,SS: So what's being synthesized here\Nis only the mouth region,
Dialogue: 0,0:04:59.11,0:05:00.71,Default,,0000,0000,0000,,and here's how we do it.
Dialogue: 0,0:05:00.71,0:05:03.02,Default,,0000,0000,0000,,Our pipeline uses a neural network
Dialogue: 0,0:05:03.02,0:05:06.81,Default,,0000,0000,0000,,to convert and input audio\Ninto these mouth points.
Dialogue: 0,0:05:06.81,0:05:10.67,Default,,0000,0000,0000,,(Video) BO: We get it through our job\Nor through Medicare or Medicaid.
Dialogue: 0,0:05:10.67,0:05:14.45,Default,,0000,0000,0000,,SS: Then we synthesize the texture,\Nenhance details and teeth,
Dialogue: 0,0:05:14.45,0:05:17.60,Default,,0000,0000,0000,,and blend it into the head\Nand background from a source video.
Dialogue: 0,0:05:17.60,0:05:19.52,Default,,0000,0000,0000,,(Video) BO: Women can get free checkups,
Dialogue: 0,0:05:19.52,0:05:22.86,Default,,0000,0000,0000,,and you can't get charged more\Njust for being a woman.
Dialogue: 0,0:05:22.86,0:05:26.56,Default,,0000,0000,0000,,Young people can stay\Non a parent's plan until they turn 26.
Dialogue: 0,0:05:26.56,0:05:30.19,Default,,0000,0000,0000,,SS: I think these results\Nseem very realistic and intriguing,
Dialogue: 0,0:05:30.19,0:05:32.02,Default,,0000,0000,0000,,but at the same time frightening,
Dialogue: 0,0:05:32.02,0:05:33.57,Default,,0000,0000,0000,,even to me.
Dialogue: 0,0:05:33.57,0:05:38.11,Default,,0000,0000,0000,,Our goal was to build an accurate model\Nof a person, not to misrepresent them.
Dialogue: 0,0:05:38.11,0:05:41.63,Default,,0000,0000,0000,,But one thing that concerns me\Nis its potential for misuse.
Dialogue: 0,0:05:41.63,0:05:45.51,Default,,0000,0000,0000,,People have been thinking\Nabout this problem for a long time,
Dialogue: 0,0:05:45.51,0:05:47.66,Default,,0000,0000,0000,,since the days when Photoshop\Nfirst hit the market.
Dialogue: 0,0:05:47.66,0:05:51.76,Default,,0000,0000,0000,,As a researcher, I'm also working\Non countermeasure technology,
Dialogue: 0,0:05:51.76,0:05:54.61,Default,,0000,0000,0000,,and I'm part of an ongoing\Neffort at AI Foundation
Dialogue: 0,0:05:54.61,0:05:58.33,Default,,0000,0000,0000,,which uses a combination\Nof machine learning and human moderators
Dialogue: 0,0:05:58.33,0:06:00.50,Default,,0000,0000,0000,,to detect fake images and videos,
Dialogue: 0,0:06:00.50,0:06:02.78,Default,,0000,0000,0000,,fighting against my own work.
Dialogue: 0,0:06:02.78,0:06:05.85,Default,,0000,0000,0000,,And one of the tools we plan to release\Nis called Reality Defender,
Dialogue: 0,0:06:05.85,0:06:09.92,Default,,0000,0000,0000,,which is a web browser plugin\Nthat can flag potentially fake content
Dialogue: 0,0:06:09.92,0:06:12.08,Default,,0000,0000,0000,,automatically right in the browser.
Dialogue: 0,0:06:12.08,0:06:14.86,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:06:17.02,0:06:18.50,Default,,0000,0000,0000,,Despite all this, though,
Dialogue: 0,0:06:18.50,0:06:20.36,Default,,0000,0000,0000,,fake videos could do a lot of damage,
Dialogue: 0,0:06:20.36,0:06:23.30,Default,,0000,0000,0000,,even before anyone has a chance to verify,
Dialogue: 0,0:06:23.30,0:06:26.43,Default,,0000,0000,0000,,so it's very important\Nthat we make everyone aware
Dialogue: 0,0:06:26.43,0:06:27.94,Default,,0000,0000,0000,,of what's currently possible
Dialogue: 0,0:06:27.94,0:06:31.68,Default,,0000,0000,0000,,so we can have the right assumption\Nand be critical about what we see.
Dialogue: 0,0:06:31.68,0:06:36.79,Default,,0000,0000,0000,,There's still a long way to go before\Nwe can fully model individual people
Dialogue: 0,0:06:36.79,0:06:40.74,Default,,0000,0000,0000,,and before we can ensure\Nthe safety of this technology,
Dialogue: 0,0:06:40.74,0:06:42.79,Default,,0000,0000,0000,,but I'm excited and hopeful
Dialogue: 0,0:06:42.79,0:06:45.96,Default,,0000,0000,0000,,because if we use it right and carefully,
Dialogue: 0,0:06:45.96,0:06:50.50,Default,,0000,0000,0000,,this tool can allow any individual's\Npositive impact on the world
Dialogue: 0,0:06:50.50,0:06:52.21,Default,,0000,0000,0000,,to be massively scaled
Dialogue: 0,0:06:52.21,0:06:55.84,Default,,0000,0000,0000,,and really help shape our future\Nthe way we want it to be.
Dialogue: 0,0:06:55.84,0:06:57.06,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:06:57.06,0:07:01.66,Default,,0000,0000,0000,,(Applause)