[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:00.88,0:00:02.03,Default,,0000,0000,0000,,Look at these images.
Dialogue: 0,0:00:02.05,0:00:04.69,Default,,0000,0000,0000,,Now, tell me which Obama here is real.
Dialogue: 0,0:00:04.71,0:00:07.57,Default,,0000,0000,0000,,(Video) Barack Obama: To help families\Nrefinance their homes,
Dialogue: 0,0:00:07.60,0:00:10.24,Default,,0000,0000,0000,,to invest in things\Nlike high-tech manufacturing,
Dialogue: 0,0:00:10.27,0:00:11.42,Default,,0000,0000,0000,,clean energy
Dialogue: 0,0:00:11.45,0:00:14.23,Default,,0000,0000,0000,,and the infrastructure\Nthat creates good new jobs.
Dialogue: 0,0:00:14.65,0:00:16.13,Default,,0000,0000,0000,,Supasorn Suwajanakorn: Anyone?
Dialogue: 0,0:00:16.16,0:00:18.03,Default,,0000,0000,0000,,The answer is none of them.
Dialogue: 0,0:00:18.05,0:00:19.17,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:00:19.19,0:00:20.98,Default,,0000,0000,0000,,None of these is actually real.
Dialogue: 0,0:00:21.00,0:00:22.84,Default,,0000,0000,0000,,So let me tell you how we got here.
Dialogue: 0,0:00:23.94,0:00:25.52,Default,,0000,0000,0000,,My inspiration for this work
Dialogue: 0,0:00:25.54,0:00:30.95,Default,,0000,0000,0000,,was a project meant to preserve our last\Nchance for learning about the Holocaust
Dialogue: 0,0:00:30.98,0:00:32.74,Default,,0000,0000,0000,,from the survivors.
Dialogue: 0,0:00:32.77,0:00:35.40,Default,,0000,0000,0000,,It's called New Dimensions in Testimony,
Dialogue: 0,0:00:35.42,0:00:38.55,Default,,0000,0000,0000,,and it allows you to have\Ninteractive conversations
Dialogue: 0,0:00:38.57,0:00:41.13,Default,,0000,0000,0000,,with a hologram\Nof a real Holocaust survivor.
Dialogue: 0,0:00:41.79,0:00:43.76,Default,,0000,0000,0000,,(Video) Man: How did you\Nsurvive the Holocaust?
Dialogue: 0,0:00:43.78,0:00:45.45,Default,,0000,0000,0000,,(Video) Hologram: How did I survive?
Dialogue: 0,0:00:45.91,0:00:47.72,Default,,0000,0000,0000,,I survived,
Dialogue: 0,0:00:48.42,0:00:49.95,Default,,0000,0000,0000,,I believe,
Dialogue: 0,0:00:49.97,0:00:52.99,Default,,0000,0000,0000,,because providence watched over me.
Dialogue: 0,0:00:53.57,0:00:57.03,Default,,0000,0000,0000,,SS: Turns out these answers\Nwere prerecorded in a studio.
Dialogue: 0,0:00:57.05,0:00:59.50,Default,,0000,0000,0000,,Yet the effect is astounding.
Dialogue: 0,0:00:59.53,0:01:03.15,Default,,0000,0000,0000,,You feel so connected to his story\Nand to him as a person.
Dialogue: 0,0:01:04.01,0:01:07.31,Default,,0000,0000,0000,,I think there's something special\Nabout human interaction
Dialogue: 0,0:01:07.34,0:01:10.09,Default,,0000,0000,0000,,that makes it much more profound
Dialogue: 0,0:01:10.12,0:01:12.32,Default,,0000,0000,0000,,and personal
Dialogue: 0,0:01:12.34,0:01:15.82,Default,,0000,0000,0000,,than what books or lectures\Nor movies could ever teach us.
Dialogue: 0,0:01:16.27,0:01:18.69,Default,,0000,0000,0000,,So I saw this and began to wonder,
Dialogue: 0,0:01:18.72,0:01:21.53,Default,,0000,0000,0000,,can we create a model\Nlike this for anyone?
Dialogue: 0,0:01:21.55,0:01:24.52,Default,,0000,0000,0000,,A model that looks, talks\Nand acts just like them?
Dialogue: 0,0:01:25.57,0:01:27.58,Default,,0000,0000,0000,,So I set out to see if this could be done
Dialogue: 0,0:01:27.60,0:01:29.91,Default,,0000,0000,0000,,and eventually came up with a new solution
Dialogue: 0,0:01:29.94,0:01:33.16,Default,,0000,0000,0000,,that can build a model of a person\Nusing nothing but these:
Dialogue: 0,0:01:33.75,0:01:35.96,Default,,0000,0000,0000,,existing photos and videos of a person.
Dialogue: 0,0:01:36.70,0:01:39.32,Default,,0000,0000,0000,,If you can leverage\Nthis kind of passive information,
Dialogue: 0,0:01:39.34,0:01:41.35,Default,,0000,0000,0000,,just photos and video that are out there,
Dialogue: 0,0:01:41.37,0:01:43.43,Default,,0000,0000,0000,,that's the key to scaling to anyone.
Dialogue: 0,0:01:44.12,0:01:45.90,Default,,0000,0000,0000,,By the way, here's Richard Feynman,
Dialogue: 0,0:01:45.92,0:01:49.33,Default,,0000,0000,0000,,who in addition to being\Na Nobel Prize winner in physics
Dialogue: 0,0:01:49.36,0:01:51.81,Default,,0000,0000,0000,,was also known as a legendary teacher.
Dialogue: 0,0:01:53.08,0:01:55.28,Default,,0000,0000,0000,,Wouldn't it be great\Nif we could bring him back
Dialogue: 0,0:01:55.30,0:01:58.57,Default,,0000,0000,0000,,to give his lectures\Nand inspire millions of kids,
Dialogue: 0,0:01:58.59,0:02:01.58,Default,,0000,0000,0000,,perhaps not just in English\Nbut in any language?
Dialogue: 0,0:02:02.44,0:02:07.04,Default,,0000,0000,0000,,Or if you could ask our grandparents\Nfor advice and hear those comforting words
Dialogue: 0,0:02:07.07,0:02:08.84,Default,,0000,0000,0000,,even if they're no longer with us?
Dialogue: 0,0:02:09.68,0:02:13.08,Default,,0000,0000,0000,,Or maybe using this tool,\Nbook authors, alive or not,
Dialogue: 0,0:02:13.10,0:02:16.04,Default,,0000,0000,0000,,could read aloud all of their books\Nfor anyone interested.
Dialogue: 0,0:02:17.20,0:02:19.64,Default,,0000,0000,0000,,The creative possibilities\Nhere are endless,
Dialogue: 0,0:02:19.66,0:02:21.37,Default,,0000,0000,0000,,and to me, that's very exciting.
Dialogue: 0,0:02:22.60,0:02:24.60,Default,,0000,0000,0000,,And here's how it's working so far.
Dialogue: 0,0:02:24.62,0:02:26.29,Default,,0000,0000,0000,,First, we introduce a new technique
Dialogue: 0,0:02:26.31,0:02:30.88,Default,,0000,0000,0000,,that can reconstruct a high-detailed\N3D face model from any image
Dialogue: 0,0:02:30.91,0:02:33.03,Default,,0000,0000,0000,,without ever 3D-scanning the person.
Dialogue: 0,0:02:33.89,0:02:36.53,Default,,0000,0000,0000,,And here's the same output model\Nfrom different views.
Dialogue: 0,0:02:37.97,0:02:39.47,Default,,0000,0000,0000,,This also works on videos,
Dialogue: 0,0:02:39.50,0:02:42.35,Default,,0000,0000,0000,,by running the same algorithm\Non each video frame
Dialogue: 0,0:02:42.37,0:02:44.59,Default,,0000,0000,0000,,and generating a moving 3D model.
Dialogue: 0,0:02:45.54,0:02:48.31,Default,,0000,0000,0000,,And here's the same\Noutput model from different angles.
Dialogue: 0,0:02:49.93,0:02:52.47,Default,,0000,0000,0000,,It turns out this problem\Nis very challenging,
Dialogue: 0,0:02:52.49,0:02:55.02,Default,,0000,0000,0000,,but the key trick\Nis that we are going to analyze
Dialogue: 0,0:02:55.04,0:02:58.01,Default,,0000,0000,0000,,a large photo collection\Nof the person beforehand.
Dialogue: 0,0:02:58.65,0:03:01.19,Default,,0000,0000,0000,,For George W. Bush,\Nwe can just search on Google,
Dialogue: 0,0:03:02.31,0:03:04.81,Default,,0000,0000,0000,,and from that, we are able\Nto build an average model,
Dialogue: 0,0:03:04.83,0:03:07.94,Default,,0000,0000,0000,,an iterative, refined model\Nto recover the expression
Dialogue: 0,0:03:07.97,0:03:10.30,Default,,0000,0000,0000,,in fine details,\Nlike creases and wrinkles.
Dialogue: 0,0:03:11.33,0:03:12.73,Default,,0000,0000,0000,,What's fascinating about this
Dialogue: 0,0:03:12.75,0:03:16.18,Default,,0000,0000,0000,,is that the photo collection\Ncan come from your typical photos.
Dialogue: 0,0:03:16.20,0:03:18.80,Default,,0000,0000,0000,,It doesn't really matter\Nwhat expression you're making
Dialogue: 0,0:03:18.83,0:03:20.71,Default,,0000,0000,0000,,or where you took those photos.
Dialogue: 0,0:03:20.74,0:03:23.14,Default,,0000,0000,0000,,What matters is\Nthat there are a lot of them.
Dialogue: 0,0:03:23.16,0:03:24.90,Default,,0000,0000,0000,,And we are still missing color here,
Dialogue: 0,0:03:24.92,0:03:27.27,Default,,0000,0000,0000,,so next, we develop\Na new blending technique
Dialogue: 0,0:03:27.29,0:03:30.13,Default,,0000,0000,0000,,that improves upon\Na single averaging method
Dialogue: 0,0:03:30.15,0:03:32.97,Default,,0000,0000,0000,,and produces sharp\Nfacial textures and colors.
Dialogue: 0,0:03:33.78,0:03:36.55,Default,,0000,0000,0000,,And this can be done for any expression.
Dialogue: 0,0:03:37.48,0:03:39.98,Default,,0000,0000,0000,,Now we have a control\Nof a model of a person,
Dialogue: 0,0:03:40.01,0:03:43.80,Default,,0000,0000,0000,,and the way it's controlled now\Nis by a sequence of static photos.
Dialogue: 0,0:03:43.83,0:03:46.95,Default,,0000,0000,0000,,Notice how the wrinkles come and go,\Ndepending on the expression.
Dialogue: 0,0:03:48.11,0:03:50.86,Default,,0000,0000,0000,,We can also use a video\Nto drive the model.
Dialogue: 0,0:03:50.88,0:03:53.47,Default,,0000,0000,0000,,(Video) Daniel Craig: Right, but somehow,
Dialogue: 0,0:03:53.50,0:03:57.27,Default,,0000,0000,0000,,we've managed to attract\Nsome more amazing people.
Dialogue: 0,0:03:58.02,0:03:59.66,Default,,0000,0000,0000,,SS: And here's another fun demo.
Dialogue: 0,0:03:59.69,0:04:01.93,Default,,0000,0000,0000,,So what you see here\Nare controllable models
Dialogue: 0,0:04:01.96,0:04:04.40,Default,,0000,0000,0000,,of people I built\Nfrom their internet photos.
Dialogue: 0,0:04:04.42,0:04:07.33,Default,,0000,0000,0000,,Now, if you transfer\Nthe motion from the input video,
Dialogue: 0,0:04:07.35,0:04:09.50,Default,,0000,0000,0000,,we can actually drive the entire party.
Dialogue: 0,0:04:09.53,0:04:11.70,Default,,0000,0000,0000,,George W. Bush:\NIt's a difficult bill to pass,
Dialogue: 0,0:04:11.72,0:04:14.03,Default,,0000,0000,0000,,because there's a lot of moving parts,
Dialogue: 0,0:04:14.05,0:04:19.28,Default,,0000,0000,0000,,and the legislative processes can be ugly.
Dialogue: 0,0:04:19.31,0:04:20.94,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:04:20.96,0:04:22.80,Default,,0000,0000,0000,,SS: So coming back a little bit,
Dialogue: 0,0:04:22.82,0:04:26.01,Default,,0000,0000,0000,,our ultimate goal, rather,\Nis to capture their mannerisms
Dialogue: 0,0:04:26.04,0:04:29.08,Default,,0000,0000,0000,,or the unique way each\Nof these people talks and smiles.
Dialogue: 0,0:04:29.11,0:04:31.42,Default,,0000,0000,0000,,So to do that, can we\Nactually teach the computer
Dialogue: 0,0:04:31.44,0:04:33.66,Default,,0000,0000,0000,,to imitate the way someone talks
Dialogue: 0,0:04:33.69,0:04:36.11,Default,,0000,0000,0000,,by only showing it\Nvideo footage of the person?
Dialogue: 0,0:04:36.90,0:04:39.48,Default,,0000,0000,0000,,And what I did exactly was,\NI let a computer watch
Dialogue: 0,0:04:39.50,0:04:42.78,Default,,0000,0000,0000,,14 hours of pure Barack Obama\Ngiving addresses.
Dialogue: 0,0:04:43.44,0:04:46.96,Default,,0000,0000,0000,,And here's what we can produce\Ngiven only his audio.
Dialogue: 0,0:04:46.98,0:04:48.76,Default,,0000,0000,0000,,(Video) BO: The results are clear.
Dialogue: 0,0:04:48.78,0:04:53.13,Default,,0000,0000,0000,,America's businesses have created\N14.5 million new jobs
Dialogue: 0,0:04:53.16,0:04:55.93,Default,,0000,0000,0000,,over 75 straight months.
Dialogue: 0,0:04:55.96,0:04:58.86,Default,,0000,0000,0000,,SS: So what's being synthesized here\Nis only the mouth region,
Dialogue: 0,0:04:58.88,0:05:00.42,Default,,0000,0000,0000,,and here's how we do it.
Dialogue: 0,0:05:00.76,0:05:02.59,Default,,0000,0000,0000,,Our pipeline uses a neural network
Dialogue: 0,0:05:02.61,0:05:05.55,Default,,0000,0000,0000,,to convert and input audio\Ninto these mouth points.
Dialogue: 0,0:05:06.55,0:05:10.77,Default,,0000,0000,0000,,(Video) BO: We get it through our job\Nor through Medicare or Medicaid.
Dialogue: 0,0:05:10.80,0:05:14.22,Default,,0000,0000,0000,,SS: Then we synthesize the texture,\Nenhance details and teeth,
Dialogue: 0,0:05:14.24,0:05:17.31,Default,,0000,0000,0000,,and blend it into the head\Nand background from a source video.
Dialogue: 0,0:05:17.34,0:05:19.24,Default,,0000,0000,0000,,(Video) BO: Women can get free checkups,
Dialogue: 0,0:05:19.27,0:05:22.24,Default,,0000,0000,0000,,and you can't get charged more\Njust for being a woman.
Dialogue: 0,0:05:22.97,0:05:26.28,Default,,0000,0000,0000,,Young people can stay\Non a parent's plan until they turn 26.
Dialogue: 0,0:05:27.27,0:05:30.22,Default,,0000,0000,0000,,SS: I think these results\Nseem very realistic and intriguing,
Dialogue: 0,0:05:30.24,0:05:33.42,Default,,0000,0000,0000,,but at the same time\Nfrightening, even to me.
Dialogue: 0,0:05:33.44,0:05:37.46,Default,,0000,0000,0000,,Our goal was to build an accurate model\Nof a person, not to misrepresent them.
Dialogue: 0,0:05:37.96,0:05:41.07,Default,,0000,0000,0000,,But one thing that concerns me\Nis its potential for misuse.
Dialogue: 0,0:05:41.96,0:05:44.93,Default,,0000,0000,0000,,People have been thinking\Nabout this problem for a long time,
Dialogue: 0,0:05:44.95,0:05:47.33,Default,,0000,0000,0000,,since the days when Photoshop\Nfirst hit the market.
Dialogue: 0,0:05:47.86,0:05:51.66,Default,,0000,0000,0000,,As a researcher, I'm also working\Non countermeasure technology,
Dialogue: 0,0:05:51.69,0:05:54.63,Default,,0000,0000,0000,,and I'm part of an ongoing\Neffort at AI Foundation,
Dialogue: 0,0:05:54.65,0:05:58.05,Default,,0000,0000,0000,,which uses a combination\Nof machine learning and human moderators
Dialogue: 0,0:05:58.07,0:06:00.22,Default,,0000,0000,0000,,to detect fake images and videos,
Dialogue: 0,0:06:00.24,0:06:01.76,Default,,0000,0000,0000,,fighting against my own work.
Dialogue: 0,0:06:02.68,0:06:05.86,Default,,0000,0000,0000,,And one of the tools we plan to release\Nis called Reality Defender,
Dialogue: 0,0:06:05.89,0:06:09.93,Default,,0000,0000,0000,,which is a web-browser plug-in\Nthat can flag potentially fake content
Dialogue: 0,0:06:09.95,0:06:12.48,Default,,0000,0000,0000,,automatically, right in the browser.
Dialogue: 0,0:06:12.51,0:06:16.74,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:06:16.76,0:06:18.21,Default,,0000,0000,0000,,Despite all this, though,
Dialogue: 0,0:06:18.24,0:06:20.08,Default,,0000,0000,0000,,fake videos could do a lot of damage,
Dialogue: 0,0:06:20.10,0:06:23.40,Default,,0000,0000,0000,,even before anyone has a chance to verify,
Dialogue: 0,0:06:23.42,0:06:26.14,Default,,0000,0000,0000,,so it's very important\Nthat we make everyone aware
Dialogue: 0,0:06:26.17,0:06:28.17,Default,,0000,0000,0000,,of what's currently possible
Dialogue: 0,0:06:28.20,0:06:31.57,Default,,0000,0000,0000,,so we can have the right assumption\Nand be critical about what we see.
Dialogue: 0,0:06:32.42,0:06:37.43,Default,,0000,0000,0000,,There's still a long way to go before\Nwe can fully model individual people
Dialogue: 0,0:06:37.45,0:06:40.24,Default,,0000,0000,0000,,and before we can ensure\Nthe safety of this technology.
Dialogue: 0,0:06:41.10,0:06:42.68,Default,,0000,0000,0000,,But I'm excited and hopeful,
Dialogue: 0,0:06:42.71,0:06:46.25,Default,,0000,0000,0000,,because if we use it right and carefully,
Dialogue: 0,0:06:46.27,0:06:50.58,Default,,0000,0000,0000,,this tool can allow any individual's\Npositive impact on the world
Dialogue: 0,0:06:50.60,0:06:52.79,Default,,0000,0000,0000,,to be massively scaled
Dialogue: 0,0:06:52.82,0:06:55.56,Default,,0000,0000,0000,,and really help shape our future\Nthe way we want it to be.
Dialogue: 0,0:06:55.58,0:06:56.74,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:06:56.76,0:07:01.85,Default,,0000,0000,0000,,(Applause)