[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:15.09,0:00:21.14,Default,,0000,0000,0000,,So over the past few centuries,\Nmicroscopes have revolutionized our world.
Dialogue: 0,0:00:23.20,0:00:27.56,Default,,0000,0000,0000,,They revealed to us a tiny world\Nof objects, life and structures
Dialogue: 0,0:00:27.56,0:00:30.57,Default,,0000,0000,0000,,that are too small for us\Nto see with our naked eyes.
Dialogue: 0,0:00:30.57,0:00:34.06,Default,,0000,0000,0000,,They are a tremendous contribution\Nto science and technology.
Dialogue: 0,0:00:34.06,0:00:37.84,Default,,0000,0000,0000,,Today I'd like to introduce you\Nto a new type of microscope,
Dialogue: 0,0:00:37.84,0:00:40.23,Default,,0000,0000,0000,,a microscope for changes.
Dialogue: 0,0:00:40.23,0:00:43.44,Default,,0000,0000,0000,,It doesn't use optics\Nlike a regular microscope
Dialogue: 0,0:00:43.44,0:00:45.35,Default,,0000,0000,0000,,to make small objects bigger,
Dialogue: 0,0:00:45.35,0:00:49.67,Default,,0000,0000,0000,,but instead it uses a video camera\Nand image processing
Dialogue: 0,0:00:49.67,0:00:54.39,Default,,0000,0000,0000,,to reveal to us the tiniest motions\Nand color changes in objects and people,
Dialogue: 0,0:00:54.53,0:00:58.37,Default,,0000,0000,0000,,changes that are impossible\Nfor us to see with our naked eyes.
Dialogue: 0,0:00:58.91,0:01:02.97,Default,,0000,0000,0000,,And it lets us look at our world\Nin a completely new way.
Dialogue: 0,0:01:03.30,0:01:05.72,Default,,0000,0000,0000,,So what do I mean by color changes?
Dialogue: 0,0:01:07.09,0:01:09.90,Default,,0000,0000,0000,,Our skin, for example,\Nchanges its color very slightly
Dialogue: 0,0:01:09.90,0:01:12.21,Default,,0000,0000,0000,,when the blood flows under it.
Dialogue: 0,0:01:12.21,0:01:14.44,Default,,0000,0000,0000,,That change is incredibly subtle,
Dialogue: 0,0:01:14.44,0:01:16.87,Default,,0000,0000,0000,,which is why, when you look\Nat other people,
Dialogue: 0,0:01:16.87,0:01:19.17,Default,,0000,0000,0000,,when you look at the person\Nsitting next to you,
Dialogue: 0,0:01:19.17,0:01:21.92,Default,,0000,0000,0000,,you don't see their skin\Nor their face changing color.
Dialogue: 0,0:01:21.92,0:01:27.15,Default,,0000,0000,0000,,When we look at this video of Steve here,\Nit appears to us like a static picture,
Dialogue: 0,0:01:27.85,0:01:31.29,Default,,0000,0000,0000,,but once we look at this video\Nthrough our new, special microscope,
Dialogue: 0,0:01:31.29,0:01:34.55,Default,,0000,0000,0000,,suddenly we see\Na completely different image.
Dialogue: 0,0:01:35.28,0:01:39.20,Default,,0000,0000,0000,,What you see here are small changes\Nin the color of Steve's skin,
Dialogue: 0,0:01:39.20,0:01:43.09,Default,,0000,0000,0000,,magnified 100 times\Nso that they become visible.
Dialogue: 0,0:01:43.54,0:01:46.26,Default,,0000,0000,0000,,We can actually see a human pulse.
Dialogue: 0,0:01:46.55,0:01:49.73,Default,,0000,0000,0000,,We can see how fast\NSteve's heart is beating,
Dialogue: 0,0:01:49.73,0:01:53.99,Default,,0000,0000,0000,,but we can also see the actual way\Nthat the blood flows in his face.
Dialogue: 0,0:01:55.15,0:01:58.06,Default,,0000,0000,0000,,And we can do that not just\Nto visualize the pulse,
Dialogue: 0,0:01:58.06,0:02:01.45,Default,,0000,0000,0000,,but also to actually recover\Nour heart rates,
Dialogue: 0,0:02:01.45,0:02:03.51,Default,,0000,0000,0000,,and measure our heart rates.
Dialogue: 0,0:02:03.51,0:02:07.69,Default,,0000,0000,0000,,And we can do it with regular cameras\Nand without touching the patients.
Dialogue: 0,0:02:07.69,0:02:12.77,Default,,0000,0000,0000,,So here you see the pulse and heart rate\Nwe extracted from a neonatal baby
Dialogue: 0,0:02:12.77,0:02:16.25,Default,,0000,0000,0000,,from a video we took\Nwith a regular DSLR camera,
Dialogue: 0,0:02:16.25,0:02:18.36,Default,,0000,0000,0000,,and the heart rate measurement we get
Dialogue: 0,0:02:18.36,0:02:22.59,Default,,0000,0000,0000,,is as accurate as the one you'd get\Nwith a standard monitor in a hospital.
Dialogue: 0,0:02:23.38,0:02:26.46,Default,,0000,0000,0000,,And it doesn't even have to be\Na video we recorded.
Dialogue: 0,0:02:26.46,0:02:29.39,Default,,0000,0000,0000,,We can do it essentially\Nwith other videos as well.
Dialogue: 0,0:02:29.39,0:02:32.56,Default,,0000,0000,0000,,So I just took a short clip\Nfrom "Batman Begins" here
Dialogue: 0,0:02:32.56,0:02:35.23,Default,,0000,0000,0000,,just to show Christian Bale's pulse.
Dialogue: 0,0:02:35.23,0:02:37.28,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:02:37.28,0:02:39.42,Default,,0000,0000,0000,,And you know, presumably\Nhe's wearing makeup,
Dialogue: 0,0:02:39.42,0:02:41.39,Default,,0000,0000,0000,,the lighting here is kind of challenging,
Dialogue: 0,0:02:41.39,0:02:44.39,Default,,0000,0000,0000,,but still, just from the video,\Nwe're able to extract his pulse
Dialogue: 0,0:02:44.39,0:02:46.22,Default,,0000,0000,0000,,and show it quite well.
Dialogue: 0,0:02:46.22,0:02:47.100,Default,,0000,0000,0000,,So how do we do all that?
Dialogue: 0,0:02:47.100,0:02:52.32,Default,,0000,0000,0000,,We basically analyze the changes\Nin the light that are recorded
Dialogue: 0,0:02:52.32,0:02:54.93,Default,,0000,0000,0000,,at every pixel in the video over time,
Dialogue: 0,0:02:54.93,0:02:56.65,Default,,0000,0000,0000,,and then we crank up those changes.
Dialogue: 0,0:02:56.65,0:02:59.49,Default,,0000,0000,0000,,We make them bigger\Nso that we can see them.
Dialogue: 0,0:02:59.49,0:03:01.58,Default,,0000,0000,0000,,The tricky part is that those signals,
Dialogue: 0,0:03:01.58,0:03:04.36,Default,,0000,0000,0000,,those changes that we're after,\Nare extremely subtle,
Dialogue: 0,0:03:04.36,0:03:07.35,Default,,0000,0000,0000,,so we have to be very careful\Nwhen you try to separate them
Dialogue: 0,0:03:07.35,0:03:10.24,Default,,0000,0000,0000,,from noise that always exists in videos.
Dialogue: 0,0:03:10.24,0:03:13.68,Default,,0000,0000,0000,,So we use some clever\Nimage processing techniques
Dialogue: 0,0:03:13.68,0:03:17.74,Default,,0000,0000,0000,,to get a very accurate measurement\Nof the color at each pixel in the video,
Dialogue: 0,0:03:17.74,0:03:20.57,Default,,0000,0000,0000,,and then the way\Nthe color changes over time,
Dialogue: 0,0:03:20.57,0:03:23.23,Default,,0000,0000,0000,,and then we amplify those changes.
Dialogue: 0,0:03:23.23,0:03:27.08,Default,,0000,0000,0000,,We make them bigger to create those types\Nof enhanced videos, or magnified videos,
Dialogue: 0,0:03:27.08,0:03:29.55,Default,,0000,0000,0000,,that actually show us those changes.
Dialogue: 0,0:03:32.01,0:03:36.23,Default,,0000,0000,0000,,But it turns out we can do that\Nnot just to show tiny changes in color,
Dialogue: 0,0:03:36.23,0:03:38.38,Default,,0000,0000,0000,,but also tiny motions,
Dialogue: 0,0:03:38.38,0:03:42.06,Default,,0000,0000,0000,,and that's because the light\Nthat gets recorded in our cameras
Dialogue: 0,0:03:42.06,0:03:45.19,Default,,0000,0000,0000,,will change not only if the color\Nof the object changes,
Dialogue: 0,0:03:45.19,0:03:47.30,Default,,0000,0000,0000,,but also if the object moves.
Dialogue: 0,0:03:47.90,0:03:52.54,Default,,0000,0000,0000,,So this is my daughter\Nwhen she was about two months old.
Dialogue: 0,0:03:56.16,0:03:59.40,Default,,0000,0000,0000,,It's a video I recorded\Nabout three years ago.
Dialogue: 0,0:03:59.40,0:04:02.81,Default,,0000,0000,0000,,And as new parents, we all want\Nto make sure our babies are healthy,
Dialogue: 0,0:04:02.81,0:04:05.37,Default,,0000,0000,0000,,that they're breathing,\Nthat they're alive, of course.
Dialogue: 0,0:04:05.37,0:04:07.46,Default,,0000,0000,0000,,So I too got one of those baby monitors
Dialogue: 0,0:04:07.46,0:04:10.07,Default,,0000,0000,0000,,so that I could see my daughter\Nwhen she was asleep.
Dialogue: 0,0:04:10.07,0:04:13.59,Default,,0000,0000,0000,,And this is pretty much what you'll see\Nwith a standard baby monitor.
Dialogue: 0,0:04:13.59,0:04:15.69,Default,,0000,0000,0000,,You can see the baby's sleeping,
Dialogue: 0,0:04:15.69,0:04:17.73,Default,,0000,0000,0000,,but there's not too much information\Nthere.
Dialogue: 0,0:04:17.73,0:04:19.52,Default,,0000,0000,0000,,There's not too much we can see.
Dialogue: 0,0:04:19.52,0:04:22.36,Default,,0000,0000,0000,,Wouldn't it be better,\Nor more informative, or more useful,
Dialogue: 0,0:04:22.36,0:04:25.26,Default,,0000,0000,0000,,if instead we could look\Nat the view like this.
Dialogue: 0,0:04:25.26,0:04:30.31,Default,,0000,0000,0000,,So here I took the motions\Nand I magnified them 30 times,
Dialogue: 0,0:04:31.22,0:04:33.71,Default,,0000,0000,0000,,and then I could clearly see\Nthat my daughter
Dialogue: 0,0:04:33.71,0:04:35.43,Default,,0000,0000,0000,,was indeed alive and breathing.
Dialogue: 0,0:04:35.43,0:04:37.56,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:04:38.09,0:04:39.89,Default,,0000,0000,0000,,Here is a side-by-side comparison.
Dialogue: 0,0:04:39.89,0:04:42.44,Default,,0000,0000,0000,,So again, in the source video,\Nin the original video,
Dialogue: 0,0:04:42.44,0:04:44.26,Default,,0000,0000,0000,,there's not too much we can see,
Dialogue: 0,0:04:44.26,0:04:48.21,Default,,0000,0000,0000,,but once we magnify the motions,\Nthe breathing becomes much more visible.
Dialogue: 0,0:04:48.21,0:04:50.80,Default,,0000,0000,0000,,And it turns out,\Nthere's a lot of phenomena
Dialogue: 0,0:04:50.80,0:04:54.47,Default,,0000,0000,0000,,we can reveal and magnify\Nwith our new motion microscope.
Dialogue: 0,0:04:54.47,0:04:58.91,Default,,0000,0000,0000,,We can see how our veins and arteries\Nare pulsing in our bodies.
Dialogue: 0,0:04:59.75,0:05:02.56,Default,,0000,0000,0000,,We can see that our eyes\Nare constantly moving
Dialogue: 0,0:05:02.56,0:05:04.78,Default,,0000,0000,0000,,in this wobbly motion.
Dialogue: 0,0:05:04.78,0:05:06.35,Default,,0000,0000,0000,,And that's actually my eye,
Dialogue: 0,0:05:06.35,0:05:09.41,Default,,0000,0000,0000,,and again this video was taken\Nright after my daughter was born,
Dialogue: 0,0:05:09.41,0:05:13.10,Default,,0000,0000,0000,,so you can see I wasn't getting\Ntoo much sleep. (Laughter)
Dialogue: 0,0:05:13.54,0:05:16.40,Default,,0000,0000,0000,,Even when a person is sitting still,
Dialogue: 0,0:05:16.40,0:05:18.100,Default,,0000,0000,0000,,there's a lot of information\Nwe can extract
Dialogue: 0,0:05:18.100,0:05:21.99,Default,,0000,0000,0000,,about their breathing patterns,\Nsmall facial expressions.
Dialogue: 0,0:05:22.67,0:05:24.62,Default,,0000,0000,0000,,Maybe we could use those motions
Dialogue: 0,0:05:24.62,0:05:27.49,Default,,0000,0000,0000,,to tell us something about\Nour thoughts or our emotions.
Dialogue: 0,0:05:29.00,0:05:32.38,Default,,0000,0000,0000,,We can also magnify\Nsmall mechanical movements,
Dialogue: 0,0:05:32.38,0:05:34.34,Default,,0000,0000,0000,,like vibrations in engines,
Dialogue: 0,0:05:34.34,0:05:38.02,Default,,0000,0000,0000,,that can help engineers detect\Nand diagnose machinery problems,
Dialogue: 0,0:05:40.13,0:05:45.55,Default,,0000,0000,0000,,or see how our buildings and structures\Nsway in the wind and react to forces.
Dialogue: 0,0:05:45.55,0:05:50.33,Default,,0000,0000,0000,,Those are all things that our society\Nknows how to measure in various ways,
Dialogue: 0,0:05:50.33,0:05:52.88,Default,,0000,0000,0000,,but measuring those motions is one thing,
Dialogue: 0,0:05:52.88,0:05:55.48,Default,,0000,0000,0000,,and actually seeing those motions\Nas they happen
Dialogue: 0,0:05:55.48,0:05:57.61,Default,,0000,0000,0000,,is a whole different thing.
Dialogue: 0,0:05:58.45,0:06:02.02,Default,,0000,0000,0000,,And ever since we discovered\Nthis new technology,
Dialogue: 0,0:06:02.02,0:06:03.72,Default,,0000,0000,0000,,we made our code available online
Dialogue: 0,0:06:03.72,0:06:06.27,Default,,0000,0000,0000,,so that others could use\Nand experiment with it.
Dialogue: 0,0:06:08.00,0:06:09.81,Default,,0000,0000,0000,,It's very simple to use.
Dialogue: 0,0:06:09.81,0:06:11.85,Default,,0000,0000,0000,,It can work on your own videos.
Dialogue: 0,0:06:11.85,0:06:15.36,Default,,0000,0000,0000,,Our collaborators at Quantum Research\Neven created this nice website
Dialogue: 0,0:06:15.36,0:06:18.04,Default,,0000,0000,0000,,where you can upload your videos\Nand process them online,
Dialogue: 0,0:06:18.04,0:06:21.60,Default,,0000,0000,0000,,so even if you don't have any experience\Nin computer science or programming,
Dialogue: 0,0:06:21.60,0:06:24.51,Default,,0000,0000,0000,,you can still very easily experiment\Nwith this new microscope.
Dialogue: 0,0:06:24.51,0:06:26.94,Default,,0000,0000,0000,,And I'd like to show you\Njust a couple of examples
Dialogue: 0,0:06:26.94,0:06:28.92,Default,,0000,0000,0000,,of what others have done with it.
Dialogue: 0,0:06:32.36,0:06:37.26,Default,,0000,0000,0000,,So this video was made\Nby a YouTube user called Tamez85.
Dialogue: 0,0:06:37.26,0:06:38.81,Default,,0000,0000,0000,,I don't know who that user is,
Dialogue: 0,0:06:38.81,0:06:41.10,Default,,0000,0000,0000,,but he, or she, used our code
Dialogue: 0,0:06:41.10,0:06:43.91,Default,,0000,0000,0000,,to magnify small belly movements\Nduring pregnancy.
Dialogue: 0,0:06:44.93,0:06:46.42,Default,,0000,0000,0000,,It's kind of creepy.
Dialogue: 0,0:06:46.42,0:06:48.82,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:06:48.82,0:06:52.78,Default,,0000,0000,0000,,People have used it to magnify\Npulsing veins in their hands.
Dialogue: 0,0:06:53.53,0:06:56.70,Default,,0000,0000,0000,,And you know it's not real science\Nunless you use guinea pigs,
Dialogue: 0,0:06:58.04,0:07:00.58,Default,,0000,0000,0000,,and apparently this guinea pig\Nis called Tiffany,
Dialogue: 0,0:07:00.58,0:07:04.01,Default,,0000,0000,0000,,and this YouTube user claims\Nit is the first rodent on Earth
Dialogue: 0,0:07:04.01,0:07:05.78,Default,,0000,0000,0000,,that was motion-magnified.
Dialogue: 0,0:07:06.60,0:07:08.81,Default,,0000,0000,0000,,You can also do some art with it.
Dialogue: 0,0:07:08.81,0:07:12.12,Default,,0000,0000,0000,,So this video was sent to me\Nby a design student at Yale.
Dialogue: 0,0:07:12.12,0:07:14.52,Default,,0000,0000,0000,,She wanted to see\Nif there's any difference
Dialogue: 0,0:07:14.52,0:07:16.07,Default,,0000,0000,0000,,in the way her classmates move.
Dialogue: 0,0:07:16.07,0:07:20.36,Default,,0000,0000,0000,,She made them all stand still,\Nand then magnified their motions.
Dialogue: 0,0:07:20.36,0:07:23.46,Default,,0000,0000,0000,,It's like seeing still pictures\Ncome to life.
Dialogue: 0,0:07:23.71,0:07:26.08,Default,,0000,0000,0000,,And the nice thing with all those examples
Dialogue: 0,0:07:26.08,0:07:28.32,Default,,0000,0000,0000,,is that we had nothing to do with them.
Dialogue: 0,0:07:28.32,0:07:32.16,Default,,0000,0000,0000,,We just provided this new tool,\Na new way to look at the world,
Dialogue: 0,0:07:32.16,0:07:36.68,Default,,0000,0000,0000,,and then people find other interesting,\Nnew and creative ways of using it.
Dialogue: 0,0:07:37.74,0:07:39.62,Default,,0000,0000,0000,,But we didn't stop there.
Dialogue: 0,0:07:40.94,0:07:44.60,Default,,0000,0000,0000,,This tool not only allows us\Nto look at the world in a new way,
Dialogue: 0,0:07:44.60,0:07:47.03,Default,,0000,0000,0000,,it also redefines what we can do
Dialogue: 0,0:07:47.03,0:07:50.23,Default,,0000,0000,0000,,and pushes the limits\Nof what we can do with our cameras.
Dialogue: 0,0:07:50.23,0:07:52.61,Default,,0000,0000,0000,,So as scientists, we started wondering,
Dialogue: 0,0:07:52.61,0:07:56.30,Default,,0000,0000,0000,,what other types of physical phenomena\Nproduce tiny motions
Dialogue: 0,0:07:56.30,0:07:59.21,Default,,0000,0000,0000,,that we could now use\Nour cameras to measure?
Dialogue: 0,0:07:59.21,0:08:02.64,Default,,0000,0000,0000,,And one such phenomenon\Nthat we focused on recently is sound.
Dialogue: 0,0:08:03.66,0:08:05.96,Default,,0000,0000,0000,,Sound, as we all know,\Nis basically changes
Dialogue: 0,0:08:05.96,0:08:08.13,Default,,0000,0000,0000,,in air pressure\Nthat travel through the air.
Dialogue: 0,0:08:08.13,0:08:11.86,Default,,0000,0000,0000,,Those pressure waves hit objects\Nand they create small vibrations in them,
Dialogue: 0,0:08:11.86,0:08:14.52,Default,,0000,0000,0000,,which is how we hear\Nand how we record sound.
Dialogue: 0,0:08:14.52,0:08:18.29,Default,,0000,0000,0000,,But it turns out that sound\Nalso produces visual motions.
Dialogue: 0,0:08:18.58,0:08:21.30,Default,,0000,0000,0000,,Those are motions\Nthat are not visible to us
Dialogue: 0,0:08:21.30,0:08:24.23,Default,,0000,0000,0000,,but are visible to a camera\Nwith the right processing.
Dialogue: 0,0:08:24.23,0:08:26.04,Default,,0000,0000,0000,,So here are two examples.
Dialogue: 0,0:08:26.04,0:08:29.37,Default,,0000,0000,0000,,This is me demonstrating\Nmy great singing skills.
Dialogue: 0,0:08:30.84,0:08:33.60,Default,,0000,0000,0000,,(Singing)
Dialogue: 0,0:08:33.60,0:08:34.71,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:08:34.71,0:08:37.71,Default,,0000,0000,0000,,And I took a high-speed video\Nof my throat while I was humming.
Dialogue: 0,0:08:37.71,0:08:39.36,Default,,0000,0000,0000,,Again, if you stare at that video,
Dialogue: 0,0:08:39.36,0:08:41.39,Default,,0000,0000,0000,,there's not too much\Nyou'll be able to see,
Dialogue: 0,0:08:41.39,0:08:45.79,Default,,0000,0000,0000,,but once we magnify the motions 100 times,\Nwe can see all the motions and ripples
Dialogue: 0,0:08:45.79,0:08:49.10,Default,,0000,0000,0000,,in the neck that are involved\Nin producing the sound.
Dialogue: 0,0:08:49.10,0:08:51.53,Default,,0000,0000,0000,,That signal is there in that video.
Dialogue: 0,0:08:51.53,0:08:54.23,Default,,0000,0000,0000,,We also know that singers\Ncan break a wine glass
Dialogue: 0,0:08:54.23,0:08:56.27,Default,,0000,0000,0000,,if they hit the correct note.
Dialogue: 0,0:08:56.27,0:08:58.32,Default,,0000,0000,0000,,So here, we're going to play a note
Dialogue: 0,0:08:58.32,0:09:00.85,Default,,0000,0000,0000,,that's in the resonance frequency\Nof that glass
Dialogue: 0,0:09:00.85,0:09:03.12,Default,,0000,0000,0000,,through a loudspeaker that's next to it.
Dialogue: 0,0:09:03.12,0:09:07.57,Default,,0000,0000,0000,,Once we play that note\Nand magnify the motions 250 times,
Dialogue: 0,0:09:07.57,0:09:10.79,Default,,0000,0000,0000,,we can very clearly see\Nhow the glass vibrates
Dialogue: 0,0:09:10.79,0:09:13.62,Default,,0000,0000,0000,,and resonates in response to the sound.
Dialogue: 0,0:09:14.13,0:09:16.54,Default,,0000,0000,0000,,It's not something you're used to seeing\Nevery day.
Dialogue: 0,0:09:16.54,0:09:19.41,Default,,0000,0000,0000,,And we actually have the demo\Nright outside set up,
Dialogue: 0,0:09:19.41,0:09:21.30,Default,,0000,0000,0000,,so I encourage you to stop by,
Dialogue: 0,0:09:21.30,0:09:24.35,Default,,0000,0000,0000,,and just play with it yourself,\Nyou can actually see it live.
Dialogue: 0,0:09:24.61,0:09:27.77,Default,,0000,0000,0000,,But this made us think.\NIt gave us this crazy idea.
Dialogue: 0,0:09:28.08,0:09:32.86,Default,,0000,0000,0000,,Can we actually invert this process\Nand recover sound from video
Dialogue: 0,0:09:33.45,0:09:37.58,Default,,0000,0000,0000,,by analyzing the tiny vibrations\Nthat sound waves create in objects,
Dialogue: 0,0:09:37.58,0:09:41.90,Default,,0000,0000,0000,,and essentially convert those\Nback into the sounds that produced them.
Dialogue: 0,0:09:42.55,0:09:46.47,Default,,0000,0000,0000,,In this way, we can turn\Neveryday objects into microphones.
Dialogue: 0,0:09:47.96,0:09:49.60,Default,,0000,0000,0000,,So that's exactly what we did.
Dialogue: 0,0:09:49.60,0:09:52.46,Default,,0000,0000,0000,,So here's an empty bag of chips\Nthat was lying on a table,
Dialogue: 0,0:09:52.46,0:09:55.23,Default,,0000,0000,0000,,and we're going to turn that bag of chips\Ninto a microphone
Dialogue: 0,0:09:55.23,0:09:57.14,Default,,0000,0000,0000,,by filming it with a video camera
Dialogue: 0,0:09:57.14,0:10:00.91,Default,,0000,0000,0000,,and analyzing the tiny motions\Nthat sound waves create in it.
Dialogue: 0,0:10:01.48,0:10:04.24,Default,,0000,0000,0000,,So here's the sound\Nthat we played in the room.
Dialogue: 0,0:10:04.24,0:10:07.63,Default,,0000,0000,0000,,(Music: "Mary Had a Little Lamb")
Dialogue: 0,0:10:12.48,0:10:15.43,Default,,0000,0000,0000,,And this is a high-speed video\Nwe recorded of that bag of chips.
Dialogue: 0,0:10:15.43,0:10:16.53,Default,,0000,0000,0000,,Again it's playing.
Dialogue: 0,0:10:16.53,0:10:19.89,Default,,0000,0000,0000,,There's no chance you'll be able\Nto see anything going on in that video
Dialogue: 0,0:10:19.89,0:10:21.00,Default,,0000,0000,0000,,just by looking at it,
Dialogue: 0,0:10:21.00,0:10:23.96,Default,,0000,0000,0000,,but here's the sound we were able\Nto recover just by analyzing
Dialogue: 0,0:10:23.96,0:10:26.27,Default,,0000,0000,0000,,the tiny motions in that video.
Dialogue: 0,0:10:27.13,0:10:30.49,Default,,0000,0000,0000,,(Music: "Mary Had a Little Lamb")
Dialogue: 0,0:10:44.61,0:10:46.46,Default,,0000,0000,0000,,I call it -- Thank you.
Dialogue: 0,0:10:46.46,0:10:49.33,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:10:53.83,0:10:56.14,Default,,0000,0000,0000,,I call it the visual microphone.
Dialogue: 0,0:10:56.14,0:10:59.25,Default,,0000,0000,0000,,We actually extract audio signals\Nfrom video signals.
Dialogue: 0,0:10:59.25,0:11:02.44,Default,,0000,0000,0000,,And just to give you a sense\Nof the scale of the motions here,
Dialogue: 0,0:11:02.44,0:11:06.70,Default,,0000,0000,0000,,a pretty loud sound will cause\Nthat bag of chips
Dialogue: 0,0:11:06.70,0:11:09.27,Default,,0000,0000,0000,,to move less than a micrometer.
Dialogue: 0,0:11:09.81,0:11:12.48,Default,,0000,0000,0000,,That's one thousandth of a millimeter.
Dialogue: 0,0:11:12.48,0:11:16.18,Default,,0000,0000,0000,,That's how tiny the motions are\Nthat we are now able to pull out
Dialogue: 0,0:11:16.18,0:11:19.28,Default,,0000,0000,0000,,just by observing how light\Nbounces off objects
Dialogue: 0,0:11:19.28,0:11:21.70,Default,,0000,0000,0000,,and gets recorded by our cameras.
Dialogue: 0,0:11:22.21,0:11:25.36,Default,,0000,0000,0000,,We can recover sounds\Nfrom other objects, like plants.
Dialogue: 0,0:11:25.99,0:11:29.18,Default,,0000,0000,0000,,(Music: "Mary Had a Little Lamb")
Dialogue: 0,0:11:34.15,0:11:36.46,Default,,0000,0000,0000,,And we can recover speech as well.
Dialogue: 0,0:11:36.46,0:11:38.82,Default,,0000,0000,0000,,So here's a person speaking in a room.
Dialogue: 0,0:11:38.82,0:11:43.63,Default,,0000,0000,0000,,Voice: Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:11:43.63,0:11:47.57,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthat lamb was sure to go.
Dialogue: 0,0:11:48.72,0:11:51.49,Default,,0000,0000,0000,,Michael Rubinstein: And here's\Nthat speech again recovered
Dialogue: 0,0:11:51.49,0:11:54.22,Default,,0000,0000,0000,,just from this video\Nof that same bag of chips.
Dialogue: 0,0:11:54.22,0:11:59.21,Default,,0000,0000,0000,,Voice: Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:11:59.21,0:12:03.73,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthat lamb was sure to go.
Dialogue: 0,0:12:04.35,0:12:06.91,Default,,0000,0000,0000,,MR: We used "Mary Had a Little Lamb"
Dialogue: 0,0:12:06.91,0:12:09.25,Default,,0000,0000,0000,,because those are said to be\Nthe first words
Dialogue: 0,0:12:09.25,0:12:13.05,Default,,0000,0000,0000,,that Thomas Edison spoke\Ninto his phonograph in 1877.
Dialogue: 0,0:12:13.05,0:12:16.56,Default,,0000,0000,0000,,It was one of the first\Nsound recording devices in history.
Dialogue: 0,0:12:16.56,0:12:19.84,Default,,0000,0000,0000,,It basically directed the sounds\Nonto a diaphragm
Dialogue: 0,0:12:19.84,0:12:24.27,Default,,0000,0000,0000,,that vibrated a needle that essentially\Nengraved the sound on tinfoil
Dialogue: 0,0:12:24.27,0:12:26.56,Default,,0000,0000,0000,,that was wrapped around the cylinder.
Dialogue: 0,0:12:26.56,0:12:29.68,Default,,0000,0000,0000,,Here's a demonstration of recording
Dialogue: 0,0:12:29.68,0:12:32.45,Default,,0000,0000,0000,,and replaying sound\Nwith Edison's phonograph.
Dialogue: 0,0:12:33.55,0:12:36.49,Default,,0000,0000,0000,,(Video) Voice: Testing, testing,\None two three.
Dialogue: 0,0:12:36.49,0:12:39.65,Default,,0000,0000,0000,,Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:12:39.65,0:12:43.49,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthe lamb was sure to go.
Dialogue: 0,0:12:43.49,0:12:46.01,Default,,0000,0000,0000,,Testing, testing, one two three.
Dialogue: 0,0:12:46.01,0:12:50.10,Default,,0000,0000,0000,,Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:12:50.10,0:12:54.24,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthe lamb was sure to go.
Dialogue: 0,0:12:55.72,0:12:59.08,Default,,0000,0000,0000,,MR: And now, 137 years later,
Dialogue: 0,0:13:00.33,0:13:03.49,Default,,0000,0000,0000,,we're able to get sound\Nin pretty much similar quality
Dialogue: 0,0:13:03.49,0:13:07.56,Default,,0000,0000,0000,,but by just watching objects\Nvibrate to sound with cameras,
Dialogue: 0,0:13:07.85,0:13:09.95,Default,,0000,0000,0000,,and we can even do that when the camera
Dialogue: 0,0:13:09.95,0:13:13.63,Default,,0000,0000,0000,,is 15 feet away from the object,\Nbehind soundproof glass.
Dialogue: 0,0:13:14.18,0:13:17.48,Default,,0000,0000,0000,,So this is the sound that we were able\Nto recover in that case.
Dialogue: 0,0:13:17.48,0:13:22.28,Default,,0000,0000,0000,,Voice: Mary had a little lamb\Nwhose fleece was white as snow,
Dialogue: 0,0:13:22.28,0:13:26.99,Default,,0000,0000,0000,,and everywhere that Mary went,\Nthe lamb was sure to go.
Dialogue: 0,0:13:28.11,0:13:31.71,Default,,0000,0000,0000,,MR: And of course, surveillance is\Nthe first application that comes to mind.
Dialogue: 0,0:13:31.71,0:13:33.99,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:13:33.99,0:13:38.06,Default,,0000,0000,0000,,But it might actually be useful\Nfor other things as well.
Dialogue: 0,0:13:38.10,0:13:41.20,Default,,0000,0000,0000,,Maybe in the future,\Nwe'll be able to use it, for example,
Dialogue: 0,0:13:41.20,0:13:43.56,Default,,0000,0000,0000,,to recover sound across space,
Dialogue: 0,0:13:43.56,0:13:46.57,Default,,0000,0000,0000,,because sound can't travel\Nin space, but light can.
Dialogue: 0,0:13:47.17,0:13:49.52,Default,,0000,0000,0000,,We've only just begun exploring
Dialogue: 0,0:13:49.52,0:13:52.51,Default,,0000,0000,0000,,other possible uses\Nfor this new technology.
Dialogue: 0,0:13:52.51,0:13:55.29,Default,,0000,0000,0000,,It lets us see physical processes\Nthat we know are there
Dialogue: 0,0:13:55.29,0:13:59.58,Default,,0000,0000,0000,,but that we've never been able\Nto see with our own eyes until now.
Dialogue: 0,0:14:00.68,0:14:01.92,Default,,0000,0000,0000,,This is our team.
Dialogue: 0,0:14:01.92,0:14:04.77,Default,,0000,0000,0000,,Everything I showed you today\Nis a result of a collaboration
Dialogue: 0,0:14:04.77,0:14:06.86,Default,,0000,0000,0000,,with this great group\Nof people you see here,
Dialogue: 0,0:14:06.86,0:14:10.48,Default,,0000,0000,0000,,and I encourage you and welcome you\Nto check out our website,
Dialogue: 0,0:14:10.48,0:14:12.02,Default,,0000,0000,0000,,try it out yourself,
Dialogue: 0,0:14:12.02,0:14:15.26,Default,,0000,0000,0000,,and join us in exploring\Nthis world of tiny motions.
Dialogue: 0,0:14:15.26,0:14:16.70,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:14:16.70,0:14:18.73,Default,,0000,0000,0000,,(Applause)