[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:13.96,0:00:17.10,Default,,0000,0000,0000,,Hello, I'm Joy, a poet of code,
Dialogue: 0,0:00:17.12,0:00:22.11,Default,,0000,0000,0000,,on a mission to stop\Nan unseen force that's rising,
Dialogue: 0,0:00:22.14,0:00:24.99,Default,,0000,0000,0000,,a force that I called "the coded gaze,"
Dialogue: 0,0:00:25.02,0:00:28.32,Default,,0000,0000,0000,,my term for algorithmic bias.
Dialogue: 0,0:00:28.35,0:00:32.65,Default,,0000,0000,0000,,Algorithmic bias, like human bias,\Nresults in unfairness.
Dialogue: 0,0:00:32.67,0:00:38.70,Default,,0000,0000,0000,,However, algorithms, like viruses,\Ncan spread bias on a massive scale
Dialogue: 0,0:00:38.72,0:00:40.30,Default,,0000,0000,0000,,at a rapid pace.
Dialogue: 0,0:00:40.86,0:00:45.25,Default,,0000,0000,0000,,Algorithmic bias can also lead\Nto exclusionary experiences
Dialogue: 0,0:00:45.27,0:00:47.40,Default,,0000,0000,0000,,and discriminatory practices.
Dialogue: 0,0:00:47.43,0:00:49.49,Default,,0000,0000,0000,,Let me show you what I mean.
Dialogue: 0,0:00:50.34,0:00:52.78,Default,,0000,0000,0000,,(Video) Joy Boulamwini: Hi, camera.\NI've got a face.
Dialogue: 0,0:00:53.24,0:00:55.11,Default,,0000,0000,0000,,Can you see my face?
Dialogue: 0,0:00:55.13,0:00:56.76,Default,,0000,0000,0000,,No-glasses face?
Dialogue: 0,0:00:58.46,0:01:00.21,Default,,0000,0000,0000,,You can see her face.
Dialogue: 0,0:01:01.08,0:01:02.69,Default,,0000,0000,0000,,What about my face?
Dialogue: 0,0:01:05.87,0:01:07.05,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:01:07.08,0:01:09.74,Default,,0000,0000,0000,,I've got a mask. Can you see my mask?
Dialogue: 0,0:01:11.91,0:01:14.28,Default,,0000,0000,0000,,Joy Boulamwini: So how did this happen?
Dialogue: 0,0:01:14.30,0:01:17.44,Default,,0000,0000,0000,,Why am I sitting in front of a computer
Dialogue: 0,0:01:17.47,0:01:18.89,Default,,0000,0000,0000,,in a white mask,
Dialogue: 0,0:01:18.92,0:01:22.57,Default,,0000,0000,0000,,trying to be detected by a cheap webcam?
Dialogue: 0,0:01:22.59,0:01:24.88,Default,,0000,0000,0000,,Well, when I'm not fighting the coded gaze
Dialogue: 0,0:01:24.90,0:01:26.42,Default,,0000,0000,0000,,as a poet of code,
Dialogue: 0,0:01:26.45,0:01:29.72,Default,,0000,0000,0000,,I'm a graduate student\Nat the MIT Media Lab,
Dialogue: 0,0:01:29.74,0:01:34.66,Default,,0000,0000,0000,,and there I have the opportunity to work\Non all sorts of whimsical projects,
Dialogue: 0,0:01:34.69,0:01:36.71,Default,,0000,0000,0000,,including the Aspire Mirror,
Dialogue: 0,0:01:36.74,0:01:41.87,Default,,0000,0000,0000,,a project I did so I could project\Ndigital masks onto my reflection.
Dialogue: 0,0:01:41.90,0:01:44.24,Default,,0000,0000,0000,,So in the morning, if I wanted\Nto feel powerful,
Dialogue: 0,0:01:44.27,0:01:45.70,Default,,0000,0000,0000,,I could put on a lion.
Dialogue: 0,0:01:45.73,0:01:49.22,Default,,0000,0000,0000,,If I wanted to be uplifted,\NI might have a quote.
Dialogue: 0,0:01:49.25,0:01:52.24,Default,,0000,0000,0000,,So I used generic\Nfacial recognition software
Dialogue: 0,0:01:52.26,0:01:53.61,Default,,0000,0000,0000,,to build the system,
Dialogue: 0,0:01:53.64,0:01:58.74,Default,,0000,0000,0000,,but found it was really hard to test it\Nunless I wore a white mask.
Dialogue: 0,0:01:59.72,0:02:04.07,Default,,0000,0000,0000,,Unfortunately, I've run\Ninto this issue before.
Dialogue: 0,0:02:04.09,0:02:08.44,Default,,0000,0000,0000,,When I was an undergraduate\Nat Georgia Tech studying computer science,
Dialogue: 0,0:02:08.46,0:02:10.51,Default,,0000,0000,0000,,I used to work on social robots,
Dialogue: 0,0:02:10.54,0:02:14.32,Default,,0000,0000,0000,,and one of my tasks was to get a robot\Nto play peek-a-boo,
Dialogue: 0,0:02:14.34,0:02:16.27,Default,,0000,0000,0000,,a simple turn-taking game
Dialogue: 0,0:02:16.30,0:02:20.62,Default,,0000,0000,0000,,where partners cover their face\Nand then uncover it saying, "Peek-a-boo!"
Dialogue: 0,0:02:20.74,0:02:25.17,Default,,0000,0000,0000,,The problem is, peek-a-boo\Ndoesn't really work if I can't see you,
Dialogue: 0,0:02:25.19,0:02:27.69,Default,,0000,0000,0000,,and my robot couldn't see me.
Dialogue: 0,0:02:27.72,0:02:31.67,Default,,0000,0000,0000,,But I borrowed my roommate's face\Nto get the project done,
Dialogue: 0,0:02:31.69,0:02:33.07,Default,,0000,0000,0000,,submitted the assignment,
Dialogue: 0,0:02:33.10,0:02:36.85,Default,,0000,0000,0000,,and figured, you know what,\Nsomebody else will solve this problem.
Dialogue: 0,0:02:37.50,0:02:39.50,Default,,0000,0000,0000,,Not too long after,
Dialogue: 0,0:02:39.53,0:02:43.68,Default,,0000,0000,0000,,I was in Hong Kong\Nfor an entrepreneurship competition.
Dialogue: 0,0:02:44.17,0:02:46.86,Default,,0000,0000,0000,,The organizers decided\Nto take participants
Dialogue: 0,0:02:46.89,0:02:49.26,Default,,0000,0000,0000,,on a tour of local start-ups.
Dialogue: 0,0:02:49.28,0:02:51.100,Default,,0000,0000,0000,,One of the start-ups had a social robot,
Dialogue: 0,0:02:52.02,0:02:53.93,Default,,0000,0000,0000,,and they decided to do a demo.
Dialogue: 0,0:02:53.96,0:02:56.94,Default,,0000,0000,0000,,The demo worked on everybody\Nuntil it got to me,
Dialogue: 0,0:02:56.96,0:02:58.88,Default,,0000,0000,0000,,and you can probably guess it.
Dialogue: 0,0:02:58.91,0:03:01.87,Default,,0000,0000,0000,,It couldn't detect my face.
Dialogue: 0,0:03:01.90,0:03:04.41,Default,,0000,0000,0000,,I asked the developers what was going on,
Dialogue: 0,0:03:04.43,0:03:09.97,Default,,0000,0000,0000,,and it turned out we had used the same\Ngeneric facial recognition software.
Dialogue: 0,0:03:09.99,0:03:11.64,Default,,0000,0000,0000,,Halfway around the world,
Dialogue: 0,0:03:11.66,0:03:15.52,Default,,0000,0000,0000,,I learned that algorithmic bias\Ncan travel as quickly
Dialogue: 0,0:03:15.54,0:03:18.71,Default,,0000,0000,0000,,as it takes to download\Nsome files off of the internet.
Dialogue: 0,0:03:19.58,0:03:22.65,Default,,0000,0000,0000,,So what's going on?\NWhy isn't my face being detected?
Dialogue: 0,0:03:22.68,0:03:26.03,Default,,0000,0000,0000,,Well, we have to look\Nat how we give machines sight.
Dialogue: 0,0:03:26.06,0:03:29.46,Default,,0000,0000,0000,,Computer vision uses\Nmachine learning techniques
Dialogue: 0,0:03:29.49,0:03:31.37,Default,,0000,0000,0000,,to do facial recognition.
Dialogue: 0,0:03:31.39,0:03:35.29,Default,,0000,0000,0000,,So how this works is, you create\Na training set with examples of faces.
Dialogue: 0,0:03:35.31,0:03:38.13,Default,,0000,0000,0000,,This is a face. This is a face.\NThis is not a face.
Dialogue: 0,0:03:38.16,0:03:42.67,Default,,0000,0000,0000,,And over time, you can teach a computer\Nhow to recognize other faces.
Dialogue: 0,0:03:42.70,0:03:46.69,Default,,0000,0000,0000,,However, if the training sets\Naren't really that diverse,
Dialogue: 0,0:03:46.71,0:03:50.06,Default,,0000,0000,0000,,any face that deviates too much\Nfrom the established norm
Dialogue: 0,0:03:50.08,0:03:51.73,Default,,0000,0000,0000,,will be harder to detect,
Dialogue: 0,0:03:51.76,0:03:53.72,Default,,0000,0000,0000,,which is what was happening to me.
Dialogue: 0,0:03:53.74,0:03:56.13,Default,,0000,0000,0000,,But don't worry -- there's some good news.
Dialogue: 0,0:03:56.15,0:03:58.92,Default,,0000,0000,0000,,Training sets don't just\Nmaterialize out of nowhere.
Dialogue: 0,0:03:58.94,0:04:00.73,Default,,0000,0000,0000,,We actually can create them.
Dialogue: 0,0:04:00.76,0:04:04.93,Default,,0000,0000,0000,,So there's an opportunity to create\Nfull-spectrum training sets
Dialogue: 0,0:04:04.96,0:04:08.78,Default,,0000,0000,0000,,that reflect a richer\Nportrait of humanity.
Dialogue: 0,0:04:08.80,0:04:11.03,Default,,0000,0000,0000,,Now you've seen in my examples
Dialogue: 0,0:04:11.05,0:04:12.82,Default,,0000,0000,0000,,how social robots
Dialogue: 0,0:04:12.84,0:04:17.45,Default,,0000,0000,0000,,was how I found out about exclusion\Nwith algorithmic bias.
Dialogue: 0,0:04:17.48,0:04:22.29,Default,,0000,0000,0000,,But algorithmic bias can also lead\Nto discriminatory practices.
Dialogue: 0,0:04:23.27,0:04:24.72,Default,,0000,0000,0000,,Across the US,
Dialogue: 0,0:04:24.74,0:04:28.94,Default,,0000,0000,0000,,police departments are starting to use\Nfacial recognition software
Dialogue: 0,0:04:28.97,0:04:31.42,Default,,0000,0000,0000,,in their crime-fighting arsenal.
Dialogue: 0,0:04:31.45,0:04:33.46,Default,,0000,0000,0000,,Georgetown Law published a report
Dialogue: 0,0:04:33.49,0:04:40.25,Default,,0000,0000,0000,,showing that one in two adults\Nin the US -- that's 117 million people --
Dialogue: 0,0:04:40.27,0:04:43.81,Default,,0000,0000,0000,,have their faces\Nin facial recognition networks.
Dialogue: 0,0:04:43.83,0:04:48.38,Default,,0000,0000,0000,,Police departments can currently look\Nat these networks unregulated,
Dialogue: 0,0:04:48.41,0:04:52.69,Default,,0000,0000,0000,,using algorithms that have not\Nbeen audited for accuracy.
Dialogue: 0,0:04:52.72,0:04:56.58,Default,,0000,0000,0000,,Yet we know facial recognition\Nis not fail proof,
Dialogue: 0,0:04:56.60,0:05:00.78,Default,,0000,0000,0000,,and labeling faces consistently\Nremains a challenge.
Dialogue: 0,0:05:00.81,0:05:02.57,Default,,0000,0000,0000,,You might have seen this on Facebook.
Dialogue: 0,0:05:02.59,0:05:05.58,Default,,0000,0000,0000,,My friends and I laugh all the time\Nwhen we see other people
Dialogue: 0,0:05:05.61,0:05:08.06,Default,,0000,0000,0000,,mislabeled in our photos.
Dialogue: 0,0:05:08.09,0:05:13.68,Default,,0000,0000,0000,,But misidentifying a suspected criminal\Nis no laughing matter,
Dialogue: 0,0:05:13.70,0:05:16.53,Default,,0000,0000,0000,,nor is breaching civil liberties.
Dialogue: 0,0:05:16.55,0:05:19.76,Default,,0000,0000,0000,,Machine learning is being used\Nfor facial recognition,
Dialogue: 0,0:05:19.78,0:05:24.29,Default,,0000,0000,0000,,but it's also extending beyond the realm\Nof computer vision.
Dialogue: 0,0:05:25.10,0:05:29.11,Default,,0000,0000,0000,,In her book, "Weapons\Nof Math Destruction,"
Dialogue: 0,0:05:29.14,0:05:35.82,Default,,0000,0000,0000,,data scientist Cathy O'Neil\Ntalks about the rising new WMDs --
Dialogue: 0,0:05:35.84,0:05:40.19,Default,,0000,0000,0000,,widespread, mysterious\Nand destructive algorithms
Dialogue: 0,0:05:40.22,0:05:43.18,Default,,0000,0000,0000,,that are increasingly being used\Nto make decisions
Dialogue: 0,0:05:43.21,0:05:46.38,Default,,0000,0000,0000,,that impact more aspects of our lives.
Dialogue: 0,0:05:46.41,0:05:48.28,Default,,0000,0000,0000,,So who gets hired or fired?
Dialogue: 0,0:05:48.30,0:05:50.41,Default,,0000,0000,0000,,Do you get that loan?\NDo you get insurance?
Dialogue: 0,0:05:50.44,0:05:53.94,Default,,0000,0000,0000,,Are you admitted into the college\Nyou wanted to get into?
Dialogue: 0,0:05:53.96,0:05:57.47,Default,,0000,0000,0000,,Do you and I pay the same price\Nfor the same product
Dialogue: 0,0:05:57.50,0:05:59.94,Default,,0000,0000,0000,,purchased on the same platform?
Dialogue: 0,0:05:59.96,0:06:03.72,Default,,0000,0000,0000,,Law enforcement is also starting\Nto use machine learning
Dialogue: 0,0:06:03.75,0:06:06.04,Default,,0000,0000,0000,,for predictive policing.
Dialogue: 0,0:06:06.06,0:06:09.55,Default,,0000,0000,0000,,Some judges use machine-generated\Nrisk scores to determine
Dialogue: 0,0:06:09.58,0:06:13.98,Default,,0000,0000,0000,,how long an individual\Nis going to spend in prison.
Dialogue: 0,0:06:14.00,0:06:16.46,Default,,0000,0000,0000,,So we really have to think\Nabout these decisions.
Dialogue: 0,0:06:16.48,0:06:17.66,Default,,0000,0000,0000,,Are they fair?
Dialogue: 0,0:06:17.69,0:06:20.58,Default,,0000,0000,0000,,And we've seen that algorithmic bias
Dialogue: 0,0:06:20.60,0:06:23.98,Default,,0000,0000,0000,,doesn't necessarily always\Nlead to fair outcomes.
Dialogue: 0,0:06:23.100,0:06:25.96,Default,,0000,0000,0000,,So what can we do about it?
Dialogue: 0,0:06:25.99,0:06:29.67,Default,,0000,0000,0000,,Well, we can start thinking about\Nhow we create more inclusive code
Dialogue: 0,0:06:29.69,0:06:32.68,Default,,0000,0000,0000,,and employ inclusive coding practices.
Dialogue: 0,0:06:32.70,0:06:35.01,Default,,0000,0000,0000,,It really starts with people.
Dialogue: 0,0:06:35.54,0:06:37.50,Default,,0000,0000,0000,,So who codes matters.
Dialogue: 0,0:06:37.52,0:06:41.64,Default,,0000,0000,0000,,Are we creating full-spectrum teams\Nwith diverse individuals
Dialogue: 0,0:06:41.67,0:06:44.08,Default,,0000,0000,0000,,who can check each other's blind spots?
Dialogue: 0,0:06:44.10,0:06:47.65,Default,,0000,0000,0000,,On the technical side,\Nhow we code matters.
Dialogue: 0,0:06:47.67,0:06:51.32,Default,,0000,0000,0000,,Are we factoring in fairness\Nas we're developing systems?
Dialogue: 0,0:06:51.34,0:06:54.26,Default,,0000,0000,0000,,And finally, why we code matters.
Dialogue: 0,0:06:54.62,0:06:59.70,Default,,0000,0000,0000,,We've used tools of computational creation\Nto unlock immense wealth.
Dialogue: 0,0:06:59.72,0:07:04.17,Default,,0000,0000,0000,,We now have the opportunity\Nto unlock even greater equality
Dialogue: 0,0:07:04.19,0:07:07.12,Default,,0000,0000,0000,,if we make social change a priority
Dialogue: 0,0:07:07.15,0:07:09.32,Default,,0000,0000,0000,,and not an afterthought.
Dialogue: 0,0:07:09.84,0:07:14.36,Default,,0000,0000,0000,,And so these are the three tenets\Nthat will make up the "incoding" movement.
Dialogue: 0,0:07:14.38,0:07:16.04,Default,,0000,0000,0000,,Who codes matters,
Dialogue: 0,0:07:16.06,0:07:17.60,Default,,0000,0000,0000,,how we code matters
Dialogue: 0,0:07:17.63,0:07:19.65,Default,,0000,0000,0000,,and why we code matters.
Dialogue: 0,0:07:19.67,0:07:22.77,Default,,0000,0000,0000,,So to go towards incoding,\Nwe can start thinking about
Dialogue: 0,0:07:22.80,0:07:25.96,Default,,0000,0000,0000,,building platforms that can identify bias
Dialogue: 0,0:07:25.98,0:07:29.06,Default,,0000,0000,0000,,by collecting people's experiences\Nlike the ones I shared,
Dialogue: 0,0:07:29.09,0:07:32.16,Default,,0000,0000,0000,,but also auditing existing software.
Dialogue: 0,0:07:32.18,0:07:35.95,Default,,0000,0000,0000,,We can also start to create\Nmore inclusive training sets.
Dialogue: 0,0:07:35.97,0:07:38.77,Default,,0000,0000,0000,,Imagine a "Selfies for Inclusion" campaign
Dialogue: 0,0:07:38.80,0:07:42.45,Default,,0000,0000,0000,,where you and I can help\Ndevelopers test and create
Dialogue: 0,0:07:42.48,0:07:44.57,Default,,0000,0000,0000,,more inclusive training sets.
Dialogue: 0,0:07:45.13,0:07:47.96,Default,,0000,0000,0000,,And we can also start thinking\Nmore conscientiously
Dialogue: 0,0:07:47.98,0:07:53.38,Default,,0000,0000,0000,,about the social impact\Nof the technology that we're developing.
Dialogue: 0,0:07:53.40,0:07:55.79,Default,,0000,0000,0000,,To get the incoding movement started,
Dialogue: 0,0:07:55.82,0:07:58.66,Default,,0000,0000,0000,,I've launched the Algorithmic\NJustice League,
Dialogue: 0,0:07:58.69,0:08:04.56,Default,,0000,0000,0000,,where anyone who cares about fairness\Ncan help fight the coded gaze.
Dialogue: 0,0:08:04.58,0:08:07.88,Default,,0000,0000,0000,,On codedgaze.com, you can report bias,
Dialogue: 0,0:08:07.90,0:08:10.35,Default,,0000,0000,0000,,request audits, become a tester
Dialogue: 0,0:08:10.37,0:08:13.14,Default,,0000,0000,0000,,and join the ongoing conversation,
Dialogue: 0,0:08:13.17,0:08:15.45,Default,,0000,0000,0000,,#codedgaze.
Dialogue: 0,0:08:16.57,0:08:19.06,Default,,0000,0000,0000,,So I invite you to join me
Dialogue: 0,0:08:19.08,0:08:22.80,Default,,0000,0000,0000,,in creating a world where technology\Nworks for all of us,
Dialogue: 0,0:08:22.83,0:08:24.72,Default,,0000,0000,0000,,not just some of us,
Dialogue: 0,0:08:24.75,0:08:29.40,Default,,0000,0000,0000,,a world where we value inclusion\Nand center social change.
Dialogue: 0,0:08:29.42,0:08:30.59,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:08:30.62,0:08:35.91,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:08:36.76,0:08:39.62,Default,,0000,0000,0000,,But I have one question:
Dialogue: 0,0:08:39.64,0:08:41.70,Default,,0000,0000,0000,,Will you join me in the fight?
Dialogue: 0,0:08:41.72,0:08:43.01,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:08:43.03,0:08:46.72,Default,,0000,0000,0000,,(Applause)