[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:01.04,0:00:04.18,Default,,0000,0000,0000,,Hello, I'm Joy, a poet of code,
Dialogue: 0,0:00:04.20,0:00:09.19,Default,,0000,0000,0000,,on a mission to stop\Nan unseen force that's rising,
Dialogue: 0,0:00:09.22,0:00:12.07,Default,,0000,0000,0000,,a force that I called "the coded gaze,"
Dialogue: 0,0:00:12.10,0:00:15.40,Default,,0000,0000,0000,,my term for algorithmic bias.
Dialogue: 0,0:00:15.43,0:00:19.73,Default,,0000,0000,0000,,Algorithmic bias, like human bias,\Nresults in unfairness.
Dialogue: 0,0:00:19.75,0:00:25.78,Default,,0000,0000,0000,,However, algorithms, like viruses,\Ncan spread bias on a massive scale
Dialogue: 0,0:00:25.80,0:00:27.38,Default,,0000,0000,0000,,at a rapid pace.
Dialogue: 0,0:00:27.94,0:00:32.33,Default,,0000,0000,0000,,Algorithmic bias can also lead\Nto exclusionary experiences
Dialogue: 0,0:00:32.35,0:00:34.48,Default,,0000,0000,0000,,and discriminatory practices.
Dialogue: 0,0:00:34.51,0:00:36.57,Default,,0000,0000,0000,,Let me show you what I mean.
Dialogue: 0,0:00:38.25,0:00:40.49,Default,,0000,0000,0000,,(Video) Joy Boulamwini: Camera.\NI've got a face.
Dialogue: 0,0:00:40.51,0:00:42.39,Default,,0000,0000,0000,,Can you see my face?
Dialogue: 0,0:00:42.41,0:00:45.52,Default,,0000,0000,0000,,No-glasses face.
Dialogue: 0,0:00:45.55,0:00:48.24,Default,,0000,0000,0000,,You can see her face.
Dialogue: 0,0:00:48.26,0:00:50.50,Default,,0000,0000,0000,,What about my face?
Dialogue: 0,0:00:53.26,0:00:54.41,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:00:54.43,0:00:58.18,Default,,0000,0000,0000,,I've got a mask. Can you see my mask?
Dialogue: 0,0:00:59.01,0:01:01.38,Default,,0000,0000,0000,,Joy Boulamwini: So how did this happen?
Dialogue: 0,0:01:01.40,0:01:04.54,Default,,0000,0000,0000,,Why am I sitting in front of a computer
Dialogue: 0,0:01:04.57,0:01:05.99,Default,,0000,0000,0000,,in a white mask,
Dialogue: 0,0:01:06.02,0:01:09.67,Default,,0000,0000,0000,,trying to be detected by a cheap webcam?
Dialogue: 0,0:01:09.69,0:01:11.98,Default,,0000,0000,0000,,Well, when I'm not fighting the coded gaze
Dialogue: 0,0:01:12.00,0:01:13.52,Default,,0000,0000,0000,,as a poet of code,
Dialogue: 0,0:01:13.55,0:01:16.82,Default,,0000,0000,0000,,I'm a graduate student\Nat the MIT Media Lab,
Dialogue: 0,0:01:16.84,0:01:21.76,Default,,0000,0000,0000,,and there I have the opportunity to work\Non all sorts of whimsical projects,
Dialogue: 0,0:01:21.79,0:01:23.81,Default,,0000,0000,0000,,including the Aspire Mirror,
Dialogue: 0,0:01:23.84,0:01:28.97,Default,,0000,0000,0000,,a project I did so I could project\Ndigital masks onto my reflection.
Dialogue: 0,0:01:28.100,0:01:31.34,Default,,0000,0000,0000,,So in the morning, if I wanted\Nto feel powerful,
Dialogue: 0,0:01:31.37,0:01:32.80,Default,,0000,0000,0000,,I could put on a lion.
Dialogue: 0,0:01:32.83,0:01:36.32,Default,,0000,0000,0000,,If I wanted to be uplifted,\NI might have a quote.
Dialogue: 0,0:01:36.35,0:01:39.34,Default,,0000,0000,0000,,So I used generic\Nfacial recognition software
Dialogue: 0,0:01:39.36,0:01:40.71,Default,,0000,0000,0000,,to build the system,
Dialogue: 0,0:01:40.74,0:01:45.84,Default,,0000,0000,0000,,but found it was really hard to test it\Nunless I wore a white mask.
Dialogue: 0,0:01:46.82,0:01:51.17,Default,,0000,0000,0000,,Unfortunately, I've run\Ninto this issue before.
Dialogue: 0,0:01:51.19,0:01:55.50,Default,,0000,0000,0000,,When I was an undergraduate\Nat Georgia Tech studying computer science,
Dialogue: 0,0:01:55.52,0:01:57.57,Default,,0000,0000,0000,,I used to work on social robots,
Dialogue: 0,0:01:57.60,0:02:01.38,Default,,0000,0000,0000,,and one of my tasks was to get a robot\Nto play peek-a-boo,
Dialogue: 0,0:02:01.40,0:02:03.08,Default,,0000,0000,0000,,a simple turn-taking game
Dialogue: 0,0:02:03.11,0:02:07.43,Default,,0000,0000,0000,,where partners cover their face\Nand then uncover it saying, "Peek-a-boo!"
Dialogue: 0,0:02:07.45,0:02:11.88,Default,,0000,0000,0000,,The problem is, peek-a-boo\Ndoesn't really work if I can't see you,
Dialogue: 0,0:02:11.90,0:02:14.40,Default,,0000,0000,0000,,and my robot couldn't see me.
Dialogue: 0,0:02:14.43,0:02:18.38,Default,,0000,0000,0000,,But I borrowed my roommate's face\Nto get the project done,
Dialogue: 0,0:02:18.40,0:02:19.78,Default,,0000,0000,0000,,submitted the assignment,
Dialogue: 0,0:02:19.80,0:02:23.56,Default,,0000,0000,0000,,and figured, you know what,\Nsomebody else will solve this problem.
Dialogue: 0,0:02:24.21,0:02:26.21,Default,,0000,0000,0000,,Not too longer after,
Dialogue: 0,0:02:26.24,0:02:30.40,Default,,0000,0000,0000,,I was in Hong Kong\Nfor an entrepreneurship competition.
Dialogue: 0,0:02:30.88,0:02:33.57,Default,,0000,0000,0000,,The organizers decided\Nto take participants
Dialogue: 0,0:02:33.60,0:02:35.97,Default,,0000,0000,0000,,on a tour of local start-ups.
Dialogue: 0,0:02:35.99,0:02:38.71,Default,,0000,0000,0000,,One of the start-ups had a social robot,
Dialogue: 0,0:02:38.73,0:02:40.64,Default,,0000,0000,0000,,and they decided to do a demo.
Dialogue: 0,0:02:40.67,0:02:43.65,Default,,0000,0000,0000,,The demo worked on everybody\Nuntil it got to me,
Dialogue: 0,0:02:43.67,0:02:45.60,Default,,0000,0000,0000,,and you can probably guess it.
Dialogue: 0,0:02:45.62,0:02:48.58,Default,,0000,0000,0000,,It couldn't detect my face.
Dialogue: 0,0:02:48.61,0:02:51.12,Default,,0000,0000,0000,,I asked the developers what was going on,
Dialogue: 0,0:02:51.14,0:02:56.68,Default,,0000,0000,0000,,and it turned out we had used the same\Ngeneric facial recognition software.
Dialogue: 0,0:02:56.70,0:02:58.35,Default,,0000,0000,0000,,Halfway around the world,
Dialogue: 0,0:02:58.37,0:03:02.23,Default,,0000,0000,0000,,I learned that algorithmic bias\Ncan travel as quickly
Dialogue: 0,0:03:02.25,0:03:05.42,Default,,0000,0000,0000,,as it takes to download\Nsome files off of the internet.
Dialogue: 0,0:03:06.28,0:03:09.36,Default,,0000,0000,0000,,So what's going on?\NWhy isn't my face being detected?
Dialogue: 0,0:03:09.38,0:03:12.74,Default,,0000,0000,0000,,Well, we have to look at\Nhow we give machines sight.
Dialogue: 0,0:03:12.76,0:03:16.17,Default,,0000,0000,0000,,Computer vision uses\Nmachine learning techniques
Dialogue: 0,0:03:16.20,0:03:18.08,Default,,0000,0000,0000,,to do facial recognition.
Dialogue: 0,0:03:18.10,0:03:21.100,Default,,0000,0000,0000,,So how this works is, you create\Na training set with examples of faces.
Dialogue: 0,0:03:22.02,0:03:24.84,Default,,0000,0000,0000,,This is a face. This is a face.\NThis is not a face.
Dialogue: 0,0:03:24.86,0:03:29.38,Default,,0000,0000,0000,,And over time, you can teach a computer\Nhow to recognize other faces.
Dialogue: 0,0:03:29.41,0:03:33.40,Default,,0000,0000,0000,,However, if the training sets\Naren't really that diverse,
Dialogue: 0,0:03:33.42,0:03:36.77,Default,,0000,0000,0000,,any face that deviates too much\Nfrom the established norm
Dialogue: 0,0:03:36.79,0:03:38.44,Default,,0000,0000,0000,,will be harder to detect,
Dialogue: 0,0:03:38.47,0:03:40.43,Default,,0000,0000,0000,,which is what was happening to me.
Dialogue: 0,0:03:40.45,0:03:42.84,Default,,0000,0000,0000,,But don't worry -- there's some good news.
Dialogue: 0,0:03:42.86,0:03:45.63,Default,,0000,0000,0000,,Training sets don't just\Nmaterialize out of nowhere.
Dialogue: 0,0:03:45.66,0:03:47.44,Default,,0000,0000,0000,,We actually can create them.
Dialogue: 0,0:03:47.47,0:03:51.64,Default,,0000,0000,0000,,So there's an opportunity to create\Nfull-spectrum training sets
Dialogue: 0,0:03:51.67,0:03:55.49,Default,,0000,0000,0000,,that reflect a richer\Nportrait of humanity.
Dialogue: 0,0:03:55.52,0:03:57.74,Default,,0000,0000,0000,,Now you've seen in my examples
Dialogue: 0,0:03:57.76,0:03:59.53,Default,,0000,0000,0000,,how social robots
Dialogue: 0,0:03:59.55,0:04:04.16,Default,,0000,0000,0000,,was how I found out about exclusion\Nwith algorithmic bias.
Dialogue: 0,0:04:04.19,0:04:09.00,Default,,0000,0000,0000,,But algorithmic bias can also lead\Nto discriminatory practices.
Dialogue: 0,0:04:09.98,0:04:11.43,Default,,0000,0000,0000,,Across the US,
Dialogue: 0,0:04:11.45,0:04:15.65,Default,,0000,0000,0000,,police departments are starting to use\Nfacial recognition software
Dialogue: 0,0:04:15.68,0:04:18.14,Default,,0000,0000,0000,,in their crime-fighting arsenal.
Dialogue: 0,0:04:18.16,0:04:20.17,Default,,0000,0000,0000,,Georgetown Law published a report
Dialogue: 0,0:04:20.20,0:04:26.96,Default,,0000,0000,0000,,showing that one in two adults\Nin the US -- that's 117 million people --
Dialogue: 0,0:04:26.98,0:04:30.52,Default,,0000,0000,0000,,have their faces\Nin facial recognition networks.
Dialogue: 0,0:04:30.54,0:04:35.09,Default,,0000,0000,0000,,Police departments can currently look\Nat these networks unregulated,
Dialogue: 0,0:04:35.12,0:04:39.40,Default,,0000,0000,0000,,using algorithms that have not\Nbeen audited for accuracy.
Dialogue: 0,0:04:39.43,0:04:43.29,Default,,0000,0000,0000,,Yet we know facial recognition\Nis not fail proof,
Dialogue: 0,0:04:43.32,0:04:47.49,Default,,0000,0000,0000,,and labeling faces consistently\Nremains a challenge.
Dialogue: 0,0:04:47.52,0:04:49.28,Default,,0000,0000,0000,,You might have seen this on Facebook.
Dialogue: 0,0:04:49.30,0:04:52.29,Default,,0000,0000,0000,,My friends and I laugh all the time\Nwhen we see other people
Dialogue: 0,0:04:52.32,0:04:54.77,Default,,0000,0000,0000,,mislabeled in our photos.
Dialogue: 0,0:04:54.80,0:05:00.39,Default,,0000,0000,0000,,But misidentifying a suspected criminal\Nis no laughing matter,
Dialogue: 0,0:05:00.41,0:05:03.24,Default,,0000,0000,0000,,nor is breaching civil liberties.
Dialogue: 0,0:05:03.26,0:05:06.47,Default,,0000,0000,0000,,Machine learning is being used\Nfor facial recognition,
Dialogue: 0,0:05:06.49,0:05:10.100,Default,,0000,0000,0000,,but it's also extending beyond the realm\Nof computer vision.
Dialogue: 0,0:05:11.81,0:05:15.82,Default,,0000,0000,0000,,In her book, "Weapons\Nof Math Destruction,"
Dialogue: 0,0:05:15.85,0:05:22.53,Default,,0000,0000,0000,,data scientist Cathy O'Neil\Ntalks about the rising new WMDs --
Dialogue: 0,0:05:22.55,0:05:26.90,Default,,0000,0000,0000,,widespread, mysterious\Nand destructive algorithms
Dialogue: 0,0:05:26.93,0:05:29.89,Default,,0000,0000,0000,,that are increasingly being used\Nto make decisions
Dialogue: 0,0:05:29.92,0:05:33.09,Default,,0000,0000,0000,,that impact more aspects of our lives.
Dialogue: 0,0:05:33.12,0:05:34.99,Default,,0000,0000,0000,,So who gets hired or fired?
Dialogue: 0,0:05:35.01,0:05:37.12,Default,,0000,0000,0000,,Do you get that loan?\NDo you get insurance?
Dialogue: 0,0:05:37.15,0:05:40.65,Default,,0000,0000,0000,,Are you admitted into the college\Nyou wanted to get into?
Dialogue: 0,0:05:40.67,0:05:44.18,Default,,0000,0000,0000,,Do you and I pay the same price\Nfor the same product
Dialogue: 0,0:05:44.21,0:05:46.65,Default,,0000,0000,0000,,purchased on the same platform?
Dialogue: 0,0:05:46.67,0:05:50.43,Default,,0000,0000,0000,,Law enforcement is also starting\Nto use machine learning
Dialogue: 0,0:05:50.46,0:05:52.74,Default,,0000,0000,0000,,for predictive policing.
Dialogue: 0,0:05:52.77,0:05:56.26,Default,,0000,0000,0000,,Some judges use machine-generated\Nrisk scores to determine
Dialogue: 0,0:05:56.29,0:06:00.69,Default,,0000,0000,0000,,how long an individual\Nis going to spend in prison.
Dialogue: 0,0:06:00.71,0:06:03.17,Default,,0000,0000,0000,,So we really have to think\Nabout these decisions.
Dialogue: 0,0:06:03.19,0:06:04.37,Default,,0000,0000,0000,,Are they fair?
Dialogue: 0,0:06:04.40,0:06:07.29,Default,,0000,0000,0000,,And we've seen that algorithmic bias
Dialogue: 0,0:06:07.31,0:06:10.68,Default,,0000,0000,0000,,doesn't necessarily always\Nlead to fair outcomes.
Dialogue: 0,0:06:10.71,0:06:12.67,Default,,0000,0000,0000,,So what can we do about it?
Dialogue: 0,0:06:12.70,0:06:16.38,Default,,0000,0000,0000,,Well, we can start thinking about\Nhow we create more inclusive code
Dialogue: 0,0:06:16.40,0:06:19.39,Default,,0000,0000,0000,,and employ inclusive coding practices.
Dialogue: 0,0:06:19.42,0:06:21.72,Default,,0000,0000,0000,,It really starts with people.
Dialogue: 0,0:06:22.25,0:06:24.21,Default,,0000,0000,0000,,So who codes matters.
Dialogue: 0,0:06:24.23,0:06:28.35,Default,,0000,0000,0000,,Are we creating full-spectrum teams\Nwith diverse individuals
Dialogue: 0,0:06:28.38,0:06:30.79,Default,,0000,0000,0000,,who can check each other's blind spots?
Dialogue: 0,0:06:30.81,0:06:34.36,Default,,0000,0000,0000,,On the technical side,\Nhow we code matters.
Dialogue: 0,0:06:34.38,0:06:38.03,Default,,0000,0000,0000,,Are we factoring in fairness\Nas we're developing systems?
Dialogue: 0,0:06:38.06,0:06:40.97,Default,,0000,0000,0000,,And finally, why we code matters.
Dialogue: 0,0:06:41.32,0:06:46.41,Default,,0000,0000,0000,,We've used tools of computational creation\Nto unlock immense wealth.
Dialogue: 0,0:06:46.43,0:06:50.88,Default,,0000,0000,0000,,We now have the opportunity\Nto unlock even greater equality
Dialogue: 0,0:06:50.90,0:06:53.83,Default,,0000,0000,0000,,if we make social change a priority
Dialogue: 0,0:06:53.86,0:06:56.03,Default,,0000,0000,0000,,and not an afterthought.
Dialogue: 0,0:06:56.55,0:07:01.07,Default,,0000,0000,0000,,And so these are the three tenets\Nthat will make up the "incoding" movement.
Dialogue: 0,0:07:01.09,0:07:02.75,Default,,0000,0000,0000,,Who codes matters,
Dialogue: 0,0:07:02.77,0:07:04.31,Default,,0000,0000,0000,,how we code matters,
Dialogue: 0,0:07:04.34,0:07:06.36,Default,,0000,0000,0000,,and why we code matters.
Dialogue: 0,0:07:06.38,0:07:09.48,Default,,0000,0000,0000,,So to go towards encoding,\Nwe can start thinking about
Dialogue: 0,0:07:09.51,0:07:12.67,Default,,0000,0000,0000,,building platforms that can identify bias
Dialogue: 0,0:07:12.70,0:07:15.77,Default,,0000,0000,0000,,by collecting people's experiences\Nlike the ones I shared,
Dialogue: 0,0:07:15.80,0:07:18.87,Default,,0000,0000,0000,,but also auditing existing software.
Dialogue: 0,0:07:18.89,0:07:22.66,Default,,0000,0000,0000,,We can also start to create\Nmore inclusive training sets.
Dialogue: 0,0:07:22.68,0:07:25.48,Default,,0000,0000,0000,,Imagine a "Selfies for Inclusion" campaign
Dialogue: 0,0:07:25.51,0:07:29.16,Default,,0000,0000,0000,,where you and I can help\Ndevelopers test and create
Dialogue: 0,0:07:29.19,0:07:31.28,Default,,0000,0000,0000,,more inclusive training sets.
Dialogue: 0,0:07:31.84,0:07:34.67,Default,,0000,0000,0000,,And we can also start thinking\Nmore conscientiously
Dialogue: 0,0:07:34.69,0:07:40.08,Default,,0000,0000,0000,,about the social impact\Nof the technology that we're developing.
Dialogue: 0,0:07:40.11,0:07:42.50,Default,,0000,0000,0000,,To get the incoding movement started,
Dialogue: 0,0:07:42.53,0:07:45.37,Default,,0000,0000,0000,,I've launched the Algorithmic\NJustice League,
Dialogue: 0,0:07:45.40,0:07:51.27,Default,,0000,0000,0000,,where anyone who cares about fairness\Ncan help fight the coded gaze.
Dialogue: 0,0:07:51.29,0:07:54.59,Default,,0000,0000,0000,,On codedgaze.com, you can report bias,
Dialogue: 0,0:07:54.61,0:07:57.06,Default,,0000,0000,0000,,request audits, become a tester
Dialogue: 0,0:07:57.08,0:07:59.85,Default,,0000,0000,0000,,and join the ongoing conversation,
Dialogue: 0,0:07:59.88,0:08:02.16,Default,,0000,0000,0000,,# codedgaze.
Dialogue: 0,0:08:03.28,0:08:05.77,Default,,0000,0000,0000,,So I invite you to join me
Dialogue: 0,0:08:05.79,0:08:09.51,Default,,0000,0000,0000,,in creating a world where technology\Nworks for all of us,
Dialogue: 0,0:08:09.54,0:08:11.43,Default,,0000,0000,0000,,not just some of us,
Dialogue: 0,0:08:11.46,0:08:16.04,Default,,0000,0000,0000,,a world where we value inclusion\Nand center social change.
Dialogue: 0,0:08:16.07,0:08:17.24,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:08:17.27,0:08:21.54,Default,,0000,0000,0000,,(Applause)
Dialogue: 0,0:08:23.41,0:08:26.27,Default,,0000,0000,0000,,But I have one question:
Dialogue: 0,0:08:26.29,0:08:28.35,Default,,0000,0000,0000,,Will you join me in the fight?
Dialogue: 0,0:08:28.37,0:08:29.66,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:08:29.68,0:08:32.04,Default,,0000,0000,0000,,(Applause)