[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:00.71,0:00:03.53,Default,,0000,0000,0000,,Six thousand miles of road,
Dialogue: 0,0:00:03.53,0:00:05.73,Default,,0000,0000,0000,,600 miles of subway track,
Dialogue: 0,0:00:05.73,0:00:07.38,Default,,0000,0000,0000,,400 miles of bike lanes
Dialogue: 0,0:00:07.38,0:00:09.20,Default,,0000,0000,0000,,and a half a mile of tram track,
Dialogue: 0,0:00:09.20,0:00:11.15,Default,,0000,0000,0000,,if you've ever been to Roosevelt Island.
Dialogue: 0,0:00:11.15,0:00:14.49,Default,,0000,0000,0000,,These are the numbers that make up\Nthe infrastructure of New York City.
Dialogue: 0,0:00:14.49,0:00:17.10,Default,,0000,0000,0000,,These are the statistics\Nof our infrastructure.
Dialogue: 0,0:00:17.10,0:00:20.81,Default,,0000,0000,0000,,They're the kind of numbers you can find\Nreleased in reports by city agencies.
Dialogue: 0,0:00:20.81,0:00:24.01,Default,,0000,0000,0000,,For example, the Department\Nof Transportation will probably tell you
Dialogue: 0,0:00:24.01,0:00:25.79,Default,,0000,0000,0000,,how many miles of road they maintain.
Dialogue: 0,0:00:25.79,0:00:28.61,Default,,0000,0000,0000,,The MTA will boast how many miles\Nof subway track there are.
Dialogue: 0,0:00:28.61,0:00:30.42,Default,,0000,0000,0000,,Most city agencies give us statistics.
Dialogue: 0,0:00:30.42,0:00:31.90,Default,,0000,0000,0000,,This is from a report this year
Dialogue: 0,0:00:31.90,0:00:33.79,Default,,0000,0000,0000,,from the Taxi and Limousine Commission,
Dialogue: 0,0:00:33.79,0:00:37.07,Default,,0000,0000,0000,,where we learn that there's about\N13,500 taxis here in New York City.
Dialogue: 0,0:00:37.07,0:00:38.36,Default,,0000,0000,0000,,Pretty interesting, right?
Dialogue: 0,0:00:38.36,0:00:41.14,Default,,0000,0000,0000,,But did you ever think about\Nwhere these numbers came from?
Dialogue: 0,0:00:41.14,0:00:44.05,Default,,0000,0000,0000,,Because for these numbers to exist,\Nsomeone at the city agency
Dialogue: 0,0:00:44.05,0:00:47.93,Default,,0000,0000,0000,,had to stop and say, hmm, here's a number\Nthat somebody might want want to know.
Dialogue: 0,0:00:47.93,0:00:50.18,Default,,0000,0000,0000,,Here's a number \Nthat our citizens want to know.
Dialogue: 0,0:00:50.18,0:00:52.01,Default,,0000,0000,0000,,So they go back to their raw data,
Dialogue: 0,0:00:52.01,0:00:53.80,Default,,0000,0000,0000,,they count, they add, they calculate,
Dialogue: 0,0:00:53.80,0:00:55.27,Default,,0000,0000,0000,,and then they put out reports,
Dialogue: 0,0:00:55.27,0:00:57.45,Default,,0000,0000,0000,,and those reports\Nwill have numbers like this.
Dialogue: 0,0:00:57.45,0:00:59.99,Default,,0000,0000,0000,,The problem is, how do they know\Nall of our questions?
Dialogue: 0,0:00:59.99,0:01:01.23,Default,,0000,0000,0000,,We have lots of questions.
Dialogue: 0,0:01:01.23,0:01:04.57,Default,,0000,0000,0000,,In fact, in some ways there's literally\Nan infinite number of questions
Dialogue: 0,0:01:04.57,0:01:06.22,Default,,0000,0000,0000,,that we can ask about our city.
Dialogue: 0,0:01:06.22,0:01:07.70,Default,,0000,0000,0000,,The agencies can never keep up.
Dialogue: 0,0:01:07.70,0:01:11.75,Default,,0000,0000,0000,,So the paradigm isn't exactly working,\Nand I think our policymakers realize that,
Dialogue: 0,0:01:11.75,0:01:15.71,Default,,0000,0000,0000,,because in 2012, Mayor Bloomberg\Nsigned into law what he called
Dialogue: 0,0:01:15.71,0:01:19.55,Default,,0000,0000,0000,,the most ambitious and comprehensive\Nopen data legislation in the country.
Dialogue: 0,0:01:19.55,0:01:21.12,Default,,0000,0000,0000,,In a lot of ways, he's right.
Dialogue: 0,0:01:21.12,0:01:23.98,Default,,0000,0000,0000,,In the last two years, \Nthe city has released 1,000 datasets
Dialogue: 0,0:01:23.98,0:01:25.59,Default,,0000,0000,0000,,on our open data portal,
Dialogue: 0,0:01:25.59,0:01:27.36,Default,,0000,0000,0000,,and it's pretty awesome.
Dialogue: 0,0:01:27.36,0:01:29.32,Default,,0000,0000,0000,,So you go and look at data like this,
Dialogue: 0,0:01:29.32,0:01:31.61,Default,,0000,0000,0000,,and instead of just counting\Nthe number of cabs,
Dialogue: 0,0:01:31.61,0:01:33.56,Default,,0000,0000,0000,,we can start to ask different questions.
Dialogue: 0,0:01:33.56,0:01:34.76,Default,,0000,0000,0000,,So I had a question.
Dialogue: 0,0:01:34.76,0:01:36.46,Default,,0000,0000,0000,,When's rush hour in New York City?
Dialogue: 0,0:01:36.46,0:01:39.04,Default,,0000,0000,0000,,It can be pretty bothersome.\NWhen is rush hour exactly?
Dialogue: 0,0:01:39.04,0:01:41.66,Default,,0000,0000,0000,,And I thought to myself,\Nthese cabs aren't just numbers,
Dialogue: 0,0:01:41.66,0:01:44.37,Default,,0000,0000,0000,,these are GPS recorders\Ndriving around in our city streets
Dialogue: 0,0:01:44.37,0:01:46.29,Default,,0000,0000,0000,,recording each and every ride they take.
Dialogue: 0,0:01:46.29,0:01:48.61,Default,,0000,0000,0000,,There's data there,\Nand I looked at that data,
Dialogue: 0,0:01:48.61,0:01:52.57,Default,,0000,0000,0000,,and I made a plot of the average speed of\Ntaxis in New York City throughout the day.
Dialogue: 0,0:01:52.57,0:01:55.98,Default,,0000,0000,0000,,You can see that from about midnight\Nto around 5:18 in the morning,
Dialogue: 0,0:01:55.98,0:01:59.54,Default,,0000,0000,0000,,speed increases, and at that point,\Nthings turn around,
Dialogue: 0,0:01:59.54,0:02:03.51,Default,,0000,0000,0000,,and they get slower and slower and slower\Nuntil about 8:35 in the morning,
Dialogue: 0,0:02:03.51,0:02:06.20,Default,,0000,0000,0000,,when they end up at around\N11 and a half miles per hour.
Dialogue: 0,0:02:06.20,0:02:09.76,Default,,0000,0000,0000,,The average taxi is going 11 and a half\Nmiles per hour on our city streets,
Dialogue: 0,0:02:09.76,0:02:11.75,Default,,0000,0000,0000,,and it turns out it stays that way
Dialogue: 0,0:02:11.75,0:02:15.12,Default,,0000,0000,0000,,for the entire day.
Dialogue: 0,0:02:15.12,0:02:16.49,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:02:16.49,0:02:19.67,Default,,0000,0000,0000,,So I said to myself, I guess\Nthere's no rush hour in New York City.
Dialogue: 0,0:02:19.67,0:02:21.21,Default,,0000,0000,0000,,There's just a rush day.
Dialogue: 0,0:02:21.21,0:02:24.06,Default,,0000,0000,0000,,Makes sense. And this is important\Nfor a couple of reasons.
Dialogue: 0,0:02:24.06,0:02:27.69,Default,,0000,0000,0000,,If you're a transportation planner,\Nthis might be pretty interesting to know.
Dialogue: 0,0:02:27.69,0:02:29.67,Default,,0000,0000,0000,,But if you want to get somewhere quickly,
Dialogue: 0,0:02:29.67,0:02:33.14,Default,,0000,0000,0000,,you now know to set your alarm for\N4:45 in the morning and you're all set.
Dialogue: 0,0:02:33.14,0:02:34.18,Default,,0000,0000,0000,,New York, right?
Dialogue: 0,0:02:34.18,0:02:35.94,Default,,0000,0000,0000,,But there's a story behind this data.
Dialogue: 0,0:02:35.94,0:02:38.13,Default,,0000,0000,0000,,This data wasn't\Njust available, it turns out.
Dialogue: 0,0:02:38.13,0:02:41.75,Default,,0000,0000,0000,,It actually came from something called\Na Freedom of Information Law Request,
Dialogue: 0,0:02:41.75,0:02:42.82,Default,,0000,0000,0000,,or a FOIL Request.
Dialogue: 0,0:02:42.82,0:02:46.29,Default,,0000,0000,0000,,This is a form you can find on the\NTaxi and Limousine Commission website.
Dialogue: 0,0:02:46.29,0:02:49.11,Default,,0000,0000,0000,,In order to access this data,\Nyou need to go get this form,
Dialogue: 0,0:02:49.11,0:02:50.96,Default,,0000,0000,0000,,fill it out, and they will notify you,
Dialogue: 0,0:02:50.96,0:02:53.09,Default,,0000,0000,0000,,and a guy named Chris Whong\Ndid exactly that.
Dialogue: 0,0:02:53.09,0:02:54.98,Default,,0000,0000,0000,,Chris went down, and they told him,
Dialogue: 0,0:02:54.98,0:02:57.81,Default,,0000,0000,0000,,"Just bring a brand new hard drive \Ndown to our office,
Dialogue: 0,0:02:57.81,0:03:01.23,Default,,0000,0000,0000,,leave it here for five hours,\Nwe'll copy the data and you take it back."
Dialogue: 0,0:03:01.23,0:03:03.26,Default,,0000,0000,0000,,And that's where this data came from.
Dialogue: 0,0:03:03.26,0:03:06.27,Default,,0000,0000,0000,,Now, Chris is the kind of guy\Nwho wants to make the data public,
Dialogue: 0,0:03:06.27,0:03:10.05,Default,,0000,0000,0000,,and so it ended up online for all to use,\Nand that's where this graph came from.
Dialogue: 0,0:03:10.05,0:03:13.57,Default,,0000,0000,0000,,And the fact that it exists is amazing.\NThese GPS recorders -- really cool.
Dialogue: 0,0:03:13.57,0:03:16.69,Default,,0000,0000,0000,,But the fact that we have citizens\Nwalking around with hard drives
Dialogue: 0,0:03:16.69,0:03:19.27,Default,,0000,0000,0000,,picking up data from city agencies\Nto make it public --
Dialogue: 0,0:03:19.27,0:03:21.66,Default,,0000,0000,0000,,it was already kind of public,\Nyou could get to it,
Dialogue: 0,0:03:21.66,0:03:23.47,Default,,0000,0000,0000,,but it was "public," it wasn't public.
Dialogue: 0,0:03:23.47,0:03:25.43,Default,,0000,0000,0000,,And we can do better than that as a city.
Dialogue: 0,0:03:25.43,0:03:28.19,Default,,0000,0000,0000,,We don't need our citizens\Nwalking around with hard drives.
Dialogue: 0,0:03:28.19,0:03:30.53,Default,,0000,0000,0000,,Now, not every dataset\Nis behind a FOIL Request.
Dialogue: 0,0:03:30.53,0:03:34.33,Default,,0000,0000,0000,,Here is a map I made with the most\Ndangerous intersections in New York City
Dialogue: 0,0:03:34.33,0:03:36.21,Default,,0000,0000,0000,,based on cyclist accidents.
Dialogue: 0,0:03:36.21,0:03:38.15,Default,,0000,0000,0000,,So the red areas are more dangerous.
Dialogue: 0,0:03:38.15,0:03:40.70,Default,,0000,0000,0000,,And what it shows is first\Nthe East side of Manhattan,
Dialogue: 0,0:03:40.70,0:03:44.31,Default,,0000,0000,0000,,especially in the lower area of Manhattan,\Nhas more cyclist accidents.
Dialogue: 0,0:03:44.31,0:03:45.33,Default,,0000,0000,0000,,That might make sense
Dialogue: 0,0:03:45.33,0:03:48.22,Default,,0000,0000,0000,,because there are more cyclists\Ncoming off the bridges there.
Dialogue: 0,0:03:48.22,0:03:50.24,Default,,0000,0000,0000,,But there's other hotspots worth studying.
Dialogue: 0,0:03:50.24,0:03:52.91,Default,,0000,0000,0000,,There's Williamsburg.\NThere's Roosevelt Avenue in Queens.
Dialogue: 0,0:03:52.91,0:03:55.76,Default,,0000,0000,0000,,And this is exactly the kind of data\Nwe need for Vision Zero.
Dialogue: 0,0:03:55.76,0:03:57.75,Default,,0000,0000,0000,,This is exactly what we're looking for.
Dialogue: 0,0:03:57.75,0:03:59.88,Default,,0000,0000,0000,,But there's a story\Nbehind this data as well.
Dialogue: 0,0:03:59.88,0:04:01.95,Default,,0000,0000,0000,,This data didn't just appear.
Dialogue: 0,0:04:01.95,0:04:04.34,Default,,0000,0000,0000,,How many of you guys know this logo?
Dialogue: 0,0:04:04.34,0:04:05.70,Default,,0000,0000,0000,,Yeah, I see some shakes.
Dialogue: 0,0:04:05.70,0:04:08.35,Default,,0000,0000,0000,,Have you ever tried to copy\Nand paste data out of a PDF
Dialogue: 0,0:04:08.35,0:04:09.71,Default,,0000,0000,0000,,and make sense of it?
Dialogue: 0,0:04:09.71,0:04:10.77,Default,,0000,0000,0000,,I see more shakes.
Dialogue: 0,0:04:10.77,0:04:14.11,Default,,0000,0000,0000,,More of you tried copying and pasting\Nthan knew the logo. I like that.
Dialogue: 0,0:04:14.11,0:04:17.62,Default,,0000,0000,0000,,So what happened is, the data\Nthat you just saw was actually on a PDF.
Dialogue: 0,0:04:17.62,0:04:20.73,Default,,0000,0000,0000,,In fact, hundreds and hundreds\Nand hundreds of pages of PDF
Dialogue: 0,0:04:20.73,0:04:22.89,Default,,0000,0000,0000,,put out by our very own NYPD,
Dialogue: 0,0:04:22.89,0:04:26.04,Default,,0000,0000,0000,,and in order to access it,\Nyou would either have to copy and paste
Dialogue: 0,0:04:26.04,0:04:27.76,Default,,0000,0000,0000,,for hundreds and hundreds of hours,
Dialogue: 0,0:04:27.76,0:04:29.11,Default,,0000,0000,0000,,or you could be John Krauss.
Dialogue: 0,0:04:29.11,0:04:30.15,Default,,0000,0000,0000,,John Krauss was like,
Dialogue: 0,0:04:30.15,0:04:33.56,Default,,0000,0000,0000,,I'm not going to copy and paste this data.\NI'm going to write a program.
Dialogue: 0,0:04:33.56,0:04:35.85,Default,,0000,0000,0000,,It's called the NYPD Crash Data Band-Aid,
Dialogue: 0,0:04:35.85,0:04:38.88,Default,,0000,0000,0000,,and it goes to the NYPD's website\Nand it would download PDFs.
Dialogue: 0,0:04:38.88,0:04:42.01,Default,,0000,0000,0000,,Every day it would search;\Nif it found a PDF, it would download it
Dialogue: 0,0:04:42.01,0:04:44.26,Default,,0000,0000,0000,,and then it would run\Nsome PDF-scraping program,
Dialogue: 0,0:04:44.26,0:04:45.60,Default,,0000,0000,0000,,and out would come the text,
Dialogue: 0,0:04:45.60,0:04:49.16,Default,,0000,0000,0000,,and it would go on the Internet,\Nand then people could make maps like that.
Dialogue: 0,0:04:49.16,0:04:52.59,Default,,0000,0000,0000,,And the fact that the data's here,\Nthe fact that we have access to it --
Dialogue: 0,0:04:52.59,0:04:55.04,Default,,0000,0000,0000,,Every accident, by the way,\Nis a row in this table.
Dialogue: 0,0:04:55.04,0:04:56.88,Default,,0000,0000,0000,,You can imagine how many PDFs that is.
Dialogue: 0,0:04:56.88,0:04:59.08,Default,,0000,0000,0000,,The fact that we\Nhave access to that is great,
Dialogue: 0,0:04:59.08,0:05:01.19,Default,,0000,0000,0000,,but let's not release it in PDF form,
Dialogue: 0,0:05:01.19,0:05:03.93,Default,,0000,0000,0000,,because then we're having our citizens\Nwrite PDF scrapers.
Dialogue: 0,0:05:03.93,0:05:06.01,Default,,0000,0000,0000,,It's not the best use\Nof our citizens' time,
Dialogue: 0,0:05:06.01,0:05:08.01,Default,,0000,0000,0000,,and we as a city can do better than that.
Dialogue: 0,0:05:08.01,0:05:10.75,Default,,0000,0000,0000,,Now, the good news is that\Nthe de Blasio administration
Dialogue: 0,0:05:10.75,0:05:13.28,Default,,0000,0000,0000,,actually recently released this data\Na few months ago,
Dialogue: 0,0:05:13.28,0:05:15.44,Default,,0000,0000,0000,,and so now we can\Nactually have access to it,
Dialogue: 0,0:05:15.44,0:05:17.97,Default,,0000,0000,0000,,but there's a lot of data\Nstill entombed in PDF.
Dialogue: 0,0:05:17.97,0:05:21.17,Default,,0000,0000,0000,,For example, our crime data\Nis still only available in PDF.
Dialogue: 0,0:05:21.17,0:05:24.93,Default,,0000,0000,0000,,And not just our crime data,\Nour own city budget.
Dialogue: 0,0:05:24.93,0:05:28.66,Default,,0000,0000,0000,,Our city budget is only readable\Nright now in PDF form.
Dialogue: 0,0:05:28.66,0:05:30.80,Default,,0000,0000,0000,,And it's not just us\Nthat can't analyze it --
Dialogue: 0,0:05:30.80,0:05:33.75,Default,,0000,0000,0000,,our own legislators\Nwho vote for the budget
Dialogue: 0,0:05:33.75,0:05:35.69,Default,,0000,0000,0000,,also only get it in PDF.
Dialogue: 0,0:05:35.69,0:05:39.54,Default,,0000,0000,0000,,So our legislators cannot analyze \Nthe budget that they are voting for.
Dialogue: 0,0:05:39.54,0:05:43.15,Default,,0000,0000,0000,,And I think as a city we can do\Na little better than that as well.
Dialogue: 0,0:05:43.15,0:05:45.63,Default,,0000,0000,0000,,Now, there's a lot of data\Nthat's not hidden in PDFs.
Dialogue: 0,0:05:45.63,0:05:47.33,Default,,0000,0000,0000,,This is an example of a map I made,
Dialogue: 0,0:05:47.33,0:05:50.26,Default,,0000,0000,0000,,and this is the dirtiest waterways\Nin New York City.
Dialogue: 0,0:05:50.26,0:05:51.77,Default,,0000,0000,0000,,Now, how do I measure dirty?
Dialogue: 0,0:05:51.77,0:05:53.63,Default,,0000,0000,0000,,Well, it's kind of a little weird,
Dialogue: 0,0:05:53.63,0:05:55.74,Default,,0000,0000,0000,,but I looked at the level\Nof fecal coliform,
Dialogue: 0,0:05:55.74,0:05:59.24,Default,,0000,0000,0000,,which is a measurement of fecal matter\Nin each of our waterways.
Dialogue: 0,0:05:59.24,0:06:02.52,Default,,0000,0000,0000,,The larger the circle,\Nthe dirtier the water,
Dialogue: 0,0:06:02.52,0:06:05.88,Default,,0000,0000,0000,,so the large circles are dirty water,\Nthe small circles are cleaner.
Dialogue: 0,0:06:05.88,0:06:07.52,Default,,0000,0000,0000,,What you see is inland waterways.
Dialogue: 0,0:06:07.52,0:06:10.92,Default,,0000,0000,0000,,This is all data that was sampled\Nby the city over the last five years.
Dialogue: 0,0:06:10.92,0:06:13.62,Default,,0000,0000,0000,,And inland waterways are,\Nin general, dirtier.
Dialogue: 0,0:06:13.62,0:06:14.84,Default,,0000,0000,0000,,That makes sense, right?
Dialogue: 0,0:06:14.84,0:06:18.21,Default,,0000,0000,0000,,And the bigger circles are dirty.\NAnd I learned a few things from this.
Dialogue: 0,0:06:18.21,0:06:21.37,Default,,0000,0000,0000,,Number one: Never swim in anything\Nthat ends in "creek" or "canal."
Dialogue: 0,0:06:21.37,0:06:25.69,Default,,0000,0000,0000,,But number two: I also found\Nthe dirtiest waterway in New York City,
Dialogue: 0,0:06:25.69,0:06:27.53,Default,,0000,0000,0000,,by this measure, one measure.
Dialogue: 0,0:06:27.53,0:06:31.17,Default,,0000,0000,0000,,In Coney Island Creek, which is not\Nthe Coney Island you swim in, luckily.
Dialogue: 0,0:06:31.17,0:06:32.33,Default,,0000,0000,0000,,It's on the other side.
Dialogue: 0,0:06:32.33,0:06:36.21,Default,,0000,0000,0000,,But Coney Island Creek, 94 percent\Nof samples taken over the last five years
Dialogue: 0,0:06:36.21,0:06:38.37,Default,,0000,0000,0000,,have had fecal levels so high
Dialogue: 0,0:06:38.37,0:06:41.46,Default,,0000,0000,0000,,that it would be against state law\Nto swim in the water.
Dialogue: 0,0:06:41.46,0:06:44.19,Default,,0000,0000,0000,,And this is not the kind of fact\Nthat you're going to see
Dialogue: 0,0:06:44.19,0:06:45.73,Default,,0000,0000,0000,,boasted in a city report, right?
Dialogue: 0,0:06:45.73,0:06:47.98,Default,,0000,0000,0000,,It's not going to be \Nthe front page on nyc.gov.
Dialogue: 0,0:06:47.98,0:06:49.56,Default,,0000,0000,0000,,You're not going to see it there,
Dialogue: 0,0:06:49.56,0:06:52.07,Default,,0000,0000,0000,,but the fact that we can get \Nto that data is awesome.
Dialogue: 0,0:06:52.07,0:06:53.85,Default,,0000,0000,0000,,But once again, it wasn't super easy,
Dialogue: 0,0:06:53.85,0:06:56.20,Default,,0000,0000,0000,,because this data was not\Non the open data portal.
Dialogue: 0,0:06:56.20,0:06:58.22,Default,,0000,0000,0000,,If you were to go to the open data portal,
Dialogue: 0,0:06:58.22,0:07:00.83,Default,,0000,0000,0000,,you'd see just a snippet of it, \Na year or a few months.
Dialogue: 0,0:07:00.83,0:07:04.22,Default,,0000,0000,0000,,It was actually on the Department\Nof Environmental Protection's website.
Dialogue: 0,0:07:04.22,0:07:08.10,Default,,0000,0000,0000,,And each one of these links is an Excel \Nsheet, and each Excel sheet is different.
Dialogue: 0,0:07:08.10,0:07:10.73,Default,,0000,0000,0000,,Every heading is different:\Nyou copy, paste, reorganize.
Dialogue: 0,0:07:10.73,0:07:13.68,Default,,0000,0000,0000,,When you do you can make maps\Nand that's great, but once again,
Dialogue: 0,0:07:13.68,0:07:16.65,Default,,0000,0000,0000,,we can do better than that \Nas a city, we can normalize things.
Dialogue: 0,0:07:16.65,0:07:20.03,Default,,0000,0000,0000,,And we're getting there, because\Nthere's this website that Socrata makes
Dialogue: 0,0:07:20.03,0:07:21.58,Default,,0000,0000,0000,,called the Open Data Portal NYC.
Dialogue: 0,0:07:21.58,0:07:23.83,Default,,0000,0000,0000,,This is where 1,100 data sets \Nthat don't suffer
Dialogue: 0,0:07:23.83,0:07:25.61,Default,,0000,0000,0000,,from the things I just told you live,
Dialogue: 0,0:07:25.61,0:07:27.76,Default,,0000,0000,0000,,and that number is growing,\Nand that's great.
Dialogue: 0,0:07:27.76,0:07:31.17,Default,,0000,0000,0000,,You can download data in any format,\Nbe it CSV or PDF or Excel document.
Dialogue: 0,0:07:31.17,0:07:33.72,Default,,0000,0000,0000,,Whatever you want,\Nyou can download the data that way.
Dialogue: 0,0:07:33.72,0:07:35.07,Default,,0000,0000,0000,,The problem is, once you do,
Dialogue: 0,0:07:35.07,0:07:38.76,Default,,0000,0000,0000,,you will find that each agency\Ncodes their addresses differently.
Dialogue: 0,0:07:38.76,0:07:40.90,Default,,0000,0000,0000,,So one is street name, \Nintersection street,
Dialogue: 0,0:07:40.90,0:07:43.39,Default,,0000,0000,0000,,street, borough, address, building,\Nbuilding address.
Dialogue: 0,0:07:43.39,0:07:46.57,Default,,0000,0000,0000,,So once again, you're spending time,\Neven when we have this portal,
Dialogue: 0,0:07:46.57,0:07:49.18,Default,,0000,0000,0000,,you're spending time\Nnormalizing our address fields.
Dialogue: 0,0:07:49.18,0:07:51.60,Default,,0000,0000,0000,,And that's not the best use \Nof our citizens' time.
Dialogue: 0,0:07:51.60,0:07:53.40,Default,,0000,0000,0000,,We can do better than that as a city.
Dialogue: 0,0:07:53.40,0:07:55.04,Default,,0000,0000,0000,,We can standardize our addresses,
Dialogue: 0,0:07:55.04,0:07:57.22,Default,,0000,0000,0000,,and if we do, \Nwe can get more maps like this.
Dialogue: 0,0:07:57.22,0:07:59.51,Default,,0000,0000,0000,,This is a map of fire hydrants\Nin New York City,
Dialogue: 0,0:07:59.51,0:08:01.04,Default,,0000,0000,0000,,but not just any fire hydrants.
Dialogue: 0,0:08:01.04,0:08:05.77,Default,,0000,0000,0000,,These are the top 250 grossing fire\Nhydrants in terms of parking tickets.
Dialogue: 0,0:08:05.77,0:08:07.75,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:08:07.75,0:08:11.11,Default,,0000,0000,0000,,So I learned a few things from this map,\Nand I really like this map.
Dialogue: 0,0:08:11.11,0:08:13.51,Default,,0000,0000,0000,,Number one, just don't park\Non the Upper East Side.
Dialogue: 0,0:08:13.51,0:08:17.10,Default,,0000,0000,0000,,Just don't. It doesn't matter where\Nyou park, you will get a hydrant ticket.
Dialogue: 0,0:08:17.10,0:08:21.25,Default,,0000,0000,0000,,Number two, I found the two highest\Ngrossing hydrants in all of New York City,
Dialogue: 0,0:08:21.25,0:08:23.14,Default,,0000,0000,0000,,and they're on the Lower East Side,
Dialogue: 0,0:08:23.14,0:08:28.24,Default,,0000,0000,0000,,and they were bringing in over\N55,000 dollars a year in parking tickets.
Dialogue: 0,0:08:28.24,0:08:30.98,Default,,0000,0000,0000,,And that seemed a little strange\Nto me when I noticed it,
Dialogue: 0,0:08:30.98,0:08:34.24,Default,,0000,0000,0000,,so I did a little digging and it turns out\Nwhat you had is a hydrant
Dialogue: 0,0:08:34.24,0:08:36.24,Default,,0000,0000,0000,,and then something called\Na curb extension,
Dialogue: 0,0:08:36.24,0:08:38.30,Default,,0000,0000,0000,,which is like a seven-foot\Nspace to walk on,
Dialogue: 0,0:08:38.30,0:08:39.46,Default,,0000,0000,0000,,and then a parking spot.
Dialogue: 0,0:08:39.46,0:08:41.71,Default,,0000,0000,0000,,And so these cars came along,\Nand the hydrant --
Dialogue: 0,0:08:41.71,0:08:43.62,Default,,0000,0000,0000,,"It's all the way over there, I'm fine,"
Dialogue: 0,0:08:43.62,0:08:47.09,Default,,0000,0000,0000,,and there was actually a parking spot\Npainted there beautifully for them.
Dialogue: 0,0:08:47.09,0:08:50.25,Default,,0000,0000,0000,,They would park there, and the NYPD\Ndisagreed with this designation
Dialogue: 0,0:08:50.25,0:08:51.31,Default,,0000,0000,0000,,and would ticket them.
Dialogue: 0,0:08:51.31,0:08:53.65,Default,,0000,0000,0000,,And it wasn't just me \Nwho found a parking ticket.
Dialogue: 0,0:08:53.65,0:08:55.80,Default,,0000,0000,0000,,This is the Google \NStreet View car driving by
Dialogue: 0,0:08:55.80,0:08:57.41,Default,,0000,0000,0000,,finding the same parking ticket.
Dialogue: 0,0:08:57.41,0:09:01.92,Default,,0000,0000,0000,,So I wrote about this on my blog,\Non I Quant NY, and the DOT responded,
Dialogue: 0,0:09:01.92,0:09:02.94,Default,,0000,0000,0000,,and they said,
Dialogue: 0,0:09:02.94,0:09:06.35,Default,,0000,0000,0000,,"While the DOT has not received\Nany complaints about this location,
Dialogue: 0,0:09:06.35,0:09:10.89,Default,,0000,0000,0000,,we will review the roadway markings\Nand make any appropriate alterations."
Dialogue: 0,0:09:10.89,0:09:13.85,Default,,0000,0000,0000,,And I thought to myself,\Ntypical government response,
Dialogue: 0,0:09:13.85,0:09:15.73,Default,,0000,0000,0000,,all right, moved on with my life.
Dialogue: 0,0:09:15.73,0:09:19.70,Default,,0000,0000,0000,,But then, a few weeks later,\Nsomething incredible happened.
Dialogue: 0,0:09:19.70,0:09:22.22,Default,,0000,0000,0000,,They repainted the spot,
Dialogue: 0,0:09:22.22,0:09:24.91,Default,,0000,0000,0000,,and for a second I thought I saw\Nthe future of open data,
Dialogue: 0,0:09:24.91,0:09:26.91,Default,,0000,0000,0000,,because think about what happened here.
Dialogue: 0,0:09:26.91,0:09:32.01,Default,,0000,0000,0000,,For five years, this spot was being \Nticketed, and it was confusing,
Dialogue: 0,0:09:32.01,0:09:36.32,Default,,0000,0000,0000,,and then a citizen found something,\Nthey told the city, and within a few weeks
Dialogue: 0,0:09:36.32,0:09:37.61,Default,,0000,0000,0000,,the problem was fixed.
Dialogue: 0,0:09:37.61,0:09:40.81,Default,,0000,0000,0000,,It's amazing. And a lot of people\Nsee open data as being a watchdog.
Dialogue: 0,0:09:40.81,0:09:42.58,Default,,0000,0000,0000,,It's not, it's about being a partner.
Dialogue: 0,0:09:42.58,0:09:45.72,Default,,0000,0000,0000,,We can empower our citizens\Nto be better partners for government,
Dialogue: 0,0:09:45.72,0:09:47.60,Default,,0000,0000,0000,,and it's not that hard.
Dialogue: 0,0:09:47.60,0:09:49.06,Default,,0000,0000,0000,,All we need are a few changes.
Dialogue: 0,0:09:49.06,0:09:50.17,Default,,0000,0000,0000,,If you're FOILing data,
Dialogue: 0,0:09:50.17,0:09:53.03,Default,,0000,0000,0000,,if you're seeing your data \Nbeing FOILed over and over again,
Dialogue: 0,0:09:53.03,0:09:56.61,Default,,0000,0000,0000,,let's release it to the public, that's\Na sign that it should be made public.
Dialogue: 0,0:09:56.61,0:09:59.09,Default,,0000,0000,0000,,And if you're a government agency\Nreleasing a PDF,
Dialogue: 0,0:09:59.09,0:10:02.74,Default,,0000,0000,0000,,let's pass legislation that requires you\Nto post it with the underlying data,
Dialogue: 0,0:10:02.74,0:10:04.77,Default,,0000,0000,0000,,because that data\Nis coming from somewhere.
Dialogue: 0,0:10:04.77,0:10:07.25,Default,,0000,0000,0000,,I don't know where, but it's\Ncoming from somewhere,
Dialogue: 0,0:10:07.25,0:10:08.97,Default,,0000,0000,0000,,and you can release it with the PDF.
Dialogue: 0,0:10:08.97,0:10:11.38,Default,,0000,0000,0000,,And let's adopt and share\Nsome open data standards.
Dialogue: 0,0:10:11.38,0:10:13.87,Default,,0000,0000,0000,,Let's start with our addresses\Nhere in New York City.
Dialogue: 0,0:10:13.87,0:10:15.94,Default,,0000,0000,0000,,Let's just start\Nnormalizing our addresses.
Dialogue: 0,0:10:15.94,0:10:18.00,Default,,0000,0000,0000,,Because New York is a leader in open data.
Dialogue: 0,0:10:18.00,0:10:20.79,Default,,0000,0000,0000,,Despite all this, we are absolutely\Na leader in open data,
Dialogue: 0,0:10:20.79,0:10:23.91,Default,,0000,0000,0000,,and if we start normalizing things,\Nand set an open data standard,
Dialogue: 0,0:10:23.91,0:10:27.55,Default,,0000,0000,0000,,others will follow. The state will follow,\Nand maybe the federal government,
Dialogue: 0,0:10:27.55,0:10:28.99,Default,,0000,0000,0000,,Other countries could follow,
Dialogue: 0,0:10:28.99,0:10:32.40,Default,,0000,0000,0000,,and we're not that far off from a time\Nwhere you could write one program
Dialogue: 0,0:10:32.40,0:10:34.29,Default,,0000,0000,0000,,and map information from 100 countries.
Dialogue: 0,0:10:34.29,0:10:36.78,Default,,0000,0000,0000,,It's not science fiction.\NWe're actually quite close.
Dialogue: 0,0:10:36.78,0:10:39.02,Default,,0000,0000,0000,,And by the way, who are we\Nempowering with this?
Dialogue: 0,0:10:39.02,0:10:42.02,Default,,0000,0000,0000,,Because it's not just John Krauss\Nand it's not just Chris Whong.
Dialogue: 0,0:10:42.02,0:10:45.12,Default,,0000,0000,0000,,There are hundreds of meetups\Ngoing on in New York City right now,
Dialogue: 0,0:10:45.12,0:10:46.14,Default,,0000,0000,0000,,active meetups.
Dialogue: 0,0:10:46.14,0:10:48.72,Default,,0000,0000,0000,,There are thousands of people\Nattending these meetups.
Dialogue: 0,0:10:48.72,0:10:51.08,Default,,0000,0000,0000,,These people are going after work\Nand on weekends,
Dialogue: 0,0:10:51.08,0:10:53.72,Default,,0000,0000,0000,,and they're attending these meetups\Nto look at open data
Dialogue: 0,0:10:53.72,0:10:55.36,Default,,0000,0000,0000,,and make our city a better place.
Dialogue: 0,0:10:55.36,0:10:59.43,Default,,0000,0000,0000,,Groups like BetaNYC, who just last week \Nreleased something called citygram.nyc
Dialogue: 0,0:10:59.43,0:11:01.58,Default,,0000,0000,0000,,that allows you to subscribe\Nto 311 complaints
Dialogue: 0,0:11:01.58,0:11:03.65,Default,,0000,0000,0000,,around your own home,\Nor around your office.
Dialogue: 0,0:11:03.65,0:11:06.08,Default,,0000,0000,0000,,You put in your address,\Nyou get local complaints.
Dialogue: 0,0:11:06.08,0:11:09.45,Default,,0000,0000,0000,,And it's not just the tech community\Nthat are after these things.
Dialogue: 0,0:11:09.45,0:11:12.07,Default,,0000,0000,0000,,It's urban planners like \Nthe students I teach at Pratt.
Dialogue: 0,0:11:12.07,0:11:13.99,Default,,0000,0000,0000,,It's policy advocates, it's everyone,
Dialogue: 0,0:11:13.99,0:11:16.55,Default,,0000,0000,0000,,it's citizens from a diverse\Nset of backgrounds.
Dialogue: 0,0:11:16.55,0:11:19.34,Default,,0000,0000,0000,,And with some small, incremental changes,
Dialogue: 0,0:11:19.34,0:11:22.56,Default,,0000,0000,0000,,we can unlock the passion\Nand the ability of our citizens
Dialogue: 0,0:11:22.56,0:11:25.72,Default,,0000,0000,0000,,to harness open data\Nand make our city even better,
Dialogue: 0,0:11:25.72,0:11:29.35,Default,,0000,0000,0000,,whether it's one dataset,\Nor one parking spot at a time.
Dialogue: 0,0:11:29.35,0:11:31.67,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:11:31.67,0:11:34.97,Default,,0000,0000,0000,,(Applause)