[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:17.24,0:00:20.04,Default,,0000,0000,0000,,Six thousand miles of road,
Dialogue: 0,0:00:20.04,0:00:22.02,Default,,0000,0000,0000,,600 miles of subway track,
Dialogue: 0,0:00:22.02,0:00:24.04,Default,,0000,0000,0000,,400 miles of bike lanes,
Dialogue: 0,0:00:24.04,0:00:25.72,Default,,0000,0000,0000,,and a half a mile of tram track,
Dialogue: 0,0:00:25.72,0:00:27.74,Default,,0000,0000,0000,,if you've ever been to Roosevelt Island.
Dialogue: 0,0:00:27.74,0:00:30.58,Default,,0000,0000,0000,,These are the numbers that make up\Nthe infrastructure of NYC,
Dialogue: 0,0:00:30.58,0:00:32.74,Default,,0000,0000,0000,,these are the statistics\Nof our infrastructure.
Dialogue: 0,0:00:32.74,0:00:35.78,Default,,0000,0000,0000,,They're the kind of numbers\Nreleased in reports by city agencies.
Dialogue: 0,0:00:35.78,0:00:38.95,Default,,0000,0000,0000,,For example, the Department\Nof Transportation will probably tell you
Dialogue: 0,0:00:38.95,0:00:40.70,Default,,0000,0000,0000,,how many miles of road they maintain.
Dialogue: 0,0:00:40.70,0:00:43.50,Default,,0000,0000,0000,,The MTA will boast how many miles\Nof subway track there are.
Dialogue: 0,0:00:43.50,0:00:45.56,Default,,0000,0000,0000,,But most city agencies give us statistics.
Dialogue: 0,0:00:45.56,0:00:48.80,Default,,0000,0000,0000,,This is from a report this year\Nfrom the Taxi & Limousine Commission,
Dialogue: 0,0:00:48.80,0:00:53.02,Default,,0000,0000,0000,,where we've learned that there is\Nabout 13,500 taxis here in NYC.
Dialogue: 0,0:00:53.02,0:00:54.35,Default,,0000,0000,0000,,Pretty interesting, right?
Dialogue: 0,0:00:54.35,0:00:57.14,Default,,0000,0000,0000,,But did you ever think about\Nwhere these numbers came from?
Dialogue: 0,0:00:57.14,0:01:00.06,Default,,0000,0000,0000,,Because for these numbers to exist\Nsomebody at the city agency
Dialogue: 0,0:01:00.06,0:01:03.67,Default,,0000,0000,0000,,has to stop and say hmm, here's a number\Nthat somebody might want to know.
Dialogue: 0,0:01:03.67,0:01:05.90,Default,,0000,0000,0000,,Here's a number\Nthat our citizens want to know.
Dialogue: 0,0:01:05.90,0:01:07.64,Default,,0000,0000,0000,,So they go back to their raw data,
Dialogue: 0,0:01:07.64,0:01:09.42,Default,,0000,0000,0000,,they count, they add, they calculate,
Dialogue: 0,0:01:09.42,0:01:11.00,Default,,0000,0000,0000,,and then they put out reports.
Dialogue: 0,0:01:11.00,0:01:13.50,Default,,0000,0000,0000,,And those reports\Nwill have numbers like this.
Dialogue: 0,0:01:13.50,0:01:16.04,Default,,0000,0000,0000,,The problem is, how do they know\Nall of our questions?
Dialogue: 0,0:01:16.04,0:01:17.48,Default,,0000,0000,0000,,We have lots of questions.
Dialogue: 0,0:01:17.48,0:01:20.76,Default,,0000,0000,0000,,In fact, in some ways there's literally\Nan infinite number of questions
Dialogue: 0,0:01:20.76,0:01:22.26,Default,,0000,0000,0000,,that we can ask about our city.
Dialogue: 0,0:01:22.26,0:01:23.89,Default,,0000,0000,0000,,So the agencies can never keep up.
Dialogue: 0,0:01:23.89,0:01:25.66,Default,,0000,0000,0000,,So the paradigm isn't exactly working
Dialogue: 0,0:01:25.66,0:01:28.26,Default,,0000,0000,0000,,and I think our policy makers realize that
Dialogue: 0,0:01:28.26,0:01:31.63,Default,,0000,0000,0000,,because in 2012, Mayor Bloomberg\Nsigned into law what he called
Dialogue: 0,0:01:31.63,0:01:35.79,Default,,0000,0000,0000,,the most ambitious and comprehensive\Nopen data legislation in the country.
Dialogue: 0,0:01:35.79,0:01:37.57,Default,,0000,0000,0000,,In a lot of ways he's right.
Dialogue: 0,0:01:37.57,0:01:42.39,Default,,0000,0000,0000,,In the last two years the city's released\N1,000 data sets on our open data portal
Dialogue: 0,0:01:42.39,0:01:44.12,Default,,0000,0000,0000,,and, it's pretty awesome.
Dialogue: 0,0:01:44.12,0:01:45.56,Default,,0000,0000,0000,,You look at data like this,
Dialogue: 0,0:01:45.56,0:01:47.62,Default,,0000,0000,0000,,and instead of counting\Nthe number of cabs,
Dialogue: 0,0:01:47.62,0:01:49.60,Default,,0000,0000,0000,,we can start to ask different questions.
Dialogue: 0,0:01:49.60,0:01:52.37,Default,,0000,0000,0000,,So I had a question:\NWhen is rush hour in NYC?
Dialogue: 0,0:01:52.37,0:01:55.09,Default,,0000,0000,0000,,It can be pretty bothersome.\NWhen is rush hour exactly?
Dialogue: 0,0:01:55.09,0:01:57.82,Default,,0000,0000,0000,,And I thought to myself,\Nthese cabs aren't just numbers,
Dialogue: 0,0:01:57.82,0:02:01.13,Default,,0000,0000,0000,,these are GPS recorders driving around\Nin our city's streets recording
Dialogue: 0,0:02:01.13,0:02:02.68,Default,,0000,0000,0000,,each and every right they take.
Dialogue: 0,0:02:02.68,0:02:03.81,Default,,0000,0000,0000,,There's data there.
Dialogue: 0,0:02:03.81,0:02:05.84,Default,,0000,0000,0000,,And I looked at that data\Nand I made a plot
Dialogue: 0,0:02:05.84,0:02:08.57,Default,,0000,0000,0000,,of the average speed of taxis in NYC\Nthroughout the day.
Dialogue: 0,0:02:08.57,0:02:12.98,Default,,0000,0000,0000,,You can see that from around midnight\Nto around 5:18 AM, speed increases,
Dialogue: 0,0:02:12.98,0:02:15.86,Default,,0000,0000,0000,,and at that point, things turn around.
Dialogue: 0,0:02:15.86,0:02:19.83,Default,,0000,0000,0000,,They get slower, slower and slower\Nuntil about 8:35 AM
Dialogue: 0,0:02:19.83,0:02:22.59,Default,,0000,0000,0000,,when they end up at 11.5 mph.
Dialogue: 0,0:02:22.59,0:02:25.74,Default,,0000,0000,0000,,The average taxi is going at 11.5 mph\Nin our city streets,
Dialogue: 0,0:02:25.74,0:02:28.22,Default,,0000,0000,0000,,and it turns out it stays that way
Dialogue: 0,0:02:28.22,0:02:30.70,Default,,0000,0000,0000,,for the entire day.
Dialogue: 0,0:02:30.70,0:02:33.18,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:02:33.18,0:02:36.01,Default,,0000,0000,0000,,So I said to myself, I guess\Nthere's no rush hour in NYC,
Dialogue: 0,0:02:36.01,0:02:37.38,Default,,0000,0000,0000,,there's just a "rush day."
Dialogue: 0,0:02:37.38,0:02:38.24,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:02:38.24,0:02:39.16,Default,,0000,0000,0000,,Makes sense.
Dialogue: 0,0:02:39.16,0:02:41.14,Default,,0000,0000,0000,,This is important\Nfor a couple of reasons.
Dialogue: 0,0:02:41.14,0:02:44.80,Default,,0000,0000,0000,,If you are a transportation planner,\Nthis might be pretty interesting to know.
Dialogue: 0,0:02:44.80,0:02:46.73,Default,,0000,0000,0000,,But if you want to get somewhere quickly
Dialogue: 0,0:02:46.73,0:02:49.70,Default,,0000,0000,0000,,you now know to set your alarm\Nfor 4:45 AM and you're all set.
Dialogue: 0,0:02:49.70,0:02:50.50,Default,,0000,0000,0000,,New York, right?
Dialogue: 0,0:02:50.50,0:02:52.18,Default,,0000,0000,0000,,But there's story behind this data,
Dialogue: 0,0:02:52.18,0:02:54.14,Default,,0000,0000,0000,,it wasn't just available as it turns out.
Dialogue: 0,0:02:54.14,0:02:57.73,Default,,0000,0000,0000,,It actually came from something called\Na Freedom of Information Law Request,
Dialogue: 0,0:02:57.73,0:02:58.66,Default,,0000,0000,0000,,or a FOIL Request.
Dialogue: 0,0:02:58.66,0:03:01.63,Default,,0000,0000,0000,,This is a form you can find on\Nthe Taxi & Limousine Commission website.
Dialogue: 0,0:03:01.63,0:03:04.45,Default,,0000,0000,0000,,In order to access this data,\Nyou need to go get this form,
Dialogue: 0,0:03:04.45,0:03:06.48,Default,,0000,0000,0000,,fill it out, and they will notify you.
Dialogue: 0,0:03:06.48,0:03:09.28,Default,,0000,0000,0000,,And a guy name Chris Whong\Ndid exactly that.
Dialogue: 0,0:03:09.28,0:03:10.97,Default,,0000,0000,0000,,Chris went down and they told him,
Dialogue: 0,0:03:10.97,0:03:13.75,Default,,0000,0000,0000,,"Just bring a brand new hard drive\Nto our office,
Dialogue: 0,0:03:13.75,0:03:17.04,Default,,0000,0000,0000,,leave it here for 5 hours,\Nwe'll copy the data and you take it back."
Dialogue: 0,0:03:17.04,0:03:19.30,Default,,0000,0000,0000,,And that's where this data came from.
Dialogue: 0,0:03:19.30,0:03:22.35,Default,,0000,0000,0000,,Now, Chris is the kind of guy\Nthat wants to make the data public,
Dialogue: 0,0:03:22.35,0:03:25.98,Default,,0000,0000,0000,,so it ended up online for all to use\Nand that's where this graph came from.
Dialogue: 0,0:03:25.98,0:03:27.86,Default,,0000,0000,0000,,And the fact that it exists is amazing.
Dialogue: 0,0:03:27.86,0:03:29.80,Default,,0000,0000,0000,,These GPS recorders - really cool!
Dialogue: 0,0:03:29.80,0:03:32.83,Default,,0000,0000,0000,,But the fact that we have citizens\Nwalking around with hard drives
Dialogue: 0,0:03:32.83,0:03:35.35,Default,,0000,0000,0000,,picking up data from city agencies\Nto make it public -
Dialogue: 0,0:03:35.35,0:03:37.69,Default,,0000,0000,0000,,it was already kind of public,\Nyou could get to it,
Dialogue: 0,0:03:37.69,0:03:39.52,Default,,0000,0000,0000,,but it was "public", it wasn't public.
Dialogue: 0,0:03:39.52,0:03:41.57,Default,,0000,0000,0000,,And we can do better than that as a city,
Dialogue: 0,0:03:41.57,0:03:44.35,Default,,0000,0000,0000,,we don't need our citizens\Nwalking around with hard drives.
Dialogue: 0,0:03:44.35,0:03:47.25,Default,,0000,0000,0000,,Now, not every dataset\Nis behind a FOIL request.
Dialogue: 0,0:03:47.25,0:03:50.81,Default,,0000,0000,0000,,Here's a map I made with\Nthe most dangerous intersections in NYC
Dialogue: 0,0:03:50.81,0:03:53.09,Default,,0000,0000,0000,,based on cyclist accidents.
Dialogue: 0,0:03:53.09,0:03:54.88,Default,,0000,0000,0000,,So the red areas are more dangerous.
Dialogue: 0,0:03:54.88,0:03:57.24,Default,,0000,0000,0000,,What it shows is first\Nthe East side of Manhattan,
Dialogue: 0,0:03:57.24,0:04:01.06,Default,,0000,0000,0000,,especially in the lower area of Manhattan,\Nhas more cycle accidents.
Dialogue: 0,0:04:01.06,0:04:02.24,Default,,0000,0000,0000,,That might makes sense
Dialogue: 0,0:04:02.24,0:04:05.32,Default,,0000,0000,0000,,because there are more cyclist\Ncoming off the bridges over there.
Dialogue: 0,0:04:05.32,0:04:07.39,Default,,0000,0000,0000,,But there's other hotspots worth studying.
Dialogue: 0,0:04:07.39,0:04:10.05,Default,,0000,0000,0000,,There's Williamsburg.\NThere's Roosevelt Avenue in Queens.
Dialogue: 0,0:04:10.05,0:04:12.75,Default,,0000,0000,0000,,This is exactly the type of data\Nwe need for vision zero.
Dialogue: 0,0:04:12.75,0:04:14.73,Default,,0000,0000,0000,,This is exactly what we're looking for.
Dialogue: 0,0:04:14.73,0:04:16.78,Default,,0000,0000,0000,,But there's story\Nbehind this data as well.
Dialogue: 0,0:04:16.78,0:04:18.30,Default,,0000,0000,0000,,This data didn't just appear.
Dialogue: 0,0:04:18.30,0:04:20.82,Default,,0000,0000,0000,,How many of you guys know this logo?
Dialogue: 0,0:04:20.82,0:04:22.07,Default,,0000,0000,0000,,Yeah, I see some shakes.
Dialogue: 0,0:04:22.07,0:04:24.75,Default,,0000,0000,0000,,Have you ever tried to copy\Nand paste data out of a PDF
Dialogue: 0,0:04:24.75,0:04:25.95,Default,,0000,0000,0000,,and make sense of it?
Dialogue: 0,0:04:25.95,0:04:27.30,Default,,0000,0000,0000,,I see more shakes.
Dialogue: 0,0:04:27.30,0:04:30.68,Default,,0000,0000,0000,,More of you tried to copying and pasting\Nthan knew the logo. I like that.
Dialogue: 0,0:04:30.68,0:04:33.73,Default,,0000,0000,0000,,What happen is, the data\Nthat you just saw was actually on a PDF.
Dialogue: 0,0:04:33.73,0:04:39.47,Default,,0000,0000,0000,,In fact, hundreds, and hundreds,\Nof pages of PDF put out by our own NYPD,
Dialogue: 0,0:04:39.47,0:04:40.77,Default,,0000,0000,0000,,and in order to access it,
Dialogue: 0,0:04:40.77,0:04:44.08,Default,,0000,0000,0000,,you either have to copy and paste\Nfor hundred and hundred of hours,
Dialogue: 0,0:04:44.08,0:04:45.59,Default,,0000,0000,0000,,or you could be John Krauss.
Dialogue: 0,0:04:45.59,0:04:46.86,Default,,0000,0000,0000,,John Krauss is like,
Dialogue: 0,0:04:46.86,0:04:50.23,Default,,0000,0000,0000,,I'm not going to copy and paste this data,\NI'm going to write a program.
Dialogue: 0,0:04:50.23,0:04:52.38,Default,,0000,0000,0000,,It's called the NYPD Crash Data Band-Aid.
Dialogue: 0,0:04:52.38,0:04:55.23,Default,,0000,0000,0000,,And it goes to the NYPD's website\Nand it would download PDFs.
Dialogue: 0,0:04:55.23,0:04:56.72,Default,,0000,0000,0000,,Every day with it would search;
Dialogue: 0,0:04:56.72,0:04:58.64,Default,,0000,0000,0000,,if it found a PDF, it would download it,
Dialogue: 0,0:04:58.64,0:05:00.91,Default,,0000,0000,0000,,and it would run\Nsome PDF-scraping program,
Dialogue: 0,0:05:00.91,0:05:02.30,Default,,0000,0000,0000,,and out would come the text
Dialogue: 0,0:05:02.30,0:05:05.62,Default,,0000,0000,0000,,and it would go on the Internet,\Nand people could make maps like that.
Dialogue: 0,0:05:05.62,0:05:08.83,Default,,0000,0000,0000,,And the fact that the data is here,\Nthat we can have access to it -
Dialogue: 0,0:05:08.83,0:05:11.45,Default,,0000,0000,0000,,every accident, by the way, is a row\Non this table.
Dialogue: 0,0:05:11.45,0:05:13.28,Default,,0000,0000,0000,,You can imagine how many PDF that is.
Dialogue: 0,0:05:13.28,0:05:15.46,Default,,0000,0000,0000,,The fact that we\Nhave access to that is great.
Dialogue: 0,0:05:15.46,0:05:17.84,Default,,0000,0000,0000,,But let's not release it in PDF form.
Dialogue: 0,0:05:17.84,0:05:20.57,Default,,0000,0000,0000,,Because then we're having our citizens\Nwrite PDF scrapers.
Dialogue: 0,0:05:20.57,0:05:22.71,Default,,0000,0000,0000,,It's not the best use\Nof our citizens' time,
Dialogue: 0,0:05:22.71,0:05:24.72,Default,,0000,0000,0000,,and we, as a city,\Ncan do better than that.
Dialogue: 0,0:05:24.72,0:05:27.10,Default,,0000,0000,0000,,The good news is that\Nthe de Blasio Administration
Dialogue: 0,0:05:27.10,0:05:30.08,Default,,0000,0000,0000,,actually released this data\Na few months ago,
Dialogue: 0,0:05:30.08,0:05:31.76,Default,,0000,0000,0000,,so now, we can have access to it.
Dialogue: 0,0:05:31.76,0:05:34.35,Default,,0000,0000,0000,,But there's a lot of data\Nstill entombed in PDF.
Dialogue: 0,0:05:34.35,0:05:37.83,Default,,0000,0000,0000,,For example our crime data,\Nstill is only available in PDF.
Dialogue: 0,0:05:37.83,0:05:39.41,Default,,0000,0000,0000,,And not just our crime data,
Dialogue: 0,0:05:39.41,0:05:41.64,Default,,0000,0000,0000,,our own city budget.
Dialogue: 0,0:05:41.64,0:05:45.41,Default,,0000,0000,0000,,Our city budget is only\Nreadable right now in PDF form.
Dialogue: 0,0:05:45.41,0:05:47.44,Default,,0000,0000,0000,,And it's not just us\Nthat can't analyze it -
Dialogue: 0,0:05:47.44,0:05:50.15,Default,,0000,0000,0000,,our own legislators\Nwho vote for the budget,
Dialogue: 0,0:05:50.15,0:05:52.08,Default,,0000,0000,0000,,also only get it in PDF.
Dialogue: 0,0:05:52.08,0:05:55.89,Default,,0000,0000,0000,,So our legislators cannot analyze\Nthe budget that they are voting for.
Dialogue: 0,0:05:55.89,0:05:59.60,Default,,0000,0000,0000,,And I think as a city we can do\Na little better than that as well.
Dialogue: 0,0:05:59.60,0:06:02.08,Default,,0000,0000,0000,,Now, there's a lot of data\Nthat's not hidden in PDFs.
Dialogue: 0,0:06:02.08,0:06:03.84,Default,,0000,0000,0000,,This is an example of a map I made.
Dialogue: 0,0:06:03.84,0:06:07.00,Default,,0000,0000,0000,,And this is the dirtiest waterways in NYC.
Dialogue: 0,0:06:07.00,0:06:08.32,Default,,0000,0000,0000,,How do I measure dirty?
Dialogue: 0,0:06:08.32,0:06:09.94,Default,,0000,0000,0000,,Well, it's kind of a little weird,
Dialogue: 0,0:06:09.94,0:06:12.42,Default,,0000,0000,0000,,but I looked at the level\Nof fecal coliform,
Dialogue: 0,0:06:12.42,0:06:15.63,Default,,0000,0000,0000,,which is a measurement of fecal matter\Nin each of our waterways.
Dialogue: 0,0:06:15.63,0:06:19.07,Default,,0000,0000,0000,,The larger the circle,\Nthe dirtier the water.
Dialogue: 0,0:06:19.07,0:06:22.27,Default,,0000,0000,0000,,The large circles are dirty waters,\Nthe smaller circles are cleaner.
Dialogue: 0,0:06:22.27,0:06:24.21,Default,,0000,0000,0000,,What you see is inland waterways.
Dialogue: 0,0:06:24.21,0:06:27.46,Default,,0000,0000,0000,,This is all data that was sampled\Nby the city over the last 5 years.
Dialogue: 0,0:06:27.46,0:06:29.72,Default,,0000,0000,0000,,And inland waterways are,\Nin general, dirtier.
Dialogue: 0,0:06:29.72,0:06:31.13,Default,,0000,0000,0000,,That makes sense, right?
Dialogue: 0,0:06:31.13,0:06:32.97,Default,,0000,0000,0000,,And I learned a few things from this.
Dialogue: 0,0:06:32.97,0:06:39.28,Default,,0000,0000,0000,,Number 1: never swim in anything\Nthat ends in creek or canal.
Dialogue: 0,0:06:39.28,0:06:42.35,Default,,0000,0000,0000,,Number 2: I also found\Nthe dirtiest waterways in New York City
Dialogue: 0,0:06:42.35,0:06:44.05,Default,,0000,0000,0000,,by this measure, one measure.
Dialogue: 0,0:06:44.05,0:06:45.12,Default,,0000,0000,0000,,In Coney Island Creek,
Dialogue: 0,0:06:45.12,0:06:48.48,Default,,0000,0000,0000,,which is not Coney Island you swim in,\Nluckily, it's on the other side.
Dialogue: 0,0:06:48.48,0:06:52.68,Default,,0000,0000,0000,,But Coney Island Creek, 94% of samples\Ntaken over the last 5 years
Dialogue: 0,0:06:52.68,0:06:55.22,Default,,0000,0000,0000,,have had fecal levels so high,
Dialogue: 0,0:06:55.22,0:06:58.47,Default,,0000,0000,0000,,that it would be against state law\Nto swim in the water.
Dialogue: 0,0:06:58.47,0:07:01.10,Default,,0000,0000,0000,,And this is not the kind of fact\Nthat you're going to see
Dialogue: 0,0:07:01.10,0:07:03.77,Default,,0000,0000,0000,,boasted in a city report\Nor on the front page of nyc.gov.
Dialogue: 0,0:07:03.77,0:07:05.31,Default,,0000,0000,0000,,You're not going to see it there,
Dialogue: 0,0:07:05.31,0:07:08.12,Default,,0000,0000,0000,,but the fact that we can\Nget to that data, is awesome.
Dialogue: 0,0:07:08.12,0:07:09.92,Default,,0000,0000,0000,,Once again, it wasn't super easy,
Dialogue: 0,0:07:09.92,0:07:12.25,Default,,0000,0000,0000,,because this data was not\Non the open data portal.
Dialogue: 0,0:07:12.25,0:07:14.26,Default,,0000,0000,0000,,If you were to go to the open data portal,
Dialogue: 0,0:07:14.26,0:07:16.77,Default,,0000,0000,0000,,you'd see just a snippet of it,\Na year or a few months.
Dialogue: 0,0:07:16.77,0:07:20.08,Default,,0000,0000,0000,,It was actually on the Department\Nof Environmental Protection's website.
Dialogue: 0,0:07:20.08,0:07:24.02,Default,,0000,0000,0000,,Each one of these links is an Excel sheet,\Nand this Excel sheet is different.
Dialogue: 0,0:07:24.02,0:07:26.67,Default,,0000,0000,0000,,Every heading is different:\Nyou copy, paste, reorganize.
Dialogue: 0,0:07:26.67,0:07:29.59,Default,,0000,0000,0000,,When you do you can make maps\Nand that's great, but once again,
Dialogue: 0,0:07:29.59,0:07:32.47,Default,,0000,0000,0000,,we can do better than that as a city,\Nwe can normalize things.
Dialogue: 0,0:07:32.47,0:07:35.65,Default,,0000,0000,0000,,We're getting there because\Nthere's this website that Socrata makes,
Dialogue: 0,0:07:35.65,0:07:37.13,Default,,0000,0000,0000,,called the Open Data Portal NYC.
Dialogue: 0,0:07:37.13,0:07:39.28,Default,,0000,0000,0000,,This is where 1100 data sets,\Nthat don't suffer
Dialogue: 0,0:07:39.28,0:07:40.83,Default,,0000,0000,0000,,from the things I told you live,
Dialogue: 0,0:07:40.83,0:07:42.90,Default,,0000,0000,0000,,and that number is growing,\Nand that's great.
Dialogue: 0,0:07:42.90,0:07:46.70,Default,,0000,0000,0000,,You can download data in any format,\Nbe it CSV or PDF or Excel document.
Dialogue: 0,0:07:46.70,0:07:49.70,Default,,0000,0000,0000,,Whatever you want,\Nyou can download the data that way.
Dialogue: 0,0:07:49.70,0:07:51.16,Default,,0000,0000,0000,,The problem is, once you do,
Dialogue: 0,0:07:51.16,0:07:55.62,Default,,0000,0000,0000,,you'll find that each agency\Ncodes their addresses differently.
Dialogue: 0,0:07:55.62,0:07:57.67,Default,,0000,0000,0000,,So, one is street name,\Nintersection street,
Dialogue: 0,0:07:57.67,0:08:00.16,Default,,0000,0000,0000,,street, borough, address building,\Nbuilding, address.
Dialogue: 0,0:08:00.16,0:08:03.34,Default,,0000,0000,0000,,So, once again, you're spending time,\Neven when we have this portal,
Dialogue: 0,0:08:03.34,0:08:05.86,Default,,0000,0000,0000,,you're spending time\Nnormalizing our address field.
Dialogue: 0,0:08:05.86,0:08:08.38,Default,,0000,0000,0000,,I think that's not the best use\Nof our citizens' time,
Dialogue: 0,0:08:08.38,0:08:10.23,Default,,0000,0000,0000,,we can do better than that as a city.
Dialogue: 0,0:08:10.23,0:08:11.86,Default,,0000,0000,0000,,We can standardize our addresses.
Dialogue: 0,0:08:11.86,0:08:13.81,Default,,0000,0000,0000,,If we do, we can get more maps like this.
Dialogue: 0,0:08:13.81,0:08:16.06,Default,,0000,0000,0000,,This is a map of fire hydrants\Nin New York City.
Dialogue: 0,0:08:16.06,0:08:17.64,Default,,0000,0000,0000,,But not just any fire hydrant.
Dialogue: 0,0:08:17.64,0:08:20.17,Default,,0000,0000,0000,,These are the top 250\Ngrossing fire hydrants
Dialogue: 0,0:08:20.17,0:08:22.86,Default,,0000,0000,0000,,in terms of parking tickets.
Dialogue: 0,0:08:22.86,0:08:24.99,Default,,0000,0000,0000,,(Laughter)
Dialogue: 0,0:08:24.99,0:08:27.11,Default,,0000,0000,0000,,So I learned a few things from this map.
Dialogue: 0,0:08:27.11,0:08:30.24,Default,,0000,0000,0000,,Number 1: just don't park\Non the Upper East side.
Dialogue: 0,0:08:30.24,0:08:33.52,Default,,0000,0000,0000,,Just don't. No matter where you park,\Nyou will get a hydrant ticket.
Dialogue: 0,0:08:33.52,0:08:37.95,Default,,0000,0000,0000,,Number 2: I found the two highest\Ngrossing hydrants in all of New York City.
Dialogue: 0,0:08:37.95,0:08:39.48,Default,,0000,0000,0000,,They are on the Lower East side,
Dialogue: 0,0:08:39.48,0:08:44.60,Default,,0000,0000,0000,,and they are bringing in over\N55,000 dollars a year in parking tickets.
Dialogue: 0,0:08:44.60,0:08:47.26,Default,,0000,0000,0000,,And that seemed a little strange to me\Nwhen I noticed it,
Dialogue: 0,0:08:47.26,0:08:49.37,Default,,0000,0000,0000,,so I did a little digging,\Nand it turns out
Dialogue: 0,0:08:49.37,0:08:52.61,Default,,0000,0000,0000,,what you had is a hydrant\Nand something called a curb extension,
Dialogue: 0,0:08:52.61,0:08:54.66,Default,,0000,0000,0000,,which is like a seven-foot space\Nto walk on,
Dialogue: 0,0:08:54.66,0:08:55.85,Default,,0000,0000,0000,,and then a parking spot.
Dialogue: 0,0:08:55.85,0:08:57.94,Default,,0000,0000,0000,,So these cars came along and the hydrant -
Dialogue: 0,0:08:57.94,0:08:59.78,Default,,0000,0000,0000,,"It's all the way over there, I'm fine,"
Dialogue: 0,0:08:59.78,0:09:03.25,Default,,0000,0000,0000,,and there was actually a parking spot\Npainted there beautifully for them.
Dialogue: 0,0:09:03.25,0:09:06.27,Default,,0000,0000,0000,,They would park there and the NYPD\Ndisagree with the designation,
Dialogue: 0,0:09:06.27,0:09:07.56,Default,,0000,0000,0000,,and would ticket them.
Dialogue: 0,0:09:07.56,0:09:09.90,Default,,0000,0000,0000,,And it wasn't just me\Nwho found a parking ticket.
Dialogue: 0,0:09:09.90,0:09:13.61,Default,,0000,0000,0000,,This is the Google street view car\Ndriving by, finding same parking ticket.
Dialogue: 0,0:09:13.61,0:09:16.08,Default,,0000,0000,0000,,So I wrote about this\Non my blog, on I Quant NY,
Dialogue: 0,0:09:16.08,0:09:18.46,Default,,0000,0000,0000,,and the DOT responded and they said,
Dialogue: 0,0:09:18.46,0:09:22.79,Default,,0000,0000,0000,,"While the DOT has not received\Nany complaints about this location,
Dialogue: 0,0:09:22.79,0:09:27.34,Default,,0000,0000,0000,,we will review the roadway markings\Nand make any appropriate alterations."
Dialogue: 0,0:09:27.34,0:09:30.33,Default,,0000,0000,0000,,I thought to myself, you know,\Ntypical government response,
Dialogue: 0,0:09:30.33,0:09:31.94,Default,,0000,0000,0000,,all right, moved on with my life.
Dialogue: 0,0:09:31.94,0:09:36.52,Default,,0000,0000,0000,,But then, a few weeks later,\Nsomething incredible happened.
Dialogue: 0,0:09:36.52,0:09:38.64,Default,,0000,0000,0000,,They repainted the spot.
Dialogue: 0,0:09:38.64,0:09:41.30,Default,,0000,0000,0000,,And for a second I thought\NI saw the future of open data
Dialogue: 0,0:09:41.30,0:09:43.22,Default,,0000,0000,0000,,because think about what happened here.
Dialogue: 0,0:09:43.22,0:09:48.42,Default,,0000,0000,0000,,For five years, this spot\Nwas being ticketed, and it was confusing.
Dialogue: 0,0:09:48.42,0:09:52.80,Default,,0000,0000,0000,,And then a citizen found something,\Nthey told the city and within a few weeks,
Dialogue: 0,0:09:52.80,0:09:55.29,Default,,0000,0000,0000,,the problem was fixed. It's amazing.
Dialogue: 0,0:09:55.29,0:09:58.09,Default,,0000,0000,0000,,A lot of people see open data\Nas being a watch dog, it's not.
Dialogue: 0,0:09:58.09,0:09:59.38,Default,,0000,0000,0000,,It's about being a partner.
Dialogue: 0,0:09:59.38,0:10:02.50,Default,,0000,0000,0000,,We can empower our citizens to be\Nbetter partners for government,
Dialogue: 0,0:10:02.50,0:10:04.08,Default,,0000,0000,0000,,and it's not that hard.
Dialogue: 0,0:10:04.08,0:10:05.53,Default,,0000,0000,0000,,All we need are a few changes.
Dialogue: 0,0:10:05.53,0:10:06.66,Default,,0000,0000,0000,,If you're FOILing data,
Dialogue: 0,0:10:06.66,0:10:09.30,Default,,0000,0000,0000,,if you seeing your data\Nbeing FOILed over and over again,
Dialogue: 0,0:10:09.30,0:10:12.11,Default,,0000,0000,0000,,let's release it to the public, that's\Na sign that it should be made public.
Dialogue: 0,0:10:12.11,0:10:15.02,Default,,0000,0000,0000,,And if you're a government agency\Nreleasing a PDF,
Dialogue: 0,0:10:15.02,0:10:18.91,Default,,0000,0000,0000,,let's pass a legislation that requires you\Nto post it with your underlying data,
Dialogue: 0,0:10:18.91,0:10:20.94,Default,,0000,0000,0000,,because that data\Nis coming from somewhere.
Dialogue: 0,0:10:20.94,0:10:23.65,Default,,0000,0000,0000,,I don't know where,\Nbut you can release it with the PDF.
Dialogue: 0,0:10:23.65,0:10:25.98,Default,,0000,0000,0000,,And let's adopt and share\Nsome open data standards.
Dialogue: 0,0:10:25.98,0:10:28.68,Default,,0000,0000,0000,,Let's start with our addresses\Nhere in New York City.
Dialogue: 0,0:10:28.68,0:10:30.71,Default,,0000,0000,0000,,Let's just start\Nnormalizing our addresses.
Dialogue: 0,0:10:30.71,0:10:32.69,Default,,0000,0000,0000,,Because New York is a leader in open data.
Dialogue: 0,0:10:32.69,0:10:35.32,Default,,0000,0000,0000,,Despite all this, we're absolutely\Na leader in open data,
Dialogue: 0,0:10:35.32,0:10:38.38,Default,,0000,0000,0000,,and if we start normalizing things,\Nand set an open data standard,
Dialogue: 0,0:10:38.38,0:10:39.33,Default,,0000,0000,0000,,others will follow.
Dialogue: 0,0:10:39.33,0:10:41.83,Default,,0000,0000,0000,,The state will follow,\Nmaybe the federal government,
Dialogue: 0,0:10:41.83,0:10:43.39,Default,,0000,0000,0000,,other countries could follow,
Dialogue: 0,0:10:43.39,0:10:47.11,Default,,0000,0000,0000,,and we're not that far off from a time\Nwhere you can write one program
Dialogue: 0,0:10:47.11,0:10:49.18,Default,,0000,0000,0000,,and map information from a 100 countries.
Dialogue: 0,0:10:49.18,0:10:51.75,Default,,0000,0000,0000,,It's not science fiction,\Nwe're actually quite close.
Dialogue: 0,0:10:51.75,0:10:54.04,Default,,0000,0000,0000,,And by the way, who are we\Nempowering with this?
Dialogue: 0,0:10:54.04,0:10:57.61,Default,,0000,0000,0000,,Because it's not just John Krauss,\Nit's not just Chris Whong.
Dialogue: 0,0:10:57.61,0:11:00.90,Default,,0000,0000,0000,,There are hundred of meetups\Ngoing around in New York City right now,
Dialogue: 0,0:11:00.90,0:11:02.03,Default,,0000,0000,0000,,active meetups.
Dialogue: 0,0:11:02.03,0:11:04.61,Default,,0000,0000,0000,,There are thousands of people\Nattending these meetups.
Dialogue: 0,0:11:04.61,0:11:06.97,Default,,0000,0000,0000,,These people are going after work\Nand on weekends,
Dialogue: 0,0:11:06.97,0:11:09.76,Default,,0000,0000,0000,,and they're attending these meetups\Nto look at open data,
Dialogue: 0,0:11:09.76,0:11:11.38,Default,,0000,0000,0000,,and make our city a better place.
Dialogue: 0,0:11:11.38,0:11:15.93,Default,,0000,0000,0000,,Groups like BetaNYC who just last week,\Nreleased something called citygram.nyc
Dialogue: 0,0:11:15.93,0:11:18.16,Default,,0000,0000,0000,,that allows you to subscribe\Nto 311 complaints
Dialogue: 0,0:11:18.16,0:11:20.30,Default,,0000,0000,0000,,around your own home,\Nor around your office.
Dialogue: 0,0:11:20.30,0:11:22.69,Default,,0000,0000,0000,,You put in your address,\Nyou get local complaints.
Dialogue: 0,0:11:22.69,0:11:25.77,Default,,0000,0000,0000,,And it's not just the tech community\Nthat are after these things.
Dialogue: 0,0:11:25.77,0:11:28.40,Default,,0000,0000,0000,,It's urban planners like the students\NI teach at Pratt.
Dialogue: 0,0:11:28.40,0:11:30.36,Default,,0000,0000,0000,,It's policy advocates, it's everyone,
Dialogue: 0,0:11:30.36,0:11:32.92,Default,,0000,0000,0000,,it's citizens from a diverse\Nset of backgrounds.
Dialogue: 0,0:11:32.92,0:11:35.68,Default,,0000,0000,0000,,And with some small incremental changes,
Dialogue: 0,0:11:35.68,0:11:38.79,Default,,0000,0000,0000,,we can unlock the passion\Nand the ability of our citizens
Dialogue: 0,0:11:38.79,0:11:41.90,Default,,0000,0000,0000,,to harness open data\Nand make our city even better,
Dialogue: 0,0:11:41.90,0:11:45.96,Default,,0000,0000,0000,,whether is one data set\Nor one parking spot at a time.
Dialogue: 0,0:11:45.96,0:11:47.21,Default,,0000,0000,0000,,Thank you.
Dialogue: 0,0:11:47.21,0:11:50.27,Default,,0000,0000,0000,,(Applause)