-
Not Synced
- [Narrator] The path from cause
to effect is dark and dangerous.
-
Not Synced
But the weapons
of Econometrics are strong.
-
Not Synced
[Attack] with fierce
and flexible instrumental variables
-
Not Synced
when nature blesses you
with fortuitous random assignment.
-
Not Synced
[gong rings]
-
Not Synced
Randomized trials are the surest
path to ceteris parabus comparisons.
-
Not Synced
Alas, this powerful tool
is often unavailable.
-
Not Synced
But sometimes, randomization
happens by accident.
-
Not Synced
That's when we turn
to instrumental variables,
-
Not Synced
IV for short.
-
Not Synced
- [Voice whispers] Instrumental
variables.
-
Not Synced
- [Narrator] Today's lesson
is the first of two on IV.
-
Not Synced
Our first IV lesson begins
with a story of schools.
-
Not Synced
- [Josh] Charter schools
are public schools
-
Not Synced
freed from daily district oversight
and teacher union contracts.
-
Not Synced
The question of whether charters
boost achievement
-
Not Synced
is one of the most important
-
Not Synced
in the history
of American education reform.
-
Not Synced
- The most popular charter schools
have more applicants
-
Not Synced
so the luck of the lottery draw
decides who's offered a seat.
-
Not Synced
A lot is at stake for the students
vying for their chance.
-
Not Synced
Waiting for the lottery results
brings up lots of emotions
-
Not Synced
as was captured
in the award-winning documentary
-
Not Synced
"Waiting For Superman."
-
Not Synced
- [Mother] Don't cry.
You're gonna make Mommy cry.
-
Not Synced
Okay?
-
Not Synced
- Do charters really provide
a better education?
-
Not Synced
Critics most definitely say no,
-
Not Synced
arguing that charters enroll
better students to begin with,
-
Not Synced
smarter or more motivated
so differences in later outcomes
-
Not Synced
reflects selection bias.
-
Not Synced
- [Kamal] Wait, this one seems easy.
-
Not Synced
In a lottery, winners
are chosen randomly,
-
Not Synced
so just compare winners and losers.
-
Not Synced
- [Student] Obviously.
-
Not Synced
- On the right track, Kamal,
-
Not Synced
but charter lotteries
don't force kids into
-
Not Synced
or out of a particular school.
-
Not Synced
They randomize offers
of a charter seat.
-
Not Synced
Some kids get lucky.
-
Not Synced
Some kids don't.
-
Not Synced
If we just wanted to know
the effect of charter school offers,
-
Not Synced
we could treat this
as a randomized trial.
-
Not Synced
But we we're interested
in the effects
-
Not Synced
of charter school attendance,
not offers.
-
Not Synced
And not everyone
who is offered, accepts.
-
Not Synced
IV turns the effect of being offered
a charter seat into the effect
-
Not Synced
of actually attending
a charter school.
-
Not Synced
- [Student] Cool.
-
Not Synced
- Oh nice.
-
Not Synced
- Let's look at an example,
a charter school from
-
Not Synced
the Knowledge Is Power
Program, or KIPP for short.
-
Not Synced
This KIPP school is in Lynn,
-
Not Synced
a faded industrial town
on the coast of Massachusetts.
-
Not Synced
The school has
more applicants than seats
-
Not Synced
and therefore picks its students
using a lottery.
-
Not Synced
From 2005 to 2008,
371 fourth and fifth graders
-
Not Synced
put their names
in the KIPP/Lynn lottery,
-
Not Synced
253 students won a seat at KIPP,
-
Not Synced
118 students lost.
-
Not Synced
A year later, lottery winners had
much higher match scores
-
Not Synced
than lottery losers.
-
Not Synced
But remember,
we're not trying to figure out
-
Not Synced
whether winning a lottery
makes you better at math.
-
Not Synced
We want to know if attending KIPP
makes you better at math.
-
Not Synced
Of the 253 lottery winners,
only 199 actually went to KIPP.
-
Not Synced
The others chose
a traditional public school.
-
Not Synced
Similarly of the 118 lottery losers,
a few actually ended up at KIPP.
-
Not Synced
They got an offer later.
-
Not Synced
So what was the effect of test scores
of actually attending KIPP?
-
Not Synced
- [Student] Why can't we just
measure their math scores?
-
Not Synced
- [Narrator] Great question.
-
Not Synced
Who would you compare them to?
-
Not Synced
- [Student] Those who didn't attend.
-
Not Synced
- [Narrator] Is attendance random?