< Return to Video

Last Week Tonight with John Oliver: Standardized Testing (HBO)

  • 0:04 - 0:08
    Standardized tests: the fastest way to
    terrify any child with five letters
  • 0:08 - 0:12
    outside of just whispering the word "clown."
  • 0:13 - 0:16
    It's currently testing season all over
    the country,
  • 0:16 - 0:19
    and with that comes the usual flood of
    anxiety
  • 0:19 - 0:23
    and school-produced videos designed to
    get kids in the mood.
  • 0:23 - 0:23
    (singing)
  • 0:44 - 0:46
    (singing) Get your No. 2 pencils out!
  • 0:46 - 0:48
    What the test say?
  • 0:48 - 0:52
    Get your No. 2 pencils out!
    Get your No. 2 pencils out!
  • 0:52 - 0:55
    Look, standardized tests look like amazing
    fun.
  • 0:55 - 0:57
    I wish I could take one right now.
  • 0:57 - 0:59
    Bring me a pencil - a No. 2, please!
  • 0:59 - 1:03
    But it gets better, because one elementary
    school in Texas
  • 1:03 - 1:06
    even held a test-themed pep rally
    featuring a monkey mascot.
  • 1:06 - 1:09
    Ooh ah ah!
    Time to get funky
  • 1:09 - 1:11
    Ooh ah ah!
    Because here comes the monkey!
  • 1:11 - 1:13
    Ooh ah ah!
    Time to get funky
  • 1:13 - 1:15
    Monkey, monkey, monkey, monkey
  • 1:16 - 1:19
    Look - let's all agree, there is
    no scenario
  • 1:19 - 1:22
    in which the words, "here comes the
    monkey"
  • 1:22 - 1:24
    can fail to pump you up.
  • 1:24 - 1:26
    Just imagine right now I was your surgeon
  • 1:26 - 1:29
    and I said to you, "I'm about to
    put you under.
  • 1:29 - 1:31
    There's about a 20% chance of survival.
  • 1:31 - 1:34
    And I have four important words for you.
  • 1:34 - 1:35
    Here comes the monkey."
  • 1:35 - 1:37
    (applause and music)
  • 1:38 - 1:41
    (Oliver) You're going to be looking
    forward to that operation.
  • 1:41 - 1:43
    It's going to be a fun time.
  • 1:43 - 1:45
    You see? You love it!
  • 1:47 - 1:50
    The point is - you proved my point!
  • 1:50 - 1:54
    The point is: those videos and monkey
    mascots would have you think
  • 1:54 - 1:56
    that testing is amazing,
  • 1:56 - 2:01
    which is why this spate of recent
    news stories has been so surprising.
  • 2:01 - 2:03
    "In the Lower Hudson Valley,
    many districts reported that
  • 2:03 - 2:06
    more than 25% of their students
    opted out -"
  • 2:06 - 2:09
    "More than 1,700 elementary, middle, and
    high school students
  • 2:09 - 2:11
    opted out of taking the PARCC test."
  • 2:11 - 2:13
    "There were five kids I was with."
  • 2:13 - 2:15
    (Reporter) "That took the test?"
    "Yeah."
  • 2:15 - 2:19
    "Almost the entire auditorium was filled
    with kids that didn't take it."
  • 2:19 - 2:21
    (Reporter) "Not a single junior showed up
  • 2:21 - 2:24
    to take the Common Core Smarter Balance
    Test this week."
  • 2:24 - 2:28
    Wow. The entire class boycotted the test.
  • 2:28 - 2:32
    The only other thing an entire class of
    juniors has ever managed to agree on
  • 2:32 - 2:36
    is that The Scarlet Letter could be told
    much simpler with emojis.
  • 2:36 - 2:39
    Yeah, we get it, we get it.
  • 2:39 - 2:42
    Red lady, finger-finger, devil, baby.
    We've all read the book.
  • 2:42 - 2:44
    It's a good story.
  • 2:44 - 2:48
    Now look, is it any wonder that American
    students are sick of tests?
  • 2:48 - 2:50
    Between benchmarks, diagnostics,
    pre- and mock- tests,
  • 2:50 - 2:52
    they take a lot of them.
  • 2:52 - 2:55
    "Students are taking between 10 and 20
    standardized tests,
  • 2:55 - 3:00
    depending on the grade, a total average of
    113 different ones by graduation."
  • 3:00 - 3:02
    113 is a lot of tests.
  • 3:02 - 3:05
    It's approaching the amount that
    you'd ask your doctor for
  • 3:05 - 3:09
    the morning after you woke up from a
    one-night stand with Colin Farrell.
  • 3:09 - 3:11
    "Just give me all of them twice."
  • 3:12 - 3:15
    And this amount of testing can
    take a toll.
  • 3:15 - 3:19
    (Woman) "Teachers have reported kids
    throwing up,
  • 3:19 - 3:23
    kids crying, especially the younger ones.
    And it's the pressure -"
  • 3:23 - 3:25
    That's true. In fact, this happens so much
  • 3:25 - 3:30
    that official instructions for test
    administrators specify what to do
  • 3:30 - 3:33
    if a student vomits on his or her test
    booklet.
  • 3:33 - 3:35
    And something is wrong with our system
  • 3:35 - 3:39
    when we just assume a certain number of
    kids will vomit.
  • 3:39 - 3:41
    Tests are supposed to be assessments of
    skills,
  • 3:41 - 3:44
    not a rap battle on 8 Mile Road.
  • 3:44 - 3:47
    Oh, Eminem, why did your mom make you
    spaghetti?
  • 3:47 - 3:50
    She knew tonight was rap battle night.
  • 3:51 - 3:54
    So, how did we get here?
  • 3:54 - 3:57
    Well, the explosion of testing can be
    traced back to the '90s,
  • 3:57 - 4:02
    when you probably remember stories like
    these about the state of public education:
  • 4:02 - 4:06
    (Reporter) "When 40 nations recently took
    the International Math and Science Test,
  • 4:06 - 4:09
    American students scored near the bottom."
  • 4:09 - 4:11
    That must have hurt.
  • 4:11 - 4:14
    Especially because you knew the French
    children weren't even trying.
  • 4:14 - 4:18
    (French accent) Go on, play with your
    silly numbers.
  • 4:18 - 4:21
    They tell you nothing of the true nature
    of the soul.
  • 4:21 - 4:23
    I weep for you.
  • 4:24 - 4:26
    (laughter)
  • 4:26 - 4:28
    In response to statistics like that-
  • 4:29 - 4:30
    (laughter and applause)
  • 4:31 - 4:35
    President George W Bush, on just his
    third day in office, announced his No
  • 4:35 - 4:40
    Child Left Behind program. It passed
    Congress with bipartisan support
  • 4:40 - 4:44
    because of course it did. Voting against
    No Child Left Behind is like voting against
  • 4:44 - 4:50
    No Puppy Left Unsnuggled. What monster
    would do that, his name is Patches, and
  • 4:50 - 4:51
    he needs love!
  • 4:52 - 4:56
    The program was designed to be data-
    driven, and involve testing children
  • 4:56 - 5:00
    every single year in order to identify and
    fix failing schools.
  • 5:00 - 5:06
    (Bush) The accountability system must have
    a consequence. Otherwise it's not much of
  • 5:06 - 5:07
    an accountability system.
  • 5:08 - 5:13
    (Oliver) It's hard to argue with any of
    that. Unfortunately, accountability is
  • 5:13 - 5:16
    one of those concepts that everybody
    is in favor of, but no body knows how
  • 5:16 - 5:21
    to make work. Like synergy, or Maxi
    dresses; no matter who wears them
  • 5:21 - 5:23
    they look like a poncho fucked a waterfall.
  • 5:23 - 5:24
    (laughter)
  • 5:25 - 5:30
    You look like the ghost of Gwyneth Paltrow
    future. "I only haunt brunch! Goooop."
  • 5:30 - 5:35
    No Child Left Behind increased the number
    of federally mandated tests from six to
  • 5:35 - 5:40
    seventeen. And the fixation on testing was
    something which our current president seemed
  • 5:40 - 5:42
    to be against as he ran for office.
  • 5:42 - 5:48
    (Obama) Don't tell us that the only way to
    teach a child is to spend too much of a year
  • 5:48 - 5:54
    preparing him to fill out a few bubbles in a
    standardized test. We know that's not true.
  • 5:55 - 5:59
    (Oliver) Wow, that man knew how to pander
    to teachers: "And you know what else, there
  • 5:59 - 6:04
    should be pool tables in the teacher's lounge!
    And ever year you should be able to slap one
  • 6:04 - 6:06
    parent. Vote for me, I'm outta here!"
  • 6:06 - 6:07
    (laughter)
  • 6:10 - 6:14
    But once this president took office, he didn't
    get rid of tests, instead he added his own
  • 6:14 - 6:18
    education initiatives like Race to the Top,
    which encouraged states to adopt the
  • 6:18 - 6:25
    Common Core which features a logo of
    snails, 69ing. And again, the intentions
  • 6:25 - 6:29
    here were good. Because we do have
    under-performing schools, and there are
  • 6:29 - 6:33
    major racial and economic disparities in
    the quality of education children receive.
  • 6:33 - 6:37
    And anything that can help us narrow those
    gaps is obviously a good thing. The problem
  • 6:37 - 6:43
    has been implementation. For instance, many
    states now tie teacher pay to performance
  • 6:43 - 6:45
    using one particular approach.
  • 6:46 - 6:51
    (Reporter) It's called "Value Added Analysis",
    rating teachers based on student test scores.
  • 6:51 - 6:55
    For instance, if a student who ranked in the
    60th percentile test higher at the end of the
  • 6:55 - 7:01
    year, the teacher gets a better rating. If
    the student falls, the teacher's rating falls.
  • 7:02 - 7:05
    (Oliver) Ok, well, that explains why many
    teachers' classroom decorations that used
  • 7:05 - 7:09
    to read: "Believe in Yourself" now say:
    "Don't Fuck Me On This".
  • 7:09 - 7:10
    (laughter)
  • 7:12 - 7:18
    And while the idea of tying teacher pay to
    student improvement sounds great in theory
  • 7:18 - 7:20
    here's how it can work in practice.
  • 7:20 - 7:25
    (Teacher) I have four students whose predicted
    scores were literally impossible. One of my sixth
  • 7:25 - 7:33
    grade students had a predicted score of 286.34.
    However, the highest a sixth grade student can
  • 7:33 - 7:41
    earn is 283. The student did earn a 283,
    incidentally. Despite the fact she earned
  • 7:41 - 7:46
    a perfect score, she counted negatively
    towards my evaluation, because she was
  • 7:46 - 7:49
    three points below her predicted score.
  • 7:49 - 7:53
    (Oliver) That is ridiculous. The only way
    she could have hit her predicted score
  • 7:53 - 7:58
    was if she answered everything right,
    wrote a few extra questions of her own,
  • 7:58 - 8:01
    got those right, and then stapled them
    to the test.
  • 8:01 - 8:02
    (laughter)
  • 8:02 - 8:07
    That teacher lives in Florida, which uses
    this formula to assess teachers. A formula
  • 8:07 - 8:10
    which looks like the kind of thing that aliens
    carve into an anti-Semite cornfield.
  • 8:11 - 8:12
    (laughter)
  • 8:12 - 8:18
    And many of these formulas on which
    teacher's careers depend were partly
  • 8:18 - 8:21
    inspired by research, and this is true,
    that modeled the reproductive trends
  • 8:21 - 8:27
    of livestock. Basically, we judge the nuance
    of what happens in the complicated world
  • 8:27 - 8:32
    of a child's mind, the same way that we judge
    this. Look, I don't know what we did wrong,
  • 8:32 - 8:37
    but your child is going to either pass
    Algebra, or birth a healthy calf.
  • 8:37 - 8:39
    I don't know, flip a coin.
  • 8:39 - 8:44
    With the stakes this high, the test had better
    be good. But there is ample reason to suspect
  • 8:44 - 8:49
    that that is not the case. Just look at the
    Florida Comprehensive Assessment Test,
  • 8:49 - 8:53
    or FCAT, that a Florida school board member
    was concerned, and a little suspicious, when
  • 8:53 - 8:59
    he learned that only 39% of his states' tenth
    graders had performed at or above grade
  • 8:59 - 9:01
    level in reading. So he had an idea.
  • 9:02 - 9:06
    (Teacher) I asked the district at that point
    to give me the closest thing they could,
  • 9:06 - 9:11
    legally, to the FCAT reading and math test,
    and I took it. That test labeled me as a
  • 9:11 - 9:15
    poor reader, and I have a couple of Master's
    Degrees and I've been re-elected four times
  • 9:15 - 9:20
    and I teach 39 graduate courses at six
    Universities in this country.
  • 9:21 - 9:26
    (Oliver) Ok, ok. We get it, the test sucks,
    anything else you want to brag about there?
  • 9:26 - 9:30
    "Oh, I also know how to play Mary Had A Little
    Lamb on the recorder, and guess who can do
  • 9:30 - 9:34
    16 non-consecutive push ups: this fucking
    guy!"
  • 9:34 - 9:35
    (laughter)
  • 9:35 - 9:41
    But look, he does have a point. If a test
    fails to reflect ability, there are human
  • 9:41 - 9:46
    consequences. Because one shy Florida
    8th grader, who had a near-perfect score
  • 9:46 - 9:50
    in her Advanced Language Arts class was
    asked to leave it last year due to her
  • 9:50 - 9:55
    inexplicable low scores on the FCAT. And
    last fall she told a school board meeting
  • 9:55 - 9:57
    exactly how that felt.
  • 9:57 - 10:01
    (Student) Every year I do good in school.
    But I get low test--
  • 10:03 - 10:07
    But I get low test scores on the FCAT and
    it feels like a punch in the stomach.
  • 10:07 - 10:10
    This is unfair and I don't want to lose
    my opportunity to take my advanced
  • 10:10 - 10:15
    classes or get better education because
    of this one test.
  • 10:15 - 10:22
    (Oliver) That is just awful. I take back
    about wanting to take a standardized
  • 10:22 - 10:25
    test. In fact, you know what, bring out
    the monkey!
  • 10:25 - 10:26
    (applause)
  • 10:27 - 10:32
    Turn off his music! Do not applaud it!
    What the fuck is wrong with you?
  • 10:32 - 10:36
    You made that little girl cry!
    Think about what you've done.
  • 10:36 - 10:40
    No! No! No! Don't you dance it off, you
    go and think about what you've done.
  • 10:40 - 10:41
    (Monkey) Aww.
  • 10:41 - 10:43
    (Oliver) Shame on you!
  • 10:44 - 10:45
    (applause)
  • 10:46 - 10:52
    At this point, you have to ask yourself: if
    standardized tests are bad for teachers
  • 10:52 - 10:57
    and bad for kids, who exactly are they
    good for? Well, it turns out that operated
  • 10:57 - 11:03
    by companies like all these, and let's just
    focus on the largest one, Pearson. As of
  • 11:03 - 11:09
    2012, they had nearly 40% of the testing
    market, almost triple their nearest competitor.
  • 11:09 - 11:12
    And if you've never heard of them, then
    congratulations. But, just mention their
  • 11:12 - 11:18
    name to any parent or teacher in a state
    they operate in, and you'll see what happens.
  • 11:18 - 11:23
    Because Pearson are the educational
    equivalent of Time Warner Cable. Either
  • 11:23 - 11:28
    you've never had an interaction with them
    and don't care, or they've ruined your fucking
  • 11:28 - 11:34
    life. Pearson have a shocking amount of
    influence over America's schools, so much
  • 11:34 - 11:40
    so, that at this point a hypothetical girl could
    take Pearson tests from kindergarten through
  • 11:40 - 11:45
    at least 8th grade, tests by the way that she
    studied for using Pearson curriculum and
  • 11:45 - 11:50
    textbooks, taught to her by teachers who
    are certified by their own Pearson test.
  • 11:50 - 11:54
    If at some point she was tested for learning
    disabilities like ADHD, that's also a Pearson
  • 11:54 - 11:58
    test, and if she eventually got sick of Pearson
    and dropped out, well she'd have to take the
  • 11:58 - 12:04
    GED, which is now, guess what, also a
    Pearson test. In fact, the only test they
  • 12:04 - 12:08
    have no hand in, is the HPV test you might
    take in college, and I can only assume that
  • 12:08 - 12:13
    they'll get on that as soon as they see this
    fucking show. Pearson has enjoyed
  • 12:13 - 12:18
    spectacular growth and profits, and yet
    their track record is littered with complaints
  • 12:18 - 12:24
    concerning technical glitches, slow grading
    and even the contents of their tests. Take
  • 12:24 - 12:26
    what happened in New York, just a few
    years ago.
  • 12:27 - 12:29
    (Reporter) Almost 30 different test questions
    have now been declared invalid because
  • 12:30 - 12:34
    they are confusing or have outright errors.
    They've already pulled six questions from
  • 12:34 - 12:38
    the English exam. Related to a bizarre
    passage about a talking pineapple.
  • 12:39 - 12:40
    (laughter)
  • 12:41 - 12:44
    (Oliver) A talking pineapple! Well, at the
    risk of sounding like a DreamWorks
  • 12:44 - 12:50
    executive talking to a CGI animator:
    "Tell me more about this talking pineapple."
  • 12:50 - 12:53
    (Reporter) Students have to answer questions
    about the story, which they say goes like this:
  • 12:53 - 12:58
    A pineapple challenges a hare to a race.
    Other animals figure the fruit has a trick
  • 12:58 - 13:02
    up its sleeve, but the hare wins and the
    animals eat the pineapple. It ends with the
  • 13:02 - 13:05
    moral: Pineapples don't have sleeves.
  • 13:05 - 13:08
    (Student) I was really confused because I
    expected a lot more from them.
  • 13:08 - 13:12
    (Student) That article about the pineapple
    and the hare was stupid and absurd.
  • 13:13 - 13:16
    (Oliver) Yeah, she's not wrong about that
    because we looked up that test section
  • 13:16 - 13:21
    and we couldn't work out all the answers.
    That pineapple item doesn't remotely work
  • 13:21 - 13:29
    as a test question. It barely works as a Doors
    lyric. But, it's not just Pearson's questions
  • 13:29 - 13:32
    that are a problem, it's how they check the
    answers.
  • 13:32 - 13:37
    (Reporter) The company posted this ad to Craig's
    List. It's to find people to grade the exams.
  • 13:37 - 13:42
    (Oliver) Craig's List. They look for scorers on
    Craig's List. Pearson chooses test graders
  • 13:42 - 13:47
    the same way that you'd look for a mattress full
    of bed bugs, or a no-strings-attached hand job.
  • 13:48 - 13:50
    (laughter)
  • 13:51 - 13:57
    And, just to be clear, this is not just a Pearson
    problem. Across the whole testing industry
  • 13:57 - 14:00
    you can find former graders who will tell you
    horror stories.
  • 14:01 - 14:05
    (Scorer) We looked at an essay every two
    minutes. A short answer every five seconds,
  • 14:05 - 14:10
    every ten seconds. We don't understand your
    kids. We don't understand anyone's kids.
  • 14:10 - 14:14
    (Oliver) That is not an acceptable answer
    from a person that may be responsible for
  • 14:14 - 14:19
    the future of your child. It's barely acceptable
    from the manufactures of American Girl Dolls.
  • 14:19 - 14:24
    "Oh, we make dolls for $100 that kids can't
    play with in case they get them dirty. We
  • 14:24 - 14:27
    don't understand your kids, we don't
    understand anyone's kids."
  • 14:28 - 14:33
    As another scorer points out, sometimes
    grades are given out, not based on merit,
  • 14:33 - 14:35
    but on quota.
  • 14:35 - 14:39
    (Scorer) I was told when I was beginning
    a project that last year there was a certain
  • 14:39 - 14:42
    amount of two, a certain amount of three,
    there's a certain amount of fours. We
  • 14:42 - 14:47
    expect that to be similar this year. If that's
    not similar, they will tell you: "You're scoring
  • 14:47 - 14:52
    too many threes. We're scoring too many
    fours." They'll say: "You have to learn to see
  • 14:52 - 14:55
    more papers as a three. You have to learn
    to see more papers as a four."
  • 14:56 - 15:00
    (Oliver) That makes no sense if the content
    of what you're looking at has not changed.
  • 15:00 - 15:03
    That's like telling a baseball umpire: "We've
    got a problem with batting averages, you
  • 15:03 - 15:08
    need to see more home runs as strike-outs,
    and more strike-outs as doubles. Do it now!"
  • 15:08 - 15:12
    And I would love to show you more questions
    from these tests, but unfortunately that's
  • 15:12 - 15:16
    not only difficult, it's often illegal. Because
    both states and companies have fought to
  • 15:16 - 15:20
    keep test questions secret by having
    teachers and students sign statements
  • 15:20 - 15:25
    like: "I will not use or discuss the content
    of secure test materials." And while they'll
  • 15:25 - 15:30
    say this is to protect against cheating, it
    does seem odd that even if you see
  • 15:30 - 15:34
    something wrong on the test, you can't
    tell anyone. Standardized tests basically
  • 15:34 - 15:39
    enforce the rule that all subway riders
    instinctively obey: If you see something,
  • 15:39 - 15:43
    keep it the fuck to yourself, we've all
    seen someone vomit in a purse before.
  • 15:44 - 15:48
    Leave it. Focus ahead, and leave it.
    Bury it.
  • 15:48 - 15:49
    (laughter)
  • 15:49 - 15:54
    Look, we've had more than a decade of
    standardized testing now, and maybe it's
  • 15:54 - 15:59
    time to put the tests to the tests. The
    original goal was to narrow the achievement
  • 15:59 - 16:04
    gap, and boost our scores relative to the
    rest of the world. Well, a 2013 study found
  • 16:04 - 16:07
    no support for the idea that No Child
    Left Behind narrowed the achievement
  • 16:07 - 16:11
    gap, and our scores on the international
    tests have not only failed to rise, they're
  • 16:11 - 16:17
    slightly down. And I do not want to hear
    what that french kid thinks of those results.
  • 16:17 - 16:22
    (French accent) "All this time, and all this
    money, and your rise to the top has been,
  • 16:22 - 16:26
    how you say, a meandering joke on a
    treadmill."
  • 16:27 - 16:29
    (laughter)
  • 16:31 - 16:38
    All of this calls for a little of what both presidents
    asked for when selling their reforms.
  • 16:39 - 16:44
    (Obama) Higher standards are the right goal.
    Accountability is the right goal.
  • 16:45 - 16:50
    (Bush) An accountability system must have
    a consequence, otherwise it's not much of
  • 16:50 - 16:51
    an accountability system.
  • 16:52 - 16:56
    (Oliver) Right, so let's look at that. Because
    as far as I can see, this is a system which
  • 16:56 - 17:00
    has enriched multiple companies and
    that pays and fires teachers with a cattle
  • 17:00 - 17:04
    birthing formula, confuses children with
    talking pineapples, and has the same kind of
  • 17:04 - 17:11
    rules regarding transparency that Brad Pitt had
    for Fight Club. So, for Pearson, the other
  • 17:11 - 17:16
    companies, and all the lawmakers who have
    supported this system, the true test is going
  • 17:16 - 17:21
    to be either convincing everyone that it works,
    or accepting it doesn't work and fixing it.
  • 17:21 - 17:26
    Because, at the risk of sounding like a
    standardized test scorer, your numbers
  • 17:26 - 17:31
    are not good. And if it seems unfair to have
    your fate riding on a complicated metric that
  • 17:31 - 17:35
    fails to take institutional factors into
    account and might not even tell the
  • 17:35 - 17:39
    whole story, well you're not wrong about
    that, but you do not get to complain about
  • 17:39 - 17:43
    it. And if all this pressure to increase
    your numbers is making you feel nauseous
  • 17:43 - 17:49
    like you might vomit at any second, then
    don't worry, I've got four words for you
  • 17:49 - 17:53
    that will make you feel better: Here
    comes the monkey!
  • 17:53 - 17:55
    (Music plays)
  • 17:55 - 17:57
    (cheers)
Title:
Last Week Tonight with John Oliver: Standardized Testing (HBO)
Description:

more » « less
Video Language:
English
Duration:
18:02

English subtitles

Revisions