< Return to Video

Can a computer write poetry?

  • 0:01 - 0:04
    I have a question:
  • 0:04 - 0:07
    Can a computer write poetry?
  • 0:07 - 0:10
    This is a provocative question.
  • 0:10 - 0:12
    You think about it for a minute,
  • 0:12 - 0:15
    and you suddenly have a bunch
    of other questions like:
  • 0:15 - 0:17
    What is a computer?
  • 0:17 - 0:19
    What is poetry?
  • 0:19 - 0:22
    What is creativity?
  • 0:22 - 0:23
    But these are questions that people
  • 0:23 - 0:26
    spend their entire lifetime
    trying to answer,
  • 0:26 - 0:28
    not in a single TED Talk.
  • 0:28 - 0:31
    So we're going to have to try
    a different approach.
  • 0:31 - 0:34
    So up here, we have two poems.
  • 0:34 - 0:36
    One of them is written by a human,
  • 0:36 - 0:39
    and the other one's
    written by a computer.
  • 0:39 - 0:42
    I'm going to ask you to tell me
    which one's which.
  • 0:42 - 0:44
    Have a go:
  • 0:57 - 1:00
    Alright, time's up.
  • 1:00 - 1:04
    Hands up if you think Poem 1
    was written by a human.
  • 1:06 - 1:07
    Okay, most of you.
  • 1:07 - 1:12
    Hands up if you think Poem 2
    was written by a human.
  • 1:12 - 1:13
    Very brave of you,
  • 1:13 - 1:18
    because the first one was written
    by the human poet William Blake.
  • 1:18 - 1:21
    The second one was written
    by an algorithm
  • 1:21 - 1:25
    that took all the language
    from my Facebook feed one day
  • 1:25 - 1:28
    and then regenerated it algorithmically
  • 1:28 - 1:32
    according to methods that I'll describe
    a little bit later on.
  • 1:32 - 1:35
    So let's try another test.
  • 1:35 - 1:37
    Again, you haven't got ages to read this,
  • 1:37 - 1:40
    so just trust your gut.
  • 1:58 - 2:00
    Alright , time's up.
  • 2:00 - 2:04
    So if you think the first poem
    was written by a human,
  • 2:04 - 2:06
    put your hand up.
  • 2:06 - 2:07
    Okay.
  • 2:07 - 2:10
    And if you think the second poem
    was written by a human,
  • 2:10 - 2:12
    put your hand up.
  • 2:12 - 2:17
    We have, more or less,
    a 50/50 split here.
  • 2:17 - 2:18
    It was much harder.
  • 2:18 - 2:20
    The answer is,
  • 2:20 - 2:23
    the first poem was generated
    by an algorithm called RACTER
  • 2:23 - 2:26
    that was created back in the 1970s,
  • 2:26 - 2:29
    and the second poem was written
    by a guy called Frank O'Hara,
  • 2:29 - 2:33
    who happens to be one
    of my favorite human poets.
  • 2:33 - 2:36
    (Laughter)
  • 2:36 - 2:40
    So what we've just done now
    is a Turing Test for poetry.
  • 2:40 - 2:44
    The Turing Test was first proposed
    by this guy, Alan Turing, in 1950
  • 2:44 - 2:46
    in order to answer the question,
  • 2:46 - 2:48
    can computers think?
  • 2:48 - 2:51
    Alan Turing believed that if
    a computer was able
  • 2:51 - 2:55
    to have a to have a text-based
    conversation with a human,
  • 2:55 - 2:58
    with such proficiency
    such that the human couldn't tell
  • 2:58 - 3:00
    whether they are talking
    to a computer or a human,
  • 3:00 - 3:03
    then the computer can be said
    to have intelligence.
  • 3:03 - 3:07
    So in 2013, my friend
    Benjamin Laird and I,
  • 3:07 - 3:10
    we created a Turing Test
    for poetry online.
  • 3:10 - 3:11
    It's called Bot or Not,
  • 3:11 - 3:13
    and you can go and play it
    for yourselves.
  • 3:13 - 3:15
    But basically, it's the game
    we just played.
  • 3:15 - 3:19
    You're presented with a poem,
    you don't know whether it was written
  • 3:19 - 3:21
    by a human or a computer
    and you have to guess.
  • 3:21 - 3:24
    So thousands and thousands
    of people have taken this test online,
  • 3:24 - 3:26
    so we have results.
  • 3:26 - 3:28
    And what are the results?
  • 3:28 - 3:31
    Well, Turing said that if
    a computer could fool a human
  • 3:31 - 3:34
    30 percent of the time
    that it was a human,
  • 3:34 - 3:37
    then it passes the Turing Test
    for intelligence.
  • 3:37 - 3:39
    We have poems on
    the Bot or Not database
  • 3:39 - 3:42
    that have fooled 65 percent
    of human readers into thinking
  • 3:42 - 3:44
    it was written by a human.
  • 3:44 - 3:48
    So, I think we have an answer
    to our question.
  • 3:48 - 3:50
    According to the logic
    of the Turing Test,
  • 3:50 - 3:52
    can a computer write poetry?
  • 3:52 - 3:56
    Well yes, absolutely it can.
  • 3:56 - 3:59
    But if you're feeling
    a little bit uncomfortable
  • 3:59 - 4:00
    with this answer, that's okay.
  • 4:00 - 4:03
    If you're having a bunch
    of gut reactions to it,
  • 4:03 - 4:07
    that's also okay because
    this isn't the end of the story.
  • 4:07 - 4:10
    Let's play our third and final test.
  • 4:10 - 4:12
    Again, you're going to have to read
  • 4:12 - 4:15
    and tell me which you think is human.
  • 4:32 - 4:35
    Okay, time is up.
  • 4:35 - 4:38
    So hands up if you think Poem 1
    was written by a human.
  • 4:40 - 4:43
    Hands up if you think Poem 2
    was written by a human.
  • 4:43 - 4:47
    Woah, that's a lot more people.
  • 4:47 - 4:49
    So you'd be surprised
    to find that Poem 1
  • 4:49 - 4:54
    was written by the very human poet
    Gertrude Stein.
  • 4:54 - 5:00
    And Poem 2 was generated
    by an algorithm called RKCP.
  • 5:00 - 5:03
    Now before we go on, let me describe,
    very quickly and simply,
  • 5:03 - 5:05
    how RKCP works.
  • 5:05 - 5:09
    So RKCP is an algorithm
    designed by Ray Kurzweil,
  • 5:09 - 5:11
    who's a director of engineering at Google
  • 5:11 - 5:14
    and a firm believer in
    artificial intelligence.
  • 5:14 - 5:18
    So, you give RKCP a source text,
  • 5:18 - 5:20
    it analyzes the source text
  • 5:20 - 5:23
    in order to find out how it
    uses language,
  • 5:23 - 5:25
    and then it regenerates language
  • 5:25 - 5:27
    that emulates that first text.
  • 5:27 - 5:29
    So in the poem we just saw before,
  • 5:29 - 5:32
    Poem 2, the one that you all
    thought was human,
  • 5:32 - 5:33
    it was fed a bunch of poems
  • 5:33 - 5:36
    by a poet called Emily Dickinson
  • 5:36 - 5:38
    and looked at the way she used language,
  • 5:38 - 5:39
    learned the model,
  • 5:39 - 5:43
    and then it regenerated a model
    according to that same structure.
  • 5:45 - 5:47
    But the important thing to know
    about RKCP
  • 5:47 - 5:51
    is that it doesn't know the meaning
    of the words it's using.
  • 5:51 - 5:53
    The language is just raw material,
  • 5:53 - 5:55
    it could be Chinese,
    it could be in Swedish,
  • 5:55 - 5:59
    it could be the collected language
    from your Facebook feed for one day.
  • 5:59 - 6:02
    It's just raw material.
  • 6:02 - 6:04
    And nevertheless, it's able
    to create a poem
  • 6:04 - 6:08
    that seems more human
    than Gertrude Stein's poem,
  • 6:08 - 6:11
    and Gertrude Stein is a human.
  • 6:11 - 6:16
    So what we've done here is,
    more or less, a reverse Turing Test.
  • 6:16 - 6:20
    So Gertrude Stein, who's a human,
  • 6:20 - 6:25
    is able to write a poem that fools
    a majority of human judges
  • 6:25 - 6:28
    into thinking that it was written
    by a computer.
  • 6:28 - 6:32
    Therefore, according to the logic
    of the reverse Turing Test,
  • 6:32 - 6:34
    Gertrude Stein is a computer.
  • 6:34 - 6:36
    (Laughter)
  • 6:36 - 6:37
    Feeling confused?
  • 6:37 - 6:40
    I think that's fair enough.
  • 6:40 - 6:43
    So far we've had humans
    that write like humans,
  • 6:43 - 6:47
    we have computers that write
    like computers,
  • 6:47 - 6:50
    we have computers that
    write like humans,
  • 6:50 - 6:54
    but we also have,
    perhaps most confusingly,
  • 6:54 - 6:57
    humans that write like computers.
  • 6:57 - 7:00
    So what do we take from all of this?
  • 7:00 - 7:03
    Do we take that William Blake
    is somehow more of a human
  • 7:03 - 7:04
    than Gertrude Stein?
  • 7:04 - 7:07
    Or that Gertrude Stein is more
    of a computer than William Blake?
  • 7:07 - 7:09
    (Laughter)
  • 7:09 - 7:11
    These are questions I've been
    asking myself
  • 7:11 - 7:13
    for around two years now,
  • 7:13 - 7:15
    and I don't have any answers.
  • 7:15 - 7:17
    But what I do have
    are a bunch of insights
  • 7:17 - 7:21
    about our relationship with technology.
  • 7:21 - 7:24
    So my first insight is that
  • 7:24 - 7:29
    for some reason we associate
    poetry with being human,
  • 7:29 - 7:32
    so that when we ask,
    "Can a computer write poetry?",
  • 7:32 - 7:33
    we're also asking,
  • 7:33 - 7:35
    "What does it mean to be human
  • 7:35 - 7:38
    and how do we put boundaries
    around this category?"
  • 7:38 - 7:43
    How do we say who or what
    can be part of this category?
  • 7:43 - 7:46
    This is an essentially
    philosophical question, I believe,
  • 7:46 - 7:48
    and it can't be answered
    with a Yes or No test
  • 7:48 - 7:50
    like the Turing Test.
  • 7:50 - 7:53
    I also believe that Alan Turing
    understood this
  • 7:53 - 7:56
    and that when he devised
    his test back in 1950,
  • 7:56 - 8:01
    he was doing it as
    a philosophical provocation.
  • 8:01 - 8:07
    So my second insight is that
    when we take the Turing Test for poetry,
  • 8:07 - 8:10
    we're not really testing
    the capacity of the computers
  • 8:10 - 8:13
    because poetry-generating algorithms,
  • 8:13 - 8:15
    they're pretty simple
  • 8:15 - 8:18
    and have existed, more or less,
    since the 1950s.
  • 8:19 - 8:22
    What we are doing with the Turing Test
    for poetry, rather,
  • 8:22 - 8:28
    is collecting opinions about what
    constitutes humaness.
  • 8:28 - 8:31
    So, what I've figured out,
  • 8:31 - 8:34
    we've seen this when
    earlier today,
  • 8:34 - 8:37
    we say that William Blake
    is more of a human
  • 8:37 - 8:38
    than Gertrude Stein.
  • 8:38 - 8:41
    Of course, this doesn't mean
    that William Blake
  • 8:41 - 8:43
    was actually more human
  • 8:43 - 8:46
    or that Gertrude Stein
    was more of a computer.
  • 8:46 - 8:51
    It simply means that the
    category of the human is unstable.
  • 8:51 - 8:54
    This has led me to understand
    that the human
  • 8:54 - 8:57
    is not a cold, hard fact.
  • 8:57 - 9:00
    Rather, it is something that's
    constructed with our opinions
  • 9:00 - 9:04
    and something that changes overtime.
  • 9:04 - 9:09
    So my final insight is that
    the computer, more or less,
  • 9:09 - 9:13
    works like a mirror
    that reflects any idea of a human
  • 9:13 - 9:15
    that we show it.
  • 9:15 - 9:17
    We show it Emily Dickinson,
  • 9:17 - 9:20
    it gives Emily Dickinson
    back to us.
  • 9:20 - 9:22
    We show it William Blake,
  • 9:22 - 9:24
    that's what it reflects back to us.
  • 9:24 - 9:26
    We show it Gertrude Stein,
  • 9:26 - 9:29
    what we get back is Gertrude Stein.
  • 9:29 - 9:32
    More than any other bit of technology,
  • 9:32 - 9:37
    the computer is a mirror that reflects
    any idea of the human we teach it.
  • 9:38 - 9:41
    So I'm sure a lot of you
    have been hearing about
  • 9:41 - 9:45
    artificial intelligence recently.
  • 9:45 - 9:51
    And much of the conversation is,
    can we build it?
  • 9:51 - 9:54
    Can we build an intelligent computer,
  • 9:54 - 9:57
    can we build a creative computer?
  • 9:57 - 9:59
    What we seem to be asking
    over and over
  • 9:59 - 10:02
    is can we build a human-like computer?
  • 10:02 - 10:04
    But what we've seen just now
  • 10:04 - 10:07
    is that a human is not a scientific fact,
  • 10:07 - 10:10
    that it's an ever-shifting,
    concatenating idea
  • 10:10 - 10:13
    and one that changes over time.
  • 10:13 - 10:16
    So that when we begin
    to grapple with the ideas
  • 10:16 - 10:19
    of artificial intelligence in the future,
  • 10:19 - 10:22
    we shouldn't only be asking ourselves,
    "Can we build it?"
  • 10:22 - 10:24
    But we should also be asking ourselves,
  • 10:24 - 10:28
    "What idea of the human
    do we want to have reflected back to us?"
  • 10:28 - 10:31
    This is an essentially philosophical idea,
  • 10:31 - 10:34
    and it's one that can't be answered
    with software alone,
  • 10:34 - 10:39
    but I think requires a moment
    of species-wide, existential reflection.
  • 10:39 - 10:40
    Thank you.
  • 10:40 - 10:43
    (Applause)
Title:
Can a computer write poetry?
Speaker:
Oscar Schwartz
Description:

more » « less
Video Language:
English
Team:
closed TED
Project:
TEDTalks
Duration:
10:56
  • Just a question:
    shouldn't the subtitles for the poems be written between square brackets since they are shown in slides and not spoken?

    Thank you!

  • A typo at 04:13 It should read "Red" instead of "Reg"

English subtitles

Revisions Compare revisions