How frustration can make us more creative

Challenges and problems can derail your creative process ... or they can make you more creative than ever. In the surprising story behind the best-selling solo piano album of all time, Tim Harford may just convince you of the advantages of having to work with a little mess.

Late in January 1975,

a 17-year-old German girl
called Vera Brandes

walked out onto the stage
of the Cologne Opera House.

The auditorium was empty.

It was lit only by the dim, green glow
of the emergency exit sign.

This was the most
exciting day of Vera's life.

She was the youngest
concert promoter in Germany,

and she had persuaded
the Cologne Opera House

to host a late-night concert of jazz

from the American musician, Keith Jarrett.

1,400 people were coming.

And in just a few hours,

Jarrett would walk out on the same stage,

he'd sit down at the piano

and without rehearsal or sheet music,

he would begin to play.

But right now,

Vera was introducing Keith
to the piano in question,

and it wasn't going well.

Jarrett looked to the instrument
a little warily,

played a few notes,

walked around it,

played a few more notes,

muttered something to his producer.

Then the producer
came over to Vera and said ...

"If you don't get a new piano,
Keith can't play."

There'd been a mistake.

The opera house had provided
the wrong instrument.

This one had this harsh,
tinny upper register,

because all the felt had worn away.

The black notes were sticking,

the white notes were out of tune,

the pedals didn't work

and the piano itself was just too small.

It wouldn't create the volume

that would fill a large space
such as the Cologne Opera House.

So Keith Jarrett left.

He went and sat outside in his car,

leaving Vera Brandes

to get on the phone
to try to find a replacement piano.

Now she got a piano tuner,

but she couldn't get a new piano.

And so she went outside

and she stood there in the rain,

talking to Keith Jarrett,

begging him not to cancel the concert.

And he looked out of his car

at this bedraggled,
rain-drenched German teenager,

took pity on her,

and said,

"Never forget ... only for you."

And so a few hours later,

Jarrett did indeed step out
onto the stage of the opera house,

he sat down at the unplayable piano

and began.

(Music)

Within moments it became clear
that something magical was happening.

Jarrett was avoiding
those upper registers,

he was sticking to the middle
tones of the keyboard,

which gave the piece
a soothing, ambient quality.

But also, because the piano was so quiet,

he had to set up these rumbling,
repetitive riffs in the bass.

And he stood up twisting,
pounding down on the keys,

desperately trying to create enough volume
to reach the people in the back row.

It's an electrifying performance.

It somehow has this peaceful quality,

and at the same time it's full of energy,

it's dynamic.

And the audience loved it.

Audiences continue to love it

because the recording of the Köln Concert

is the best-selling piano album in history

and the best-selling
solo jazz album in history.

Keith Jarrett had been handed a mess.

He had embraced that mess, and it soared.

But let's think for a moment
about Jarrett's initial instinct.

He didn't want to play.

Of course,

I think any of us,
in any remotely similar situation,

would feel the same way,
we'd have the same instinct.

We don't want to be asked
to do good work with bad tools.

We don't want to have to overcome
unnecessary hurdles.

But Jarrett's instinct was wrong,

and thank goodness he changed his mind.

And I think our instinct is also wrong.

I think we need to gain
a bit more appreciation

for the unexpected advantages
of having to cope with a little mess.

So let me give you some examples

from cognitive psychology,

from complexity science,

from social psychology,

and of course, rock 'n' roll.

So cognitive psychology first.

We've actually known for a while

that certain kinds of difficulty,

certain kinds of obstacle,

can actually improve our performance.

For example,

the psychologist Daniel Oppenheimer,

a few years ago,

teamed up with high school teachers.

And he asked them to reformat the handouts

that they were giving
to some of their classes.

So the regular handout would be formatted
in something straightforward,

such as Helvetica or Times New Roman.

But half these classes were getting
handouts that were formatted

in something sort of intense,
like Haettenschweiler,

or something with a zesty bounce,
like Comic Sans italicized.

Now, these are really ugly fonts,

and they're difficult fonts to read.

But at the end of the semester,

students were given exams,

and the students who'd been asked
to read the more difficult fonts,

had actually done better on their exams,

in a variety of subjects.

And the reason is,

the difficult font had slowed them down,

forced them to work a bit harder,

to think a bit more
about what they were reading,

to interpret it ...

and so they learned more.

Another example.

The psychologist Shelley Carson
has been testing Harvard undergraduates

for the quality
of their attentional filters.

What do I mean by that?

What I mean is,
imagine you're in a restaurant,

you're having a conversation,

there are all kinds of other conversations
going on in the restaurant,

you want to filter them out,

you want to focus
on what's important to you.

Can you do that?

If you can, you have
good, strong attentional filters.

But some people really struggle with that.

Some of Carson's undergraduate
subjects struggled with that.

They had weak filters,
they had porous filters --

let a lot of external information in.

And so what that meant is they were
constantly being interrupted

by the sights and the sounds
of the world around them.

If there was a television on
while they were doing their essays,

they couldn't screen it out.

Now, you would think
that that was a disadvantage ...

but no.

When Carson looked at what
these students had achieved,

the ones with the weak filters

were vastly more likely

to have some real
creative milestone in their lives,

to have published their first novel,

to have released their first album.

These distractions were actually
grists to their creative mill.

They were able to think outside the box
because their box was full of holes.

Let's talk about complexity science.

So how do you solve a really complex --

the world's full
of complicated problems --

how do you solve
a really complicated problem?

For example, you try to make a jet engine.

There are lots and lots
of different variables,

the operating temperature, the materials,

all the different dimensions, the shape.

You can't solve that kind
of problem all in one go,

it's too hard.

So what do you do?

Well, one thing you can do
is try to solve it step-by-step.

So you have some kind of prototype

and you tweak it,
you test it, you improve it.

You tweak it, you test it, you improve it.

Now, this idea of marginal gains
will eventually get you a good jet engine.

And it's been quite widely
implemented in the world.

So you'll hear about it, for example,
in high performance cycling,

web designers will talk about trying
to optimize their web pages,

they're looking
for these step-by-step gains.

That's a good way
to solve a complicated problem.

But you know what would
make it a better way?

A dash of mess.

You add randomness,

early on in the process,

you make crazy moves,

you try stupid things that shouldn't work,

and that will tend to make
the problem-solving work better.

And the reason for that is

the trouble with the step-by-step process,

the marginal gains,

is they can walk you
gradually down a dead end.

And if you start with the randomness,
that becomes less likely,

and your problem-solving
becomes more robust.

Let's talk about social psychology.

So the psychologist Katherine Phillips,
with some colleagues,

recently gave murder mystery
problems to some students,

and these students
were collected in groups of four

and they were given dossiers
with information about a crime --

alibis and evidence,
witness statements and three suspects.

And the groups of four students
were asked to figure out who did it,

who committed the crime.

And there were two treatments
in this experiment.

In some cases these were four friends,

they all knew each other well.

In other cases,

three friends and a stranger.

And you can see where I'm going with this.

Obviously I'm going to say

that the groups with the stranger
solved the problem more effectively,

which is true, they did.

Actually, they solved the problem
quite a lot more effectively.

So the groups of four friends,

they only had a 50-50 chance
of getting the answer right.

Which is actually not that great --

in multiple choice, for three answers?
50-50's not good.

(Laughter)

The three friends and the stranger,

even though the stranger
didn't have any extra information,

even though it was just a case

of how that changed the conversation
to accommodate that awkwardness,

the three friends and the stranger,

they had a 75 percent chance
of finding the right answer.

That's quite a big leap in performance.

But I think what's really interesting

is not just that the three friends
and the stranger did a better job,

but how they felt about it.

So when Katherine Phillips
interviewed the groups of four friends,

they had a nice time,

they also thought they'd done a good job.

They were complacent.

When she spoke to the three
friends and the stranger,

they had not had a nice time --

it's actually rather difficult,
it's rather awkward ...

and they were full of doubt.

They didn't think they'd done a good job
even though they had.

And I think that really exemplifies

the challenge that we're
dealing with here.

Because, yeah --

the ugly font,

the awkward stranger,

the random move ...

these disruptions help us solve problems,

they help us become more creative.

But we don't feel that they're helping us.

We feel that they're
getting in the way ...

and so we resist.

And that's why the last example
is really important.

So I want to talk about somebody

from the background
of the world of rock 'n' roll.

And you may know him,
he's actually a TED-ster.

His name is Brian Eno.

He is an ambient composer --
rather brilliant.

He's also a kind of catalyst

behind some of the great
rock 'n' roll albums of the last 40 years.

He's worked with David Bowie on "Heroes,"

he worked with U2 on "Achtung Baby"
and "The Joshua Tree,"

he's worked with DEVO,

he's worked with Coldplay,
he's worked with everybody.

And what does he do to make
these great rock bands better?

Well, he makes a mess.

He disrupts their creative processes.

It's his role to be the awkward stranger.

It's his role to tell them

that they have to play
the unplayable piano.

And one of the ways
in which he creates this disruption

is through this remarkable
deck of cards --

I have my signed copy here --
thank you, Brian.

They're called The Oblique Strategies,

he developed them with a friend of his.

And when they're stuck in the studio,

Brian Eno will reach for one of the cards.

He'll draw one at random,

and he'll make the band
follow the instructions on the card.

So this one ...

"Change instrument roles."

Yeah, everyone swap instruments --
Drummer on the piano --

Brilliant, brilliant idea.

"Look closely at the most
embarrassing details. Amplify them."

"Make a sudden, destructive,
unpredictable action. Incorporate."

These cards are disruptive.

Now, they've proved their worth
in album after album.

The musicians hate them.

(Laughter)

So Phil Collins was playing drums
on an early Brian Eno album.

He got so frustrated he started
throwing beer cans across the studio.

Carlos Alomar, great rock guitarist,

working with Eno
on David Bowie's "Lodger" album,

and at one point
he turns to Brian and says,

"Brian, this experiment is stupid."

But the thing is
it was a pretty good album,

but also,

Carlos Alomar, 35 years later,
now uses The Oblique Strategies.

And he tells his students
to use The Oblique Strategies

because he's realized something.

Just because you don't like it
doesn't mean it isn't helping you.

The strategies actually
weren't a deck of cards originally,

they were just a list --

list on the recording studio wall.

A checklist of things
you might try if you got stuck.

The list didn't work.

Know why?

Not messy enough.

Your eye would go down the list

and it would settle on whatever
was the least disruptive,

the least troublesome,

which of course misses the point entirely.

And what Brian Eno came to realize was,

yes, we need to run
the stupid experiments,

we need to deal
with the awkward strangers,

we need to try to read the ugly fonts.

These things help us.

They help us solve problems,

they help us be more creative.

But also ...

we really need some persuasion
if we're going to accept this.

So however we do it ...

whether it's sheer willpower,

whether it's the flip of a card

or whether it's a guilt trip
from a German teenager,

all of us, from time to time,

need to sit down and try and play
the unplayable piano.

Thank you.

(Applause)