0:00:00.948,0:00:03.783
Hi. I'm Refik. I'm a media artist.

0:00:03.783,0:00:05.618
I use data as a pigment

0:00:05.618,0:00:07.888
and paint with a thinking brush

0:00:07.888,0:00:10.747
that is assisted[br]by artificial intelligence.

0:00:11.364,0:00:14.250
Using architectural spaces as canvases,

0:00:14.250,0:00:15.818
I collaborate with machines

0:00:15.818,0:00:18.737
to make buildings dream and hallucinate.

0:00:19.037,0:00:21.680
You may be wondering,[br]what does all this mean?

0:00:21.680,0:00:24.632
So let me please take you[br]into my work and my world.

0:00:24.632,0:00:28.453
I witnessed the power of imagination

0:00:28.453,0:00:30.110
when I was eight years old

0:00:30.110,0:00:32.279
as a child growing up in Istanbul.

0:00:32.279,0:00:35.583
One day, my mom brought home[br]a videocassette

0:00:35.583,0:00:38.552
of the science fiction movie[br]"Blade Runner."

0:00:38.552,0:00:41.345
I clearly remember being mesmerized

0:00:41.345,0:00:46.277
by the stunning architectural vision[br]of the future of Los Angeles,

0:00:46.277,0:00:48.697
a place that I had never seen before.

0:00:48.913,0:00:52.368
That vision became a kind of a staple

0:00:52.368,0:00:54.376
of my daydreams.

0:00:54.376,0:00:57.011
When I arrived in LA in 2012

0:00:57.011,0:00:59.914
for a graduate program[br]in design media arts,

0:00:59.914,0:01:02.166
I rented a car and drove downtown

0:01:02.166,0:01:04.675
to see that wonderful world[br]of the near future.

0:01:05.178,0:01:08.431
I remember a specific line[br]that kept playing

0:01:08.431,0:01:10.567
over and over in my head:

0:01:10.567,0:01:14.192
the scene where the android Rachael

0:01:14.192,0:01:16.744
realizes that her memories[br]are actually not hers,

0:01:16.744,0:01:21.198
and when Deckard tells her[br]they are someone else's memories.

0:01:21.198,0:01:22.540
Since that moment,

0:01:22.540,0:01:24.109
one of my inspirations

0:01:24.109,0:01:25.828
has been this question.

0:01:25.828,0:01:30.247
What can a mission do[br]with someone else's memories?

0:01:30.247,0:01:32.973
Or, to say that in another way,

0:01:32.973,0:01:37.010
what does it mean to be an AI[br]in the 21st century?

0:01:37.748,0:01:41.133
Any android or AI mission[br]is only intelligent

0:01:41.133,0:01:43.586
as long as we collaborate with it.

0:01:43.586,0:01:46.354
It can construct things[br]that human intelligence

0:01:46.354,0:01:48.323
intends to produce,

0:01:48.323,0:01:51.325
but does not have the capacity to do so.

0:01:51.325,0:01:54.029
Think about your activities[br]and social networks.

0:01:54.029,0:01:59.039
For example, they get smarter[br]the more you interact with them.

0:01:59.039,0:02:03.593
If machines can learn or process memories,

0:02:03.593,0:02:05.362
can they also dream?

0:02:05.362,0:02:06.768
Hallucinate?

0:02:06.768,0:02:09.438
Involuntarily remember,

0:02:09.438,0:02:10.866
or make connections

0:02:10.866,0:02:13.501
between multiple people streams?

0:02:13.501,0:02:16.995
Does being an AI in the 21st century

0:02:16.995,0:02:20.648
simply mean not forgetting anything?

0:02:20.648,0:02:24.142
And, if so,

0:02:24.142,0:02:25.410
isn't it the most revolutionary thing

0:02:25.410,0:02:28.145
that we have experienced

0:02:28.145,0:02:31.665
in our centuries-long effort[br]to capture history across media?

0:02:31.665,0:02:33.500
In other words,

0:02:33.500,0:02:36.977
how far have we come[br]since we discussed "Blade Runner"?

0:02:36.977,0:02:40.487
So I established my studio in 2014,

0:02:40.487,0:02:42.805
and invited architects,

0:02:42.805,0:02:46.229
computer and data scientists,[br]neuroscientists, musicians

0:02:46.229,0:02:48.075
and even storytellers to join me[br]in realizing my dreams.

0:02:48.075,0:02:54.222
Can data become a pigment?

0:02:54.222,0:02:57.608
This was the very first question we asked

0:02:57.608,0:02:59.243
when starting our journey

0:02:59.243,0:03:01.536
to embed media arts into architecture,

0:03:01.536,0:03:04.838
to collide virtual and physical worlds.

0:03:04.838,0:03:06.907
So we began to imagine

0:03:06.907,0:03:08.208
what I would call

0:03:08.208,0:03:10.294
the politics of data.

0:03:10.486,0:03:13.053
One of our first projects,[br]Virtual Depictions,

0:03:13.053,0:03:15.088
was a public data sculpture piece

0:03:15.088,0:03:17.958
commissioned by the city of San Francisco.

0:03:17.958,0:03:20.042
The work invites the audience

0:03:20.042,0:03:23.487
to be part of a spectacular[br]aesthetic experience

0:03:23.487,0:03:25.087
in a living urban space

0:03:25.087,0:03:30.832
by depicting a ?? network[br]of connections of the city itself.

0:03:30.832,0:03:35.086
It also stands as a reminder[br]of how invisible data

0:03:35.086,0:03:36.739
from our everyday lives,

0:03:36.739,0:03:39.574
like the ?? feeds[br]that are represented here,

0:03:39.574,0:03:42.066
can be made visible

0:03:42.066,0:03:45.335
and transformed into sensory knowledge

0:03:45.335,0:03:48.305
that can be experienced collectively.

0:03:48.839,0:03:52.699
In fact, data can only become knowledge

0:03:52.699,0:03:54.267
when it's experienced,

0:03:54.267,0:03:56.387
and what is knowledge and experience

0:03:56.387,0:03:57.920
can take many forms.

0:03:57.920,0:03:59.727
When exploring such connections

0:03:59.727,0:04:02.832
through the vast potential[br]of machine intelligence,

0:04:03.350,0:04:05.618
we also pondered

0:04:05.618,0:04:09.539
the connection between human senses

0:04:09.539,0:04:13.432
and the machines' capacity[br]for simulating nature.

0:04:13.432,0:04:18.136
These inquiries began while working[br]on wind data paintings.

0:04:18.136,0:04:20.490
They took the shape of visualized plans

0:04:20.490,0:04:23.182
based on hidden data sets

0:04:23.182,0:04:25.884
that we collected from wind sensors.

0:04:25.884,0:04:28.602
We then used generative algorithms

0:04:28.602,0:04:33.031
to transform wind speed,[br]gust and direction

0:04:33.031,0:04:36.367
into an ethereal data pigment.

0:04:36.583,0:04:38.802
The result was a meditative

0:04:38.802,0:04:41.194
yet speculative experience.

0:04:41.561,0:04:44.447
This kinetic data sculpture,[br]titled, "Bosphorus,"

0:04:44.447,0:04:48.451
was a similar attempt to question[br]our capacity to reimagine

0:04:48.451,0:04:50.253
natural occurrences.

0:04:50.253,0:04:55.969
Using high-frequency radar collections[br]of the Marmara Sea,

0:04:55.969,0:04:58.550
we collected sea surface data

0:04:58.550,0:05:02.093
and projected its dynamic movement[br]with machine intelligence.

0:05:02.093,0:05:04.096
We create the sense of immersion

0:05:04.096,0:05:06.831
in a calm yet constantly changing

0:05:06.831,0:05:08.916
synthetic serial.

0:05:09.183,0:05:11.509
Seeing with the brain

0:05:11.509,0:05:13.560
is often called imagination,

0:05:13.560,0:05:16.064
and, for me, imagining architecture

0:05:16.064,0:05:18.348
goes beyond just glass,

0:05:18.348,0:05:20.017
metal or concrete,

0:05:20.017,0:05:24.494
instead experimenting with[br]the furthermost possibilities of immersion

0:05:24.494,0:05:28.381
and ways of augmenting[br]our perception in built environments.

0:05:28.631,0:05:32.308
Research in artificial intelligence[br]is growing every day,

0:05:32.308,0:05:36.012
leaving us with the feeling[br]of being plugged into a system

0:05:36.012,0:05:38.597
that is bigger and more knowledgeable

0:05:38.597,0:05:39.970
than ourselves.

0:05:40.199,0:05:43.776
In 2017, we discovered[br]an open source library

0:05:43.776,0:05:46.362
of cultural documents in Istanbul

0:05:46.362,0:05:49.998
and began working on "Archive Dreaming,"

0:05:49.998,0:05:54.325
one of the first AI-driven[br]public installations in the world,

0:05:54.509,0:06:01.306
an AI exploring approximately[br]1.7 million documents that span 270 years.

0:06:01.888,0:06:04.951
One of our inspirations[br]during this process

0:06:04.951,0:06:08.004
was a short story[br]called "The Library of Babel"

0:06:08.004,0:06:11.656
by the Argentine writer Jorge Luis Borges.

0:06:11.656,0:06:17.052
In the story, the author conceives[br]a universe in the form of a vast library

0:06:17.052,0:06:20.254
containing all possible 410-page books

0:06:20.254,0:06:22.858
of a certain format and character set.

0:06:23.124,0:06:24.815
Through this inspiring image,

0:06:24.815,0:06:27.401
we imagine a way to physically explore

0:06:27.401,0:06:29.503
the vast archives of knowledge

0:06:29.503,0:06:31.788
in the age of machine intelligence.

0:06:32.005,0:06:34.040
The resulting work, as you can see,

0:06:34.040,0:06:36.615
was a user-driven immersive space.

0:06:36.615,0:06:41.838
"Archive Dreaming" profoundly transformed[br]the experience of a library

0:06:41.838,0:06:44.390
in the age of machine intelligence.

0:06:44.557,0:06:48.301
"Machine Hallucination"[br]is an exploration of time and space

0:06:48.301,0:06:50.903
experienced through New York City's

0:06:50.903,0:06:53.005
public photographic archives.

0:06:53.005,0:06:55.481
For this one-of-a-kind immersive project,

0:06:55.481,0:06:58.250
we deployed machine-learning algorithms

0:06:58.250,0:07:02.321
to find and process over[br]100 million photographs of the city.

0:07:03.188,0:07:06.214
We designed an innovative narrative system

0:07:06.214,0:07:12.536
to use artificial intelligence[br]to predict or to hallucinate new images,

0:07:12.536,0:07:16.246
allowing the viewer to step[br]into a dreamlike fusion

0:07:16.246,0:07:18.666
of past and future New York.

0:07:20.067,0:07:25.578
As our projects delve deeper into[br]remembering and transmitting knowledge,

0:07:25.578,0:07:28.582
we thought more about how memories

0:07:28.582,0:07:30.532
were not static recollections

0:07:30.532,0:07:34.369
but ever-changing[br]interpretations of past events.

0:07:34.369,0:07:36.645
We pondered how machines

0:07:36.645,0:07:40.282
could simulate unconscious[br]and subconscious events

0:07:40.282,0:07:41.951
such as dreaming,

0:07:41.951,0:07:43.300
remembering

0:07:43.300,0:07:46.028
and hallucinating.

0:07:46.028,0:07:48.296
Thus we created "Melting Memories"

0:07:48.296,0:07:51.282
to visualize the moment of remembering.

0:07:51.282,0:07:54.869
The inspiration came from a tragic event

0:07:54.875,0:07:58.962
when I found out that my uncle[br]was diagnosed with Alzheimer's.

0:07:58.962,0:08:02.282
At that time, all I could think about

0:08:02.282,0:08:04.734
was to find a way to celebrate

0:08:04.734,0:08:07.429
how and what he remembered

0:08:07.429,0:08:09.446
when we are still able to do so.

0:08:09.446,0:08:11.911
I began to think of memories

0:08:11.911,0:08:13.500
not as disappearing

0:08:13.500,0:08:15.101
but as melting

0:08:15.101,0:08:16.508
or changing shape.

0:08:16.508,0:08:18.377
With the help of machine intelligence,

0:08:18.377,0:08:21.580
we worked with the scientists[br]at the Neuroscape Laboratory

0:08:21.864,0:08:23.883
at the University of California,

0:08:23.883,0:08:29.444
who showed us how to understand[br]brain signals as memories are made.

0:08:29.444,0:08:34.048
Although my own uncle was losing[br]the ability to process memories,

0:08:34.048,0:08:37.108
the artwork generated by the EEG data

0:08:37.392,0:08:41.128
explored the materiality of remembering

0:08:41.128,0:08:43.931
and stood as a tribute

0:08:43.931,0:08:47.190
to what my uncle had lost.

0:08:47.190,0:08:51.611
Almost nothing about contemporary LA

0:08:51.611,0:08:54.197
matched my childhood expectation

0:08:54.197,0:08:55.538
of the city,

0:08:55.538,0:08:58.692
with the exception[br]of one amazing building:

0:08:58.692,0:09:02.311
the Walt Disney Concert Hall,[br]designed by Frank Gehry,

0:09:02.311,0:09:04.380
one of my all-time heroes.

0:09:04.380,0:09:07.589
In 2018, I had a call[br]from the LA Philharmonic

0:09:07.589,0:09:09.624
who was looking for an installation

0:09:09.624,0:09:13.677
to help mark the celebrated symphony's[br]hundredth year anniversary.

0:09:13.909,0:09:16.988
For this, we decided to ask the question,

0:09:16.988,0:09:20.074
can a build learn? Can it dream?

0:09:20.825,0:09:22.025
To answer this question,

0:09:22.025,0:09:25.402
we decided to collect everything recorded

0:09:25.402,0:09:27.923
in the archives of the LA field and WHC,

0:09:27.923,0:09:32.811
to be precise, 77 terabytes[br]of digitally archived memories.

0:09:32.811,0:09:35.097
By using machine intelligence,

0:09:35.097,0:09:38.433
the entire archive going back 100 years

0:09:38.433,0:09:41.319
became projections on the building's skin,

0:09:41.319,0:09:45.412
42 projectors to achieve[br]this futuristic public experience

0:09:45.412,0:09:47.664
in the heart of Los Angeles,

0:09:47.664,0:09:52.342
getting one step closer[br]to the LA of "Blade Runner."

0:09:52.342,0:09:54.761
If ever a building could dream,

0:09:54.761,0:09:56.829
it was in this moment.

0:10:00.049,0:10:03.292
Now, I am inviting you to one last journey

0:10:03.292,0:10:05.795
into the mind of a machine.

0:10:05.795,0:10:09.365
Right now, we are fully immersed[br]in the data universe

0:10:09.365,0:10:12.091
of every single created TED Talk

0:10:12.091,0:10:14.092
from the past 30 years.

0:10:14.092,0:10:20.565
That means, this data set includes[br]7,705 talks from the TED stage.

0:10:21.433,0:10:23.641
Those talks have been translated

0:10:23.641,0:10:25.843
into 7.4 million seconds,

0:10:25.843,0:10:30.093
and each second is represented[br]here in this data universe.

0:10:30.093,0:10:32.259
Every image that you are seeing in here

0:10:32.259,0:10:35.228
represents unique moments[br]from those talks.

0:10:35.228,0:10:37.221
By using machine intelligence,

0:10:37.221,0:10:41.407
we processed a total of 487,000 sentences

0:10:41.407,0:10:45.819
into 330 unique clusters of topics[br]like nature, global emissions,

0:10:45.819,0:10:47.620
extinction, race issues,

0:10:47.620,0:10:49.105
computation,

0:10:49.105,0:10:52.758
trust, emotions, water and refugees.

0:10:52.758,0:10:55.630
These clusters are then[br]connected to each other

0:10:55.630,0:10:56.784
by an algorithm,

0:10:56.784,0:11:00.950
and generated 113 million line segments,

0:11:00.950,0:11:03.910
which revealed new[br]conceptual relationships.

0:11:03.910,0:11:06.064
Wouldn't it be amazing

0:11:06.064,0:11:07.381
to be able to remember

0:11:07.381,0:11:10.450
all the questions that have ever[br]been asked on the stage?

0:11:11.758,0:11:13.126
Here I am,

0:11:13.126,0:11:16.011
inside the mind[br]of countless great thinkers,

0:11:16.011,0:11:17.629
as well as a machine

0:11:17.629,0:11:20.032
interacting with various feelings

0:11:20.032,0:11:22.241
attributed to learning,

0:11:22.241,0:11:23.325
remembering,

0:11:23.325,0:11:24.460
questioning

0:11:24.460,0:11:27.213
and imagining all at the same time,

0:11:27.529,0:11:30.882
expanding the power of the mind.

0:11:31.198,0:11:33.691
For me, being right here

0:11:33.691,0:11:38.113
is indeed what it means[br]to be an AI in the 21st century.

0:11:38.113,0:11:40.515
It is in our hands, humans,

0:11:40.515,0:11:44.141
to train this mind to learn and remember

0:11:44.141,0:11:46.994
what we can only dream of.

0:11:46.994,0:11:48.362
Thank you.