[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:00.30,0:00:05.61,Default,,0000,0000,0000,,Herald: Hello, and welcome back to the FM-\Nchannel. Our next speaker is Kai Konsa.
Dialogue: 0,0:00:05.61,0:00:11.34,Default,,0000,0000,0000,,He's a professor at the Graduate School of\NMedia Design at Cairo University Japan.
Dialogue: 0,0:00:11.34,0:00:15.87,Default,,0000,0000,0000,,His talk will be about focus on Wirfs.\NFrom what I understood is that it's about
Dialogue: 0,0:00:15.87,0:00:20.93,Default,,0000,0000,0000,,shivers and goosebumps in media\Nperformances that are usually spontaneous.
Dialogue: 0,0:00:20.93,0:00:27.14,Default,,0000,0000,0000,,But somehow he and his team managed to\Ninduce them artificially. But I'm very
Dialogue: 0,0:00:27.14,0:00:33.56,Default,,0000,0000,0000,,forward. I'm looking very forward to this\Ntalk as I don't really understand it. But
Dialogue: 0,0:00:33.56,0:00:40.52,Default,,0000,0000,0000,,now, if you want to ask questions in the\Nend, RC at the Channel rc3-fm in the
Dialogue: 0,0:00:40.52,0:00:46.13,Default,,0000,0000,0000,,rocket chat at the Channel FM and on\NTwitter, and the videos and the hashtag
Dialogue: 0,0:00:46.13,0:00:51.21,Default,,0000,0000,0000,,3FM without the Dash, you can ask\Nquestions that will be answered in the Q&A
Dialogue: 0,0:00:51.21,0:00:53.79,Default,,0000,0000,0000,,session afterwards.\N*repated but on english*
Dialogue: 0,0:00:53.79,0:00:58.59,Default,,0000,0000,0000,,Allardyce parking Seotioa your current\Nidea that some 200 images of a player for
Dialogue: 0,0:00:58.59,0:01:04.83,Default,,0000,0000,0000,,native of translated and that and now I'm\Nlooking forward to a hopefully very
Dialogue: 0,0:01:04.83,0:01:09.77,Default,,0000,0000,0000,,interesting talk.\NKonsa: Hello and welcome to my talk
Dialogue: 0,0:01:09.77,0:01:16.63,Default,,0000,0000,0000,,"Frisson Waves", augmenting esthetic\Nchills in classical music performances.
Dialogue: 0,0:01:16.63,0:01:25.83,Default,,0000,0000,0000,,This is conceptual, early research work\Nfrom collaboration of a lot of artists,
Dialogue: 0,0:01:25.83,0:01:33.80,Default,,0000,0000,0000,,designers, researchers, and I'm just\Nspeaker to introduce it to you a little
Dialogue: 0,0:01:33.80,0:01:39.73,Default,,0000,0000,0000,,bit. My name is Kai. And in the next 20\Nminutes, I will talk to you a little bit
Dialogue: 0,0:01:39.73,0:01:46.58,Default,,0000,0000,0000,,about what is Frisson. Give you a bit of\Nmotivation and background information, why
Dialogue: 0,0:01:46.58,0:01:55.32,Default,,0000,0000,0000,,we are interested in this feeling. And\Nthen I will talk about how can we
Dialogue: 0,0:01:55.32,0:02:03.38,Default,,0000,0000,0000,,recognize into youth and also share\NFrisson. And then at the end, I'll talk
Dialogue: 0,0:02:03.38,0:02:11.62,Default,,0000,0000,0000,,about some conclusion and a little bit of\Noutlook. So the question is, what is
Dialogue: 0,0:02:11.62,0:02:18.48,Default,,0000,0000,0000,,Frisson? You might not have heard the\Nterm, I actually haven't heard Frisson
Dialogue: 0,0:02:18.48,0:02:25.84,Default,,0000,0000,0000,,before we started the research. Two and a\Nhalf years, three years ago. But I
Dialogue: 0,0:02:25.84,0:02:31.85,Default,,0000,0000,0000,,definitely knew the feeling. So if you're\Nlistening attentively to a musical piece,
Dialogue: 0,0:02:31.85,0:02:39.48,Default,,0000,0000,0000,,sometimes you might get goose bumps or\Nsome shiver down your spine. And that is
Dialogue: 0,0:02:39.48,0:02:46.65,Default,,0000,0000,0000,,usually triggered from the music. Frisson\Nis from the French shivers and sorry, my
Dialogue: 0,0:02:46.65,0:02:55.80,Default,,0000,0000,0000,,pronunciation with the German accent. So\Nyou applied for that, I hope. And it's
Dialogue: 0,0:02:55.80,0:03:01.85,Default,,0000,0000,0000,,this psycho physiological phenomenon, that\Nwe feel when we get these goose bumps or
Dialogue: 0,0:03:01.85,0:03:11.52,Default,,0000,0000,0000,,shivers that are triggered from music, but\Nalso other. If you insist and you might
Dialogue: 0,0:03:11.52,0:03:20.61,Default,,0000,0000,0000,,wonder why goosebumps, how can goosebumps\Nbe related to a positive feeling? There is
Dialogue: 0,0:03:20.61,0:03:32.82,Default,,0000,0000,0000,,actually no need to answer theories. I'm\None that I particularly like, is that
Dialogue: 0,0:03:32.82,0:03:37.32,Default,,0000,0000,0000,,Frisson is often induced over music or\Nover some kind of stimulus that is
Dialogue: 0,0:03:37.32,0:03:42.36,Default,,0000,0000,0000,,repetitive, that has a certain pattern,\Nand that at one point the pattern breaks
Dialogue: 0,0:03:42.36,0:03:50.63,Default,,0000,0000,0000,,and that surprises you. So this triggers\Nyour autonomous nervous system. So the
Dialogue: 0,0:03:50.63,0:03:56.10,Default,,0000,0000,0000,,fight or flight response you get to\Nsurprise you wonder alertness goes up and
Dialogue: 0,0:03:56.10,0:04:03.37,Default,,0000,0000,0000,,you realize that there's no danger and you\Nwill relax. And feel this esthetic chills.
Dialogue: 0,0:04:03.37,0:04:13.35,Default,,0000,0000,0000,,So the talk, I will give today is an\Nexploration of the feeling of Frisson with
Dialogue: 0,0:04:13.35,0:04:21.50,Default,,0000,0000,0000,,technology. So how could we detect, induce\Nor transmit it using especially variable
Dialogue: 0,0:04:21.50,0:04:26.42,Default,,0000,0000,0000,,sensors and actuators and to be a little\Nbit aclimactic? I can already tell you
Dialogue: 0,0:04:26.42,0:04:33.34,Default,,0000,0000,0000,,that this is still in process. So this is\Nreally exploratory work. However, you
Dialogue: 0,0:04:33.34,0:04:42.54,Default,,0000,0000,0000,,might also wonder why do you care about\Nthis? Why do you want to do this? And you
Dialogue: 0,0:04:42.54,0:04:48.88,Default,,0000,0000,0000,,know, one reason, of course, is. Because\Nwe can and because it's fun, and I think
Dialogue: 0,0:04:48.88,0:04:55.51,Default,,0000,0000,0000,,that's definitely, you know, kind of one\Naspect of of the research, however. Also
Dialogue: 0,0:04:55.51,0:05:02.51,Default,,0000,0000,0000,,another reason is so our lab in Yokohama\Nworks in human factors, research, so HCI
Dialogue: 0,0:05:02.51,0:05:09.13,Default,,0000,0000,0000,,and human computer interaction. And we\Nlately revisited a lot of work also from
Dialogue: 0,0:05:09.13,0:05:16.55,Default,,0000,0000,0000,,cybernetics, also nonlinear dynamics in\Nterms of research and also in terms of art
Dialogue: 0,0:05:16.55,0:05:22.55,Default,,0000,0000,0000,,and performance. We are very much inspired\Nby Stilnox work on extending and
Dialogue: 0,0:05:22.55,0:05:31.43,Default,,0000,0000,0000,,augmenting our body. And there's this\Nrealization, if you work on research that,
Dialogue: 0,0:05:31.43,0:05:35.56,Default,,0000,0000,0000,,you know, knowledge is not merely\Nfunctional, there's always some kind of
Dialogue: 0,0:05:35.56,0:05:42.65,Default,,0000,0000,0000,,enjoyment in understanding a concept. And\NI think also this community will really
Dialogue: 0,0:05:42.65,0:05:47.88,Default,,0000,0000,0000,,understand that type of feeling and this\Nsense of wonder and this feeling we also
Dialogue: 0,0:05:47.88,0:05:53.76,Default,,0000,0000,0000,,want to explore. We want to understand\Nourselves better in terms of cognition
Dialogue: 0,0:05:53.76,0:06:00.66,Default,,0000,0000,0000,,perception, but also in terms of our\Nfeeling. And actually, last year, I gave
Dialogue: 0,0:06:00.66,0:06:06.96,Default,,0000,0000,0000,,also a talk on on boiling mind on an\NFrisson loop that we played with and
Dialogue: 0,0:06:06.96,0:06:12.46,Default,,0000,0000,0000,,started researching on. And to some\Nextent, this expression. If this all beef
Dialogue: 0,0:06:12.46,0:06:17.40,Default,,0000,0000,0000,,talk is just the continuation of this, and\Noverall, we are also looking for more
Dialogue: 0,0:06:17.40,0:06:23.88,Default,,0000,0000,0000,,creative ways to use physiological data or\Nother wearable computing sensing that is
Dialogue: 0,0:06:23.88,0:06:33.00,Default,,0000,0000,0000,,not related to surveillance. So extended\Nto this, we also wonder what does it mean
Dialogue: 0,0:06:33.00,0:06:40.45,Default,,0000,0000,0000,,to be life? It's easy if you think about\Ntransmitting audio video, easy in
Dialogue: 0,0:06:40.45,0:06:45.49,Default,,0000,0000,0000,,quotation marks because yeah, there are\Nsome experts that know a lot about that.
Dialogue: 0,0:06:45.49,0:06:53.22,Default,,0000,0000,0000,,And I see also the effort that goes into\Nthe remote experience and not the
Dialogue: 0,0:06:53.22,0:06:59.43,Default,,0000,0000,0000,,congresses or conferences. However, we\Nstill don't know how to transmit an
Dialogue: 0,0:06:59.43,0:07:05.25,Default,,0000,0000,0000,,atmosphere or a feeling that's much more\Ndifficult. I think the Congress is a very
Dialogue: 0,0:07:05.25,0:07:11.43,Default,,0000,0000,0000,,nice example for that because it moved\Nfrom Berlin to Hamburg to Leipzig. But
Dialogue: 0,0:07:11.43,0:07:17.14,Default,,0000,0000,0000,,every time I visited, I kind of felt at\Nhome. I felt, Oh yeah, these are, you
Dialogue: 0,0:07:17.14,0:07:23.32,Default,,0000,0000,0000,,know, kind of the people I like. These are\Nthe culture, the community I belong to,
Dialogue: 0,0:07:23.32,0:07:29.05,Default,,0000,0000,0000,,even though it's at different places. And\Nwe wonder, you know, kind of how can we
Dialogue: 0,0:07:29.05,0:07:36.57,Default,,0000,0000,0000,,transmit at this type of feeling and to\Nefforts that we get inspired from from
Dialogue: 0,0:07:36.57,0:07:42.34,Default,,0000,0000,0000,,this work is one is neuro life. That's a\Nproject, an EU project with co-
Dialogue: 0,0:07:42.34,0:07:50.33,Default,,0000,0000,0000,,investigator Jamie Ward and also\Ncybernetic being project here in Japan,
Dialogue: 0,0:07:50.33,0:07:56.56,Default,,0000,0000,0000,,headed by Quarterman Minami. So that deals\Nwith things like parallel agency and
Dialogue: 0,0:07:56.56,0:08:01.26,Default,,0000,0000,0000,,similar. And both of them are actually\Nalso collaborators in the work that I will
Dialogue: 0,0:08:01.26,0:08:07.63,Default,,0000,0000,0000,,present today. So this is the high level\Noverview why we are interested in this
Dialogue: 0,0:08:07.63,0:08:14.71,Default,,0000,0000,0000,,song, but now getting back to the esthetic\Nchills. And first, the question is how
Dialogue: 0,0:08:14.71,0:08:22.62,Default,,0000,0000,0000,,could we go about and try to detect or\Nrecognize them? Looking into related work,
Dialogue: 0,0:08:22.62,0:08:29.80,Default,,0000,0000,0000,,of course, we'll see Frisson is that\Nchills, of course, affect our physiology.
Dialogue: 0,0:08:29.80,0:08:35.09,Default,,0000,0000,0000,,And the first thing that you notice is, of\Ncourse, the payload erection. So the goose
Dialogue: 0,0:08:35.09,0:08:40.71,Default,,0000,0000,0000,,bumps that you can get on your arm so the\Nhairs go up. So we could try to detect
Dialogue: 0,0:08:40.71,0:08:44.99,Default,,0000,0000,0000,,that. However, that might be a little bit\Ndifficult because some people might not
Dialogue: 0,0:08:44.99,0:08:53.69,Default,,0000,0000,0000,,have so much hair on on them and so on. So\Nthen looking into other physiological
Dialogue: 0,0:08:53.69,0:09:00.94,Default,,0000,0000,0000,,changes, respiratory rate is going up for\Nthe sweat glands, electro dermal activity.
Dialogue: 0,0:09:00.94,0:09:05.69,Default,,0000,0000,0000,,You will see more peaks. That's a stress\Nand excitement indicator, and heart rate
Dialogue: 0,0:09:05.69,0:09:10.89,Default,,0000,0000,0000,,goes up, blood pressure goes up and\Nusually heart rate variability related
Dialogue: 0,0:09:10.89,0:09:17.21,Default,,0000,0000,0000,,features go down. Because also, if you saw\Nlast year's talk, we already built a
Dialogue: 0,0:09:17.21,0:09:25.33,Default,,0000,0000,0000,,system to record electro dermal activity.\NSo the sweating on the hand as well as
Dialogue: 0,0:09:25.33,0:09:34.05,Default,,0000,0000,0000,,heart rate we just thought will move along\Nand use that. Luckily, we also did a
Dialogue: 0,0:09:34.05,0:09:38.76,Default,,0000,0000,0000,,redesign of the wristband bands in the\Nmeantime, so they look a little bit nicer
Dialogue: 0,0:09:38.76,0:09:45.26,Default,,0000,0000,0000,,now and you see also a life demo on my\Nbackground right now. So you see EDA and
Dialogue: 0,0:09:45.26,0:09:54.30,Default,,0000,0000,0000,,heart rate behind and if I press here. You\Nshould also see some noise on the sensor.
Dialogue: 0,0:09:54.30,0:10:03.15,Default,,0000,0000,0000,,The visualization, by the way, is done by\NKirill Ragodzin. So thanks for the work!
Dialogue: 0,0:10:03.15,0:10:08.99,Default,,0000,0000,0000,,And then moving forward, so we use these\Nwristbands to set up a controlled
Dialogue: 0,0:10:08.99,0:10:14.81,Default,,0000,0000,0000,,experiment to detect esthetic chill\Nevents. We just added a trigger, so to add
Dialogue: 0,0:10:14.81,0:10:19.62,Default,,0000,0000,0000,,some self-reporting to it. So in this\Ncase, we really use the user as a self-
Dialogue: 0,0:10:19.62,0:10:27.47,Default,,0000,0000,0000,,report to classify or to label the Frisson\Nevents that has, of course, you know, also
Dialogue: 0,0:10:27.47,0:10:33.52,Default,,0000,0000,0000,,some limitations. So you hope that that's\Ngood enough to capture it. And we used
Dialogue: 0,0:10:33.52,0:10:39.74,Default,,0000,0000,0000,,some music pieces also from related work\Nand did some counterbalancing and run this
Dialogue: 0,0:10:39.74,0:10:48.70,Default,,0000,0000,0000,,lab study just in know kind of controlled\Nspace or with headphones and so on. We
Dialogue: 0,0:10:48.70,0:10:54.64,Default,,0000,0000,0000,,finished this, but then we also wondered,\Nyou know, how does it look like in real
Dialogue: 0,0:10:54.64,0:11:02.56,Default,,0000,0000,0000,,life in the wild experiments? So we also\Norganized a concert. With 18 audience
Dialogue: 0,0:11:02.56,0:11:08.80,Default,,0000,0000,0000,,members for one album musical program, and\Nthe set up was the same, so everybody got
Dialogue: 0,0:11:08.80,0:11:15.62,Default,,0000,0000,0000,,a wristband and a trigger. We also added a\Nthird for the pianist, so using EDA from
Dialogue: 0,0:11:15.62,0:11:23.47,Default,,0000,0000,0000,,the foot actually works also relatively\Nwell and then recorded here the data and
Dialogue: 0,0:11:23.47,0:11:35.83,Default,,0000,0000,0000,,hope that people would report their focus\Non their esthetic chills. Here's now one
Dialogue: 0,0:11:35.83,0:12:32.31,Default,,0000,0000,0000,,video. A short minute video that shows you\Nthe recording. *piano music* How about the
Dialogue: 0,0:12:32.31,0:12:39.40,Default,,0000,0000,0000,,analysis? I have to see? I'm sorry the\Nthis is still ongoing, so we don't really
Dialogue: 0,0:12:39.40,0:12:43.71,Default,,0000,0000,0000,,have a lot of results yet. And of course,\Nthere were a lot of issues with the life
Dialogue: 0,0:12:43.71,0:12:48.81,Default,,0000,0000,0000,,recording. If you're interested in doing\Nsomething similar, contact some of the
Dialogue: 0,0:12:48.81,0:12:54.81,Default,,0000,0000,0000,,technical stuff or also me. We can give\Nyou hints and doing this now over 15 or 20
Dialogue: 0,0:12:54.81,0:13:00.30,Default,,0000,0000,0000,,years and always do something is going\Nwrong, depending on the setting and so on.
Dialogue: 0,0:13:00.30,0:13:05.49,Default,,0000,0000,0000,,Now I also know more about the classical\Nmusic concerts. However, we got some
Dialogue: 0,0:13:05.49,0:13:11.00,Default,,0000,0000,0000,,useful data. The problem there was we\Ncould also train a machine learning model
Dialogue: 0,0:13:11.00,0:13:16.01,Default,,0000,0000,0000,,because we really wanted to dect it real\Ntime. And it seemed to work really well.
Dialogue: 0,0:13:16.01,0:13:22.52,Default,,0000,0000,0000,,We are just still not sure if it really\Nworks or not, so we want to be very
Dialogue: 0,0:13:22.52,0:13:26.41,Default,,0000,0000,0000,,careful about that. So we get higher\Naccuracy spec. But given the limited
Dialogue: 0,0:13:26.41,0:13:31.80,Default,,0000,0000,0000,,amount of uses we had also and we want to\Nlook into that a little bit more. However,
Dialogue: 0,0:13:31.80,0:13:36.22,Default,,0000,0000,0000,,the analysis, as well as the data sets,\Nwill be publicly available. And if you
Dialogue: 0,0:13:36.22,0:13:41.28,Default,,0000,0000,0000,,want to get them a little bit earlier to\Nalso contact me. So then moving on, this
Dialogue: 0,0:13:41.28,0:13:46.94,Default,,0000,0000,0000,,is the progress on detection. How does it\Nlook like for triggering or inducing
Dialogue: 0,0:13:46.94,0:13:55.90,Default,,0000,0000,0000,,Frisson? So there's also a lot of cool\Nrelated work. I just show or highlight two
Dialogue: 0,0:13:55.90,0:14:03.35,Default,,0000,0000,0000,,of them. One is work by Shoko Fukushima at\Nall. And they're using the electrostatic
Dialogue: 0,0:14:03.35,0:14:12.25,Default,,0000,0000,0000,,effect on the arm to control payload\Nerection. And they use it to increase the
Dialogue: 0,0:14:12.25,0:14:17.67,Default,,0000,0000,0000,,surprise feeling of somebody, so you put\Nyour arm inside and they can control the
Dialogue: 0,0:14:17.67,0:14:24.06,Default,,0000,0000,0000,,payload erection. Other work is from Ha at\Nall, whether using three Peltier elements
Dialogue: 0,0:14:24.06,0:14:31.55,Default,,0000,0000,0000,,on your back, on your spine and deactivate\Nthem upwards to also induce Frisson or
Dialogue: 0,0:14:31.55,0:14:39.61,Default,,0000,0000,0000,,static chills. The problem with those two\Nsetups, it's quite hard to get them into a
Dialogue: 0,0:14:39.61,0:14:44.19,Default,,0000,0000,0000,,into a concert hall. And, you know, some\Npeople might not really have much hair on
Dialogue: 0,0:14:44.19,0:14:49.70,Default,,0000,0000,0000,,their arms or so on, so there might be\Nlimitations for it. So then, you know, for
Dialogue: 0,0:14:49.70,0:14:56.01,Default,,0000,0000,0000,,first iteration, we decided to go for a\Nneck prototype, because kind of the neck
Dialogue: 0,0:14:56.01,0:15:02.62,Default,,0000,0000,0000,,is also a part of some of the Frisson\Nresponses. So you get either chills down
Dialogue: 0,0:15:02.62,0:15:08.51,Default,,0000,0000,0000,,the spine or up the neck or also your hair\Nmight stand up. So we thought it's a good
Dialogue: 0,0:15:08.51,0:15:12.63,Default,,0000,0000,0000,,start and we used first healthy elements\Nor thermal modules and also vibrant
Dialogue: 0,0:15:12.63,0:15:18.35,Default,,0000,0000,0000,,tactile feedback. In later iterations we\Nmoved just to a thermal feedback to
Dialogue: 0,0:15:18.35,0:15:25.01,Default,,0000,0000,0000,,activate this on the back of the neck\Naround on the upper side of the trapezius
Dialogue: 0,0:15:25.01,0:15:32.26,Default,,0000,0000,0000,,muscle, and they would activate with\Nslight cold feedback. So for an initial
Dialogue: 0,0:15:32.26,0:15:37.94,Default,,0000,0000,0000,,tests, it seemed to work or just this,\Njust with 10 participants, around 30
Dialogue: 0,0:15:37.94,0:15:44.38,Default,,0000,0000,0000,,minutes per participant, we had two music\Npieces that are based on related works or
Dialogue: 0,0:15:44.38,0:15:51.08,Default,,0000,0000,0000,,Chopin and Gustav Holst. We counterbalance\Nthe conditions or music pieces with
Dialogue: 0,0:15:51.08,0:15:56.88,Default,,0000,0000,0000,,neckband without neck bent with neck bent,\Nwith activation and without activation.
Dialogue: 0,0:15:56.88,0:16:03.57,Default,,0000,0000,0000,,And from an initial test, we can see that\Nit seems that slight cold feedback really
Dialogue: 0,0:16:03.57,0:16:09.01,Default,,0000,0000,0000,,provides more instances of reported\NFrisson. So there is a slight positive
Dialogue: 0,0:16:09.01,0:16:12.14,Default,,0000,0000,0000,,feedback, but you know, it was still quite\Nlittle participants and we'll have to
Dialogue: 0,0:16:12.14,0:16:17.75,Default,,0000,0000,0000,,continue and see also with a little bit of\Nredesign. So we want to change the order
Dialogue: 0,0:16:17.75,0:16:25.13,Default,,0000,0000,0000,,and placement of the pelty elements for\Nthe continuation work as well. Now moving
Dialogue: 0,0:16:25.13,0:16:30.65,Default,,0000,0000,0000,,to the last part, so we talked about\Ndetection, induction, and now let's talk
Dialogue: 0,0:16:30.65,0:16:37.88,Default,,0000,0000,0000,,about sharing or transmitting Frisson. He\Nhad the idea would be, you know, you are
Dialogue: 0,0:16:37.88,0:16:45.20,Default,,0000,0000,0000,,listening to a musical piece, a classical\Npiece and one person gets Frisson, does
Dialogue: 0,0:16:45.20,0:16:52.23,Default,,0000,0000,0000,,this detect it over the wristband and then\Nit's distributed ripples through the
Dialogue: 0,0:16:52.23,0:17:00.67,Default,,0000,0000,0000,,neighbors? They get activated over the\NNick Bend and hopefully also free Frisson
Dialogue: 0,0:17:00.67,0:17:08.31,Default,,0000,0000,0000,,again around the same time it just after\Nthe red circled person felt that the
Dialogue: 0,0:17:08.31,0:17:13.20,Default,,0000,0000,0000,,esthetic chills. So in this case, then,\Nyou know, we would have all of the
Dialogue: 0,0:17:13.20,0:17:18.31,Default,,0000,0000,0000,,audience members need to wear sensors and\Nactuators, and we would need to freshen
Dialogue: 0,0:17:18.31,0:17:27.53,Default,,0000,0000,0000,,detection and also then the activation\Nbased on that. And for that, we also
Dialogue: 0,0:17:27.53,0:17:33.70,Default,,0000,0000,0000,,organized a not a concert in this case, 50\Naudience members. The program was around
Dialogue: 0,0:17:33.70,0:17:43.27,Default,,0000,0000,0000,,1,5 hours. And the set up was, as you see\Nhere. So performers on the top, and then
Dialogue: 0,0:17:43.27,0:17:51.34,Default,,0000,0000,0000,,we had two sections. One saw 25 users\Nwould wear just the wristband as a kind of
Dialogue: 0,0:17:51.34,0:17:58.36,Default,,0000,0000,0000,,control group. And the second group, 25\Nusers would wear wristband and neck bent,
Dialogue: 0,0:17:58.36,0:18:02.93,Default,,0000,0000,0000,,so it would get to actually the detection\Nand also the activation. That's all, you
Dialogue: 0,0:18:02.93,0:18:10.18,Default,,0000,0000,0000,,know, 50 plus wristbands needed charging\Nand 25 neck bands were manufactured, and
Dialogue: 0,0:18:10.18,0:18:18.00,Default,,0000,0000,0000,,this is the picture from the actual\Nconcert with an nick bent section. And
Dialogue: 0,0:18:18.00,0:18:22.64,Default,,0000,0000,0000,,here is how this should work, so, you\Nknow, you have first one person, you
Dialogue: 0,0:18:22.64,0:18:29.96,Default,,0000,0000,0000,,detect the Frisson and then you ripple it\Nout to the neighbors, then the next person
Dialogue: 0,0:18:29.96,0:18:34.71,Default,,0000,0000,0000,,might feel Frisson we detected over the\Nwristband and then replay it out to the
Dialogue: 0,0:18:34.71,0:18:40.68,Default,,0000,0000,0000,,other people that haven't gotten\Nactivation yet and so on. So you have then
Dialogue: 0,0:18:40.68,0:18:50.56,Default,,0000,0000,0000,,a wave of Frisson hopefully moving through\Nthe audience members. This is not a setup
Dialogue: 0,0:18:50.56,0:18:54.72,Default,,0000,0000,0000,,up, yab he (NAME!) who also did a lot of\Nthe organization parts or so on at the
Dialogue: 0,0:18:54.72,0:19:02.63,Default,,0000,0000,0000,,piano, and he is then a small video that\Nsummarizes the work. And at the end you
Dialogue: 0,0:19:02.63,0:19:08.09,Default,,0000,0000,0000,,see also the servers, the recording\Nserver, the activation server and the I
Dialogue: 0,0:19:08.09,0:19:38.10,Default,,0000,0000,0000,,know the detection server and also the\Nactivation server. *piano music playes*
Dialogue: 0,0:19:38.10,0:20:25.07,Default,,0000,0000,0000,,*one person plays piano, another plays\Nchello* So the question you might have
Dialogue: 0,0:20:25.07,0:20:35.14,Default,,0000,0000,0000,,now, did it work? Hmm. Not not completely\Nsure. Again, here, work in progress or
Dialogue: 0,0:20:35.14,0:20:39.87,Default,,0000,0000,0000,,analysis is ongoing, and we can't also\Nreally see because, yeah, we had this
Dialogue: 0,0:20:39.87,0:20:44.89,Default,,0000,0000,0000,,control group and we could see more\NFrisson events in the sharing group. But
Dialogue: 0,0:20:44.89,0:20:49.46,Default,,0000,0000,0000,,how to interpret that, that's really,\Nreally difficult. We are also working on
Dialogue: 0,0:20:49.46,0:20:54.05,Default,,0000,0000,0000,,the design of the wristbands as well as\Nthe neckband and especially for the
Dialogue: 0,0:20:54.05,0:20:59.57,Default,,0000,0000,0000,,neckband. We got a couple of uses, I think\Nfive or six or seven that really didn't
Dialogue: 0,0:20:59.57,0:21:05.91,Default,,0000,0000,0000,,like the neckband, not the activations or\Nthe slight called activation was OK, but
Dialogue: 0,0:21:05.91,0:21:10.87,Default,,0000,0000,0000,,just because it was a little bit too tight\Nand a little bit too uncomfortable. So
Dialogue: 0,0:21:10.87,0:21:16.05,Default,,0000,0000,0000,,we're working on a redesign we have for\Nthe next concert in april. All of the data
Dialogue: 0,0:21:16.05,0:21:23.13,Default,,0000,0000,0000,,make it also publicly available. Soon\Nenough, look also a little bit more what
Dialogue: 0,0:21:23.13,0:21:27.88,Default,,0000,0000,0000,,we can find out about what happened. This\Nbrings me to the end of the presentation.
Dialogue: 0,0:21:27.88,0:21:34.59,Default,,0000,0000,0000,,I hope you enjoyed it. Yeah, I just wanted\Nto thank a couple of people first and
Dialogue: 0,0:21:34.59,0:21:44.37,Default,,0000,0000,0000,,foremost Yann He, who organized this\NFrisson , who introduced us. And also the
Dialogue: 0,0:21:44.37,0:21:49.18,Default,,0000,0000,0000,,teams are dismissed for their second\Nconcert. The extended team thanks a lot
Dialogue: 0,0:21:49.18,0:21:54.72,Default,,0000,0000,0000,,for everybody who was involved here, then\Nalso all of the names. So these are the
Dialogue: 0,0:21:54.72,0:21:58.75,Default,,0000,0000,0000,,people that did the actual work did not\Njust doing the presenting like I do right
Dialogue: 0,0:21:58.75,0:22:04.98,Default,,0000,0000,0000,,now. I hope I haven't missed anybody. So\Nalso, thanks to George, Dingding, Denny
Dialogue: 0,0:22:04.98,0:22:10.47,Default,,0000,0000,0000,,and so on and all of the other people\Ninvolved in group planning the studio
Dialogue: 0,0:22:10.47,0:22:19.53,Default,,0000,0000,0000,,Apollo and also the piano NIST's and\Ninteractive performers. So thanks a lot.
Dialogue: 0,0:22:19.53,0:22:27.27,Default,,0000,0000,0000,,Yeah, that brings me to the end of the\Npresentation. As I said, we have a third
Dialogue: 0,0:22:27.27,0:22:31.32,Default,,0000,0000,0000,,concert, probably in April next year in\NYokohama, Tokyo area. So if you're
Dialogue: 0,0:22:31.32,0:22:36.67,Default,,0000,0000,0000,,interested, let me know also if you have a\Ngeneral interest in effect or similar
Dialogue: 0,0:22:36.67,0:22:43.40,Default,,0000,0000,0000,,phenomenon. Also, just write me an email.\NIt would be good if you mentioned Frisson
Dialogue: 0,0:22:43.40,0:22:49.75,Default,,0000,0000,0000,,remote experience in the subject, so I can\Njust filter that out and something
Dialogue: 0,0:22:49.75,0:22:54.82,Default,,0000,0000,0000,,completely different. We also have a\Nconference next year. March submission
Dialogue: 0,0:22:54.82,0:23:01.11,Default,,0000,0000,0000,,deadline is January 7th, augmented humans\Nin Japan and Germany and cyberspace that
Dialogue: 0,0:23:01.11,0:23:11.42,Default,,0000,0000,0000,,deals with maybe similar work. So thanks a\Nlot for listening and I hope. Yeah, I told
Dialogue: 0,0:23:11.42,0:23:16.85,Default,,0000,0000,0000,,you something interested in the last 20\Nminutes. By.
Dialogue: 0,0:23:16.85,0:23:21.62,Default,,0000,0000,0000,,Herald: Hello, and welcome back to the FM\NChannel, thank you Kay for the very
Dialogue: 0,0:23:21.62,0:23:25.40,Default,,0000,0000,0000,,interesting talk, and Kay should actually\Nbe with us to answer a few questions.
Dialogue: 0,0:23:25.40,0:23:27.40,Default,,0000,0000,0000,,Hello, Kay.\NKay: Hello.
Dialogue: 0,0:23:27.40,0:23:33.21,Default,,0000,0000,0000,,Herald: And we actually do have a few\Nquestions already. And the first one
Dialogue: 0,0:23:33.21,0:23:39.28,Default,,0000,0000,0000,,sounds a bit more like a comment, but I\Ntell you anyway. So one one viewer noted
Dialogue: 0,0:23:39.28,0:23:42.96,Default,,0000,0000,0000,,that this a technical cybernetics and\Nsystems course here in Illmenau, the two
Dialogue: 0,0:23:42.96,0:23:46.98,Default,,0000,0000,0000,,in the know and wanted to know if you were\Naware of this already.
Dialogue: 0,0:23:46.98,0:23:53.88,Default,,0000,0000,0000,,Kay: Actually, it wasn't, but it sounds\Nthat sounds quite fun and getting more and
Dialogue: 0,0:23:53.88,0:23:57.76,Default,,0000,0000,0000,,more interested in cybernetics as well.\NAnd I think it's useful to revisit some of
Dialogue: 0,0:23:57.76,0:24:03.73,Default,,0000,0000,0000,,the ideas around feedback loops, as I said\Nat the beginning. So that's cool if you if
Dialogue: 0,0:24:03.73,0:24:08.00,Default,,0000,0000,0000,,you're already looking into that. And I\Nthink especially if people go into HCI
Dialogue: 0,0:24:08.00,0:24:12.24,Default,,0000,0000,0000,,fields, I think it's quite useful to get a\Nlittle bit of that background.
Dialogue: 0,0:24:12.24,0:24:17.81,Default,,0000,0000,0000,,Herald: Yes, nice. OK, let's go to the\Nnext question. It's about neural networks,
Dialogue: 0,0:24:17.81,0:24:22.62,Default,,0000,0000,0000,,which have the neural network was us. Have\Nyou considered neural net different doing
Dialogue: 0,0:24:22.62,0:24:27.24,Default,,0000,0000,0000,,differential equations such as echo-state\Nnetwork or reservoir computing, which are
Dialogue: 0,0:24:27.24,0:24:30.49,Default,,0000,0000,0000,,good when modeling stiff time\Nconsciousness processes?
Dialogue: 0,0:24:30.49,0:24:37.04,Default,,0000,0000,0000,,Kay: That's actually a really good\Nquestion and actually also good hint for
Dialogue: 0,0:24:37.04,0:24:42.46,Default,,0000,0000,0000,,what to do next. I just tried to look up.\NI saw the question already. Also in the
Dialogue: 0,0:24:42.46,0:24:47.20,Default,,0000,0000,0000,,chat, I try to look up what we used, and I\Nthink at the beginning we just used
Dialogue: 0,0:24:47.20,0:24:52.15,Default,,0000,0000,0000,,support vector machines, so not neural\Nnetworks. And no, no, we are using some
Dialogue: 0,0:24:52.15,0:24:57.94,Default,,0000,0000,0000,,neural network, but I don't know the\Nconfiguration and I couldn't check. I'll
Dialogue: 0,0:24:57.94,0:25:03.48,Default,,0000,0000,0000,,get back to the person who asked the\Nquestion. What was interesting for me was
Dialogue: 0,0:25:03.48,0:25:08.56,Default,,0000,0000,0000,,that the the data looks already quite\Ngood. The sensor data looks actually quite
Dialogue: 0,0:25:08.56,0:25:15.61,Default,,0000,0000,0000,,good. And I would assume that in most\Ncases, any classifier will do a decent job
Dialogue: 0,0:25:15.61,0:25:21.76,Default,,0000,0000,0000,,for the lab experiments for the other\Nworks. I think, yeah, that sounds quite
Dialogue: 0,0:25:21.76,0:25:29.00,Default,,0000,0000,0000,,interesting. I also want to go more\Ntowards, um yeah, nonlinear dynamics work
Dialogue: 0,0:25:29.00,0:25:35.70,Default,,0000,0000,0000,,as well in terms of of of estimating\NFrisson or different feelings. But that's
Dialogue: 0,0:25:35.70,0:25:41.14,Default,,0000,0000,0000,,that's a really good hint, that it would\Nbe more question also for Jo Ann Hunt,
Dialogue: 0,0:25:41.14,0:25:47.34,Default,,0000,0000,0000,,coauthor of the paper that is also linked.\NShe is our data analyst and so on, and
Dialogue: 0,0:25:47.34,0:25:51.91,Default,,0000,0000,0000,,notes what what she used to the first\Nclassifier was a support vector machine
Dialogue: 0,0:25:51.91,0:25:56.13,Default,,0000,0000,0000,,fairly basic and I think recently we use a\Nneural network, but I thought it's just
Dialogue: 0,0:25:56.13,0:26:01.81,Default,,0000,0000,0000,,very straightforward. PyTorch long\Ntraining, but nothing, nothing special and
Dialogue: 0,0:26:01.81,0:26:06.02,Default,,0000,0000,0000,,nothing fancy so far.\NHerald: OK, nice, I guess I guess she will
Dialogue: 0,0:26:06.02,0:26:10.33,Default,,0000,0000,0000,,probably also hear from the questions\Nthen. And then let's go to the next
Dialogue: 0,0:26:10.33,0:26:15.62,Default,,0000,0000,0000,,question. Have you considered or tested\Nthe effects of editorial stimulus, such as
Dialogue: 0,0:26:15.62,0:26:20.89,Default,,0000,0000,0000,,attempting to cross Frisson Waves and in\Nboring situations instead of like
Dialogue: 0,0:26:20.89,0:26:29.98,Default,,0000,0000,0000,,interesting ones?\NKay: That's also quite a good or
Dialogue: 0,0:26:29.98,0:26:35.00,Default,,0000,0000,0000,,interesting question. I mean, there were\Nsome some audience members also that
Dialogue: 0,0:26:35.00,0:26:41.06,Default,,0000,0000,0000,,mentioned that Nick Bend was actually a\Nlittle bit uncomfortable. So I'm not
Dialogue: 0,0:26:41.06,0:26:47.12,Default,,0000,0000,0000,,really sure if we cost Frisson with them.\NAnd I don't know what would happen if you,
Dialogue: 0,0:26:47.12,0:26:53.32,Default,,0000,0000,0000,,I think you probably would just make the\Nsituation uncomfortable anyways. I'm not
Dialogue: 0,0:26:53.32,0:27:00.71,Default,,0000,0000,0000,,sure what would happen then, if you\Nstimulating called feedback. Actually, you
Dialogue: 0,0:27:00.71,0:27:05.71,Default,,0000,0000,0000,,might get the fear response in these cases\Nif you're in a boring situation, I'm not
Dialogue: 0,0:27:05.71,0:27:12.91,Default,,0000,0000,0000,,sure if you if you. Hmm. Yeah, I actually\NI don't know. It's definitely an
Dialogue: 0,0:27:12.91,0:27:21.24,Default,,0000,0000,0000,,interesting idea to to use it in boring\Nsituations. Can you get somebody to change
Dialogue: 0,0:27:21.24,0:27:28.74,Default,,0000,0000,0000,,their? The feeling and get to the more\Nexcited state? We are playing often, we
Dialogue: 0,0:27:28.74,0:27:32.63,Default,,0000,0000,0000,,played a little bit with the thermal\Nfeedback and it was always interesting if
Dialogue: 0,0:27:32.63,0:27:37.45,Default,,0000,0000,0000,,you change the thermal feedback. So\Ninstead of if you see something hot in VR,
Dialogue: 0,0:27:37.45,0:27:42.23,Default,,0000,0000,0000,,you give cold stimulus or so on. It really\Nis a little bit confusing and interesting.
Dialogue: 0,0:27:42.23,0:27:49.28,Default,,0000,0000,0000,,I haven't thought about that in Frisson\Nsituation. And if it works for boring
Dialogue: 0,0:27:49.28,0:27:53.48,Default,,0000,0000,0000,,work, but it's definitely cool or\Ninteresting. So if somebody wants to play
Dialogue: 0,0:27:53.48,0:27:58.85,Default,,0000,0000,0000,,with that, I would be up for also giving a\Nlittle bit of help or ideas in that
Dialogue: 0,0:27:58.85,0:28:04.13,Default,,0000,0000,0000,,direction.\NHerald: OK, thank you for. For answering
Dialogue: 0,0:28:04.13,0:28:11.81,Default,,0000,0000,0000,,these questions, unfortunately, that don't\Nseem to be any more of them. So that's it.
Dialogue: 0,0:28:11.81,0:28:16.26,Default,,0000,0000,0000,,Thank you very much for the very\Ninteresting talk. That's a topic I haven't
Dialogue: 0,0:28:16.26,0:28:22.04,Default,,0000,0000,0000,,really thinking that much about, but thank\Nyou very much. It was very interesting.
Dialogue: 0,0:28:22.04,0:28:26.34,Default,,0000,0000,0000,,Kay: Thanks a lot also for having me, and\Nit's always fun and I always enjoyed the
Dialogue: 0,0:28:26.34,0:28:30.94,Default,,0000,0000,0000,,feedback. Yet there's also a candlelight\Nlife demonstration behind me. So you saw
Dialogue: 0,0:28:30.94,0:28:34.54,Default,,0000,0000,0000,,my excitement level kind of increasing or\Ndecreasing with the questions.
Dialogue: 0,0:28:34.54,0:28:38.68,Default,,0000,0000,0000,,Herald: Oh wow, that's pretty cool.\NKay: OK. Yeah, thanks a lot.
Dialogue: 0,0:28:38.68,0:28:46.54,Default,,0000,0000,0000,,Herald: Then here and here on the FM\Nchannel, the next thing happening will at
Dialogue: 0,0:28:46.54,0:28:51.01,Default,,0000,0000,0000,,11:00 p.m. the lightening think talk or\Nnot on the film channel. But one of the
Dialogue: 0,0:28:51.01,0:28:56.06,Default,,0000,0000,0000,,next things happening at three will be at\N11:00 p.m. The lightning talks at remote
Dialogue: 0,0:28:56.06,0:29:02.21,Default,,0000,0000,0000,,range. And here on on our channel,\Nactually at 12:00 a.m. or midnight, there
Dialogue: 0,0:29:02.21,0:29:13.75,Default,,0000,0000,0000,,will be the next terror news show. And\Nthat until then by.