WEBVTT 00:00:00.270 --> 00:00:01.862 Hi KQED, 00:00:01.862 --> 00:00:03.848 my name is Stephen Malnowski. 00:00:03.848 --> 00:00:06.047 Let me tell you what I've been making. 00:00:06.978 --> 00:00:09.594 A while ago, when I was learning to read music, 00:00:09.594 --> 00:00:11.826 I could follow the score for a single instrument 00:00:11.826 --> 00:00:15.378 [violin playing] 00:00:18.490 --> 00:00:21.234 much more easily than a score with many instruments. 00:00:21.234 --> 00:00:24.104 [orchestra playing] 00:00:26.491 --> 00:00:28.889 To make complex scores that were easier to read, 00:00:28.889 --> 00:00:32.930 I condensed them by putting all the notes on a single staff, 00:00:32.930 --> 00:00:34.837 like in piano music. 00:00:34.837 --> 00:00:39.593 Unfortunately, this made it hard to see which instrument was playing which note. 00:00:39.593 --> 00:00:42.470 I tried coloring the notes by instrument. 00:00:42.470 --> 00:00:46.354 That worked better, but since all the note symbols were about the same size, 00:00:46.354 --> 00:00:51.193 a long note for one instrument could easily be lost among shorter notes of other instruments. 00:00:51.193 --> 00:00:54.137 The solution was to use bar graph notation. 00:00:54.137 --> 00:00:57.145 At first, I drew paper scrolls by hand, 00:00:59.974 --> 00:01:02.688 but later I learned how to make them with computer software. 00:01:02.688 --> 00:01:06.761 The first version, on the Atari 800, looked and sounded like this: 00:01:06.761 --> 00:01:10.149 [electronic song plays] 00:01:26.325 --> 00:01:30.630 The second one, on an IBM PC, looked like this: 00:01:30.630 --> 00:01:35.858 [harpsichord arrangement] 00:02:03.118 --> 00:02:06.379 Over the years, I experimented with other ways of showing music. 00:02:06.379 --> 00:02:09.764 [classical piano playing] 00:02:23.416 --> 00:02:26.134 [Beethoven's 5th Symphony] 00:03:04.092 --> 00:03:04.092 [adagio piece] 00:03:26.138 --> 00:03:29.162 [allegro violin] 00:03:43.130 --> 00:03:45.943 [Bach's Cello Suite #1] 00:03:54.561 --> 00:03:59.656 Recently a violinist told me he wanted to use my visualizations in live performance. 00:03:59.656 --> 00:04:04.307 So I made a version of my software in which the timing of the animation is controlled with a crank. 00:04:07.713 --> 00:04:10.058 We tried this out with the symphony orchestra. 00:04:10.058 --> 00:04:12.254 It worked.