WEBVTT
00:00:02.250 --> 00:00:04.833
>> Vance Stevens: We're live!
00:00:04.833 --> 00:00:08.256
Hello, everybody. Somehow my video disappeared.
00:00:08.256 --> 00:00:12.643
It's there, but that's my - it's just in avatar format.
00:00:12.643 --> 00:00:13.201
Plus does that every now and then.
00:00:13.201 --> 00:00:17.335
OK, well anyway, this is Vance Stevens in Abu Dh..., no, sorry, in L.A.
00:00:17.335 --> 00:00:20.140
I'm living in L.A. now, I forget where I'm living.
00:00:20.140 --> 00:00:21.533
Today is the 8th of December.
00:00:21.533 --> 00:00:25.155
They move me around so much, you know.
00:00:25.155 --> 00:00:30.064
And, anyway, it's the 8th of December 2013.
00:00:30.064 --> 00:00:33.420
We're talking with a good friend of mine, Phil Hubbard,
00:00:33.420 --> 00:00:38.039
from Stanford University in Palo Alto, California.
00:00:38.039 --> 00:00:44.940
And he's been doing some really neat stuff in Cal.
00:00:44.940 --> 00:00:48.606
I've known him for a long time in the Cal Intersection Tea Salts [check].
00:00:48.606 --> 00:00:50.243
>> Phil Hubbard: Since we were kids.
00:00:50.243 --> 00:00:53.546
>> Stevens: We were, it was like 20 years ago
[Hubbard laughs]
00:00:53.546 --> 00:00:57.998
>> Hubbard: reaching 30 [check]
[background voice]
00:00:57.998 --> 00:01:03.036
>> Stevens: Someone has a -- someone needs to have a headset on.
00:01:03.036 --> 00:01:04.814
[missed words] is muted.
00:01:04.814 --> 00:01:10.499
Errh not sure: it could be someone listening to the stream.
00:01:10.499 --> 00:01:11.918
Yeah, if you're listening to the stream -- OK.
00:01:11.918 --> 00:01:13.499
Their call has gone away [check]
00:01:13.499 --> 00:01:15.047
Someone has corrected it, that's good.
00:01:15.047 --> 00:01:23.371
All right, well, OK. Someone has announced in the stream chat that they're listening to it there.
00:01:23.371 --> 00:01:25.999
So that's good, everything seems to be working.
00:01:25.999 --> 00:01:28.499
We're doing a Hangout on Air, as we often do.
00:01:28.499 --> 00:01:32.271
We're streaming it on webheadsinaction.org/live
00:01:32.271 --> 00:01:36.495
At the moment we have six people in the hangout,
00:01:36.495 --> 00:01:37.752
there's room for four more.
00:01:37.752 --> 00:01:41.914
So if anyone is listening on the stream and would like to join us, they can.
00:01:41.914 --> 00:01:47.998
And right now we've got Claire Siskin and Jim Buckingham, Rita Zeinstejer and
00:01:47.998 --> 00:01:59.105
let's see, and also Rob, Rob is there, and me, Vance Stevens. Rob Permanus, is that correct?
00:01:59.105 --> 00:02:05.665
Correct me if I'm wrong. Permanus, Permanus - how do you pronounce your name?
00:02:05.665 --> 00:02:09.245
>> Hubbard: You have to unmute him chuckles
00:02:09.245 --> 00:02:17.438
>> Stevens: it's Perhamus -- Perhamus, OK, Good, I'll never forget that again, all right.
00:02:17.438 --> 00:02:23.162
Thank you very much, Rob. Rob is an occasional participant in our hangouts.
00:02:23.162 --> 00:02:28.379
Well Phil, take it away and anybody who wants to --
00:02:28.379 --> 00:02:31.826
by the way, you're all muted by default when you come into the hangout.
00:02:31.826 --> 00:02:33.777
You can unmute yourself.
00:02:33.777 --> 00:02:39.071
If you're going to unmute yourself and talk, please mute yourself again,
00:02:39.071 --> 00:02:43.199
so we don't get keyboard noises and things like that.
00:02:43.199 --> 00:02:48.005
And there's Elizabeth Anne, also shown up from Grenoble in France.
00:02:48.005 --> 00:02:53.204
And Halima [check] in Tashkent has also joined us, I see.
00:02:53.204 --> 00:02:55.367
>> Hubbard [check] I think we're great, well, hello, everybody.
00:02:55.367 --> 00:02:59.136
It's Good Morning for me, a little early in the morning,
00:02:59.136 --> 00:03:04.035
but the sun is beginning to show through the back window here.
00:03:04.035 --> 00:03:08.669
Thank you all for being here from all over the world.
00:03:08.669 --> 00:03:18.079
What I wanted to do today is talk about largely an idea and a project that I've been working on
00:03:18.079 --> 00:03:21.585
for the last couple of years, very sporadically.
00:03:21.585 --> 00:03:25.410
Unfortunately I get interrupted easily, as I'm sure all of you do,
00:03:25.410 --> 00:03:35.897
so what started out as a -- what I hoped was going to be a much more robust collection of materials
00:03:35.897 --> 00:03:39.579
has turned out to be a little more anemic
00:03:39.579 --> 00:03:44.415
but I still think that I have enough here that I can demonstrate the idea
00:03:44.415 --> 00:03:48.710
and especially share my thoughts about how to go
00:03:48.710 --> 00:03:55.746
about dealing with this relatively new notion of curation,
00:03:55.746 --> 00:04:01.083
although in some ways, maybe it's just a label for an old notion that we've had for quite some time.
00:04:01.083 --> 00:04:06.463
So, let me give you a little bit of the background,
00:04:06.463 --> 00:04:10.592
like several of the things I've worked on in the last few years,
00:04:10.592 --> 00:04:12.663
like learner training.
00:04:12.663 --> 00:04:17.979
This is something that has emerged out of my classroom experience
00:04:17.979 --> 00:04:21.939
with an advanced listening and vocabulary class,
00:04:21.939 --> 00:04:27.321
and I see Vance is showing some of the slides now.
00:04:27.321 --> 00:04:36.856
The class is for graduate students at Stanford
00:04:36.856 --> 00:04:42.469
and it's a really nice sandbox for playing with ideas,
00:04:42.469 --> 00:04:48.099
because these are -- well, they're all in graduate school already,
00:04:48.099 --> 00:04:57.270
they're, for the most part, in the high 90's onwards to the 100s in the TOEFL iBT
00:04:57.270 --> 00:04:59.100
so they really are advanced in that sense.
00:04:59.100 --> 00:05:06.054
And many of them are taking the course because we require them to do it.
00:05:06.054 --> 00:05:08.050
So they're kind of a captive audience
00:05:08.050 --> 00:05:12.065
but it's also a small course: we have a maximum 14 students in it
00:05:12.065 --> 00:05:22.370
and it allows me to not only play around with ideas, but get a chance to talk to the students afterward,
00:05:22.370 --> 00:05:29.890
not usually with formal research, but just informally as part of our normal tutorial sessions
00:05:29.890 --> 00:05:35.036
and find out what they thought about them and what I can do to make them work a little better.
00:05:37.512 --> 00:05:42.645
So, the problem that I noticed - an important part of this class
00:05:42.645 --> 00:05:45.288
is that students do independent projects
00:05:45.795 --> 00:05:52.906
and those independent projects are supposed to be for a minimum of three hours a week.
00:05:54.443 --> 00:05:59.941
Sounds like I am getting some echo in the background, but I will keep pushing through here..
00:06:00.510 --> 00:06:03.404
Uhh.. those projects are for three hours a week
00:06:03.404 --> 00:06:09.411
and they are responsible for doing the selection of the material
00:06:09.411 --> 00:06:14.913
with my help and with my guidance both before and after.
00:06:16.528 --> 00:06:23.328
And over the years, I have discovered that they are actually not really good at that.
00:06:23.328 --> 00:06:27.032
What they are good at is finding material that is interesting to them.
00:06:27.385 --> 00:06:31.478
But, they are not necessarily good at finding material that helps them.
00:06:32.585 --> 00:06:38.933
They discover that on their own a little bit down the road
00:06:38.933 --> 00:06:41.643
and often it doesn't become clear to both of us
00:06:41.643 --> 00:06:46.655
because I have a very slow learning curve and quickly forget things.
00:06:46.655 --> 00:06:50.816
So, I get to the end of the class and then I go
00:06:50.816 --> 00:06:53.945
"Oh, I should have provided them with a little more guidance.".
00:06:53.945 --> 00:06:56.410
So, about 2 years ago, I started doing this
00:06:56.410 --> 00:06:59.926
and it came as a juxtaposition of a couple of things.
00:06:59.926 --> 00:07:05.399
First of all, just my own general interest in the development of autonomy had been growing
00:07:06.275 --> 00:07:11.533
and as I have gone out and collected materials that I would just use in class,
00:07:12.086 --> 00:07:16.977
it was pretty clear to me that there is a huge amount of really interesting materials out there.
00:07:17.899 --> 00:07:20.553
And people have been collecting these for a while
00:07:20.585 --> 00:07:24.330
and teachers have been building lessons out of them
00:07:24.899 --> 00:07:27.055
-- sometimes pretty sophisiticated lessons --
00:07:27.516 --> 00:07:31.749
but I needed something that students could work with on their own.
00:07:32.241 --> 00:07:37.784
And so, I wanted to find a way to help them without just my advice
00:07:37.784 --> 00:07:41.513
as to how to look for materials, to actually start collecting materials
00:07:41.513 --> 00:07:44.729
in ways that would still give them quite a bit of freedom of choice
00:07:44.729 --> 00:07:52.101
but would also make it better as a language learning experience.
00:07:53.008 --> 00:07:58.163
As part of this course, they are also required to build vocabulary.
00:07:58.179 --> 00:08:02.794
They have to identify at least 35 new words and phrases every week,
00:08:02.794 --> 00:08:04.447
from the material they are using.
00:08:04.447 --> 00:08:07.488
So, this is a bit of the backdrop.
00:08:08.714 --> 00:08:14.115
In 2011, I came across a book, kind of independently.
00:08:14.115 --> 00:08:17.200
It was just recommended to me, for some reason, by Amazon:
00:08:17.200 --> 00:08:18.730
you know how that works.
00:08:19.360 --> 00:08:22.147
And the book was called 'Curation Nation'
00:08:22.147 --> 00:08:27.468
and there is, I think, a slide there perhaps somewhere, it's like the sixth slide.
00:08:29.268 --> 00:08:32.835
There's a -- if you want to pop that up.
00:08:32.835 --> 00:08:34.596
If not, it's just a picture of the book.
00:08:34.596 --> 00:08:36.537
But it's a book it's a book by Steven Rosembaum.
00:08:36.537 --> 00:08:38.163
>>Stevens: I will. Could I --
00:08:38.163 --> 00:08:42.805
I am supposed to be able to mute mikes, as the owner of the chat,
00:08:42.805 --> 00:08:45.385
but I am unable to mute Halima's for some reason
00:08:45.385 --> 00:08:47.854
and that is where the echo is coming from.
00:08:47.854 --> 00:08:53.118
So, Halima, could I ask if you could click on the "mute" on your mike when not speaking?
00:08:53.118 --> 00:08:56.133
And if you want to unmute, you can always speak to us.
00:08:56.133 --> 00:08:58.294
That is where our echo is coming from.
00:08:58.709 --> 00:09:03.525
And okay, I will do what Phil has asked me to do and pull up 'Curation Nation'.
00:09:04.801 --> 00:09:06.185
>> Hubbard: laughs Alright, thanks.
00:09:06.741 --> 00:09:10.701
Anyway, this is not a book about education by any stretch,
00:09:10.701 --> 00:09:17.721
but it did come up with this notion that we have so much material on-line now
00:09:17.721 --> 00:09:21.692
and we are having so much difficulty in sorting out
00:09:21.692 --> 00:09:26.891
what the good stuff is from the chaff, for any reason, for news and so on.
00:09:26.891 --> 00:09:29.052
Now we have all these feeds:
00:09:29.990 --> 00:09:37.173
You know, if you -- those of you on Twitter or any of the other networks that have lots of feeds,
00:09:37.173 --> 00:09:41.142
you get the -- even Google+ -- you get feeds from your friends,
00:09:41.142 --> 00:09:47.974
you get feeds from people that whoever runs the site thinks might be interesting to you
00:09:47.974 --> 00:09:51.139
and you are just overwhelmed with an enormous amount of material.
00:09:51.139 --> 00:09:53.054
Some of it's pretty cool.
00:09:53.715 --> 00:09:59.156
Much of it is stuff you wouldn't find on your own and that's great.
00:09:59.586 --> 00:10:03.788
But when you've got the specific target of trying to improve your language
00:10:03.788 --> 00:10:09.074
-- and of course, the group that I work with doesn't actually do a whole lot with social media
00:10:09.074 --> 00:10:13.669
because they don't have time as full-time graduate students --
00:10:13.669 --> 00:10:17.406
I am lucky if I can squeeze a few hours out of them to do the work
00:10:17.406 --> 00:10:20.241
that they need for the course that they are taking for credit from me.
00:10:20.241 --> 00:10:28.026
So, this notion of curation is based roughly
00:10:28.026 --> 00:10:35.591
on the idea of what people do in museums and in art galleries.
00:10:36.683 --> 00:10:42.346
You get an expert, somebody who actually knows a fair amount about a particular area
00:10:42.346 --> 00:10:50.067
and you have that expert create collections, add value to them in one way or another,
00:10:50.759 --> 00:10:56.363
and then you release those collections for the consumer - whoever it might be --
00:10:56.363 --> 00:10:59.565
to have a look at and to interact with.
00:11:00.964 --> 00:11:06.434
So, the key difference between this and what a lot of people are doing with this material
00:11:06.434 --> 00:11:11.308
-- you may have heard concepts like "digital curation",
00:11:11.308 --> 00:11:14.558
which can just mean curating digital materials
00:11:14.558 --> 00:11:18.503
but often means that computers are doing the job for you.
00:11:19.994 --> 00:11:22.444
Google news is a really good example of that:
00:11:22.444 --> 00:11:28.187
I find a lot of interesting stuff in there, I can even ask it to find particular categories,
00:11:28.863 --> 00:11:32.475
but it's still being selected without any human intervention.
00:11:33.198 --> 00:11:35.557
You compare that with something like Huffington Post,
00:11:35.557 --> 00:11:40.208
which is material that's been brought in by people who are
00:11:40.700 --> 00:11:45.423
-- in some cases, they're producing it, but in other cases they are aggregating it
00:11:45.423 --> 00:11:48.129
and trying to make sense out of it for the rest of us.
00:11:49.313 --> 00:11:57.321
So, a key point here is that curation isn't the same as aggregation, or listing, or tagging.
00:11:57.321 --> 00:12:01.378
It's okay to use that term for that but that's not the way I am using it.
00:12:02.378 --> 00:12:09.164
There is a really nice quote in my slide there that -- I think it's maybe --
00:12:09.164 --> 00:12:17.368
two more slides down, Vance. One more. There you go. Past curation.. yeah, that one.
00:12:17.368 --> 00:12:23.741
So this is - it's maybe a little mean, but I think it's right on point
00:12:23.741 --> 00:12:28.623
that when you just get collections of things, you've just got collections of things
00:12:28.623 --> 00:12:34.513
and its not necessarily anything other than "these are things that I liked"
00:12:34.513 --> 00:12:36.666
or "these are things that I think you will like".
00:12:37.342 --> 00:12:42.645
So, I prefer the next slide: you want to go to it, Vance?
00:12:44.566 --> 00:12:46.877
This is more the way I see curation,
00:12:46.908 --> 00:12:50.737
where you collect material, you organize it,
00:12:50.737 --> 00:12:53.748
there is even the potentially a path, well, there is certainly a path
00:12:53.748 --> 00:12:56.101
through the individual material groups,
00:12:56.101 --> 00:12:57.985
and then mayble even a path through the groups,
00:12:57.985 --> 00:13:00.631
although at the moment I haven't done that last point.
00:13:01.061 --> 00:13:05.415
So, this is, you know, kind of captures the idea that I want to talk about today.
00:13:07.291 --> 00:13:13.432
Curation, importantly, is not the same as creation or recreation
00:13:13.432 --> 00:13:18.596
or adaptation or sampling, or synthesizing.
00:13:19.257 --> 00:13:24.761
It's taking the material and adding something to it, maybe just a commentary,
00:13:24.761 --> 00:13:31.052
maybe just collecting it into some logical framework or logical sequence.
00:13:32.175 --> 00:13:40.250
So, when I took that idea, which I was getting through the Curation Nation book,
00:13:40.250 --> 00:13:44.483
and thought about it with respect to the material that I was using,
00:13:45.159 --> 00:13:49.541
I decided to experiment with that and come up
00:13:49.541 --> 00:13:57.217
with some collections of materials from -- as you probably know from the title here and also the PDF,
00:13:57.217 --> 00:13:59.723
if you've had a look at it -- comes from TED Talks.
00:14:00.476 --> 00:14:04.232
And in a moment I will talk about why I think TED talks is so good for that
00:14:04.232 --> 00:14:07.827
but at the base level, these were very popular with my students.
00:14:08.242 --> 00:14:10.465
What the students were doing more--
00:14:10.465 --> 00:14:14.168
they were having trouble coming up with good ones.
00:14:14.168 --> 00:14:16.931
They would always pick what was interesting
00:14:16.931 --> 00:14:19.268
and then often come back to me and say
00:14:19.268 --> 00:14:24.707
"Well, this was interesting, but I had trouble understanding it because my --
00:14:24.707 --> 00:14:29.656
the accent of the speaker was not easy for me to understand."
00:14:29.656 --> 00:14:33.436
or "I had trouble understanding it because -- it was interesting
00:14:33.436 --> 00:14:36.837
because I didn't know anything about it and I didn't have the background
00:14:36.837 --> 00:14:39.431
so there was a whole bunch of new vocabulary."
00:14:40.176 --> 00:14:42.461
So t could be interesting for all sorts of reasons,
00:14:43.061 --> 00:14:45.206
but it wasn't interesting for the right reasons,
00:14:45.206 --> 00:14:48.763
for what we think is good for independent language learning.
00:14:48.763 --> 00:14:54.022
Again, this doesn't mean that all of those collections, with the help of a teacher,
00:14:54.022 --> 00:14:57.007
couldn't have been very valuable in a classroom
00:14:57.007 --> 00:15:01.677
and especially getting to the content for connecting to discussions.
00:15:02.000 --> 00:15:05.423
But that's not the same thing as letting students work on their own.
00:15:05.423 --> 00:15:07.880
So, I do want to emphasis that.
00:15:07.880 --> 00:15:10.543
My perspective here, at least initially,
00:15:10.543 --> 00:15:14.879
is getting students to be able to do these things outside of class
00:15:14.879 --> 00:15:16.921
and then just come back and report on them
00:15:16.921 --> 00:15:21.143
rather than having something we do in class
00:15:21.143 --> 00:15:24.026
or that everybody does the same homework assignment on.
00:15:25.887 --> 00:15:33.516
Alright, so that's the set-up for what I believe curation should be,
00:15:33.516 --> 00:15:35.935
or at least can be, within this framework.
00:15:35.935 --> 00:15:40.968
So, I think what I'll do here is pause for a second and see if anybody has questions.
00:15:40.968 --> 00:15:46.983
and bring it up by trying to look at some of the chat pieces here
00:15:48.106 --> 00:15:51.352
Uh -- [he hums]
00:15:51.994 --> 00:15:53.539
[reading:] "What is meant by sign..."
00:15:53.539 --> 00:15:56.667
OK, so some of these chats are to each other about the chats.
00:15:56.823 --> 00:15:58.219
So I got to go to the other window
00:15:59.488 --> 00:16:06.801
Uh -- anybody -- anybody have any questions here?
00:16:06.801 --> 00:16:08.187
If not, I'll continue on.
00:16:09.446 --> 00:16:12.809
>> Stevens: I have to admit I have trouble following all the chats.
00:16:12.809 --> 00:16:17.614
There's also a back channel here, with Google: some people could be in that one.
00:16:17.614 --> 00:16:20.877
I never see that one until I get off of --
00:16:20.880 --> 00:16:26.476
>> Hubbard: Well, the last chat -- the last piece on the group chat said:
00:16:26.686 --> 00:16:28.646
"Yeah, we agree with you, Phil."
00:16:28.621 --> 00:16:29.849
So: that's great.
00:16:29.849 --> 00:16:33.861
I'll stop [check] there and if everybody agrees with me, I don't really need to --
00:16:34.495 --> 00:16:37.118
>> Stevens: you need go no further
>> Hubbard: [overlapping, inaudible]
00:16:37.200 --> 00:16:38.715
No [Hubbard and Stevens laugh]
00:16:38.976 --> 00:16:41.808
>> Hubbard: OK, well, so, again, that's kind of the background,
00:16:43.113 --> 00:16:46.913
this idea that I needed to start collecting things.
00:16:46.913 --> 00:16:50.611
So, I'm still kind of almost two years in the past, now,
00:16:51.241 --> 00:16:54.997
telling you the story of how I got to where I got here.
00:16:55.064 --> 00:16:59.014
So I picked TED talks and I started going into TED talks.
00:17:00.594 --> 00:17:03.696
I wasn't quite sure how I wanted to collect them
00:17:03.696 --> 00:17:06.494
but I knew there were some of the ones that I liked
00:17:06.494 --> 00:17:11.218
and I also knew some characteristics that I thought were useful for the students.
00:17:12.709 --> 00:17:15.601
I thought it was important to collect them into themes.
00:17:16.270 --> 00:17:21.069
You know, we've known for a long time that if you have related content,
00:17:21.069 --> 00:17:25.790
that it kind of feeds -- the materials feed one another
00:17:25.790 --> 00:17:29.920
and the students get probably a better and a richer experience,
00:17:29.956 --> 00:17:32.986
they get more natural repetition and key vocabulary
00:17:32.996 --> 00:17:36.425
than if you have people just kind of jumping out piecemeal
00:17:36.855 --> 00:17:40.002
with unconnected bits of material.
00:17:40.944 --> 00:17:48.436
I -- in the 1980's I was forced to teach a course with a book I don't remember the name of that.
00:17:48.436 --> 00:17:48.686
I do remember the author, but I'm not going to mention it on air.
00:17:51.517 --> 00:17:59.717
It was a reading textbook and the reading textbook had really interesting little chapters,
00:17:59.717 --> 00:18:02.103
at least most of them were interesting to me,
00:18:02.634 --> 00:18:05.397
but, you know, one chapter would be on the Olympics
00:18:05.397 --> 00:18:07.681
and the next chapter would be on sea-horses.
00:18:08.707 --> 00:18:14.054
And it's that kind of jumping around -- we typically don't do that with textbooks anymore.
00:18:14.189 --> 00:18:18.099
And yet when we turn students loose, a lot of times, that's what they decide to do.
00:18:19.584 --> 00:18:22.829
So again, even though I had been giving them guidance, saying:
00:18:22.839 --> 00:18:28.462
"Well, collect several bits of, you know, pieces of material, videos or podcasts
00:18:28.462 --> 00:18:31.050
that are related to one another in some way,"
00:18:31.806 --> 00:18:35.553
they wouldn't follow that advice, because it hadn't been done for them.
00:18:35.553 --> 00:18:42.310
They were still kind of chasing around, looking for the spots that just seemed interesting.
00:18:44.428 --> 00:18:49.208
OK. I think what I'll do is tell you what the
00:18:50.112 --> 00:18:53.592
-- at a kind of the abstract level, what I came up with
00:18:53.592 --> 00:18:56.469
about what the curator's role should be.
00:18:57.255 --> 00:19:02.039
And again, this is specifically for this target audience,
00:19:02.039 --> 00:19:05.950
but I think it can be tweaked and extended to other ones.
00:19:06.548 --> 00:19:10.976
The first thing you have to do is collect the stuff: you want digital materials,
00:19:11.206 --> 00:19:14.342
you want to organize them in some way:
00:19:15.278 --> 00:19:18.059
mine are organized systematically, but you could do
00:19:18.250 --> 00:19:21.119
-- you know, you could take news stories and do them chronologically.
00:19:22.972 --> 00:19:28.712
You need to sequence them and this is where a lot of collections fall short.
00:19:28.732 --> 00:19:32.150
They're just -- they're either randomly sequenced
00:19:32.470 --> 00:19:34.180
or they're not sequenced at all.
00:19:34.751 --> 00:19:40.448
And I think it is possible, as, you know, as the resident [check] expert, the teacher,
00:19:40.921 --> 00:19:41.923
to be able to say:
00:19:41.923 --> 00:19:48.039
"Here's a way to move so that the earlier ones might be a little bit easier to follow
00:19:48.549 --> 00:19:53.496
and the later ones are better understood if you've done the earlier ones."
00:19:54.765 --> 00:19:56.653
The fourth point there that
00:19:56.653 --> 00:19:58.350
-- on the slide that Vance has --
00:19:58.350 --> 00:20:01.791
is the hardest part of all of this,
00:20:02.563 --> 00:20:07.479
and that is trying to get this material levelled in some way.
00:20:08.465 --> 00:20:12.049
Wilfried Decoo in 2010 wrote a book, it's at the end
00:20:12.049 --> 00:20:15.115
-- the reference is at the end of the slideshow here --
00:20:15.840 --> 00:20:17.528
on systemization.
00:20:17.540 --> 00:20:20.248
And it was kind of a return to the idea that
00:20:20.618 --> 00:20:24.057
even if you're using authentic material,
00:20:24.057 --> 00:20:27.410
and especially if you're trying to create course material yourself,
00:20:27.940 --> 00:20:35.059
that you need to have a kind of natural development of that material
00:20:35.059 --> 00:20:38.564
from, you know, easier at lower levels, to harder
00:20:38.949 --> 00:20:43.671
and he went to the point of even talking about keeping databases
00:20:43.681 --> 00:20:45.156
that were very finely tuned,
00:20:45.156 --> 00:20:50.289
so you would be able to pull out lexical items and grammatical points and so on
00:20:50.289 --> 00:20:54.224
in a scope and sequence that fit
00:20:54.224 --> 00:20:56.640
what we thought we knew about language learning.
00:20:57.776 --> 00:21:01.588
And you know his -- I think his perspective is
00:21:01.588 --> 00:21:05.546
what I think is a reasonable one to bring up again,
00:21:05.592 --> 00:21:11.317
because I think we are often not cognizant of the difference between
00:21:11.317 --> 00:21:16.572
accessible and barely accessible and inaccessible materials,
00:21:16.572 --> 00:21:19.549
especially now that students can go in and, you know,
00:21:19.549 --> 00:21:27.174
get their first-language subtitles and transcripts for a lot of these materials
00:21:27.174 --> 00:21:32.854
and then have the illusion that they are actually understanding the English, in this case,
00:21:34.115 --> 00:21:38.173
and that they're building their English proficiency, where they --
00:21:38.173 --> 00:21:44.132
-- they may be to some extent, but probably not to the extent that they think they are.
00:21:44.148 --> 00:21:49.700
So there is the, you know, that idea of --
00:21:51.270 --> 00:21:54.711
well, in Decoo's book of fine tuning material.
00:21:54.711 --> 00:21:58.265
That doesn't work for me because at the levels I have,
00:21:58.265 --> 00:22:01.301
first of all, I have mixed-level classes to some degree,
00:22:01.301 --> 00:22:03.437
although they are all fairly advanced.
00:22:03.437 --> 00:22:07.878
They come from different backgrounds, I don't know what they know going in.
00:22:08.570 --> 00:22:13.225
So it's a little tricky to do it in the way that he likes.
00:22:13.640 --> 00:22:19.266
But it still gave me the impetus to try and see if I could come up with something,
00:22:19.266 --> 00:22:21.970
you know, I'll show you that in a bit.
00:22:22.555 --> 00:22:27.901
So, the last part of that, then, once you can give at least some kind of level information,
00:22:27.901 --> 00:22:34.435
is to go ahead and then present your pedagogical support,
00:22:34.435 --> 00:22:36.066
whatever it might be.
00:22:36.850 --> 00:22:44.765
This is fairly open-ended, I mean teachers can get -- and often do get -- into material
00:22:44.765 --> 00:22:48.065
and they start stripping out what they think are key vocabulary,
00:22:48.065 --> 00:22:52.777
they produce, you know, pre-listening activities,
00:22:52.777 --> 00:22:56.745
they have post-listening activities,
00:22:56.745 --> 00:22:58.151
they have discussion activities.
00:22:58.151 --> 00:23:02.223
All these are great, but they're based kind of on a classroom model
00:23:02.223 --> 00:23:06.587
and even more important: they take a lot of time away
00:23:06.587 --> 00:23:11.287
from the job of collecting this material.
00:23:11.287 --> 00:23:15.325
So if you put the hours into making full lessons,
00:23:15.535 --> 00:23:20.659
you end up not having the time to even produce as much as I have,
00:23:20.679 --> 00:23:23.019
which, as I mentioned, is not as much as I'd like.
00:23:23.984 --> 00:23:30.364
OK, so that's the curator's role and then -- Vance, if you could go to the next slide.
00:23:32.632 --> 00:23:33.708
Did we lose you?
00:23:33.990 --> 00:23:36.493
>> Museum curator MC [check]: Hi Phil, I just wanted to add to something you--
00:23:36.493 --> 00:23:37.298
>> Hubbard: Yes, go ahead
00:23:37.468 --> 00:23:38.835
>> MC: Just because of my background:
00:23:38.835 --> 00:23:42.315
I used to work in museums
>> Hubbard: Oh, fantastic
00:23:42.344 --> 00:23:44.974
>> MC: in education and curation
>> Hubbard: A real curator!
00:23:44.992 --> 00:23:49.311
>> MC: Yeah. Just one other item I would add to the list
00:23:49.311 --> 00:23:53.027
and I made a note of it in the chat section
00:23:53.027 --> 00:23:57.493
and that's the -- often without knowing it we're making assumptions about our audience.
00:23:58.108 --> 00:24:01.898
>> Hubbard: Ah!
>> MC: When we're selecting things,
00:24:02.271 --> 00:24:08.871
whether they be objects for display or -- like in the museums -- or
00:24:08.871 --> 00:24:12.502
objects for presentations to students, we're often unknowingly making assumptions
00:24:14.807 --> 00:24:19.404
and I think it's a really important thing to know, to challenge ourselves
00:24:19.404 --> 00:24:24.169
about the assumptions we're making in making those selections, those choices, as experts.
00:24:25.059 --> 00:24:27.409
>> Hubbard: Yeah, I mean that's a very good point
00:24:27.422 --> 00:24:34.204
and I have to -- as individuals, the students always change in my classes.
00:24:34.706 --> 00:24:38.776
As a group, you know, I get to know the group better.
00:24:38.776 --> 00:24:41.911
So I think, in this very targeted group, I can --
00:24:42.215 --> 00:24:47.501
I can come up with at least, initially, some likely ones,
00:24:47.721 --> 00:24:51.349
but I do in fact ask them for feedback on --
00:24:52.248 --> 00:24:56.428
Well, first of all, I give them choices and then I ask them for feedback
00:24:56.450 --> 00:25:01.795
both on, you know, what they chose and why, of the ones I selected for them,
00:25:01.795 --> 00:25:05.816
and also what else they might like to see.
00:25:06.712 --> 00:25:09.048
So it becomes a little bit od a dialog,
00:25:09.063 --> 00:25:13.252
and that could be even more of a dialog, you know, if you have --
00:25:13.559 --> 00:25:17.375
the way my class is structured, again, because it's so small,
00:25:17.388 --> 00:25:23.568
we do a lot both within class discussion and with the individual tutorials.
00:25:23.568 --> 00:25:28.335
But if you got a larger class and you got a discussion board or a wiki or something like that
00:25:28.335 --> 00:25:32.402
where, you know, students can -- can chime in more regularly,
00:25:32.402 --> 00:25:35.071
then you could get some information.
00:25:35.071 --> 00:25:42.596
I also haven't formally surveyed them, so that would be useful too. I --
00:25:42.596 --> 00:25:46.832
>> MC: You're inviting their feedback to inform --
>> Hubbard: Very much so. Yeah.
00:25:46.832 --> 00:25:49.637
>> MC: Yeah --
>> Hubbard: But not as richly as I could.
00:25:49.637 --> 00:25:54.600
So one idea I had was that, you know, like you've seen probably in museums,
00:25:56.450 --> 00:26:02.146
sometimes they have the displays but they'll also have, you know,
00:26:02.155 --> 00:26:04.710
places where people can, you know, write cards
00:26:04.710 --> 00:26:08.744
and make suggestions and say things and drop those off
00:26:08.744 --> 00:26:15.303
and I think, probably increasingly, we'll see museum displays
00:26:15.303 --> 00:26:24.598
where the, you know, the viewers' thoughts are right up there and accessible to other viewers
00:26:24.598 --> 00:26:26.875
when they go to look at the material.
00:26:27.765 --> 00:26:36.956
So I think you're making a really good point and, you know, this is the --
00:26:37.755 --> 00:26:42.788
figuring out exactly the role of the students who are still kind of developing,
00:26:42.788 --> 00:26:48.598
you want to meet them half way but you also, in the curation model, I think,
00:26:48.598 --> 00:26:52.490
want to be careful about the difference between curation and crowdsourcing,
00:26:53.520 --> 00:26:56.068
because I've had students come up with some materials
00:26:56.068 --> 00:26:57.755
that they thought were really exciting,
00:26:58.109 --> 00:26:58.359
but when I looked at it, I could see what the problems were in terms of the --
00:27:04.248 --> 00:27:07.042
the use of it by other students.
00:27:08.155 --> 00:27:10.749
>> MC: Now I take your point: it's you acting as the filter.
00:27:10.959 --> 00:27:12.484
>> MC: and finding --
>> Hubbard: Yeah, and that's --
00:27:12.511 --> 00:27:16.946
and again that's -- and again that's the -- this is the kind of, to me, this the curation model.
00:27:17.354 --> 00:27:19.426
>> MC: Yeah
>> Hubbard: The crowdsourcing model
00:27:19.426 --> 00:27:21.852
is a great model too, it's just a different model
00:27:21.852 --> 00:27:24.981
and it may work better in some cases.
00:27:24.981 --> 00:27:28.426
Of course it also depends on, you know,
00:27:28.426 --> 00:27:32.788
I've been to museums that I didn't think were very well run, were very well organized
00:27:32.791 --> 00:27:34.046
or were confusing.
00:27:34.046 --> 00:27:34.851
So --
>> MC: Yeah.
00:27:34.851 --> 00:27:37.056
>> Hubbard: as soon as you have the human expert coming in,
00:27:37.405 --> 00:27:40.693
they may not be as much of an expert as they think they are.
00:27:41.178 --> 00:27:44.180
That's probably true of me, in fact.
>> MC: Yeah, and there are lots of people [check]
00:27:44.180 --> 00:27:47.537
a lot of examples of museums, because I'm into curating things
00:27:48.783 --> 00:27:54.622
and then I'm finding out that the interpretations that they were expecting audiences to have
00:27:54.622 --> 00:27:56.452
were completely off-base.
00:27:56.721 --> 00:27:58.624
>> Hubbard: Yeah.
>> MC: I think that's a good example
00:27:58.624 --> 00:28:05.901
of big money going into these exhibitions and then being interpreted in a completely unexpected --
00:28:05.901 --> 00:28:09.318
>> Hubbard: Yeah, well, the good news here is, I have no big money.
00:28:09.318 --> 00:28:13.184
I mostly have no money at all for this. So -- [he laughs]
00:28:13.660 --> 00:28:18.035
It's also, the nice thing is, you know, compared to the museum,
00:28:18.035 --> 00:28:23.779
where you have all of these Unkosten [? check] to putting the material in,
00:28:24.025 --> 00:28:26.063
once you have something, you start a web page:
00:28:26.063 --> 00:28:34.435
if it is a disaster, or if it needs to be tweaked or significantly changed,
00:28:34.435 --> 00:28:38.265
it's possible to do that just by finding a little bit of time.
00:28:40.726 --> 00:28:44.331
[MC and Hubbard overlap]
>> MC It's just [missed words check]
00:28:44.331 --> 00:28:48.094
There's even an opportunity, actually, in, as an expert,
00:28:48.094 --> 00:28:52.110
putting together a series of well-chosen articles
00:28:52.110 --> 00:28:57.165
and then inviting students to assemble them and put them into a -- into an order or sequence,
00:28:57.165 --> 00:29:01.309
and to try and explain the rationale that they've used,
00:29:01.309 --> 00:29:03.255
what connections they've seen in the works.
00:29:03.255 --> 00:29:05.960
It's just another angle to it I sure would --
00:29:05.960 --> 00:29:08.911
>> Hubbard: No, it's a very good angle and in fact, you know,
00:29:08.911 --> 00:29:16.363
as I've moved through stages in probably about 15 years of teaching this course,
00:29:16.363 --> 00:29:23.279
I've tried to give students more independence but also to give them guidance in that independence
00:29:23.279 --> 00:29:28.371
and one of the -- what I hope I'm doing with the material I have,
00:29:28.371 --> 00:29:30.667
I do show them how I put it together.
00:29:30.667 --> 00:29:34.766
And I hope I'm, you know, kind of modeling curation for them as well.
00:29:35.627 --> 00:29:41.664
The idea of getting them to maybe do a little curated piece of their own,
00:29:42.771 --> 00:29:45.914
that could be an interesting final project for the course.
00:29:45.914 --> 00:29:48.982
I will be revisiting it again in Spring.
00:29:49.658 --> 00:29:52.731
I'll be away from it in Winter quarter here
00:29:52.731 --> 00:29:54.677
because we have -- we teach 10-week quarters.
00:29:55.677 --> 00:29:59.355
But that's a possibility for Spring, actually.
00:29:59.355 --> 00:30:04.231
It could also greatly enrich the collection of material that's available to other students.
00:30:04.231 --> 00:30:08.111
Again, as long as I'm there to be a kind of a filter,
00:30:08.111 --> 00:30:10.566
rather than just releasing these into the wild.
00:30:11.504 --> 00:30:14.813
Or if I do release them, you know, making sure that students know the difference
00:30:14.813 --> 00:30:18.486
between ones that are student-produced and the once that I produced
00:30:18.486 --> 00:30:21.756
and why, you know, I did mine one way.
00:30:21.756 --> 00:30:26.381
Then they can -- they can judge to some extent, you know,
00:30:26.381 --> 00:30:32.144
whether they think the rationale used by their peers, you know, was useful for them.
00:30:32.144 --> 00:30:35.683
So, that's a nice idea, I'm making a note of that.
00:30:40.174 --> 00:30:42.468
OK, shall I move on?
00:30:42.468 --> 00:30:48.754
>> [Stevens? check] Yeah. I'm aware of a podcast - there's the slide on I'm talking --
00:30:48.754 --> 00:30:50.669
>> Hubbard: Yeah, thanks
[they laugh]
00:30:50.669 --> 00:30:56.384
>> Stevens (?): I listened to a podcast where some educators had gone to Europe,
00:30:56.384 --> 00:30:59.005
probably on a junket but ostensibly
[Hubbard laughs]
00:30:59.005 --> 00:31:01.594
>> Stevens: to visit museums and find out, you know,
00:31:01.594 --> 00:31:05.349
especially ones that had audience attract--
00:31:05.349 --> 00:31:09.204
you know, the idea was that museums, people didn't have to go there,
00:31:09.204 --> 00:31:10.380
they have to attract people.
00:31:10.380 --> 00:31:13.986
So what do they do to attract the people, as opposed to schools?
00:31:13.986 --> 00:31:17.841
And then, how can we design our classroom environment
00:31:17.841 --> 00:31:19.294
so it's more like a museum?
00:31:19.294 --> 00:31:23.631
So that was actually a serious project and I'll never remember --
00:31:23.631 --> 00:31:30.044
I'll never forget how to get it back, but maybe I will tell you in Portmont [check].
00:31:30.044 --> 00:31:32.599
>> Hubbard: Ah OK? So that was good.
00:31:33.080 --> 00:31:38.012
Yeah, so Vance has put up the slide that I wanted to make a point of here,
00:31:38.012 --> 00:31:41.871
because there are a couple of things that are important about this slide, I think.
00:31:42.563 --> 00:31:45.804
The first is, even though these are just little bullet points,
00:31:45.804 --> 00:31:51.668
that actually took me a while to kind of figure this out, maybe because I'm slow, but --
00:31:52.298 --> 00:31:54.842
Oop, Vance, I lost the slide.
>> Stevens: it is here again? >> Hubbard: thanks.
00:31:58.025 --> 00:32:01.920
Because of all the other distractions I have
00:32:03.381 --> 00:32:10.931
and because of other elements of where I am and what the -- sort of the visibility,
00:32:11.300 --> 00:32:18.985
the first thing I have to make sure is that anything that I curate is actually legally available.
00:32:20.969 --> 00:32:26.269
And a certain amount of stuff that I had used years before, even in my own class,
00:32:27.238 --> 00:32:32.877
I wasn't quite so sure about what the legality was, I think, in the early days of the internet.
00:32:33.861 --> 00:32:38.880
Even now with YouTube I try to be careful about making sure that
00:32:38.880 --> 00:32:43.133
what I've found is something that whoever put it up either has the right to
00:32:43.133 --> 00:32:45.597
or they're reposting something that is --
00:32:45.597 --> 00:32:50.785
that's already got a Creative Commons license or something like that.
00:32:51.166 --> 00:32:55.123
So, especially for something I'm going to put some time into here,
00:32:55.123 --> 00:32:59.430
I want to make sure that what I've got is something I can use.
00:32:59.430 --> 00:33:01.621
I also always want to make it freely available
00:33:01.621 --> 00:33:05.464
because my students have friends back in their home countries
00:33:05.464 --> 00:33:10.798
and they have even colleagues here who don't end up taking my class
00:33:11.644 --> 00:33:17.455
and I have colleagues that are interested in using some of the material I do,
00:33:17.455 --> 00:33:23.949
so everything I do in this kind of a project, I try to make sure it's freely available on the Web.
00:33:24.769 --> 00:33:29.036
Vance, we lost the slide again, or at least I did.
[incomprehensible metallic voice - check]
00:33:29.036 --> 00:33:32.712
>> Hubbard: Oh wait, is this Halima saying something? Uh, you know--
00:33:32.712 --> 00:33:37.752
>> Stevens: No, Halima is unmuting herself as soon as she comes into the chat.
00:33:37.752 --> 00:33:41.633
So I'm going to have to -- Halima, can you mute your microphone?
00:33:42.571 --> 00:33:44.194
Because it's causing feedback.
00:33:45.009 --> 00:33:50.652
And I hope you can figure that out, and meanwhile we put this back.
00:33:50.667 --> 00:33:54.120
Is it back yet [missed words check] Phil?
>> Hubbard: Yeah, that's great. >> Vance: OK
00:33:55.012 --> 00:33:59.666
>> Hubbard: Yeah, so the "freely and legally available" is an important quality
00:33:59.666 --> 00:34:03.582
and you know, TED talks obviously are ideal for that.
00:34:04.458 --> 00:34:06.373
They're likely to be interesting.
00:34:06.373 --> 00:34:09.829
Again that's something -- oops, lost the slide again,
00:34:10.705 --> 00:34:12.604
but I'll just go ahead and walk through these.
00:34:13.050 --> 00:34:19.808
"Likely to be interesting", I guess that connects to a previous commentary [laughs]
00:34:19.808 --> 00:34:22.506
that we don't always know what students think are interesting,
00:34:23.429 --> 00:34:25.675
but I try to pick things that I think are,
00:34:25.675 --> 00:34:29.839
you know, have a good chance of being interesting for the students.
00:34:31.639 --> 00:34:37.032
The good technical quality: there is a lot of stuff, obviously,
00:34:37.032 --> 00:34:44.375
available on the Web that's not, that's interesting and freely and legally available,
00:34:45.328 --> 00:34:51.656
but the technical quality is such that it may be less ideal for language learning.
00:34:53.254 --> 00:34:57.517
We're getting better at that now, certainly, than in the old days,
00:34:57.517 --> 00:35:04.043
but when - when you're looking for material, if it's been overly compressed,
00:35:04.043 --> 00:35:07.392
or it was done with devices that weren't that good in the first place,
00:35:08.607 --> 00:35:13.418
it doesn't necessarily lend itself as well for language learning.
00:35:13.956 --> 00:35:18.189
Stability is a really important point, because I don't want to do this
00:35:18.804 --> 00:35:24.400
and then find out what I did is not available the next time I teach the class,
00:35:24.400 --> 00:35:26.253
or even the next week.
00:35:26.729 --> 00:35:32.188
So again, finding material that has -- either has been up for a while
00:35:32.188 --> 00:35:35.562
or that you know is going to continue to be up for a while.
00:35:36.522 --> 00:35:41.262
The 5th one is a -- you know, people have different views of this,
00:35:41.262 --> 00:35:47.670
but because I'm so tied in with vocabulary development along with comprehension,
00:35:48.546 --> 00:35:55.584
to me it's critical to have captions at least -- [coughs] excuse me, losing my voice here --
00:35:58.333 --> 00:36:03.074
to have captions at least and ideally, to have transcripts.
00:36:03.074 --> 00:36:08.933
And one of the reasons for transcripts is to be able to try to use some material
00:36:09.609 --> 00:36:12.837
which I'll show you in a moment here some of you are probably familiar with:
00:36:12.837 --> 00:36:16.182
the vocabulary profile from lextutor.
00:36:16.766 --> 00:36:22.106
By using -- by dumping the transcript into that, you can get an idea of levelling.
00:36:23.749 --> 00:36:25.525
And if you don't have a transcript,
00:36:25.525 --> 00:36:29.821
then you have to kind of use just intuitive feels for what's the level.
00:36:29.821 --> 00:36:34.194
Then I've personally seen some pretty significant problems with that.
00:36:35.058 --> 00:36:37.755
I may mention one towards the end here
00:36:37.755 --> 00:36:42.397
when I get to some of the alternative sites I know that already exist for this.
00:36:43.182 --> 00:36:45.411
And then ideally, if you can find complem --
00:36:45.411 --> 00:36:47.341
something that has complementary materials.
00:36:47.694 --> 00:36:51.930
Again, in the case of TED talks, you've got materials that are --
00:36:52.837 --> 00:36:59.487
you have a brief summary of whatever the talk is, right there available,
00:36:59.487 --> 00:37:02.246
you don't have to create it as the curator,
00:37:02.246 --> 00:37:06.463
you've got the bio of the speaker, which is good background information,
00:37:06.939 --> 00:37:11.979
and in some cases you even have -- I think, what do they call it, TED Ed or something --
00:37:11.979 --> 00:37:17.160
there are some TED talks that even have some additional material that --
00:37:17.160 --> 00:37:22.277
that people have added to them, in the way of discussion questions and things like that.
00:37:23.015 --> 00:37:28.138
TED's not as rich as, say, you know, if you're doing a newscast for example,
00:37:28.138 --> 00:37:34.395
and you might have several written forms of the same news story
00:37:34.395 --> 00:37:35.910
that you can use for back up:
00:37:35.910 --> 00:37:37.363
it's not quite as rich as that,
00:37:37.363 --> 00:37:44.202
but it's still pretty good with giving you some of these complementary materials, besides the video itself.
00:37:46.786 --> 00:37:50.293
OK. You want to move on to the next --
00:37:51.984 --> 00:37:54.729
>> Hubbard: Actually, it's probably the next couple of slides
>> Stevens: Yeah.
00:37:54.729 --> 00:37:56.136
>> Hubbard: does someone have a question?
00:37:56.689 --> 00:38:04.026
>> Stevens [check]: Yes, Peggy George has asked questions in the text chat, the Etherpad one.
00:38:04.795 --> 00:38:06.710
Let's see, I can -- she asks:
00:38:06.710 --> 00:38:10.976
"Are your students able to share your curated content with others outside the course?"
00:38:10.976 --> 00:38:15.266
>> Hubbard: Yes. Yes, som you'll see the --
00:38:15.266 --> 00:38:20.397
in fact I think it comes up here on the next slide or couple of slides.
00:38:20.397 --> 00:38:25.352
Actually the next slide, if you go to the next slide, let me talk briefly about that,
00:38:25.352 --> 00:38:30.531
because it does have to do with the sharing.
>> Stevens: Mmm - OK
00:38:30.924 --> 00:38:36.351
>> Hubbard: So that the link there is to the advanced listening website
00:38:36.351 --> 00:38:39.045
and you'll see, you know, quite a bit of material there,
00:38:39.045 --> 00:38:40.506
not just the TED talks.
00:38:41.223 --> 00:38:45.365
The link - the specific link to the curated TED talks is a couple of slides from here
00:38:45.365 --> 00:38:52.346
but those are -- those themselves are legally and freely available.
00:38:52.346 --> 00:38:55.430
They're my websites, they are on the Stanford server:
00:38:55.430 --> 00:39:01.159
Stanford is not going away any time soon, as far as I know I'm not going away any time soon.
00:39:01.635 --> 00:39:06.380
So those are not only, you know, available on the World Wide Web,
00:39:06.380 --> 00:39:11.226
unless you happen to be from a country that is for some reason blocking access to Stanford:
00:39:11.702 --> 00:39:14.114
that has happened a few times in the past.
00:39:16.201 --> 00:39:19.125
But if not, then you can get to that material
00:39:19.125 --> 00:39:23.420
and all it does is jump out to the TED talks themselves
00:39:23.420 --> 00:39:26.641
and the TED talks again are, you know, freely available.
00:39:27.317 --> 00:39:31.073
I noticed in one of the preliminary discussions
00:39:31.073 --> 00:39:38.663
that somebody had put in some comments, before this began, on the learning2gether site,
00:39:38.663 --> 00:39:45.799
and mentioned YouTube videos, and YouTube videos are certainly a great resource,
00:39:46.460 --> 00:39:52.745
most of my students are from China and most of them, then, unless things have changed,
00:39:53.130 --> 00:39:57.879
can't freely and legally get the YouTube videos there.
00:39:58.491 --> 00:40:03.737
And so for that reason I try to -- I don't avoid YouTube
00:40:03.737 --> 00:40:07.812
but I try to limit it and I like to make the curated collections
00:40:07.812 --> 00:40:14.174
something that my students will be able to use and their friends will be able to use.
00:40:17.771 --> 00:40:19.946
OK. Any other questions?
00:40:21.019 --> 00:40:26.865
Uh, so, yeah, so they are available and when I -- just so you know --
00:40:26.880 --> 00:40:35.245
when I redo the course every quarter, that URL there stays the same, the material is new.
00:40:35.829 --> 00:40:38.552
Well, most of it is old actually, but I do update it
00:40:38.552 --> 00:40:41.418
sometimes because I come up with other ideas
00:40:41.418 --> 00:40:45.627
and sometimes because some of my other class material disappears.
00:40:47.119 --> 00:40:52.874
But the home page of that each quarter has the link to the previous quarter's materials,
00:40:52.874 --> 00:40:58.528
so you can actually step back from quarter to quarter and go back.
00:40:58.528 --> 00:41:04.268
I never throw anything away on the Web, so it's probably got stuff from 5 years ago
00:41:04.268 --> 00:41:09.394
if you keep clicking back through the previous quarters' material.
00:41:09.978 --> 00:41:16.009
So you can see what it was like in the past ["without"? check] sort of my own Internet Archive.
00:41:18.248 --> 00:41:24.538
OK. The way that I did this material, let me move on to the --
00:41:25.760 --> 00:41:27.536
Well, I guess on this slide,
00:41:28.243 --> 00:41:35.087
the problems that my students have, typically, fall into issues with speech rate:
00:41:35.579 --> 00:41:38.483
some of the TED talks are too fast.
00:41:38.483 --> 00:41:43.486
It doesn't mean they can't, you know, use top-down skills to understand the basic content,
00:41:43.486 --> 00:41:46.852
but that's not necessarily going to help them drive their --
00:41:46.852 --> 00:41:54.129
either their listening proficiency, you know, their ability to process English, automatize it,
00:41:54.129 --> 00:42:00.709
or their ability to pick out the vocabulary that they don't understand or --
00:42:00.709 --> 00:42:05.666
even more interesting is the vocabulary they sort of understand or partially understand,
00:42:05.666 --> 00:42:11.833
but they just can't get to it, they can't access it in the time with a faster speaker.
00:42:11.833 --> 00:42:16.700
And there are others in my class, actually, that do OK with some of the faster speakers,
00:42:16.700 --> 00:42:20.215
but just having knowledge of the speech rate is useful.
00:42:21.552 --> 00:42:28.016
Preliminary knowledge of the accent: just a -- since in some cases we have students
00:42:28.016 --> 00:42:33.663
that are having particular difficulties with particular accents, often of their professors,
00:42:34.647 --> 00:42:39.950
and they may actually be doing a project where they're trying to focus on that accent.
00:42:40.690 --> 00:42:45.640
And so in that case, knowing more about the accent is helpful.
00:42:45.640 --> 00:42:50.886
And others are really trying to -- I wouldn't say "master",
00:42:50.886 --> 00:42:59.161
but at least becoming -- become more proficient with the North American accent
00:42:59.161 --> 00:43:04.149
because they plan on not only doing their graduate work here, but staying a few years afterwards.
00:43:04.149 --> 00:43:10.060
It's a very common professional track for our students whether at the Master's or the Ph.D. level, to --
00:43:11.981 --> 00:43:15.330
because so many of them are in technology, they want to hang around Silicon Valley
00:43:15.330 --> 00:43:18.683
as much as the can after they, after the graduate.
00:43:20.223 --> 00:43:23.411
OK. If you could go to the next slide, Vance?
00:43:26.865 --> 00:43:30.330
>> Stevens: OK I might
[both overlap]
00:43:30.330 --> 00:43:35.744
>> Stevens: You mentioned Claude Almansi's contribution to the wiki earlier
00:43:35.744 --> 00:43:45.113
and one thing that she said -- she left this on the Google+ page as well:
00:43:45.113 --> 00:43:50.068
I post this to several pages.
Let me just get rid of that slide for a second.
00:43:50.068 --> 00:43:53.922
I see I can do that by clicking off the screen share for a second, OK?
00:43:53.922 --> 00:43:58.394
Well, anyway. She does work in closed captioning,
00:43:58.394 --> 00:44:01.842
she does a lot of very interesting work relating to MOOCs [check] where she is.
00:44:01.842 --> 00:44:08.343
And one of the suggestions she made -- I didn't know this, but maybe you did already,
00:44:08.343 --> 00:44:16.991
but you can -- she said you can, if you get the MP4, if you get an MP4 of a YouTube video,
00:44:16.991 --> 00:44:20.436
you can then load it into Audacity -- I didn't know that --
00:44:20.436 --> 00:44:29.521
and then you can adjust the rate of speech there, without causing any chipmunk effects.
00:44:30.182 --> 00:44:31.928
>> Hubbard: Mmm.
>> Stevens: I thought that was kind of neat.
00:44:31.928 --> 00:44:34.138
Sounds like useful information?
00:44:34.859 --> 00:44:45.063
>> Hubbard: Yeah, that's -- again, there are lots of things you can do to go more deeply into this stuff.
00:44:45.601 --> 00:44:52.019
I -- one of the things I do with TED talks is, you can also download TED talks and you can --
00:44:52.711 --> 00:44:58.337
even if you put them into something, well I use the VLC player,
00:44:58.337 --> 00:45:03.383
because the speech rate slider is right on the top,
00:45:03.383 --> 00:45:08.938
it's much easier to get at than it is in QuickTime or in Windows Media Player.
00:45:08.938 --> 00:45:12.050
I like the VLC player for other reasons, in fact.
00:45:12.495 --> 00:45:20.027
But, you know, once you have downloaded you can use the VLC player to --
00:45:21.532 --> 00:45:24.048
for the most part you don't really get the chipmunk effect
00:45:25.032 --> 00:45:29.930
because it's trying to expand the time domain without changing the frequencies,
00:45:29.930 --> 00:45:34.590
it's not like the old days with LP's and cassette tapes
00:45:34.590 --> 00:45:38.253
where time and frequency were connected to one another.
00:45:38.253 --> 00:45:41.161
Digitally, you can isolate those.
00:45:42.037 --> 00:45:47.079
What we found is that if you slow somebody down to about 80%,
00:45:47.079 --> 00:45:54.181
you can get a lot more processing time and it still sounds natural as long as you have good material.
00:45:55.011 --> 00:45:58.228
If you have material that's already been compressed too much,
00:45:58.228 --> 00:46:04.109
then those compression artefacts become stronger if you try to slow it down.
00:46:04.515 --> 00:46:08.955
Occasionally, we get people that my students want to speed up
00:46:08.955 --> 00:46:13.164
but most of the time, for language learning processes, we're talking about slowing it down.
00:46:14.040 --> 00:46:21.178
So it's -- using, changing speech rate, that's a whole different talk,
00:46:21.178 --> 00:46:31.456
but it's, I think, a very underused functionality and something that students sometimes baulk from
00:46:31.456 --> 00:46:41.000
but we have some research evidence that it's helpful when the students have control over it.
00:46:41.753 --> 00:46:44.627
Anyway, I don't want to diverge too much on that, but that's a --
00:46:44.627 --> 00:46:47.232
I do encourage everybody to read that post
00:46:47.232 --> 00:46:51.981
and see in more detail what some of the options are for doing that.
00:46:53.580 --> 00:47:00.362
In fact, one of the -- one of the problems with using the VLC player with those is,
00:47:00.362 --> 00:47:09.049
if you -- if you do try to slow down the speech rate by downloading it and putting it in the VLC player,
00:47:09.064 --> 00:47:12.298
you actually move the subtitles, because the subtitle feature --
00:47:13.159 --> 00:47:20.899
the captioning feature in the TED website is built into the website, it's not built into the video.
00:47:20.899 --> 00:47:26.627
And so you would need to do some additional captioning if you want to do that.
00:47:27.481 --> 00:47:34.506
My -- if your goal is general comprehension and you've got decent material,
00:47:35.044 --> 00:47:41.312
then I'm a fan of using the Google beta transcription.
00:47:43.695 --> 00:47:46.604
Even with good material, it makes a lot of mistakes
00:47:46.604 --> 00:47:50.136
and with material which, you know, isn't really, really clear,
00:47:50.136 --> 00:47:53.500
either because the speaker wasn't clear, or because the signal wasn't clear,
00:47:53.500 --> 00:47:54.853
it makes a lot more mistakes.
00:47:55.307 --> 00:47:59.597
And in my case, when I'm trying to have students use it for vocabulary development,
00:48:00.166 --> 00:48:05.289
if it's got -- if it picks the wrong word, then they're going to be learning something pretty weird.
00:48:05.289 --> 00:48:07.970
And it does that all the time.
00:48:08.624 --> 00:48:15.242
If you change that and, you know, get around to Google Translate, to get first-language captions,
00:48:15.242 --> 00:48:18.662
you just accentuate the error rate.
00:48:19.431 --> 00:48:22.725
So again, it really depends on what the goal is.
00:48:22.725 --> 00:48:29.445
If the goal is letting students watch a video for cultural and general content information,
00:48:29.983 --> 00:48:32.884
maybe to trigger classroom discussions, things like that,
00:48:32.884 --> 00:48:38.693
then using the automated captions is not a bad idea
00:48:38.693 --> 00:48:44.726
and being able to slow down is not necessarily -- is, well, I think a good idea.
00:48:46.620 --> 00:48:50.587
So again, it depends on what the goals are, but you have to be careful,
00:48:50.587 --> 00:48:54.117
because the Google beta, there is a reason why they keep calling it beta,
00:48:54.117 --> 00:48:57.572
it's because it's pretty error-prone.
00:48:58.418 --> 00:49:00.464
It's getting better but it's not there yet.
00:49:01.362 --> 00:49:04.721
And if students think it's an accurate rendition
00:49:04.721 --> 00:49:06.328
that's going to be even more difficult.
00:49:06.328 --> 00:49:12.756
If you do use the automated captions then the students need to be prepared for --
00:49:13.463 --> 00:49:16.414
you know, to be able to recognize when something doesn't make sense.
00:49:17.090 --> 00:49:19.737
It's usually -- it's a very obvious semantic issue
00:49:19.737 --> 00:49:21.506
with the words they pick.
00:49:24.072 --> 00:49:28.859
OK. One other thing, I don't remember if it was in that post or another one but
00:49:28.859 --> 00:49:36.097
something I hadn't noticed before someone mentioned that there is a slight delay
00:49:36.097 --> 00:49:39.881
in the synchronization of the captions in TED
00:49:40.296 --> 00:49:43.649
compared to the system that they were suggesting.
00:49:44.163 --> 00:49:48.985
So, uh, that's something else to take into account.
00:49:48.985 --> 00:49:54.082
You might, If that delay seems to be an issue for you or your students, then --
00:49:56.773 --> 00:50:00.845
it's something that I plan to explore because I hadn't noticed that before.
00:50:01.850 --> 00:50:05.785
Okay, a little bit about how I finally figured out to do this,
00:50:05.785 --> 00:50:09.164
which is not the way I would recommend doing it now necessarily
00:50:09.917 --> 00:50:17.277
But this is how I started working on this. When I did it I guess it was Spring of 2011.
00:50:18.184 --> 00:50:27.345
The first thing was to...oh no, it wasn't Spring: Fall of 2011.
00:50:27.773 --> 00:50:30.717
The first thing to do is to get the TED database.
00:50:30.717 --> 00:50:35.492
It turns out you can get an excel spreadsheet that has all of the Ted talks on it.
00:50:35.492 --> 00:50:39.395
If you go to their website you can see that there's a link for that.
00:50:40.176 --> 00:50:45.474
And the nice thing about that is that you can skim that a whole lot more easily
00:50:45.474 --> 00:50:47.624
than you can skim other material
00:50:47.624 --> 00:50:55.086
and you can also look, among other things, it tells you what the length of the talk is.
00:50:55.086 --> 00:51:04.124
And most Ted talks are around 18 minutes and most students attention focus ability is less.
00:51:06.981 --> 00:51:17.365
Um, okay, the database then, when I did it myself,
00:51:17.365 --> 00:51:19.865
it was smaller for one thing, at that point.
00:51:19.865 --> 00:51:24.829
But I did sort of skim it and looked for ideas, looked for themes
00:51:25.490 --> 00:51:27.343
and searched for keywords.
00:51:27.343 --> 00:51:30.100
So creativity was one of the first ones I did,
00:51:30.100 --> 00:51:34.022
so I was just able to search for anything that had creativity
00:51:34.022 --> 00:51:37.467
either in its description or in its title.
00:51:38.467 --> 00:51:43.295
I put together a list of candidates within that.
00:51:43.295 --> 00:51:48.094
I was looking for four or five talks to make a kind of a cluster,
00:51:48.094 --> 00:51:52.217
a sort of a virtual room in the museum if you will.
00:51:53.317 --> 00:52:01.441
And for each of those, I -- well, first of all, I did listen to the accent and got that.
00:52:02.364 --> 00:52:06.405
I wanted to get at least a proxy for the speech speed
00:52:06.405 --> 00:52:08.335
and so -- the speech rate --
00:52:08.335 --> 00:52:11.527
so I just took the transcript, dumped it into Word
00:52:11.527 --> 00:52:16.117
so that I got a word count, divided that and came up with words per minute.
00:52:16.117 --> 00:52:20.745
I was actually quite surprised at the range that I could see there.
00:52:20.745 --> 00:52:25.562
If you go to the website for cre-- the link for "creativity"
00:52:25.562 --> 00:52:30.609
on my ted1 website of the curated talks there --
00:52:31.209 --> 00:52:35.528
the slowest speech rate is like 91 words a minute.
00:52:36.036 --> 00:52:40.006
Some of that is because there are pictures being shown in between
00:52:40.482 --> 00:52:44.878
but it still means you got a lot more time to process the language coming in
00:52:44.878 --> 00:52:48.530
than if you got somebody coming in at -- at a higher rate.
00:52:49.837 --> 00:52:54.340
Some of my students do a --
00:52:55.447 --> 00:53:00.118
there's a website at Stanford called "Entrepreneurship corner"
00:53:00.118 --> 00:53:03.107
and they have a lot of Silicon Valley types come in
00:53:03.107 --> 00:53:05.160
and give talks on campus.
00:53:05.160 --> 00:53:08.132
They also have transcripts and subtitles for that
00:53:08.562 --> 00:53:13.150
and one of the talks that I always have the students try
00:53:13.150 --> 00:53:17.601
is Marissa Mayer who, at the time she gave the talk, was a VP for Google
00:53:18.092 --> 00:53:21.264
but is now the CEO of Yahoo!.
00:53:22.001 --> 00:53:28.877
And she talks between 220 and 237 words a minute on the one I have,
00:53:28.877 --> 00:53:36.271
so I use her as an example of where you might try to use the speech rate shift
00:53:36.271 --> 00:53:40.918
and be able to use the slider to slow her down to 80%.
00:53:42.640 --> 00:53:47.581
OK. The next thing, once I have that rough speed --
00:53:47.581 --> 00:53:53.330
and again, it's just a rough speed, but it's better than not using technology
00:53:53.330 --> 00:53:57.678
and try just to use intuition about "This is too fast, this is too slow."
00:53:58.354 --> 00:54:06.895
The vocabulary profiler -- this is Tom Cobb's work of genius in my opinion.
00:54:06.895 --> 00:54:11.190
There are a lot of parts to that lextutor.ca site,
00:54:11.190 --> 00:54:14.063
but the one that I use for this purpose is the --
00:54:14.063 --> 00:54:18.312
well, at the time, was the British National Corpus profiler
00:54:18.312 --> 00:54:19.919
and there is the link to it there.
00:54:19.919 --> 00:54:23.600
Basically, you dump a text, a transcript into it
00:54:23.600 --> 00:54:30.634
and it gives you as output all the words divided into 1'000 verbal frequency bands,
00:54:30.634 --> 00:54:34.219
so, you know, which words are in the first thousand words of English,
00:54:34.219 --> 00:54:36.778
the second thousand words of English, and so on,
00:54:36.778 --> 00:54:38.947
all the way up to the 20'000 level.
00:54:38.947 --> 00:54:47.196
For my students, we try to focus more on the, you know, just doing a short --
00:54:48.641 --> 00:54:53.681
well, we -- I try to get them to focus more around the 5'000 level,
00:54:53.681 --> 00:54:55.961
so anything below that that they don't know,
00:54:55.961 --> 00:54:57.784
it means it's a word that they should learn.
00:54:59.752 --> 00:55:03.797
And when you go to my site, you can see how that's split up.
00:55:04.689 --> 00:55:07.612
I skim the transcript for unusual terms and idioms --
00:55:07.612 --> 00:55:10.851
Oh, I meant to mention: in the last few weeks,
00:55:11.558 --> 00:55:20.449
Tom has actually added the Coca, it's a contemporary corpus of American English
00:55:20.449 --> 00:55:21.979
and blended those in,
00:55:21.979 --> 00:55:24.338
so it now goes up to the 25'000 level.
00:55:24.737 --> 00:55:29.222
And it has much more American English in it now,
00:55:29.222 --> 00:55:30.506
rather than just the British.
00:55:31.198 --> 00:55:35.210
So, for those of you who like, you know, concordancing
00:55:35.210 --> 00:55:37.511
and corpus studying, study and so on,
00:55:37.511 --> 00:55:43.030
it's got a much richer layering out than it did when I was using it for this purpose.
00:55:45.905 --> 00:55:47.743
OK. So that's the process.
00:55:47.743 --> 00:55:53.333
Now I said, you know, I would do it a little bit differently, probably.
00:55:53.333 --> 00:55:57.579
It turns out that, since the time I began this and now,
00:55:58.502 --> 00:56:01.464
TED has come up with its own curated collections.
00:56:01.464 --> 00:56:03.598
And so, if you go to the TED website,
00:56:03.598 --> 00:56:06.178
you will see a link to something called "playlists"
00:56:06.916 --> 00:56:11.232
and these are collections of material that people have put together.
00:56:11.232 --> 00:56:13.627
In some cases, it's done by TED itself,
00:56:14.503 --> 00:56:17.039
you know, whoever is in the background working there,
00:56:17.039 --> 00:56:21.583
but they also have curated collections by Bill Gates and Bono
00:56:21.598 --> 00:56:24.073
and, you know, other famous folk,
00:56:24.073 --> 00:56:27.414
or in some cases, they're people who are less famous
00:56:27.414 --> 00:56:34.829
but, you know, are very well-known within their, you know, their more restricted field.
00:56:34.851 --> 00:56:37.567
And there's some really, really good collections there.
00:56:39.074 --> 00:56:41.648
So now, instead of just going to the database,
00:56:41.648 --> 00:56:45.870
my inclination would be to go to that -- to those other curated playlists.
00:56:45.870 --> 00:56:48.443
Those have been curated just by interest
00:56:48.812 --> 00:56:54.915
and so if you have a list of maybe 10 or 12 videos on one topic,
00:56:55.438 --> 00:56:58.707
you go through those, and maybe you pick out the 4 or 5
00:56:58.707 --> 00:57:00.391
that you think are easiest to work with.
00:57:03.681 --> 00:57:05.847
So, that's there on the "Recent changes".
00:57:07.062 --> 00:57:09.887
I did -- number 2 there where it says
00:57:09.887 --> 00:57:11.263
-- this is from my talk last July --
00:57:11.263 --> 00:57:16.483
Well, I did have a project assistant who has collected some more material for me
00:57:16.483 --> 00:57:21.208
and basically run it through the -- the Word, you know,
00:57:21.208 --> 00:57:27.859
done some of the preliminary work for the words for minute and the vocabulary profile.
00:57:28.659 --> 00:57:31.237
Unfortunately, that came at the end of Summer,
00:57:31.237 --> 00:57:33.568
right before Fall quarter started for me
00:57:33.568 --> 00:57:36.337
and I have not had a chance to really look through her material
00:57:37.244 --> 00:57:41.933
but I do have some partially digested material
00:57:41.933 --> 00:57:44.901
that should help me create some new stuff.
00:57:47.207 --> 00:57:51.275
I guess, at this point, probably the most useful thing --
00:57:51.275 --> 00:57:56.155
Vance, could you -- can you actually click on that link to the TED1,
00:57:56.155 --> 00:57:58.435
just so I can sort of show people what --
00:57:59.622 --> 00:58:01.137
[Stevens and Hubbard speak together]
>> Stevens: ... already.
00:58:01.137 --> 00:58:05.935
It's in the text chat. So --
>> Hubbard: Ah, OK, so people can go to it
00:58:05.935 --> 00:58:08.496
on their own? Alright, then you --
>>Stevens: I can also share it.
00:58:09.145 --> 00:58:13.485
>> Hubbard: Well, the only thing -- I think if you go down -- go to the next slide actually,
00:58:13.485 --> 00:58:15.138
there's the Creativity group.
>> Stevens: OK.
00:58:15.968 --> 00:58:17.344
>> Hubbard: and this will show --
00:58:19.697 --> 00:58:23.629
This is a more condensed version of what you would see on the page.
00:58:24.367 --> 00:58:26.533
>> Stevens: Mmh. OK: let me share it.
00:58:26.533 --> 00:58:30.460
>> Hubbard: but this is, yeah, this is the Andy Hobs-- Hobsbawm,
00:58:30.460 --> 00:58:32.490
I'm not sure how to pronounce his name.
00:58:34.019 --> 00:58:41.784
This is a nice beginning talk, I think it's the second talk in the Creativity group.
00:58:41.784 --> 00:58:44.603
You can see it's a pretty short talk, just three and a half minutes.
00:58:44.603 --> 00:58:47.656
You can see the speed is 135 words per minute.
00:58:47.656 --> 00:58:50.703
He has kind of a dramatic presentation style,
00:58:51.117 --> 00:58:55.910
so that's why it's a little bit more slow, a little bit slower,
00:58:55.910 --> 00:58:58.845
it's very articulate, it's very easy to hear,
00:58:58.845 --> 00:59:05.877
it is more of a British English rather than an American English version.
00:59:06.692 --> 00:59:09.745
The vocabulary you can see at the 5'000 level,
00:59:09.745 --> 00:59:16.047
so if you -- to read that, I mean, 95% of the words are in the first 5'000 words of English.
00:59:17.523 --> 00:59:22.504
And, you know, 98% of the first 10'000, and then Off-List.
00:59:22.504 --> 00:59:25.538
The Off-List on these are often proper nouns.
00:59:25.538 --> 00:59:29.486
So those don't necessarily cause a great deal of difficulty,
00:59:29.486 --> 00:59:31.233
especially if some of the names in it,
00:59:31.233 --> 00:59:36.164
or names of places are ones that the students already are familiar with.
00:59:36.164 --> 00:59:38.158
[stifles a sneeze] Excuse me.
00:59:38.158 --> 00:59:41.088
About to sneeze. Wasn't expecting to do that online.
00:59:42.857 --> 00:59:46.715
And then a little bit of a comment: "creativity is repeated a number of times."
00:59:46.715 --> 00:59:50.565
So, if you go to the website, you'll see it's a -- it's a little richer than that
00:59:50.565 --> 00:59:53.958
but this kind of captures the main point I want to say.
00:59:53.958 --> 00:59:59.188
So I said, I'm giving value added, as the expert,
00:59:59.188 --> 01:00:01.465
and not only am I collecting these things,
01:00:02.111 --> 01:00:08.186
but I'm using technology to give students some idea of level.
01:00:09.263 --> 01:00:11.737
Ultimately, it would be great if I could say, you know,
01:00:11.737 --> 01:00:21.270
this is level 5 of 10 levels, or this is at the B1 level of the C, CEF,
01:00:22.946 --> 01:00:28.632
or just even, you know, this is high-intermediate, or something like that.
01:00:28.632 --> 01:00:31.867
I don't have that confidence yet,
01:00:31.867 --> 01:00:34.867
so at this point I'm giving students more the raw data,
01:00:34.867 --> 01:00:40.032
but I do actually tell them, and I may highlight this in future versions,
01:00:40.032 --> 01:00:47.177
that at the 5'000 level is probably the most important pivot point for my students.