[Script Info]
Title: 
[Events]
Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text
Dialogue: 0,0:00:07.17,0:00:09.13,Default,,0000,0000,0000,,Hi. Welcome to session three
Dialogue: 0,0:00:09.13,0:00:13.35,Default,,0000,0000,0000,,of the AI 101 for Teachers\NProfessional Learning Series.
Dialogue: 0,0:00:13.43,0:00:16.18,Default,,0000,0000,0000,,In this session\Nwe are traveling to the Wharton School
Dialogue: 0,0:00:16.18,0:00:19.27,Default,,0000,0000,0000,,at the University of Pennsylvania\Nto chat with Dr.
Dialogue: 0,0:00:19.27,0:00:24.48,Default,,0000,0000,0000,,Ethan Mollick, a professor who teaches\Ninnovation and entrepreneurship, and Dr.
Dialogue: 0,0:00:24.48,0:00:29.28,Default,,0000,0000,0000,,Lilach Mollick, who works on\Ninteractive pedagogy and AI research.
Dialogue: 0,0:00:29.36,0:00:32.62,Default,,0000,0000,0000,,They will help us explore\Nhow AI can be combined
Dialogue: 0,0:00:32.62,0:00:36.12,Default,,0000,0000,0000,,with pedagogy to enhance student learning.
Dialogue: 0,0:00:36.20,0:00:37.50,Default,,0000,0000,0000,,Let's go meet the Mollicks.
Dialogue: 0,0:00:43.75,0:00:45.13,Default,,0000,0000,0000,,Hi I’m Ethan Mollick
Dialogue: 0,0:00:45.13,0:00:48.88,Default,,0000,0000,0000,,a professor at Wharton\Nwho has been working on how we democratize
Dialogue: 0,0:00:48.88,0:00:54.05,Default,,0000,0000,0000,,access to education through tools\Nlike games and interactive tools and AI
Dialogue: 0,0:00:54.14,0:00:55.18,Default,,0000,0000,0000,,and I’m Lilach Mollick
Dialogue: 0,0:00:55.18,0:00:57.26,Default,,0000,0000,0000,,I'm director of Pedagogy\Nat Wharton Interactive,
Dialogue: 0,0:00:57.26,0:00:58.89,Default,,0000,0000,0000,,and I've been working at the intersection
Dialogue: 0,0:00:58.89,0:01:02.81,Default,,0000,0000,0000,,of AI and education,\Nhelping to democratize education
Dialogue: 0,0:01:02.81,0:01:06.86,Default,,0000,0000,0000,,for everyone through effective,\Npedagogically sound use of AI.
Dialogue: 0,0:01:06.94,0:01:11.11,Default,,0000,0000,0000,,And we have been working together\Non the future of education for a while,
Dialogue: 0,0:01:11.11,0:01:14.91,Default,,0000,0000,0000,,thinking about how to make education\Nmore interactive, to work at scale.
Dialogue: 0,0:01:15.12,0:01:18.83,Default,,0000,0000,0000,,And with the advent of general AI,\Nwe found a powerful new tool
Dialogue: 0,0:01:18.100,0:01:22.25,Default,,0000,0000,0000,,that can really help in the classroom\Nbut also carries some risks.
Dialogue: 0,0:01:22.46,0:01:24.88,Default,,0000,0000,0000,,Today, we'd like to talk a little bit\Nabout the classroom
Dialogue: 0,0:01:24.88,0:01:28.76,Default,,0000,0000,0000,,use of AI upsides and downsides\Nto give you some examples to work with.
Dialogue: 0,0:01:28.84,0:01:31.76,Default,,0000,0000,0000,,But first, we like to start\Nwith our three guiding principles.
Dialogue: 0,0:01:31.76,0:01:33.97,Default,,0000,0000,0000,,The first is that AI is undetectable.
Dialogue: 0,0:01:33.97,0:01:38.43,Default,,0000,0000,0000,,There are AI tools, detection tools,\Nbut they are not effective.
Dialogue: 0,0:01:38.52,0:01:41.77,Default,,0000,0000,0000,,The second principle\Nis that AI is ubiquitous.
Dialogue: 0,0:01:41.77,0:01:43.35,Default,,0000,0000,0000,,It's everywhere.
Dialogue: 0,0:01:43.35,0:01:46.73,Default,,0000,0000,0000,,169 countries have access to Bing Chat\Nand you and
Dialogue: 0,0:01:46.73,0:01:50.61,Default,,0000,0000,0000,,your students have access\Nto the most powerful AI available.
Dialogue: 0,0:01:50.69,0:01:53.82,Default,,0000,0000,0000,,The third principle\Nis that AI is transformative.
Dialogue: 0,0:01:53.86,0:01:58.58,Default,,0000,0000,0000,,It will transform how we live,\Nhow we work, and how we teach and learn.
Dialogue: 0,0:02:04.96,0:02:06.25,Default,,0000,0000,0000,,Not only is
Dialogue: 0,0:02:06.25,0:02:09.80,Default,,0000,0000,0000,,AI not going\Naway, but this is probably the worst AI
Dialogue: 0,0:02:09.80,0:02:10.67,Default,,0000,0000,0000,,you're ever going to use.
Dialogue: 0,0:02:10.67,0:02:14.51,Default,,0000,0000,0000,,So if this feels disruptive\Nnow kind of have bad news, which is that
Dialogue: 0,0:02:14.51,0:02:17.14,Default,,0000,0000,0000,,there isn't a reason to suspect\Nthat AI development will not continue.
Dialogue: 0,0:02:17.14,0:02:17.89,Default,,0000,0000,0000,,And I think people worry
Dialogue: 0,0:02:17.89,0:02:21.85,Default,,0000,0000,0000,,a lot about like the far future\Nor who knows how far it is where AI
Dialogue: 0,0:02:21.85,0:02:22.60,Default,,0000,0000,0000,,smarter than humans.
Dialogue: 0,0:02:22.60,0:02:26.56,Default,,0000,0000,0000,,But even over the next couple of years,\Neven with this fact of this academic year,
Dialogue: 0,0:02:26.69,0:02:28.90,Default,,0000,0000,0000,,I would expect AI\Nto continue to improve.
Dialogue: 0,0:02:28.90,0:02:31.15,Default,,0000,0000,0000,,Five times. Ten times? We have no idea.
Dialogue: 0,0:02:31.15,0:02:34.11,Default,,0000,0000,0000,,But if you're not already thinking\Nabout these systems, what they mean
Dialogue: 0,0:02:34.11,0:02:37.12,Default,,0000,0000,0000,,for education, what they mean for you,\Nwhat they mean for your students careers.
Dialogue: 0,0:02:37.12,0:02:40.49,Default,,0000,0000,0000,,I think we have to think about it because\Nthese systems are not going to disappear.
Dialogue: 0,0:02:40.62,0:02:44.58,Default,,0000,0000,0000,,Let me make the very pragmatic case\Nfor why you may want to do this.
Dialogue: 0,0:02:44.66,0:02:47.92,Default,,0000,0000,0000,,The first part of the pragmatic case is\Nyour students are using this anyway.
Dialogue: 0,0:02:48.13,0:02:49.38,Default,,0000,0000,0000,,So you have to come up to speed.
Dialogue: 0,0:02:49.38,0:02:51.80,Default,,0000,0000,0000,,I don't think everybody\Nwants to be dragged along this technology.
Dialogue: 0,0:02:51.80,0:02:54.13,Default,,0000,0000,0000,,No one asked for education\Nto be massively disrupted.
Dialogue: 0,0:02:54.13,0:02:54.97,Default,,0000,0000,0000,,But it is.
Dialogue: 0,0:02:54.97,0:02:57.38,Default,,0000,0000,0000,,And unfortunately, we've got to figure out\Na way to get around that.
Dialogue: 0,0:02:57.38,0:03:00.47,Default,,0000,0000,0000,,All your homework assignments can be done\Nby AI now, so you have to think about that.
Dialogue: 0,0:03:00.47,0:03:04.64,Default,,0000,0000,0000,,And then I think the second thing\Nis a pragmatic argument about how AI
Dialogue: 0,0:03:04.64,0:03:06.06,Default,,0000,0000,0000,,can make your life easier as a teacher.
Dialogue: 0,0:03:06.06,0:03:08.02,Default,,0000,0000,0000,,If you put the hours down,\Nyou get them back later.
Dialogue: 0,0:03:08.02,0:03:09.44,Default,,0000,0000,0000,,And then if you've worked out\Na number of prompts
Dialogue: 0,0:03:09.44,0:03:11.65,Default,,0000,0000,0000,,to help make lives easier for teachers.
Dialogue: 0,0:03:11.65,0:03:14.78,Default,,0000,0000,0000,,Yes. So one thing you can do prompts\Nlike give me a lesson
Dialogue: 0,0:03:14.78,0:03:19.57,Default,,0000,0000,0000,,hook prompts like create a lesson plan\Nor create a quiz for me.
Dialogue: 0,0:03:19.78,0:03:24.08,Default,,0000,0000,0000,,So starting to work with your material\Nand the different models could get you
Dialogue: 0,0:03:24.12,0:03:28.08,Default,,0000,0000,0000,,give you a really good sense of how the\NAI works, what it's good at, what it
Dialogue: 0,0:03:28.17,0:03:32.00,Default,,0000,0000,0000,,what it's not good at. And so\Nand save you time in the end, right?
Dialogue: 0,0:03:32.00,0:03:33.17,Default,,0000,0000,0000,,So that's where I would be
Dialogue: 0,0:03:33.17,0:03:37.38,Default,,0000,0000,0000,,my push to teachers is A\Nyou have to and B you're going to want to.
Dialogue: 0,0:03:37.47,0:03:40.47,Default,,0000,0000,0000,,I think the other important thing\Nis just to try it.
Dialogue: 0,0:03:40.68,0:03:42.06,Default,,0000,0000,0000,,They're very simple to use.
Dialogue: 0,0:03:42.06,0:03:45.39,Default,,0000,0000,0000,,They're very intuitive\Nbecause they're conversational.
Dialogue: 0,0:03:45.48,0:03:49.27,Default,,0000,0000,0000,,You can continue a conversation\Nand it feels fairly natural.
Dialogue: 0,0:03:49.48,0:03:52.69,Default,,0000,0000,0000,,And I think the key really\Nis experimentation.
Dialogue: 0,0:03:52.77,0:03:56.53,Default,,0000,0000,0000,,See how it works with you,\Nsee how it works within your context,
Dialogue: 0,0:03:56.61,0:03:58.61,Default,,0000,0000,0000,,within your topic that you teach.
Dialogue: 0,0:03:58.61,0:04:01.12,Default,,0000,0000,0000,,Our rule of thumb is\Nyou need about 10 hours time with
Dialogue: 0,0:04:01.12,0:04:03.95,Default,,0000,0000,0000,,AI to get what it's good at,\Nwhat its limitations are.
Dialogue: 0,0:04:03.95,0:04:07.70,Default,,0000,0000,0000,,So I would actually start by suggesting\Nthat this that the teacher throw
Dialogue: 0,0:04:07.70,0:04:10.71,Default,,0000,0000,0000,,their own assignments into the AI and see\Nwhat kind of results they get back.
Dialogue: 0,0:04:10.88,0:04:14.25,Default,,0000,0000,0000,,I would think about asking them\Nto ask their students
Dialogue: 0,0:04:14.25,0:04:18.05,Default,,0000,0000,0000,,to create an assignment using AI\Nand then critique that assignment,
Dialogue: 0,0:04:18.22,0:04:20.18,Default,,0000,0000,0000,,potentially even in class, to see
Dialogue: 0,0:04:20.18,0:04:23.68,Default,,0000,0000,0000,,if the students can get a sense\Nof what the gaps and abilities of AI are.
Dialogue: 0,0:04:23.72,0:04:26.10,Default,,0000,0000,0000,,I have a little bit of freedom\Nas an instructor
Dialogue: 0,0:04:26.10,0:04:29.73,Default,,0000,0000,0000,,because I'm teaching college\Nand MBA students entrepreneurship.
Dialogue: 0,0:04:29.73,0:04:30.73,Default,,0000,0000,0000,,So I have a lot of
Dialogue: 0,0:04:30.73,0:04:33.11,Default,,0000,0000,0000,,I have points I want them to make,\Nbut they also are building things
Dialogue: 0,0:04:33.11,0:04:36.94,Default,,0000,0000,0000,,and doing things\Nand absolutely transformed how that works.
Dialogue: 0,0:04:36.94,0:04:38.70,Default,,0000,0000,0000,,So my assignments now
Dialogue: 0,0:04:38.70,0:04:41.78,Default,,0000,0000,0000,,literally call for students to do this one\Nimpossible thing in class.
Dialogue: 0,0:04:41.78,0:04:44.37,Default,,0000,0000,0000,,If you can't code,\Nyou have to write working programs.
Dialogue: 0,0:04:44.37,0:04:47.24,Default,,0000,0000,0000,,If you have never if you can't do design\Nwork, you have to create a full
Dialogue: 0,0:04:47.24,0:04:50.75,Default,,0000,0000,0000,,graphic design working prototypes\Nthat's literally now part of the class.
Dialogue: 0,0:04:50.75,0:04:52.33,Default,,0000,0000,0000,,So where it used to be, write it write
Dialogue: 0,0:04:52.33,0:04:54.67,Default,,0000,0000,0000,,a little bit of an essay,\Ndo a prototype on paper.
Dialogue: 0,0:04:54.67,0:04:56.71,Default,,0000,0000,0000,,Now you have to create a full working\Nproduct.
Dialogue: 0,0:04:56.71,0:04:58.38,Default,,0000,0000,0000,,Every assignment that is written
Dialogue: 0,0:04:58.38,0:05:00.22,Default,,0000,0000,0000,,has to be critiqued\Nby at least five famous
Dialogue: 0,0:05:00.22,0:05:02.97,Default,,0000,0000,0000,,entrepreneurs through history,\Nand they use AI to invoke those.
Dialogue: 0,0:05:02.97,0:05:04.30,Default,,0000,0000,0000,,There's a pedagogical reason, too,
Dialogue: 0,0:05:04.30,0:05:06.60,Default,,0000,0000,0000,,which is that entrepreneurs\Ntend to be overconfident.
Dialogue: 0,0:05:06.60,0:05:08.72,Default,,0000,0000,0000,,So you want feedback\Nfrom different sources.
Dialogue: 0,0:05:08.72,0:05:12.19,Default,,0000,0000,0000,,So to me it is\Nlet me teach ten times more than I did.
Dialogue: 0,0:05:12.19,0:05:14.90,Default,,0000,0000,0000,,I used to teach an advanced\Nintermedia entrepreneurship course.
Dialogue: 0,0:05:14.90,0:05:17.23,Default,,0000,0000,0000,,I can now, in the intermediate\Nor basic course,
Dialogue: 0,0:05:17.23,0:05:19.65,Default,,0000,0000,0000,,get all the way\Npast the advanced material and further.
Dialogue: 0,0:05:19.65,0:05:22.16,Default,,0000,0000,0000,,So I think we're going to see that\Nshake out more in the future.
Dialogue: 0,0:05:22.16,0:05:25.12,Default,,0000,0000,0000,,But some of this is about powering past\Nwhat we could do before
Dialogue: 0,0:05:25.12,0:05:26.99,Default,,0000,0000,0000,,and I think that's exciting as well.
Dialogue: 0,0:05:26.99,0:05:32.04,Default,,0000,0000,0000,,Apart from student tutors\Nas assignments, teachers can certainly use
Dialogue: 0,0:05:32.12,0:05:36.75,Default,,0000,0000,0000,,AI coaches, AI assistants\Nto help students prepare for discussions,
Dialogue: 0,0:05:37.00,0:05:41.59,Default,,0000,0000,0000,,help students outline, help students\Ndo research, help students get feedback
Dialogue: 0,0:05:41.59,0:05:44.72,Default,,0000,0000,0000,,on assignments, and just help students\Ndevelop explanations.
Dialogue: 0,0:05:44.72,0:05:50.18,Default,,0000,0000,0000,,I think there are myriad of approaches\Nthat are pedagogically sound
Dialogue: 0,0:05:50.27,0:05:51.77,Default,,0000,0000,0000,,that teachers can assign to
Dialogue: 0,0:05:51.77,0:05:56.48,Default,,0000,0000,0000,,students and watch their work\Nand ask for the back and forth interaction
Dialogue: 0,0:05:56.48,0:06:00.11,Default,,0000,0000,0000,,to really see that students are paying\Nattention to and focusing on the material.
Dialogue: 0,0:06:05.91,0:06:07.32,Default,,0000,0000,0000,,Let's talk a little bit about AI
Dialogue: 0,0:06:07.32,0:06:08.41,Default,,0000,0000,0000,,from a teacher's perspective.
Dialogue: 0,0:06:08.41,0:06:11.16,Default,,0000,0000,0000,,So because of the ubiquity of AI,
Dialogue: 0,0:06:11.16,0:06:14.87,Default,,0000,0000,0000,,you've got some choices to make in terms\Nof your AI policies in your class.
Dialogue: 0,0:06:14.87,0:06:18.13,Default,,0000,0000,0000,,So do you want to permit\NI do want to forbid AI
Dialogue: 0,0:06:18.25,0:06:20.00,Default,,0000,0000,0000,,How are you going\Nto enforce these sorts of things?
Dialogue: 0,0:06:20.00,0:06:21.76,Default,,0000,0000,0000,,We're going to assume\Nthat you want to use AI
Dialogue: 0,0:06:21.76,0:06:25.13,Default,,0000,0000,0000,,to some extent, and we'll dive\Ninto a little bit of the details here.
Dialogue: 0,0:06:25.13,0:06:27.72,Default,,0000,0000,0000,,So as a instructor,\Nyou should know a few things.
Dialogue: 0,0:06:27.72,0:06:30.97,Default,,0000,0000,0000,,One is there is obviously ongoing\Nethical debates about AI,
Dialogue: 0,0:06:30.97,0:06:32.27,Default,,0000,0000,0000,,and those are complicated debates.
Dialogue: 0,0:06:32.27,0:06:34.14,Default,,0000,0000,0000,,There are debates over whether or not
Dialogue: 0,0:06:34.14,0:06:37.06,Default,,0000,0000,0000,,the AI's trained on the right kind of data\Nabout the biases
Dialogue: 0,0:06:37.06,0:06:41.98,Default,,0000,0000,0000,,I might have about the use of AI\Nand the outcomes for student learning.
Dialogue: 0,0:06:42.19,0:06:44.15,Default,,0000,0000,0000,,And it's worth\Nacknowledging these sets of things.
Dialogue: 0,0:06:44.15,0:06:48.03,Default,,0000,0000,0000,,But this tool is out there and it is worth\Nthinking about how you want to use it.
Dialogue: 0,0:06:48.12,0:06:51.08,Default,,0000,0000,0000,,If you decide that that is okay\Nand how you want to communicate
Dialogue: 0,0:06:51.08,0:06:54.20,Default,,0000,0000,0000,,that information\Nbeyond the initial ethical concerns,
Dialogue: 0,0:06:54.37,0:06:56.71,Default,,0000,0000,0000,,there's also concerns\Nabout how AI actually works.
Dialogue: 0,0:06:56.71,0:07:00.13,Default,,0000,0000,0000,,So the large language models that power
Dialogue: 0,0:07:00.13,0:07:03.26,Default,,0000,0000,0000,,today’s AI don't actually have knowledge\Nof the world.
Dialogue: 0,0:07:03.26,0:07:04.63,Default,,0000,0000,0000,,They're predicting the next word.
Dialogue: 0,0:07:04.63,0:07:07.72,Default,,0000,0000,0000,,They're predicting the right kinds\Nof sentences or information to give out.
Dialogue: 0,0:07:07.93,0:07:11.64,Default,,0000,0000,0000,,And as a result, they make stuff up\Nthey hallucinate.
Dialogue: 0,0:07:11.64,0:07:13.64,Default,,0000,0000,0000,,So there are often errors or mistakes.
Dialogue: 0,0:07:13.64,0:07:15.64,Default,,0000,0000,0000,,Now, it's not always clear\Nthose errors or mistakes are worse
Dialogue: 0,0:07:15.64,0:07:17.35,Default,,0000,0000,0000,,than the errors and mistakes\Nhumans would make.
Dialogue: 0,0:07:17.35,0:07:18.86,Default,,0000,0000,0000,,But you need to be aware that there's
Dialogue: 0,0:07:18.86,0:07:20.69,Default,,0000,0000,0000,,going to be\Nthose kind of errors and mistakes.
Dialogue: 0,0:07:20.69,0:07:23.86,Default,,0000,0000,0000,,And then finally,\Nyou need to think about as an instructor
Dialogue: 0,0:07:24.07,0:07:26.95,Default,,0000,0000,0000,,how you're going to be using\NAI to aid learning,
Dialogue: 0,0:07:26.95,0:07:30.82,Default,,0000,0000,0000,,which means being really clear about what\Nyou want to accomplish with an AI tool.
Dialogue: 0,0:07:31.08,0:07:33.24,Default,,0000,0000,0000,,They can be used for student learning,
Dialogue: 0,0:07:33.24,0:07:35.41,Default,,0000,0000,0000,,but AI's many possible\Nuses in the classroom,
Dialogue: 0,0:07:35.41,0:07:37.79,Default,,0000,0000,0000,,so do you want to use them\Nto have student’s generate ideas,
Dialogue: 0,0:07:37.79,0:07:41.08,Default,,0000,0000,0000,,which I do in my classes and get better\Nproject ideas as a result.
Dialogue: 0,0:07:41.17,0:07:44.59,Default,,0000,0000,0000,,Do you want them to use them as tutors\Nto explain concepts
Dialogue: 0,0:07:44.59,0:07:45.76,Default,,0000,0000,0000,,to them they don't understand?
Dialogue: 0,0:07:45.76,0:07:48.43,Default,,0000,0000,0000,,Do you want the students\Nto get feedback from AI
Dialogue: 0,0:07:48.43,0:07:51.68,Default,,0000,0000,0000,,by asking for questions about work\Nthat they're doing.
Dialogue: 0,0:07:51.80,0:07:53.56,Default,,0000,0000,0000,,Do you want to be a writing companion?
Dialogue: 0,0:07:53.56,0:07:56.56,Default,,0000,0000,0000,,Do you want it to explain\Nwhy quiz answers might be right or wrong?
Dialogue: 0,0:07:56.68,0:07:58.73,Default,,0000,0000,0000,,And then once you've decided\Nwhat who's instructor,
Dialogue: 0,0:07:58.73,0:08:02.23,Default,,0000,0000,0000,,you decide what you're\Ngoing to tell your students.
Dialogue: 0,0:08:07.57,0:08:09.57,Default,,0000,0000,0000,,AI detectors don't work.
Dialogue: 0,0:08:09.57,0:08:10.28,Default,,0000,0000,0000,,They just don't work.
Dialogue: 0,0:08:10.28,0:08:12.12,Default,,0000,0000,0000,,You shouldn't use them.\NAnd it's worse than them
Dialogue: 0,0:08:12.12,0:08:15.29,Default,,0000,0000,0000,,not working because they have a high false\Npositive rate.
Dialogue: 0,0:08:15.29,0:08:18.58,Default,,0000,0000,0000,,That means they select things\Nthat’s AI written that aren't AI written
Dialogue: 0,0:08:18.75,0:08:23.17,Default,,0000,0000,0000,,and that disproportionately falls on\Npeople whose English is a second language.
Dialogue: 0,0:08:23.25,0:08:24.80,Default,,0000,0000,0000,,This is just not something that we can do.
Dialogue: 0,0:08:24.80,0:08:28.30,Default,,0000,0000,0000,,And I think trying to close the barn door\Nhere after it's been opened
Dialogue: 0,0:08:28.38,0:08:33.47,Default,,0000,0000,0000,,and try and detect AI is not the future\Nfor responsibility in classrooms.
Dialogue: 0,0:08:33.55,0:08:37.06,Default,,0000,0000,0000,,The other thing to note too,\Nis that students
Dialogue: 0,0:08:37.14,0:08:39.06,Default,,0000,0000,0000,,were using shortcuts in the past.
Dialogue: 0,0:08:39.06,0:08:40.60,Default,,0000,0000,0000,,It's not that they weren't using Google,
Dialogue: 0,0:08:40.60,0:08:43.10,Default,,0000,0000,0000,,it's not that they weren't using,\Nyou know, other students essays.
Dialogue: 0,0:08:43.10,0:08:46.15,Default,,0000,0000,0000,,This was happening in the past,\Nbut this is a major disruption,
Dialogue: 0,0:08:46.36,0:08:50.45,Default,,0000,0000,0000,,and I think it does call for a rethinking\Nof how we do essays.
Dialogue: 0,0:08:50.45,0:08:54.20,Default,,0000,0000,0000,,So thinking a little bit more\Nabout the learning goal for an essay
Dialogue: 0,0:08:54.20,0:08:55.99,Default,,0000,0000,0000,,or the learning goal for any assignment,
Dialogue: 0,0:09:02.42,0:09:05.59,Default,,0000,0000,0000,,One of the things that we're noticing\Nas we watch teachers do this
Dialogue: 0,0:09:05.59,0:09:09.30,Default,,0000,0000,0000,,is they all feel an obligation\Nto talk about AI and dive
Dialogue: 0,0:09:09.30,0:09:12.30,Default,,0000,0000,0000,,deep into the ethical implications of AI\Nand so on.
Dialogue: 0,0:09:12.34,0:09:14.55,Default,,0000,0000,0000,,I think that's important,\Nbut I don't think that needs
Dialogue: 0,0:09:14.55,0:09:15.93,Default,,0000,0000,0000,,to be the theme of every class.
Dialogue: 0,0:09:15.93,0:09:18.93,Default,,0000,0000,0000,,I don't think every class needs\Nto be a discussion about AI,
Dialogue: 0,0:09:19.02,0:09:21.69,Default,,0000,0000,0000,,just like every class that uses computers\Ndoesn't need to be a discussion
Dialogue: 0,0:09:21.69,0:09:24.27,Default,,0000,0000,0000,,about computers, I think is important\Nto have that conversation.
Dialogue: 0,0:09:24.27,0:09:25.19,Default,,0000,0000,0000,,And right now
Dialogue: 0,0:09:25.19,0:09:28.23,Default,,0000,0000,0000,,we're all just reacting so it's not clear\Nwho's supposed to have that.
Dialogue: 0,0:09:28.23,0:09:30.36,Default,,0000,0000,0000,,So I totally get teachers\Nwanting to have AI
Dialogue: 0,0:09:30.36,0:09:33.91,Default,,0000,0000,0000,,discussions,\Nbut it's even harder to get up to speed,
Dialogue: 0,0:09:33.91,0:09:36.08,Default,,0000,0000,0000,,not just on the use of AI,\Nbut how it works.
Dialogue: 0,0:09:36.08,0:09:39.16,Default,,0000,0000,0000,,It's, you know, standards,\Nits ethical implications.
Dialogue: 0,0:09:39.41,0:09:43.33,Default,,0000,0000,0000,,So I think teachers should feel\Na little bit of okay ness
Dialogue: 0,0:09:43.33,0:09:46.79,Default,,0000,0000,0000,,with experimenting with AI without having\Nto make it the subject of class.
Dialogue: 0,0:09:53.30,0:09:56.30,Default,,0000,0000,0000,,First is\Nas Ethan mentioned, that AI can fabricate.
Dialogue: 0,0:09:56.30,0:10:00.10,Default,,0000,0000,0000,,That means that any output\Nthat the AI gives a student may be made
Dialogue: 0,0:10:00.10,0:10:04.40,Default,,0000,0000,0000,,up, it may be mistaken,\Nit may be very subtly mistaken.
Dialogue: 0,0:10:04.40,0:10:07.48,Default,,0000,0000,0000,,And so students should be responsible\Nfor their own work.
Dialogue: 0,0:10:07.69,0:10:11.03,Default,,0000,0000,0000,,They should at the very least check\Nsources, check any number,
Dialogue: 0,0:10:11.03,0:10:14.95,Default,,0000,0000,0000,,check any facts that the AI gives them\Nand check them with credible sources.
Dialogue: 0,0:10:15.03,0:10:18.33,Default,,0000,0000,0000,,The second principle is that\Nthe AI is not a person.
Dialogue: 0,0:10:18.33,0:10:21.100,Default,,0000,0000,0000,,It's easy to imbue the AI\Nwith a personality or to feel like you're
Dialogue: 0,0:10:21.100,0:10:25.96,Default,,0000,0000,0000,,talking to a person, but it's not a person\Nand it doesn't know you.
Dialogue: 0,0:10:26.04,0:10:29.38,Default,,0000,0000,0000,,The third principle is really\Nto give it a lot of context.
Dialogue: 0,0:10:29.38,0:10:30.92,Default,,0000,0000,0000,,The AI doesn't know you.
Dialogue: 0,0:10:30.92,0:10:34.34,Default,,0000,0000,0000,,It doesn't know your context\Nor your experience or your expertise.
Dialogue: 0,0:10:34.42,0:10:38.01,Default,,0000,0000,0000,,The more context you give it,\Nthe more useful it'll be for you.
Dialogue: 0,0:10:38.05,0:10:40.81,Default,,0000,0000,0000,,And the fourth principle\Nis that you're in charge.
Dialogue: 0,0:10:40.81,0:10:42.39,Default,,0000,0000,0000,,Not only should you evaluate
Dialogue: 0,0:10:42.39,0:10:46.31,Default,,0000,0000,0000,,and interrogate its output,\Nbut if it's leading you in a conversation
Dialogue: 0,0:10:46.40,0:10:49.73,Default,,0000,0000,0000,,that is no longer useful to you,\Nor if it's stuck in a loop,
Dialogue: 0,0:10:49.82,0:10:52.69,Default,,0000,0000,0000,,or if you'd like to change the direction\Nof the conversation,
Dialogue: 0,0:10:52.69,0:10:55.20,Default,,0000,0000,0000,,you should absolutely\Nfeel free to take charge.
Dialogue: 0,0:11:01.79,0:11:04.41,Default,,0000,0000,0000,,So when we talk about AI
Dialogue: 0,0:11:04.41,0:11:07.33,Default,,0000,0000,0000,,and these generative AI solutions,
Dialogue: 0,0:11:07.33,0:11:09.34,Default,,0000,0000,0000,,we tend to talk about large language\Nmodels.
Dialogue: 0,0:11:09.34,0:11:10.46,Default,,0000,0000,0000,,And there's actually only
Dialogue: 0,0:11:10.46,0:11:13.92,Default,,0000,0000,0000,,a few large scale\Ngeneral purpose, large language models.
Dialogue: 0,0:11:13.92,0:11:18.93,Default,,0000,0000,0000,,There is the models created by OpenAI,\Nwhich are GPT 3.5 or GPT 4
Dialogue: 0,0:11:19.14,0:11:23.06,Default,,0000,0000,0000,,GPT 3.5 is the free version\Nthat you get through
Dialogue: 0,0:11:23.14,0:11:26.35,Default,,0000,0000,0000,,through Chat GPT\Nand GPT 4 is either
Dialogue: 0,0:11:26.35,0:11:29.65,Default,,0000,0000,0000,,through the paid Chat GPT or through\NMicrosoft Bing in creative mode.
Dialogue: 0,0:11:29.86,0:11:34.53,Default,,0000,0000,0000,,And when we talk about specialized apps,\Nalmost all of them are using
Dialogue: 0,0:11:34.53,0:11:38.74,Default,,0000,0000,0000,,one of these models and providing prompts\Nand other information on top of it.
Dialogue: 0,0:11:38.82,0:11:42.37,Default,,0000,0000,0000,,I generally think instructors\Nshould get familiar with the models
Dialogue: 0,0:11:42.37,0:11:46.66,Default,,0000,0000,0000,,themselves because those are the models\Nthat are actually producing the answers
Dialogue: 0,0:11:46.83,0:11:49.38,Default,,0000,0000,0000,,and you can manipulate them directly\Nthat way and learn how they work.
Dialogue: 0,0:11:49.38,0:11:51.38,Default,,0000,0000,0000,,So if you're trying to buy\Nan off the shelf solution,
Dialogue: 0,0:11:51.38,0:11:53.80,Default,,0000,0000,0000,,they're almost certainly\Nusing one of these existing models
Dialogue: 0,0:11:53.80,0:11:57.26,Default,,0000,0000,0000,,and then providing some sort of wrapper\Nor other information on top of it,
Dialogue: 0,0:11:57.47,0:12:00.76,Default,,0000,0000,0000,,and it's often cheaper and more effective\Nand gives you more control
Dialogue: 0,0:12:00.89,0:12:02.68,Default,,0000,0000,0000,,to use the foundation models yourself.
Dialogue: 0,0:12:02.68,0:12:04.22,Default,,0000,0000,0000,,But that's a choice you get to make.
Dialogue: 0,0:12:04.22,0:12:09.31,Default,,0000,0000,0000,,So when developing the prompt,\Nwe really and for all of our prompts,
Dialogue: 0,0:12:09.52,0:12:11.81,Default,,0000,0000,0000,,we really look at the science of learning
Dialogue: 0,0:12:11.81,0:12:14.82,Default,,0000,0000,0000,,and try to combine\Nthat with the power of the AI.
Dialogue: 0,0:12:14.90,0:12:19.07,Default,,0000,0000,0000,,So for instance,\Na good tutor pushes you for information.
Dialogue: 0,0:12:19.16,0:12:21.66,Default,,0000,0000,0000,,It doesn't just hand to you, a good tutor
Dialogue: 0,0:12:21.66,0:12:26.29,Default,,0000,0000,0000,,finds out what you know\Nand builds on that prior knowledge.
Dialogue: 0,0:12:26.37,0:12:29.62,Default,,0000,0000,0000,,A good tutor will also find out\Na little bit about you.
Dialogue: 0,0:12:29.62,0:12:34.13,Default,,0000,0000,0000,,A good tutor also knows that you need lots\Nand varied kinds of examples
Dialogue: 0,0:12:34.21,0:12:35.84,Default,,0000,0000,0000,,and analogies,
Dialogue: 0,0:12:35.84,0:12:40.51,Default,,0000,0000,0000,,and a good tutor knows that the way to\Nyou show evidence of mastery
Dialogue: 0,0:12:40.51,0:12:43.51,Default,,0000,0000,0000,,is by being able\Nto explain something in your own words
Dialogue: 0,0:12:43.51,0:12:48.39,Default,,0000,0000,0000,,to someone else and give an example of it,\Nwhich is exactly these are exactly
Dialogue: 0,0:12:48.39,0:12:52.15,Default,,0000,0000,0000,,the steps in the kinds of questions\Nthat we use in the tutor prompt.
Dialogue: 0,0:12:52.40,0:12:54.40,Default,,0000,0000,0000,,But you'll notice\Nwhen you look at our prompts
Dialogue: 0,0:12:54.40,0:12:58.57,Default,,0000,0000,0000,,that they do things like provide context\Nthe AI as life has discussed already,
Dialogue: 0,0:12:58.57,0:13:02.66,Default,,0000,0000,0000,,the idea that it asks you who you are,\Nand we tell the AI who it is.
Dialogue: 0,0:13:02.66,0:13:04.87,Default,,0000,0000,0000,,It's an instructor\Nwith this kind of setting,
Dialogue: 0,0:13:04.87,0:13:07.70,Default,,0000,0000,0000,,you'll notice that it also tells it\Nexactly
Dialogue: 0,0:13:07.70,0:13:11.42,Default,,0000,0000,0000,,the scientific framework\Nto use this idea of context matters.
Dialogue: 0,0:13:11.50,0:13:12.67,Default,,0000,0000,0000,,We provide controls.
Dialogue: 0,0:13:12.67,0:13:16.63,Default,,0000,0000,0000,,We ask it to go step by step through\Nsets of questions to ask, sometimes
Dialogue: 0,0:13:16.63,0:13:20.05,Default,,0000,0000,0000,,not in these prompts, we provide examples\Nof good output, and then we tested a lot.
Dialogue: 0,0:13:20.26,0:13:23.80,Default,,0000,0000,0000,,You can't do prompting without testing,\Nand that's one of the great things
Dialogue: 0,0:13:23.80,0:13:25.39,Default,,0000,0000,0000,,about testing your error expertise.
Dialogue: 0,0:13:25.39,0:13:26.68,Default,,0000,0000,0000,,It's cheap to do
Dialogue: 0,0:13:26.68,0:13:30.14,Default,,0000,0000,0000,,and so you get to experiment a lot\Nand that makes for good prompts.
Dialogue: 0,0:13:30.31,0:13:34.56,Default,,0000,0000,0000,,And we should also say we test it not\Njust on one model but on several models.
Dialogue: 0,0:13:34.56,0:13:37.61,Default,,0000,0000,0000,,So for instance, these two prompts\Nwe just worked
Dialogue: 0,0:13:37.61,0:13:40.78,Default,,0000,0000,0000,,with ChatGPT 4 for,\Nthey also work with Bing.
Dialogue: 0,0:13:40.90,0:13:44.86,Default,,0000,0000,0000,,Bing will react a little bit differently\Nand it will
Dialogue: 0,0:13:44.95,0:13:46.41,Default,,0000,0000,0000,,because it's connected to the Internet.
Dialogue: 0,0:13:46.41,0:13:48.37,Default,,0000,0000,0000,,It will also look up citations sometimes.
Dialogue: 0,0:13:48.37,0:13:50.25,Default,,0000,0000,0000,,So the right citation,\Nsometimes they're not.
Dialogue: 0,0:13:50.25,0:13:51.100,Default,,0000,0000,0000,,But that is available.
Dialogue: 0,0:13:51.100,0:13:54.42,Default,,0000,0000,0000,,It may or may not work\Nwith some of the other models.
Dialogue: 0,0:13:54.42,0:13:55.63,Default,,0000,0000,0000,,So you really have to test it,
Dialogue: 0,0:13:55.63,0:13:58.63,Default,,0000,0000,0000,,I think, as an instructor\Nbefore you give it to your students
Dialogue: 0,0:13:58.84,0:14:02.38,Default,,0000,0000,0000,,in the context of the topic\Nthat you're teaching to see how it works.
Dialogue: 0,0:14:02.47,0:14:05.39,Default,,0000,0000,0000,,So this is all very theoretical,\Nbut I think important.
Dialogue: 0,0:14:05.39,0:14:06.51,Default,,0000,0000,0000,,So let's let's get practical.
Dialogue: 0,0:14:06.51,0:14:08.81,Default,,0000,0000,0000,,Let's talk about some examples\Nof what AI can do.
Dialogue: 0,0:14:08.81,0:14:13.23,Default,,0000,0000,0000,,And again, this isn't a monolithic thing,\Na has many possible uses.
Dialogue: 0,0:14:13.23,0:14:14.81,Default,,0000,0000,0000,,As we said, it was transformative earlier.
Dialogue: 0,0:14:14.81,0:14:17.52,Default,,0000,0000,0000,,So we're going to show you\Na couple of prompts that we've created
Dialogue: 0,0:14:17.52,0:14:21.19,Default,,0000,0000,0000,,and those will be available to you\Nas well to work with
Dialogue: 0,0:14:21.28,0:14:25.49,Default,,0000,0000,0000,,and these are just examples of the ways\NAI classroom use can work.
Dialogue: 0,0:14:25.49,0:14:29.58,Default,,0000,0000,0000,,So the first one we want to show\Nyou is a prompt that I believe you created
Dialogue: 0,0:14:29.66,0:14:33.12,Default,,0000,0000,0000,,that talks about feedback\Nthat gives proper feedback.
Dialogue: 0,0:14:33.20,0:14:36.75,Default,,0000,0000,0000,,And one of the really interesting things\Nabout the AI side of things
Dialogue: 0,0:14:36.75,0:14:38.17,Default,,0000,0000,0000,,is a more sophisticated prompt
Dialogue: 0,0:14:38.17,0:14:39.71,Default,,0000,0000,0000,,that takes into account\Nsome of the principles
Dialogue: 0,0:14:39.71,0:14:41.92,Default,,0000,0000,0000,,we were talking about\Nearlier will result in better outcomes.
Dialogue: 0,0:14:41.92,0:14:44.42,Default,,0000,0000,0000,,So students will often\Nask for writing advice from an AI
Dialogue: 0,0:14:44.42,0:14:45.97,Default,,0000,0000,0000,,even if you tell them not to do it.
Dialogue: 0,0:14:45.97,0:14:48.22,Default,,0000,0000,0000,,But they're in ask for it in a way\Nthat's fairly unsophisticated
Dialogue: 0,0:14:48.22,0:14:51.85,Default,,0000,0000,0000,,and is going to give them fairly generic\Nsounding work and possibly more mistakes.
Dialogue: 0,0:14:51.93,0:14:54.81,Default,,0000,0000,0000,,If you give a more elaborate prompt,\Nyou can get more elaborate answers.
Dialogue: 0,0:14:54.81,0:14:58.81,Default,,0000,0000,0000,,So in this case, could you explain what\Nthis prompt does, the feedback prompt. Yes.
Dialogue: 0,0:14:58.81,0:15:03.07,Default,,0000,0000,0000,,So we combine\Nthe principles of good feedback,
Dialogue: 0,0:15:03.07,0:15:06.36,Default,,0000,0000,0000,,which is feedback that takes into account\Nyour prior knowledge
Dialogue: 0,0:15:06.36,0:15:10.08,Default,,0000,0000,0000,,or what you already know from the student\Nperspective takes into account
Dialogue: 0,0:15:10.08,0:15:13.54,Default,,0000,0000,0000,,who you are, your learning level,\Nwhat grade you're in,
Dialogue: 0,0:15:13.62,0:15:16.62,Default,,0000,0000,0000,,whether you're in college\Nor you're in a professional.
Dialogue: 0,0:15:16.66,0:15:21.34,Default,,0000,0000,0000,,And it also takes into account the idea\Nthat you want to respond to this feedback.
Dialogue: 0,0:15:21.34,0:15:24.55,Default,,0000,0000,0000,,So it is going to be actionable,\Nit's going to be balanced,
Dialogue: 0,0:15:24.55,0:15:28.26,Default,,0000,0000,0000,,it's going to tell you what's wrong\Nand what you can improve on
Dialogue: 0,0:15:28.34,0:15:31.18,Default,,0000,0000,0000,,and what you're doing well,\Nand it's going to keep working with you.
Dialogue: 0,0:15:31.18,0:15:35.35,Default,,0000,0000,0000,,But like any good tutor or coach,\Nit won't actually give you the answer.
Dialogue: 0,0:15:35.52,0:15:37.10,Default,,0000,0000,0000,,It'll push you in that direction,
Dialogue: 0,0:15:37.10,0:15:40.77,Default,,0000,0000,0000,,ask you to explain,\Nask you to construct your own knowledge.
Dialogue: 0,0:15:40.86,0:15:44.23,Default,,0000,0000,0000,,And so you can see the prompt\Nhopefully on the screen here
Dialogue: 0,0:15:44.32,0:15:46.90,Default,,0000,0000,0000,,and as a place to work from.
Dialogue: 0,0:15:46.90,0:15:49.57,Default,,0000,0000,0000,,You don't need to take this\Nas an absolute answer.
Dialogue: 0,0:15:49.57,0:15:52.08,Default,,0000,0000,0000,,This is something you can play with,\Nbut let's see it in action.
Dialogue: 0,0:15:52.08,0:15:53.95,Default,,0000,0000,0000,,So let's get started using this prompt.
Dialogue: 0,0:15:53.95,0:15:57.21,Default,,0000,0000,0000,,It says that it's a teaching assistant\Nbecause that the instructions we gave it
Dialogue: 0,0:15:57.37,0:16:00.79,Default,,0000,0000,0000,,and it asks us for our grade\Nlevel and subject we're studying,
Dialogue: 0,0:16:00.79,0:16:01.96,Default,,0000,0000,0000,,what should we say?
Dialogue: 0,0:16:01.96,0:16:05.26,Default,,0000,0000,0000,,So I think we're studying Macbeth\Nand we're in 12th grade.
Dialogue: 0,0:16:05.34,0:16:11.39,Default,,0000,0000,0000,,In 12th grade. Okay, great.
Dialogue: 0,0:16:11.47,0:16:12.26,Default,,0000,0000,0000,,Okay.
Dialogue: 0,0:16:12.26,0:16:14.97,Default,,0000,0000,0000,,And so we've told the AI this information\Nit’s feeding it
Dialogue: 0,0:16:14.97,0:16:17.98,Default,,0000,0000,0000,,into the logic that it's using here.
Dialogue: 0,0:16:18.06,0:16:20.77,Default,,0000,0000,0000,,And it's asking us about a specific assignment
Dialogue: 0,0:16:20.77,0:16:23.44,Default,,0000,0000,0000,,and it's asking if we have a rubric\Nor other information to work with or what
Dialogue: 0,0:16:23.44,0:16:26.86,Default,,0000,0000,0000,,we're hoping to achieve\Nwith with as much information as possible.
Dialogue: 0,0:16:26.86,0:16:30.95,Default,,0000,0000,0000,,I don't have a huge amount here,\Nso I'll say I have to write
Dialogue: 0,0:16:31.03,0:16:35.41,Default,,0000,0000,0000,,an analysis of Macbeth.
Dialogue: 0,0:16:35.49,0:16:38.66,Default,,0000,0000,0000,,It is graded
Dialogue: 0,0:16:38.75,0:16:40.92,Default,,0000,0000,0000,,based on
Dialogue: 0,0:16:40.92,0:16:45.92,Default,,0000,0000,0000,,rating style and depth of content
Dialogue: 0,0:16:46.00,0:16:48.80,Default,,0000,0000,0000,,and you'll see what it's going\Nis it's asking ask questions
Dialogue: 0,0:16:48.80,0:16:50.26,Default,,0000,0000,0000,,and soliciting information from us,
Dialogue: 0,0:16:50.26,0:16:53.26,Default,,0000,0000,0000,,which makes it kind of a good prompt\Nthat you might hand a student
Dialogue: 0,0:16:53.30,0:16:56.97,Default,,0000,0000,0000,,better than one that is just they're just\Ndeveloping themselves and it's asking
Dialogue: 0,0:16:56.97,0:17:00.35,Default,,0000,0000,0000,,about specific instructions\Nand ask us to share the assignment.
Dialogue: 0,0:17:00.44,0:17:05.19,Default,,0000,0000,0000,,Here is what I have written so far,
Dialogue: 0,0:17:05.27,0:17:05.57,Default,,0000,0000,0000,,and I
Dialogue: 0,0:17:05.57,0:17:08.78,Default,,0000,0000,0000,,have asked\Nthe I to generate a Macbeth essay.
Dialogue: 0,0:17:08.78,0:17:10.70,Default,,0000,0000,0000,,So here we go.
Dialogue: 0,0:17:10.70,0:17:13.32,Default,,0000,0000,0000,,I'm just pasting that in
Dialogue: 0,0:17:13.32,0:17:14.28,Default,,0000,0000,0000,,and we'll see what it says here.
Dialogue: 0,0:17:14.28,0:17:17.45,Default,,0000,0000,0000,,And you'll notice\Nit's it's working on the information.
Dialogue: 0,0:17:17.45,0:17:19.46,Default,,0000,0000,0000,,It's saying it's taking time\Nto carefully read through it.
Dialogue: 0,0:17:19.46,0:17:20.71,Default,,0000,0000,0000,,That's a bit of illusion.
Dialogue: 0,0:17:20.71,0:17:24.04,Default,,0000,0000,0000,,It's obviously not taking extra time,\Nbut it's responding in this method
Dialogue: 0,0:17:24.04,0:17:26.38,Default,,0000,0000,0000,,and you'll see it's giving a set\Nof strengths and weaknesses.
Dialogue: 0,0:17:26.38,0:17:27.63,Default,,0000,0000,0000,,What's great about, again,
Dialogue: 0,0:17:27.63,0:17:31.01,Default,,0000,0000,0000,,using a tutor that you've built\Nor a mentor that you built is that it
Dialogue: 0,0:17:31.01,0:17:33.68,Default,,0000,0000,0000,,can give you the kind of feedback\Nthat's educationally valuable
Dialogue: 0,0:17:33.68,0:17:37.60,Default,,0000,0000,0000,,that ties into pedagogy rather than just\Nstudents asking Make this essay better.
Dialogue: 0,0:17:37.81,0:17:42.39,Default,,0000,0000,0000,,An example of a working in your favor\Nas an educator
Dialogue: 0,0:17:42.39,0:17:46.15,Default,,0000,0000,0000,,and not necessarily working against you\Nand undermining the point you're making.
Dialogue: 0,0:17:46.23,0:17:49.36,Default,,0000,0000,0000,,So you'll notice at the end, by the way,\Nit gives a question
Dialogue: 0,0:17:49.36,0:17:51.70,Default,,0000,0000,0000,,that for the students to answer.
Dialogue: 0,0:17:51.70,0:17:54.49,Default,,0000,0000,0000,,So how do you plan to revise\Nyour analysis?
Dialogue: 0,0:17:54.49,0:17:56.82,Default,,0000,0000,0000,,Give me a plan\Nand specific changes are going again.
Dialogue: 0,0:17:56.82,0:17:58.45,Default,,0000,0000,0000,,The kind of thing\Nwe would do as an instructor
Dialogue: 0,0:17:58.45,0:18:01.54,Default,,0000,0000,0000,,in a classroom\Nsoliciting changes or differences.
Dialogue: 0,0:18:01.54,0:18:05.75,Default,,0000,0000,0000,,So I think you can start to see why a
Dialogue: 0,0:18:05.83,0:18:06.54,Default,,0000,0000,0000,,tool like
Dialogue: 0,0:18:06.54,0:18:09.55,Default,,0000,0000,0000,,this can be really useful\Nwhen properly applied.
Dialogue: 0,0:18:09.71,0:18:13.51,Default,,0000,0000,0000,,Now, let's also talk about one\Nother potential use for AI, AI as a tutor.
Dialogue: 0,0:18:13.51,0:18:16.18,Default,,0000,0000,0000,,What are some of the advantages\Nand disadvantages of that approach?
Dialogue: 0,0:18:16.18,0:18:17.47,Default,,0000,0000,0000,,So an advantage of this approach
Dialogue: 0,0:18:17.47,0:18:21.02,Default,,0000,0000,0000,,is that you're getting students\Nto actually pay attention to the material.
Dialogue: 0,0:18:21.22,0:18:24.73,Default,,0000,0000,0000,,You're getting them\Nto read over the rubric, to read over
Dialogue: 0,0:18:24.85,0:18:29.11,Default,,0000,0000,0000,,the purpose of the essay and the audience,\Nand to really think through it.
Dialogue: 0,0:18:29.19,0:18:31.86,Default,,0000,0000,0000,,A disadvantage is that you
Dialogue: 0,0:18:31.86,0:18:36.45,Default,,0000,0000,0000,,you certainly can ask the AI\Nto do it for you, but if you work with it
Dialogue: 0,0:18:36.45,0:18:40.45,Default,,0000,0000,0000,,and if you're given guidelines to work\Nwith it, it's one way to get feedback.
Dialogue: 0,0:18:40.45,0:18:42.75,Default,,0000,0000,0000,,But you would then have to evaluate
Dialogue: 0,0:18:42.75,0:18:46.38,Default,,0000,0000,0000,,something else that a teacher could do\Nis to ask for the interactions
Dialogue: 0,0:18:46.38,0:18:48.58,Default,,0000,0000,0000,,and ask for a reflection\Nabout the interactions.
Dialogue: 0,0:18:48.58,0:18:49.21,Default,,0000,0000,0000,,What about this
Dialogue: 0,0:18:49.21,0:18:50.13,Default,,0000,0000,0000,,feedback was good?
Dialogue: 0,0:18:50.13,0:18:52.30,Default,,0000,0000,0000,,What about this feedback was not as good?
Dialogue: 0,0:18:52.30,0:18:56.38,Default,,0000,0000,0000,,And again, it's a higher order level\Nthinking about your essay
Dialogue: 0,0:18:56.47,0:18:59.35,Default,,0000,0000,0000,,and your process. Excellent.
Dialogue: 0,0:18:59.35,0:19:04.14,Default,,0000,0000,0000,,And so why don't you do one other example\Nwhere the AI acts as a direct instructor
Dialogue: 0,0:19:04.23,0:19:06.02,Default,,0000,0000,0000,,and we have a prompt for that as well.
Dialogue: 0,0:19:06.02,0:19:09.65,Default,,0000,0000,0000,,There are risks associated with asking\Nthe AI to be a direct instructor,
Dialogue: 0,0:19:09.65,0:19:11.44,Default,,0000,0000,0000,,which is that hallucination risk.
Dialogue: 0,0:19:11.44,0:19:14.70,Default,,0000,0000,0000,,It doesn't know your pedagogy,\Nyour your, your perspective.
Dialogue: 0,0:19:14.94,0:19:17.95,Default,,0000,0000,0000,,But I find in my classrooms\Nthat students are increasingly
Dialogue: 0,0:19:17.95,0:19:22.37,Default,,0000,0000,0000,,using the AI as a method of learning\Nso they don't raise their hands as much.
Dialogue: 0,0:19:22.37,0:19:23.62,Default,,0000,0000,0000,,So when I ask them why, they're like,\NWell,
Dialogue: 0,0:19:23.62,0:19:25.20,Default,,0000,0000,0000,,I'd rather not show my ignorance in class,
Dialogue: 0,0:19:25.20,0:19:27.92,Default,,0000,0000,0000,,I could ask the AI to explain\Nlike I'm five.
Dialogue: 0,0:19:27.92,0:19:29.63,Default,,0000,0000,0000,,So they're already engaged\Nin this behavior.
Dialogue: 0,0:19:29.63,0:19:32.88,Default,,0000,0000,0000,,So something like a tutor\Nboth does a useful thing
Dialogue: 0,0:19:32.88,0:19:36.22,Default,,0000,0000,0000,,of showing you what the future of AI\Neducation might look like.
Dialogue: 0,0:19:36.30,0:19:39.64,Default,,0000,0000,0000,,Like the way Khan Academy is building\NAI interactive tutors to work.
Dialogue: 0,0:19:39.80,0:19:43.43,Default,,0000,0000,0000,,And it also might be a tool your students\Ncan use to achieve more in class,
Dialogue: 0,0:19:43.68,0:19:45.48,Default,,0000,0000,0000,,but you should caveat that\Nwith the knowledge
Dialogue: 0,0:19:45.48,0:19:48.35,Default,,0000,0000,0000,,that AI tutors are not 100% there yet.
Dialogue: 0,0:19:48.35,0:19:49.77,Default,,0000,0000,0000,,But let's let's use an example here.
Dialogue: 0,0:19:49.77,0:19:52.44,Default,,0000,0000,0000,,So this tutor is again\Ntrying to take the right kind of format.
Dialogue: 0,0:19:52.44,0:19:55.44,Default,,0000,0000,0000,,It says, Hello there, I'm your AI tutor\Nand I'm excited to work with you today.
Dialogue: 0,0:19:55.69,0:19:57.24,Default,,0000,0000,0000,,What do we want to learn about today?
Dialogue: 0,0:19:57.24,0:19:59.11,Default,,0000,0000,0000,,Let's learn about opportunity cost.
Dialogue: 0,0:19:59.11,0:20:02.12,Default,,0000,0000,0000,,Opportunity cost.\NA concept from economics.
Dialogue: 0,0:20:02.20,0:20:04.29,Default,,0000,0000,0000,,Let's see what happens.
Dialogue: 0,0:20:04.33,0:20:06.62,Default,,0000,0000,0000,,Okay, so we're telling the AI\Nor the opportunity cost
Dialogue: 0,0:20:06.62,0:20:09.62,Default,,0000,0000,0000,,that saying it is a key concept economics
Dialogue: 0,0:20:09.67,0:20:12.46,Default,,0000,0000,0000,,it’s even throwing in a little emoji here,\Nwhich is cute.
Dialogue: 0,0:20:12.46,0:20:14.13,Default,,0000,0000,0000,,Can you ask us about our learning level?
Dialogue: 0,0:20:14.13,0:20:15.55,Default,,0000,0000,0000,,What level are we at here?
Dialogue: 0,0:20:15.55,0:20:18.34,Default,,0000,0000,0000,,11th grade. 11th grade.
Dialogue: 0,0:20:18.34,0:20:21.43,Default,,0000,0000,0000,,Now, I wouldn't get too\Ntied up on the individual grade.
Dialogue: 0,0:20:21.43,0:20:22.47,Default,,0000,0000,0000,,It's not amazing
Dialogue: 0,0:20:22.47,0:20:24.56,Default,,0000,0000,0000,,at differentiating a 10th grader\Nfrom an 11th grader,
Dialogue: 0,0:20:24.56,0:20:26.31,Default,,0000,0000,0000,,but this is part of the context\Nin which it's working in.
Dialogue: 0,0:20:26.31,0:20:31.10,Default,,0000,0000,0000,,So that pulling from some sort of\Nuniversal standards here and it says,
Dialogue: 0,0:20:31.15,0:20:33.90,Default,,0000,0000,0000,,what do we know about opportunity cost?
Dialogue: 0,0:20:33.90,0:20:37.53,Default,,0000,0000,0000,,So we know that it has to do\Nwith alternative choices,
Dialogue: 0,0:20:37.61,0:20:41.86,Default,,0000,0000,0000,,has to do with alternative choices.
Dialogue: 0,0:20:41.95,0:20:43.16,Default,,0000,0000,0000,,That is it.
Dialogue: 0,0:20:43.16,0:20:44.83,Default,,0000,0000,0000,,And of course, \None of the advantages of AI
Dialogue: 0,0:20:44.83,0:20:46.08,Default,,0000,0000,0000,,is this kind of freeform text
Dialogue: 0,0:20:46.08,0:20:49.66,Default,,0000,0000,0000,,and interaction\Nis the real power of education
Dialogue: 0,0:20:49.75,0:20:51.92,Default,,0000,0000,0000,,and it's something the AI can fake\Nreasonably well.
Dialogue: 0,0:20:51.92,0:20:54.88,Default,,0000,0000,0000,,Again, not as well as a real human\Ninstructor yet.
Dialogue: 0,0:20:54.88,0:20:57.88,Default,,0000,0000,0000,,And you'll notice it's giving us examples
Dialogue: 0,0:20:58.01,0:21:02.39,Default,,0000,0000,0000,,and explaining things in different ways,\Nwhich is a powerful thing that AI can do.
Dialogue: 0,0:21:02.39,0:21:04.72,Default,,0000,0000,0000,,It's very good\Nat breaking things down in different ways,
Dialogue: 0,0:21:04.72,0:21:07.18,Default,,0000,0000,0000,,but you'll notice that it's\Nthey're starting to ask questions.
Dialogue: 0,0:21:07.18,0:21:09.18,Default,,0000,0000,0000,,It's asking us to make choices.
Dialogue: 0,0:21:09.18,0:21:11.60,Default,,0000,0000,0000,,So one of things\Nwe know from the research on tutoring is
Dialogue: 0,0:21:11.60,0:21:13.86,Default,,0000,0000,0000,,you can't just declaim things to people.
Dialogue: 0,0:21:13.86,0:21:16.44,Default,,0000,0000,0000,,The value of tutoring comes\Nfrom soliciting information,
Dialogue: 0,0:21:16.44,0:21:17.28,Default,,0000,0000,0000,,making connections.
Dialogue: 0,0:21:17.28,0:21:18.86,Default,,0000,0000,0000,,And you can see the AI\Nstarting to do this
Dialogue: 0,0:21:18.86,0:21:21.07,Default,,0000,0000,0000,,and asking us for connections\Nin our own life.
Dialogue: 0,0:21:21.07,0:21:24.37,Default,,0000,0000,0000,,The other thing to mention too,\Nabout the tutor prompt is that it
Dialogue: 0,0:21:24.37,0:21:29.83,Default,,0000,0000,0000,,is not assuming that the student\Ncan judge their own learning. Very often
Dialogue: 0,0:21:29.96,0:21:32.71,Default,,0000,0000,0000,,you'll see in a tutor prompt\Nthat is very simple.
Dialogue: 0,0:21:32.71,0:21:34.25,Default,,0000,0000,0000,,Like explain to me like on ten,
Dialogue: 0,0:21:34.25,0:21:36.84,Default,,0000,0000,0000,,it'll ask you\Nif you'll understand something instead.
Dialogue: 0,0:21:36.84,0:21:37.55,Default,,0000,0000,0000,,here
Dialogue: 0,0:21:37.55,0:21:39.13,Default,,0000,0000,0000,,It's not asking you to make a judgment
Dialogue: 0,0:21:39.13,0:21:41.80,Default,,0000,0000,0000,,about your own learning,\Nwhich we know is inherently flawed.
Dialogue: 0,0:21:41.80,0:21:45.39,Default,,0000,0000,0000,,Instead, it's soliciting, as Ethan said,\Nsoliciting information from you
Dialogue: 0,0:21:45.55,0:21:49.18,Default,,0000,0000,0000,,to find out what you know\Nand to help you build on your knowledge.
Dialogue: 0,0:21:49.39,0:21:53.48,Default,,0000,0000,0000,,And these sorts of subtle differences\Nare what separates
Dialogue: 0,0:21:53.56,0:21:57.40,Default,,0000,0000,0000,,using AI in sort of an expert way\Nin a classroom where we know
Dialogue: 0,0:21:57.48,0:22:00.99,Default,,0000,0000,0000,,what we want to have happen from\Njust the naive use people are doing,
Dialogue: 0,0:22:05.95,0:22:06.74,Default,,0000,0000,0000,,I think that
Dialogue: 0,0:22:06.74,0:22:10.54,Default,,0000,0000,0000,,there is an advantage\Nto taking charge of your students AI usage
Dialogue: 0,0:22:10.54,0:22:12.12,Default,,0000,0000,0000,,because they're going to be using it\Nanyway
Dialogue: 0,0:22:12.12,0:22:15.42,Default,,0000,0000,0000,,and thinking about directing it either by giving them\Nprompts, having these discussions
Dialogue: 0,0:22:15.62,0:22:17.04,Default,,0000,0000,0000,,and it's a really powerful tool
Dialogue: 0,0:22:17.04,0:22:20.05,Default,,0000,0000,0000,,that in the future will greatly boost\Nclassroom learning
Dialogue: 0,0:22:20.05,0:22:23.38,Default,,0000,0000,0000,,and is not a replacement\Nor threat for teachers.
Dialogue: 0,0:22:23.38,0:22:27.10,Default,,0000,0000,0000,,It is something that we can use\Nto improve the outputs of our work,
Dialogue: 0,0:22:27.22,0:22:31.56,Default,,0000,0000,0000,,improve student learning, make our lives\Neasier while making students lives better
Dialogue: 0,0:22:31.68,0:22:34.69,Default,,0000,0000,0000,,and I think that that's\Na very powerful view of the future.
Dialogue: 0,0:22:34.69,0:22:37.98,Default,,0000,0000,0000,,And I hope that you at least embrace\Nand experiment with AI before deciding
Dialogue: 0,0:22:37.98,0:22:40.36,Default,,0000,0000,0000,,whether you want to use it\Nor ban it in your classrooms.
Dialogue: 0,0:22:41.23,0:22:46.16,Default,,0000,0000,0000,,Wow. There really are so many ways\Nto enhance student learning using AI.
Dialogue: 0,0:22:46.24,0:22:46.86,Default,,0000,0000,0000,,With AI
Dialogue: 0,0:22:46.86,0:22:51.29,Default,,0000,0000,0000,,technology advancing rapidly, there\Nwill be more and more tools available.
Dialogue: 0,0:22:51.37,0:22:55.42,Default,,0000,0000,0000,,As with any new tool,\Neducators have a responsibility to ensure
Dialogue: 0,0:22:55.42,0:23:00.17,Default,,0000,0000,0000,,they're using age appropriate tools,\Nprotecting student privacy
Dialogue: 0,0:23:00.25,0:23:03.59,Default,,0000,0000,0000,,and creating spaces\Nfor students to critically evaluate
Dialogue: 0,0:23:03.67,0:23:07.18,Default,,0000,0000,0000,,the potential pitfalls of the technology\Nthey are using.
Dialogue: 0,0:23:07.26,0:23:11.22,Default,,0000,0000,0000,,Join us in session 4 Ensuring\Na Responsible Approach to AI
Dialogue: 0,0:23:11.39,0:23:13.39,Default,,0000,0000,0000,,as we explore these topics.
Dialogue: 0,0:23:13.39,0:23:14.43,Default,,0000,0000,0000,,Thanks for joining us.
Dialogue: 0,0:23:14.43,0:23:16.10,Default,,0000,0000,0000,,See you again In session four.
Dialogue: 0,0:23:16.10,0:23:21.90,Default,,0000,0000,0000,,Visit the AI 101 for Teachers\Nwebsite at Code.org/ai101
Dialogue: 0,0:23:22.11,0:23:23.74,Default,,0000,0000,0000,,to sign up\Nfor early access
Dialogue: 0,0:23:23.86,0:23:27.07,Default,,0000,0000,0000,,and to explore additional resources\Nfrom Code.org.
Dialogue: 0,0:23:27.16,0:23:29.95,Default,,0000,0000,0000,,ETS, ISTE and Khan Academy.
Dialogue: 0,0:23:29.95,0:23:30.91,Default,,0000,0000,0000,,Thanks for joining us.