[Script Info] Title: [Events] Format: Layer, Start, End, Style, Name, MarginL, MarginR, MarginV, Effect, Text Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,1\N00:00:04,540 --> 00:00:10,180\NWelcome in this video, I'm going to start introducing the basic concepts of statistical graphics. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,2\N00:00:10,180 --> 00:00:13,660\NI want you to be able to understand the value of graphics for presenting data, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,3\N00:00:13,660 --> 00:00:19,540\Nidentify parts of a statistical image, and understand some pitfalls and graphics that we want to try to avoid. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,4\N00:00:19,540 --> 00:00:25,300\NSo here's an example of a chart, and there's a variety of different pieces of this chart. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,5\N00:00:25,300 --> 00:00:31,900\NWe have an x axis. That's the horizontal x axis. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,6\N00:00:31,900 --> 00:00:41,820\NWe have a y axis, the vertical axis. Each of these axes has a label. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,7\N00:00:41,820 --> 00:00:52,610\NTask to task one. We have a caption up at the top that explains what's going on in the image, provides us with the context to understand it. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,8\N00:00:52,610 --> 00:00:59,660\NAnd it says that this graph is showing the number of queries per task with query account distributions in the margins. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,9\N00:00:59,660 --> 00:01:04,070\NAnd each dot is one participant. So it tells us we have a data point in it. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,10\N00:01:04,070 --> 00:01:09,020\NWhat is that? It tells us what it is that we're charting. Number of queries per task. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,11\N00:01:09,020 --> 00:01:14,760\NWhen we then see the axis labels that we have task one and we have task to. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,12\N00:01:14,760 --> 00:01:19,500\NThose two together, give us the context, understand that. Oh, we have two tasks. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,13\N00:01:19,500 --> 00:01:24,000\NAnd this is why of one participant. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,14\N00:01:24,000 --> 00:01:28,620\NAnd they're appearing at the point where they have their task, one count on their task, two counts. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,15\N00:01:28,620 --> 00:01:34,530\NOK, this allows us to to see if there's any relationship between how long it took to. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,16\N00:01:34,530 --> 00:01:40,800\NHow many queries it took to complete the two different tasks. It then says we have query count distribution than the margin. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,17\N00:01:40,800 --> 00:01:46,050\NSo this is a compound plot. And in the left and right, margins are in the X and Y margins. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,18\N00:01:46,050 --> 00:01:52,530\NWe have the distribution, a histogram of the X axis, the task one. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,19\N00:01:52,530 --> 00:01:59,560\NWe have a histogram of the Y axis task to these histograms don't have axes themselves because, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,20\N00:01:59,560 --> 00:02:04,680\Nwell, we just wanted to show a distribution the exact particularly for our purposes here. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,21\N00:02:04,680 --> 00:02:16,980\NThe exact number in each bean is not so important. The key thing is just see being able to see relatively where is the mass of the different? Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,22\N00:02:16,980 --> 00:02:21,150\NWhere is the mass on the two different task counts? Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,23\N00:02:21,150 --> 00:02:27,620\NAnd we can see that both of them have a a right skew. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,24\N00:02:27,620 --> 00:02:32,780\NThey're bulked up towards towards the low end of the scale. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,25\N00:02:32,780 --> 00:02:41,120\NAnd then we have the all the we have all of the individual data points scat on the chart. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,26\N00:02:41,120 --> 00:02:46,670\NThis is called a scatterplot. We have these different pieces of the chart that we want to be able to identify. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,27\N00:02:46,670 --> 00:02:55,400\NAnd when you go particularly as you go to refine a chart, what you're going to need to do is specify what's happening on each of these pieces. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,28\N00:02:55,400 --> 00:02:59,300\NWhat is your x axis? What is your y axis? Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,29\N00:02:59,300 --> 00:03:08,600\NBefore you even start the chart, you need to set up your data so that we have what is the data point that I'm going to be plotting on this chart? Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,30\N00:03:08,600 --> 00:03:16,280\NSo charts can are really useful for revealing a variety of things that can reveal patterns or lack there of. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,31\N00:03:16,280 --> 00:03:19,200\NIn this chart, there's really not much of a pattern. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,32\N00:03:19,200 --> 00:03:26,700\NAnd we can see that it's booked up, but particularly if we get out to that larger number of tasks, there's not a lot of pattern. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,33\N00:03:26,700 --> 00:03:34,560\NThe one with the participant, with the most tasks and with the most tasks or queries for task one. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,34\N00:03:34,560 --> 00:03:38,760\NHas a middling to low number of queries for Task two. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,35\N00:03:38,760 --> 00:03:47,790\NAnd the the one who has the most queries for task to while they're in the upper end of of the queries per task on task one, they're biased. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,36\N00:03:47,790 --> 00:03:53,520\NThey're not at all the highest. So we can see there's not a not very much of a relationship here. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,37\N00:03:53,520 --> 00:03:59,490\NAt least that doesn't look like one. They can be useful for comparisons. If we've got a bar chart, we can compare to bars. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,38\N00:03:59,490 --> 00:04:08,220\NWe can see where points lay. We can see like we can see in that chart that we just saw that the the highest number of counts for one task, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,39\N00:04:08,220 --> 00:04:12,210\Nthe highest number of counts for another task or different. We can also see trends. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,40\N00:04:12,210 --> 00:04:14,610\NWe can see if a line looks like it goes up or down, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,41\N00:04:14,610 --> 00:04:22,950\Nwiggles around so they can reveal a lot of these kinds of things and they can really leverage our human perception and our human, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,42\N00:04:22,950 --> 00:04:25,080\Nparticularly our human visual senses, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,43\N00:04:25,080 --> 00:04:35,820\Nto be able to quickly internalize and understand what is going on in in a set of data when we're creating a chart. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,44\N00:04:35,820 --> 00:04:41,520\NWe need to clearly document a few things. We you clearly state what is being presented when someone looks at a chart. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,45\N00:04:41,520 --> 00:04:45,720\NThey need to be able to understand what each point in the chart is going to be. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,46\N00:04:45,720 --> 00:04:56,530\NThey need to understand what values are plotted on the axis. They need to understand what values are plotted on the axes. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,47\N00:04:56,530 --> 00:05:01,260\NOften this is done in an axis label in our in the chart I showed you, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,48\N00:05:01,260 --> 00:05:06,040\Nit said the values in the caption in the axis labels said which version of them they were. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,49\N00:05:06,040 --> 00:05:08,560\NIf there are units, that needs to be clear. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,50\N00:05:08,560 --> 00:05:19,840\NSo if you've got something that's millimeters, that's pounds, that's megabytes, whatever, you need to specify the units in your in your chart, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,51\N00:05:19,840 --> 00:05:29,320\Neither in the Axis label or in the caption, some of these things can sometimes be implicit in the type of chart, such as a histogram. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,52\N00:05:29,320 --> 00:05:32,440\NAnd you've got a fraction or a percentage in the left hand side. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,53\N00:05:32,440 --> 00:05:41,260\NIt's standard convention that we're talking about, the fraction of the values that are in each bin, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,54\N00:05:41,260 --> 00:05:49,930\Nat least if you label it as a histogram or as a chart showing the distribution. But when in doubt, if there's any doubt about. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,55\N00:05:49,930 --> 00:05:57,090\NWhat a value, what an axis label is. Or there's any doubt that the reader will understand what it is. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,56\N00:05:57,090 --> 00:06:04,230\NBe explicit, explicitly, say what's going on in your chart. That also the chart in the caption should be interpretable on their own. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,57\N00:06:04,230 --> 00:06:08,640\NYou can assume a reasonable level. You have to know your audience for this. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,58\N00:06:08,640 --> 00:06:16,200\NBut someone should be able to just look at the chart with its immediately surrounding description, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,59\N00:06:16,200 --> 00:06:20,670\Nthe labels, the caption and understand have a pretty good idea of what's going on. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,60\N00:06:20,670 --> 00:06:25,990\NThe surrounding text with the text that references the chart if you're writing a document. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,61\N00:06:25,990 --> 00:06:30,190\NThat can have your observations, that can provide more context and clarity. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,62\N00:06:30,190 --> 00:06:35,950\NBut someone just looking at the chart should be able to figure out basically what's going on and Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,63\N00:06:35,950 --> 00:06:41,080\Nnot be too far off of this is particularly important because there's a there's a lot of people, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,64\N00:06:41,080 --> 00:06:46,150\Nwhether this is a good or a bad practice, we can debate. But there's a lot of people who, when they're reading a paper, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,65\N00:06:46,150 --> 00:06:52,000\Nthey focus on the charts and look at the key charts first to see what it is that's going on in the paper. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,66\N00:06:52,000 --> 00:07:01,990\NAnd if our if our charts are self-explanatory and are clear that it makes a lot easier for people to glance at our work, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,67\N00:07:01,990 --> 00:07:09,370\Nsee what it's doing and decide whether they are going to pay it further attention. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,68\N00:07:09,370 --> 00:07:12,970\NSo in a paper, if you're putting a chart in a docket, a written document or a paper, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,69\N00:07:12,970 --> 00:07:18,640\Neach figure should have a caption and the caption can it labels the figure and it can also provide interpretive guidance. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,70\N00:07:18,640 --> 00:07:18,790\NLike, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,71\N00:07:18,790 --> 00:07:26,410\Nit's not uncommon for a caption to be two or three sentences saying things about what's going on in the chart and describing some of the methodology, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,72\N00:07:26,410 --> 00:07:31,800\Nwhat precisely some of the computations are, etc. In other contexts, we often need a title for the charts. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,73\N00:07:31,800 --> 00:07:37,900\NSo if we have a caption we don't, we need to label our axes, but we don't need a title for the chart itself all the time. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,74\N00:07:37,900 --> 00:07:40,840\NIt doesn't hurt, but often it's redundant with the caption. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,75\N00:07:40,840 --> 00:07:46,690\NIn other contexts, though, we often do need a title such as when we have a chart that's going in a presentation. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,76\N00:07:46,690 --> 00:07:50,230\NWe have a chart in one of our notebooks. A title is often helpful in notebooks. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,77\N00:07:50,230 --> 00:07:52,180\NThe surrounding text may be sufficient, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,78\N00:07:52,180 --> 00:07:59,920\Nbut a title is often a good idea for someone who's quickly scanning the notebook to be able to understand what's going on in the chart. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,79\N00:07:59,920 --> 00:08:04,570\NSo a few pitfalls to be aware of when we're thinking about statistical graphics is Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,80\N00:08:04,570 --> 00:08:10,930\None is distorting the distances or the differences that are happening particularly. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,81\N00:08:10,930 --> 00:08:13,600\NWe need to make sure if something has a length, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,82\N00:08:13,600 --> 00:08:21,040\Nanything that has a length that length should accurately represent quantities, position, relative position. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,83\N00:08:21,040 --> 00:08:26,800\NIf you have two dots, their relative position is what's important. But if we have a length of it, if we have a bar, it has a length. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,84\N00:08:26,800 --> 00:08:30,700\NIt also is an area we need to make sure those accurately represent quantities. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,85\N00:08:30,700 --> 00:08:37,140\NOne really common way to violate this is having a bar chart whose access starts at something other than zero. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,86\N00:08:37,140 --> 00:08:41,670\NThe software we're using doesn't do that by default. Excel does. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,87\N00:08:41,670 --> 00:08:46,860\NBut your bar chart always needs to start at zero because people are beat. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,88\N00:08:46,860 --> 00:08:51,540\NPeople don't look at the relative position of the bar. People see the whole height of the bar. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,89\N00:08:51,540 --> 00:08:59,400\NAnd so if it doesn't start at zero, it looks like the difference between bars is much higher relative to the bar size than it actually is. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,90\N00:08:59,400 --> 00:09:01,860\NThere's also ways in which we can violate conventions. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,91\N00:09:01,860 --> 00:09:09,210\NSo in the first video I showed you the chart that violated the convention, that the x axis goes in order. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,92\N00:09:09,210 --> 00:09:16,320\NIf we violate the user's expectations, they they'll either be confused by the chart or read it wrong. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,93\N00:09:16,320 --> 00:09:24,240\NStatistical graphics in each particular type of chart have conventions that people who read a lot of them assimilate by long patterns of reading, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,94\N00:09:24,240 --> 00:09:32,570\Nlike you assimilate how to read written text. And if those expect expectations are violated, that can. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,95\N00:09:32,570 --> 00:09:37,490\NLead the user to incorrect conclusions from our charts, from our presentation. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,96\N00:09:37,490 --> 00:09:42,920\NA key thing to remember here that also applies to all of our presentations. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,97\N00:09:42,920 --> 00:09:52,350\NResearch isn't a mystery novel. You don't have to worry about spoiling the surprise or you end the goal here is not to present it, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,98\N00:09:52,350 --> 00:09:56,100\Nnot to subvert tropes or present shocking new presentations. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,99\N00:09:56,100 --> 00:10:00,470\NWe might have shocking new evidence, but from a presentation perspective, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,100\N00:10:00,470 --> 00:10:08,040\Nwe want it to fit within conventions and not violate readers expectations unnecessarily so that Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,101\N00:10:08,040 --> 00:10:14,370\Nthey can read it and be confident that they've correctly understood what it is that you're saying. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,102\N00:10:14,370 --> 00:10:18,990\NAnother thing to be aware of is that graphics can illustrate an effect. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,103\N00:10:18,990 --> 00:10:27,060\NThey can also help you find an effect. Like more exploring data. We can look at the graphics to see what effects we might be looking for. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,104\N00:10:27,060 --> 00:10:33,660\NWe have to be careful about that. We'll talk about some of the pitfalls of we have to be careful, more combining. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,105\N00:10:33,660 --> 00:10:39,420\NWe can't combine exploratory and what's called confirmatory analysis, but they can help us. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,106\N00:10:39,420 --> 00:10:45,990\NVisualizing data can help us look for possible effects and get ideas for what to go look for next. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,107\N00:10:45,990 --> 00:10:53,530\NBut they're not conclusive proof of an effect. We need the numeric results, just the raw numerical. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,108\N00:10:53,530 --> 00:11:00,030\NThe raw numbers as well as the numeric result are the results of inferential techniques that let us Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,109\N00:11:00,030 --> 00:11:06,090\Nestimate how big an effect is and whether it's significant in order to come to any conclusions. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,110\N00:11:06,090 --> 00:11:13,920\NSo in this chart, I want to show you, for example, we have if we look at the chart closely, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,111\N00:11:13,920 --> 00:11:20,790\Nwe have these two data points and the little blue Xs in them, the func SVOD axis. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,112\N00:11:20,790 --> 00:11:26,160\NAs to the left of the item, item X. So it looks like for this particular metric, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,113\N00:11:26,160 --> 00:11:32,900\Nlower is a better value for it because it's an error metric root mean squared errors with RMX he stands for. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,114\N00:11:32,900 --> 00:11:38,520\NBut it looks like. Okay. This is a little bit better, but that's not sufficient evidence for us to include. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,115\N00:11:38,520 --> 00:11:44,220\NTo conclude that func SVOD is better than item item on the per user are masc metric. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,116\N00:11:44,220 --> 00:11:48,900\NExactly what all these things are is, is a topic for another day. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,117\N00:11:48,900 --> 00:11:55,230\NBut the fact that we see the thing to the left, that s that if the effect is real, this illustrates it. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,118\N00:11:55,230 --> 00:12:02,220\NBut seeing it's not enough for us to conclude that it outperforms because it might be a fluke of our experimental strategy, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,119\N00:12:02,220 --> 00:12:07,120\Nit's a relatively small difference. So. They help us see. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,120\N00:12:07,120 --> 00:12:11,620\NThey help us communicate. They're not definitive and conclusive proof. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,121\N00:12:11,620 --> 00:12:16,660\NCouple of other things I want to highlight. They're going on in this graph. I've introduced two different kinds of symbols here. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,122\N00:12:16,660 --> 00:12:19,930\NSo the earlier graph, we just had one kind of symbol. We had dots here. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,123\N00:12:19,930 --> 00:12:24,580\NWe have two different kinds with a legend that says red circles are global. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,124\N00:12:24,580 --> 00:12:30,930\NOremus are a thing called global are masc and blue Xs are a thing called per user are MSE. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,125\N00:12:30,930 --> 00:12:37,920\NDon't have to understand what those are. But the point is, I'm using different colors and shapes in order to communicate, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,126\N00:12:37,920 --> 00:12:45,750\Nto show different versions of a thing in the same chart, using different shapes. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,127\N00:12:45,750 --> 00:12:50,430\NIn addition to different colors is useful because it's so imprinted on a black and white printer. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,128\N00:12:50,430 --> 00:12:57,270\NIf they if they have some form of color blindness, it helps it make the differences clearer. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,129\N00:12:57,270 --> 00:13:05,070\NI've also in addition so I've got my Y at my at Y axis, which is indicating different things that I'm plotting here. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,130\N00:13:05,070 --> 00:13:11,430\NI also have grouped them just to make it easier for the user to see. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,131\N00:13:11,430 --> 00:13:15,330\NThese are the same like these. These first ones are all single algorithms. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,132\N00:13:15,330 --> 00:13:20,920\NAnd then we have a blend and a few other things. The details are. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,133\N00:13:20,920 --> 00:13:27,220\NAren't important for illustrating them, but it helps guide the user to understand his structures to we have these group breakdowns. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,134\N00:13:27,220 --> 00:13:32,680\NIt also helps save space in the paper because I can present all of these different things in one place. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,135\N00:13:32,680 --> 00:13:39,730\NIt's easy to compare the different stages, even though I have to split the mountain, the discussion in the paper. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,136\N00:13:39,730 --> 00:13:46,540\NBut it gives you one place to compare them and it concisely shows the key results of the entire paper in one chart. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,137\N00:13:46,540 --> 00:13:51,880\NSo to wrap up graphics can make data clearer and they let us leverage human perception to understand it. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,138\N00:13:51,880 --> 00:13:54,160\NThey don't replace our numerical analysis, Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,139\N00:13:54,160 --> 00:14:01,570\Nbut they give it context and they help us more clearly communicate what it is that we're learning from the data and what's going on in it. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,140\N00:14:01,570 --> 00:14:06,340\NWe do, however, always need to make sure that we clearly label and describe our graphics so that Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,141\N00:14:06,340 --> 00:14:15,300\Nreaders can understand them and they can draw correct conclusions from them. Dialogue: 0,9:59:59.99,9:59:59.99,Default,,0000,0000,0000,,