1
99:59:59,999 --> 99:59:59,999
- [Narrator] On his quest 
to master econometrics,

2
99:59:59,999 --> 99:59:59,999
Grasshopper Kamal has 
made great progress

3
99:59:59,999 --> 99:59:59,999
stretching his capabilities 
and outsmarting his foes.

4
99:59:59,999 --> 99:59:59,999
Alas, today he's despondent.

5
99:59:59,999 --> 99:59:59,999
For one challenge remains unmet.

6
99:59:59,999 --> 99:59:59,999
Kamal cannot yet decode 
the scriptures of academic research,

7
99:59:59,999 --> 99:59:59,999
journals like 
"The American Economic Review"

8
99:59:59,999 --> 99:59:59,999
and "Econometrica."

9
99:59:59,999 --> 99:59:59,999
These seemed to him to be inscribed 
in an obscure foreign tongue.

10
99:59:59,999 --> 99:59:59,999
- [Kamal] Ugh, what the... ?

11
99:59:59,999 --> 99:59:59,999
- [Narrator] These volumes are 
opaque to novice, Kamal,

12
99:59:59,999 --> 99:59:59,999
but can be deciphered with study.

13
99:59:59,999 --> 99:59:59,999
Let us learn to read them together.

14
99:59:59,999 --> 99:59:59,999
Let's dive into the West Point study,

15
99:59:59,999 --> 99:59:59,999
published in the "Economics 
of Education Review."

16
99:59:59,999 --> 99:59:59,999
This paper reports 
on a randomized evaluation

17
99:59:59,999 --> 99:59:59,999
of student electronics use 
in Economics 101 classrooms.

18
99:59:59,999 --> 99:59:59,999
First, a quick review 
of the research design.

19
99:59:59,999 --> 99:59:59,999
- Okay.

20
99:59:59,999 --> 99:59:59,999
- [Josh] 'Metrics masters 
teaching at West Point,

21
99:59:59,999 --> 99:59:59,999
the military college that trains 
American Army officers

22
99:59:59,999 --> 99:59:59,999
designed a randomized trial
to answer this question.

23
99:59:59,999 --> 99:59:59,999
These masters randomly assigned
West Point cadets

24
99:59:59,999 --> 99:59:59,999
into Economics classes
operating under different rules.

25
99:59:59,999 --> 99:59:59,999
Unlike most American colleges,

26
99:59:59,999 --> 99:59:59,999
the West Point default 
is no electronics.

27
99:59:59,999 --> 99:59:59,999
For purposes of this experiment,
some students were left

28
99:59:59,999 --> 99:59:59,999
in such traditional 
technology-free classes,

29
99:59:59,999 --> 99:59:59,999
no lap tops, no tablets 
and no phones!

30
99:59:59,999 --> 99:59:59,999
[voice echoes]

31
99:59:59,999 --> 99:59:59,999
This is the control group,
or baseline case.

32
99:59:59,999 --> 99:59:59,999
Another group was allowed
to use electronics.

33
99:59:59,999 --> 99:59:59,999
This is the treatment group,
subject to a changed environment.

34
99:59:59,999 --> 99:59:59,999
The treatment in this case
is the unrestricted use

35
99:59:59,999 --> 99:59:59,999
of laptops or tablets in class.

36
99:59:59,999 --> 99:59:59,999
Every causal question 
has a clear outcome,

37
99:59:59,999 --> 99:59:59,999
the variables we hope to influence
defined in advance of the study.

38
99:59:59,999 --> 99:59:59,999
The outcomes in the West Point
electronics study

39
99:59:59,999 --> 99:59:59,999
are final exam scores.

40
99:59:59,999 --> 99:59:59,999
The study seeks to answer
the following question,

41
99:59:59,999 --> 99:59:59,999
what is the causal effect 
of classroom electronics on learning

42
99:59:59,999 --> 99:59:59,999
as measured by exam scores?

43
99:59:59,999 --> 99:59:59,999
- Economics journal articles 
usually begin with a table

44
99:59:59,999 --> 99:59:59,999
of descriptive statistics,
giving key facts

45
99:59:59,999 --> 99:59:59,999
about the study sample.

46
99:59:59,999 --> 99:59:59,999
- Oh my gosh, I remember this table,
so confusing!

47
99:59:59,999 --> 99:59:59,999
Columns 1 to 3 report mean,
or average, characteristics.

48
99:59:59,999 --> 99:59:59,999
These give a sense 
of who we're studying.

49
99:59:59,999 --> 99:59:59,999
Let's start with column 1 
which describes covariates

50
99:59:59,999 --> 99:59:59,999
in a control group.

51
99:59:59,999 --> 99:59:59,999
Covariates are characteristics 
of the control and treatment groups

52
99:59:59,999 --> 99:59:59,999
measured before 
the experiment begins.

53
99:59:59,999 --> 99:59:59,999
For example, we see the control group
has an average age a bit over 20.

54
99:59:59,999 --> 99:59:59,999
Many of these covariates 
are dummy variables.

55
99:59:59,999 --> 99:59:59,999
A dummy variable can only have 
two values, a zero or a one.

56
99:59:59,999 --> 99:59:59,999
For example, student gender
is captured by a dummy variable

57
99:59:59,999 --> 99:59:59,999
that equals one for woman
and zero for man.

58
99:59:59,999 --> 99:59:59,999
The mean of this variable 
is the proportion female.

59
99:59:59,999 --> 99:59:59,999
We also see that the control group 
is 13% Hispanic

60
99:59:59,999 --> 99:59:59,999
and 19% had prior military service.

61
99:59:59,999 --> 99:59:59,999
The table notes are key.

62
99:59:59,999 --> 99:59:59,999
Refer to these 
as you scan the table.

63
99:59:59,999 --> 99:59:59,999
These notes explain what's shown 
in each column and panel.

64
99:59:59,999 --> 99:59:59,999
The notes tell us, for example,
that standard deviations

65
99:59:59,999 --> 99:59:59,999
are reported in brackets.

66
99:59:59,999 --> 99:59:59,999
Standard deviations tell us how
spread out the data are.

67
99:59:59,999 --> 99:59:59,999
For example, a standard deviation 
of 0.52 tells us that most

68
99:59:59,999 --> 99:59:59,999
of the control group's GPAs
fall between 2.35,

69
99:59:59,999 --> 99:59:59,999
which is 0.52 below 
the mean GPA of 2.87,

70
99:59:59,999 --> 99:59:59,999
and 3.39, which is 0.52 above 2.87.

71
99:59:59,999 --> 99:59:59,999
A lower standard deviation
would mean the GPAs were

72
99:59:59,999 --> 99:59:59,999
more tightly clustered 
around the mean.

73
99:59:59,999 --> 99:59:59,999
- [Kamal] Yeah, but they're missing
from most of the variables.

74
99:59:59,999 --> 99:59:59,999
- [Narrator] That's right.

75
99:59:59,999 --> 99:59:59,999
Masters usually omit 
standard deviations for dummies.