Showing Revision 5 created 05/25/2016 by Udacity Robot.

1. Title:
   Counting Words Serially - Intro to Data Science
2. Description:

3. 400 0:00 - 0:03
   Here is one way to explain the Mapreduce programming
4. 3200 0:03 - 0:06
   model. Say that I wanted to count the number of
5. 5850 0:06 - 0:09
   occurrences of each word that appears at least once in
6. 8930 0:09 - 0:12
   a document. Let's use the text of Alice in Wonderland.
7. 13520 0:14 - 0:16
   Here's a bit of text that says Alice was
8. 15750 0:16 - 0:18
   begining to get very tired of sitting by her sister
9. 18400 0:18 - 0:22
   on the bank And of having nothing to do. If
10. 21560 0:22 - 0:26
    I wanted to solve this problem without Mapreduce, I might
11. 25600 0:26 - 0:29
    create a Python dictionary consisting of all the words
12. 28680 0:29 - 0:32
    and their counts. I could go through the document
13. 31600 0:32 - 0:35
    and say, for each word in the document, if
14. 34570 0:35 - 0:38
    there is a key for that word, add one.
15. 37980 0:38 - 0:41
    Otherwise, set the initial for that key equal to
16. 41375 0:41 - 0:45
    one. And instead of applying it to this short
17. 44590 0:45 - 0:47
    sentence fragment from the book, we'd apply it to
18. 47070 0:47 - 0:51
    the entire book. Before we solve this problem with Mapreduce,
19. 50640 0:51 - 0:52
    why don't you try to write a Python script
20. 52480 0:52 - 0:55
    along the lines of what we just discussed, that will
21. 54720 0:55 - 0:58
    get the job done. Given many lines of a text,
22. 58060 0:58 - 1:01
    create a dictionary with a key for each word, and
23. 60530 1:01 - 1:03
    a value corresponding to the count of the word in
24. 63390 1:03 - 1:07
    that text. Note that we want the words to be
25. 66880 1:07 - 1:11
    stripped of any capitalization and punctuation. We just want the
26. 71360 1:11 - 1:16
    basic words. Here's some code to get you started. First,
27. 75920 1:16 - 1:19
    we import system string. And then we
28. 78990 1:19 - 1:22
    initialize an empty dictionary, which will hold our
29. 82360 1:22 - 1:29
    words and values. We cycle through the lines of the input, and for each line we
30. 88840 1:29 - 1:33
    create an array, data. Which is essentially all
31. 92730 1:33 - 1:36
    of the words in that line, split by
32. 95700 1:36 - 1:38
    white space. So if we started with this
33. 97780 1:38 - 1:41
    line. Hello, how are you? It would become,
34. 101060 1:41 - 1:48
    hello, how, are, and you, in an array of length four. Your code should go here.
35. 107910 1:48 - 1:52
    After we split the line by white space, and before we print out the dictionary.