How to Process, Analyze and Visualize Data
Clean, analyze and visualize real data in Python: campaign finance plots, statistics, Enron text processing and MapReduce, in daily lab walkthroughs.
Raw data found online rarely answers a question until it has been cleaned, tested and charted. Over a short series of daily labs, real datasets carry this process forward: campaign contributions become plots, county health rankings meet t-tests and regression, and the Enron email corpus is searched with tf-idf and then scaled up with MapReduce. All the programming is in Python.
What You Will Achieve
- Take a dataset found online through to a set of static charts
- Run t-tests and linear regression and judge statistical significance
- Compare documents in a text corpus using tf-idf and cosine similarity
- Process a large dataset using Hadoop and MapReduce
Program Overview
Data, Charts and Statistics
An end-to-end example, then visualization practice and statistics basics.
- Campaign contribution plots
- Going from data to chart
- T-tests and linear regression
- Per-county health rankings
Text and Scale
Working with the Enron email dataset, first locally and then at scale.
- Tf-idf and cosine similarity
- Hadoop and MapReduce
- Analyzing a dataset of your choosing
Course Completion
Job Outlook
Cleaning, analyzing and charting data in Python is everyday work in data analysis, research and reporting, including roles that handle large text collections.
Good for: Python programmers who want a quick, hands-on tour of the whole path of data analysis using real datasets.
Keep in mind: From January 2012, so its Python modules and Hadoop setup may need updating; the page says its GitHub repository may be updated more often.
Bottom line: Daily walkthroughs make this a practical week of analysis on real datasets.
Frequently Asked Questions
What does the class leave out?
It says it does not teach R, or visualization with browser technology or non-Python languages such as d3 and Processing. The charts it teaches are static ones made in Python.
Which datasets are used?
The syllabus names campaign contributions, per-county health rankings and the Enron email dataset, with a larger Enron copy for MapReduce. The last day lets you choose your own dataset.
How does the class end?
The last day asks you to work alone or in a group, analyze a dataset of your choosing and tell a story with it.



There are no reviews yet.