How to Process, Analyze and Visualize Data

View Course Materials

Buying via our links supports this free directory · Affiliate disclosure.
Course facts
  • Payment: Free, no certificate
  • Credits: Non Credit
  • Learning style: Self-paced, start anytime
  • Resources: Lecture Notes; Problem Sets; Programming Assignments
MIT OpenCourseWare details
  • As taught in: January IAP 2012
  • Department: Electrical Engineering and Computer Science
Created byMIT
Available onMIT OpenCourseWareMIT OpenCourseWare

Course Details
Learning Style

Start Anytime

Level

All Levels

Study Mode

100% Online

Outcomes
Academic Credits

Non Credit

Price & Terms
Pricing Model

Free Content (No Certificate)

Technical
Content Medium

Text Based

Specification
Access

Free Access

Academic Level

Non-Credit

SKU: how-process-analyze-visualize-data Category: Brand:

Clean, analyze and visualize real data in Python: campaign finance plots, statistics, Enron text processing and MapReduce, in daily lab walkthroughs.

At a glance
LevelAll Levels
AccessFree access
FormatText Based
As taught inJanuary IAP 2012
DepartmentElectrical Engineering and Computer Science
Add your review
Add to wishlistAdded to wishlistRemoved from wishlist 0
Add to compare

Raw data found online rarely answers a question until it has been cleaned, tested and charted. Over a short series of daily labs, real datasets carry this process forward: campaign contributions become plots, county health rankings meet t-tests and regression, and the Enron email corpus is searched with tf-idf and then scaled up with MapReduce. All the programming is in Python.

What You Will Achieve

  • Take a dataset found online through to a set of static charts
  • Run t-tests and linear regression and judge statistical significance
  • Compare documents in a text corpus using tf-idf and cosine similarity
  • Process a large dataset using Hadoop and MapReduce


Program Overview

Data, Charts and Statistics

An end-to-end example, then visualization practice and statistics basics.

  • Campaign contribution plots
  • Going from data to chart
  • T-tests and linear regression
  • Per-county health rankings

Text and Scale

Working with the Enron email dataset, first locally and then at scale.

  • Tf-idf and cosine similarity
  • Hadoop and MapReduce
  • Analyzing a dataset of your choosing

Course Completion


Job Outlook

Cleaning, analyzing and charting data in Python is everyday work in data analysis, research and reporting, including roles that handle large text collections.


Before you start: We assume you have a working knowledge of Python (perhaps from 6.01 ) and are willing to write code. Most of the code you interact with will come with an example that you can modify. Hopefully you won’t need to write too much custom code—unless you’re inspired to write more!; We expect you to install several development-related Python modules, and download the datasets we will be using in the class. Instructions can be found under Day 0, in the Lectures and Labs section.

Our take

Good for: Python programmers who want a quick, hands-on tour of the whole path of data analysis using real datasets.

Keep in mind: From January 2012, so its Python modules and Hadoop setup may need updating; the page says its GitHub repository may be updated more often.

Bottom line: Daily walkthroughs make this a practical week of analysis on real datasets.

Frequently Asked Questions

What does the class leave out?

It says it does not teach R, or visualization with browser technology or non-Python languages such as d3 and Processing. The charts it teaches are static ones made in Python.

Which datasets are used?

The syllabus names campaign contributions, per-county health rankings and the Enron email dataset, with a larger Enron copy for MapReduce. The last day lets you choose your own dataset.

How does the class end?

The last day asks you to work alone or in a group, analyze a dataset of your choosing and tell a story with it.

User Reviews

0.0 out of 5
★★★★★
0
★★★★★
0
★★★★★
0
★★★★★
0
★★★★★
0

No reviews yet. Be the first to review this course.

There are no reviews yet.

Write your review

Reviews can only be posted by registered learners. Log in, then you will return here to post.

×

    Report this page
    How to Process, Analyze and Visualize Data
    How to Process, Analyze and Visualize Data
    LiveTalent
    Logo
    Compare items
    • Total (0)
    Compare
    0