Matrix Methods in Data Analysis, Signal Processing, and Machine Learning

View Course Materials

Buying via our links supports this free directory · Affiliate disclosure.
Course facts
  • Payment: Free, no certificate
  • Credits: Non Credit
  • Learning style: Self-paced, start anytime
  • Resources: Instructor Insights; Lecture Videos; Podcasts; Problem Sets
  • Before you start: 18.06 Linear Algebra
MIT OpenCourseWare details
  • As taught in: Spring 2018
  • Department: Mathematics
Created byMIT
Available onMIT OpenCourseWareMIT OpenCourseWare

Course Details
Learning Style

Start Anytime

Level

All Levels

Study Mode

100% Online

Outcomes
Academic Credits

Non Credit

Price & Terms
Pricing Model

Free Content (No Certificate)

Technical
Content Medium

Video Based

Specification
Access

Free Access

Academic Level

Undergraduate

SKU: matrix-methods-data-analysis-signal-processing-machine Category: Tags: , , Brand:

Linear algebra for data science and deep learning: SVD, least squares, low rank, gradient descent, neural nets and CNNs.

At a glance
LevelAll Levels
AccessFree access
FormatVideo Based
As taught inSpring 2018
DepartmentMathematics
Add your review
Add to wishlistAdded to wishlistRemoved from wishlist 0
Add to compare

Linear algebra is the language of machine learning, and this course by Gilbert Strang reviews it with applications to probability, statistics and optimization, and above all to a full explanation of deep learning. In recorded lectures it moves through matrix factorizations, eigenvalues and the singular value decomposition, low-rank approximation and least squares, then calculus of matrices, gradient descent and its stochastic and accelerated forms, and finally the structure of neural networks, backpropagation, convolutional networks and clustering in graphs.

What You Will Achieve

  • Factor matrices and use eigenvalues and the singular value decomposition
  • Solve least squares problems and find low-rank approximations
  • Apply gradient descent, momentum and stochastic gradient descent to optimization
  • Explain how neural networks are structured and trained by backpropagation


Program Overview

Highlights of Linear Algebra

Column spaces, factorizations and the singular value decomposition.

  • Multiplying and factoring matrices
  • Eigenvalues, eigenvectors and positive definite matrices
  • The SVD and the Eckart-Young theorem
  • Norms and four ways to solve least squares

Computation and Optimization

Computing with large matrices and minimizing functions.

  • Randomized matrix multiplication and low rank changes
  • Derivatives of matrices and singular values
  • Gradient descent, momentum and linear programming
  • Stochastic gradient descent

Learning from Data

Neural networks and the matrices inside them.

  • Structure of neural nets and backpropagation
  • Circulant matrices and the Fourier matrix
  • Convolutional neural networks
  • Distance matrices and clustering in graphs

Course Completion


Job Outlook

Matrix methods are the working mathematics of machine learning engineering, data science, signal processing and scientific computing.


Our take

Good for: Learners heading into machine learning who want the linear algebra behind it explained properly.

Keep in mind: The problem sets refer to sections of a textbook that is not included, and two in-class computing sessions have no video.

Bottom line: A clear, well-built course that shows how linear algebra drives deep learning.

Frequently Asked Questions

What does the group project involve?

It replaces the last three homework sets: in groups of two or three, you take one topic further, such as SVD for PCA, sparse solutions, or learning weights in a neural net.

Is there a podcast?

Yes. A Chalk Radio podcast episode and a video with Professor Gilbert Strang describe how he taught the course.

Does it touch on the Julia language?

Yes. The last session features Alan Edelman and the Julia language, after the sessions on distance matrices and clustering.

User Reviews

0.0 out of 5
★★★★★
0
★★★★★
0
★★★★★
0
★★★★★
0
★★★★★
0

No reviews yet. Be the first to review this course.

There are no reviews yet.

Write your review

Reviews can only be posted by registered learners. Log in, then you will return here to post.

×

    Report this page
    Matrix Methods in Data Analysis, Signal Processing, and Machine Learning
    Matrix Methods in Data Analysis, Signal Processing, and Machine Learning
    LiveTalent
    Logo
    Compare items
    • Total (0)
    Compare
    0