Hyperparameter Tuning in Python

Start Free Preview

Buying via our links supports this free directory · Affiliate disclosure.
Course facts
  • Payment: Free Preview (Paid Upgrade)
  • Learning style: Self-paced, start anytime
  • Format: Text & Interactive
  • Video access: Streaming Only
  • Before you start: Supervised Learning with scikit-learn
DataCamp details
  • Chapters: 4
Created byDataCamp
Available onDataCamp

Course Details
Learning Style

Start Anytime

Level

Intermediate

Study Mode

100% Online

Duration

Short (< 10 Hours)

Languages
Audio Language

English

Outcomes
Certificate

Certificate of Completion

Price & Terms
Pricing Model

Free Preview (Paid Upgrade)

Technical
Content Medium

Text & Interactive

Video Access

Streaming Only

Specification
Access

Subscription

SKU: hyperparameter-tuning-python Category: Tags: , , Brand:

Learn to tune machine learning hyperparameters in Python with grid search, random search, and Bayesian and genetic methods using Scikit Learn.

At a glance
Duration4 hrs
LevelIntermediate
CertificateCertificate of Completion
LanguageEnglish
Taught byAlex Scriven
AccessSubscription
Add your review
Add to wishlistAdded to wishlistRemoved from wishlist 0
Add to compare

Hyperparameter tuning is the work of choosing the settings that shape how a machine learning model learns, and doing it by hand quickly becomes impractical as models gain more options. You first separate the values a model learns during training from the ones you set beforehand. Then you automate the search for good settings with Scikit Learn, comparing exhaustive and random sampling before trying Bayesian and genetic algorithms.

What You Will Achieve

  • Pull learned parameters out of fitted logistic regression and random forest models
  • Plot how model performance changes as a single hyperparameter value is varied
  • Choose between grid and random search for a problem, then read and reuse the best settings each one finds
  • Apply Bayesian and genetic algorithms to narrow down hyperparameter settings


Program Overview

Model Parameters and Hyperparameter Values

Separates what a model learns in training from the settings chosen beforehand, using logistic regression, random forest and KNN examples.

  • Parameters in logistic regression and random forests
  • Hyperparameters of random forests and KNN
  • Tips on which hyperparameters to tune
  • Automating hyperparameter choice with learning curves

Grid Search and Random Search in Scikit Learn

Covers the two uninformed search methods, how each samples combinations, and how to read and compare their output.

  • Writing grid search functions and counting models
  • GridSearchCV inputs and output
  • RandomizedSearchCV and visualizing a random search
  • Grid and random search side by side

Informed Search Methods

Gives a first look at informed search and how it differs from uninformed approaches, with practice in each method.

  • Coarse to fine iterations
  • Bayes rule and Bayesian tuning with Hyperopt
  • Genetic hyperparameter tuning with TPOT
  • Checking the stability of TPOT results

Certificate Awarded (Paid)


Job Outlook

Tuning model settings is routine work for data scientists and machine learning scientists who build predictive models in Python and need them to perform well on a specific problem.


Our take

Good for: Data scientists and machine learning practitioners who want to stop setting model options by hand and search for them systematically.

Keep in mind: The final chapter only gives a first taste of Bayesian and genetic tuning, so expect to read further before using Hyperopt or TPOT on real projects.

Bottom line: Its side-by-side comparison of grid and random search, followed by Hyperopt and TPOT, maps out the main automated tuning options in Python.

Frequently Asked Questions

What is the difference between a parameter and a hyperparameter?

A parameter is a value the model learns while it trains, such as the ones the first chapter extracts from logistic regression and random forest models. A hyperparameter is a setting you choose before training starts, and the course practices setting them for random forests and KNN.

Which Python libraries do the exercises use?

Scikit Learn carries most of the work, through its GridSearchCV and RandomizedSearchCV tools. The last chapter adds Hyperopt for Bayesian hyperparameter tuning and TPOT for genetic tuning.

How does random search differ from grid search?

Grid search tries every combination in the grid you define, and one lesson counts how many models that produces. Random search samples combinations at random, which the course presents as more efficient in large parameter spaces, and a chapter runs the two side by side.

Do I need to install Hyperopt or TPOT on my computer?

No. The coding exercises run inside the course browser, so there is no software to download or set up on your own machine before you start.

User Reviews

0.0 out of 5
★★★★★
0
★★★★★
0
★★★★★
0
★★★★★
0
★★★★★
0

No reviews yet. Be the first to review this course.

There are no reviews yet.

Write your review

Reviews can only be posted by registered learners. Log in, then you will return here to post.

×

    Report this page
    Hyperparameter Tuning in Python
    Hyperparameter Tuning in Python
    LiveTalent
    Logo
    Compare items
    • Total (0)
    Compare
    0