Sign inSign in
ConceptAI & ML

Hyperparameters

Choices about the algorithm that are set rather than learned from training data.
as Fei-Fei Li, Justin Johnson & Serena Yeung defines itStanford UniversityThe wording closest to all 5 definitions
Watch it explained

Know first

Named as a prerequisite by the lectures that define this. The number is how many say so. A grey one has no page yet.

Machine learning algorithms1Neural network architecture1Neural networks1Parameter1Reinforcement learning algorithms1Smoothing1Training data1Training process1

Opens up

Concepts that name this one as a prerequisite.

Lecturers

4

Each in their own terms, from the easiest level.

  • Fei-Fei Li, Justin Johnson & Serena Yeung

    Stanford University · Undergraduate

    • 2:21Detection and Segmentation
  • Andrej Karpathy

    Undergraduate

    A design choice determined by the model creator, such as the size of the hidden layer.
    • 7:08Building makemore Part 2: Multi-Layer Perceptron Language Models (Bengio et al. 2003)
  • Pieter Abbeel

    UC Berkeley · Undergraduate

    Settings like the amount or type of smoothing, such as k or alpha, that are not learned directly from training data parameters.
    • 1:21:10Machine Learning: Naive Bayes
  • Matthew Vandergrift

    Alberta Machine Intelligence Institute (Amii) · Graduate

    Variables which control the learning process of an agent that must be manually set by the practitioner before deploying the agent.
    • 1:35Online Hyperparameter Tuning as an Empirical Approach for Reinforcement Learning

Lectures that assume it

11

Connections

24

The lectures that define it or assume it, and the concepts next to it.

4 lecturers. Definitions are written by AI from each lecture’s transcript. A time with a play mark starts the lecture at the moment the lecturer says it.