• Save
  • Run All Cells
  • Clear All Output
  • Runtime
  • Download
  • Difficulty Rating

Loading Runtime

Lesson Topics

  • Gradient Descent Overview
  • Visualizing the Loss Function
  • What is a "gradient"?
  • Updating Parameters by subtracting the (Learning Rate X Gradient)
  • Contour Plots
  • Convex vs Non-convex Loss Functions
  • Implementing Gradient Descent with a non-exact gradient (slope) calculation.
  • Plotting each parameter update on a 3D graph.
  • The importance of selecting a moderate learning rate
  • Implementing Gradient Descent with TensorFlow (calculating actual gradients).

Resources

Blank Starter Notebook

Live Lecture Notebook