1. Optimization Methods

1.1 - Gradient Descent

1.2 - Mini-Batch Gradient descent

1.3 - Momentum

1.4 - Adam

2. Model with different optimization algorithms

2.1 - Mini-batch Gradient descent

2.2 - Mini-batch gradient descent with momentum

2.3 - Mini-batch with Adam mode

2.4 - Summary

Improving DNNs Hyperparameter tuning-Regularization and Optimization（week2）Optimization Methods

原文：https://www.cnblogs.com/douzujun/p/13092358.html