Problem: Describe how LR affects training.
Topics to be covered:
- Impact of Different Learning Rate Values on the Training Process.
- The role of Learning Rate in Overfitting and Underfitting.
- Effect of Learning Rate on Convergence in Gradient Descent.
- Connection Between Learning Rate and Batch Size.
- Use of Learning Rate Schedules like learning rate decay.