https://www.deeplearningwizard.com/deep_learning/boosting_models_pytorch/lr_scheduling/ Learning Rate Scheduling - Deep Learning Wizard Learning Rate Scheduling Optimization Algorithm: Mini-batch Stochastic Gradient Descent (SGD) We will be using mini-batch gradient descent in all our examples here when scheduling our learning rate Combination of batch gradient descent & stochastic gradien www.d..

https://towardsdatascience.com/hyper-parameter-tuning-techniques-in-deep-learning-4dad592c63c8 Hyper-parameter Tuning Techniques in Deep Learning The process of setting the hyper-parameters requires expertise and extensive trial and error. There are no simple and easy ways to set… towardsdatascience.com Hyper-parameters 1) learning rate 2) momentum 3) batch size 4) weight decay Momentum이란? - 기존 ..