learning-rate

Play deep learning with CIFAR datasets

A learning rate range test implementation in PyTorch

Visualize Tensorflow's optimizers.

An easy neural network for Java!

Videos of deep learning optimizers moving on 3D problem-landscapes

Improving MMD-GAN training with repulsive loss function

FIR & LMS filter implementation in C++ with Python & JAVA wrappers

Cyclic learning rate TensorFlow implementation.

PyTorch implementation of some learning rate schedulers for deep learning researcher.

One cycle policy learning rate scheduler in PyTorch

Learning rate multiplier

Automatic and Simultaneous Adjustment of Learning Rate and Momentum for Stochastic Gradient Descent

Stochastic Weight Averaging - TensorFlow implementation

How optimizer and learning rate choice affects training performance

Improved Hypergradient optimizers, providing better generalization and faster convergence.

sharpDARTS: Faster and More Accurate Differentiable Architecture Search

Meta Transfer Learning for Few Shot Semantic Segmentation using U-Net

OneCycle LearningRateScheduler & Learning Rate Finder for TensorFlow 2.

Pytorch implementation of arbitrary learning rate and momentum schedules, including the One Cycle Policy

Implementation of learning rate finder in TensorFlow