On the Variance of the Adaptive Learning Rate and Beyond

RAdam implemented in Keras & TensorFlow

ADAM - A Question Answering System. Inspired from IBM Watson

This is a repo for my master thesis research about the Fusion of Visual SLAM and GPS. It contains the research paper, code and other interesting data.

AdamW optimizer for Keras

Pytorch LSTM RNN for reinforcement learning to play Atari games from OpenAI Universe. We also use Google Deep Mind's Asynchronous Advantage Actor-Critic (A3C) Algorithm. This is much superior and efficient than DQN and obsoletes it. Can play on many games

Coroutine-friendly Android Debug Bridge client written in Kotlin

Partially Adaptive Momentum Estimation method in the paper "Closing the Generalization Gap of Adaptive Gradient Methods in Training Deep Neural Networks" (accepted by IJCAI 2020)

Switching from Adam to SGD optimization in PyTorch.

Learning Rate Warmup in PyTorch

Adam, NAdam and AAdam optimizers

Addon which enhances all user profiles of confluence. It also adds an advanced people directory. The whole addon is configurable by means of an XML, can be localized, supports Velocity templates and supports view and edit restrictions.

AdaShift optimizer implementation in PyTorch

[Python] [arXiv/cs] Paper "An Overview of Gradient Descent Optimization Algorithms" by Sebastian Ruder

Deep learning projects including applications (face recognition, neural style transfer, autonomous driving, sign language reading, music generation, translation, speech recognition and NLP) and theories (CNNs, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, hyperparameter tuning, regularization, optimization, Residual Networks). Deep Learning Specialization by Andrew Ng, deeplearning.ai

The Asteroid Decision, Analysis, and Mapping platform

Simple MATLAB toolbox for deep learning network: Version 1.0.3

DeepVariant-on-Spark is a germline short variant calling pipeline that runs Google DeepVariant on Apache Spark at scale.

Implementation of Deep Neural Network from scratch without other librariees

Gradient descent optimizers for linear regression

Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay

DNN classifiers for WDBC and Wine datasets.

Generalization of Adam, AdaMax, AMSGrad algorithms for PyTorch

Coding Assignment of PFN intern 2019

Tensorflow-Keras callback implementing arXiv 1712.07628

pytorch implement of NovoGrad Optimizer

solutions of deep learning specialization on coursera

Orbit propagation, orbit determination, and analysis code

gradient descent optimization algorithms

Quasi-Newton optimization methods for Deep Learning using PyTorch-Optimizer interface.