On the Variance of the Adaptive Learning Rate and Beyond
-
Updated
Jul 31, 2021 - Python
#
adam-optimizer
Here are 351 public repositories matching this topic...
Deep learning library in plain Numpy.
-
Updated
Jun 21, 2022 - Python
This repository contains the results for the paper: "Descending through a Crowded Valley - Benchmarking Deep Learning Optimizers"
-
Updated
Jul 17, 2021
CS F425 Deep Learning course at BITS Pilani (Goa Campus)
machine-learning deep-neural-networks deep-learning generative-model optimisation bits-pilani adam-optimizer
-
Updated
Feb 5, 2025 - Jupyter Notebook
ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance
-
Updated
Jan 19, 2021 - C++
Google Street View House Number(SVHN) Dataset, and classifying them through CNN
machine-learning computer-vision cnn dropout mnist svhn convolutional-neural-networks confusion-matrix google-street convolutional-neural-network tensorboard-visualizations tesnorflow svhn-classifier grayscale-images house-numbers adam-optimizer mini-batch-gradient-descent one-hot-encode
-
Updated
Mar 4, 2018 - Jupyter Notebook
Lion and Adam optimization comparison
-
Updated
Feb 23, 2023 - Jupyter Notebook
Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge
tensorflow optimization keras wide-residual-networks adam-optimizer tensorflow-eager amsgrad sgd-momentum padam
-
Updated
Apr 13, 2019 - Python
PyTorch/Tensorflow solutions for Stanford's CS231n: "CNNs for Visual Recognition"
machine-learning computer-vision deep-learning neural-network solutions tensorflow numpy jupyter-notebook stanford-university assignment pytorch recurrent-neural-networks lstm generative-adversarial-network style-transfer convolutional-neural-networks backpropagation svm-classifier adam-optimizer sgd-optimizer
-
Updated
Jan 27, 2021 - Jupyter Notebook
Toy implementations of some popular ML optimizers using Python/JAX
machine-learning momentum gradient-descent optimization-algorithms adam adam-optimizer jax optimizers
-
Updated
Jun 20, 2021 - Python
A collection of various gradient descent algorithms implemented in Python from scratch
machine-learning ai deep-learning machine-learning-algorithms ml deep-learning-algorithms gradient-descent adagrad rmsprop gradient-descent-algorithm adam-optimizer nesterov-accelerated-sgd nesterov-momentum nesterov momentum-optimization-algorithm
-
Updated
Feb 28, 2023 - Python
This library provides a set of basic functions for different type of deep learning (and other) algorithms in C.This deep learning library will be constantly updated
c library deep-learning neural-network opencl transformer lstm convolutional-layers deeplearning residual-layers residual-networks backpropagation optimization-algorithms softmax adam-optimizer avarage nesterov adam-algorithm dropout-layers
-
Updated
Sep 29, 2023 - C
A compressed adaptive optimizer for training large-scale deep learning models using PyTorch
hashing deep-learning neural-network pytorch transformer imagenet count-min-sketch language-model adagrad adam-optimizer sgd-optimizer count-sketch sgd-momentum
-
Updated
Nov 26, 2019 - Python
Modified XGBoost implementation from scratch with Numpy using Adam and RSMProp optimizers.
numpy gradient-boosting-machine rmsprop adam-optimizer xgboost-algorithm implementation-of-algorithms
-
Updated
Jul 24, 2020 - Jupyter Notebook
The project aimed to implement Deep NN / RNN based solution in order to develop flexible methods that are able to adaptively fillin, backfill, and predict time-series using a large number of heterogeneous training datasets.
deep-neural-networks deep-learning time-series recurrent-neural-networks pca-analysis rnn adagrad rmsprop leaky-relu adam-optimizer random-forest-regressor adamax
-
Updated
Aug 16, 2016 - Python
Lookahead optimizer ("Lookahead Optimizer: k steps forward, 1 step back") for tensorflow
-
Updated
Sep 3, 2019 - Python
From linear regression towards neural networks...
data-science machine-learning neural-network linear-regression machine-learning-algorithms data-analysis logistic-regression gradient-descent backpropagation adagrad rmsprop generalized-linear-models multilayer-perceptron-network adam-optimizer nesterov-accelerated-sgd nesterov-momentum nadam
-
Updated
Sep 21, 2024 - C++
[Python] [arXiv/cs] Paper "An Overview of Gradient Descent Optimization Algorithms" by Sebastian Ruder
adadelta momentum gradient-descent optimization-methods optimization-algorithms adam adagrad rmsprop gradient-descent-algorithm stochastic-optimizers stochastic-gradient-descent gradient-boosting adam-optimizer adamax stochastic-optimization batch-gradient-descent nesterov-accelerated-sgd amsgrad nesterov-momentum nadam
-
Updated
Mar 23, 2019 - Python
Implementation of Adam Optimization algorithm using Numpy
-
Updated
Feb 5, 2020 - Jupyter Notebook
Improve this page
Add a description, image, and links to the adam-optimizer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the adam-optimizer topic, visit your repo's landing page and select "manage topics."