adam-optimizer

ADAS is short for Adaptive Step Size, it's an optimizer that unlike other optimizers that just normalize the derivative, it fine-tunes the step size, truly making step size scheduling obsolete, achieving state-of-the-art training performance

machine-learning deep-learning optimizer mnist adam adam-optimizer artifical-neural-network

UpdatedJan 19, 2021
C++

nengwp /Lion-vs-Adam

Star64

Lion and Adam optimization comparison

vis adam lion adam-optimizer lion-optimization

UpdatedFeb 23, 2023
Jupyter Notebook

aditya9211 /SVHN-CNN

Star63

Google Street View House Number(SVHN) Dataset, and classifying them through CNN

machine-learning computer-vision cnn dropout mnist svhn convolutional-neural-networks confusion-matrix google-street convolutional-neural-network tensorboard-visualizations tesnorflow svhn-classifier grayscale-images house-numbers adam-optimizer mini-batch-gradient-descent one-hot-encode

UpdatedMar 4, 2018
Jupyter Notebook

yashkant /padam-tensorflow

Star51

Reproducing the paper "PADAM: Closing The Generalization Gap of Adaptive Gradient Methods In Training Deep Neural Networks" for the ICLR 2019 Reproducibility Challenge

tensorflow optimization keras wide-residual-networks adam-optimizer tensorflow-eager amsgrad sgd-momentum padam

UpdatedApr 13, 2019
Python

v-iashin /CS231n

Star50

PyTorch/Tensorflow solutions for Stanford's CS231n: "CNNs for Visual Recognition"

machine-learning computer-vision deep-learning neural-network solutions tensorflow numpy jupyter-notebook stanford-university assignment pytorch recurrent-neural-networks lstm generative-adversarial-network style-transfer convolutional-neural-networks backpropagation svm-classifier adam-optimizer sgd-optimizer

UpdatedJan 27, 2021
Jupyter Notebook

sagarvegad /Adam-optimizer

Star48

Implemented Adam optimizer in python

gradient adam-optimizer

UpdatedJun 8, 2017
Python

shreyansh26 /ML-Optimizers-JAX

Star44

Toy implementations of some popular ML optimizers using Python/JAX

machine-learning momentum gradient-descent optimization-algorithms adam adam-optimizer jax optimizers

UpdatedJun 20, 2021
Python

Arko98 /Gradient-Descent-Algorithms

Star39

A collection of various gradient descent algorithms implemented in Python from scratch

machine-learning ai deep-learning machine-learning-algorithms ml deep-learning-algorithms gradient-descent adagrad rmsprop gradient-descent-algorithm adam-optimizer nesterov-accelerated-sgd nesterov-momentum nesterov momentum-optimization-algorithm

UpdatedFeb 28, 2023
Python

VivianoRiccardo /Learning-Lab-C-Library

Star34

This library provides a set of functionalities for different type of deep learning (and ML) algorithms in C

c library deep-learning neural-network opencl transformer lstm convolutional-layers deeplearning residual-layers residual-networks backpropagation optimization-algorithms softmax adam-optimizer avarage nesterov adam-algorithm dropout-layers

UpdatedSep 29, 2023
C

aromanro /MachineLearning

Star27

From linear regression towards neural networks...

data-science machine-learning neural-network linear-regression machine-learning-algorithms data-analysis logistic-regression gradient-descent backpropagation adagrad rmsprop generalized-linear-models multilayer-perceptron-network adam-optimizer nesterov-accelerated-sgd nesterov-momentum nadam

UpdatedNov 23, 2025
C++

rdspring1 /Count-Sketch-Optimizers

Star26

A compressed adaptive optimizer for training large-scale deep learning models using PyTorch

hashing deep-learning neural-network pytorch transformer imagenet count-min-sketch language-model adagrad adam-optimizer sgd-optimizer count-sketch sgd-momentum

UpdatedNov 26, 2019
Python

RudreshVeerkhare /CustomXGBoost

Star26

Modified XGBoost implementation from scratch with Numpy using Adam and RSMProp optimizers.

numpy gradient-boosting-machine rmsprop adam-optimizer xgboost-algorithm implementation-of-algorithms

UpdatedJul 24, 2020
Jupyter Notebook

yaricom /TimeSeriesLearning

Star26

The project aimed to implement Deep NN / RNN based solution in order to develop flexible methods that are able to adaptively fillin, backfill, and predict time-series using a large number of heterogeneous training datasets.

deep-neural-networks deep-learning time-series recurrent-neural-networks pca-analysis rnn adagrad rmsprop leaky-relu adam-optimizer random-forest-regressor adamax

UpdatedAug 16, 2016
Python

Janus-Shiau /lookahead_tensorflow

Star25

Lookahead optimizer ("Lookahead Optimizer: k steps forward, 1 step back") for tensorflow

deep-learning tensorflow optimizer adam-optimizer sgd-optimizer

UpdatedSep 3, 2019
Python

harshraj11584 /Paper-Implementation-Overview-Gradient-Descent-Optimization-Sebastian-Ruder

Star24

[Python] [arXiv/cs] Paper "An Overview of Gradient Descent Optimization Algorithms" by Sebastian Ruder

adadelta momentum gradient-descent optimization-methods optimization-algorithms adam adagrad rmsprop gradient-descent-algorithm stochastic-optimizers stochastic-gradient-descent gradient-boosting adam-optimizer adamax stochastic-optimization batch-gradient-descent nesterov-accelerated-sgd amsgrad nesterov-momentum nadam

UpdatedMar 23, 2019
Python

thetechdude124 /Adam-Optimization-From-Scratch

Star22

📈Implementing the ADAM optimizer from the ground up with PyTorch and comparing its performance on six 3-D objective functions (each progressively more difficult to optimize) against SGD, AdaGrad, and RMSProp.

deep-learning artificial-intelligence optimization-algorithms rmsprop adam-optimizer sgd-optimizer

UpdatedJul 2, 2022
Jupyter Notebook

Improve this page

Add a description, image, and links to theadam-optimizer topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with theadam-optimizer topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

adam-optimizer

Here are 401 public repositories matching this topic...

LiyuanLucasLiu /RAdam

parasdahal /deepnet

SirRob1997 /Crowded-Valley---Results

tirtharajdash /CS-F425_Deep-Learning

YanaiEliyahu /AdasOptimizer

nengwp /Lion-vs-Adam

aditya9211 /SVHN-CNN

yashkant /padam-tensorflow

v-iashin /CS231n

sagarvegad /Adam-optimizer

shreyansh26 /ML-Optimizers-JAX

Arko98 /Gradient-Descent-Algorithms

VivianoRiccardo /Learning-Lab-C-Library

aromanro /MachineLearning

rdspring1 /Count-Sketch-Optimizers

RudreshVeerkhare /CustomXGBoost

yaricom /TimeSeriesLearning

Janus-Shiau /lookahead_tensorflow

harshraj11584 /Paper-Implementation-Overview-Gradient-Descent-Optimization-Sebastian-Ruder

thetechdude124 /Adam-Optimization-From-Scratch

Improve this page

Add this topic to your repo