cosine-annealing

Star

Here are 8 public repositories matching this topic...

Language:All

Filter by language

All8 Python5 Jupyter Notebook2 C1

Andras7 /word2vec-pytorch

Star185

Extremely simple and fast word2vec implementation with Negative Sampling + Sub-sampling

word2vec pytorch skipgram wordembeddings sub-sampling negative-sampling cosine-annealing

UpdatedJan 21, 2021
Python

Implementshttps://arxiv.org/abs/1711.05101 AdamW optimizer, cosine learning rate scheduler and "Cyclical Learning Rates for Training Neural Networks"https://arxiv.org/abs/1506.01186 for PyTorch framework

scheduler clr optimizer pytorch restarts triangular adamw cosine-annealing cyclical-learning-rate adamw-optimizer

UpdatedJul 14, 2019
Python

ahundt /sharpDARTS

Star16

sharpDARTS: Faster and More Accurate Differentiable Architecture Search

computer-vision deep-learning pytorch neural-networks hyperparameter-optimization imagenet nas hyperparameter-tuning learning-rate cifar10 sota neural-architecture-search hyperparameter-search state-of-the-art architecture-search cosine-annealing learning-rate-scheduling differentiable-hyperparamter-search cosine-power-annealing power-cosine-annealing

UpdatedFeb 7, 2021
Python

iSiddharth20 /DeepLearning-ImageClassification-Toolkit

Sponsor

Star2

End-to-end Image Classification using Deep Learning toolkit for custom image datasets. Features include Pre-Processing, Training with Multiple CNN Architectures and Statistical Inference Tools. Special utilities for RAM optimization, Learning Rate Scheduling, and Detailed Code Comments are included.