batchnorm

Deep learning projects including applications (face recognition, neural style transfer, autonomous driving, sign language reading, music generation, translation, speech recognition and NLP) and theories (CNNs, RNNs, LSTM, Adam, Dropout, BatchNorm, Xavier/He initialization, hyperparameter tuning, regularization, optimization, Residual Networks). …

natural-language-processing translation tensorflow keras cnn lstm dropout speech-recognition yolo rnn face-recognition regularization autonomous-driving music-generation residual-networks hyperparameter-tuning adam batchnorm neural-style-transfer xavier-he-initialization

UpdatedOct 3, 2018
Jupyter Notebook

jcatanza /Fastai-Deep-Learning-From-the-Foundations-TWiML-Study-Group

Star26

Review materials for the TWiML Study Group. Contains annotated versions of the original Jupyter noteboooks (look for names like *_jcat.ipynb ), slide decks from weekly Zoom meetups, etc.

audio nlp swift deep-neural-networks deep-learning tensorflow optimizer cnn rnn callbacks augmentation batchnorm mixup ulmfit cyclegan-pytorch fastai-v3

UpdatedJan 25, 2020
Jupyter Notebook

xternalz /SDPoint

Star18

Stochastic Downsampling for Cost-Adjustable Inference and Improved Regularization in Convolutional Networks

deep-neural-networks computer-vision deep-learning batch-normalization deep-learning-algorithms imagenet resnet regularization convolutional-networks convolutional-neural-networks resnext pooling batchnorm imagenet-dataset efficient-inference resnets preact-resnet downsampling efficient-model cost-adjustable

UpdatedNov 5, 2019
Python

ytoon /Synchronized-BatchNorm-PyTorch

Star15

Synchronized BatchNorm in PyTorch 1.0

batchnorm synchronized-batchnorm

UpdatedJan 18, 2019
Cuda

revilokeb /vgg16_batchnorm

Star14

VGG16 architecture with BatchNorm

caffe vgg16 weights pre-trained batchnorm

UpdatedApr 4, 2017

techpro-studio /NNToolkitCore

Star8

Cross-platform mobile Neural network C library for training and inference on the device. CPU only. It fits for time-series data.

android macos ios dft neural-network watchos lstm gru rnn accelerate spectrogram audio-processing batchnorm dense conv1d nn-filters

UpdatedOct 17, 2021
C

spolivin /nnzerotohero_solutions

Star7

Solutions for Andrej Karpathy's "Neural Networks: Zero to Hero" course

pytorch autograd neural-networks mlp karpathy batchnorm bigram-model trigram-model wavenet-pytorch

UpdatedMar 3, 2024
Jupyter Notebook

345ishaan /Digit-Classification-using-Numpy

Star5

MNIST Classification using Neural Network and Back Propagation. Written in Python and depends only on Numpy

neural-network numpy mnist-classification digit-recognition backpropagation-algorithm batchnorm trained mnist-handwriting-recognition onlynumpy

UpdatedJan 31, 2018
Python

mindee /Problem-of-BatchNorm

Star5

Playground repository to highlight the problem of BatchNorm layers for an blog article

learning model tricks deep batch-normalization normalization batchnorm

UpdatedMar 9, 2022
Python

vsooda /mxnet_merge_bn

Star5

remove batchnorm when deploy mxnet model

mxnet remove batchnorm

UpdatedDec 18, 2017
Python

raja-kumar /folding-batchnorm

Star4

Code to fold batch norm layer of a DNN model in pytorch

deep-neural-networks batchnorm mobilenetv2 batchnormalization

UpdatedMar 8, 2021
Python

fk128 /batchnorm-transferlearning

Star4

Partial transfusion: on the expressive influence of trainable batch norm parameters for transfer learning. TL;DR: Fine-tuning only the batch norm affine parameters leads to similar performance as to fine-tuning all of the model parameters

transfer-learning batchnorm tensorflow2 batchnormalization