Movatterモバイル変換


[0]ホーム

URL:


Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings

Implementation of key concepts of neuralnetwork via numpy

NotificationsYou must be signed in to change notification settings

hwalsuklee/numpy-neuralnet-exercise

Repository files navigation

All codes and slides are based on the online bookneuralnetworkanddeeplearning.com.

numpy-only-implementation

From example1.py to example8.py is implemented via only numpy and use the same architecture of a simple network called multilayer perceptrons (MLP) with one hidden layer.

example1.py : Quadratic Loss, SGD, Sigmoid (BASE LINE)

n is the number of unit in a hidden layer in following results.

example2.py : BASE LINE + Cross Entropy Loss

n=30n=100

example3.py : BASE LINE + Cross Entropy Loss + L2 regularization

n=30n=100

example4.py : BASE LINE + Cross Entropy Loss + L1 regularization

n=30n=100

example5.py : BASE LINE + Cross Entropy Loss + Droput

n=30n=100

example6.py : BASE LINE + Cross Entropy Loss + Xavier Initializer

n=30n=100

example7.py : BASE LINE + Cross Entropy Loss + Momentum based SGD

n=30n=100

example8.py : BASE LINE + Cross Entropy Loss + Xavier Initializer + ReLU

n=30n=100

lauchers for other resources of numpy-only-implementation

There are also good resources for numpy-only-implementation and laucher for each recourse is provided.

ResourceLauncher
neuralnetworkanddeeplearning.comlauncher_package1.py
Stanford CS231 lectureslauncher_package2.py

simple tensoflow code for CNN

Code in tf_code_mnist folder is for CNN implmentation.
ch6_summary.pdf is related slide.

CommandDescriptionMNIST acc.
train --model v0model v0 : BASE LINE + Softmax Layer + Cross Entropy Loss97.80%
train --model v1model v1 : model v0 + 1 Convolutional/Pooling Layers98.78%
train --model v2model v2 : model v1 + 1 Convolutional/Pooling Layers99.06%
train --model v3model v3 : model v2 + ReLU99.23%
train --model v4model v4 : model v3 + Data Augmentation99.37%
train --model v5model v5 : model v4 + 1 Fully-Connected Layer99.43%
train --model v6model v6 : model v5 + Dropout99.60%

Releases

No releases published

Packages

No packages published

Languages


[8]ページ先頭

©2009-2025 Movatter.jp