sparse-neural-networks

Star

Here are 33 public repositories matching this topic...

Language:All

Filter by language

All33 Python25 Jupyter Notebook3 Rust2 C++1 Cuda1 F#1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

dcmocanu /sparse-evolutionary-artificial-neural-networks

Star250

Always sparse. Never dense. But never say never. A Sparse Training repository for the Adaptive Sparse Connectivity concept and its algorithmic instantiation, i.e. Sparse Evolutionary Training, to boost Deep Learning scalability on various aspects (e.g. memory and computational time efficiency, representation and generalization power).

deep-neural-networks sparsity deep-learning scalability randomization neuroevolution deep-learning-algorithms classification evolutionary-algorithms artificial-neural-networks restricted-boltzmann-machine complex-networks deep-learning-papers multi-layer-perceptron generative-models sparse-neural-networks scalable-deep-learning sparse-training sparse-evolutionary-training adaptive-sparse-connectivity

UpdatedJul 21, 2021
Python

lilucse /SparseNetwork4DRL

Star39

[ICML 2025 oral] Network Sparsity Unlocks the Scaling Potential of Deep Reinforcement Learning

reinforcement-learning deep-learning sparse-neural-networks deepmind-control-suite

UpdatedJun 5, 2025
Python

nanowell /Q-Sparse-LLM

Sponsor

Star33

My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated

machine-learning deep-neural-networks artificial-intelligence transformer deeplearning sparse-neural-networks large-language-models q-sparse

UpdatedAug 14, 2024
Python

VITA-Group /SFW-Once-for-All-Pruning

Star32

[ICLR 2022] "Learning Pruning-Friendly Networks via Frank-Wolfe: One-Shot, Any-Sparsity, and No Retraining" by Lu Miao*, Xiaolong Luo*, Tianlong Chen, Wuyang Chen, Dong Liu, Zhangyang Wang

pruning once-and-for-all sparse-neural-networks stochastic-frank-wolfe

UpdatedJan 20, 2022
Python

VITA-Group /SMC-Bench

Star28

[ICLR 2023] "Sparsity May Cry: Let Us Fail (Current) Sparse Neural Networks Together!" Shiwei Liu, Tianlong Chen, Zhenyu Zhang, Xuxi Chen, Tianjin Huang, AJAY KUMAR JAISWAL, Zhangyang Wang

benchmark sparsity deep-learning pruning sparse-neural-networks dynamic-sparse-training

UpdatedAug 29, 2023
Python

Efficient-Scalable-Machine-Learning /EvNN

Star26

Event-based neural networks

neural-network cuda pytorch spiking-neural-networks rnn-model sparse-neural-networks efficient-neural-networks

UpdatedJul 7, 2024
Python

zahraatashgahi /QuickSelection

Star17

[Machine Learning Journal (ECML-PKDD 2022 journal track)] Quick and Robust Feature Selection: the Strength of Energy-efficient Sparse Training for Autoencoders

sparsity deep-learning feature-selection autoencoder dimensionality-reduction denoising-autoencoders sparse-neural-networks sparse-training

UpdatedOct 2, 2023
Python

lim142857 /Sparsifiner

Star15

Demo code for CVPR2023 paper "Sparsifiner: Learning Sparse Instance-Dependent Attention for Efficient Vision Transformers"

attention-mechanism fast-inference sparse-neural-networks low-rank vision-transformer efficient-transformers sparse-attention efficient-vision-transformers

UpdatedJul 4, 2023
Python

GhadaSokar /Dynamic-Sparse-Training-for-Deep-Reinforcement-Learning

Star14

[IJCAI 2022] "Dynamic Sparse Training for Deep Reinforcement Learning" by Ghada Sokar, Elena Mocanu , Decebal Constantin Mocanu, Mykola Pechenizkiy, and Peter Stone.

deep-neural-networks sparsity reinforcement-learning deep-learning deep-reinforcement-learning sparse-neural-networks sparse-training continuous-control-tasks

UpdatedMay 13, 2022
Python

IlanPrice /DCTpS

Star14

Code for testing DCT plus Sparse (DCTpS) networks

deep-learning neural-network-compression sparse-neural-networks neural-network-pruning

UpdatedJun 15, 2021
Python

bcrafton /ssdfa

Star11

Github page for SSDFA

hardware-acceleration backpropagation feedback-alignment sparse-neural-networks bio-plausible-algorithms local-learning

UpdatedJan 28, 2020
Python

cambridge-mlg /arch_uncert

Star9

Code for "Variational Depth Search in ResNets" (https://arxiv.org/abs/2002.02797)

reproducible-research uncertainty mnist expectation-maximization svhn bayesian-inference variational-inference residual-networks bayesian-neural-networks neural-architecture-search bayesian-deep-learning fashion-mnist reproducible-paper resnets network-compression sparse-neural-networks learnt-depth network-depths

UpdatedJun 12, 2020
Jupyter Notebook

GhadaSokar /SpaceNet

Star9

Implementation for the paper "SpaceNet: Make Free Space For Continual Learning" in PyTorch.

deep-neural-networks deep-learning incremental-learning sparse-representations brain-inspired continual-learning catastrophic-forgetting sparse-neural-networks sparse-training life-long-learning

UpdatedFeb 28, 2021
Python

VITA-Group /Peek-a-Boo

Star7

[ICLR 2022] "Peek-a-Boo: What (More) is Disguised in a Randomly Weighted Neural Network, and How to Find It Efficiently", by Xiaohan Chen, Jason Zhang and Zhangyang Wang.

deep-learning sparse-neural-networks efficient-deep-learning

UpdatedJan 21, 2022
Python

zahraatashgahi /NeuroFS

Star7

[TMLR] Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks

python deep-learning keras efficiency high-dimensional-data feature-selection neural-networks sparse-neural-networks sparse-training dynamic-sparse-training

UpdatedFeb 12, 2023
Python

theovincent /EauDeDQN

Star6

🌸Eau De Q-Network [RLC 25] is a pruning algorithm specifically designed for RL which discovers the final sparsity level of the networks🌸

reinforcement-learning dqn bellman-equation distillation sparse-neural-networks

UpdatedFeb 27, 2025
Python

BICLab /RM-SNN

Star6

Offical implementation of "Sparser spiking activity can be better: Feature Refine-and-Mask spiking neural network for event-based visual recognition" (Neural Networks 2023)

spiking-neural-networks attention-mechanism sparse-neural-networks