kfac

Here are 9 public repositories matching this topic...

ikostrikov /pytorch-a2c-ppo-acktr-gail

PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).

reinforcement-learning deep-learning deep-reinforcement-learning pytorch atari hessian second-order continuous-control actor-critic ale mujoco proximal-policy-optimization ppo advantage-actor-critic a2c acktr natural-gradients roboschool kfac kronecker-factored-approximation

UpdatedMay 29, 2022
Python

tfjgeorge /nngeometry

Star211

{KFAC,EKFAC,Diagonal,Implicit} Fisher Matrices and finite width NTKs in PyTorch

pytorch gram jacobian hessian fim ntk kfac tangent fisher-information-matrix ekfac neural-tangent-kernel k-fac ek-fac

UpdatedMar 13, 2025
Python

alecwangcq /KFAC-Pytorch

Star130

Pytorch implementation of KFAC and E-KFAC (Natural Gradient).

optimization optimizer pytorch kfac ekfac

UpdatedJul 2, 2019
Python

gpauloski /kfac-pytorch

Star85

Distributed K-FAC Preconditioner for PyTorch

deep-learning optimizer pytorch distributed kfac second-order-optimization

UpdatedMar 11, 2025
Python

MaximeRobeyns /bayesian_lora

Star29

Bayesian Low-Rank Adaptation for Large Language Models

kfac laplace-approximation llm

UpdatedJun 22, 2024
Python

f-dangel /einconv

Star14

Convolutions and more as einsum for PyTorch

fisher pytorch convolution ntk transpose-convolution im2col kfac einsum tensornetwork einsum-notation vjp jvp ggn

UpdatedJun 6, 2024
Python

yorkerlin /StructuredNGD-DL

Star4

Matrix-multiplication-only KFAC; Code for ICML 2023 paper on Simplifying Momentum-based Positive-definite Submanifold Optimization with Applications to Deep Learning

deep-learning fisher optimizer optimization-methods natural-gradients kfac second-order-optimization hessian-free pytorch-implementation