PinnedLoading

1. croco.cppcroco.cppPublic

   Forked fromLostRuins/koboldcpp

   Croco.Cpp is a 3rd party testground for KoboldCPP, a simple one-file way to run various GGML/GGUF models with KoboldAI's UI. (for Croco.Cpp, in Cuda mode mainly!)

   C++ 100 3

2. ik_llama.cpp.nxsik_llama.cpp.nxsPublic

   Forked fromikawrakow/ik_llama.cpp

   llama.cpp clone with additional SOTA quants and improved CPU performance

   C++

3. lite.koboldai.fkslite.koboldai.fksPublic

   Forked fromLostRuins/lite.koboldai.net

   A zero dependency web UI for KoboldAI Horde

   HTML

4. SillyTavern.fksSillyTavern.fksPublic

   Forked fromSillyTavern/SillyTavern

   Playground for LLM Frontend for Power Users.

   JavaScript 1

5. AutoGGUF.fksAutoGGUF.fksPublic

   Forked fromleafspark/AutoGGUF

   fork of AutoGGUF to automatically quant GGUF models

   Python

6. exllamav2.fksexllamav2.fksPublic

   Forked fromturboderp-org/exllamav2

   A fast inference library for running LLMs locally on modern consumer-class GPUs

   Python