high-throughput

Star

Here are 120 public repositories matching this topic...

Language:All

Filter by language

All120 Python47 Go13 Java11 C++7 Jupyter Notebook5 Rust5 R4 C3 C#3 HTML3

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

FMInference /FlexLLMGen

Star9.4k

Running large language models on a single GPU for throughput-oriented scenarios.

machine-learning deep-learning offloading high-throughput opt gpt-3 large-language-models

UpdatedOct 28, 2024
Python

alphadose /ZenQ

Star695

A thread-safe queue faster and more resource efficient than golang's native channels

go golang optimization concurrency ringbuffer low-latency lock-free fastest high-throughput memory-efficient thread-safe spsc-queue mpsc-queue highly-concurrent zero-allocations zenq

UpdatedMar 12, 2024
Go

FMInference /H2O

Star504

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

sparsity high-throughput heavy-hitters kv-cache gpt-3 large-language-models

UpdatedAug 1, 2024
Python

salesforce /warp-drive

Star500

Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)

reinforcement-learning deep-learning gpu cuda pytorch numba high-throughput multiagent-reinforcement-learning

UpdatedMay 1, 2025
Python

ByteDance-Seed /ShadowKV

Star283

[ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

research high-throughput low-rank cpu-offload sparse-attention long-context llm-inference

UpdatedMay 1, 2025
Python

materialsproject /atomate2

Star282

atomate2 is a library of computational materials science workflows

automation dft vasp materials-science high-throughput

UpdatedFeb 20, 2026
Python

Quantum-Accelerators /quacc

Star245

quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.

python workflow database dft chemistry hpc quantum-mechanics quantum-chemistry high-throughput computational-materials-science

UpdatedFeb 18, 2026
Python

JoyalAJohney /Realtime-distributed-chat

Star226

Realtime distributed messaging platform built using Go and React (Fullstack) ❤️

low-latency high-throughput realtime-messaging system-design

UpdatedFeb 21, 2025
Go

kakao /actionbase

Star209

One database for likes, views, follows — pre-computed, served in real-time

real-time database scalability graphdb low-latency high-throughput oltp

UpdatedFeb 19, 2026
Kotlin

ale94mleon /BindFlow

Star146

A snakemake-based workflow for FEP and MM(PB/GB)SA calculations with GROMACS

drug-discovery drug-design high-throughput mmpbsa fep abfe

UpdatedFeb 3, 2026
Python

jnk0le /AVR-UART-lib

Star110

extremly light uart library for AVR 8 bit microcontrollers

c avr transmission optimized flow-control uart rs232 rs485 avr-gcc prematured usart high-speed low-overhead arduino-less high-throughput avr-microcontroller avr-microcontrollers

UpdatedMar 13, 2024
C

tugrul512bit /LruClockCache

Star77

A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.

fast caching benchmark memoization cpp high-performance cache lru data-structures low-latency fastest high-throughput lru-cache cache-simulator multi-level-cache low-latency-queries least-recently-used set-associative-cache direct-mapped-cache clock-second-chance

UpdatedJan 18, 2024
C++

svenkubiak /mangooio

Star59

An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.

java performance frontend backend web-framework undertow fullstack high-throughput

UpdatedFeb 20, 2026
Java

RUB-Bioinf /VesselExpress

Star53

🔬🖥 Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes

docker bioinformatics snakemake high-throughput graph-analysis vessel-segmentation 3d-imaging 3d-skeleton light-sheet-microscopy

UpdatedJun 6, 2024
Python

scalecube /reactor-aeron

Star50

A reactive driver for Aeron transport (https://github.com/real-logic/aeron)

udp ipc rpc low-latency multicast shared-memory high-throughput unicast aeron

UpdatedFeb 5, 2025
Java

dgruber /wfl

Star47

A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs

go macos linux docker kubernetes golang workflow hpc containers workflow-engine singularity processes k8s high-throughput

UpdatedDec 20, 2024
Go

MLSysU /TD-Pipe

Star46

A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models

high-throughput pipeline-parallelism vllm llm-inference

UpdatedDec 24, 2025
Python

protocaller /ProtoCaller

Star46

Full automation of relative protein-ligand binding free energy calculations in GROMACS

python molecular-dynamics-simulation high-throughput gromacs free-energies ligand-binding

UpdatedMay 3, 2021
Python

lsds /Saber

Star42

Window-Based Hybrid CPU/GPU Stream Processing Engine

streaming stream gpu stream-processing hybrid high-throughput multicore sliding-windows streaming-data saber multicore-cpu

UpdatedNov 16, 2022
Java

zavolanlab /zarp

Star36

The Zavolab Automated RNA-seq Pipeline

docker workflow bioinformatics rna-seq snakemake pipeline reproducible-research conda singularity fair high-throughput transcriptomics

UpdatedJan 29, 2026
Python

Improve this page

Add a description, image, and links to thehigh-throughput topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thehigh-throughput topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly