high-throughput

Star

Here are 102 public repositories matching this topic...

Language:All

Filter by language

All102 Python42 Go12 Java10 C++8 Jupyter Notebook4 R4 C3 HTML3 Rust3 C#2

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

FMInference /FlexLLMGen

Star9.4k

Running large language models on a single GPU for throughput-oriented scenarios.

machine-learning deep-learning offloading high-throughput opt gpt-3 large-language-models

UpdatedOct 28, 2024
Python

alphadose /ZenQ

Star690

A thread-safe queue faster and more resource efficient than golang's native channels

go golang optimization concurrency ringbuffer low-latency lock-free fastest high-throughput memory-efficient thread-safe spsc-queue mpsc-queue highly-concurrent zero-allocations zenq

UpdatedMar 12, 2024
Go

salesforce /warp-drive

Star493

Extremely Fast End-to-End Deep Multi-Agent Reinforcement Learning Framework on a GPU (JMLR 2022)

reinforcement-learning deep-learning gpu cuda pytorch numba high-throughput multiagent-reinforcement-learning

UpdatedMay 1, 2025
Python

FMInference /H2O

Star484

[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

sparsity high-throughput heavy-hitters kv-cache gpt-3 large-language-models

UpdatedAug 1, 2024
Python

ByteDance-Seed /ShadowKV

Star267

[ICML 2025 Spotlight] ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

research high-throughput low-rank cpu-offload sparse-attention long-context llm-inference

UpdatedMay 1, 2025
Python

materialsproject /atomate2

Star249

atomate2 is a library of computational materials science workflows

automation dft vasp materials-science high-throughput

UpdatedNov 3, 2025
Python

Quantum-Accelerators /quacc

Star229

quacc is a flexible platform for computational materials science and quantum chemistry that is built for the big data era.

python workflow database dft chemistry hpc quantum-mechanics quantum-chemistry high-throughput computational-materials-science

UpdatedNov 4, 2025
Python

JoyalAJohney /Realtime-distributed-chat

Star223

Realtime distributed messaging platform built using Go and React (Fullstack) ❤️

low-latency high-throughput realtime-messaging system-design

UpdatedFeb 21, 2025
Go

ale94mleon /BindFlow

Star117

A snakemake-based workflow for FEP and MM(PB/GB)SA calculations with GROMACS

drug-discovery drug-design high-throughput mmpbsa fep abfe

UpdatedOct 18, 2025
Python

jnk0le /AVR-UART-lib

Star108

extremly light uart library for AVR 8 bit microcontrollers

c avr transmission optimized flow-control uart rs232 rs485 avr-gcc prematured usart high-speed low-overhead arduino-less high-throughput avr-microcontroller avr-microcontrollers

UpdatedMar 13, 2024
C

tugrul512bit /LruClockCache

Star74

A low-latency LRU approximation cache in C++ using CLOCK second-chance algorithm. Multi level cache too. Up to 2.5 billion lookups per second.

fast caching benchmark memoization cpp high-performance cache lru data-structures low-latency fastest high-throughput lru-cache cache-simulator multi-level-cache low-latency-queries least-recently-used set-associative-cache direct-mapped-cache clock-second-chance

UpdatedJan 18, 2024
C++

svenkubiak /mangooio

Star59

An Intuitive, Lightweight, High Performance Full Stack Java Web Framework.

java performance frontend backend web-framework undertow fullstack high-throughput

UpdatedNov 3, 2025
Java

RUB-Bioinf /VesselExpress

Star52

🔬🖥 Automated Blood Vasculature Analysis of 3D Light-Sheet Image Volumes

docker bioinformatics snakemake high-throughput graph-analysis vessel-segmentation 3d-imaging 3d-skeleton light-sheet-microscopy

UpdatedJun 6, 2024
Python

scalecube /reactor-aeron

Star49

A reactive driver for Aeron transport (https://github.com/real-logic/aeron)

udp ipc rpc low-latency multicast shared-memory high-throughput unicast aeron

UpdatedFeb 5, 2025
Java

dgruber /wfl

Star47

A Simple Way of Creating Job Workflows in Go running in Processes, Containers, Tasks, Pods, or Jobs

go macos linux docker kubernetes golang workflow hpc containers workflow-engine singularity processes k8s high-throughput

UpdatedDec 20, 2024
Go

jmsadair /RapidTrader

Star46

A low-latency, high-throughput order matching system implementation.

finance trading cpp concurrency multithreading trading-platform low-latency high-throughput matching-engine orderbook

UpdatedJul 3, 2023
C++

protocaller /ProtoCaller

Star45

Full automation of relative protein-ligand binding free energy calculations in GROMACS

python molecular-dynamics-simulation high-throughput gromacs free-energies ligand-binding

UpdatedMay 3, 2021
Python

MLSysU /TD-Pipe

Star44

A Throughput-Optimized Pipeline Parallel Inference System for Large Language Models

high-throughput pipeline-parallelism vllm llm-inference

UpdatedAug 5, 2025
Python

lsds /Saber

Star42

Window-Based Hybrid CPU/GPU Stream Processing Engine

streaming stream gpu stream-processing hybrid high-throughput multicore sliding-windows streaming-data saber multicore-cpu

UpdatedNov 16, 2022
Java

zavolanlab /zarp

Star35

The Zavolab Automated RNA-seq Pipeline

docker workflow bioinformatics rna-seq snakemake pipeline reproducible-research conda singularity fair high-throughput transcriptomics

UpdatedJul 20, 2025
Python

Improve this page

Add a description, image, and links to thehigh-throughput topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with thehigh-throughput topic, visit your repo's landing page and select "manage topics."

Learn more

Movatterモバイル変換

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly