benchmarking-framework

Python Multi-Process Execution Pool: concurrent asynchronous execution pool with custom resource constraints (memory, timeouts, affinity, CPU cores and caching), load balancing and profiling capabilities of the external apps on NUMA architecture

multiprocessing parallel-computing numa monitoring-server cache-control task-queue application-framework parallel-processing execution-pool benchmarking-framework load-balancing in-memory-computations

UpdatedAug 28, 2019
Python

microsoft /MLOS

Star168

MLOS is a project to enable autotuning for systems.

infrastructure performance-engineering benchmarking data-science autotuning benchmarking-framework optimize-systems

UpdatedJan 21, 2026
Python

HewlettPackard /dc-rl

Star94

SustainDC is a set of Python environments for Data Center simulation and control using Heterogeneous Multi Agent Reinforcement Learning. Includes customizable environments for workload scheduling, cooling optimization, and battery management, with integration into Gymnasium.

python benchmarking benchmark machine-learning sustainability data-center energy-efficiency gymnasium benchmarking-framework carbon-footprint multi-agent-reinforcement-learning battery-management sustainable-computing gymnasium-environment data-center-management workload-scheduling cooling-optimization heterogeneous-reinforcement-learning reinforcement-learningmulti-agent-systems

UpdatedAug 25, 2025
HTML

spcl /npbench

Star91

NPBench - A Benchmarking Suite for High-Performance NumPy

python numpy benchmarking-suite benchmarking-framework

UpdatedJan 28, 2026
Python

pyrddlgym-project /pyRDDLGym

Star89

A toolkit for auto-generation of OpenAI Gym environments from RDDL description files.

visualization benchmarking simulator reinforcement-learning planner simulation visualisation planning visualizer gym benchmark-framework gymnasium evaluation-framework benchmarking-framework planning-domain-definition-language model-based planners gym-environments rddl rddl-domains

UpdatedFeb 10, 2026
Python

neurosim /DNN_NeuroSim_V2.0

Star53

Benchmark framework of compute-in-memory based accelerators for deep neural network (on-chip training chip focused)

benchmarking-framework dnn-neurosim xiaochen-peng memory-accelerators chip-training

UpdatedJun 1, 2021
C++

KumarRobotics /kr_mp_design

Star48

A guidance for the design and evaluation of motion planners for quadrotors in Environments with Varying Complexities

motion-planning benchmarking-framework

UpdatedAug 13, 2024

UVA-LavaLab /PIMeval-PIMbench

Star44

PIMeval simulator and PIMbench suite

open-source benchmark simulator architecture cuda-kernels benchmark-suite benchmarking-framework modeling-and-simulation near-data-processing processing-in-memory

UpdatedNov 22, 2025
C++

ArlineQ /arline_benchmarks

Star32

Arline Benchmarks platform allows to benchmark various algorithms for quantum circuit mapping/compression against each other on a list of predefined hardware types and target circuit classes

python benchmarking benchmark quantum quantum-computing benchmarks benchmarking-framework quantum-benchmarks