streaming-algorithms

Star

Here are 64 public repositories matching this topic...

Language:All

Filter by language

All64 Python13 C++10 Java9 Rust7 Go4 MATLAB4 C3 C#2 JavaScript2 Assembly1

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

johnkerl /miller

Star9.6k

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

tsv devops json statistics csv command-line json-data tabular-data data-reduction unix-toolkit statistical-analysis csv-format devops-tools data-regression data-processing command-line-tools data-cleaning streaming-algorithms streaming-data miller

UpdatedDec 17, 2025
Go

MOA is an open source framework for Big Data stream mining. It includes a collection of machine learning algorithms (classification, regression, clustering, outlier detection, concept drift detection and recommender systems) and tools for evaluation.

java machine-learning clustering machine-learning-algorithms streaming-algorithms moa data-stream-mining

UpdatedNov 13, 2025
Java

ast-al /rangeless

Star200

c++ LINQ -like library of higher-order functions for data manipulation

linq functional pipeline cpp functional-programming parallel range cpp11 lazy-evaluation streaming-algorithms streaming-data itertools

UpdatedMar 14, 2021
C++

dynatrace-oss /hash4j

Star127

Dynatrace hash library for Java

java hash-functions hash simhash farmhash minhash consistent-hashing murmur3 hashing-algorithm hash-algorithm hyperloglog data-sketches cardinality-estimation streaming-algorithms jumphash non-cryptographic-hash-functions superminhash wyhash xxh3 imohash

UpdatedDec 12, 2025
Java

alecmocatta /streaming_algorithms

Star88

Performant implementations of various streaming algorithms, including Count–min sketch, Top k, HyperLogLog, Reservoir sampling.

rust data-structures hyperloglog streaming-algorithms probabilistic-data-structures

UpdatedAug 14, 2024
Rust

cmdevries /LMW-tree

Star78

Learning M-Way Tree - Web Scale Clustering - EM-tree, K-tree, k-means, TSVQ, repeated k-means, bitwise clustering

locality-sensitive-hashing random-projections clustering-algorithm streaming-algorithms large-scale-learning hierarchical-clustering k-means-clustering random-indexing bit-vectors

UpdatedFeb 7, 2022
C++

bcgsc /ntCard

Star77

Estimating k-mer coverage histogram of genomics data

hyperloglog cardinality-estimation k-mer-counting k-mer-frequency streaming-algorithms

UpdatedDec 13, 2023
C++

usmanm /redis-tdigest

Star73

t-digest module for Redis

redis quantile percentile redis-module streaming-algorithms tdigest redis-tdigest

UpdatedJan 14, 2021
C

andylamp /federated_pca

Star43

Federated Principal Component Analysis Revisited!

streaming decentralized pca dimensionality-reduction streaming-algorithms online-learning principal-components subspace-tracking differential-privacy federated-learning perturbation-mask federated-pca

UpdatedNov 1, 2021
MATLAB

LaurentRDC /npstreams

Star38

Streaming operations on NumPy arrays

numpy python3 streaming-algorithms

UpdatedJan 16, 2025
Python

alexander-yu /stream

Star34

An online statistics library, written in Go

go golang statistics data-structures stats streaming-algorithms online-algorithms

UpdatedMar 10, 2025
Go

bmoscon /StreamingAlgorithms

Sponsor

Star33

A Set of Streaming Algorithms in C++, Python, and Go

python go golang c-plus-plus cpp streaming-algorithms

UpdatedJul 28, 2017
C++

dccuchile /rivertext

Star23

RiverText is a framework that standardizes the Incremental Word Embeddings proposed in the state-of-art. Please feel welcome to open an issue in case you have any questions or a pull request if you want to contribute to the project!

cbow nlp-machine-learning streaming-algorithms online-learning streaming-data incremental-learning wordembeddings pytorch-nlp skipgram-algorithm

UpdatedFeb 26, 2025
Python

andylamp /moses

Star22

Streaming, Memory-Limited, r-truncated SVD Revisited!

streaming pca dimensionality-reduction svd streaming-algorithms subspace-tracking subspace-learning online-algorithms subspace-identification

UpdatedNov 1, 2021
MATLAB

Shamir-Lab /Faucet

Star18

This is the codebase for Faucet, described in our manuscript:https://academic.oup.com/bioinformatics/article/34/1/147/4004871, by Roye Rozov, Gil Goldshlager, Eran Halperin, and Ron Shamir

streaming-algorithms metagenomes de-novo-assembly

UpdatedMay 21, 2017
C++

jianshu93 /lash

Star17

Fast and Memory Efficient Genome Sketching via HyperLogLog, HyperMinHash and UltraLogLog

hyperloglog cardinality-estimation streaming-algorithms metagenome average-nucleotide-identity hyperloglogplus ultraloglog genome-sketching hyperminhash

UpdatedDec 17, 2025
Rust

MikeJaredS /hermiter

Star16

Efficient Sequential and Batch Estimation of Univariate and Bivariate Probability Density Functions and Cumulative Distribution Functions along with Quantiles (Univariate) and Nonparametric Correlation (Bivariate)

statistics quantile streaming-algorithms streaming-data online-algorithms probability-density-function cumulative-distribution-function spearman-correlation-coefficient kendall-correlation-coefficient