s3-storage

Star

Here are 622 public repositories matching this topic...

Language:All

Filter by language

All622 Python122 JavaScript111 TypeScript64 Go60 Java49 C#22 PHP22 HTML21 Shell21 Jupyter Notebook18

Sort:Most stars

Sort options

Most stars Fewest stars Most forks Fewest forks Recently updated Least recently updated

seaweedfs /seaweedfs

Star24.3k

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.

kubernetes distributed-systems fuse replication cloud-drive s3 posix s3-storage hdfs distributed-storage distributed-file-system erasure-coding object-storage blob-storage seaweedfs hadoop-hdfs tiered-file-system

UpdatedMay 5, 2025
Go

mnfst /manifest

Sponsor

Star2.5k

🦚 The 1-file backend.

api manifest open-source yaml cms postgres database backend rest-api sqlite headless baas s3-storage admin-panel backend-server headless-cms backend-api sdk-js backend-as-a-servise headless-cms-rest-api

UpdatedMay 6, 2025
TypeScript

truenas /middleware

Star2.4k

TrueNAS CORE/Enterprise/SCALE Middleware Git Repository

scale storage smb nfs s3-storage iscsi zfs freenas truenas

UpdatedMay 7, 2025
Python

TileDB-Inc /TileDB

Star1.9k

The Universal Storage Engine

data-science storage-engine s3 sparse-data scientific-computing s3-storage arrays hdfs data-analysis dataframes tiledb dense-data sparse-arrays

UpdatedMay 6, 2025
C++

Forceu /Gokapi

Star1.9k

Lightweight selfhosted Firefox Send alternative without public upload. AWS S3 supported.

docker golang ssl download selfhosted self-hosted s3-storage uploader backblaze-b2 ownyourdata firefox-send

UpdatedMay 3, 2025
Go

scality /cloudserver

Star1.8k

Zenko CloudServer, an open-source Node.js implementation of the Amazon S3 protocol on the front-end and backend storage capabilities to multiple clouds, including Azure and Google.

nodejs javascript docker cloud storage aws-s3 cloud-storage s3-storage cloud-native object-storage multiple-backends zenko artesca

UpdatedMay 6, 2025
JavaScript

leo-project /leofs

Star1.6k

The LeoFS Storage System

erlang s3 nfs s3-storage distributed-storage distributed-file-system leofs nfs-server datalake

UpdatedJun 2, 2020
Erlang

stavro /arc

Star1.2k

📎 Flexible file upload and attachment library for Elixir

elixir storage s3 attachment s3-storage

UpdatedJul 12, 2024
Elixir

okhosting /awesome-storage

Star841

A curated list of storage open source tools. Backups, redundancy, sharing, distribution, encryption, etc.

awesome backup replication storage s3 nfs s3-bucket s3-storage ceph awesome-list glusterfs high-availability san nas curated-lists s3-backup redundancy awesome-lists s3-client encription

UpdatedMar 22, 2024

stefanprodan /mgob

Sponsor

Star766

MongoDB dockerized backup agent. Runs schedule backups with retention, S3 & SFTP upload, notifications, instrumentation with Prometheus and more.

docker kubernetes backup mongodb sftp s3-storage

UpdatedNov 3, 2022
Go

open-io /oio-sds

Star689

High Performance Software-Defined Object Storage for Big Data and AI, that supports Amazon S3 and Openstack Swift

python c lightweight golang open-source flexible storage openstack-swift s3-storage software-defined-storage objectstorage object-storage

UpdatedMay 6, 2025
Python

Seagate /cortx

Star620

CORTX Community Object Storage is 100% open source object storage uniquely optimized for mass capacity storage devices.

open-source inclusivity distributed-systems opensource big-data storage bigdata s3 hackathons s3-storage objectstore distributed-storage software-defined-storage objectstorage hacktoberfest storage-api object-storage hacktoberfest2020 object-storage-service cortx-community

UpdatedMay 3, 2024
Jupyter Notebook

Clivern /Walrus

Star489

🔥 Fast, Secure and Reliable System Backup, Set up in Minutes.

backup walrus s3 minio s3-storage recovery high-availability hacktoberfest digitalocean-spaces clivern minio-storage

UpdatedMay 6, 2025
Go

MikaAK /s3-plugin-webpack

Star488

Uploads files to s3 after complete

webpack amazon s3-storage

UpdatedAug 3, 2023
JavaScript

ling-drag0n /CloudPaste

Star417

基于Worker的在线剪贴板和文件分享服务，支持 Markdown、阅后即焚、文本/大文件分享、密码保护等功能，支持多种部署方式，可作为WebDav挂载

docker markdown webdav b2 s3-storage r2 cloudfare-workers vercel cloudfare-pages cloudpaste

UpdatedMay 6, 2025
JavaScript

operatorai /modelstore

Star389

🏬 modelstore is a Python library that allows you to version, export, and save a machine learning model to your filesystem or a cloud storage provider.

data-science machine-learning tensorflow scikit-learn python-library keras pytorch transformer s3-storage mlops modelstore

UpdatedJan 14, 2025
Python

awslabs /serverless-photo-recognition

Star387

A collection of 3 lambda functions that are invoked by Amazon S3 or Amazon API Gateway to analyze uploaded images with Amazon Rekognition and save picture labels to ElasticSearch (written in Kotlin)

kotlin aws elasticsearch jwt aws-lambda serverless picture aws-s3 architecture lambda-functions kotlin-language aws-apigateway s3-storage amazon-cognito amazon-api-gateway amazon-rekognition serverless-photo-recognition