- Notifications
You must be signed in to change notification settings - Fork100
The high-performance kv storage engine based on bitcask paper made in golang
License
ByteStorage/FlyDB
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
English |简体中文
FlyDB aims to serve as an alternative to in-memory key-value storage (such asRedis) in some cases, aiming to strike a balance between performance and storage cost. It does this by optimizing resource allocation and using cost-effective storage media. By intelligently managing data,FlyDB ensures efficient operations while minimizing storage costs. It provides a reliable solution for scenarios that require a balance between performance and storage costs.
FlyDB is a high-performance key-value (KV) storage engine based on the efficient bitcask model. It offers fast and reliable data retrieval and storage capabilities. By leveraging the simplicity and effectiveness of the bitcask model,FlyDB ensures efficient read and write operations, resulting in improved overall performance. It provides a streamlined approach to storing and accessing key-value pairs, making it an excellent choice for scenarios that require fast and responsive data access.FlyDB's focus on speed and simplicity makes it a valuable alternative for applications that prioritize performance while balancing storage costs.
You can install FlyDB using the Go command line tool:
gogetgithub.com/ByteStorage/FlyDB@v1.1.0
Or clone this project from github:
git clone https://github.com/ByteStorage/FlyDB.git
Here is a simple example of how to use the Linux version:
See flydb/examples for details.
package mainimport ("fmt""github.com/ByteStorage/FlyDB/flydb""github.com/ByteStorage/FlyDB/config")funcmain() {options:=config.DefaultOptionsoptions.DirPath="/tmp/flydb"db,_:=flydb.NewFlyDB(options)err:=db.Put([]byte("name"), []byte("flydb-example"))iferr!=nil {fmt.Println("Put Error => ",err) }val,err:=db.Get([]byte("name"))iferr!=nil {fmt.Println("Get Error => ",err)}fmt.Println("name value => ",string(val))err:=db.Delete([]byte("name"))iferr!=nil {fmt.Println("Delete Error => ",err) }}
./build.sh
docker run -d --name flydb-server --network=host -p 8999:8999 bytestorage/flydb:v1.0
kubectl apply -f kubernetes/flydb-namespace.yamlkubectl apply -f kubernetes/flydb-deployment.yamlkubectl apply -f kubernetes/flydb-service.yamlkubectlwait --for=condition=ready pod -l app=flydb -n flydb-systemkubectl port-forward svc/flydb-service -n flydb-system 8999:8999When install flydb server by shell/docker/kubernetes, you can use the flydb-cli to connect the flydb server.
./bin/flydb-client 127.0.0.1:8999"We did a simple performance test of the V1.0.4 version of FlyDB. This test mainly focused on reading and writing large-scale data, and we selected 500,000 random data for testing.
Through testing, we found that in V1.0.4, with 500,000 data:
PUT performance: 572.265968ms
GET performance: 355.943926ms
PUT performance: 569.610614ms
GET performance: 297.781977ms
If you have a better way to optimize read and write performance, please submit your 'pr'.
We compared the results of a benchmark test using FlyDB V1.0.4 with other kv databases written in golang on the market and found that the read/write performance test results exceeded most open source kv databases.
See in detail:https://github.com/ByteStorage/contrast-benchmark
goos: linuxgoarch: amd64pkg: contrast-benchmarkcpu: 11th Gen Intel(R) Core(TM) i7-11800H @ 2.30GHzBenchmark_PutValue_FlyDBBenchmark_PutValue_FlyDB-16 95023 13763 ns/op 2904 B/op 16 allocs/opBenchmark_GetValue_FlyDBBenchmark_GetValue_FlyDB-16 2710143 463.5 ns/op 259 B/op 5 allocs/opBenchmark_PutValue_BadgerBenchmark_PutValue_Badger-16 59331 22711 ns/op 6006 B/op 48 allocs/opBenchmark_GetValue_BadgerBenchmark_GetValue_Badger-16 158686 7686 ns/op 10844 B/op 42 allocs/opBenchmark_PutValue_BoltDBBenchmark_PutValue_BoltDB-16 32637 56519 ns/op 21009 B/op 123 allocs/opBenchmark_GetValue_BoltDBBenchmark_GetValue_BoltDB-16 655971 24327 ns/op 723 B/op 26 allocs/op Benchmark_PutValue_GoLevelDBBenchmark_PutValue_GoLevelDB-16 71931 14709 ns/op 2226 B/op 12 allocs/opBenchmark_GetValue_GoLevelDBBenchmark_GetValue_GoLevelDB-16 500736 2520 ns/op 1278 B/op 15 allocs/opBenchmark_PutValue_NutsDBBenchmark_PutValue_NutsDB-16 78801 13582 ns/op 3242 B/op 22 allocs/opBenchmark_GetValue_NutsDBBenchmark_GetValue_NutsDB-16 373124 5702 ns/op 1392 B/op 14 allocs/opBenchmark_PutValue_RoseDBBenchmark_PutValue_RoseDB-16 69776 19166 ns/op 6242 B/op 59 allocs/opBenchmark_GetValue_RoseDBBenchmark_GetValue_RoseDB-16 4155183 298.0 ns/op 167 B/op 4 allocs/opBenchmark_PutValue_PebbleBenchmark_PutValue_Pebble-16 91304 21877 ns/op 2720 B/op 8 allocs/opBenchmark_GetValue_PebbleBenchmark_GetValue_Pebble-16 66135 15837 ns/op 17193 B/op 22 allocs/opPASSIf you have any questions and want to contact us, you can contact our developer team, we will reply to your email:
Team Email:bytestoragecommunity@gmail.com
Or add my wechat, invite you to enter the project community, and code masters together to exchange learning.
Add wechat please comment Github
- Extended data structure support: including but not limited to string, list, hash, set, etc.
- Compatible with Redis protocols and commands.
- Support http services.
- Support tcp services.
- Log aggregation
- Data backup
- Distributed cluster model.
See in detail:Version-update-document
If you have any ideas or suggestions for FlyDB, please feel free to submit 'issues' or' pr 'on GitHub. We welcome your contributions!
Please refer to the complete specification procedure：CONTRIBUTEING
FlyDB is released under the Apache license. For details, see LICENSE file.
Thanks to
JetBrainsfor the free open source license.
About
The high-performance kv storage engine based on bitcask paper made in golang
Topics
Resources
License
Contributing
Uh oh!
There was an error while loading.Please reload this page.
Stars
Watchers
Forks
Packages0
Uh oh!
There was an error while loading.Please reload this page.
Contributors14
Uh oh!
There was an error while loading.Please reload this page.