- Notifications
You must be signed in to change notification settings - Fork94
NoSQL benchmark tests for documents and graphs
License
weinberger/nosql-tests
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
This repository contains the performance tests described in myblog. Please feel free to improve the various database test drivers. If you see any optimization I have missed, please issue a pull request.
The files are structured as follows:
benchmark.js contains the test driver and all the test cases. Currently, the following tests are implemented:shortest,hardPath,neighbors,neighbors2,neighbors2data,singleRead,singleWrite andaggregation. Useall to run all tests inclusive warmup.
arangodb,arangodb_mmfiles,neo4j,mongodb,orientdb,postgresql_jsonb andpostgresql_tabular are directories containing the filesdescription.js,setup.sh andimport.sh. The description file implements the database specific parts of the tests. The setup and import files are used to set up the database and import the needed dataset for the test.
data contains the test data used for the read and write tests and the start and end vertices for the shortest path.
We need additional services to install:
$ curl -sL https://deb.nodesource.com/setup_8.x | sudo -E bash -$ sudo apt-get install -y make build-essential nodejsClone the test repo and uncompress the test data files.
$ git clone https://github.com/weinberger/nosql-tests.git$ cd nosql-tests$ npm install$ npm run dataThe server also needs the nosql-tests repo checked out. The folder on client and server are required to have the same path!
$ git clone https://github.com/weinberger/nosql-tests.gitFor the complete setup with all databases we need several additional services:
$ sudo apt-get install -y unzip default-jre binutils numactl collectd nodejsTo install all databases and import the test dataset:
$ ./setupAll.shTo run a single test against one database, we executebenchmark.js over node.
& node benchmark.js -hUsage: benchmark.js <command> [options]Commands: arangodb ArangoDB benchmark arangodb-mmfiles ArangoDB benchmark mongodb MongoDB benchmark neo4j neo4j benchmark orientdb orientdb benchmark postgresql postgresql JSON benchmark postgresql_tabular postgresql tabular benchmarkOptions: --version Show version number [boolean] -t, --tests tests to run separated by comma: shortest, neighbors, neighbors2, neighbors2data, singleRead, singleWrite, aggregation, hardPath, singleWriteSync [string] [default: "all"] -s, --restrict restrict to that many elements (0=no restriction) [default: 0] -l, --neighbors look at that many neighbors [default: 1000] --ld, --neighbors2data look at that many neighbors2 with profiles [default: 100] -a, --address server host [string] [default: "127.0.0.1"] -h Show help [boolean]copyright 2018 Claudius WeinbergerTo run the complete test against every database, we simply executerunAll.sh.
./runAll.sh <server-ip> <num-runs>