- Notifications
You must be signed in to change notification settings - Fork5
simdjson/simdjson_experiments_vldb2019
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
Originally, these were detailed experiments done over the simdjson code base for the paperParsing gigabytes of JSON per second.
We use a simple Makefile to execute the docker scripts. If you have a proper configured Linux system, you should be able to generate all experimental results with a simple command:
makeThe code for the experiments is in theexperiments directory. Each experiment is in its own repository with a docker file describing the container.
The experimental results are in theresult directory. They are organized first by node name (to distinguish results from different systems). When you typemake, it creates a new subdirectory and fills it with experimental results.
There is a distinct directory calledanalysis that contains the scripts processing the resutlts from theresult directory. The analysis scripts have dependencies: python, pandas, gnuplot. Doing the analysis is not fully automated, by design: a human being needs to look at the number.
Software:
- Linux
- Docker (you need privileged access).
Hardware:
- AVX2-compatible processing (Intel, AMD).
- We check that hyperthreading is disabled.
You need toinstall docker, make sure it is running, and make yourself a priviliged user which may involveusermod -G -a docker myusername or some similar command. You want to create a docker group, put yourself in the docker group and restarts docker.
About
Detailed experiments over simdjson for VLDB article (2019) and future work
Resources
Uh oh!
There was an error while loading.Please reload this page.