Setup and version your ML project
with MLV-tools and DVC
Stéphanie Bracaloni & Sarah Diot-Girard
@SDGAbout Us
Sarah Diot-Girard Data Scientist since 2012 Interested in DataOps and Ethics
@SgdJlbl
@SgdJlblStéphanie Bracaloni Software Engineer since 2013 Automation and Code Quality @sbracaloni
@sbracaloni
@SDG + @SBIMajor issues:
- Versioning (Data & Jupyter Notebooks)
- Automate the pipeline execution
- Reproduce & Share experiments
Setup a project using MLV-tools
- Easily createDVC steps from command line pipeline steps
gen_dvc -i ./script.py -o ./commands/script_dvcSetup a project using MLV-tools
- Convert Jupyter Notebooks to
executable andconfigurable Python3 scripts
ipynb_to_python -n ./notebook.ipynb -o ./script.pySetup a project using MLV-tools
- Convert Jupyter Notebooks toDVC steps in one command
ipynb_to_dvc -n ./notebook.ipynb -o ./commands/script_dvc[Tutorial time]CloneMLV-tools tutorial repositoryResources:mlv-tools-tutorial/resources/setup_projectHow to:mlv-tools-tutorial/tutorial/setup_project.mdWe are waiting for your Pull Requests!
github.com/peopledoc/ml-versioning-tools github.com/peopledoc/mlv-tools-tutorial
Fonts:White Rabbit by Matthew Welch Capsuula by Henrich Fichna Icons made bySmashicons,Good Ware,Designmodo,Freepik fromwww.flaticon.com; licenseCC 3.0 BY
Contact Us !
sarah_diot-girard@ultimatesoftware.com
stephanie_bracaloni@ultimatesoftware.com
Time Optimization
Tutorial Part1: build docker images
cd mlv-tools-tutorial/resources/dvc_playgrounddocker-compose buildTutorial Part2: build docker image (Optional)
(Can also be run on your computer)./resources/setup_project/docker/run.sh