Repository files navigation

This is an open solution to theHome Credit Default Risk challenge 🏡.

Check collection ofpublic projects 🎁, where you can find multiple Kaggle competitions with code, experiments and outputs.

We are building entirely open solution to this competition. Specifically:

1. Learning from the process - updates about new ideas, code and experiments is the best way to learn data science. Our activity is especially useful for people who wants to enter the competition, but lack appropriate experience.
2. Encourage more Kagglers to start working on this competition.
3. Deliver open source solution with no strings attached. Code is available on ourGitHub repository 💻. This solution should establish solid benchmark, as well as provide good base for your custom ideas and experiments. We care about clean code 😃
4. We are opening our experiments as well: everybody can havelive preview on our experiments, parameters, code, etc. Check:Home Credit Default Risk 📈 and screens below.

Train and validation results on folds 📊	LightGBM learning curves 📊

In this open source solution you will find references to theneptune.ml. It is free platform for community Users, which we use daily to keep track of our experiments. Please note that using neptune.ml is not necessary to proceed with this solution. You may run it as plain Python script 🐍.

As of1.07.2019 we officially discontinuedneptune-cli client project makingneptune-client the only supported way to communicate with Neptune.That means you should run experiments viapython ... command or update loggers toneptune-client.For more information about the new client go toneptune-client read-the-docs page.

1. CheckKaggle forum and participate in the discussions.
2. Check ourWiki pages 🏡, where we document our work. See solutions below:

You can jump start your participation in the competition by using our starter pack. Installation instruction below will guide you through the setup.

1. Clone repository andinstall requirements (use Python3.5)

pip3 install -r requirements.txt

2. Register to theneptune.ml(if you wish to use it)
3. Run experiment based onLightGBM:

🔱

neptune account loginneptune run --config configs/neptune.yaml main.py train_evaluate_predict_cv --pipeline_name lightGBM

🐍

python main.py -- train_evaluate_predict_cv --pipeline_name lightGBM

Step by step installation 🖥️

Various options of hyperparameter tuning are available

1. Random Search

   configs/neptune.yaml

   hyperparameter_search__method:randomhyperparameter_search__runs:100

   src/pipeline_config.py

   'tuner': {'light_gbm': {'max_depth': ([2,4,6],"list"),'num_leaves': ([2,100],"choice"),'min_child_samples': ([5,10,1525,50],"list"),'subsample': ([0.95,1.0],"uniform"),'colsample_bytree': ([0.3,1.0],"uniform"),'min_gain_to_split': ([0.0,1.0],"uniform"),'reg_lambda': ([1e-8,1000.0],"log-uniform"),                            },              }

You are welcome to contribute your code and ideas to this open solution. To get started:

1. Checkcompetition project on GitHub to see what we are working on right now.
2. Express your interest in paticular task by writing comment in this task, or by creating new one with your fresh idea.
3. We will get back to you quickly in order to start working together.
4. CheckCONTRIBUTING for some more information.

There are several ways to seek help:

1. Kagglediscussion is our primary way of communication.
2. Read project'sWiki, where we publish descriptions about the code, pipelines and supporting tools such asneptune.ml.
3. Submit an issue directly in this repo.