Airbus Ship Detection Challenge
This is an open solution to the Airbus Ship Detection Challenge.
Our goals
We are building entirely open solution to this competition. Specifically:
- Learning from the process - updates about new ideas, code and experiments is the best way to learn data science. Our activity is especially useful for people who wants to enter the competition, but lack appropriate experience.
- Encourage more Kagglers to start working on this competition.
- Deliver open source solution with no strings attached. Code is available on our GitHub repository
💻 . This solution should establish solid benchmark, as well as provide good base for your custom ideas and experiments. We care about clean code😃 - We are opening our experiments as well: everybody can have live preview on our experiments, parameters, code, etc. Check: Airbus Ship Detection Challenge
📈 or screen below.
| Train and validation monitor |
|---|
 |
Disclaimer
In this open source solution you will find references to the neptune.ml. It is free platform for community Users, which we use daily to keep track of our experiments. Please note that using neptune.ml is not necessary to proceed with this solution. You may run it as plain Python script
How to start?
Learn about our solutions
- Check Kaggle forum and participate in the discussions.
- See solutions below:
| link to code | CV | LB |
|---|---|---|
| solution 1 | 0.541 | 0.573 |
| solution 2 | 0.661 | 0.679 |
| solution 3 | 0.694 | 0.696 |
| solution 4 | 0.722 | 0.703 |
| solution 5 | 0.719 | 0.725 |
Start experimenting with ready-to-use code
You can jump start your participation in the competition by using our starter pack. Installation instruction below will guide you through the setup.
Installation (fast track)
- Clone repository and install requirements (use Python3.5)
pip3 install -r requirements.txt - Register to the neptune.ml (if you wish to use it)
- Run experiment based on U-Net:
Cloud
neptune account login
Create project say Ships (SHIP)
Go to neptune.yaml and change:
project: USERNAME/PROJECT_NAME
to your username and project name
Prepare metadata and overlayed target masks It only needs to be done once
neptune send --worker xs \
--environment base-cpu-py3 \
--config neptune.yaml \
prepare_metadata.py
They will be saved in the
metadata_filepath: /output/metadata.csv
masks_overlayed_dir: /output/masks_overlayed
From now on we will load the metadata by changing the neptune.yaml
metadata_filepath: /input/metadata.csv
masks_overlayed_dir: /input/masks_overlayed
and adding the path to the experiment that generated metadata say SHIP-1 to every command --input/metadata.csv
Let's train the model by running the main.py:
neptune send --worker m-2p100 \
--environment pytorch-0.3.1-gpu-py3 \
--config neptune.yaml \
--input /SHIP-1/output/metadata.csv \
--input /SHIP-1/output/masks_overlayed \
main.py
The model will be saved in the:
experiment_dir: /output/experiment
and the submission.csv will be saved in /output/experiment/submission.csv
You can easily use models trained during one experiment in other experiments. For example when running evaluation we need to use the previous model folder in our experiment. We do that by:
changing main.py
CLONE_EXPERIMENT_DIR_FROM = '/SHIP-2/output/experiment'
and running the following command:
neptune send --worker m-2p100 \
--environment pytorch-0.3.1-gpu-py3 \
--config neptune.yaml \
--input /SHIP-1/output/metadata.csv \
--input /SHIP-1/output/masks_overlayed \
--input /SHIP-2 \
main.py
Local
Login to neptune if you want to use it
neptune account login
Prepare metadata by running:
neptune run --config neptune.yaml prepare_metadata.py
Training and inference by running main.py:
neptune run --config neptune.yaml main.py
You can always run it with pure python
python main.py
Get involved
You are welcome to contribute your code and ideas to this open solution. To get started:
- Check competition project on GitHub to see what we are working on right now.
- Express your interest in particular task by writing comment in this task, or by creating new one with your fresh idea.
- We will get back to you quickly in order to start working together.
- Check CONTRIBUTING for some more information.
User support
There are several ways to seek help:
- Kaggle discussion is our primary way of communication.
- Submit an issue directly in this repo.
5 Nov 04, 2022
1 Oct 14, 2021
919 Dec 25, 2022
75 Nov 11, 2022
7.2k Jan 07, 2023
62 Dec 12, 2022
71 Dec 30, 2022
201 Dec 17, 2022
1.2k Jan 02, 2023
5.5k Jan 04, 2023
175 Dec 28, 2022
39 Dec 05, 2022
4 Apr 17, 2021
149 Jan 08, 2023
1.3k Dec 31, 2022
69 Aug 11, 2022
591 Dec 27, 2022
35 Dec 01, 2022
202 Dec 13, 2022
334 Jan 06, 2023