README.md

Montandon ETL

Getting Started

Clone this repository:

git clone [email protected]:IFRCGo/montandon-etl.github
cd montandon-etl

Update submodules

 git submodule update --init --recursive

Create an empty .env file.

touch .env

Install python dependencies

# uv should be installed globally
uv sync

Running

Run container using the following command:

 docker compose up --build -d

Run migration using the following command:

docker-compose exec web python manage.py migrate

Create users to access admin panel using the following command:

docker-compose exec web python manage.py createsuperuser

Triggering data import from external sources

# Import from GDACS
 docker-compose exec web python manage.py extract_gdacs_data

# Import from GLIDE
docker-compose exec web python manage.py extract_glide_data

# Import from EMDAT
docker-compose exec web python manage.py extract_glide_data

# Import from IDU
docker-compose exec web python manage.py extract_idu_data

# Import from GIDD
docker-compose exec web python manage.py extract_gidd_data

# Import from GFD
docker-compose exec web python manage.py extract_gfd_data