There is a file here:
https://storage.googleapis.com/on-the-layer-public/demo_test_data.csv
It consists of products structured like this:
- id
- brand
- product_family
- name
- title
- description
- size
- material
- colour
You need to:
- Download the file
- Get the information from the file
- Save information about the product to sql db
To deploy docker container with db use:
cd docker/postgres
docker compose up -d --build
db structure is here:
cd postgres/docker-entrypoint-initdb.d
postgresql db is:
POSTGRES_USER: test
POSTGRES_PASSWORD: test
POSTGRES_DB: test
You can:
- use any external libraries
- use any source of information that you have including websites, books, etc.
- ask questions to an examinator about the task (but not about the solution)
Acceptance criteria:
- Script should work on any machine
- Db connection should be configurable
- Recurring execution should not cause database data to duplicate
- Increase size of csv file should not result in out of memory exceptions or other related exceptions