Skip to content

gmankab/csv_to_db

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Task 1

There is a file here:

https://storage.googleapis.com/on-the-layer-public/demo_test_data.csv

It consists of products structured like this:

  • id
  • brand
  • product_family
  • name
  • title
  • description
  • size
  • material
  • colour

You need to:

  • Download the file
  • Get the information from the file
  • Save information about the product to sql db

To deploy docker container with db use:

cd docker/postgres
docker compose up -d --build

db structure is here:

cd postgres/docker-entrypoint-initdb.d

postgresql db is:

  POSTGRES_USER: test
  POSTGRES_PASSWORD: test
  POSTGRES_DB: test

You can:

  • use any external libraries
  • google
  • use any source of information that you have including websites, books, etc.
  • ask questions to an examinator about the task (but not about the solution)

Acceptance criteria:

  • Script should work on any machine
  • Db connection should be configurable
  • Recurring execution should not cause database data to duplicate
  • Increase size of csv file should not result in out of memory exceptions or other related exceptions

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published