Code

Feat/parquet bug fixing#338

Code

Open

alexglasertpx wants to merge 56 commits intomaindigital-land/digital-land-python:mainfrom feat/parquet_bug_fixingdigital-land/digital-land-python:feat/parquet_bug_fixingCopy head branch name to clipboard

+2,012-63

Commits

Commits on Dec 5, 2024

• add convert to parquet function in and run in the pipeline

  eveleighoj

  committed
  5ed2010

  Copy full SHA for 5ed2010

• correct imports

  eveleighoj

  committed
  8622c43

  Copy full SHA for 8622c43

• correct arg

  eveleighoj

  committed
  ff82675

  Copy full SHA for ff82675

• cureent arguement names

  eveleighoj

  committed
  f93068f

  Copy full SHA for f93068f

• correct input for csv to pq

  eveleighoj

  committed
  271e664

  Copy full SHA for 271e664

• add parquet package back in

  eveleighoj

  committed
  cdd480e

  Copy full SHA for cdd480e

• tweak to remove temptable

  eveleighoj

  committed
  e6ac9bf

  Copy full SHA for e6ac9bf

Commits on Jan 6, 2025

• add updated tests

  eveleighoj

  committed
  37ad0c7

  Copy full SHA for 37ad0c7

Commits on Jan 8, 2025

• make acceptance test work

  eveleighoj

  committed
  5a621ae

  Copy full SHA for 5a621ae

Commits on Jan 10, 2025

• ensure no error if all orgs are blank

  eveleighoj

  committed
  60ee6fe

  Copy full SHA for 60ee6fe

Commits on Jan 11, 2025

• add converted resources to the cache directory

  eveleighoj

  committed
  792b9a6

  Copy full SHA for 792b9a6

• change to cache directory

  eveleighoj

  committed
  a0a445e

  Copy full SHA for a0a445e

• change to cache directory default

  eveleighoj

  committed
  b1d08c7

  Copy full SHA for b1d08c7

Commits on Jan 12, 2025

• use output path in other function

  eveleighoj

  committed
  175f465

  Copy full SHA for 175f465

Commits on Jan 14, 2025

• use a specific path for duck.db database to help with overflow

  eveleighoj

  committed
  cbb5eec

  Copy full SHA for cbb5eec

Commits on Jan 15, 2025

• make query entity range specific

  eveleighoj

  committed
  f56cf08

  Copy full SHA for f56cf08

• add condition for no range

  eveleighoj

  committed
  7c04686

  Copy full SHA for 7c04686

• update arguement in wrong place

  eveleighoj

  committed
  ccd1dda

  Copy full SHA for ccd1dda

• start range in correct place

  eveleighoj

  committed
  753b40a

  Copy full SHA for 753b40a

• get value from tuple

  eveleighoj

  committed
  25f7618

  Copy full SHA for 25f7618

• correct max in for loop

  eveleighoj

  committed
  1b8f7a4

  Copy full SHA for 1b8f7a4

Commits on Jan 16, 2025

• iterate file count

  eveleighoj

  committed
  73835e9

  Copy full SHA for 73835e9

• build a single file

  eveleighoj

  committed
  8938a25

  Copy full SHA for 8938a25

• remove cache_dir thats not provided

  eveleighoj

  committed
  0f590eb

  Copy full SHA for 0f590eb

• make the right directory

  eveleighoj

  committed
  e7a3f7f

  Copy full SHA for e7a3f7f

• need remove whole tree

  eveleighoj

  committed
  f0722c5

  Copy full SHA for f0722c5

• run full command

  eveleighoj

  committed
  b89079a

  Copy full SHA for b89079a

• change logginng level

  eveleighoj

  committed
  57feeb8

  Copy full SHA for 57feeb8

• make parquet package prinnt info logs

  eveleighoj

  committed
  2917f43

  Copy full SHA for 2917f43

• make intgeger

  eveleighoj

  committed
  3d3abd9

  Copy full SHA for 3d3abd9

• include entity field change

  eveleighoj

  committed
  3453840

  Copy full SHA for 3453840

• ensure where clause isnt used if no range is supplied

  eveleighoj

  committed
  f43907d

  Copy full SHA for f43907d

• use better logging

  eveleighoj

  committed
  c94d4f1

  Copy full SHA for c94d4f1

• logging tweaks

  eveleighoj

  committed
  8ec07f9

  Copy full SHA for 8ec07f9

• add loading loggings

  eveleighoj

  committed
  bd0749d

  Copy full SHA for bd0749d

• remove indexes before loading

  eveleighoj

  committed
  ba48403

  Copy full SHA for ba48403

• add crreate cursur

  eveleighoj

  committed
  0bf17f2

  Copy full SHA for 0bf17f2

Commits on Jan 23, 2025

• remove error and some wrong validation

  eveleighoj

  committed
  0183d9b

  Copy full SHA for 0183d9b

Commits on Jan 24, 2025

• chacnge package structure

  eveleighoj

  committed
  4a605ad

  Copy full SHA for 4a605ad

• merge in main

  eveleighoj

  committed
  14e015b

  Copy full SHA for 14e015b

• align with proper convert changes

  eveleighoj

  committed
  1b34bd1

  Copy full SHA for 1b34bd1

Commits on Jan 30, 2025

• Merge branch 'feat/parquet_owen' of github-second.com:digital-land/digital-land-python into feat/parquet_owen

  alexglasertpx

  committed
  e976197

  Copy full SHA for e976197

Commits on Feb 4, 2025

• ran black

  alexglasertpx

  committed
  a856ae2

  Copy full SHA for a856ae2

Commits on Feb 5, 2025

• Added custom_temp_dir to ConvertPhase class

  alexglasertpx

  committed
  bf0a949

  Copy full SHA for bf0a949

• Merge branch 'feat/parquet_owen' of github-second.com:digital-land/digital-land-python into feat/parquet_owen

  alexglasertpx

  committed
  550ad05

  Copy full SHA for 550ad05

• black update for parquet code

  alexglasertpx

  committed
  2917f8e

  Copy full SHA for 2917f8e

• Reran test with duckdb 1.2.0

  alexglasertpx

  committed
  cd57b17

  Copy full SHA for cd57b17

• Added 'INSTALL spatial' at class initialisation

  alexglasertpx

  committed
  50fe50e

  Copy full SHA for 50fe50e

• Remove adding spatial parts in class initialisation

  alexglasertpx

  committed
  3bed069

  Copy full SHA for 3bed069

• Set verrsion for duckdb

  alexglasertpx

  committed
  6771c05

  Copy full SHA for 6771c05

• Adding spatial install on class initialisation and setting duckdb version

  alexglasertpx

  committed
  9748762

  Copy full SHA for 9748762

• Removed duckdb version

  alexglasertpx

  committed
  a29b628

  Copy full SHA for a29b628

Commits on Feb 6, 2025

• Removed 'INSTALL spatial' from class initialisation

  alexglasertpx

  committed
  39457df

  Copy full SHA for 39457df

• Reversed prior changes to check if get same error

  alexglasertpx

  committed
  901148a

  Copy full SHA for 901148a

• Reversed prior changes to check if get same error

  alexglasertpx

  committed
  937f3f0

  Copy full SHA for 937f3f0

• Reversed prior changes to check if get same error

  alexglasertpx

  committed
  1db57db

  Copy full SHA for 1db57db