Code

h5boss version 2#1

Code

Open

valiantljk wants to merge 199 commits intosbailey:mastersbailey/h5boss:masterfrom valiantljk:mastervaliantljk/h5boss:masterCopy head branch name to clipboard

+12,899-351

Commits

Commits on Mar 14, 2016

• h5boss subselect

  valiantljk

  committed
  89ce43a

  Copy full SHA for 89ce43a

Commits on Mar 15, 2016

• update

  valiantljk

  committed
  15def44

  Copy full SHA for 15def44

Commits on Apr 15, 2016

• update

  valiantljk

  committed
  d78cd1e

  Copy full SHA for d78cd1e

Commits on Apr 18, 2016

• update

  valiantljk

  committed
  c14db91

  Copy full SHA for c14db91

• update

  valiantljk

  committed
  81ee2fc

  Copy full SHA for 81ee2fc

• fix but in select.py

  valiantljk

  committed
  6c7f37a

  Copy full SHA for 6c7f37a

• add timing

  valiantljk

  committed
  7385b40

  Copy full SHA for 7385b40

• add pmj test

  valiantljk

  committed
  ba68934

  Copy full SHA for ba68934

• add pmj check

  valiantljk

  committed
  b4f2ee5

  Copy full SHA for b4f2ee5

• add metadata check

  valiantljk

  committed
  b0a02de

  Copy full SHA for b0a02de

Commits on Apr 25, 2016

• update parallel converter

  valiantljk

  committed
  47281d9

  Copy full SHA for 47281d9

• update gitignore

  valiantljk

  committed
  56c6a72

  Copy full SHA for 56c6a72

Commits on May 2, 2016

• update add pmf

  valiantljk

  committed
  c0fdb4f

  Copy full SHA for c0fdb4f

• h5boss select function

  valiantljk

  committed
  ea11b36

  Copy full SHA for ea11b36

• Create README.md

  valiantljk

  committed
  1e72067

  Copy full SHA for 1e72067

• boss2hdf5

  valiantljk

  committed
  1875387

  Copy full SHA for 1875387

• Merge branch 'master' of https://github.com/valiantljk/h5boss-util

  valiantljk

  committed
  fdab5c9

  Copy full SHA for fdab5c9

• update

  valiantljk

  committed
  d093808

  Copy full SHA for d093808

Commits on May 3, 2016

• update select

  valiantljk

  committed
  96bbda4

  Copy full SHA for 96bbda4

Commits on May 5, 2016

• update demo and scritps

  valiantljk

  committed
  3dd8d54

  Copy full SHA for 3dd8d54

Commits on May 6, 2016

• update random

  valiantljk

  committed
  5884ac4

  Copy full SHA for 5884ac4

Commits on May 25, 2016

• update h5boss subset-selection

  valiantljk

  committed
  05a1192

  Copy full SHA for 05a1192

• delete h5 files

  valiantljk

  committed
  9ea4163

  Copy full SHA for 9ea4163

• h5boss_uitl.ipynb

  valiantljk

  committed
  117c23e

  Copy full SHA for 117c23e

• update

  valiantljk

  committed
  b8e3045

  Copy full SHA for b8e3045

Commits on May 26, 2016

• update xlsx

  valiantljk

  committed
  63c18e7

  Copy full SHA for 63c18e7

• update add

  valiantljk

  committed
  731c627

  Copy full SHA for 731c627

Commits on May 27, 2016

• update

  valiantljk

  committed
  dca3f76

  Copy full SHA for dca3f76

Commits on Jun 1, 2016

• update update.py

  valiantljk

  committed
  428ca13

  Copy full SHA for 428ca13

Commits on Jun 2, 2016

• update remove.py

  valiantljk

  committed
  d52f82b

  Copy full SHA for d52f82b

• delete files

  valiantljk

  committed
  bcf07b2

  Copy full SHA for bcf07b2

• update tdd

  valiantljk

  committed
  c8e20ed

  Copy full SHA for c8e20ed

• Update README.md

  valiantljk

  committed
  01d0bda

  Copy full SHA for 01d0bda

• Update README.md

  valiantljk

  committed
  3b17d1f

  Copy full SHA for 3b17d1f

• update test cases

  valiantljk

  committed
  99acd41

  Copy full SHA for 99acd41

• Merge branch 'master' of github.com:valiantljk/h5boss-util

  valiantljk

  committed
  27263ec

  Copy full SHA for 27263ec

• update test_remove.py

  valiantljk

  committed
  7b933ac

  Copy full SHA for 7b933ac

Commits on Jun 5, 2016

• pmf full list and csv read

  valiantljk

  committed
  c73b510

  Copy full SHA for c73b510

• random pmf list

  valiantljk

  committed
  c147555

  Copy full SHA for c147555

• Update README.md

  valiantljk

  committed
  19a8766

  Copy full SHA for 19a8766

• Update README.md

  valiantljk

  committed
  d72f4f7

  Copy full SHA for d72f4f7

• Update README.md

  valiantljk

  committed
  1498a3a

  Copy full SHA for 1498a3a

• Update README.md

  valiantljk

  committed
  41759dd

  Copy full SHA for 41759dd

• update functions

  valiantljk

  committed
  f04560a

  Copy full SHA for f04560a

• Merge branch 'master' of github.com:valiantljk/h5boss-util

  valiantljk

  committed
  c515c11

  Copy full SHA for c515c11

Commits on Jun 6, 2016

• update

  valiantljk

  committed
  f2e870c

  Copy full SHA for f2e870c

• update

  valiantljk

  committed
  a74fcf7

  Copy full SHA for a74fcf7

Commits on Jun 24, 2016

• update multiprocessing subset

  valiantljk

  committed
  7f7bd0f

  Copy full SHA for 7f7bd0f

• start h5boss select mpi version

  valiantljk

  committed
  eb4bb99

  Copy full SHA for eb4bb99

• add cori script

  valiantljk

  committed
  09aff6a

  Copy full SHA for 09aff6a

• update mpi version

  valiantljk

  committed
  0892557

  Copy full SHA for 0892557

• added repack option in remove

  valiantljk

  committed
  3b44d35

  Copy full SHA for 3b44d35

Commits on Jun 27, 2016

• update boss2hdf5 parallel

  valiantljk

  committed
  9018209

  Copy full SHA for 9018209

Commits on Jul 1, 2016

• parallel dev

  valiantljk

  committed
  6531811

  Copy full SHA for 6531811

Commits on Jul 7, 2016

• update parallel meta query

  valiantljk

  committed
  7ff0346

  Copy full SHA for 7ff0346

Commits on Jul 9, 2016

• subset function bug fixed, catalog is a 1d table that contains compound type, previous code replace the table each time, new code only updates the table for selected fiber id

  valiantljk

  committed
  13e3a15

  Copy full SHA for 13e3a15

Commits on Jul 11, 2016

• update mpi version

  valiantljk

  committed
  7d7e6c9

  Copy full SHA for 7d7e6c9

• update parallel subset with virtual dataset optimization

  valiantljk

  committed
  8796ea7

  Copy full SHA for 8796ea7

Commits on Jul 20, 2016

• update

  valiantljk

  committed
  15c583e

  Copy full SHA for 15c583e

Commits on Jul 22, 2016

• update h5boss

  valiantljk

  committed
  269e250

  Copy full SHA for 269e250

Commits on Aug 3, 2016

• support parallel read write to shared file

  valiantljk

  committed
  a67dea6

  Copy full SHA for a67dea6

Commits on Aug 9, 2016

• update h5boss

  valiantljk

  committed
  aa400d8

  Copy full SHA for aa400d8

• remove h5check

  valiantljk

  committed
  1e621f9

  Copy full SHA for 1e621f9

• update

  valiantljk

  committed
  1ba57f1

  Copy full SHA for 1ba57f1

• update h5boss c

  valiantljk

  committed
  31c3399

  Copy full SHA for 31c3399

Commits on Aug 12, 2016

• ch5boss parallel and pyh5boss catalog function

  valiantljk

  committed
  aea23cb

  Copy full SHA for aea23cb

Commits on Aug 14, 2016

• update

  valiantljk

  committed
  6eb624e

  Copy full SHA for 6eb624e

Commits on Aug 15, 2016

• change code structure

  valiantljk

  committed
  19de353

  Copy full SHA for 19de353

Commits on Aug 18, 2016

• catalog parallel smart write

  valiantljk

  committed
  5e559cf

  Copy full SHA for 5e559cf

Commits on Aug 19, 2016

• update catalog copy

  valiantljk

  committed
  5e06af7

  Copy full SHA for 5e06af7

• update

  valiantljk

  committed
  00b5f56

  Copy full SHA for 00b5f56

Commits on Aug 21, 2016

• update catalog write

  valiantljk

  committed
  cab6926

  Copy full SHA for cab6926

Commits on Aug 22, 2016

• update h5bosspy timing

  valiantljk

  committed
  60b4f2d

  Copy full SHA for 60b4f2d

• update gitignore

  valiantljk

  committed
  82f73ad

  Copy full SHA for 82f73ad

Commits on Aug 25, 2016

• before adding catalog c code

  valiantljk

  committed
  0169d48

  Copy full SHA for 0169d48

Commits on Aug 29, 2016

• fix bug in parsing parameters, break

  valiantljk

  committed
  47aa06f

  Copy full SHA for 47aa06f

Commits on Aug 30, 2016

• update catalog parsing and read

  valiantljk

  committed
  45790e5

  Copy full SHA for 45790e5

• update catalog read

  valiantljk

  committed
  8170c5f

  Copy full SHA for 8170c5f

Commits on Aug 31, 2016

• update 1 read fields by fiberid, 2 read records by offsets list, 3 write records contiguously, 4 get records offset from catalog table

  valiantljk

  committed
  7ff1c91

  Copy full SHA for 7ff1c91

Commits on Sep 1, 2016

• finish h5boss c catalog parallel read write debugging

  valiantljk

  committed
  a9120fd

  Copy full SHA for a9120fd

Commits on Sep 9, 2016

• update h5boss python

  valiantljk

  committed
  25768cb

  Copy full SHA for 25768cb

Commits on Sep 14, 2016

• update h5boss map initial version

  valiantljk

  committed
  03b99be

  Copy full SHA for 03b99be

• update new format converter

  valiantljk

  committed
  24d863b

  Copy full SHA for 24d863b

• update h5boss format version 2, done

  valiantljk

  committed
  ab53b00

  Copy full SHA for ab53b00

Commits on Sep 15, 2016

• update h5boss converter v2, fix exposures part, change 1d to 2d array

  valiantljk

  committed
  e308057

  Copy full SHA for e308057

• update boss2hdf5 v1

  valiantljk

  committed
  044cb4b

  Copy full SHA for 044cb4b

Commits on Sep 21, 2016

• update conversion 2 script

  valiantljk

  committed
  cafdcb9

  Copy full SHA for cafdcb9

Commits on Sep 24, 2016

• update h5boss query

  valiantljk

  committed
  8fb7c3e

  Copy full SHA for 8fb7c3e

• update checkfiber

  valiantljk

  committed
  c502dca

  Copy full SHA for c502dca

• update h5boss v2 query

  valiantljk

  committed
  9088033

  Copy full SHA for 9088033

Commits on Sep 25, 2016

• Update README.md

  valiantljk

  authored
  12b45ed

  Copy full SHA for 12b45ed

• update h5map: get dataset type and shape. fiber template create for new format

  valiantljk

  committed
  3ee5cc1

  Copy full SHA for 3ee5cc1

• Merge branch 'master' of github.com:valiantljk/h5boss-util

  valiantljk

  committed
  6a14020

  Copy full SHA for 6a14020

• readd h5boss subset v1

  valiantljk

  committed
  74612d4

  Copy full SHA for 74612d4

• regorganize the files

  valiantljk

  committed
  fa1b46f

  Copy full SHA for fa1b46f

• update subset_mpi.py

  valiantljk

  committed
  a7d652b

  Copy full SHA for a7d652b

Commits on Sep 26, 2016

• update h5boss v2 query

  valiantljk

  committed
  dce5894

  Copy full SHA for dce5894

• figured out python list buffer reusing issue

  valiantljk

  committed
  8cb15bc

  Copy full SHA for 8cb15bc

• create template has bug, start to rewrite fiber copy

  valiantljk

  committed
  23e5f78

  Copy full SHA for 23e5f78

Commits on Sep 27, 2016

• template creation is ok, parallel fiber copy is under debugging

  valiantljk

  committed
  63358ba

  Copy full SHA for 63358ba

• found a bug in datamap, the assumption that flux in different plate/mjds has same y dimension is wrong, now need to update the returned structure of the query, such that the shape of the dataset is…

  Show description for 1a3b6d4
  valiantljk

  committed
  1a3b6d4

  Copy full SHA for 1a3b6d4

• need to fix the bug in datamap

  valiantljk

  committed
  a908031

  Copy full SHA for a908031

• update selectmpi and h5map

  valiantljk

  committed
  d8ff2e8

  Copy full SHA for d8ff2e8

Commits on Sep 30, 2016

• parallel read for v2 is done

  valiantljk

  committed
  6784a14

  Copy full SHA for 6784a14

Commits on Oct 3, 2016

• update subset_mpi interface

  valiantljk

  committed
  e37d94b

  Copy full SHA for e37d94b

• unify the submit_subset script

  valiantljk

  committed
  1066f55

  Copy full SHA for 1066f55

Commits on Oct 4, 2016

• achived 2.5X in template creation by turning on latest -libver- option

  valiantljk

  committed
  f4e84bc

  Copy full SHA for f4e84bc

• update gitignore

  valiantljk

  committed
  ef56095

  Copy full SHA for ef56095

• clean h5boss c

  valiantljk

  committed
  bee3c25

  Copy full SHA for bee3c25

• clean h5boss c parser

  valiantljk

  committed
  b32589e

  Copy full SHA for b32589e

• re-org h5boss py

  valiantljk

  committed
  f7cbf21

  Copy full SHA for f7cbf21

• add converter notebook and fibercheck slurm script

  valiantljk

  committed
  de4c8d8

  Copy full SHA for de4c8d8

Commits on Oct 5, 2016

• rename files for version 2

  valiantljk

  committed
  6eed9b2

  Copy full SHA for 6eed9b2

• rename files for version 2

  valiantljk

  committed
  1e106e7

  Copy full SHA for 1e106e7

• clean scripts

  valiantljk

  committed
  045c675

  Copy full SHA for 045c675

• update test scripts

  valiantljk

  committed
  1795a93

  Copy full SHA for 1795a93

• update random pmf script

  valiantljk

  committed
  2992060

  Copy full SHA for 2992060

Commits on Oct 14, 2016

• h5boss clean codes version 0.1

  valiantljk

  committed
  79e50c8

  Copy full SHA for 79e50c8

• update clean version 0.1

  valiantljk

  committed
  b414ac3

  Copy full SHA for b414ac3

• update

  valiantljk

  committed
  45aec5d

  Copy full SHA for 45aec5d

• update

  valiantljk

  committed
  f9a2ef2

  Copy full SHA for f9a2ef2

• Update README.md

  valiantljk

  authored
  708aade

  Copy full SHA for 708aade

• Update README.md

  valiantljk

  authored
  bd503a0

  Copy full SHA for bd503a0

• update

  valiantljk

  committed
  069169a

  Copy full SHA for 069169a

• update

  valiantljk

  committed
  6d5cf9a

  Copy full SHA for 6d5cf9a

• update

  valiantljk

  committed
  b0bc3eb

  Copy full SHA for b0bc3eb

• add setup.py

  valiantljk

  committed
  0e51fa0

  Copy full SHA for 0e51fa0

• update docs for parallel subset

  valiantljk

  committed
  a8eafe8

  Copy full SHA for a8eafe8

• update

  valiantljk

  committed
  c964de8

  Copy full SHA for c964de8

• update table contents on the page

  valiantljk

  committed
  9aaf5d5

  Copy full SHA for 9aaf5d5

Commits on Oct 23, 2016

• update converter

  valiantljk

  committed
  fc99d09

  Copy full SHA for fc99d09

• update h5boss doc

  valiantljk

  committed
  2c14611

  Copy full SHA for 2c14611

• fix boss2hdf5

  valiantljk

  committed
  40396f0

  Copy full SHA for 40396f0

Commits on Oct 24, 2016

• update select

  valiantljk

  committed
  057a16f

  Copy full SHA for 057a16f

• update select

  valiantljk

  committed
  d27182f

  Copy full SHA for d27182f

• reverse subset

  valiantljk

  committed
  98be44f

  Copy full SHA for 98be44f

• update subset output

  valiantljk

  committed
  33c6730

  Copy full SHA for 33c6730

• change select output timing

  valiantljk

  committed
  66b5786

  Copy full SHA for 66b5786

• update page of subset

  valiantljk

  committed
  4820b45

  Copy full SHA for 4820b45

• fix sql

  valiantljk

  committed
  c4a88ed

  Copy full SHA for c4a88ed

• fix sql

  valiantljk

  committed
  d51d8fc

  Copy full SHA for d51d8fc

• fix sql

  valiantljk

  committed
  f41363f

  Copy full SHA for f41363f

• fix sql

  valiantljk

  committed
  7b46de8

  Copy full SHA for 7b46de8

• fix sql

  valiantljk

  committed
  3adca57

  Copy full SHA for 3adca57

• fix sql

  valiantljk

  committed
  ff6dd82

  Copy full SHA for ff6dd82

• fix sql

  valiantljk

  committed
  fe7c73f

  Copy full SHA for fe7c73f

• fix sql

  valiantljk

  committed
  70d6a49

  Copy full SHA for 70d6a49

• fix sql

  valiantljk

  committed
  2f18885

  Copy full SHA for 2f18885

• fix sql

  valiantljk

  committed
  a9102c3

  Copy full SHA for a9102c3

• fix sql

  valiantljk

  committed
  a7d95f5

  Copy full SHA for a7d95f5

• fix sql

  valiantljk

  committed
  fd4f79d

  Copy full SHA for fd4f79d

• fix sql

  valiantljk

  committed
  dfb4b27

  Copy full SHA for dfb4b27

• fix sql

  valiantljk

  committed
  90f7f87

  Copy full SHA for 90f7f87

• fix sql

  valiantljk

  committed
  16d1135

  Copy full SHA for 16d1135

• fix sql

  valiantljk

  committed
  14c508b

  Copy full SHA for 14c508b

• fix sql

  valiantljk

  committed
  49f76e3

  Copy full SHA for 49f76e3

• fix sql

  valiantljk

  committed
  4654068

  Copy full SHA for 4654068

• fix sql

  valiantljk

  committed
  44c4236

  Copy full SHA for 44c4236

• add base file or function(add) demo

  valiantljk

  committed
  b64274a

  Copy full SHA for b64274a

• add base.h5

  valiantljk

  committed
  2d9e4bc

  Copy full SHA for 2d9e4bc

• update select and sql

  valiantljk

  committed
  9465105

  Copy full SHA for 9465105

• select_update fix

  valiantljk

  committed
  583d427

  Copy full SHA for 583d427

• fix update

  valiantljk

  committed
  f9b9a8f

  Copy full SHA for f9b9a8f

• fix update

  valiantljk

  committed
  dde7816

  Copy full SHA for dde7816

• update remove

  valiantljk

  committed
  5a2769e

  Copy full SHA for 5a2769e

• update remove.py

  valiantljk

  committed
  c94418d

  Copy full SHA for c94418d

• update timing report

  valiantljk

  committed
  c6d2fea

  Copy full SHA for c6d2fea

• update timing of repack

  valiantljk

  committed
  f43e9d6

  Copy full SHA for f43e9d6

• repack option

  valiantljk

  committed
  55f7da9

  Copy full SHA for 55f7da9

• error handling

  valiantljk

  committed
  b839e8d

  Copy full SHA for b839e8d

• clean codes in select.py

  valiantljk

  committed
  2d70890

  Copy full SHA for 2d70890

• timer report

  valiantljk

  committed
  5befd4a

  Copy full SHA for 5befd4a

• updating docs

  valiantljk

  committed
  09a504b

  Copy full SHA for 09a504b

• bug fixed in select_update.py

  valiantljk

  committed
  5e48475

  Copy full SHA for 5e48475

• update add/subset/update docs

  valiantljk

  committed
  c804108

  Copy full SHA for c804108

Commits on Oct 25, 2016

• fix convertion code

  valiantljk

  committed
  b45ab80

  Copy full SHA for b45ab80

• boss2hdf5

  valiantljk

  committed
  b876a22

  Copy full SHA for b876a22

• boss2hdf5

  valiantljk

  committed
  0dc1346

  Copy full SHA for 0dc1346

• fix bugs in two converters

  valiantljk

  committed
  84e74b5

  Copy full SHA for 84e74b5

• select.py

  valiantljk

  committed
  0a45939

  Copy full SHA for 0a45939

• update doc for select

  valiantljk

  committed
  d9d4173

  Copy full SHA for d9d4173

• update sample file

  valiantljk

  committed
  324275a

  Copy full SHA for 324275a

• doc for update

  valiantljk

  committed
  ed64567

  Copy full SHA for ed64567

• typo in update.rst

  valiantljk

  committed
  6b6a429

  Copy full SHA for 6b6a429

Commits on Oct 27, 2016

• update fits2hdf5

  valiantljk

  committed
  c962f4b

  Copy full SHA for c962f4b

• update fits2hdf

  valiantljk

  committed
  b6be763

  Copy full SHA for b6be763

• update fits2hdf

  valiantljk

  committed
  b7fb347

  Copy full SHA for b7fb347

• update fits2hdf image

  valiantljk

  committed
  c6dc976

  Copy full SHA for c6dc976

Commits on Oct 29, 2016

• update fits2hdf

  valiantljk

  committed
  7c3b5ad

  Copy full SHA for 7c3b5ad

Commits on Nov 3, 2016

• example code for reading from fits versus from hdf5

  valiantljk

  committed
  1791541

  Copy full SHA for 1791541

Commits on Nov 7, 2016

• h5boss missing features

  valiantljk

  committed
  38347c0

  Copy full SHA for 38347c0

• update missing features

  valiantljk

  committed
  287f6e4

  Copy full SHA for 287f6e4

• h5boss missing features

  valiantljk

  committed
  a673844

  Copy full SHA for a673844

Commits on Nov 17, 2016

• update fits2hdf5

  valiantljk

  committed
  2a51d49

  Copy full SHA for 2a51d49

Commits on Dec 5, 2016

• update examples for reading multiple HDUs

  valiantljk

  committed
  0019e0b

  Copy full SHA for 0019e0b

Commits on Dec 12, 2016

• typo in h5boss.add function

  valiantljk

  committed
  b7da5c8

  Copy full SHA for b7da5c8

Commits on Apr 23, 2017

• Update README.md

  valiantljk

  authored
  584f5be

  Copy full SHA for 584f5be

Commits on Jul 27, 2017

• Update README.md

  valiantljk

  authored
  9dc49a6

  Copy full SHA for 9dc49a6

• Update README.md

  valiantljk

  authored
  998e928

  Copy full SHA for 998e928