Code

Split behaviour#86

Code

Merged

mathysgrapotte merged 36 commits intomathysgrapotte:devmathysgrapotte/stimulus-py:devfrom JulienRaynal:split_behaviourJulienRaynal/stimulus-py:split_behaviourCopy head branch name to clipboardFeb 19, 2025

+966-265

Commits

Commits on Feb 12, 2025

• FIX: utils/yaml_data.py:generate_data_configs -> generates only a config per split and not all the config possible between splits and transforms

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  049c937

  Copy full SHA for 049c937

• FIX: utils/yaml_data.py:generate_data_configs -> changed transform to the right variable transforms

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  7e9ad63

  Copy full SHA for 7e9ad63

• FIX: utils/yaml_data.py:YamlSubConfigDict -> transforms is now a list of YamlTransform

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  3be595c

  Copy full SHA for 3be595c

• FIX: utils/yaml_data.py:generate_data_configs -> updated docstring

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  acda764

  Copy full SHA for acda764

• FIX: utils/yaml_data.py -> Removed 'Yaml'

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  5ab7ca0

  Copy full SHA for 5ab7ca0

• FIX: utils/yaml_data.py -> Put 'Yaml' back to modify that in another branch

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  b213b2f

  Copy full SHA for b213b2f

• FIX: tests/cli/__snapshots__/test_split_yaml.ambr -> updated the snapshot for the unique generated file

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  beac235

  Copy full SHA for beac235

Commits on Feb 14, 2025

• NEW: cli/split_split.py -> New file to split the config only on the splits, gives one file per split

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  cf0f234

  Copy full SHA for cf0f234

• NEW: cli/split_transforms.py -> New file to split the config for each transform, gives one file per transform

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  cfdbee6

  Copy full SHA for cfdbee6

• REMOVE: cli/split_yaml -> deleted the old splitter file because two new ones exist now

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  7221371

  Copy full SHA for 7221371

• UPDATE: utils/yaml_data.py -> new functions for the transform splitter

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  b8251d3

  Copy full SHA for b8251d3

• FIX: data/data_handlers.py -> YamlSubConfigDict takes a transform or a list of transforms because the titanic test uses a unique value and the dna uses a list

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  a34754e

  Copy full SHA for a34754e

Commits on Feb 17, 2025

• NEW: src/stimulus/cli/split_split.py -> A file that splits all the splits in a yaml config in x files holding unique splits

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  6437bd2

  Copy full SHA for 6437bd2

• NEW: src/stimulus/cli/split_transforms.py -> Cli function to split unique yaml config with splits and multiple transforms in configs with one unique split and one unique transform

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  ac1d70c

  Copy full SHA for ac1d70c

• NEW: tests/test_data/titanic/titanic_unique_split.yaml -> A config file with a unique split and multiple Transforms

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  359b86e

  Copy full SHA for 359b86e

• DELETE: tests/cli/__snapshots__/test_split_yaml.ambr -> Removed this file because now the the config are first separated per unique split and then per unique transforms

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  4aca687

  Copy full SHA for 4aca687

• {src/stimulus,tests}/cli/check_model.py -> Input is now a yaml with one split and one transform and changed the test file is just formatting

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  887d9f1

  Copy full SHA for 887d9f1

• FIX: src/stimulus/cli/split_csv.py -> Updated to take a YamlSplitConfigDict

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  ff0881c

  Copy full SHA for ff0881c

• FIX: tests/cli/test_shuffle_csv.py -> changed the test file to be the one with only a unique split and multiple transforms

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  96b3b5b

  Copy full SHA for 96b3b5b

Commits on Feb 18, 2025

• FIX: {src/stimulus, tests}/data/data_handlers.py -> Changed the input to not be a file but a YamlSplitTransformDict object

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  f4edfab

  Copy full SHA for f4edfab

• FIX: check_model.py -> takes a yaml and then passes on only YamlSplitTransformDict and not the yaml path anymore

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  1dd858c

  Copy full SHA for 1dd858c

• FIX: tests/data/test_data_handlers.py -> changed the call from 'config_path' to 'data_config' for the DatasetLoader

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  f4ad7ab

  Copy full SHA for f4ad7ab

• FIX: tests/data/transform/test_data_transformers.py -> changed 'generate_data_configs' to 'generate_split_transform_configs' as the awaited output is the sub config file

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  131388d

  Copy full SHA for 131388d

• FIX: tests/utils/test_data_yaml.py -> added tests for the new generate_split and generate_split_transform function + fixed old tests

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  2c110ad

  Copy full SHA for 2c110ad

• FIX: tests/data/test_experiment.py -> Fixed tests to work with the new generate_split_config and generate_split_transform_config functions

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  1b4339b

  Copy full SHA for 1b4339b

• FIX: tests/data/test_handlertorch.py -> changed test to use the YamlSplitTransformDict directly instead of yaml files as argument for the class:

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  19d8d16

  Copy full SHA for 19d8d16

• ADD: src/stimulus/utils/yaml_data.py -> Added a class SplitConfigDict

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  5ef82ff

  Copy full SHA for 5ef82ff

• FIX: tests/cli/test_shuffle_csv.py -> Uses a YamlSplitTransformDict now

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  cda0a6e

  Copy full SHA for cda0a6e

• {src/stimulus,tests}/typing/{__init__.py, test_typing.py} -> Added the two new class YamlSplitConfigDict and YamlSplitTransformDict

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  ac672f0

  Copy full SHA for ac672f0

• FIX: src/stimulus/cli/transform_csv.py -> When the file is called it creates a YamlSplitConfigDict from the path given as argument

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  4fa3abd

  Copy full SHA for 4fa3abd

• FIX: tests/learner/test_raytune_learner -> Uses a YamlSplitTransformDict now

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  d03ac07

  Copy full SHA for d03ac07

• FIX: {src/stimulus,tests}/cli/tuning.py -> the main function now takes directly YamlSplitTransformDict, the tests have been fixed to work with this

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  3c31d67

  Copy full SHA for 3c31d67

• DELETED: tests/cli/test_split_yaml.py -> Deleted it has it has been replaced with two new files for splitting in YamlSplitConfigDict and YamlSplitTransformDict

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  cb7d55f

  Copy full SHA for cb7d55f

• FIX: src/stimulus/loaders.py -> initialize_splitter_from_config uses a YamlSplitConfigDict as input now

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  10092ee

  Copy full SHA for 10092ee

• Merge branch 'dev' into split_behaviour

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  eaaf40c

  Copy full SHA for eaaf40c

• FIX: src/stimulus/data/{data_handlers.py,handlertorch.py} -> Change the docstring to match the right parameters

  

  Julien Raynal

  authored and

  Julien Raynal

  committed
  0012c72

  Copy full SHA for 0012c72