Skip to content

Orm yaml #170

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
tim-band wants to merge 85 commits into
base: main
Choose a base branch
from
Open

Orm yaml #170

tim-band wants to merge 85 commits into from

Conversation

@tim-band
Copy link
Collaborator

@tim-band tim-band commented May 20, 2025

Helps governance by separating private from public processes and making all files coming out of the private network (somewhat human-readable) YAML,
Makes writing config.yaml much easier to write with configure-tables, -generators and -missingness.

Tim Band added 30 commits November 27, 2024 18:27
Initial proof of concept of orm.yaml
e89ed26
primary, nullable and unique added to orm.yaml
5543f44
Foreign keys in orm.yaml
5978809
ssg.py code generation fixed
4c7d2e3
Creating data now works for Paglia!
a137cae 
...with a small config file
Primary key increment, unique constraint support
709eb07
New unique constraint handling.
ec6c749 
Added WITHOUT TIME ZONE.
Removed sqlacodegen dependency.
Vocab table generation moved into new command make-vocab
9421fba
Using Typer more conventially now
9ea0c1e
Vocabulary tables can now be created even with circular dependencies.
2b1a9ab
Fixed some issues
4e878cc
Copy with config.yaml tables properties being empty.
a47c1ee
Sort tables ourselves so we don't warn about vocab table loops
a457c62
added --compress to make-vocab
92828c5
make-vocab progress reporting
2f59627
remove-vocab and remove-data doesn't use ssg.py. Progress for create-…
ff7e3e0 
…vocab.
Initial attempt for generic column generator analysis
405409c
fit fix and tidy up
dc180eb
small fixes
2654db8
"obvious" generators
ef3e690
Incomplete summary data fails all distrubtions that depend on it.
128befc
distrubution buckets should not include NULL
5f17371
protect against standard deviation being NaN
08ef715
Fixed dynamic module loading
cdf0480
Fixed make-generators without src-stats.yaml
ab571bf
Initial missingness implementation
4e038b4 
including union column sets
and template changes
cbd6e05
primary keys now start after all existing keys
20b59fb
Fixed ssg template choice stuff
0883fa8
Generating config.yaml and making it mandatory as input
1e3ca32
Tim Band added 30 commits April 16, 2025 18:39
configure-generators writes out existing queries to config.yaml
39a7a7f
select aggregate clauses merge
2f6ef58
alan-turing-institute#12 tab completion for configure_generators' next
b5a051f
alan-turing-institute#2 configure-generators' compare command reports…
8d5eded 
… the privacy of the table it is configuring
testing that configure-generators does not damage other configuration
fbdea22
Updated dependencies to work with Python 3.13
ab02542
Cope with nulls in config.yaml
6ed417d
More robustness against null table configuration
88fb03d
Dockerfile
54652c5
make-tables should not take config.yaml by default
695f17e
initial configure-missing implementation
2ab8074
initial missingness_generators implementation
c2c308f
First test for configure-missing
da0e165
removed some cruft
0b8b3de
end-to-end missingness test
8ce26a0
interactive commands ask to save even when no changes have been made
89b2c18
Much better information on columns in configure-tables and configure-…
7f3ed81 
…generators
configure-generators propose on all-null column no longer fails
97d3e34
EMPTY (num_passes: 0) table type in interactive commands
2ec6192
datetime generator creation fixed
24eeb1b
NULL generator
8e43d43
alan-turing-institute#20 configure-generators unset command
7c08c55
alan-turing-institute#21 configure-generators: better text for propos…
5aa3faa 
…e if no source data
Some fixes
4533b4c
alan-turing-institute#25 interactive peek, select and count
241e141 
test fixes
make-vocab gets --only
ea3df37
removed generate-configuration
49a1eb2
change make-generators to create-generators
4274b53
Various fixes
8f46dea
Updated quick start guide
08b4896
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@tim-band