Skip to content

0.2.0a8

Pre-release
Pre-release
Compare
Choose a tag to compare
@rudolfix rudolfix released this 04 Dec 21:55
· 2940 commits to devel since this release
0.2.0a8
cfcc6a6
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's Changed

  • deletes all pipeline state (schemas, state, intermediate files) if destination dataset is dropped
  • synchronizes state with the destination in the run method
  • you can opt out from state sync with restore_from_destination=false in ie. config.toml
  • loads all schemas/source into single dataset by default. this will simplify experience for less advanced users. you can switch back to the old behavior (each source/schema has separate dataset) with use_single_dataset=false config option
  • enables CTRL-C when running user code
  • commits all files extracted from several sources after all user code ran
Assets 2
Loading