Skip to content

v0.4.0

Latest
Compare
Choose a tag to compare
@percevalw percevalw released this 17 Jun 10:56
· 10 commits to main since this release
  • Added eds_pseudo.dates_normalizer to parse ML detected dates and extract their value and format.
  • Support empty doc._.context field
  • Update EDS-NLP to v0.10.7:
    • fix somes issues with jsonl loading
    • more transformer overriding options
    • fix out-of-memory issues (auto split transformer input depending on the available memory)
    • fixes some multiprocessing deadlock issues
    • add chunk sorting option to the lazy collection set_processing method
  • Replace gen_dataset/train.jsonl with the original fictitious templates and the dataset generation script.
  • Update the README with the instructions to download the public pre-trained model.
  • Improve packaging to add evaluation results to the model's meta field and packaged model README (for HF)