NVIDIA Neural Modules 1.0.0b1

Release 1.0.0b1

This release is a major re-design compared to previous version.
All NeMo models and modules are now compatible out-of-the box with Pytorch and Pytorch Lightning.
Every NeMo model is a LightningModule that comes equipped with all supporting infrastructure for training and reproducibility. Every NeMo model has an example configuration file and a corresponding script that contains all configurations needed for training. NeMo, Pytorch Lightning, and Hydra makes all NeMo models have the same look and feel so that it is easy to do Conversational AI research across multiple domains. New models such as Speaker verification and Megatron are added.

Highlights

• Pytorch Lightning based Core
• Hydra and Omegaconf configuration management
• All model's files tarred together as .nemo files make it easy for users to download models automatically from NGC
• NGC collections now includes a collection of all NeMo assets in one
• New Models & tutorials
  • ASR: SpeakerNet speaker verification model
  • NLP: Bio Megatron state of the art model trained on bio medical tasks
• ASR, NLP and TTS tutorials as interactive notebooks

Known Issues

Toolkit in an early version software. Breaking changes compared to previous version.

Resolved Issues

All models and modules can be used anywhere torch.nn.Module is expected.