Json to Avro converter supports capturing failures

[johnny-schmidt]

Summary

This is to provide support for capturing field-level conversion failures when converting from json to avro. It adds a FieldConversionFailureListener option to the record reader, which provides a hook for replacing the field value and adding metadata to the record when a failure occurs.

Most of the changes here are to support that. Additionally I had to thread the original field name through the reader so that it could be added to the metadata if needed. (Sometimes the field name is edited to make it avro compatible.)

Additionally I had to update the dependencies, as one of the underlying artifacts vanished.

Checklist

• Write unit tests
• Make sure there is no logging in the Json / Avro conversion code
• Update documentation in README.md

[johnny-schmidt]

• Json to Avro converter supports capturing failures #23 👈
• master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @johnny-schmidt and the rest of your teammates on Graphite

[gisripa]

lgtm.

I had to read the test to figure pushPostProcessingAction needs to be called for a sample Listener impl.

[johnny-schmidt]

lgtm.

I had to read the test to figure pushPostProcessingAction needs to be called for a sample Listener impl.

I updated the readme.

A listener can be set to react to conversion failures at the field level. It will be called with metadata about the field and failure, and it may do any of the following:

* return a replacement value for the field
* call `pushPostProcessingAction` to register a function to apply to the record (eg, to add metadata about the failure)
* (re)throw an exception if the failure is unrecoverable