Added code coverage report for github workflow#18
Closed
xShinnRyuu wants to merge 8 commits into
Closed
Conversation
* Added a stream writer which will write streamed data from neoj4 database to temp csv file, which then gets converted into neptune accepted formats
…label with YAML config (Bit-Quill#6) * implement an optional `--conversion-config` that takes in a YAML file with label mapping and record skipping configurations, which will update node/edge labels accordingly and skip elements specified by IDs/labels.
* Added in an automated way to process gremlin formatted CSV with Neptune bulk loader
* Added in business logic to validate if bulk load options are present before proceeding, added BulkLoadConfig parameter option, removed redundant flag parameters * Refactored how the parameters for bulk loading were passed in, updated parameter validations to be more localized and robust, added in unit testing for the BulkLoadConfig class * Implemented id transformation for both vertex and edge during conversion * Updated relevant documentations for the ID transformation logic * Added in usage of S3TransferManager to support file uploads larger than 5GB to S3. Also added support for compressed files in the .gz format.
Added in logic to compress Neo4j exported files during the convert & bulk load process. This logic will due the compress into gzip as part of the s3 upload. Updated relevant unit tests.
Welcome to Codecov 🎉Once you merge this PR into your default branch, you're all set! Codecov will compare coverage reports and display results in all future pull requests. Thanks for integrating Codecov - We've got you covered ☂️ |
xiazcy
force-pushed
the
neo4j-to-neptune-update
branch
from
11f614e to
32528a9
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Issue #, if available:
Description of changes:
Adding in code coverage report for github workflow
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.