Fixing all lint errors#233
Conversation
|
Thanks for opening a pull request! If this is not a minor PR. Could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project. Then could you also rename the pull request title in the following format? or See also: |
argmarco-tkd
left a comment
There was a problem hiding this comment.
Thank you for this! - this was massive (not a criticism!!). LGTM - it seemed mainly like a re-formatting PR, let me know if there is anything in particular that may need closer attention.
Now, future looking question: what could/should we have done before so that we didn't get to this point (where we had to put in massive effort to correct formatting)?
| catch (...) { | ||
| ARROW_LOG(ERROR) << "[DBPAExecutor] UNKNOWN EXCEPTION: " << operation_name << " failed with unknown exception"; | ||
| throw; // Re-throw original exception | ||
| } catch (const std::exception& e) { |
There was a problem hiding this comment.
ew. but whatever it takes to make the linter happy :D
There was a problem hiding this comment.
This one I do actually prefer :)
| {"port", "5432"}, | ||
| {"database", "testdb"} | ||
| }; | ||
| {"host", "localhost"}, {"port", "5432"}, {"database", "testdb"}}; |
There was a problem hiding this comment.
sigh. not as legible as the original. oh, well.
| int64_t init_timeout_ms = 10*1000; //10 seconds | ||
| int64_t encrypt_timeout_ms = 30*1000; //30 seconds | ||
| int64_t decrypt_timeout_ms = 30*1000; //30 seconds. | ||
| int64_t init_timeout_ms = 10 * 1000; // 10 seconds |
There was a problem hiding this comment.
There were many, many uggs when I was doing this.
There was a problem hiding this comment.
My internal linter likes this actually :)
Thanks for the review! Going forward, every PR should make sure the linter action is clean before merging :) |
avalerio-tkd
left a comment
There was a problem hiding this comment.
LGTM+
Thanks for all the changes @sofia-tekdatum ! Nothing major on the comments, except for one. If that's the only change, it's ok to leave as-is.
| {parquet::Type::DOUBLE, dbps::external::Type::DOUBLE}, | ||
| {parquet::Type::BYTE_ARRAY, dbps::external::Type::BYTE_ARRAY}, | ||
| {parquet::Type::FIXED_LEN_BYTE_ARRAY, dbps::external::Type::FIXED_LEN_BYTE_ARRAY}, | ||
| {parquet::Type::UNDEFINED, dbps::external::Type::UNDEFINED}}; |
There was a problem hiding this comment.
Probably a note for the future, but this one is likely to fail when we integrate the new dbps::external::Type without UNDEFINED.
Kind of a mental note, not related to this PR
There was a problem hiding this comment.
@avalerio-tkd - I noticed this as well. We will deal with this once we bring the latest version of DBPA interface to Arrow. Not a biggie, and definitely not a blocker for this PR.
| parquet_to_external_type_map; | ||
| static const std::unordered_map<::arrow::Compression::type, | ||
| dbps::external::CompressionCodec::type> | ||
| arrow_to_external_compression_map; |
There was a problem hiding this comment.
ufff.. :( If this passes the linter, then fine.
| * @param encrypt_timeout Timeout for encrypt operations in milliseconds | ||
| * (default: 30000) | ||
| * @param decrypt_timeout Timeout for decrypt operations in milliseconds | ||
| * (default: 30000) |
There was a problem hiding this comment.
Nit: Align as the previous line for consistency. If this is the only change, then it's ok to leave as-is.
There was a problem hiding this comment.
I am choosing to leave this as the linter is currently happy and I'll prioritize that.
| std::string app_context, std::string column_key_id, Type::type data_type, | ||
| std::optional<int> datatype_length, CompressionCodec::type compression_type, | ||
| std::optional<std::map<std::string, std::string>> column_encryption_metadata) | ||
| override { |
There was a problem hiding this comment.
My internal linter doesn't like this, but leave it as-is if this passes the Arrow linter. :(
| int64_t init_timeout_ms = 10*1000; //10 seconds | ||
| int64_t encrypt_timeout_ms = 30*1000; //30 seconds | ||
| int64_t decrypt_timeout_ms = 30*1000; //30 seconds. | ||
| int64_t init_timeout_ms = 10 * 1000; // 10 seconds |
There was a problem hiding this comment.
My internal linter likes this actually :)
| std::move(meta_decryptor_factory), | ||
| std::move(data_decryptor_factory)}; | ||
| CryptoContext ctx{ | ||
| col->has_dictionary_page(), static_cast<int16_t>(row_group_ordinal_), |
Fix all lint errors reported in github actions. See [this run] for the original errors. (https://github.com/protegrity/arrow/actions/runs/20860646944/job/59939104419).
Clean run (with a straggling R lint error which is not ours) is here.