Skip to content

Release 3.3.1

Compare
Choose a tag to compare
@Aryex Aryex released this 26 Jul 20:57
· 46 commits to main since this release
300dbad

Overview

This patch release added support for Spark 3.3.0, allowing the query option to be used with dbschema, as well as other fixes.

Support Spark 3.3.0

The connector is now compatible with Spark 3.3.0 while maintaining backward compatibility with previous Spark 3.x

Make a query with dbschema option

With the option query and dbschema defined, the schema specified in dbschema will be appended to the table name of the query's FROM clause. This will also work when the dbschema is a string literals.

However, dbschema will not be appended if:

  1. The FROM clause is a query.
  2. The FROM clause already has a schema defined.

Bug fixes

  • Fixes #443. The connector should now be able to handle empty element names.
  • Fixes #463. Reading an empty table using Json format should no longer throw an exception.