Skip to content

Commit 04f1df6

Browse files
authored
# Lakebridge v0.11.0 Release Notes (#2138)
## 🎉 New Features This release introduces **two exciting new capabilities** to Lakebridge: ### Synapse Profiler A powerful new Synapse Profiler feature is now available to help you analyze and profile your Synapse data. Refer to the documentation for usage details and examples. ### Switch LLM Converter Introducing the new Switch LLM converter, expanding Lakebridge's conversion capabilities. Refer to the documentation for usage details and examples. --- ## Other updates ## Converters ### General **Conversion Output Fix** Fixed a bug where files nested 2 or more directories deep within the input directory could fail to be written out after conversion when the directory structure wasn't already in place. ### Morpheus **Code Formatting Improvements** Refactored code formatting logic by introducing a tree-like structure in `CodeBlock` and a new `CodeBlockRenderer` to handle whitespace, comments, and error positioning, making the formatting system more maintainable and accurate. #### TSQL Added support for translating TSQL join hints (like `REPLICATE` and `MERGE`) to their Databricks SQL equivalents by transforming them into special `/*+ ... */` comments after the `SELECT` keyword, while unsupported hints are flagged as annotated errors. ### BladeBridge #### SQL Server - Fixed SELECT INTO real table syntax, corrected LIKE pattern handling, and mapped unsupported FUNC_ROW_NUMBER function while removing ANON_NOLOCK. - Resolved an issue where CASE WHEN expressions as the last statement in a file generated incorrect semicolon placement in SQL scripts. - Added fragment breaker before GO keyword and removed unsupported COMMIT TRANSACTION and CREATE INDEX constraints. - Fixed T-SQL UPDATE statements that were not correctly converted to MERGE operations in specific cases. - Corrected fragment handling around SELECT and UNION statements, and fixed issues with IF condition blocks and error handling blocks being mixed up. - Removed SET IDENTITY_INSERT and BEGIN/COMMIT TRANSACTION statements, and changed INT GENERATED ALWAYS AS IDENTITY to BIGINT GENERATED ALWAYS AS IDENTITY. - Added validation check for converted MERGE statements, implemented global variable reset in init_hook subroutine, and performed code refactoring. - Fixed T-SQL DELETE statements that were not correctly converted to MERGE operations and added corresponding test cases. ## Reconcile ### Oracle Improved Oracle support with the following enhancements: - Fixed Oracle JDBC URL by moving credentials out of URL into options and correcting thin syntax - Updated hashing/expression pipeline to replace `RAWTOHEX(...), 2` with `UTL_I18N.STRING_TO_RAW(...,'AL32UTF8'), 4` (SHA-256) - Fixed schema comparison for Oracle - Tweaked datatype parsing in default transformations for Oracle compatibility - Added Oracle jars in setup script - Extended integration scaffolding and added end-to-end tests ### Snowflake - Fixed schema comparison for Snowflake - Adjusted log levels by demoting noisy warnings to debug/info - Added Snowflake jars in setup script - Extended integration scaffolding ## Documentation Added documentation for deploying reconciliation dashboards and updated documentation notebooks. Dependency updates: * Bump actions/setup-node from 5 to 6 by @dependabot[bot] in #2094 ## New Contributors * @hiroyukinakazato-db made their first contribution in #2066 **Full Changelog**: v0.10.13...v0.11.0
1 parent 99b6786 commit 04f1df6

File tree

2 files changed

+68
-1
lines changed

2 files changed

+68
-1
lines changed

CHANGELOG.md

Lines changed: 67 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,72 @@
11
# Version changelog
22

3+
## # Lakebridge v0.11.0 Release Notes
4+
5+
## 🎉 New Features
6+
7+
This release introduces **two exciting new capabilities** to Lakebridge:
8+
9+
### Synapse Profiler
10+
A powerful new Synapse Profiler feature is now available to help you analyze and profile your Synapse data. Refer to the documentation for usage details and examples.
11+
12+
### Switch LLM Converter
13+
Introducing the new Switch LLM converter, expanding Lakebridge's conversion capabilities. Refer to the documentation for usage details and examples.
14+
15+
---
16+
## Other updates
17+
## Converters
18+
19+
### General
20+
21+
**Conversion Output Fix**
22+
Fixed a bug where files nested 2 or more directories deep within the input directory could fail to be written out after conversion when the directory structure wasn't already in place.
23+
24+
### Morpheus
25+
**Code Formatting Improvements**
26+
Refactored code formatting logic by introducing a tree-like structure in `CodeBlock` and a new `CodeBlockRenderer` to handle whitespace, comments, and error positioning, making the formatting system more maintainable and accurate.
27+
#### TSQL
28+
Added support for translating TSQL join hints (like `REPLICATE` and `MERGE`) to their Databricks SQL equivalents by transforming them into special `/*+ ... */` comments after the `SELECT` keyword, while unsupported hints are flagged as annotated errors.
29+
30+
### BladeBridge
31+
32+
#### SQL Server
33+
- Fixed SELECT INTO real table syntax, corrected LIKE pattern handling, and mapped unsupported FUNC_ROW_NUMBER function while removing ANON_NOLOCK.
34+
- Resolved an issue where CASE WHEN expressions as the last statement in a file generated incorrect semicolon placement in SQL scripts.
35+
- Added fragment breaker before GO keyword and removed unsupported COMMIT TRANSACTION and CREATE INDEX constraints.
36+
- Fixed T-SQL UPDATE statements that were not correctly converted to MERGE operations in specific cases.
37+
- Corrected fragment handling around SELECT and UNION statements, and fixed issues with IF condition blocks and error handling blocks being mixed up.
38+
- Removed SET IDENTITY_INSERT and BEGIN/COMMIT TRANSACTION statements, and changed INT GENERATED ALWAYS AS IDENTITY to BIGINT GENERATED ALWAYS AS IDENTITY.
39+
- Added validation check for converted MERGE statements, implemented global variable reset in init_hook subroutine, and performed code refactoring.
40+
- Fixed T-SQL DELETE statements that were not correctly converted to MERGE operations and added corresponding test cases.
41+
42+
## Reconcile
43+
44+
### Oracle
45+
Improved Oracle support with the following enhancements:
46+
- Fixed Oracle JDBC URL by moving credentials out of URL into options and correcting thin syntax
47+
- Updated hashing/expression pipeline to replace `RAWTOHEX(...), 2` with `UTL_I18N.STRING_TO_RAW(...,'AL32UTF8'), 4` (SHA-256)
48+
- Fixed schema comparison for Oracle
49+
- Tweaked datatype parsing in default transformations for Oracle compatibility
50+
- Added Oracle jars in setup script
51+
- Extended integration scaffolding and added end-to-end tests
52+
53+
### Snowflake
54+
- Fixed schema comparison for Snowflake
55+
- Adjusted log levels by demoting noisy warnings to debug/info
56+
- Added Snowflake jars in setup script
57+
- Extended integration scaffolding
58+
59+
## Documentation
60+
61+
Added documentation for deploying reconciliation dashboards and updated documentation notebooks.
62+
63+
Dependency updates:
64+
* Bump actions/setup-node from 5 to 6 by @dependabot[bot] in https://github.com/databrickslabs/lakebridge/pull/2094
65+
66+
## New Contributors
67+
* @hiroyukinakazato-db made their first contribution in https://github.com/databrickslabs/lakebridge/pull/2066
68+
69+
**Full Changelog**: https://github.com/databrickslabs/lakebridge/compare/v0.10.13...v0.11.0
370
## 0.10.13
471

572
## Analyzer
Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,2 @@
11
# DO NOT MODIFY THIS FILE
2-
__version__ = "0.10.13"
2+
__version__ = "0.11.0"

0 commit comments

Comments
 (0)