Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HIVE-27102: Upgrade Calcite to 1.33.0 and Avatica to 1.23.0 #5196

Open
wants to merge 93 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
93 commits
Select commit Hold shift + click to select a range
8647e0f
Bump Calcite version to 1.32.0
zabetak Oct 3, 2022
873ec93
Resolve compilation failure in hive-exec due to missing Value annotation
zabetak Oct 6, 2022
107ea0d
Compilation fails in JdbcHiveTableScan due to breaking changes in sup…
zabetak Oct 6, 2022
3d009d5
Compilation error in HiveFilterJoinRule due to RelRule.Config.EMPTY
zabetak Oct 6, 2022
0dbbb14
Revert "Compilation error in HiveFilterJoinRule due to RelRule.Config…
zabetak Oct 6, 2022
ef7fd7d
Compilation error in HiveFilterJoinRule due to RelRule.Config.EMPTY
zabetak Oct 6, 2022
6b8ca94
Compilation fails in JDBCExtractJoinFilterRule due to removed supercl…
zabetak Oct 6, 2022
109d0f4
Compilation fails in HiveDruidRules due to RelRule.Config.EMPTY
zabetak Oct 7, 2022
c31a952
Simplify HiveDruidRules by using the config from respective rules in …
zabetak Oct 7, 2022
dc00906
Compilation fails in HiveRelFactories due to ProjectFactory signature…
zabetak Oct 7, 2022
417b7fa
NoSuchFieldError: BACK_TICK_BACKSLASH when running TestMiniLlapLocalC…
zabetak Oct 7, 2022
8064bdd
Compilation fails in HiveRemoveEmptySingleRules due to RelRule.Config…
zabetak Oct 10, 2022
0ea9235
Compilation fails in HiveReduceExpressionsRule due to missing XxReduc…
zabetak Feb 16, 2023
2466c93
Bump Calcite version to 1.33.0 and Avatica to 1.23.0
zabetak Feb 20, 2023
c678661
Compilation fails in HiveProjectFactoryImpl due to new method added i…
zabetak Feb 21, 2023
7e5863e
StackOverflowError while running cbo_query13.q
zabetak Feb 23, 2023
7f5e940
ClassCastException in RelMdSize#typeValueSize when compiling cbo_quer…
zabetak Feb 23, 2023
bb99929
use RexSimplify in point look up rule
kasakrisz Apr 20, 2023
1c96942
Correlate related prune empty rules config
kasakrisz Apr 26, 2023
8daa3b1
Iceberg MV related rules config
kasakrisz Apr 26, 2023
169d5a0
Correlate related prune empty rules config
kasakrisz Apr 26, 2023
8ae7bd2
transform search in ASTConverter
kasakrisz May 4, 2023
cac2b6d
support cbo.returnpath
kasakrisz May 5, 2023
54412d6
Add EPL-2.0 license to hive-packaging
soumyakanti3578 Apr 16, 2024
1df72a8
Expand SEARCH in HiveFilterSortPredicates to compute cost
soumyakanti3578 Apr 18, 2024
f8ab61e
Extract RexInputRef in SEARCH Op when it is wrapped with a CAST
soumyakanti3578 Apr 18, 2024
97d000b
Fix error caused by use of deprecated API which was removed
soumyakanti3578 Apr 19, 2024
e6c76aa
Error due to IN Operator in RexCall
soumyakanti3578 Apr 19, 2024
98f182b
Changes for cbo_query.* with TestTezTPCDS30TBPerfCliDriver
soumyakanti3578 Apr 20, 2024
546a087
clean up searchOperandToAST method to handle different visitors
soumyakanti3578 Apr 22, 2024
e75f90d
ClassCastException because of trying to convert every operand to RexI…
soumyakanti3578 Apr 22, 2024
ebdc5fa
Add HivePointLookupOptimizerRules to simplify some RexNodes which are…
soumyakanti3578 May 3, 2024
5abedfb
Delete HiveSearchExpandRule.java
soumyakanti3578 May 3, 2024
464f914
Fix AST generation for literals with struct types
soumyakanti3578 May 4, 2024
6b0d74e
changes in cbo_query*.q.out
soumyakanti3578 May 4, 2024
2670271
Add jts-core to beeline to try to fix init-metastore test failures in…
soumyakanti3578 May 4, 2024
ea883bd
Fix error in null to complex type handling
soumyakanti3578 May 4, 2024
8b96e1b
Convert Sarg with bounded range to BETWEEN
soumyakanti3578 May 4, 2024
3a3613c
revert some changes to q.outs
soumyakanti3578 May 4, 2024
f5ac79e
Fix testFilterIsRemovedAndVersionIntervalFromIsSetWhenFilterHasSnapsh…
soumyakanti3578 May 2, 2024
7fcf9a9
Fix testFilterLeftIntactWhenItDoesNotHaveSnapshotIdPredicate
soumyakanti3578 May 2, 2024
7baf3d3
Fix TestMaterializedViewRebuild
soumyakanti3578 May 4, 2024
cfd5c88
Ensure bound types for lower and upper endpoints are CLOSED to check …
soumyakanti3578 May 5, 2024
c59a41f
Convert Sarg with multiple ranges to BETWEEN and NOT BETWEEN in the A…
soumyakanti3578 May 7, 2024
b59ceed
Support SEARCH operator in FilterSelectivityEstimator
soumyakanti3578 May 7, 2024
16c9618
benign changes
soumyakanti3578 May 7, 2024
86b8312
Use HivePointLookupOptimizerRule to convert SEARCH to BETWEEN and NOT…
soumyakanti3578 May 10, 2024
deb33bd
benign changes due to handling nulls in Sargs
soumyakanti3578 May 14, 2024
bcb4676
benign changes for TestTezTPCDS30TBPerfCliDriver
soumyakanti3578 May 16, 2024
13dcdce
Fix tests in TestHivePointLookupOptimizerRule
soumyakanti3578 May 16, 2024
5a8e6e4
Allow cast for CHARs and VARCHARs to avoid getting cast to STRING
soumyakanti3578 May 16, 2024
5f7e47b
benign changes to various qouts
soumyakanti3578 May 16, 2024
1d06e05
Implement visit(JdbcTableScan) which was removed in CALCITE-4640
soumyakanti3578 May 17, 2024
2f39101
Add external_jdbc_table2.q.out, although the change indicates that pr…
soumyakanti3578 May 17, 2024
3759e6b
Don't convert SEARCH to IN when pointCount is less than HIVE_POINT_LO…
soumyakanti3578 May 17, 2024
c8f3d12
Adding changes to various qouts
soumyakanti3578 May 18, 2024
bad92c3
benign changes
soumyakanti3578 May 20, 2024
1baf593
Fix tests failing in TestFilterSelectivityEstimator
soumyakanti3578 May 20, 2024
38b43f6
Fix getRollup in SqlAggFunction
kasakrisz May 22, 2024
5528662
Plan changes after fixing rollup
soumyakanti3578 May 22, 2024
f6a493a
Remove unnecessary CASTs in ASTConverter
soumyakanti3578 May 23, 2024
cacdd3f
More benign changes
soumyakanti3578 May 23, 2024
58633b9
Do not extract cast when its operand is a literal
soumyakanti3578 May 23, 2024
447422b
Changes in prepare_plan.q.out
soumyakanti3578 May 23, 2024
3cd0edd
changes to qouts
soumyakanti3578 May 28, 2024
76b8f04
Clean up and resolve some smells
soumyakanti3578 May 28, 2024
ded9bf5
Support serialization and deserialization for SEARCH
soumyakanti3578 May 31, 2024
fc04898
Add SORT_QUERY_RESULTS to pointlookup3.q to remove flakiness
soumyakanti3578 May 31, 2024
b4233a7
add explain cbo plan to sharedwork.q
soumyakanti3578 Jun 3, 2024
f5b641d
Exclude HivePreFilteringRule from cardinality_preserving_join_opt2.q
soumyakanti3578 Jun 3, 2024
087dd21
Fix failure of TestSymlinkTextInputFormat#testCombine
soumyakanti3578 Jun 5, 2024
155bfb5
benign changes for split0
soumyakanti3578 Jun 5, 2024
b537210
Resolve review comments
soumyakanti3578 Jun 17, 2024
136b6a2
benign changes after rebasing
soumyakanti3578 Jul 9, 2024
2f12411
Add Calcite version check for 1.35
soumyakanti3578 Jul 10, 2024
210e484
Refactor method that transforms ORs to INs and BETWEENs
soumyakanti3578 Jul 10, 2024
6eecb69
benign changes for correlationoptimizer8.q
soumyakanti3578 Jul 11, 2024
7695941
Refactor method `makeNotBetween` to use the RexBuilder.makeBetween
soumyakanti3578 Jul 11, 2024
268f878
Retry simplify until a RexNode is simplified completely, upto a max of 5
soumyakanti3578 Jul 23, 2024
ba2d5a3
benign changes after rebasing
soumyakanti3578 Jul 24, 2024
c784eac
Revert "Retry simplify until a RexNode is simplified completely, upto…
soumyakanti3578 Jul 24, 2024
6c0e77f
Check if HivePreFilteringRule has been applied on a Filter based on i…
soumyakanti3578 Jul 25, 2024
e0953d1
Compilation errors due to RelRule.Config.EMPTY
zabetak Oct 11, 2024
88ebff7
Update cbo_query*.q.out after rebasing
soumyakanti3578 Oct 31, 2024
c58fb75
Handle ROW in SEARCH ooperators for JDBC queries
soumyakanti3578 Nov 4, 2024
c606968
benign plan changes after rebasing
soumyakanti3578 Nov 4, 2024
33159af
rebasing because of a test failure
soumyakanti3578 Nov 4, 2024
edcb646
Copy the imlementation of Lopt optimization and apply changes from CA…
kasakrisz Dec 19, 2024
6678b84
tpcds plan changes after applying changes from CALCITE-6737
soumyakanti3578 Dec 19, 2024
21d4f33
plan changes after applying changes from CALCITE-6737
soumyakanti3578 Dec 20, 2024
f8fe62f
Multiply sarg.pointCount to function selectivity instead of (call.ope…
soumyakanti3578 Dec 20, 2024
18153e5
tpcds plan changes after correcting filter selectivity for SEARCH
soumyakanti3578 Dec 20, 2024
6ee315a
explainuser_2 plan changes
soumyakanti3578 Dec 30, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
5 changes: 5 additions & 0 deletions beeline/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -127,6 +127,11 @@
<groupId>org.apache.logging.log4j</groupId>
<artifactId>log4j-slf4j-impl</artifactId>
</dependency>
<dependency>
<groupId>org.locationtech.jts</groupId>
<artifactId>jts-core</artifactId>
<version>1.19.0</version>
</dependency>
<!-- test intra-project -->
<dependency>
<groupId>org.apache.hive</groupId>
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -111,10 +111,10 @@ STAGE PLANS:
Processor Tree:
TableScan
alias: hbase_ck_4
filterExpr: ((key.col1 < '27') and (key.col1 >= '165')) (type: boolean)
filterExpr: ((key.col1 >= '165') and (key.col1 < '27')) (type: boolean)
Statistics: Num rows: 1 Data size: 792 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: ((key.col1 < '27') and (key.col1 >= '165')) (type: boolean)
predicate: ((key.col1 >= '165') and (key.col1 < '27')) (type: boolean)
Statistics: Num rows: 1 Data size: 792 Basic stats: COMPLETE Column stats: NONE
Select Operator
expressions: key (type: struct<col1:string,col2:string,col3:string>), value (type: string)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -113,7 +113,7 @@ STAGE PLANS:
alias: hbase_ck_5
Statistics: Num rows: 1 Data size: 792 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: ((key.col1 < '27') and (key.col1 >= '165')) (type: boolean)
predicate: ((key.col1 >= '165') and (key.col1 < '27')) (type: boolean)
Statistics: Num rows: 1 Data size: 792 Basic stats: COMPLETE Column stats: NONE
Select Operator
expressions: key (type: struct<col1:string,col2:string,col3:string>), value (type: string)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -326,7 +326,7 @@ STAGE PLANS:
alias: hbase_table_2
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Filter Operator
predicate: ((key < 120) and (key > 100)) (type: boolean)
predicate: ((key > 100) and (key < 120)) (type: boolean)
Statistics: Num rows: 1 Data size: 188 Basic stats: COMPLETE Column stats: NONE
Select Operator
expressions: key (type: int), value (type: string)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -48,10 +48,10 @@ STAGE PLANS:
Map Operator Tree:
TableScan
alias: tbl_ice
filterExpr: (((b <> 'one') and (b <> 'four') and (a <> 22)) or ((a = 22) or (b) IN ('one', 'four')) is null or (b) IN ('one', 'four') or (a = 22)) (type: boolean)
filterExpr: (((b) IN ('four', 'one') or (a = 22)) is null or ((b <> 'four') and (b <> 'one') and (a <> 22)) or (b) IN ('four', 'one') or (a = 22)) (type: boolean)
Statistics: Num rows: 7 Data size: 672 Basic stats: COMPLETE Column stats: COMPLETE
Filter Operator
predicate: ((((b <> 'one') and (b <> 'four') and (a <> 22)) or ((a = 22) or (b) IN ('one', 'four')) is null) and FILE__PATH is not null) (type: boolean)
predicate: ((((b) IN ('four', 'one') or (a = 22)) is null or ((b <> 'four') and (b <> 'one') and (a <> 22))) and FILE__PATH is not null) (type: boolean)
Statistics: Num rows: 7 Data size: 672 Basic stats: COMPLETE Column stats: COMPLETE
Select Operator
expressions: a (type: int), b (type: string), c (type: int), PARTITION__SPEC__ID (type: int), PARTITION__HASH (type: bigint), FILE__PATH (type: string), ROW__POSITION (type: bigint), PARTITION__PROJECTION (type: string)
Expand All @@ -65,7 +65,7 @@ STAGE PLANS:
Statistics: Num rows: 7 Data size: 3388 Basic stats: COMPLETE Column stats: COMPLETE
value expressions: _col0 (type: int), _col1 (type: string), _col2 (type: int), _col3 (type: int), _col4 (type: bigint), _col6 (type: bigint), _col7 (type: string)
Filter Operator
predicate: (((b) IN ('one', 'four') or (a = 22)) and FILE__PATH is not null) (type: boolean)
predicate: (((b) IN ('four', 'one') or (a = 22)) and FILE__PATH is not null) (type: boolean)
Statistics: Num rows: 4 Data size: 368 Basic stats: COMPLETE Column stats: COMPLETE
Reduce Output Operator
key expressions: FILE__PATH (type: string)
Expand All @@ -78,10 +78,10 @@ STAGE PLANS:
Map Operator Tree:
TableScan
alias: tbl_ice
filterExpr: ((a = 22) or (b) IN ('one', 'four')) (type: boolean)
filterExpr: ((a = 22) or (b) IN ('four', 'one')) (type: boolean)
Statistics: Num rows: 7 Data size: 672 Basic stats: COMPLETE Column stats: COMPLETE
Filter Operator
predicate: ((a = 22) or (b) IN ('one', 'four')) (type: boolean)
predicate: ((a = 22) or (b) IN ('four', 'one')) (type: boolean)
Statistics: Num rows: 4 Data size: 384 Basic stats: COMPLETE Column stats: COMPLETE
Reduce Output Operator
key expressions: FILE__PATH (type: string)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -84,17 +84,17 @@ Stage-4
<-Reducer 2 [CONTAINS]
File Output Operator [FS_46]
table:{"name:":"default.ice01"}
Select Operator [SEL_44] (rows=3 width=479)
Select Operator [SEL_44] (rows=3 width=450)
Output:["_col0","_col1","_col2","_col3","_col4","_col5","_col6"]
Merge Join Operator [MERGEJOIN_43] (rows=3 width=479)
Merge Join Operator [MERGEJOIN_43] (rows=3 width=450)
Conds:RS_57._col4=RS_63._col0(Left Semi),Output:["_col0","_col1","_col2","_col3","_col4","_col5","_col6"]
<-Map 1 [SIMPLE_EDGE] vectorized
SHUFFLE [RS_57]
PartitionCols:_col4
Select Operator [SEL_55] (rows=5 width=479)
Select Operator [SEL_55] (rows=6 width=464)
Output:["_col0","_col1","_col2","_col3","_col4","_col5","_col6"]
Filter Operator [FIL_53] (rows=5 width=91)
predicate:((((id <= 4) and (id <> 2)) or ((id > 4) or (id = 2)) is null) and ((id <= 4) or (id <> 2) or ((id > 4) or (id = 2)) is null) and FILE__PATH is not null)
Filter Operator [FIL_53] (rows=6 width=76)
predicate:((((id = 2) or (id > 4)) is null or (id < 2) or ((id > 2) and (id <= 4))) and FILE__PATH is not null)
TableScan [TS_0] (rows=7 width=78)
default@ice01,ice01,Tbl:COMPLETE,Col:COMPLETE,Output:["id","name"]
<-Reducer 4 [SIMPLE_EDGE] vectorized
Expand All @@ -114,7 +114,7 @@ Stage-4
SHUFFLE [RS_56]
PartitionCols:FILE__PATH
Filter Operator [FIL_54] (rows=6 width=4)
predicate:(((id > 4) or (id = 2)) and FILE__PATH is not null)
predicate:(((id = 2) or (id > 4)) and FILE__PATH is not null)
Please refer to the previous TableScan [TS_0]
<-Reducer 6 [CONTAINS] vectorized
File Output Operator [FS_70]
Expand All @@ -131,7 +131,7 @@ Stage-4
SHUFFLE [RS_65]
PartitionCols:FILE__PATH
Filter Operator [FIL_64] (rows=6 width=76)
predicate:((id > 4) or (id = 2))
predicate:((id = 2) or (id > 4))
TableScan [TS_18] (rows=7 width=78)
default@ice01,ice01,Tbl:COMPLETE,Col:COMPLETE,Output:["id","name"]

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -164,13 +164,13 @@ Stage-0
Select Operator [SEL_52] (rows=500 width=178)
Output:["_col0","_col1"]
Filter Operator [FIL_51] (rows=500 width=178)
predicate:((key <> '0') and (key <> '100') and value is not null)
predicate:(key is not null and (key <> '0') and (key <> '100') and value is not null)
TableScan [TS_3] (rows=500 width=178)
default@src,b,Tbl:COMPLETE,Col:COMPLETE,Output:["key","value"]
<-Select Operator [SEL_55] (rows=500 width=269)
Output:["_col0","_col1","_col2"]
Filter Operator [FIL_54] (rows=500 width=269)
predicate:((key1 <> '0') and (key1 <> '100') and key2 is not null)
predicate:(key1 is not null and (key1 <> '0') and (key1 <> '100') and key2 is not null)
TableScan [TS_0] (rows=500 width=269)
default@srcbucket_big,a,Tbl:COMPLETE,Col:COMPLETE,Grouping Num Buckets:8,Grouping Partition Columns:["key1","key2"],Output:["key1","key2","value"]

Expand Down Expand Up @@ -360,13 +360,13 @@ Stage-0
Select Operator [SEL_32] (rows=500 width=178)
Output:["_col0","_col1"]
Filter Operator [FIL_31] (rows=500 width=178)
predicate:((key <> '0') and (key <> '100'))
predicate:(key is not null and (key <> '0') and (key <> '100'))
TableScan [TS_3] (rows=500 width=178)
default@src,b,Tbl:COMPLETE,Col:COMPLETE,Output:["key","value"]
<-Select Operator [SEL_35] (rows=500 width=269)
Output:["_col0","_col1","_col2"]
Filter Operator [FIL_34] (rows=500 width=269)
predicate:((key1 <> '0') and (key1 <> '100'))
predicate:(key1 is not null and (key1 <> '0') and (key1 <> '100'))
TableScan [TS_0] (rows=500 width=269)
default@srcbucket_big,a,Tbl:COMPLETE,Col:COMPLETE,Grouping Num Buckets:4,Grouping Partition Columns:["key1"],Output:["key1","key2","value"]

Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -360,11 +360,11 @@ STAGE PLANS:
Map Operator Tree:
TableScan
alias: o
filterExpr: ((quantity NOT BETWEEN 39 AND 0 or quantity NOT BETWEEN 69 AND 39 or (quantity > 70)) and (((quantity > 0) and (quantity < 39)) or ((quantity > 39) and (quantity < 69)) or (quantity > 70)) and itemid is not null) (type: boolean)
filterExpr: (quantity is not null and (((quantity > 0) and (quantity < 39)) or ((quantity > 39) and (quantity < 69)) or (quantity > 70)) and itemid is not null) (type: boolean)
probeDecodeDetails: cacheKey:HASH_MAP_MAPJOIN_29_container, bigKeyColName:itemid, smallTablePos:1, keyRatio:0.9523809523809523
Statistics: Num rows: 21 Data size: 168 Basic stats: COMPLETE Column stats: COMPLETE
Filter Operator
predicate: ((quantity NOT BETWEEN 39 AND 0 or quantity NOT BETWEEN 69 AND 39 or (quantity > 70)) and (((quantity > 0) and (quantity < 39)) or ((quantity > 39) and (quantity < 69)) or (quantity > 70)) and itemid is not null) (type: boolean)
predicate: (quantity is not null and (((quantity > 0) and (quantity < 39)) or ((quantity > 39) and (quantity < 69)) or (quantity > 70)) and itemid is not null) (type: boolean)
Statistics: Num rows: 21 Data size: 168 Basic stats: COMPLETE Column stats: COMPLETE
Select Operator
expressions: quantity (type: int), itemid (type: int)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -283,7 +283,7 @@ STAGE PLANS:
outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8
Statistics: Num rows: 8 Data size: 3884 Basic stats: COMPLETE Column stats: COMPLETE
Filter Operator
predicate: ((_col5 <> _col8) or ((_col5 = _col8) or _col5 is null) is null) (type: boolean)
predicate: ((_col5 <> _col8) or (_col5 is null or (_col5 = _col8)) is null) (type: boolean)
Statistics: Num rows: 8 Data size: 3884 Basic stats: COMPLETE Column stats: COMPLETE
Select Operator
expressions: _col0 (type: int), _col1 (type: bigint), _col2 (type: string), _col3 (type: bigint), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: int)
Expand Down Expand Up @@ -634,7 +634,7 @@ STAGE PLANS:
outputColumnNames: _col0, _col1, _col2, _col3, _col4, _col5, _col6, _col7, _col8
Statistics: Num rows: 8 Data size: 3884 Basic stats: COMPLETE Column stats: COMPLETE
Filter Operator
predicate: ((((_col5 <> _col8) or (_col5 <= 100)) and _col5 is not null) or (((_col5 = _col8) and (_col5 > 100)) or _col5 is null) is null) (type: boolean)
predicate: ((((_col5 <> _col8) or (_col5 <= 100)) and _col5 is not null) or (_col5 is null or ((_col5 = _col8) and (_col5 > 100))) is null) (type: boolean)
Statistics: Num rows: 8 Data size: 3884 Basic stats: COMPLETE Column stats: COMPLETE
Select Operator
expressions: _col0 (type: int), _col1 (type: bigint), _col2 (type: string), _col3 (type: bigint), _col4 (type: string), _col5 (type: int), _col6 (type: string), _col7 (type: int)
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -50,10 +50,10 @@ STAGE PLANS:
Map Operator Tree:
TableScan
alias: tbl_ice
filterExpr: ((a = 22) or (b) IN ('one', 'four')) (type: boolean)
filterExpr: ((a = 22) or (b) IN ('four', 'one')) (type: boolean)
Statistics: Num rows: 7 Data size: 672 Basic stats: COMPLETE Column stats: COMPLETE
Filter Operator
predicate: ((a = 22) or (b) IN ('one', 'four')) (type: boolean)
predicate: ((a = 22) or (b) IN ('four', 'one')) (type: boolean)
Statistics: Num rows: 4 Data size: 384 Basic stats: COMPLETE Column stats: COMPLETE
Select Operator
expressions: PARTITION__SPEC__ID (type: int), PARTITION__HASH (type: bigint), FILE__PATH (type: string), ROW__POSITION (type: bigint), PARTITION__PROJECTION (type: string), a (type: int), 'Changed' (type: string), c (type: int)
Expand All @@ -71,10 +71,10 @@ STAGE PLANS:
Map Operator Tree:
TableScan
alias: tbl_ice
filterExpr: (((b <> 'one') and (b <> 'four') and (a <> 22)) or ((a = 22) or (b) IN ('one', 'four')) is null) (type: boolean)
filterExpr: (((b) IN ('four', 'one') or (a = 22)) is null or ((b <> 'four') and (b <> 'one') and (a <> 22))) (type: boolean)
Statistics: Num rows: 7 Data size: 672 Basic stats: COMPLETE Column stats: COMPLETE
Filter Operator
predicate: ((((b <> 'one') and (b <> 'four') and (a <> 22)) or ((a = 22) or (b) IN ('one', 'four')) is null) and FILE__PATH is not null) (type: boolean)
predicate: ((((b) IN ('four', 'one') or (a = 22)) is null or ((b <> 'four') and (b <> 'one') and (a <> 22))) and FILE__PATH is not null) (type: boolean)
Statistics: Num rows: 7 Data size: 672 Basic stats: COMPLETE Column stats: COMPLETE
Select Operator
expressions: a (type: int), b (type: string), c (type: int), PARTITION__SPEC__ID (type: int), PARTITION__HASH (type: bigint), FILE__PATH (type: string), ROW__POSITION (type: bigint), PARTITION__PROJECTION (type: string)
Expand All @@ -92,10 +92,10 @@ STAGE PLANS:
Map Operator Tree:
TableScan
alias: tbl_ice
filterExpr: ((a = 22) or (b) IN ('one', 'four')) (type: boolean)
filterExpr: ((a = 22) or (b) IN ('four', 'one')) (type: boolean)
Statistics: Num rows: 7 Data size: 672 Basic stats: COMPLETE Column stats: COMPLETE
Filter Operator
predicate: ((a = 22) or (b) IN ('one', 'four')) (type: boolean)
predicate: ((a = 22) or (b) IN ('four', 'one')) (type: boolean)
Statistics: Num rows: 4 Data size: 384 Basic stats: COMPLETE Column stats: COMPLETE
Reduce Output Operator
key expressions: FILE__PATH (type: string)
Expand All @@ -105,7 +105,7 @@ STAGE PLANS:
Statistics: Num rows: 4 Data size: 384 Basic stats: COMPLETE Column stats: COMPLETE
value expressions: a (type: int), b (type: string), c (type: int), PARTITION__SPEC__ID (type: int), PARTITION__HASH (type: bigint), PARTITION__PROJECTION (type: string)
Filter Operator
predicate: (((b) IN ('one', 'four') or (a = 22)) and FILE__PATH is not null) (type: boolean)
predicate: (((b) IN ('four', 'one') or (a = 22)) and FILE__PATH is not null) (type: boolean)
Statistics: Num rows: 4 Data size: 368 Basic stats: COMPLETE Column stats: COMPLETE
Reduce Output Operator
key expressions: FILE__PATH (type: string)
Expand Down
Loading
Loading