Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[enhance](nereids) add eliminate order by key by uniform #46225

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

feiniaofeiafei
Copy link
Contributor

@feiniaofeiafei feiniaofeiafei commented Dec 31, 2024

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
select a,b,c from test where a=1 order by a
->
select a,b,c from test where a=1

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@feiniaofeiafei feiniaofeiafei force-pushed the order_by_key_eliminate_by_uniform branch from 068fbed to bfad26c Compare December 31, 2024 12:31
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32281 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bfad26cc257f8f516650de417d4c4713ed750d2f, data reload: false

------ Round 1 ----------------------------------
q1	17573	6842	6047	6047
q2	2049	308	178	178
q3	10427	1212	728	728
q4	10208	870	439	439
q5	7521	2176	1975	1975
q6	208	178	145	145
q7	892	763	606	606
q8	9243	1362	1151	1151
q9	5262	4874	4953	4874
q10	6738	2307	1835	1835
q11	470	278	262	262
q12	345	357	221	221
q13	17778	3577	2924	2924
q14	230	228	209	209
q15	551	505	510	505
q16	631	617	598	598
q17	560	840	323	323
q18	6968	6405	6311	6311
q19	2133	952	550	550
q20	309	308	182	182
q21	2842	2165	1909	1909
q22	366	335	309	309
Total cold run time: 103304 ms
Total hot run time: 32281 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6292	6248	6223	6223
q2	238	326	233	233
q3	2248	2650	2259	2259
q4	1435	1846	1392	1392
q5	4361	4747	4764	4747
q6	186	175	142	142
q7	2078	1951	1840	1840
q8	2639	2838	2668	2668
q9	7354	7272	7344	7272
q10	3088	3398	2870	2870
q11	571	515	518	515
q12	657	757	621	621
q13	3367	3747	3139	3139
q14	307	299	286	286
q15	567	509	508	508
q16	671	663	656	656
q17	1212	1735	1251	1251
q18	7676	7483	7350	7350
q19	823	1180	1068	1068
q20	2032	2029	1834	1834
q21	5660	5314	4890	4890
q22	597	623	566	566
Total cold run time: 54059 ms
Total hot run time: 52330 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197216 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bfad26cc257f8f516650de417d4c4713ed750d2f, data reload: false

query1	1321	975	913	913
query2	6358	2429	2377	2377
query3	11122	4535	4894	4535
query4	32987	23767	23598	23598
query5	3756	581	425	425
query6	271	198	201	198
query7	3994	511	319	319
query8	308	261	240	240
query9	9358	2738	2734	2734
query10	442	324	243	243
query11	18029	15304	15753	15304
query12	165	108	103	103
query13	1668	522	405	405
query14	11518	6904	7678	6904
query15	247	217	192	192
query16	7947	639	512	512
query17	1541	763	600	600
query18	2072	400	308	308
query19	192	187	159	159
query20	132	115	111	111
query21	206	122	109	109
query22	4752	4602	4516	4516
query23	34784	33479	34068	33479
query24	6486	2304	2376	2304
query25	482	454	393	393
query26	740	275	168	168
query27	2225	459	341	341
query28	5494	2503	2510	2503
query29	649	552	416	416
query30	217	190	154	154
query31	1020	924	833	833
query32	96	62	57	57
query33	535	358	292	292
query34	794	853	534	534
query35	793	850	761	761
query36	1054	1061	960	960
query37	118	106	78	78
query38	4331	4129	4275	4129
query39	1496	1471	1472	1471
query40	212	125	107	107
query41	47	46	42	42
query42	118	108	105	105
query43	531	547	509	509
query44	1318	845	817	817
query45	180	176	181	176
query46	881	1067	658	658
query47	2019	2008	1964	1964
query48	395	417	320	320
query49	717	488	388	388
query50	647	684	399	399
query51	7279	7233	7199	7199
query52	103	105	97	97
query53	229	250	185	185
query54	493	521	413	413
query55	82	91	78	78
query56	261	263	253	253
query57	1277	1248	1166	1166
query58	269	219	234	219
query59	3395	3531	3271	3271
query60	283	278	265	265
query61	130	153	112	112
query62	837	810	761	761
query63	228	204	194	194
query64	3589	1031	649	649
query65	3328	3275	3266	3266
query66	711	421	312	312
query67	16479	15678	15531	15531
query68	8579	760	527	527
query69	483	295	249	249
query70	1192	1140	1167	1140
query71	443	284	256	256
query72	6222	3938	3849	3849
query73	667	773	364	364
query74	10121	9419	9355	9355
query75	4032	3139	2643	2643
query76	3624	1203	830	830
query77	744	376	279	279
query78	10029	10203	9353	9353
query79	3462	921	588	588
query80	748	618	442	442
query81	500	283	234	234
query82	643	159	116	116
query83	191	163	148	148
query84	272	87	77	77
query85	761	358	303	303
query86	359	322	308	308
query87	4586	4426	4583	4426
query88	4243	2231	2223	2223
query89	425	340	288	288
query90	1835	195	189	189
query91	183	141	105	105
query92	62	59	52	52
query93	1310	897	527	527
query94	638	416	309	309
query95	332	274	256	256
query96	491	626	293	293
query97	2741	2833	2689	2689
query98	220	199	202	199
query99	1706	1594	1465	1465
Total cold run time: 297582 ms
Total hot run time: 197216 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.76 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit bfad26cc257f8f516650de417d4c4713ed750d2f, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.04
query3	0.24	0.08	0.07
query4	1.62	0.10	0.10
query5	0.43	0.42	0.40
query6	1.15	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.50	0.50
query10	0.55	0.56	0.55
query11	0.14	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.61	0.60
query14	2.74	2.78	2.88
query15	0.91	0.83	0.83
query16	0.37	0.39	0.38
query17	1.08	1.05	1.08
query18	0.22	0.20	0.20
query19	1.94	1.80	1.95
query20	0.01	0.01	0.01
query21	15.39	0.95	0.60
query22	0.75	0.78	0.63
query23	15.36	1.47	0.56
query24	2.93	1.20	1.74
query25	0.16	0.14	0.21
query26	0.29	0.14	0.14
query27	0.05	0.04	0.05
query28	14.42	1.51	1.06
query29	12.60	3.92	3.25
query30	0.25	0.09	0.07
query31	2.82	0.60	0.38
query32	3.23	0.53	0.46
query33	3.07	3.18	3.18
query34	16.75	5.20	4.56
query35	4.49	4.45	4.60
query36	0.65	0.49	0.49
query37	0.09	0.07	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.09	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.61 s
Total hot run time: 31.76 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants