Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature](nereids)support create function command in nereids #45874

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

starocean999
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Dec 24, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39927 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 611affda70d2a764ad8e63ab264fcf19c7c6ae61, data reload: false

------ Round 1 ----------------------------------
q1	17624	7461	7297	7297
q2	2056	179	169	169
q3	10694	1059	1133	1059
q4	10567	751	733	733
q5	7614	2699	2675	2675
q6	243	150	144	144
q7	1000	631	605	605
q8	9246	1888	1920	1888
q9	6576	6434	6413	6413
q10	6992	2288	2323	2288
q11	467	260	269	260
q12	432	222	219	219
q13	17761	2979	2980	2979
q14	243	210	214	210
q15	575	516	489	489
q16	654	576	583	576
q17	992	516	510	510
q18	7158	6806	6795	6795
q19	1356	957	1009	957
q20	444	179	184	179
q21	4004	3184	3177	3177
q22	379	329	305	305
Total cold run time: 107077 ms
Total hot run time: 39927 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7253	7238	7223	7223
q2	332	235	231	231
q3	2895	2746	2886	2746
q4	2052	1764	1804	1764
q5	5679	5616	5615	5615
q6	219	149	143	143
q7	2248	1786	1827	1786
q8	3339	3539	3504	3504
q9	8923	8923	9004	8923
q10	3610	3561	3540	3540
q11	606	494	518	494
q12	837	611	586	586
q13	10883	3118	3149	3118
q14	310	273	288	273
q15	543	514	496	496
q16	692	667	666	666
q17	1856	1620	1620	1620
q18	8288	7692	7547	7547
q19	3346	1579	1523	1523
q20	2068	1867	1913	1867
q21	5474	5525	5456	5456
q22	682	567	615	567
Total cold run time: 72135 ms
Total hot run time: 59688 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196454 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 611affda70d2a764ad8e63ab264fcf19c7c6ae61, data reload: false

query1	1284	945	988	945
query2	6252	2351	2279	2279
query3	11129	4934	4856	4856
query4	32987	23443	23467	23443
query5	3684	485	469	469
query6	282	185	188	185
query7	3986	304	306	304
query8	304	242	232	232
query9	9372	2735	2734	2734
query10	477	249	242	242
query11	17932	15320	15284	15284
query12	173	103	109	103
query13	1594	462	425	425
query14	10913	7786	6961	6961
query15	267	209	207	207
query16	8240	467	462	462
query17	1793	585	562	562
query18	2194	302	326	302
query19	389	165	159	159
query20	123	118	111	111
query21	205	103	104	103
query22	4739	4489	4581	4489
query23	34293	33449	33826	33449
query24	10217	2412	2508	2412
query25	618	403	408	403
query26	1244	152	153	152
query27	2303	330	335	330
query28	7881	2457	2470	2457
query29	865	437	416	416
query30	248	151	153	151
query31	1042	838	846	838
query32	110	57	58	57
query33	769	302	293	293
query34	1264	521	535	521
query35	914	761	787	761
query36	1115	955	974	955
query37	131	85	76	76
query38	4213	4291	4153	4153
query39	1508	1490	1460	1460
query40	209	99	99	99
query41	44	42	44	42
query42	112	97	101	97
query43	537	501	497	497
query44	1277	824	833	824
query45	194	168	177	168
query46	1228	739	734	734
query47	2059	1927	1935	1927
query48	418	321	328	321
query49	883	410	402	402
query50	852	410	390	390
query51	7283	7064	7023	7023
query52	103	99	90	90
query53	262	193	186	186
query54	1163	429	436	429
query55	86	76	77	76
query56	280	237	241	237
query57	1322	1176	1148	1148
query58	236	216	223	216
query59	3398	3200	3178	3178
query60	278	253	255	253
query61	111	105	105	105
query62	924	782	760	760
query63	217	193	199	193
query64	3882	731	682	682
query65	3316	3303	3276	3276
query66	767	305	300	300
query67	16470	15632	15439	15439
query68	5971	555	569	555
query69	495	252	255	252
query70	1197	1119	1120	1119
query71	515	245	257	245
query72	7022	4048	4180	4048
query73	787	368	374	368
query74	10302	8842	8926	8842
query75	4069	2637	2654	2637
query76	4289	980	1047	980
query77	647	276	281	276
query78	10188	9419	9816	9419
query79	1722	617	606	606
query80	1293	421	425	421
query81	506	247	232	232
query82	249	125	119	119
query83	184	153	142	142
query84	287	72	74	72
query85	1008	301	320	301
query86	351	289	294	289
query87	4495	4265	4333	4265
query88	3538	2249	2219	2219
query89	406	290	289	289
query90	2156	189	188	188
query91	141	103	103	103
query92	66	50	51	50
query93	1600	558	569	558
query94	887	243	285	243
query95	348	258	248	248
query96	619	275	278	275
query97	2834	2638	2685	2638
query98	221	195	197	195
query99	1700	1439	1427	1427
Total cold run time: 305058 ms
Total hot run time: 196454 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.2 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 611affda70d2a764ad8e63ab264fcf19c7c6ae61, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.10
query5	0.44	0.39	0.41
query6	1.16	0.65	0.66
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.56	0.52	0.49
query10	0.56	0.58	0.54
query11	0.14	0.10	0.10
query12	0.14	0.10	0.11
query13	0.60	0.60	0.58
query14	2.84	2.85	2.74
query15	0.89	0.82	0.82
query16	0.38	0.39	0.36
query17	1.08	1.05	1.07
query18	0.23	0.21	0.21
query19	1.94	1.84	2.00
query20	0.02	0.01	0.01
query21	15.38	0.60	0.60
query22	3.10	1.96	1.44
query23	16.80	1.26	0.87
query24	2.91	0.80	1.82
query25	0.26	0.20	0.06
query26	0.38	0.14	0.14
query27	0.05	0.04	0.03
query28	10.22	1.11	1.08
query29	12.63	3.22	3.24
query30	0.25	0.06	0.07
query31	2.84	0.38	0.38
query32	3.27	0.46	0.46
query33	3.03	3.13	3.12
query34	17.05	4.48	4.52
query35	4.50	4.52	4.51
query36	0.66	0.50	0.48
query37	0.10	0.07	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.14	0.13
query41	0.07	0.03	0.02
query42	0.04	0.03	0.02
query43	0.03	0.03	0.03
Total cold run time: 106.79 s
Total hot run time: 32.2 s

@starocean999 starocean999 force-pushed the nereids_create_function branch from 611affd to f5249ed Compare December 25, 2024 10:02
@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32503 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f5249edb39a1c88c1e1df4ee0f68e3124eeb1516, data reload: false

------ Round 1 ----------------------------------
q1	17583	6125	6018	6018
q2	2050	295	156	156
q3	10442	1208	770	770
q4	10223	851	437	437
q5	7838	2166	1924	1924
q6	212	184	149	149
q7	891	734	602	602
q8	9229	1355	1219	1219
q9	5163	4862	4935	4862
q10	6718	2294	1850	1850
q11	493	275	262	262
q12	345	367	218	218
q13	17775	3601	2937	2937
q14	234	222	213	213
q15	562	497	494	494
q16	622	611	574	574
q17	550	835	331	331
q18	6884	6646	6460	6460
q19	2508	957	555	555
q20	299	317	188	188
q21	2851	2247	1987	1987
q22	359	337	297	297
Total cold run time: 103831 ms
Total hot run time: 32503 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6310	6234	6235	6234
q2	239	324	233	233
q3	2290	2676	2337	2337
q4	1403	1858	1372	1372
q5	4310	4716	4788	4716
q6	184	185	151	151
q7	2064	1969	1820	1820
q8	2622	2801	2679	2679
q9	7356	7331	7329	7329
q10	3078	3363	2787	2787
q11	587	498	491	491
q12	666	775	594	594
q13	3370	3769	3123	3123
q14	289	321	274	274
q15	590	514	509	509
q16	646	679	652	652
q17	1226	1736	1249	1249
q18	7706	7471	7353	7353
q19	828	1189	1055	1055
q20	1993	2046	1930	1930
q21	5740	5386	4870	4870
q22	626	629	608	608
Total cold run time: 54123 ms
Total hot run time: 52366 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants