Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [enhancement](cloud) add profile counter for file cache #45678 #45892

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #45678

@Thearas
Copy link
Contributor

Thearas commented Dec 25, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Dec 25, 2024
@Thearas
Copy link
Contributor

Thearas commented Dec 25, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41436 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0ab0906144f7a97ea8e09535f62c533fb0cbc204, data reload: false

------ Round 1 ----------------------------------
q1	17630	7666	7669	7666
q2	2074	172	170	170
q3	10715	1102	1226	1102
q4	10568	802	762	762
q5	7733	2950	2814	2814
q6	243	146	142	142
q7	999	623	602	602
q8	9586	2038	2054	2038
q9	7108	6463	6523	6463
q10	7018	2305	2342	2305
q11	458	264	255	255
q12	420	213	214	213
q13	17791	2967	2968	2967
q14	267	213	215	213
q15	570	533	520	520
q16	649	607	598	598
q17	1041	661	567	567
q18	7316	6592	6547	6547
q19	1383	1107	1108	1107
q20	493	204	228	204
q21	3989	3205	3284	3205
q22	1078	976	990	976
Total cold run time: 109129 ms
Total hot run time: 41436 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7432	7858	7342	7342
q2	329	229	229	229
q3	3056	2908	2876	2876
q4	2062	1781	1762	1762
q5	5708	5740	5721	5721
q6	228	144	140	140
q7	2198	1809	1756	1756
q8	3404	3602	3503	3503
q9	8997	9014	8990	8990
q10	3589	3559	3530	3530
q11	605	499	513	499
q12	822	615	630	615
q13	16185	3103	3133	3103
q14	309	283	285	283
q15	552	508	526	508
q16	708	671	666	666
q17	1863	1661	1646	1646
q18	8098	8020	7573	7573
q19	3949	1670	1702	1670
q20	2093	1829	1880	1829
q21	5314	5262	5301	5262
q22	1118	1025	994	994
Total cold run time: 78619 ms
Total hot run time: 60497 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196163 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0ab0906144f7a97ea8e09535f62c533fb0cbc204, data reload: false

query1	1291	939	918	918
query2	6231	2053	2081	2053
query3	10832	4194	4130	4130
query4	66135	29533	23519	23519
query5	5389	446	430	430
query6	454	174	173	173
query7	5647	317	304	304
query8	313	216	223	216
query9	9295	2737	2717	2717
query10	531	280	250	250
query11	17966	15396	15803	15396
query12	176	102	98	98
query13	1551	440	412	412
query14	10036	7198	7386	7198
query15	211	173	187	173
query16	7268	431	511	431
query17	1310	564	578	564
query18	1872	316	304	304
query19	199	163	169	163
query20	115	116	113	113
query21	66	43	43	43
query22	4429	4441	4353	4353
query23	34522	33914	33980	33914
query24	6075	2917	2984	2917
query25	515	397	386	386
query26	668	168	162	162
query27	1728	300	301	300
query28	4334	2563	2544	2544
query29	687	447	445	445
query30	244	169	169	169
query31	1004	828	829	828
query32	64	54	58	54
query33	455	299	293	293
query34	911	506	517	506
query35	839	771	765	765
query36	1087	924	942	924
query37	114	74	71	71
query38	4144	4038	3968	3968
query39	1542	1469	1453	1453
query40	143	87	88	87
query41	58	50	48	48
query42	118	98	94	94
query43	534	500	491	491
query44	1213	788	832	788
query45	194	169	181	169
query46	1171	756	737	737
query47	1973	1922	1922	1922
query48	491	398	376	376
query49	767	407	408	407
query50	828	440	422	422
query51	7282	7130	7092	7092
query52	104	87	93	87
query53	257	189	179	179
query54	590	469	466	466
query55	81	76	74	74
query56	274	243	236	236
query57	1184	1121	1087	1087
query58	213	209	235	209
query59	3127	3017	2881	2881
query60	282	278	287	278
query61	129	125	123	123
query62	761	665	676	665
query63	212	192	199	192
query64	1806	652	615	615
query65	3203	3162	3208	3162
query66	710	295	303	295
query67	15818	15374	15228	15228
query68	4492	562	557	557
query69	433	251	251	251
query70	1166	1133	1066	1066
query71	403	264	251	251
query72	6570	3905	3914	3905
query73	769	339	338	338
query74	10202	8918	8857	8857
query75	3351	2640	2683	2640
query76	2194	966	1047	966
query77	528	270	261	261
query78	10698	9575	9577	9575
query79	8097	601	604	601
query80	1966	424	427	424
query81	547	243	241	241
query82	1353	121	116	116
query83	263	137	139	137
query84	297	85	86	85
query85	1661	314	312	312
query86	476	292	279	279
query87	4521	4169	4280	4169
query88	5573	2456	2431	2431
query89	438	284	290	284
query90	2061	191	186	186
query91	182	142	142	142
query92	62	46	50	46
query93	6536	548	547	547
query94	872	291	272	272
query95	346	254	249	249
query96	627	282	282	282
query97	3369	3137	3208	3137
query98	215	198	205	198
query99	1611	1291	1297	1291
Total cold run time: 335652 ms
Total hot run time: 196163 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.39 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 0ab0906144f7a97ea8e09535f62c533fb0cbc204, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.02
query3	0.23	0.06	0.06
query4	1.63	0.10	0.11
query5	0.53	0.51	0.51
query6	1.13	0.74	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.49	0.50
query10	0.54	0.55	0.58
query11	0.13	0.10	0.12
query12	0.14	0.12	0.11
query13	0.59	0.60	0.58
query14	2.97	2.94	2.98
query15	0.88	0.82	0.82
query16	0.37	0.38	0.40
query17	1.01	1.05	1.00
query18	0.24	0.20	0.22
query19	1.93	1.74	1.88
query20	0.02	0.01	0.01
query21	15.39	0.60	0.56
query22	2.66	2.77	2.01
query23	16.70	1.19	0.89
query24	3.18	1.58	1.47
query25	0.17	0.11	0.13
query26	0.54	0.14	0.13
query27	0.05	0.04	0.06
query28	9.93	1.11	1.08
query29	12.53	3.22	3.20
query30	0.24	0.05	0.06
query31	2.85	0.39	0.38
query32	3.26	0.46	0.47
query33	2.97	2.96	2.99
query34	16.93	4.42	4.41
query35	4.53	4.51	4.45
query36	0.66	0.49	0.48
query37	0.10	0.06	0.06
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.12
query41	0.09	0.02	0.03
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.15 s
Total hot run time: 33.39 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants