Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](meta-mgr) Real-time parsing meta service endpoint to avoid rpc failed after config muted #45877 #45899

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #45877

…failed after config muted (#45877)


Original config::meta_service_endpoint is immutable. But it is changed
to mutable now, so we should parse it in realtime to avoid rpc failure.
@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Dec 25, 2024
@hello-stephen
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40310 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3d42f9b9a1f8f36588e8d24c34c94d4804a6a73c, data reload: false

------ Round 1 ----------------------------------
q1	17565	7396	7221	7221
q2	2061	167	160	160
q3	10739	1088	1193	1088
q4	10544	714	762	714
q5	7733	2772	2763	2763
q6	231	148	146	146
q7	976	601	602	601
q8	9570	1889	1957	1889
q9	8056	6316	6361	6316
q10	6933	2291	2298	2291
q11	452	263	263	263
q12	394	215	215	215
q13	17969	2962	2979	2962
q14	250	210	229	210
q15	564	514	529	514
q16	701	596	622	596
q17	950	588	529	529
q18	7244	6509	6518	6509
q19	3887	1050	992	992
q20	490	200	190	190
q21	4284	3161	3162	3161
q22	1057	1005	980	980
Total cold run time: 112650 ms
Total hot run time: 40310 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7346	7169	7266	7169
q2	318	231	244	231
q3	2998	3041	2878	2878
q4	2065	1739	1763	1739
q5	5654	5650	5752	5650
q6	221	140	144	140
q7	2149	1770	1777	1770
q8	3377	3401	3395	3395
q9	8824	8822	8720	8720
q10	3544	3481	3478	3478
q11	612	495	501	495
q12	824	620	596	596
q13	16342	3196	3136	3136
q14	288	267	273	267
q15	578	516	528	516
q16	695	684	686	684
q17	1806	1593	1561	1561
q18	8123	7857	7328	7328
q19	3792	1619	1528	1528
q20	2075	1844	1819	1819
q21	9081	5212	5146	5146
q22	1091	1008	1017	1008
Total cold run time: 81803 ms
Total hot run time: 59254 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195607 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3d42f9b9a1f8f36588e8d24c34c94d4804a6a73c, data reload: false

query1	1244	931	899	899
query2	6232	2041	2007	2007
query3	10786	4094	4076	4076
query4	67911	28850	23429	23429
query5	5351	454	451	451
query6	461	183	182	182
query7	5699	313	305	305
query8	311	218	230	218
query9	9089	2767	2731	2731
query10	520	269	253	253
query11	17933	15229	15967	15229
query12	174	100	100	100
query13	1587	436	436	436
query14	11104	6902	6992	6902
query15	209	180	187	180
query16	7554	472	452	452
query17	1045	555	593	555
query18	1919	311	309	309
query19	198	149	147	147
query20	113	110	107	107
query21	66	42	45	42
query22	5001	4931	4687	4687
query23	34020	33712	33824	33712
query24	6467	2913	2929	2913
query25	545	409	408	408
query26	696	169	166	166
query27	2003	302	296	296
query28	4318	2556	2535	2535
query29	710	454	434	434
query30	265	172	164	164
query31	999	854	857	854
query32	64	55	54	54
query33	431	289	287	287
query34	911	507	520	507
query35	866	747	751	747
query36	1082	951	958	951
query37	122	74	72	72
query38	4050	3942	3956	3942
query39	1505	1484	1455	1455
query40	140	84	86	84
query41	50	47	50	47
query42	108	99	103	99
query43	528	496	486	486
query44	1176	811	814	811
query45	182	171	167	167
query46	1136	762	732	732
query47	1999	1899	1948	1899
query48	453	371	387	371
query49	753	396	405	396
query50	816	435	434	434
query51	7401	7668	7141	7141
query52	99	90	90	90
query53	250	184	184	184
query54	573	468	444	444
query55	73	72	78	72
query56	245	231	227	227
query57	1198	1095	1099	1095
query58	200	194	207	194
query59	3166	2942	2792	2792
query60	271	244	243	243
query61	109	108	108	108
query62	768	664	649	649
query63	210	191	200	191
query64	1806	649	630	630
query65	3234	3198	3160	3160
query66	734	293	301	293
query67	15815	15494	15428	15428
query68	4608	552	545	545
query69	423	255	252	252
query70	1098	1141	1046	1046
query71	398	248	254	248
query72	6555	4043	3821	3821
query73	756	342	341	341
query74	10201	8952	9027	8952
query75	3281	2645	2621	2621
query76	2171	1006	1073	1006
query77	493	269	270	269
query78	10596	9845	9578	9578
query79	6801	606	583	583
query80	1704	412	418	412
query81	552	243	235	235
query82	1048	123	113	113
query83	256	143	139	139
query84	289	84	74	74
query85	1717	302	290	290
query86	470	267	289	267
query87	4481	4217	4145	4145
query88	5585	2390	2393	2390
query89	412	290	285	285
query90	2105	180	187	180
query91	200	141	143	141
query92	58	48	49	48
query93	5825	540	531	531
query94	933	276	296	276
query95	345	255	250	250
query96	618	279	288	279
query97	3307	3147	3166	3147
query98	222	198	196	196
query99	1834	1287	1286	1286
Total cold run time: 336396 ms
Total hot run time: 195607 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.05 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3d42f9b9a1f8f36588e8d24c34c94d4804a6a73c, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.63	0.10	0.10
query5	0.54	0.53	0.52
query6	1.14	0.73	0.72
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.55	0.50	0.49
query10	0.55	0.53	0.54
query11	0.14	0.10	0.10
query12	0.16	0.11	0.11
query13	0.60	0.60	0.59
query14	3.03	2.99	3.06
query15	0.88	0.82	0.82
query16	0.38	0.39	0.38
query17	1.04	1.00	0.96
query18	0.23	0.21	0.22
query19	1.79	1.76	1.95
query20	0.01	0.01	0.01
query21	15.35	0.58	0.58
query22	2.85	1.79	1.68
query23	16.89	0.90	0.89
query24	3.15	0.53	1.49
query25	0.17	0.24	0.08
query26	0.45	0.14	0.13
query27	0.05	0.05	0.05
query28	10.71	1.09	1.07
query29	12.54	3.18	3.19
query30	0.25	0.06	0.06
query31	2.87	0.39	0.37
query32	3.31	0.45	0.46
query33	2.92	3.02	3.01
query34	16.98	4.37	4.38
query35	4.54	4.45	4.38
query36	0.65	0.49	0.47
query37	0.08	0.06	0.05
query38	0.04	0.03	0.03
query39	0.04	0.02	0.02
query40	0.16	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.22 s
Total hot run time: 32.05 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants