Skip to content

[feat](cloud) support compacting snapshots manuall#61078

Open
w41ter wants to merge 2 commits intoapache:masterfrom
w41ter:feat/doris_compact_snapshot
Open

[feat](cloud) support compacting snapshots manuall#61078
w41ter wants to merge 2 commits intoapache:masterfrom
w41ter:feat/doris_compact_snapshot

Conversation

@w41ter
Copy link
Contributor

@w41ter w41ter commented Mar 5, 2026

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Mar 5, 2026

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@w41ter
Copy link
Contributor Author

w41ter commented Mar 5, 2026

run buildall

@w41ter
Copy link
Contributor Author

w41ter commented Mar 5, 2026

run buildall

@hello-stephen
Copy link
Contributor

Cloud UT Coverage Report

Increment line coverage 6.00% (3/50) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 79.21% (1798/2270)
Line Coverage 64.47% (32209/49959)
Region Coverage 65.31% (16127/24694)
Branch Coverage 55.83% (8589/15384)

@hello-stephen
Copy link
Contributor

FE UT Coverage Report

Increment line coverage `` 🎉
Increment coverage report
Complete coverage report

@doris-robot
Copy link

TPC-H: Total hot run time: 27824 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: http://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2134182e80bfea5e29cd43bad30f1579b712068d, data reload: false

------ Round 1 ----------------------------------
============================================
q1	17726	4597	4381	4381
q2	q3	10742	783	530	530
q4	4740	371	263	263
q5	8144	1195	1035	1035
q6	219	181	145	145
q7	811	829	665	665
q8	10692	1494	1318	1318
q9	6554	4868	4712	4712
q10	6561	1943	1656	1656
q11	459	257	248	248
q12	744	574	466	466
q13	18071	2988	2173	2173
q14	229	233	210	210
q15	931	805	813	805
q16	754	716	674	674
q17	709	859	430	430
q18	6379	5380	5323	5323
q19	1131	999	611	611
q20	490	500	393	393
q21	4711	1929	1537	1537
q22	357	298	249	249
Total cold run time: 101154 ms
Total hot run time: 27824 ms

----- Round 2, with runtime_filter_mode=off -----
============================================
q1	4840	4590	4721	4590
q2	q3	3932	4363	3850	3850
q4	885	1192	766	766
q5	4066	4419	4383	4383
q6	194	184	147	147
q7	1787	1669	1505	1505
q8	2502	2713	2586	2586
q9	7457	7369	7416	7369
q10	3796	4111	3611	3611
q11	505	441	417	417
q12	495	603	441	441
q13	2876	3164	2389	2389
q14	311	301	276	276
q15	870	820	842	820
q16	703	769	720	720
q17	1133	1417	1365	1365
q18	7337	6899	6777	6777
q19	881	875	898	875
q20	2089	2173	2019	2019
q21	4026	3488	3406	3406
q22	473	420	385	385
Total cold run time: 51158 ms
Total hot run time: 48697 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 153236 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: http://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2134182e80bfea5e29cd43bad30f1579b712068d, data reload: false

query5	4322	651	519	519
query6	333	226	206	206
query7	4215	464	280	280
query8	325	243	224	224
query9	8675	2722	2694	2694
query10	507	403	359	359
query11	7382	5793	5520	5520
query12	191	140	124	124
query13	1258	469	364	364
query14	5609	3816	3597	3597
query14_1	2819	2834	2782	2782
query15	200	196	176	176
query16	977	486	463	463
query17	893	717	631	631
query18	2453	448	356	356
query19	218	210	184	184
query20	137	130	133	130
query21	233	149	132	132
query22	4811	4891	4753	4753
query23	16591	16091	15665	15665
query23_1	15915	15981	16012	15981
query24	7495	1776	1374	1374
query24_1	1289	1252	1300	1252
query25	602	549	496	496
query26	1277	260	159	159
query27	2768	482	334	334
query28	4488	1858	1865	1858
query29	824	552	467	467
query30	307	253	207	207
query31	1380	1277	1229	1229
query32	84	74	72	72
query33	505	331	292	292
query34	930	899	556	556
query35	631	668	585	585
query36	1086	1105	1008	1008
query37	127	98	83	83
query38	2969	2923	2859	2859
query39	874	871	839	839
query39_1	839	811	848	811
query40	232	158	142	142
query41	65	61	60	60
query42	306	295	307	295
query43	243	240	226	226
query44	
query45	199	192	182	182
query46	875	973	602	602
query47	2123	2148	2046	2046
query48	318	314	231	231
query49	625	476	405	405
query50	687	280	212	212
query51	4155	4148	4073	4073
query52	285	290	280	280
query53	288	340	285	285
query54	288	268	261	261
query55	93	89	85	85
query56	313	322	302	302
query57	1354	1344	1274	1274
query58	295	283	275	275
query59	1297	1419	1298	1298
query60	337	334	374	334
query61	156	144	149	144
query62	628	581	542	542
query63	312	269	270	269
query64	5027	1287	1018	1018
query65	
query66	1455	476	350	350
query67	16381	16410	16277	16277
query68	
query69	391	311	285	285
query70	988	963	896	896
query71	330	300	301	300
query72	2847	2697	2511	2511
query73	539	550	317	317
query74	10030	10002	9779	9779
query75	2843	2754	2444	2444
query76	2273	1040	658	658
query77	355	370	309	309
query78	11146	11245	10663	10663
query79	2978	796	599	599
query80	1761	631	555	555
query81	597	295	240	240
query82	1008	144	127	127
query83	337	266	243	243
query84	304	127	96	96
query85	918	501	476	476
query86	496	311	322	311
query87	3129	3105	3022	3022
query88	3564	2653	2663	2653
query89	419	367	339	339
query90	2253	180	176	176
query91	161	172	137	137
query92	91	73	70	70
query93	1914	807	497	497
query94	647	320	295	295
query95	570	402	321	321
query96	642	505	231	231
query97	2479	2521	2411	2411
query98	238	221	218	218
query99	1018	987	928	928
Total cold run time: 236827 ms
Total hot run time: 153236 ms

@hello-stephen
Copy link
Contributor

BE UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 52.56% (19646/37381)
Line Coverage 36.18% (183411/506986)
Region Coverage 32.47% (142250/438100)
Branch Coverage 33.43% (61729/184658)

@hello-stephen
Copy link
Contributor

BE Regression && UT Coverage Report

Increment line coverage 100% (0/0) 🎉

Increment coverage report
Complete coverage report

Category Coverage
Function Coverage 71.55% (26189/36603)
Line Coverage 54.30% (274446/505433)
Region Coverage 51.52% (227829/442237)
Branch Coverage 52.92% (98026/185222)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants