milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
22,874 Commits
174 Branches
149 Tags
607 MiB
Commit Graph

5 Commits (master)

Author SHA1 Message Date
yihao.dai 0e1f367164
enhance: Fail compaction task to prevent data loss (#43545) 
We’ve frequently observed data loss caused by broken mutual exclusion in
compaction tasks. This PR introduces a post-check: before modifying
metadata upon compaction task completion, it verifies the state of the
input segments. If any input segment has been dropped, the compaction
task will be marked as failed.

issue: https://github.com/milvus-io/milvus/issues/43513

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-07-25 16:24:54 +08:00
yihao.dai 804a7692a6
fix: Fix delete loss caused by missing mutual exclusion in sort compaction (#43540) 
issue: https://github.com/milvus-io/milvus/issues/43513

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-07-24 14:53:34 +08:00
cai.zhang 6989e18599
enhance: Move sort stats task to sort compaction (#42562) 
issue: #42560

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-07-08 20:22:47 +08:00
yihao.dai 79b51cbb73
fix: Fix task getting stuck after recovery (#42114) 
Submit tasks into the global scheduler after recovery.

issue: https://github.com/milvus-io/milvus/issues/42046

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2025-05-28 12:46:28 +08:00
yihao.dai 142bd2fc05
enhance: Pooling for data tasks (#41256) 
1. Add global scheduler for datacoord.
2. Define and implement new CreateTask, QueryTask, DropTask interfaces.
3. Refine Import, Compaction, Stats, Index task.

issue: https://github.com/milvus-io/milvus/issues/41123

Co-authored-by: Cai Zhang <cai.zhang@zilliz.com>
 2025-05-20 21:06:24 +08:00