milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
19,505 Commits
97 Branches
161 Tags
578 MiB
Commit Graph

3 Commits (2.4-hotfix)

Author SHA1 Message Date
yihao.dai 9cb640fe78
fix: Fix import hanging and improve logging output (#32166) (#32167) 
Fix import hanging when the previous import task failed, and improve
parquet import logging outout.

issue: https://github.com/milvus-io/milvus/issues/31834

pr: https://github.com/milvus-io/milvus/pull/32166

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-13 22:03:23 +08:00
yihao.dai 39d988cf8d
enhance: Use an individual buffer size parameter for imports (#31833) (#31937) 
Use an individual buffer size parameter for imports and set buffer size
to 64MB.

issue: https://github.com/milvus-io/milvus/issues/28521

pr: https://github.com/milvus-io/milvus/pull/31833

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-08 21:05:17 +08:00
yihao.dai 808a944f93
enhance: Ensure ImportV2 waits for the index to be built and refine some logic (#31629) (#31733) 
Feature Introduced:
1. Ensure ImportV2 waits for the index to be built

Enhancements Introduced:
1. Utilization of local time for timeout ts instead of allocating ts
from rootcoord.
2. Enhanced input file length check for binlog import.
3. Removal of duplicated manager in datanode.
4. Renaming of executor to scheduler in datanode.
5. Utilization of a thread pool in the scheduler in datanode.

issue: https://github.com/milvus-io/milvus/issues/28521

pr: https://github.com/milvus-io/milvus/pull/31629

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2024-04-01 20:45:13 +08:00