milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
15,223 Commits
169 Branches
154 Tags
632 MiB
Commit Graph

15223 Commits (perf)

Author SHA1 Message Date
Enwei Jiao a9eb72e580
fix GetCompactionState hang (#18850) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-08-26 18:00:54 +08:00
congqixia 85bbba95d2
Add semver in session (#18796) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-24 10:38:52 +08:00
Enwei Jiao 0c6953474b
refactor compaction concurency logic (#18795) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-08-23 19:20:53 +08:00
wei liu 996a4f5ee1
fix insert meets vChannels reuse pChannel (#18784) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2022-08-23 19:12:55 +08:00
wayblink 6929e94065
Fix watchDmChannel may be out-of-date after compaction issue and add context (#18790) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-08-23 17:44:56 +08:00
wei liu 588d165819
fix load segment hangs (#18783) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2022-08-23 16:42:52 +08:00
sre-ci-robot 1d30c33aba
Update Pytest image changes (#18753) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2022-08-23 08:58:52 +08:00
Cai Yudong ab30ebb1c2
Ugrade to knowhere-v1.2.0 (#18745) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-08-22 20:52:52 +08:00
jaime 11dd50a8a2
support configurable sasl mechanisms for kafka (#17899) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-08-22 10:02:52 +08:00
NicoYuan1986 4ee62667be
Update pymilvus version (#18740) 
Signed-off-by: “nico” <Nico_1986@163.com>

Signed-off-by: “nico” <Nico_1986@163.com>
 2022-08-22 09:06:52 +08:00
jaime 0c96a390f9
Fix password verification cache missed (#18732) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-08-20 13:56:51 +08:00
Ten Thousand Leaves 328e751478
Fix # of rows of recovering segment (#18733) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-08-19 21:06:50 +08:00
Bingyi Sun 671d629f0c
Drop empty sealed segment (#17708) (#18714) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-08-19 17:12:52 +08:00
Jiquan Long d335c7b591
Fix query cluster metrics (#18725) (#18727) 
pick from master and fix #18722
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-08-19 13:58:01 +08:00
XuanYang-cn 3369fdd085
Fix RHNSWPQ pqm divide by zero (#18701) 
See also: #18671

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-08-19 10:52:50 +08:00
congqixia 9353dfb843
Simplify Dml-DeltaChannel mapping logic (#18708) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-18 16:12:50 +08:00
ThreadDao b08fd7136f
[test] Add case to test search and index about handoff (#18679) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2022-08-18 09:10:50 +08:00
congqixia 1e1b63d8fe
Fix DataType::bool cast to double (#18690) (#18693) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-17 22:14:54 +08:00
congqixia d66f3505fc
Dedup output fields for task query (#18673) (#18683) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-17 22:12:59 +08:00
XuanYang-cn 769c016fb9
Fix flush panic after compaction (#18678) 
See also: #18565

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-08-17 19:00:49 +08:00
XuanYang-cn e9f5b35e83
Fix DN flowgraph delete buffer logs (#18658) 
1. Remove logs about not existing segments.
2. Group logs by timestamp.
3. Log changed segments only.
4. Pair the segments reference lock and unlock log by taskID.

Resolves: #18655

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-08-16 14:34:49 +08:00
sre-ci-robot 8f8af18ddb
Update Pytest image changes (#18632) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2022-08-16 08:50:52 +08:00
jaime 75e16208d9
Fix Parse binlog path failure (#18584) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-08-15 16:57:52 +08:00
binbin f63faf0d6f
Update pymilvus version (#18627) 
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
 2022-08-12 19:18:49 +08:00
wei liu 0e4dc112aa
support dynamic change log level through http (#18570) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2022-08-09 19:44:37 +08:00
congqixia bc62ca1fab
Release collection resources when all partition released (#18569) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-09 18:32:37 +08:00
congqixia d62381afc9
Add cgo worker pool for querynode (#18542) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-09 18:30:42 +08:00
congqixia 702e3253d0
Close Node/Segment detector when close ShardCluster (#18476) (#18568) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-09 18:18:36 +08:00
Xiaofan 9899a5be98
Remove Load Delta Channel Request (#18394) 
Fix #18393

remove watch delta channel task related logic

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-04 17:50:37 +08:00
xing.zhao 936da41f5f
Use chunkManager rather than minio.Client in datanode garbage collection (#18513) 
Signed-off-by: xingzhao <xing.zhao@zilliz.com>

Co-authored-by: xingzhao <xing.zhao@zilliz.com>
 2022-08-03 16:44:37 +08:00
jaime f4e7861e6b
Add reqeust id log for minio chunk manager (#18467) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-08-01 18:54:33 +08:00
yah01 dcd6c9e5a9
Limit the concurrency level for single load request (#18410) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-07-29 11:36:32 +08:00
congqixia 7169256c0b
Fix garbage collector error handling and parse segment id logic (#18432) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-27 20:10:30 +08:00
wayblink ae10a2f616
Add some debug log to explore ocassionally channel name mismatch issue in create collection (#18427) 
Signed-off-by: wayblink <anyang.wang@zilliz.com>
 2022-07-27 18:16:31 +08:00
cai.zhang 773f8a9ca0
Fix bug for unit test (#18423) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-07-27 11:38:30 +08:00
cai.zhang 1b33c73138
Fix bug for etcd compaction causes the metaTable pointer to be different (#18418) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-07-26 21:30:30 +08:00
congqixia 63fd633c26
Fix ParseSegmentIDBinlog panicks with bad input (#18413) (#18419) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-26 21:16:30 +08:00
ThreadDao 32fdc848d2
[debug] Change k8s client load cluster config (#18403) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2022-07-26 09:00:33 +08:00
congqixia 1e038a75ef
Use errgroup to load DeltaData in parallel (#18384) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-23 21:36:29 +08:00
congqixia b5678f1e6a
Sync patched segmentInfo to etcd (#18383) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-23 21:26:29 +08:00
zhenshan.cao 6521f6da44
Fix segment DmChannel in querycoord for compatibility to 2.0.2 (#18373) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-07-22 21:00:28 +08:00
binbin 4844219e5a
Update pymilvus version (#18359) 
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
 2022-07-21 23:04:28 +08:00
Xiaofan a34f635bcb
Change handoff handler from timer to ticker (#18358) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-07-21 21:30:27 +08:00
Ten Thousand Leaves f96ad7ec6c
Make DataNode not panic if stale segment is not found during flush (#18345) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-07-20 21:18:29 +08:00
Ten Thousand Leaves 819e5b3368
Fix a nil pointer issue (#18346) 
/kind bug

issue: #18270
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-07-20 20:46:29 +08:00
wei liu f132197ae9
fix sync problem during reblance (#18344) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2022-07-20 15:58:28 +08:00
binbin 8128a7b7c0
[skip e2e] Modify test cases (#18342) 
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
 2022-07-20 15:46:32 +08:00
congqixia 69aea00c09
Use serialized size before compression in log meta (#18337) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-07-19 21:38:30 +08:00
bigsheeper 8fcd6aa56b
Fix addSegment error, avoid the risk of mem leaks (#18308) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-07-19 20:16:28 +08:00
zhenshan.cao 461a022e65
Return empty result in advance if all data filtered out (#18329) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-07-19 19:34:28 +08:00