Commit Graph

16149 Commits (4c5ffc832c3dbdaa846e36fdbb33b438bce80cb9)

Author SHA1 Message Date
Cai Yudong 4c5ffc832c
Add param check for BruteForceSearch in segcore ()
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-11-30 14:53:15 +08:00
Jiquan Long 5a6a92d603
Refine log level ()
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-30 14:11:15 +08:00
cai.zhang 83244afcf3
Reduce some logs level which is frequent ()
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-30 14:07:15 +08:00
yah01 060649b8aa
Refactor task scheduler and executor ()
Make the performance able to scale out

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 13:57:15 +08:00
yah01 18762f82aa
Refine TimeRecorder output ()
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-30 13:33:15 +08:00
Jiquan Long 8d78d9943a
Fix term filtering failed on indexed scalar field () ()
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-30 10:05:15 +08:00
smellthemoon a46a5ac900
Fix rocksmq incompatible ()
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-30 10:01:15 +08:00
SimFG c6fc1511aa
Update the error message for the rabc method ()
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-29 20:05:14 +08:00
ThreadDao efd5404d4f
[test] Fix compaction case to wait for index before getting segments ()
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-11-29 19:35:15 +08:00
Ten Thousand Leaves 0700e56008
Increase MaxWatchDuration and make it configurable ()
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-29 17:19:14 +08:00
yah01 8153b84f1a
Fix asserting PK slice equal fails due to the same distances ()
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-29 16:45:14 +08:00
yah01 5ffbb01a67
Fix IndexNode panic while failed to create index ()
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-29 15:31:15 +08:00
Jiquan Long 7f76e798e9
Fix metric ProxyApplyPrimaryKeyLatency ()
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-29 15:23:14 +08:00
congqixia a8e6d5d47e
Fix delete operation scope to vchannel ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 15:15:15 +08:00
congqixia 938c09679c
Fix LRU cache may panic on double close ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 09:47:14 +08:00
smellthemoon b5f178f22b
Fix kafka panic ()
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-28 18:17:14 +08:00
sre-ci-robot 6824188bbc
Update Pytest image changes ()
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-11-28 15:55:14 +08:00
Ten Thousand Leaves 4f9a294b2e
Refine segment stat metrics on QueryNode ()
issue: 

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-28 14:53:14 +08:00
congqixia dd7e309a29
Add log for transfer segment operation ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-28 09:53:13 +08:00
Enwei Jiao 9b61170bf0
Fix compile proto failed ()
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-28 09:47:14 +08:00
edward.zeng 170bbde0de
Add storageclass check for meta migration ()
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>

Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2022-11-28 09:19:14 +08:00
binbin f588a73719
Update pymilvus version ()
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-11-26 09:33:13 +08:00
smellthemoon d9185485f1
Remove TraceID in mq ()
Signed-off-by: lixinguo <xinguo.li@zilliz.com>

Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2022-11-25 23:11:12 +08:00
MrPresent-Han b021d7c59c
[skip e2e] add log for querynode load and remove segment() ()
issue: 

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-25 17:33:13 +08:00
congqixia 49c8ce7561
Remove etcd dependency for querynode ut ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-25 14:45:12 +08:00
XuanYang-cn 7fbe0c4df2
Remove mockTestKv in metatable test ()
See also: 

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-25 11:07:12 +08:00
yah01 882ba6240b
Check whether CodecIndex is nil to avoid panic ()
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-25 10:45:12 +08:00
shaoyue 37725d3470
[restapi] Fix insert request lost precision for int64 fields ()
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-11-25 10:43:12 +08:00
congqixia 83d3007744
Fix install linux dep priviledge ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-24 19:49:11 +08:00
Ten Thousand Leaves 3cde5b53ad
Fix a panic issue while reporting metrics ()
issue: 

/kind bug

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-24 17:37:13 +08:00
jingkl 81d0056e83
[test]modify the diskann testcase ()
Signed-off-by: jingkl <jingjing.jia@zilliz.com>

Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-11-24 16:53:12 +08:00
SimFG 44d45452fa
Make the sync segment request idempotent in the data node ()
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-24 10:21:13 +08:00
SimFG 6d9d24b4ca
Make memory and etcd data as consistent as possible ()
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-24 10:19:12 +08:00
Jenny Li b834cce8c3
Add jenkins e2e cache for conan ()
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-23 19:09:11 +08:00
Bennu 1f65c9f337
[skip e2e] Delete windows code-checker ()
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>

Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-11-23 16:01:12 +08:00
yah01 1eabfdb199
Avoid allocating and coping when fill column with default values ()
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-23 15:15:11 +08:00
Enwei Jiao 958e94f6f0
Use Conan as c++ package manager ()
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-11-23 10:39:11 +08:00
jingkl 5e207c0785
add diskann testcase with search,query ()
Signed-off-by: jingkl <jingjing.jia@zilliz.com>

Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-11-23 09:55:12 +08:00
Jenny Li 8e2083c8a1
[skip e2e]Improve codecov uploader ()
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-23 09:53:21 +08:00
NicoYuan1986 294987741f
Modify test cases by making create index after insert ()
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-11-23 09:51:12 +08:00
congqixia e6c8f9cdee
Add collection delta channel in mutex protection ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-23 09:49:11 +08:00
Ten Thousand Leaves a8c7199a52
Fix segment_num, stored_rows_num and stored_rows_count metrics ()
TODO: better track segment with state other than flushed and dropped.

/kind bug

issue: , 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-22 19:21:13 +08:00
XuanYang-cn d1cb380ee0
Enable to gen compaction plan for stale segments ()
See also: 

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-22 17:33:16 +08:00
yah01 f76ea292d2
Change LRU to a generic type ()
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-22 12:11:11 +08:00
congqixia e35b523a99
Use embed etcd for allocator ut ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-22 09:47:16 +08:00
jaime c761de19bc
Fix broken kafka UT ()
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-21 20:43:13 +08:00
sre-ci-robot 234a4577cf Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-11-21 12:00:59 +00:00
xige-16 1ad702cc40
Reduce the memory used by load disk index ()
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-21 19:35:11 +08:00
wei liu 67403fcb3b
fix mannual balance with empty segment list ()
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-21 19:29:12 +08:00
wayblink b32f99e2e4
Update datanode.segment.insertBufSize default value to 16777216 ()
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-11-21 19:19:11 +08:00