Commit Graph

14770 Commits (8a958e1ea3a619eff4ac2f27f22aad3d99a8b8f8)

Author SHA1 Message Date
Jiquan Long 8a958e1ea3
Fix missing dependencies in install_deps.sh ()
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-24 17:19:59 +08:00
congqixia a0cef3a0a2
Fix sessionutil log always datanode ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-24 16:05:59 +08:00
zhenshan.cao d05c24a0ff
Delete unused code ()
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-24 14:49:59 +08:00
zhenshan.cao 2512e668f7
Update timestmap according to gracefultime for Bounded Consistency ()
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-24 12:05:59 +08:00
yanliang567 8dc43fa811
Add test for numpy files in diff folders ()
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-05-24 10:47:58 +08:00
zhenshan.cao ea8e1623cd
Acquire nq from placeholdergroup incase of nq is zero ()
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-24 10:05:58 +08:00
zhuwenxing f93e5a7d42
[skip e2e]Update replicaCount of etcd for deploy test ()
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-23 22:26:00 +08:00
zhuwenxing 2c15cd3203
[skip e2e]Add checker for chaos test ()
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-23 22:24:05 +08:00
yanliang567 d6d9c9126c
Remove some xfail markers ()
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-05-23 19:55:58 +08:00
ThreadDao e75ee18bc5
[test] Update case get growing segments info ()
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-05-23 19:45:58 +08:00
Bennu fe56ceae6f
[skip e2e] Update monitor dashboard for Proxy, querynode, datanode, indexnode ()
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-05-23 18:09:59 +08:00
zhenshan.cao cce533c246
Fix unitest fail, change default index slice to 16 ()
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-23 17:44:25 +08:00
zhenshan.cao 08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks ()
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
cai.zhang 3685ff9e0c
Mark indexing task to retry when minio occurs error ()
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-23 15:47:58 +08:00
zhenshan.cao 246b22b5ea
Configure indexSliceSize to 16MB ()
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-05-23 15:01:58 +08:00
Xiaofan 65269a4744
Remove rocksmq reader ()
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-23 13:55:59 +08:00
jaime a20e0dfc74
Refactor kafka msgstream implementation ()
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-05-23 12:39:58 +08:00
Bennu 33ddd8bb58
[skip e2e] Add script for building deb package. ()
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-05-23 12:07:58 +08:00
Enwei Jiao d28a2db46c
move arrow from storage to core ()
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
2022-05-22 20:03:58 +08:00
sre-ci-robot e8df5ed406
Update Pytest image changes ()
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-05-21 11:33:58 +08:00
zhuwenxing 5256d2c3f4
[skip e2e]Add script to export containers log one by one ()
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-20 22:53:59 +08:00
jingkl 5344dbd2b6
[test]Modify the testcase with query ()
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-05-20 22:51:58 +08:00
sre-ci-robot 7659968126 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-05-20 12:01:02 +00:00
Bingyi Sun 86728490a2
Fix partition not found ()
issue: 

Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-05-20 19:37:57 +08:00
Jiquan Long e756fdccd4
Fix pool of lexer and parser ()
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-05-20 18:47:57 +08:00
yah01 7746a5b742
Add NodeIds field for QuerySegmentInfo ()
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-20 18:03:58 +08:00
congqixia 90ee23df22
Fix shardLeader cache concurrent access ()
Fix  write map without mutex control
Also GetShards returns a copy of leader list instead of original one

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-20 14:33:57 +08:00
ownbylichaobao 2f8a7e7793
Support tls/ssl connection to etcd () ()
Signed-off-by: lichaobao <1527563274@qq.com>
2022-05-20 12:29:19 +08:00
groot d525e95550
Bulkload not allow duplicate numpy file ()
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-05-20 10:27:56 +08:00
zhuwenxing 4eaacf49f5
[skip e2e]Add bulk load checker for chaos test ()
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-20 09:31:57 +08:00
Letian Jiang 70825a35cf
Make querynode LoadSegments interface idempotent ()
This PR makes the following changes:
* separate LoadSegmentsTask into two phases: PreExecute and Execute
* filters out segments that are already loaded in PreExecute phase

Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-05-20 09:15:57 +08:00
congqixia 599763d9bf
Fix replicas info is not removed after release ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-19 20:05:57 +08:00
cai.zhang e05cfe194e
Fix data race for indexcoord test ()
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-19 17:25:56 +08:00
Jiquan Long 276ba69819
Replace plan parser with antlr ()
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-19 17:15:57 +08:00
yah01 dcfe472586
Fix LoadBalance doesn't save the modification to replicas' shards ()
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-19 16:51:57 +08:00
congqixia ae2864639e
Fix replica freeAll order ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-19 14:53:56 +08:00
congqixia 7eb6fcfb34
Limit the query node timetick log rate ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-19 10:19:56 +08:00
bigsheeper 9eeec4a2d5
Add collection load cache and InvalidateCollMetaCache by collID ()
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-19 10:13:56 +08:00
jingkl 619bab21c5
[test]Add the string testcase of delete ()
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-05-19 09:35:56 +08:00
congqixia b95681770b
Add deferred clean up for ShardCluster ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-18 21:51:56 +08:00
zhuwenxing 1cabaa16a1
[skip e2e]Update multi replicas chaos test ()
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-18 17:57:57 +08:00
zhuwenxing 95bf91795d
[skip e2e]Add util to get milvus instance name ()
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-18 17:56:02 +08:00
jingkl 694f8903cc
[test]Add the string testcase of search and query ()
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-05-18 17:54:01 +08:00
SimFG cf08b5aa11
Fix 'TestChannelManager_StateTransfer' ut when etcd is slow ()
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-05-18 17:19:57 +08:00
Jiquan Long 99b4042f8c
Disable segment small index ()
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-18 15:27:56 +08:00
yah01 33c855dcd2
Fix LoadBalance doesn't remove the source nodes from segment ()
If the triggerCondition isn't NodeDown, the removing won't happen.

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-18 11:55:56 +08:00
XuanYang-cn 127dd34b37
Make proxy use roundrobin to choose replica ()
Fixes: 

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-05-17 22:35:57 +08:00
cai.zhang b37b87eb97
The GetIndexFilePaths interface judges whether the index is complete ()
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-17 20:41:56 +08:00
Jiquan Long 77b0f290a8
Fix prefix match on sealed segment ()
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-17 20:15:55 +08:00
ThreadDao 3cab89c178
[test] Add chaos memory stress test for multiple memory replicas ()
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-05-17 18:23:57 +08:00