milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
14,757 Commits
133 Branches
115 Tags
559 MiB
Commit Graph

14757 Commits (3685ff9e0cfeb7379445b536a213f006f1048f88)

Author SHA1 Message Date
cai.zhang 3685ff9e0c
Mark indexing task to retry when minio occurs error (#17153) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-05-23 15:47:58 +08:00
zhenshan.cao 246b22b5ea
Configure indexSliceSize to 16MB (#17080) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-05-23 15:01:58 +08:00
Xiaofan 65269a4744
Remove rocksmq reader (#17149) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-23 13:55:59 +08:00
jaime a20e0dfc74
Refactor kafka msgstream implementation (#17069) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-05-23 12:39:58 +08:00
Bennu 33ddd8bb58
[skip e2e] Add script for building deb package. (#16929) 
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
 2022-05-23 12:07:58 +08:00
Enwei Jiao d28a2db46c
move arrow from storage to core (#17061) 
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
 2022-05-22 20:03:58 +08:00
sre-ci-robot e8df5ed406
Update Pytest image changes (#17140) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2022-05-21 11:33:58 +08:00
zhuwenxing 5256d2c3f4
[skip e2e]Add script to export containers log one by one (#17138) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2022-05-20 22:53:59 +08:00
jingkl 5344dbd2b6
[test]Modify the testcase with query (#17137) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-05-20 22:51:58 +08:00
sre-ci-robot 7659968126 Update all contributors 
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
 2022-05-20 12:01:02 +00:00
Bingyi Sun 86728490a2
Fix partition not found (#17132) 
issue: #16842

Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-05-20 19:37:57 +08:00
Jiquan Long e756fdccd4
Fix pool of lexer and parser (#17129) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-05-20 18:47:57 +08:00
yah01 7746a5b742
Add NodeIds field for QuerySegmentInfo (#17121) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-05-20 18:03:58 +08:00
congqixia 90ee23df22
Fix shardLeader cache concurrent access (#17120) 
Fix  write map without mutex control
Also GetShards returns a copy of leader list instead of original one

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-20 14:33:57 +08:00
ownbylichaobao 2f8a7e7793
Support tls/ssl connection to etcd (#7703) (#17012) 
Signed-off-by: lichaobao <1527563274@qq.com>
 2022-05-20 12:29:19 +08:00
groot d525e95550
Bulkload not allow duplicate numpy file (#17105) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-05-20 10:27:56 +08:00
zhuwenxing 4eaacf49f5
[skip e2e]Add bulk load checker for chaos test (#17101) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2022-05-20 09:31:57 +08:00
Letian Jiang 70825a35cf
Make querynode LoadSegments interface idempotent (#17109) 
This PR makes the following changes:
* separate LoadSegmentsTask into two phases: PreExecute and Execute
* filters out segments that are already loaded in PreExecute phase

Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-05-20 09:15:57 +08:00
congqixia 599763d9bf
Fix replicas info is not removed after release (#17111) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-19 20:05:57 +08:00
cai.zhang e05cfe194e
Fix data race for indexcoord test (#17057) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-05-19 17:25:56 +08:00
Jiquan Long 276ba69819
Replace plan parser with antlr (#17090) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-19 17:15:57 +08:00
yah01 dcfe472586
Fix LoadBalance doesn't save the modification to replicas' shards (#17064) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-05-19 16:51:57 +08:00
congqixia ae2864639e
Fix replica freeAll order (#17106) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-19 14:53:56 +08:00
congqixia 7eb6fcfb34
Limit the query node timetick log rate (#17065) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-19 10:19:56 +08:00
bigsheeper 9eeec4a2d5
Add collection load cache and InvalidateCollMetaCache by collID (#16882) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-19 10:13:56 +08:00
jingkl 619bab21c5
[test]Add the string testcase of delete (#17085) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-05-19 09:35:56 +08:00
congqixia b95681770b
Add deferred clean up for ShardCluster (#17094) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-18 21:51:56 +08:00
zhuwenxing 1cabaa16a1
[skip e2e]Update multi replicas chaos test (#17084) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2022-05-18 17:57:57 +08:00
zhuwenxing 95bf91795d
[skip e2e]Add util to get milvus instance name (#17081) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2022-05-18 17:56:02 +08:00
jingkl 694f8903cc
[test]Add the string testcase of search and query (#17078) 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-05-18 17:54:01 +08:00
SimFG cf08b5aa11
Fix 'TestChannelManager_StateTransfer' ut when etcd is slow (#17082) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-05-18 17:19:57 +08:00
Jiquan Long 99b4042f8c
Disable segment small index (#16935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-18 15:27:56 +08:00
yah01 33c855dcd2
Fix LoadBalance doesn't remove the source nodes from segment (#17051) 
If the triggerCondition isn't NodeDown, the removing won't happen.

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-05-18 11:55:56 +08:00
XuanYang-cn 127dd34b37
Make proxy use roundrobin to choose replica (#17063) 
Fixes: #17055

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-05-17 22:35:57 +08:00
cai.zhang b37b87eb97
The GetIndexFilePaths interface judges whether the index is complete (#17052) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-05-17 20:41:56 +08:00
Jiquan Long 77b0f290a8
Fix prefix match on sealed segment (#17050) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-17 20:15:55 +08:00
ThreadDao 3cab89c178
[test] Add chaos memory stress test for multiple memory replicas (#17047) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2022-05-17 18:23:57 +08:00
ThreadDao db49d8d7d7
[test][skip-e2e] Update delete cases due to adding string field (#17054) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2022-05-17 18:21:56 +08:00
congqixia 5282397c1b
Fix VectorChunkManager cache enable parameter (#17058) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-17 17:37:55 +08:00
cai.zhang d6bb86dd46
Return buildID when creating index if the index alreay exists (#17045) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-05-17 15:21:57 +08:00
xige-16 c2f1d65fa1
Print err info when insert msg not aligned (#16305) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-05-17 13:01:57 +08:00
yah01 960d35e517
Add MockCluster, make unit tests reliable (#17032) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-05-17 12:57:56 +08:00
XuanYang-cn a1480aaf76
Clear shard leaders cache when releasing (#16942) 
See also: #16926

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-05-17 11:11:56 +08:00
Xiaofan 5355153805
Minio Error is not Handled gracefully (#17003) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-16 19:25:55 +08:00
Xiaofan 327bd6abbe
Support Txn interface in rockskv (#17027) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-05-16 19:17:55 +08:00
xige-16 935b729a0c
Fix multiple deletes not taking effect (#17033) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-05-16 18:39:56 +08:00
congqixia ffff291018
Fix Handoff log in shardCluster service (#17039) 
Fix #17035

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-16 18:29:56 +08:00
congqixia 94f0951f0d
Fix query lock logic in query shard (#17034) 
Previously query shard locks the querylock in collectionReplica before any search/query
The lock range is too large and easy to cause dead lock

This PR makes following changes:
- Rename collectionReplica to metaReplica which is more reasonable
- Make release collection operation cancels waiting search/query request
- Reduce the queryLock to collection level
- Add some unit tests for timeout & released case

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-16 18:23:55 +08:00
Bingyi Sun 59bc0a7000
Add some log. (#16978) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-05-16 17:15:55 +08:00
yah01 e38c6f6c44
Fix load the same segments multiple times for manual LoadBalance (#16921) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-05-16 15:41:56 +08:00