Commit Graph

14723 Commits (b37b87eb9799ee2105d81c1ae41e9695e8b5b7c5)

Author SHA1 Message Date
cai.zhang b37b87eb97
The GetIndexFilePaths interface judges whether the index is complete (#17052)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-17 20:41:56 +08:00
Jiquan Long 77b0f290a8
Fix prefix match on sealed segment (#17050)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-17 20:15:55 +08:00
ThreadDao 3cab89c178
[test] Add chaos memory stress test for multiple memory replicas (#17047)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-05-17 18:23:57 +08:00
ThreadDao db49d8d7d7
[test][skip-e2e] Update delete cases due to adding string field (#17054)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2022-05-17 18:21:56 +08:00
congqixia 5282397c1b
Fix VectorChunkManager cache enable parameter (#17058)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-17 17:37:55 +08:00
cai.zhang d6bb86dd46
Return buildID when creating index if the index alreay exists (#17045)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-17 15:21:57 +08:00
xige-16 c2f1d65fa1
Print err info when insert msg not aligned (#16305)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-17 13:01:57 +08:00
yah01 960d35e517
Add MockCluster, make unit tests reliable (#17032)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-17 12:57:56 +08:00
XuanYang-cn a1480aaf76
Clear shard leaders cache when releasing (#16942)
See also: #16926

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-05-17 11:11:56 +08:00
Xiaofan 5355153805
Minio Error is not Handled gracefully (#17003)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-16 19:25:55 +08:00
Xiaofan 327bd6abbe
Support Txn interface in rockskv (#17027)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-16 19:17:55 +08:00
xige-16 935b729a0c
Fix multiple deletes not taking effect (#17033)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-16 18:39:56 +08:00
congqixia ffff291018
Fix Handoff log in shardCluster service (#17039)
Fix #17035

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-16 18:29:56 +08:00
congqixia 94f0951f0d
Fix query lock logic in query shard (#17034)
Previously query shard locks the querylock in collectionReplica before any search/query
The lock range is too large and easy to cause dead lock

This PR makes following changes:
- Rename collectionReplica to metaReplica which is more reasonable
- Make release collection operation cancels waiting search/query request
- Reduce the queryLock to collection level
- Add some unit tests for timeout & released case

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-16 18:23:55 +08:00
Bingyi Sun 59bc0a7000
Add some log. (#16978)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-05-16 17:15:55 +08:00
yah01 e38c6f6c44
Fix load the same segments multiple times for manual LoadBalance (#16921)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-16 15:41:56 +08:00
zhuwenxing 5f1d7c5267
[skip e2e]Update issue template (#17020)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-16 13:33:55 +08:00
sre-ci-robot b7e40f7532
Update Pytest image changes (#17017)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-05-16 13:31:55 +08:00
exia 01d5580d34
proxy support tls document (#16891)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-05-16 12:21:55 +08:00
XuanYang-cn 2c005400fd
Update pymilvus version to 2.1.0.dev57 (#16977)
Existing alias without host and port are valid params

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-05-16 11:21:55 +08:00
yanliang567 ab9b091bb1
Refine bulk load tests with data preparation (#16998)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-05-16 09:55:55 +08:00
yongpengli-z aefff31ba8
modify index test cases to 2.0 (#17000)
Signed-off-by: yongpengli-z <yongpeng.li@zilliz.com>
2022-05-15 20:43:55 +08:00
zhuwenxing c052892e27
[skip e2e]Update multi replicas chaos test (#16981)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-15 20:41:59 +08:00
zhuwenxing 6090a4e78e
[skip e2e]Update the way of reconnection (#16970)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-15 20:39:58 +08:00
Xiaofan 338edcd3cc
Load binlog for different field in parallel (#17005)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-15 16:11:54 +08:00
SimFG ea2c395a38
Fix the comment info in task_test.go (#16982)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-05-15 09:03:54 +08:00
jaime 328ab7ecf6
Fix kafka client hang after killing broker pod of parition leader (#16983)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-05-14 23:05:54 +08:00
congqixia 23f7ef931c
Remove not used QueryService (#16973)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-13 20:27:54 +08:00
sre-ci-robot 5b658349c4 Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-05-13 12:00:45 +00:00
congqixia ec66ac69ac
Simplify chunk manager in QueryShard (#16976)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-13 19:55:54 +08:00
yah01 a382133a8a
Add new node into the replica which has the most of offline nodes (#16907)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-05-13 18:31:54 +08:00
Xiaofan 52fc9a558c
Fix valid error message (#16953)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-13 18:19:53 +08:00
Jiquan Long ca3ecec5b5
Fix ut data race (#16939)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-13 17:43:53 +08:00
yongpengli-z a4038d9f0c
Modify index test cases by comment (#16969)
Signed-off-by: yongpengli-z <yongpeng.li@zilliz.com>
2022-05-13 17:33:57 +08:00
groot 168935f4cf
Fix bulkload bug for string primary key (#16958)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-05-13 16:07:54 +08:00
jingkl 18b4480ca0
[skip e2e]Delete duplicate file with search (#16975)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-05-13 15:59:53 +08:00
Letian Jiang f0dee539bb
Improve query shard log (#16950)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-05-13 13:45:53 +08:00
wayblink 77d06bd071
[skip ci]Fix a minor mistake (#16966)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Co-authored-by: wayblink <anyang.wang@zilliz.com>
2022-05-13 12:37:53 +08:00
XuanYang-cn 43b36b4e5f
Make proxy update cache with NotShardLeader status code (#16940)
See also: #16926

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-05-13 11:35:53 +08:00
Jiquan Long c5149c7e85
Replace text codec of pb with binary codec (#16955)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-13 09:53:53 +08:00
Ten Thousand Leaves 63385b7c12
Make data queryable and data indexed states as independent flags (#16837)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-12 19:23:53 +08:00
zhuwenxing cd6f539948
[skip e2e]Add utils to get node id and corresponding pod name (#16952)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-05-12 18:49:53 +08:00
congqixia ae717bf991
Fix channelUnsubscribe data race and logic (#16946)
- Add a RWMutex for container/list which is not goroutine-safe
- Fix the element in list is never removed

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-12 18:09:53 +08:00
jingkl 2d3981c98c
[test]Add the testcase of index (#16931)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-05-12 16:15:54 +08:00
Chenglong.li ab59d94e4a
[skip e2e]Add log export instructions for issue template (#16917)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2022-05-12 15:49:53 +08:00
Bennu d3d907c0a5
[skip e2e] Solve the problem of file residue when uninstalling rpm (#16928)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2022-05-12 15:03:53 +08:00
xige-16 08ad77c71b
Delete all repeated primary keys (#16863)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-12 14:09:53 +08:00
Letian Jiang b3eb2b1d0d
Support deltaLog loading on growing segment (#16903)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-05-12 11:59:53 +08:00
congqixia a8b81e215b
Fix deadlock in release replica (#16925)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-05-11 21:57:53 +08:00
jingkl 3579ae8240
[test]Add the string testcase of index and query (#16884)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-05-11 21:55:53 +08:00