milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,825 Commits
127 Branches
113 Tags
553 MiB
Commit Graph

223 Commits (416bfeafc9722c2d3f05bc9c9d27b870e0eba589)

Author SHA1 Message Date
yukun 604f96ed2b Replace consumers map by sync.map 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-31 10:05:24 +08:00
xige-16 e823b56040 Add retry for seek function 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-30 13:53:49 +08:00
Xiangyu Wang 72917467ec Change singlenode logs output 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-03-30 10:52:42 +08:00
yukun c4f9a6f22b Fix get position wrong 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-27 17:39:12 +08:00
XuanYang-cn 35656ea9ce Update pulsar client version and fix cannot close tcp connection error 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-03-27 13:58:52 +08:00
xige-16 3ab8b9af25 Dlete unlocked mutex in seek function 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-27 11:16:20 +08:00
xige-16 a48d46cfaf Alter msgID’s type to bytes 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-27 09:46:54 +08:00
yukun 432b53149b Refactor msgstream 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-26 20:10:11 +08:00
yukun 85bc2a54f0 Fix load twice hang bug 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-25 18:49:41 +08:00
quicksilver 7ad9b36207 Update reviewdog/action-hadolint github action version to v1.16.1 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-03-25 14:41:46 +08:00
zhenshan.cao c2734fa55f Fix bug and enchance system 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-03-22 16:36:10 +08:00
groot 2280791128 Add memory message stream for search 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2021-03-19 20:16:04 +08:00
yukun 0823382876 Refactor rmq_msgstream 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-19 19:33:21 +08:00
yukun 207f6ae773 Fix rocksmq CreateConsumerGroup 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-16 21:37:25 +08:00
XuanYang-cn 32660d547b Add endPositions in datanode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-03-16 17:55:42 +08:00
Xiangyu Wang fc6472eb08 Implement RocksMQ client 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-03-13 11:46:50 +08:00
godchen f3649f0419 Refactor interface and proto 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-03-12 14:22:09 +08:00
xige-16 09ae985daa Fix wrong error code in master_service_test.go 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-10 22:06:22 +08:00
neza2017 7b2d67242d Fix describe segment if index not exist 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-03-10 14:45:35 +08:00
yukun 0d499a9f99 Fix search waiting for seconds in singlenode 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-09 17:42:13 +08:00
quicksilver 455cc59dbb Update publish-test-images.yaml 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-03-09 13:55:35 +08:00
yukun 33d8e13f96 Fix load-collection in singlenode 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-05 18:14:59 +08:00
sunby ddddd65d10 Delete internal/errors package 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-03-05 10:15:27 +08:00
yukun 36bae90635 Fix singlenode search timeout caused by selectcase in rmq_msgstream 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-03-04 15:53:17 +08:00
xige-16 6cdd4d02fc Refactor seek function 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-04 14:49:51 +08:00
xige-16 795cb74c85 Fix message stream miss ack 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-03-02 13:15:49 +08:00
cai.zhang f5977a1302 Change retry times and add retry logic 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-02-26 15:17:47 +08:00
Cai Yudong 84110d2684 Add tests/benchmark and tests/python_test using new python SDK 
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
 2021-02-25 17:35:36 +08:00
bigsheeper 7cb28428ce Prevent consuming after loading collection 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-25 15:08:50 +08:00
yukun a391d4fbbf Fix stuck problem of create_index 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-25 12:03:35 +08:00
zhenshan.cao 0679954922 Refactor tso and global id allocator 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-24 17:12:06 +08:00
BossZou b02a9d6b43 Enlarge rocksmq stream buffer size 
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
 2021-02-24 15:16:09 +08:00
XuanYang-cn fd562f9f9c Update doc: add proxy graph 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-02-24 09:48:17 +08:00
xige-16 7a7a73e89c Fix high memory usage in pulsarTtStream 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-23 11:40:12 +08:00
sunby ea1d9ea99a Replace log in dataservice 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-23 09:58:06 +08:00
yukun e786ad6aa8 Fix inconsistency of produce msg and consume msg with rmq 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-22 16:34:15 +08:00
sunby b07a371f25 Create a goroutine to receive msg for every consumer 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-22 09:58:34 +08:00
BossZou 7ac1821cf1 Add RocksMQ throughout test 
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
 2021-02-20 18:30:37 +08:00
yukun 346b0a9549 Add unittest for RmqTtMsgStream 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-20 15:58:19 +08:00
sunby 5769c000a1 Find failed python tests and add skip mark "r0.3-test" 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-19 15:37:04 +08:00
bigsheeper d8f41db823 Fix search crash error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-19 13:56:01 +08:00
sunby 5b61182140 Add zap log 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-18 19:53:55 +08:00
groot af3736aff6 Fix rocksmq bug 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2021-02-18 14:13:55 +08:00
xige-16 70fe5233cf Watch queryChannel on query node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-09 17:09:26 +08:00
groot 833f1d49ab Let singlenode use rocksmq 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2021-02-09 15:57:10 +08:00
groot dc3736281a Integrate message stream 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2021-02-08 14:30:54 +08:00
xige-16 2ca53fa668 Fix msgstream deadlock when loadCollection 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-07 15:47:10 +08:00
yukun 563a8d66ae Add RmqTtMsgStream 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-07 15:10:13 +08:00
yukun 099220394e Add rmq_msgstream unittest and fix bugs 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-06 11:39:12 +08:00
XuanYang-cn dd72dfcbd1 Fix queryservice start 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-02-05 17:57:41 +08:00
godchen c231f6da79 Fix collectionName not found error 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-02-05 16:32:03 +08:00
xige-16 57ba236117 Add mutex for message stream’s asConsumer 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-05 15:42:53 +08:00
godchen c2ca2c276f Fix response check error 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-02-04 19:34:35 +08:00
yukun e3fadc45d4 Fix for new msgstream interface 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-04 15:23:21 +08:00
zhenshan.cao b89e5a3240 Add GetQuerySegmentInfo 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-04 14:37:12 +08:00
sunby 71b6c88c6e Defer lock's unlock in meta::DropSegment 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-02-04 11:52:10 +08:00
Xiangyu Wang 8d35e76ad1 Change Msgstream interface 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-02-04 13:55:47 +08:00
godchen 6e7e0b748a Send timetick to insert channel 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-02-03 20:04:29 +08:00
Xiangyu Wang fd9e42d3ed Update msgstream/unmarshal interface 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-02-03 17:30:10 +08:00
bigsheeper abffdbff62 Remove partition tag 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-02-03 16:44:38 +08:00
yukun 35f6f4b7c2 Add consume in rmq_msgstream 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-02-03 15:18:54 +08:00
xige-16 4cd315408b Refactor query service’s meta interface 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-02-02 11:52:41 +08:00
zhenshan.cao c2914dd113 Refactor segment allocator, use collectionID and partitionID 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-31 10:15:54 +08:00
neza2017 854accf95b Remove master and writenode 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-30 16:41:47 +08:00
cai.zhang f940cc455a Add dockerfile for index 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-26 09:38:40 +08:00
FluorineDog a8fd6e7686 Enable drop index/field_data and extract info visitor 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-25 18:59:44 +08:00
yukun 5600d06583 Add global_rmq 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-25 18:53:08 +08:00
neza2017 5aec8bc5e6 Refactor masterservice 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-24 20:26:35 +08:00
neza2017 92e3c519d9 Use FlushCompletedMsg instead 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-23 10:40:34 +08:00
neza2017 e68d50f29e Invalid collection meta caceh && ingore time stamp if not dd request 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-23 10:12:41 +08:00
XuanYang-cn 50e2369000 Change name and tag to ID 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-22 19:36:09 +08:00
XuanYang-cn 377ee8687d Modify flush logic 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-22 09:36:40 +08:00
XuanYang-cn ec27788628 Add segment statistics updates logic for datanode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-21 09:55:25 +08:00
xige-16 76bc365181 Add seek function for pulsarTtMsgStream 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-20 17:34:50 +08:00
BossZou 4588342fa1 Add IdAlocator service 
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
 2021-01-20 15:02:23 +08:00
Xiangyu Wang 7ee8623e1a Refactor msgstream 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-01-20 10:02:59 +08:00
zhenshan.cao 2ec573d2f9 Recover delete docs 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-20 09:36:50 +08:00
cai.zhang fb493cc235 Update interface name of GetIndexStates 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-01-19 18:32:57 +08:00
neza2017 918e279869 Set msg stream 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-19 16:14:13 +08:00
zhenshan.cao 76d92e73d1 Replace old proto with new proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-18 21:39:56 +08:00
xige-16 d22c2cd203 Add proto for query service loading collection 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-18 19:32:08 +08:00
XuanYang-cn 37688559f1 Fix multi rowdata writenode crash bug 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-16 15:06:19 +08:00
Xiangyu Wang 52bd6abdf8 Change RocksMQ interface 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-01-13 17:26:57 +08:00
bigsheeper 2d2af1505a Improve mutex usage in query node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-12 18:03:24 +08:00
GuoRentong f3d2afa4f4 Update doc:detailed interface definition 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-11 18:35:54 +08:00
bigsheeper 01781103a9 Fix incorrect usage of msgStream and illegal check in master 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-11 18:02:22 +08:00
quicksilver a6690dbc99 Fix syntax error: Bad fd number 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-11 15:25:19 +08:00
yukun 18cfd31d40 Fix Load and Remove with prefix 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-11 15:17:06 +08:00
zhenshan.cao 02df310fa5 Fix data race 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-09 12:30:22 +08:00
xige-16 f4566731fc Fix search error in regression test 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-09 09:47:22 +08:00
sunby 5dfe9448ae Modify test_index 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-08 16:00:16 +08:00
GuoRentong 82ad488555 Update doc: rocksmq 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 18:37:24 +08:00
XuanYang-cn 65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-08 17:20:59 +08:00
GuoRentong c4599e26de Update doc: node api 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 16:59:19 +08:00
bigsheeper e13822043d Fix search test when partition not exists, add binary vector search validation 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-08 16:41:27 +08:00
godchen fa73f17f94 Add opentracing doc 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-08 15:32:38 +08:00
dragondriver ced56c84f8 Add support to build binary vector index 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-07 14:56:17 +08:00
godchen 8f1f118b26 Add query opentracing 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-07 14:24:35 +08:00
bigsheeper a1e2ff3c26 Add gcNode to write node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-06 16:44:12 +08:00
neza2017 4015d7245d Merge operation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-06 14:45:50 +08:00