Commit Graph

152 Commits (33d8e13f9650462c7b59f1d2efbdfe99065e4224)

Author SHA1 Message Date
yukun 33d8e13f96 Fix load-collection in singlenode
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-03-05 18:14:59 +08:00
sunby ddddd65d10 Delete internal/errors package
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
yukun 36bae90635 Fix singlenode search timeout caused by selectcase in rmq_msgstream
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-03-04 15:53:17 +08:00
xige-16 6cdd4d02fc Refactor seek function
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-04 14:49:51 +08:00
xige-16 795cb74c85 Fix message stream miss ack
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-02 13:15:49 +08:00
cai.zhang f5977a1302 Change retry times and add retry logic
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-26 15:17:47 +08:00
Cai Yudong 84110d2684 Add tests/benchmark and tests/python_test using new python SDK
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-02-25 17:35:36 +08:00
bigsheeper 7cb28428ce Prevent consuming after loading collection
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-25 15:08:50 +08:00
yukun a391d4fbbf Fix stuck problem of create_index
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-25 12:03:35 +08:00
zhenshan.cao 0679954922 Refactor tso and global id allocator
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-24 17:12:06 +08:00
BossZou b02a9d6b43 Enlarge rocksmq stream buffer size
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
2021-02-24 15:16:09 +08:00
XuanYang-cn fd562f9f9c Update doc: add proxy graph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-24 09:48:17 +08:00
xige-16 7a7a73e89c Fix high memory usage in pulsarTtStream
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-23 11:40:12 +08:00
sunby ea1d9ea99a Replace log in dataservice
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-23 09:58:06 +08:00
yukun e786ad6aa8 Fix inconsistency of produce msg and consume msg with rmq
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-22 16:34:15 +08:00
sunby b07a371f25 Create a goroutine to receive msg for every consumer
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-22 09:58:34 +08:00
BossZou 7ac1821cf1 Add RocksMQ throughout test
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
2021-02-20 18:30:37 +08:00
yukun 346b0a9549 Add unittest for RmqTtMsgStream
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-20 15:58:19 +08:00
sunby 5769c000a1 Find failed python tests and add skip mark "r0.3-test"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
bigsheeper d8f41db823 Fix search crash error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00
sunby 5b61182140 Add zap log
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-18 19:53:55 +08:00
groot af3736aff6 Fix rocksmq bug
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-18 14:13:55 +08:00
xige-16 70fe5233cf Watch queryChannel on query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-09 17:09:26 +08:00
groot 833f1d49ab Let singlenode use rocksmq
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-09 15:57:10 +08:00
groot dc3736281a Integrate message stream
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-08 14:30:54 +08:00
xige-16 2ca53fa668 Fix msgstream deadlock when loadCollection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-07 15:47:10 +08:00
yukun 563a8d66ae Add RmqTtMsgStream
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-07 15:10:13 +08:00
yukun 099220394e Add rmq_msgstream unittest and fix bugs
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-06 11:39:12 +08:00
XuanYang-cn dd72dfcbd1 Fix queryservice start
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-05 17:57:41 +08:00
godchen c231f6da79 Fix collectionName not found error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-05 16:32:03 +08:00
xige-16 57ba236117 Add mutex for message stream’s asConsumer
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-05 15:42:53 +08:00
godchen c2ca2c276f Fix response check error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-04 19:34:35 +08:00
yukun e3fadc45d4 Fix for new msgstream interface
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-04 15:23:21 +08:00
zhenshan.cao b89e5a3240 Add GetQuerySegmentInfo
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-04 14:37:12 +08:00
sunby 71b6c88c6e Defer lock's unlock in meta::DropSegment
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-04 11:52:10 +08:00
Xiangyu Wang 8d35e76ad1 Change Msgstream interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-04 13:55:47 +08:00
godchen 6e7e0b748a Send timetick to insert channel
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-03 20:04:29 +08:00
Xiangyu Wang fd9e42d3ed Update msgstream/unmarshal interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-03 17:30:10 +08:00
bigsheeper abffdbff62 Remove partition tag
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 16:44:38 +08:00
yukun 35f6f4b7c2 Add consume in rmq_msgstream
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-03 15:18:54 +08:00
xige-16 4cd315408b Refactor query service’s meta interface
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-02 11:52:41 +08:00
zhenshan.cao c2914dd113 Refactor segment allocator, use collectionID and partitionID
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-31 10:15:54 +08:00
neza2017 854accf95b Remove master and writenode
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-30 16:41:47 +08:00
cai.zhang f940cc455a Add dockerfile for index
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-26 09:38:40 +08:00
FluorineDog a8fd6e7686 Enable drop index/field_data and extract info visitor
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-25 18:59:44 +08:00
yukun 5600d06583 Add global_rmq
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-01-25 18:53:08 +08:00
neza2017 5aec8bc5e6 Refactor masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-24 20:26:35 +08:00
neza2017 92e3c519d9 Use FlushCompletedMsg instead
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-23 10:40:34 +08:00
neza2017 e68d50f29e Invalid collection meta caceh && ingore time stamp if not dd request
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-23 10:12:41 +08:00
XuanYang-cn 50e2369000 Change name and tag to ID
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-22 19:36:09 +08:00