Commit Graph

166 Commits (902307327bccf7ff7eda9e12700ce49c3e087a23)

Author SHA1 Message Date
xige-16 861576f77a Checkout field ids when load segment in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-22 10:44:38 +08:00
BossZou 7ac1821cf1 Add RocksMQ throughout test
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
2021-02-20 18:30:37 +08:00
BossZou ae0e8b1a19 Init data service param before new DataServive
Signed-off-by: BossZou <yinghao.zou@zilliz.com>
2021-02-20 16:45:49 +08:00
cai.zhang 5c8747cf40 Make proxy retry time more frequently
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-20 16:14:10 +08:00
yukun 346b0a9549 Add unittest for RmqTtMsgStream
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-20 15:58:19 +08:00
neza2017 1d3fdebcf4 Add drop index for proxy
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-02-20 15:38:44 +08:00
zhenshan.cao d404d87633 Fix bug of getindexstate
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-19 09:52:06 +08:00
groot dc3736281a Integrate message stream
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-08 14:30:54 +08:00
zhenshan.cao faa23fde86 Fix getindexstate failed to fetch indexstate
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-08 14:20:29 +08:00
zhenshan.cao 2c9e226703 Add log for segment logic in proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-07 16:44:11 +08:00
sunby eba5b9ae27 Fix queryservice client init bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-07 13:53:40 +08:00
bigsheeper b07b2484dc Fix error when loading
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-07 10:29:58 +08:00
dragondriver 8f4995dab5 Fix DropCollection task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-07 09:56:39 +08:00
zhenshan.cao 39161cac9a Add collectonScheam when calling load_collection and load_partition
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-06 21:17:18 +08:00
groot b034740c6c Make paramstable initialize once by using do_once
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-06 13:39:15 +08:00
dragondriver 6ef82a59e5 Fix the bug when close the message stream of InsertTask
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 13:49:51 +08:00
godchen 0f620ab149 Fix invalidate metacache error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-05 11:49:13 +08:00
dragondriver e384222803 Fix the logic of node id allocator
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 11:25:52 +08:00
bigsheeper 1578c13224 Refactor collection replica
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-05 10:53:11 +08:00
bigsheeper 2ee54541aa Fix query node address
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-05 10:25:47 +08:00
sunby 9c3ea487f6 Fix close insert msg stream bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-05 10:19:52 +08:00
godchen c2ca2c276f Fix response check error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-04 19:34:35 +08:00
cai.zhang 4f2a1e7912 Fix bug for dataservice dockerfile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-04 18:11:19 +08:00
dragondriver e0e8e1605e Implement the release-related task and load-related task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-04 17:47:19 +08:00
XuanYang-cn 560d2350ae Fix datanode watchDmChannel bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 16:09:34 +08:00
godchen d6200a5196 Fix meta cache error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-04 15:54:16 +08:00
cai.zhang 55634dc5f3 Add interface of load and release collection and partition
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-04 15:31:02 +08:00
zhenshan.cao b89e5a3240 Add GetQuerySegmentInfo
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-04 14:37:12 +08:00
sunby 71b6c88c6e Defer lock's unlock in meta::DropSegment
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-04 11:52:10 +08:00
Xiangyu Wang 8d35e76ad1 Change Msgstream interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-04 13:55:47 +08:00
XuanYang-cn 1aafe86ffe Change MsgPosition Logic
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 11:19:48 +08:00
dragondriver b92ff69cea Implement GetIndexState in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-04 11:08:36 +08:00
XuanYang-cn bc7ad02df4 Fix datanode init bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 10:25:01 +08:00
godchen 6e7e0b748a Send timetick to insert channel
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-03 20:04:29 +08:00
sunby e7588d3250 Implement getSegmentInfo interfaces
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-03 19:45:52 +08:00
Xiangyu Wang fd9e42d3ed Update msgstream/unmarshal interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-03 17:30:10 +08:00
bigsheeper abffdbff62 Remove partition tag
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 16:44:38 +08:00
dragondriver 6c3f169ecc Add collection id and partition id to insert & search workflow
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-03 16:40:23 +08:00
zhenshan.cao b853020ef9 Remove redudent ctx and openTracing logic
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-03 16:34:56 +08:00
godchen 66d5189601 Add get collection statistics implemetation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-02 19:54:31 +08:00
Xiangyu Wang 32c5a92449 Update interface in msgstream
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-02 16:32:15 +08:00
dragondriver e4e3ec88d1 Add usage count of insert channels
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-02 15:49:13 +08:00
zhenshan.cao 3afa7dd50d Fix GetSegmentStates
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-02 10:58:39 +08:00
godchen 94dfab5b21 Check collection whether exists before drop
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-01 10:53:13 +08:00
godchen abcc565311 Add proxy metacache
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-31 14:55:36 +08:00
zhenshan.cao c2914dd113 Refactor segment allocator, use collectionID and partitionID
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-31 10:15:54 +08:00
neza2017 854accf95b Remove master and writenode
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-30 16:41:47 +08:00
dragondriver 996111bf8c Refactor insert channels used in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-30 15:30:38 +08:00
dragondriver 454c05f2de Implement the InvalidateCollectionMetaCacheTask in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-30 10:40:22 +08:00
dragondriver f660caca0c Refactor the client interface of proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-29 17:29:31 +08:00
zhenshan.cao ee0faddb07 Refactor proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-29 09:27:26 +08:00
dragondriver 7957170220 Dock Proxy with other service component
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-28 20:51:44 +08:00
dragondriver c6a6b1436c Add soft time tick in proxy service
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-26 13:41:41 +08:00
zhenshan.cao aef4e41e91 Enable proxynode microbatch pulsar msg and enable parallel test
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-23 20:58:46 +08:00
dragondriver cd52adc18b Add proxy service to ci workflow
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 12:57:23 +08:00
dragondriver eba6bb288c Refactor the sructure of proto file
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-22 09:36:18 +08:00
Xiangyu Wang 7ee8623e1a Refactor msgstream
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-20 10:02:59 +08:00
zhenshan.cao 76d92e73d1 Replace old proto with new proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-18 21:39:56 +08:00
xige-16 d22c2cd203 Add proto for query service loading collection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-18 19:32:08 +08:00
XuanYang-cn 37688559f1 Fix multi rowdata writenode crash bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-16 15:06:19 +08:00
sunby 67e6ea8051 Add data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-15 17:09:41 +08:00
bigsheeper b98b226d8c Refactor query node and implement channelRemove, channelAdd
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-15 15:28:54 +08:00
godchen 0971cf65b2 Remove opentracing stdlog
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-15 15:28:27 +08:00
quicksilver 7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-15 14:38:36 +08:00
neza2017 56ab2bda2d Update proto:add partition id
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-15 11:53:22 +08:00
zhenshan.cao 63b21321d6 Refactor indexservice and update doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-15 13:50:27 +08:00