Commit Graph

176 Commits (81d3546b7ce83f62850001795071a1a7a8bbe682)

Author SHA1 Message Date
sunby ae432436db Init start position when opening new segment
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-02 15:52:42 +08:00
bigsheeper d3db2b0d82 Add zap log in query service
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-27 10:11:52 +08:00
godchen 7b9fdd7f29 Add opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-26 17:44:24 +08:00
cai.zhang f5977a1302 Change retry times and add retry logic
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-26 15:17:47 +08:00
sunby e95cb78ec8 Add LoadCollection from master
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-26 09:23:39 +08:00
Cai Yudong 84110d2684 Add tests/benchmark and tests/python_test using new python SDK
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-02-25 17:35:36 +08:00
sunby c149995bcd Change return value of GetCollectionStatistics.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-24 17:56:03 +08:00
XuanYang-cn fd562f9f9c Update doc: add proxy graph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-24 09:48:17 +08:00
zhenshan.cao bbfcbbdd68 Fix ci: paramstable and startup logic refactor
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-23 11:40:30 +08:00
sunby ea1d9ea99a Replace log in dataservice
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-23 09:58:06 +08:00
sunby 5769c000a1 Find failed python tests and add skip mark "r0.3-test"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-19 15:37:04 +08:00
bigsheeper d8f41db823 Fix search crash error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-19 13:56:01 +08:00
sunby 5b61182140 Add zap log
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-18 19:53:55 +08:00
sunby c74221e4da Change ttMsgStream of dataservice to MsgStream
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-08 16:42:56 +08:00
groot dc3736281a Integrate message stream
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-08 14:30:54 +08:00
sunby 6ee6557981 Record segment flushed state
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-07 14:51:52 +08:00
groot b034740c6c Make paramstable initialize once by using do_once
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-02-06 13:39:15 +08:00
sunby 0111cba8ae Fix startup bugs in some modules
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-06 10:28:53 +08:00
dragondriver 75e549da4e Change sdk version used in regression to 0.0.19
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-05 10:09:03 +08:00
XuanYang-cn a64c4efde9 Refactor collectionReplica in datanode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 20:31:23 +08:00
sunby be596123d1 Fix dataservice startup
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-04 20:03:19 +08:00
godchen c2ca2c276f Fix response check error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-04 19:34:35 +08:00
cai.zhang 4f2a1e7912 Fix bug for dataservice dockerfile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-04 18:11:19 +08:00
dragondriver e0e8e1605e Implement the release-related task and load-related task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-02-04 17:47:19 +08:00
sunby 7270d18c98 Fix timesync startup bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-04 17:31:02 +08:00
yukun e3fadc45d4 Fix for new msgstream interface
Signed-off-by: yukun <kun.yu@zilliz.com>
2021-02-04 15:23:21 +08:00
zhenshan.cao b89e5a3240 Add GetQuerySegmentInfo
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-04 14:37:12 +08:00
sunby 71b6c88c6e Defer lock's unlock in meta::DropSegment
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-04 11:52:10 +08:00
Xiangyu Wang 8d35e76ad1 Change Msgstream interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-04 13:55:47 +08:00
XuanYang-cn 1aafe86ffe Change MsgPosition Logic
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 11:19:48 +08:00
XuanYang-cn bc7ad02df4 Fix datanode init bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-02-04 10:25:01 +08:00
godchen 6e7e0b748a Send timetick to insert channel
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-03 20:04:29 +08:00
sunby e7588d3250 Implement getSegmentInfo interfaces
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-03 19:45:52 +08:00
zhenshan.cao 1b616fb874 Add persistent_segmentinfo
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-03 18:55:00 +08:00
Xiangyu Wang fd9e42d3ed Update msgstream/unmarshal interface
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-02-03 17:30:10 +08:00
bigsheeper abffdbff62 Remove partition tag
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-03 16:44:38 +08:00
sunby 208700b0e7 Set fixed insert channel number, remove channel manager
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-03 15:07:48 +08:00
sunby f3aad3a71c Change SegmentInfo
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 18:53:10 +08:00
sunby ca9c2f5c12 Add GetCount and implement GetCollectionStatistics
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 14:25:58 +08:00
sunby 46f14a5e69 Fix bugs in GetInsertChannels
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-02 11:14:17 +08:00
zhenshan.cao 3afa7dd50d Fix GetSegmentStates
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-02-02 10:58:39 +08:00
godchen 93fd6b70f3 Fix the error usage of ttmsg
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-01 19:22:35 +08:00
sunby a74767fe57 Fix bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-01 16:20:13 +08:00
Xiangyu Wang 99cef4b5c8 Add Distributed main entrypoint
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-01-29 17:08:31 +08:00
bigsheeper 73d2b6a101 Get index param from minio and filter by vector fields
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-29 15:22:24 +08:00
sunby f088467dde Add watcher_test and fix some bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 10:14:31 +08:00
neza2017 2ebeade25e Fix get component states
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-28 17:13:00 +08:00
sunby 2be8cc1c4b Add index params serde to IndexCodec
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 16:41:24 +08:00
sunby bcd7368533 Fix get component states
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 15:20:24 +08:00
sunby 5ac463c9ca Add datanode client in data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-28 11:24:41 +08:00
bigsheeper 68cd15af63 Get index info from master
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-27 14:41:56 +08:00
dragondriver a0226c09f0 Change the logic node id allocator in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-27 13:52:01 +08:00
sunby b4bcaaf847 Fix data service startup bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-27 11:40:10 +08:00
xige-16 947976dbec Add test for query service’s load function
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-27 11:34:16 +08:00
sunby dbfe68512d Add dbID to data service proto
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-27 10:33:17 +08:00
sunby a3adb22e10 Change params
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-27 09:59:17 +08:00
neza2017 8c54af292e Add dd handler
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 17:55:15 +08:00
XuanYang-cn 0b1c4f0420 Add building datanode cmd in Makefile
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-26 17:40:26 +08:00
sunby 9f72633fd9 Add dd handler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 17:06:13 +08:00
sunby 3b08162059 Add main function
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-26 15:14:49 +08:00
neza2017 5af23cf018 Init params and add segment start/end position
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-26 09:43:41 +08:00
bigsheeper 7554246ace Add segment seeking and use real client
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-25 18:33:10 +08:00
sunby 7c0c835b49 Init params and add segment start/end position
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-25 15:16:28 +08:00
neza2017 1fe099775d Refactor data service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 15:17:17 +08:00
neza2017 e89e89b894 Add main for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-25 12:03:44 +08:00
sunby 54fcd486bb Refactor data service.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-25 13:45:56 +08:00
XuanYang-cn 9fe672ab86 Enchance datanode interface
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-24 21:20:11 +08:00
neza2017 5aec8bc5e6 Refactor masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-24 20:26:35 +08:00
sunby 82d6fb18b8 Add init params returned to data node
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-23 20:22:59 +08:00
sunby c23e2de435 Implment data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-23 14:41:29 +08:00
sunby 2f7319cdbb Add interfaces with other modules
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-22 19:43:27 +08:00
sunby ef79b8d8c7 Add client and grpc service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-22 11:07:07 +08:00
sunby 7e8162a79e Add dd handler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 15:35:40 +08:00
sunby 76a7684d96 Add data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-19 12:10:49 +08:00
xige-16 d22c2cd203 Add proto for query service loading collection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-01-18 19:32:08 +08:00
sunby 67e6ea8051 Add data service
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-15 17:09:41 +08:00