cebdfb34f7
Enable multiple datanode ( #5068 )
...
Now it's able to start multiple datanode, however, they will process the same insert data.
Further changes are needed to truly enable multiple datanode:
While registering, dataservice need to return different insert channels for different datanode.
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-04-28 18:43:48 +08:00
74f457bd14
add more testcase to improve code coverage for data service ( #5041 )
...
* fix TestChannel run error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* comment validateAllocRequest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add test APIs
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-26 01:45:54 +00:00
4d03da9c4f
Remove `SetSegmentState` and seal segment in segment allocator ( #4994 )
...
Segment should be sealed once it exceeds the limited size. This operation
should be done in segment allocator. Watcher only check the status to
decide whether the segment will be flushed.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-25 01:51:57 +00:00
ada58b5bde
add unit test for master's grpc server, the coverage of package "internal/distributed/masterservice" increase from 46.6% to 82.9% ( #5019 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-24 09:23:35 +00:00
5a75e23795
improve data service code coverage ( #5020 )
...
* optimize TestAssignSegmentID
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update mockMasterService to improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename client to kvClient in Server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update server.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TestChannel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-24 03:29:15 +00:00
111376ba40
improve code coverage for data service ( #4998 )
...
* rename mock.go to mock_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add allocator_test.go to improve code coverage
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update meta_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update watcher_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix race
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-04-23 02:15:30 +00:00
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
fad94fb576
Remove unsed configs ( #4990 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-22 03:04:59 +00:00
b79a408491
Remove unused config item in dataservice and datanode
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-19 19:28:45 +08:00
0f2f46f39d
Add copyright
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-19 11:35:38 +08:00
83647e8503
Add copyright in master service module
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-19 11:12:56 +08:00
94c3fc9321
Add unit tests in dataservice
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-16 16:30:55 +08:00
a7dac818ee
Refactor datanode register
...
Dataservice should not be stalled during registering datanode.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-13 09:47:02 +08:00
deba964590
Change name of kvBase
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-12 18:09:28 +08:00
61edc53faf
Refactor data service segment allocator
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-12 16:35:51 +08:00
751c9d4e81
Refactor meta.go
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-09 09:55:04 +08:00
6e70ce3f66
Add cluster unit tests
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-08 15:08:34 +08:00
7bad0a01e9
Fix bug: unmarshal got unexpected EOF
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-31 13:55:51 +08:00
efbf4452c5
Add log for port changed or proto unmarshal error
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-30 20:19:30 +08:00
a78cd3e2a7
Add proxy service timetick loop to expire allcoations
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-27 14:01:52 +08:00
5ccf0c3d70
Add log for segment row estimate
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-03-27 11:35:42 +08:00
a48d46cfaf
Alter msgID’s type to bytes
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-27 09:46:54 +08:00
7ad9b36207
Update reviewdog/action-hadolint github action version to v1.16.1
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-25 14:41:46 +08:00
972dad4d8e
Add Flush segment optimization
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-24 14:43:38 +08:00
51f669f1cb
Flush segments concurrently & change etcd meta
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-23 18:50:13 +08:00
25f3e520f9
Add testcase for index
...
Signed-off-by: 紫晴 <ting.wang@zilliz.com>
2021-03-23 16:57:59 +08:00
c2734fa55f
Fix bug and enchance system
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
f4d055cf42
Add global mutex for segment allocate
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-20 20:41:39 +08:00
32660d547b
Add endPositions in datanode
...
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-03-16 17:55:42 +08:00
f3649f0419
Refactor interface and proto
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
ca916a5c47
Add ci nightly
...
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2021-03-11 14:14:29 +08:00
09ae985daa
Fix wrong error code in master_service_test.go
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
b1763c3690
Disable xdist in test cases
...
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-10 15:27:26 +08:00
7b2d67242d
Fix describe segment if index not exist
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 14:45:35 +08:00
455cc59dbb
Update publish-test-images.yaml
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
76480fcefe
Change default log output to stdout
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 16:24:55 +08:00
ab21115d54
Init rand.Seed
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 15:25:55 +08:00
aeb3038545
Remove GetCount in data service
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 10:49:44 +08:00
2835bcdc4e
Update masterservice unittest
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-05 20:41:34 +08:00
e5d595564a
Add log for singlenode
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-03-05 18:16:50 +08:00
74154a11a4
Fix deploy error during regression stage
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 16:52:45 +08:00
ddddd65d10
Delete internal/errors package
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
dec0b40a66
Add log panic in log module
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-04 16:01:30 +08:00
ae432436db
Init start position when opening new segment
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-02 15:52:42 +08:00
d3db2b0d82
Add zap log in query service
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-02-27 10:11:52 +08:00
7b9fdd7f29
Add opentracing
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-02-26 17:44:24 +08:00
f5977a1302
Change retry times and add retry logic
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-02-26 15:17:47 +08:00
e95cb78ec8
Add LoadCollection from master
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-26 09:23:39 +08:00
84110d2684
Add tests/benchmark and tests/python_test using new python SDK
...
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-02-25 17:35:36 +08:00
c149995bcd
Change return value of GetCollectionStatistics.
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-02-24 17:56:03 +08:00
XuanYang-cn
Cai Yudong
sunby
neza2017
Xiangyu Wang
godchen
zhenshan.cao
xige-16
quicksilver
紫晴
ThreadDao
del-zhenwu
bigsheeper
cai.zhang