bc46e4780d
Fixbug:index is not loaded in some cases ( #5633 )
...
* Fixbug:index is not created in some cases
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Delete unecessary print
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* fix create index
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-06 09:41:35 +08:00
03e3b4beb4
Add log to startup process ( #5594 )
...
* Add log to startup process
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fixbug: avoid ctx exceed deadline
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fmt code
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fix bug: wrong time unit
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fixbug: datanservice client reconnect use time ctx
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-04 16:29:35 +08:00
2ba93deb5e
Support master get segment info channel name from config file ( #5606 )
...
* optimize msgstream unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* get data service segment info channel name from config file directly
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-04 16:28:34 +08:00
99699b2021
Support to show collections which are loaded into memory ( #5567 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-03 19:09:33 +08:00
4018dfc5b7
Support data segment channel seek to the break point when system start ( #5540 )
...
* add DecodeDdOperation
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* reload MsgPosition from etcd and seek when system start
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update testcase
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename const string
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize master unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add msg into dataSegmentChannel to test seek
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix seek test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* roll back distributed/masterservice/masterservice_test.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-02 22:36:41 +08:00
d5cd561449
Add metrics for master ( #5515 )
...
* metric
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* metric
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add MasterDDChannelTimeTick for metrics
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add metrics for all master grpc
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* register metrics
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add metrics register
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add comments for codacy check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix format issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-01 11:04:31 +08:00
5ac726b7b9
use NewTicker instead of NewTimer ( #5503 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-31 14:44:30 +08:00
f80dbab6ec
watch proxynode ( #5424 )
...
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Resolves : #5423
2021-05-26 12:14:30 +00:00
c28c34e852
let master use session.ServerID as nodeID ( #5385 )
...
let master use session.ServerID as nodeID
also see #5386
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
dab536a6cf
Rename some field names in master for better code readability ( #5389 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 06:03:06 +00:00
4058350e30
update AddIndex not return error when fail ( #5372 )
...
Resolves : #5332
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 03:42:23 +00:00
39f8c9dd56
Save msg start position and end position when AddSegment and AddIndex ( #5358 )
...
Resolves : #5332
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-24 06:19:52 +00:00
e326eaad1e
master client,reconnect if grpc failed ( #5360 )
...
master client,reconnect if grpc failed
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-24 01:44:49 +00:00
0eee7e5252
Change session ( #5329 )
...
Change session.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-21 11:28:52 +00:00
761350e44d
Refactor timetick msg handling between proxy node and master ( #5321 )
...
Proxy node send channel timetick msg to master, master reduce timetick
msg for each channel and send the min timetick to msg stream.
Resolves : #5276
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-21 08:08:12 +00:00
c0daf8e41d
set timestamp on dd requests ( #5298 )
...
- set dd request's time tick on master
- send time tick into dd channel
See also: #5291
Signed-off-by: yefu.chen yefu.chen@zilliz.com
2021-05-20 06:14:14 +00:00
e224d1e725
Add SessionManager ( #5288 )
...
Add SessionManager.
Resolves : #5174
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-19 10:36:05 +00:00
49f6542b1d
query master service's with timestamp ( #5275 )
...
let meta support snapshot
so collection could query meta with timestamp
Resolves : #5219
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-18 06:18:02 +00:00
001795ee70
Optimize CreateIndex routine in master service ( #5238 )
...
Remove CreateIndexTask struct and indexTaskQueue
Resolves : #5228
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-15 10:08:08 +00:00
08bb1b2ec3
Resend unsuccessful ddMsg when master start ( #5214 )
...
Resend unsuccessful ddMsg when master start
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-14 21:26:06 +08:00
b74afd7a0e
Add service registration ( #5189 )
...
Add service registration.
Part of Issue #5174 .
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-14 02:05:18 +00:00
82ccd4cec0
Rename module ( #4988 )
...
* Rename module
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
83647e8503
Add copyright in master service module
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-19 11:12:56 +08:00
56d367b1e9
Add unit test for master service
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-09 16:10:12 +08:00
952f70af2a
Clean makefile
...
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-04-09 14:07:03 +08:00
751c9d4e81
Refactor meta.go
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-09 09:55:04 +08:00
8dd3e1e28f
Add unit test for masterservice
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-08 17:31:39 +08:00
a250eb370f
Check request type and add unittest
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-08 15:26:18 +08:00
d7f5c6b1ef
Add benchmark for timtick
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-01 18:05:43 +08:00
a532444da7
Add log when alloc time stamp failed
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-01 11:25:30 +08:00
eca1e25470
Add msg id at master service
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-26 15:13:33 +08:00
7ad9b36207
Update reviewdog/action-hadolint github action version to v1.16.1
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-25 14:41:46 +08:00
c2734fa55f
Fix bug and enchance system
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
ba65c38d40
Fix Deadline Exceeded
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-19 17:50:26 +08:00
9e0fc0b169
Fix ts loop
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-15 15:45:17 +08:00
6eb45c92eb
Fix flush segment
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-13 17:05:36 +08:00
47d9471498
Change gracefultime to 1 second
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-03-13 14:42:53 +08:00
7bb806b5f6
Log msgID and role when log collection
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-13 11:59:24 +08:00
f3649f0419
Refactor interface and proto
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
09ae985daa
Fix wrong error code in master_service_test.go
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
b1763c3690
Disable xdist in test cases
...
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-10 15:27:26 +08:00
7b2d67242d
Fix describe segment if index not exist
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 14:45:35 +08:00
455cc59dbb
Update publish-test-images.yaml
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
014c4fe8ce
Add config of minSegmentSizeToEnableIndex
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-08 15:46:51 +08:00
3ef18e86f0
Add 0331 tag for test_partition
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-06 17:47:11 +08:00
2835bcdc4e
Update masterservice unittest
...
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-05 20:41:34 +08:00
e5d595564a
Add log for singlenode
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-03-05 18:16:50 +08:00
74154a11a4
Fix deploy error during regression stage
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-05 16:52:45 +08:00
ddddd65d10
Delete internal/errors package
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-05 10:15:27 +08:00
3ba0dc2f44
Change doc
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-04 10:35:28 +08:00
zhenshan.cao
Cai Yudong
dragondriver
neza2017
godchen
Xiangyu Wang
sunby
quicksilver
bigsheeper
groot
xige-16
del-zhenwu