c863a193de
Rename filename from dataservice to datacoordinator ( #5946 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-22 10:42:07 +08:00
8643127e99
Change grpc retry ( #5925 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-22 09:46:06 +08:00
7f2d7c1da3
Rename dataservice to datacoordinator ( #5912 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 18:22:13 +08:00
0300b682f8
Remove deprecated interfaces in data coordinator ( #5929 )
...
* Remove derecated interfaces in data coordinator
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove RegisterNode in data coordinator
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 17:40:05 +08:00
92e429d812
Rename IndexService to IndexCoord ( #5932 )
...
* rename package indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix queryservice static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move distributed/indexservice to distributed/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move internal/indexservice to internal/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename MasterComponent to RootCoordComponent
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for queryservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for dataservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for datanode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for proxynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for querynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix rebase issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-21 17:28:03 +08:00
2642415bc3
Redefine the auto_id and primary_key ( #5903 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-21 11:42:18 +08:00
da1f9f9241
Rename dataservice to datacoordinator ( #5904 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-21 11:40:15 +08:00
e4c51aae36
Add recovery logic for querynode and queryservice ( #5843 )
...
* merge milvus/recovery2
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add recovery logic in queryservice
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug smoke case
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add etcd to querynode
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix release partition error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix load balance error
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* debug querynode down and recovery
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* add log
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* fix showCollection
Signed-off-by: xige-16 <xi.ge@zilliz.com>
* skip smoke test search without insert
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-06-19 11:45:09 +08:00
5a1f7e4feb
rename masterservice to rootcoord ( #5875 )
...
* rename masterservice to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix build error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename package
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename masterservice to rootcoord under distributed
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update scripts
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable more unittests
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-18 21:30:08 +08:00
710ac1a4f1
remove query node id env dependency and fix start script ( #5874 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-06-18 19:00:15 +08:00
2f8bccda8d
Improve help message ( #5870 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-18 16:16:06 +08:00
676a30e418
Use channelsMgr to manage search message stream ( #5819 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-06-18 10:33:58 +08:00
b2908c4780
Release collection ( #5839 )
...
* relese collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* gen-proto
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* release collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* release collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-17 17:45:56 +08:00
ae3daff5e4
Rename Master to RootCoord ( #5830 )
...
* rename master_service.go to root_coordinator.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coordinator under cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord under cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord for metrics
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename service to coord for masterservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix metrics unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* roll back cmd
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-17 16:47:57 +08:00
b7bf26b486
Update grpc trace ( #5817 )
...
* Update grpc trace
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove useless code in mod
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-17 14:17:56 +08:00
5ce06de3d1
Add context usage and fix defer issue ( #5796 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-16 18:35:59 +08:00
5c69c6902d
Refactor proxy channelTimeTick and fix search timeout ( #5760 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:36 +08:00
0f4bd50ce3
Support ETCD endpoints array ( #5755 )
2021-06-15 16:36:36 +08:00
17b19233dc
add BroadcastMany, send DdMsg to collection channels only ( #5734 )
...
* add BroadcastMany, send DdMsg to collection channels only
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix master unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix time tick of masterservice
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix time tick unittest of masterservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* skip dataservice ut
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix format issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update timeticksync
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update timeticksync
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update SendDdXXXReq interface
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update master unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* roll back unecessary change
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* enable ut
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-15 16:36:36 +08:00
f74ea3beee
[skip ci] Remove ProxyService ( #5738 )
...
* [skip ci] Remove ProxyService
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Change helm branch
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fix bug: paramstable crashed
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:36:35 +08:00
33a43f48c8
[skip ci] Fix bug: Search timeout and refactor client init logic ( #5735 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-15 16:24:48 +08:00
7d9f299ff6
Change default unregister policy ( #5710 )
...
* Change default unassign policy
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix gofmt
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-15 16:06:13 +08:00
189ac881f3
Fix bugs ( #5676 )
...
* Remove redundant session startup
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Register datanode after start success
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix meta snap shot
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix datanode message stream channel
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix bugs when drop empty collection
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Fix bug of getting pchan statistics from task scheduler
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix i/dist/dataservice test code
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix epoch lifetime not applied
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* fix datanode flowgraph dd node
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix handle datanode timetick bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove repack function of dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Apply extended seal policy
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add check for time tick
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix check
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix the repack function of dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix the bug when send statistics of pchan
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Fix the repack function when craete dml stream
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix bugs
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* fix describe collection
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix bug when send timestamp statistics
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* fix data node
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Add length check before flush request
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add log for data node
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix SaveBinlog bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Add more log in datanode
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Put SegmentState.Flushing as the last one in enum to fit the client
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Fix params in GetInsertBinlogPaths
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Rename policy
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Remove unused ddl functions and fields
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Remove pchan when drop collection
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
* Add balanced assignment policy
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* fix master ut
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Add lock in session manager
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* add log for debug
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* Fix some logic bug and typo
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* Fix recover bugs
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Get collection scheme of a specific timestamp
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Change CheckPoint to SegmentInfo in VchannelInfo
Signed-off-by: sunby <bingyi.sun@zilliz.com>
* Recover Unflushed segment numOfRows
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* Fix dataservice unit tests
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-15 16:06:11 +08:00
a948b71e06
Support to send dd msg to all dml channels ( #5597 )
...
* send dd msg to dml channel
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add dml_channels.go
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix race
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 16:04:48 +08:00
275881dbdb
Remove address param ( #5556 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-15 16:04:46 +08:00
54ab03e28f
Fix queryservice connect error ( #5526 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-15 15:59:04 +08:00
62eaa0390a
Add dataservice metrics with grpc prometheus middleware ( #5523 )
...
* Add dataservice metrics with grpc prometheus middleware
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
* register server metrics
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-06-15 15:59:04 +08:00
2cc330b117
Remove proxy service from master ( #5510 )
...
* remove proxy service
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove time sync
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove proxy service
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove proxy service
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove proxy service
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* remove proxy service from distributed/masterservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-15 15:59:04 +08:00
a14c35274f
Fix bugs in dataservice ( #5457 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-15 15:59:04 +08:00
55eac3ee7f
Complete Flush procedure in DataNode ( #5454 )
...
* Complete Flush proceduer in DataNode
Resolves : #5220
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix unittest
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-06-15 15:59:04 +08:00
cdbc6d2c94
Refactor query node and query service ( #5751 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-15 12:41:40 +08:00
50b3d39370
Add GetRecoveryInfo interface and proto ( #5598 )
...
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-06-07 14:16:36 +08:00
03e3b4beb4
Add log to startup process ( #5594 )
...
* Add log to startup process
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fixbug: avoid ctx exceed deadline
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fmt code
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fix bug: wrong time unit
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Fixbug: datanservice client reconnect use time ctx
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-04 16:29:35 +08:00
2ba93deb5e
Support master get segment info channel name from config file ( #5606 )
...
* optimize msgstream unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* get data service segment info channel name from config file directly
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-04 16:28:34 +08:00
afa5da7df0
Add query rpc into proto ( #5592 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-06-04 12:02:34 +08:00
b0b8f58192
Fix bug: search timeout ( #5557 )
...
* Fix bug: search timeout
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
* Add log and fix unittest bug
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-06-03 14:58:34 +08:00
ca0993c274
Update OWNERS
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-30 18:58:47 +08:00
a606ab9c67
Add power-off restart logic for IndexService and IndexNode ( #5395 )
...
Add power-off restart logic for IndexService and IndexNode
Signed-off-by: <xiaocai2333> <cai.zhang@zilliz.com>
2021-05-27 14:24:29 +00:00
6e3a0d2a8e
Add queryservice grpc retry ( #5437 )
...
Add queryservice grpc retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 10:44:36 +00:00
220c12e12f
Add indexservice grpc retry ( #5425 )
...
Add indexservice grpc retry.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:12:13 +00:00
279d77020a
Change proxy grpc retry ( #5431 )
...
Change proxy grpc retry.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-27 07:10:39 +00:00
9aa1fd25fa
Add indexnode grpc retry ( #5418 )
...
Add indexnode grpc retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-27 02:30:11 +00:00
f80dbab6ec
watch proxynode ( #5424 )
...
watch proxy node and,
send InvalidataCollectionMetaCache to each proxynode
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
Resolves : #5423
2021-05-26 12:14:30 +00:00
5fd92ec80c
Add querynode grpc retry ( #5428 )
...
Add querynode grpc retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-26 11:37:34 +00:00
bfa683ce79
Change dataservice grpc retry ( #5411 )
...
Change dataservice grpc retry.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:55:05 +00:00
5f0f840782
Remove datanode client code ( #5427 )
...
Remove datanode client code.
Signed-off-by: godchen qingxiang.chen@zilliz.com
2021-05-26 10:41:37 +00:00
200801271d
Fix GetSession error ( #5401 )
...
Fix GetSession error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 12:15:46 +00:00
17cabfbed3
Add datanode client retry ( #5394 )
...
Add datanode client retry.
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-25 07:47:08 +00:00
c28c34e852
let master use session.ServerID as nodeID ( #5385 )
...
let master use session.ServerID as nodeID
also see #5386
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
88b42304ef
Add dummy RPC ( #5376 )
...
Adding a dummy RPC makes it easier to develop new RPCs in the future.
When developing a new function, the SDK is often implemented last.
At this time, this is helpful for debugging.
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-05-25 06:44:43 +00:00
sunby
godchen
Cai Yudong
dragondriver
xige-16
bigsheeper
congqixia
neza2017
zhenshan.cao
XuanYang-cn
Xiangyu Wang
cai.zhang