Commit Graph

149 Commits (1c49ddc86aa67611a367c83154176d54fa38e88d)

Author SHA1 Message Date
neza2017 c28c34e852
let master use session.ServerID as nodeID (#5385)
let master use session.ServerID as nodeID

also see #5386 

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-25 07:06:05 +00:00
Cai Yudong dab536a6cf
Rename some field names in master for better code readability (#5389)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 06:03:06 +00:00
Cai Yudong 4058350e30
update AddIndex not return error when fail (#5372)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-25 03:42:23 +00:00
Cai Yudong 39f8c9dd56
Save msg start position and end position when AddSegment and AddIndex (#5358)
Resolves: #5332 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-24 06:19:52 +00:00
neza2017 e326eaad1e
master client,reconnect if grpc failed (#5360)
master client,reconnect if grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-24 01:44:49 +00:00
godchen 0eee7e5252
Change session (#5329)
Change session.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-21 11:28:52 +00:00
Cai Yudong 761350e44d
Refactor timetick msg handling between proxy node and master (#5321)
Proxy node send channel timetick msg to master, master reduce timetick
msg for each channel and send the min timetick to msg stream.

Resolves: #5276 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-21 08:08:12 +00:00
sunby c1efa53779
Remove redundant fields in SegmentInfo and related structure (#5280)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-05-21 06:51:25 +00:00
neza2017 c0daf8e41d
set timestamp on dd requests (#5298)
- set dd request's time tick on master
- send time tick into dd channel

See also: #5291

Signed-off-by: yefu.chen yefu.chen@zilliz.com
2021-05-20 06:14:14 +00:00
godchen e224d1e725
Add SessionManager (#5288)
Add SessionManager.
Resolves: #5174 

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-19 10:36:05 +00:00
neza2017 d68ee3fbc2
query base on timeline (#5279)
query base on timeline, add timestamp on these queries:
- ShowCollections
- HasCollection
- DescribeCollection

Resolves: #5219

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-18 09:12:17 +00:00
neza2017 49f6542b1d
query master service's with timestamp (#5275)
let meta support snapshot
so collection could query meta with timestamp

Resolves: #5219

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-05-18 06:18:02 +00:00
Cai Yudong e8ceb37f81
Add ShardsNum when create collection (#5245)
Updata PhysicalChannelNames and VirtualChannelNames based
on ShardsNum when create collection, and update collVChan2Chan
map.

Resolves: #5240 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-17 11:15:01 +00:00
Cai Yudong 001795ee70
Optimize CreateIndex routine in master service (#5238)
Remove CreateIndexTask struct and indexTaskQueue

Resolves: #5228 

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-15 10:08:08 +00:00
Cai Yudong 08bb1b2ec3
Resend unsuccessful ddMsg when master start (#5214)
Resend unsuccessful ddMsg when master start

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-14 21:26:06 +08:00
godchen b74afd7a0e
Add service registration (#5189)
Add service registration.
Part of Issue #5174.

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-05-14 02:05:18 +00:00
Cai Yudong 7b83b11e95
Save ddmsg info and type into ETCD (#5173)
Save ddmsg info and type into ETCD to support re-send ddmsg 
when system restart or recover from failure (#5172)

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-05-12 07:33:53 +00:00
neza2017 262c484cec
the return struct of "DescribeIndex" should contain "filed_name" (#5055)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-27 02:30:55 +00:00
neza2017 d7c0a72611
index name is unique in collection scope (#5046)
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-04-26 15:53:47 +08:00
Xiangyu Wang 82ccd4cec0
Rename module (#4988)
* Rename module

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-22 14:45:57 +08:00
neza2017 83647e8503 Add copyright in master service module
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-19 11:12:56 +08:00
godchen deba964590 Change name of kvBase
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-04-12 18:09:28 +08:00
neza2017 e760605187 Add unit test for master service, the coverage of meta table reachs 100%
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-12 15:03:23 +08:00
neza2017 15f26f653e Add unit test for master service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-10 10:53:58 +08:00
neza2017 56d367b1e9 Add unit test for master service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-09 16:10:12 +08:00
Cai Yudong 952f70af2a Clean makefile
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2021-04-09 14:07:03 +08:00
sunby 751c9d4e81 Refactor meta.go
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-04-09 09:55:04 +08:00
neza2017 8dd3e1e28f Add unit test for masterservice
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-08 17:31:39 +08:00
neza2017 a250eb370f Check request type and add unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-08 15:26:18 +08:00
Xiangyu Wang 87a1e0b662 Reorganize msgstream
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-04-02 13:48:25 +08:00
neza2017 d7f5c6b1ef Add benchmark for timtick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-01 18:05:43 +08:00
neza2017 a532444da7 Add log when alloc time stamp failed
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-04-01 11:25:30 +08:00
zhenshan.cao efbf4452c5 Add log for port changed or proto unmarshal error
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-30 20:19:30 +08:00
neza2017 536a0e33d6 Fix meta table, dead lock
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-27 19:46:00 +08:00
neza2017 eca1e25470 Add msg id at master service
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-26 15:13:33 +08:00
quicksilver 7ad9b36207 Update reviewdog/action-hadolint github action version to v1.16.1
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-25 14:41:46 +08:00
zhenshan.cao c2734fa55f Fix bug and enchance system
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-03-22 16:36:10 +08:00
bigsheeper ba65c38d40 Fix Deadline Exceeded
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-03-19 17:50:26 +08:00
neza2017 1d105ae451 Tag test case of test_connect.py::TestConnect::test_close_repeatedly
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-16 11:19:56 +08:00
neza2017 9e0fc0b169 Fix ts loop
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-15 15:45:17 +08:00
neza2017 6eb45c92eb Fix flush segment
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-13 17:05:36 +08:00
groot 47d9471498 Change gracefultime to 1 second
Signed-off-by: groot <yihua.mo@zilliz.com>
2021-03-13 14:42:53 +08:00
sunby 7bb806b5f6 Log msgID and role when log collection
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-13 11:59:24 +08:00
godchen f3649f0419 Refactor interface and proto
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-03-12 14:22:09 +08:00
xige-16 09ae985daa Fix wrong error code in master_service_test.go
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-03-10 22:06:22 +08:00
neza2017 aee7c74762 Fix override index name
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 16:21:49 +08:00
del-zhenwu b1763c3690 Disable xdist in test cases
Signed-off-by: del-zhenwu <zhenxiang.li@zilliz.com>
2021-03-10 15:27:26 +08:00
neza2017 7b2d67242d Fix describe segment if index not exist
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-03-10 14:45:35 +08:00
quicksilver 455cc59dbb Update publish-test-images.yaml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-03-09 13:55:35 +08:00
sunby 76480fcefe Change default log output to stdout
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-03-08 16:24:55 +08:00