milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
10,438 Commits
146 Branches
120 Tags
575 MiB
Commit Graph

189 Commits (c019e80dbb14abdcf3e775125213a166eb955835)

Author SHA1 Message Date
sunby 6fc64b836a
[skip ci]Add comment for SetBinlogs (#9667) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-11 21:04:42 +08:00
congqixia 02dc2a2453
Add GetVChanPosition new cases ut (#9544) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-09 20:57:33 +08:00
sunby 1e0c3cbcb9
[skip ci]Add comment for SetCurrentRows (#9526) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-09 00:16:56 +08:00
sunby 7834649dbc
[skip ci]Add comment for AddAllocation (#9525) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-09 00:15:13 +08:00
sunby 292aeeac63
[skip ci]Add comment for SetAllocations (#9524) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-09 00:13:21 +08:00
godchen 937dbf4279
Add flushed segments (#9476) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-08 19:09:12 +08:00
sunby 006303285f
Fix a nil pointer bug and improve comments (#7625) 
Issue: #7624
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-08 19:05:25 +08:00
congqixia d828a63c94
[skip ci] Add comment for SegmentsInfo AddBinglogPaths (#9386) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-08 17:31:50 +08:00
congqixia 2711b53d57
Apply collection start position (#9459) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-08 14:51:13 +08:00
sunby e7e481444b
Check error returned by server stop (#9015) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-08 10:09:02 +08:00
sunby f705281884
Check error returned by ExpireAllocations (#9016) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-08 10:07:02 +08:00
sunby 21655d54be
[skip ci]Add comment for AddSegmentBinlogs (#9389) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 18:32:50 +08:00
sunby ad15e786cc
[skip ci]Add comment for SetStartPosition (#9399) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:59:31 +08:00
sunby d5081783c3
[skip ci]Add comment for SetDmlPosition (#9398) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:57:47 +08:00
sunby d41cdbb909
[skip ci]Add comment for SetState (#9397) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:55:53 +08:00
sunby cc794354b5
[skip ci]Add comment for SetRowCount (#9394) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:54:12 +08:00
sunby 82ff4563b3
[skip ci]Add comment for SegmentInfoOption (#9393) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:52:17 +08:00
sunby 41633aee0a
[skip ci]Add comment for ShadowClone (#9391) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:50:14 +08:00
sunby ad6b06ed85
[skip ci]Add comment for Clone (#9390) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:48:00 +08:00
sunby 6c0b38eb5a
[skip ci]Add comment for SetExpireTime (#9395) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:45:29 +08:00
godchen d08370d06b
[skip ci]Fix meta go comment typo (#9378) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-10-07 10:36:03 +08:00
godchen 5c14f96dc4
[skip ci]Fix cluster go comment typo (#9377) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-10-07 10:32:13 +08:00
congqixia 5031f09073
[skip ci] Add detail comment for SegmentsInfo (#9332) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-06 17:20:07 +08:00
sunby 5467240fca
[skip ci]Add comment for SetFlushTime (#9295) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-05 22:36:48 +08:00
sunby a1a69a8fef
[skip ci]Add comment for SetBinlogs (#9293) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-05 22:34:49 +08:00
sunby 88b4439fdf
[skip ci]Add comment for package datacoord (#9014) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-05 22:33:01 +08:00
sunby a51533de7f
[skip ci]Add comment for SetCurrentRows (#9294) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-05 22:28:38 +08:00
congqixia 768535f31c
Add positionProvider implementation assertion (#9261) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-05 20:58:04 +08:00
congqixia 423f6584da
[skip ci] Add comment for Datacoord SegmentsInfo allocation (#9260) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-05 15:29:03 +08:00
zhenshan.cao 45d6b8dcd0
[skip ci] Fix golint error in datacoord (#9184) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-04 17:16:54 +08:00
zhenshan.cao 5fcae9d956
[skip ci] Fix golint error in datacoord (#9191) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-04 13:20:51 +08:00
godchen 2792f85211
Handle server error (#9032) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-03 22:17:56 +08:00
congqixia e20445987e
Add Datacoord Server implementation Assertion (#9143) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-03 19:44:11 +08:00
sunby 68b26326d3
[skip ci]Modify comment for Init in param table (#9142) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-03 17:51:55 +08:00
sunby c54599ae6f
[skip ci]Modify comment for SetState (#9141) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-03 17:50:03 +08:00
sunby 7448904c8a
[skip ci]Modify comment in param table (#9140) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-03 17:38:14 +08:00
godchen f18e0628ae
Make NewMeta private (#9057) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-02 23:09:56 +08:00
congqixia a5cd484ff2
Add Manager implemenation assertion (#9038) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-02 14:45:56 +08:00
congqixia 2044e5eacb
Add ClusterStore implementation assertion (#9037) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-01 23:48:54 +08:00
sunby 6f08430cb8
Check error in server test (#9012) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-01 21:00:46 +08:00
sunby 332025aace
Check error in server_test.go (#9011) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-01 20:58:10 +08:00
Xiaofan 2c2b800ff4
Change Log Name with NodeId (#8721) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 08:52:50 +08:00
congqixia a11f9b7eb5
Add log for Flush to print return segments with CollectionID (#8928) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-30 18:12:25 +08:00
congqixia 1cb2e2153f
[skip ci] Fix AllocationPolicy golint (#8883) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-29 20:52:09 +08:00
zhenshan.cao d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-29 20:26:00 +08:00
sunby 2ea7c0af25
Check error in datacoord server test (#8802) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-28 22:04:06 +08:00
sunby eee075b10e
Check error in server test (#8801) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-28 21:54:14 +08:00
congqixia d374ea71ba
Unify liveness check in datacoord and datanode (#8480) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-28 16:10:04 +08:00
sunby 745221e87d
Check error in segment_manager.go (#8705) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-27 22:46:12 +08:00
sunby e5bc8e7050
Check error in MoveSegmentBinlogs (#8704) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-27 22:44:18 +08:00
sunby c152cf2b6b
Check error in segment_manager_test.go (#8706) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-27 22:42:02 +08:00
congqixia ffbfaf7f76
Apply collection start position when open segment (#8697) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-27 20:34:03 +08:00
sunby d1dead500c
Check error in allocator test (#8621) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-27 10:46:08 +08:00
sunby 75767d58b3
Remove useless codes in datacoord (#8619) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-26 21:54:07 +08:00
Xiaofan d38adda8c2
Rename log file based on node id (#8517) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 21:18:11 +08:00
dragondriver 019f18ddf9
Expose created time and updated time to datacoord metrics (#8172) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-26 17:50:07 +08:00
zhenshan.cao 5390136cd6
[skip ci] Fix golint error of services.go in datacoord (#8524) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-24 21:33:55 +08:00
congqixia ca62b1e149
Use clone instead of ShadowClone when update pb data (#8461) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-24 12:53:54 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-23 10:53:53 +08:00
sunby 3fc1b9cf9f
Change copyright (#8318) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 20:12:08 +08:00
sunby 82dd762ef0
Change copyright (#8317) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-22 19:59:59 +08:00
cai.zhang 79b7dcc75a
Add trace log for insert (#8301) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-22 19:33:54 +08:00
Xiaofan 0c35cd57b0
Unify param table to the same naming format (#8254) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-20 23:27:52 +08:00
congqixia 21f15d66bb
Add option for DataNode creation (#8240) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-18 19:10:07 +08:00
Xiangyu Wang c314b2b4a8
Remove unused label rules (#7929) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-18 18:19:51 +08:00
Yusup ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
congqixia 266db4c883
Add readme for datacoord (#8141) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-17 23:57:55 +08:00
congqixia 01c8341a2e
[skip ci]Add comments for SegmentManager (#8087) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-16 19:55:49 +08:00
congqixia 2bca69596e
Add some comment for SegmentsInfo (#7995) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 21:07:53 +08:00
congqixia c76f91233f
Put errors together (#7958) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 21:05:52 +08:00
sunby eed856d626
Change error message to lower case (#7890) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-14 17:33:48 +08:00
sunby 9c2fb0bccb
Recorrect comment for Allocation (#7887) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-14 17:27:55 +08:00
congqixia 85d73358cc
Remove ctx from LongTermChecker (#7792) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-13 16:50:57 +08:00
congqixia e2c15d5b01
[skip ci]Add comment for ClusterStore (#7785) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-13 15:59:55 +08:00
congqixia d3be316bc2
Add Comment for datacoord cluster (#7676) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-10 11:26:00 +08:00
Xiangyu Wang 42aafdc407
Remove unused msg from msg.go (#7612) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-09 19:56:00 +08:00
sunby 49b6c3101d
Remove datacoord useless code (#7673) 
Issue: #7624
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-09 19:08:03 +08:00
congqixia c96b19a640
Add datacoord metricsinfo unit test (#7595) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-09 10:16:00 +08:00
dragondriver 9b21b3b5fd
Initialize test framework of proxy (#7563) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-09 10:06:29 +08:00
congqixia 664aeb09c6
Add ut and comments for datacoord meta (#7560) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-08 11:35:59 +08:00
congqixia 5b22697ec4
Add segment manager unit tests (#7525) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-07 13:59:58 +08:00
bigsheeper b7103357fd
Load failed if collection beyonds the memory limit (#7434) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-09-07 11:35:18 +08:00
congqixia fb4e23bc79
Add datacoord server unit tests (#7499) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-06 17:02:41 +08:00
congqixia 1f590d6c26
Add datacoord services related unit tests (#7467) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-06 11:12:42 +08:00
dragondriver 960741ee16
Support more detailed metrics information (#7472) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 19:35:47 +08:00
dragondriver 1db573731b
Cache the system information metrics (#7436) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 17:15:26 +08:00
dragondriver 3721cbfea1
Proxy metrics integrates with other coordinators (#7400) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 17:35:00 +08:00
dragondriver 89748ac639
Expose metrics of data cluster (#7177) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 10:13:15 +08:00
congqixia 0281bd8d22
Change context to correct package (#7331) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-27 15:37:56 +08:00
Xiangyu Wang c62f23e201
[skip ci]Remove neza2017 from reviewers (#7324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-27 00:27:36 +08:00
sunby 4d56d53c0b
Add a tool to move binlog path to SegmentInfo (#7243) 
issue: #7214
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-24 15:51:51 +08:00
Xiaofan 58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
congqixia f5451d12f3
Refactor datacoord allocator (#7226) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-23 17:59:51 +08:00
congqixia be5c492e5a
Add datacoord unit tests (#7197) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-20 17:50:12 +08:00
sunby 6e34f4c7f1
Add a seal policy which restrict the lifetime of a segment (#7172) 
issue: #7164
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-20 15:42:12 +08:00
sunby 3cc210da26
Add flush interval (#6996) 
Time tick message is sent about per 0.2 seconds. DataCoord will call
`FlushSegment` too frequently. We add a min interval for segment flush. A
segment will called `FlushSegment` only once between the interval.

issue: #6995
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-19 14:08:10 +08:00
sunby 4f7c3e7d3a
Save binlog path in SegmentInfo (#6590) 
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-19 13:00:12 +08:00
sunby 9551dc3b7e
Fix segment auto flush bug (#7085) 
issue: #7084
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-16 11:00:09 +08:00
XuanYang-cn 6c5be83ea1
Refactor NewEtcdKV API (#7075) 
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-13 11:04:09 +08:00
sunby 5c383d1d02
Add a checker to listen for the timetick. (#7061) 
issue: #7060
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-08-12 19:58:08 +08:00