milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
14,497 Commits
130 Branches
115 Tags
556 MiB
Commit Graph

438 Commits (88d11b958b219637ac71e657a16cfb570744ca07)

Author SHA1 Message Date
Xiangyu Wang 006a095370
Improve import statements (#13437) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-15 19:57:13 +08:00
edward.zeng dbae087d21
[skip ci] Refine datacoord garbage collector comment (#13430) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-15 18:25:43 +08:00
edward.zeng f44ede7b9d
[skip ci] Refine datacoord meta comment (#13432) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-15 16:57:23 +08:00
xige-16 97d5231a0a
Reorganize querycoord proto (#13181) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-15 16:53:12 +08:00
xiangzhou.guo 5e644a780c
correct spelling error (#13409) 
Signed-off-by: xiangzhou.guo <xiangzhou.guo@zilliz.com>
 2021-12-15 16:47:13 +08:00
Bingyi Sun 5c2302d711
Improve compaction log (#13394) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-15 16:07:10 +08:00
Bingyi Sun bd03236b79
Improve log (#13396) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-15 16:03:12 +08:00
Bingyi Sun 663a3aa333
Improve compaction log (#13395) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-15 16:01:11 +08:00
xiangzhou.guo a87e690d53
Correct spelling error in code comment (#13413) 
Signed-off-by: xiangzhou.guo <xiangzhou.guo@zilliz.com>
 2021-12-15 15:59:17 +08:00
xiangzhou.guo 78d583a3bb
Correct spelling error (#13412) 
Signed-off-by: xiangzhou.guo <xiangzhou.guo@zilliz.com>
 2021-12-15 15:57:09 +08:00
Bingyi Sun fcd1ee9c8e
Improve log (#13397) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-15 13:15:10 +08:00
edward.zeng f8b85c4646
[skip ci] Refine datacoord cluster comment (#13408) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-15 11:58:31 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-15 11:47:10 +08:00
Bingyi Sun 0c39e0370c
Move segment statistics update to datanode tt loop (#13233) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-15 10:53:16 +08:00
Bingyi Sun f480b314d9
Improve compaction log (#13393) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-15 10:43:15 +08:00
Bingyi Sun 4a5aa1cfea
Improve datacoord log (#13392) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-15 10:41:27 +08:00
congqixia 3b4d114b71
Add comment for DataCoord startFlushLoop (#13379) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-15 09:45:09 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-14 15:31:07 +08:00
congqixia 8476791492
Process only flushed/flushing segment in global compaction (#13339) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-14 15:15:10 +08:00
Bingyi Sun 3a2aace6f0
Fix ci issue caused by only compact flushed segments (#13317) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-14 13:55:07 +08:00
edward.zeng 6593e277f7
[skip ci] Refine datacoord metrics info comment (#13114) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-09 22:14:14 +08:00
edward.zeng d323b3bd84
[skip ci] Refine datacoord handler comment (#13113) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-09 22:10:23 +08:00
edward.zeng 4459611126
[skip ci] Refine datacoord meta comment (#13112) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-09 22:07:10 +08:00
XuanYang-cn a9a332dbcf
Fix empty segment compact and load (#12710) 
1. Fix compaction save empty segment bug
2. Fix load empty segment bug
3. Add UT for dmlchannels to 100%

Resolves: #12450

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-09 11:03:08 +08:00
Bingyi Sun a78b2010e9
[skip ci]Improve log style (#13008) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-08 20:27:06 +08:00
Bingyi Sun 48c5632277
[skip ci]Improve log style (#13007) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-08 20:25:15 +08:00
Bingyi Sun 320cfbb606
[skip ci]Improve log style (#13006) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-08 20:19:26 +08:00
congqixia aea5a61e9a
Add switch for auto compaction (#12974) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-08 19:47:05 +08:00
edward.zeng 260d3e124d
[skip ci] Refine datacoord channel store comment (#12991) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-08 17:57:05 +08:00
edward.zeng 2e84eef229
[skip ci] Refine datacoord channel manager comment (#12989) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-08 17:53:22 +08:00
edward.zeng 8ca248dce6
[skip ci] Refine datacoord allocator comment (#12985) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-08 17:35:06 +08:00
congqixia de454956fe
Refactor session WatchSessions to allow rewatch when Rev Compacted (#12880) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-08 10:11:04 +08:00
JackLCL f90410fe8e
[skip ci]Fix error log output format in segment_manager.go (#12856) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-07 14:36:27 +08:00
JackLCL de00aa038a
[skip ci]Fix error log output format in meta.go (#12854) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-07 14:32:51 +08:00
congqixia 22fddc537c
Fix not all segment state is drop after DropVirtualChannel (#12702) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-03 18:55:34 +08:00
congqixia 58664bb6b9
Fix zero length slice declaration in datacoord/channel_manager.go (#12582) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-02 19:17:38 +08:00
edward.zeng f8c826c597
Fix typo in datacoord compaction trigger (#12636) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-02 19:09:37 +08:00
congqixia 8f9e62fa18
Apply DropVirtualChannel and FlushManager drop mode (#12563) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-02 16:39:33 +08:00
Bingyi Sun 0778e6f715
Fix alloc segment with dropped segment (#12572) 
issue: #12465
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-01 22:39:37 +08:00
godchen 5e3e3b3b41
Remove grpc returned error (#12537) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-12-01 22:17:46 +08:00
edward.zeng 5db458a44e
[skip ci] Add license for data coord compaction (#12561) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-01 19:33:32 +08:00
edward.zeng 446b5a3a48
[skip ci] Refine datacoord cluster comment (#12562) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-01 19:29:31 +08:00
Bingyi Sun 7ff15490c9
[skip ci]Add comment for GetVChanPosition (#12495) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-30 23:15:33 +08:00
Bingyi Sun 27898928b0
[skip ci]Modify WatchChannels comment in services.go (#12417) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@gmail.com>
 2021-11-29 23:09:41 +08:00
congqixia 06ced4d1d1
Add DropVirtualChannel for DataCoord (#12361) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-29 22:35:41 +08:00
congqixia eb48013042
Set start position for compact result segment (#12280) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-25 17:19:17 +08:00
congqixia 2ee0c7c074
Add compacted segment into check list when drop collection (#12272) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-25 15:13:15 +08:00
bigsheeper e245ba87a9
Add excluded segments for dropped segemnts (#12247) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-25 14:25:15 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-24 15:43:15 +08:00
congqixia 7b870e3392
Limit datacoord gc scan prefixes (#12231) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-24 09:55:15 +08:00
congqixia 8e0c8febe9
Add dropped segment ids in vchaninfo (#12230) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-23 18:59:15 +08:00
Bingyi Sun 3be9442c0f
Clear dropped segment meta on etcd (#12191) 
issue: #9613
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-23 11:23:15 +08:00
Bingyi Sun 01be91116e
Add GetFlushState interface (#12170) 
issue: #12075
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-23 10:55:14 +08:00
congqixia 8c107ab15f
Set segment DroppedAt when compacted (#12182) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 20:11:14 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 16:23:17 +08:00
shaoyue 6777d24c65
[skip ci] Add comment for exported items (#12126) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-19 18:05:25 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-19 13:57:12 +08:00
congqixia dfc70108c4
Add load collection for AssignSegmentID (#12077) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:31:34 +08:00
congqixia b99164f43d
Add datacoord GC configuration (#12061) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:29:40 +08:00
Bingyi Sun 175a656ff1
Unwatch dropped channel when init channel manager (#11986) 
issue: #11558
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-17 23:25:12 +08:00
XuanYang-cn 7dbb4d10e5
Fix DeltaLogs empty yet appending a deltaInfo bug (#11984) 
- Add more logs for startpositions

Fixes: #11970

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-17 17:57:11 +08:00
congqixia 5edbb82610
Add session revoke (#11908) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-16 22:31:14 +08:00
Bingyi Sun e3e4dc7153
Improve GetVChanPosistion and fix unit tests (#11888) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-16 21:41:50 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
congqixia 7e43b568ee
Add dropped ts and apply when gc scan dropped segments (#11838) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-16 14:23:21 +08:00
shaoyue 6322eb31e7
[skip ci] Add comments for exported things in policy.go (#11876) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-11-16 13:21:16 +08:00
Bingyi Sun b8c5239784
Add compaction retention config (#11793) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-16 11:47:10 +08:00
Bingyi Sun 8b60aa8c4e
Skip single compaction if there's no delta log in a segment (#11806) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-16 11:23:11 +08:00
Bingyi Sun 902e856a06
[skip ci]Remove redundancy log (#11732) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-15 10:25:09 +08:00
congqixia d38043f235
Filter with partition id in GetVChanPosition (#11746) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-13 08:45:09 +08:00
Xiaofan 71e814f796
Remove common.yaml and component.yaml (#11661) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-12 21:25:08 +08:00
bigsheeper 93149c5ad9
Load growing segment in query node (#11664) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-11-12 18:27:10 +08:00
Bingyi Sun 5c8978e5d6
Fix drop segment bug (#11709) 
issue: #11708
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-12 17:31:11 +08:00
Bingyi Sun 54b40da4c5
Add segment drop logic (#11621) 
issue: #11558
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-12 00:22:42 +08:00
Bingyi Sun 002b854590
Move compaction and garbage switch to milvus.yaml (#11654) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-11 23:38:42 +08:00
Bingyi Sun 7a3873960b
Fix watch channel with nil seek position (#11650) 
issue: #11649
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-11 19:32:43 +08:00
Bingyi Sun 5574a104c9
Add triggerInfo in compactionTask (#11517) 
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-11 15:54:42 +08:00
godchen 5357e301f4
Fix retrieve search error (#11501) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-11 00:54:45 +08:00
Bingyi Sun f01063a020
[skip ci]Add comment for GetCompactionState (#11599) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-11 00:00:45 +08:00
Bingyi Sun 1104f752f5
[skip ci]Add comment for ManualCompaction (#11598) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-10 23:58:57 +08:00
Bingyi Sun adea19352c
[skip ci]Add comment for CompleteCompaction (#11597) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-10 23:57:38 +08:00
congqixia 3c9610cb1b
Add garbage collector for DataCoord (#11554) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-10 19:03:38 +08:00
Xiaofan 5f08b67156
Move node.yaml to component.yaml (#11363) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-10 14:27:37 +08:00
Bingyi Sun c3f0c5a3ff
Add compaction interfaces in proxy (#11431) 
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-09 14:47:02 +08:00
sunby 05681364c9
Fix some review comments in compaction. related pr #9906 (#11399) 
issue: #9904
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2021-11-08 21:45:00 +08:00
sunby db6ecd58f2
Fix UpdateFlushSegmentsInfo bug (#11407) 
issue: #7313
Signed-off-by: sunby <sunbingyi1992@gmail.com>
 2021-11-08 14:16:56 +08:00
congqixia 0c4e09e341
Add comment for datacoord Server.startDataNodeTtLoop (#11033) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-05 23:01:02 +08:00
sunby c26cd79532
Add compaction (#9906) 
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-11-05 22:25:00 +08:00
sunby a55019825b
Fix stale segments selector (#11051) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-11-01 22:30:04 +08:00
godchen 7108612398
[skip ci]Fix allocator typo (#10998) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-01 16:54:07 +08:00
godchen 0970aea7e7
[skip ci]Fix allocator typo (#10997) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-01 16:52:19 +08:00
godchen d0ee395de5
[skip ci]Fix allocator typo (#10996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-01 16:50:33 +08:00
congqixia 54738d2ac5
[skip ci] Fix lint for datacoord/channel_store.og (#10964) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-30 21:08:00 +08:00
congqixia 2b07876827
[skip ci] Fix lint for AvgAssignRegisterPolicy (#10965) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-30 21:03:52 +08:00
Xiaofan 2df2d488e1
Fix Unit test fatal fail (#10933) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-30 10:24:38 +08:00
congqixia 390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-29 21:30:49 +08:00
godchen ad2cfdd99f
[skip ci]Fix datanode typo error (#10880) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-29 13:04:04 +08:00
godchen 7071ded008
[skip ci]Fix datanode typo error (#10879) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-29 12:03:38 +08:00
Xiaofan 93f205b49e
Rename param names (#10853) 
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 23:16:40 +08:00
congqixia c019e80dbb
Change SeekPosition to earliest of all segments (#10771) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-28 14:30:26 +08:00
Xiaofan 6fddcb3925
Fix Session checker for proxy (#10737) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-27 21:58:33 +08:00
congqixia 169af67eb1
Fix segments not removed from flushingCache (#10738) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-27 16:06:24 +08:00
congqixia 5c0b5c42ca
Fix merge caused compile error (#10693) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-26 21:46:21 +08:00
sunby 7fbb469081
Change channel's field to upper case to log details (#10567) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-26 20:15:41 +08:00
sunby 2de3131bb3
Change default balance policy (#10563) 
issue: #10198
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-26 19:40:44 +08:00
sunby 9b8e1c657e
Split watch operations to many transactions (#10655) 
issue: #10633
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-26 19:38:20 +08:00
godchen 095a2378ca
Add datanode ut (#10433) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-25 22:52:27 +08:00
godchen 3030454eb9
[skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
XuanYang-cn 102bb36440
[skip ci]Update license for dc cluster (#10593) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-25 20:23:16 +08:00
XuanYang-cn fe955b888f
[skip ci]Update license for dc meta (#10592) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-25 20:21:18 +08:00
XuanYang-cn acb4dd2069
[skip ci]Update license for dc channel manager (#10591) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-25 20:19:25 +08:00
XuanYang-cn 23c7691d59
[skip ci]Update license for dc policy (#10590) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-25 19:48:23 +08:00
XuanYang-cn e5a88374bd
[skip ci]Update license for dc server (#10589) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-25 19:46:28 +08:00
XuanYang-cn 548634ff05
[skip ci]Update license for dc segmentinfo (#10588) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-25 19:44:37 +08:00
xige-16 9ebabdac79
Add handoffTask (#10330) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-10-24 22:39:09 +08:00
sunby 4036830b2d
Fix modify segment without clone (#10498) 
issue: #10430
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-23 13:31:09 +08:00
congqixia 285c3f63e3
Trim segmentinfo binlog for VChaninfo usage (#10425) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-22 14:35:13 +08:00
godchen d6bf0c928f
Get stats delta path from datacoord (#10362) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-22 14:31:13 +08:00
groot 0a1529cf7e
Fix a typo (#10339) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-21 14:16:37 +08:00
godchen c2fa2e940d
Check cluster error (#10116) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-21 10:57:03 +08:00
congqixia 7ce7cb7a5e
Add a timed flush trigger mechanism (#10197) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-20 15:02:36 +08:00
groot 76b053a11c
Fix a typo (#10192) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-20 12:46:42 +08:00
sunby 6d5671add8
[skip ci]Add comment for NewBgChecker (#10224) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-19 21:00:35 +08:00
sunby 0bad693cd1
[skip ci]Add comment for NewReassignPolicy (#10223) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-19 20:58:42 +08:00
sunby 7c74c0fda1
[skip ci]Add comment for NewAssignPolicy (#10222) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-19 20:56:48 +08:00
sunby 600768882c
[skip ci]Add comment for NewDeregisterPolicy (#10133) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-19 14:44:35 +08:00
sunby 09435300b6
[skip ci]Add comment for NewConsistentHashChannelPolicyFactory (#10131) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-19 14:42:42 +08:00
sunby 9847063a40
[skip ci]Add comment for NewRegisterPolicy (#10132) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-19 14:40:42 +08:00
congqixia 6a886d63f2
Support stats and delta log SaveBinlog logic (#10156) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-19 14:32:41 +08:00
zhenshan.cao 32a029fbed
[skip ci]Fix golint error in datacoord (#10135) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-18 21:32:49 +08:00
groot 07599e6a35
[skip ci] Fix a typo (#10106) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-18 17:54:41 +08:00
congqixia b028dc3918
[skip ci] Fix golint issue for datacoord/channel_store.go (#9995) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-15 20:44:38 +08:00
congqixia 1e11a11c27
[skip ci] Fix golint issue for datacoord/util.go (#9992) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-15 20:40:53 +08:00
zwd1208 08ca551a75
[skip ci]Change etcd to lowercase (#9983) 
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
 2021-10-15 18:58:37 +08:00
godchen 3f713a1104
Check server test error (#9954) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-15 17:12:35 +08:00
sunby bfc9e47e2c
Fix data race in datacoord test (#9936) 
issue: #9935
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-15 15:56:35 +08:00
Xiaofan a0b98dacda
Skip reconsume tt msgstream when datacoord restart (#9684) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-15 11:46:33 +08:00
sunby 003a7ed7cc
[skip ci]Add comment for MarshalLogObject (#9920) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-14 21:26:33 +08:00
sunby 3a6f6d399f
[skip ci]Add comment for ChannelOpTypeNames (#9919) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-14 21:24:41 +08:00
sunby 2617b0f2a9
[skip ci]Improve code style (#9918) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-14 21:22:45 +08:00
congqixia 641e472b73
[skip ci] Add comment for ChannelPolicyFactoryv1 (#9913) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 20:28:33 +08:00
congqixia 6b8ff60de3
Close event channel when watch event found error (#9819) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 19:20:35 +08:00
congqixia ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 16:40:35 +08:00
sunby 044b06421a
Use etcd to watch channel on datanode (#7115) 
issue: #6578
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-14 15:44:34 +08:00
dragondriver 72d3d470ba
Use the server id as identifier in system topology graph (#9825) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-14 11:12:38 +08:00
sunby 26a365c06d
Print more information when handling SaveBinlogPathsRequest (#9803) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-13 20:54:33 +08:00
zhenshan.cao b122fda325
[skip ci]Clarify the errors of DataCoord (#9771) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-13 11:02:34 +08:00
sunby e811a66527
Fix save binlog path timeout bug (#9573) 
issue: #9559
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-12 23:46:35 +08:00
sunby aba9aa450d
[skip ci]Add comment for SetFlushTime (#9668) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-11 21:06:37 +08:00
sunby 6fc64b836a
[skip ci]Add comment for SetBinlogs (#9667) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-11 21:04:42 +08:00
congqixia 02dc2a2453
Add GetVChanPosition new cases ut (#9544) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-09 20:57:33 +08:00
sunby 1e0c3cbcb9
[skip ci]Add comment for SetCurrentRows (#9526) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-09 00:16:56 +08:00
sunby 7834649dbc
[skip ci]Add comment for AddAllocation (#9525) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-09 00:15:13 +08:00
sunby 292aeeac63
[skip ci]Add comment for SetAllocations (#9524) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-09 00:13:21 +08:00
godchen 937dbf4279
Add flushed segments (#9476) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-08 19:09:12 +08:00
sunby 006303285f
Fix a nil pointer bug and improve comments (#7625) 
Issue: #7624
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-08 19:05:25 +08:00
congqixia d828a63c94
[skip ci] Add comment for SegmentsInfo AddBinglogPaths (#9386) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-08 17:31:50 +08:00
congqixia 2711b53d57
Apply collection start position (#9459) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-08 14:51:13 +08:00
sunby e7e481444b
Check error returned by server stop (#9015) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-08 10:09:02 +08:00
sunby f705281884
Check error returned by ExpireAllocations (#9016) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-08 10:07:02 +08:00
sunby 21655d54be
[skip ci]Add comment for AddSegmentBinlogs (#9389) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 18:32:50 +08:00
sunby ad15e786cc
[skip ci]Add comment for SetStartPosition (#9399) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:59:31 +08:00
sunby d5081783c3
[skip ci]Add comment for SetDmlPosition (#9398) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:57:47 +08:00
sunby d41cdbb909
[skip ci]Add comment for SetState (#9397) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:55:53 +08:00
sunby cc794354b5
[skip ci]Add comment for SetRowCount (#9394) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:54:12 +08:00
sunby 82ff4563b3
[skip ci]Add comment for SegmentInfoOption (#9393) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:52:17 +08:00
sunby 41633aee0a
[skip ci]Add comment for ShadowClone (#9391) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:50:14 +08:00
sunby ad6b06ed85
[skip ci]Add comment for Clone (#9390) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:48:00 +08:00
sunby 6c0b38eb5a
[skip ci]Add comment for SetExpireTime (#9395) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-07 17:45:29 +08:00
godchen d08370d06b
[skip ci]Fix meta go comment typo (#9378) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-10-07 10:36:03 +08:00
godchen 5c14f96dc4
[skip ci]Fix cluster go comment typo (#9377) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2021-10-07 10:32:13 +08:00
congqixia 5031f09073
[skip ci] Add detail comment for SegmentsInfo (#9332) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-06 17:20:07 +08:00
sunby 5467240fca
[skip ci]Add comment for SetFlushTime (#9295) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-05 22:36:48 +08:00
sunby a1a69a8fef
[skip ci]Add comment for SetBinlogs (#9293) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-05 22:34:49 +08:00
sunby 88b4439fdf
[skip ci]Add comment for package datacoord (#9014) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-05 22:33:01 +08:00
sunby a51533de7f
[skip ci]Add comment for SetCurrentRows (#9294) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-05 22:28:38 +08:00
congqixia 768535f31c
Add positionProvider implementation assertion (#9261) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-05 20:58:04 +08:00
congqixia 423f6584da
[skip ci] Add comment for Datacoord SegmentsInfo allocation (#9260) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-05 15:29:03 +08:00
zhenshan.cao 45d6b8dcd0
[skip ci] Fix golint error in datacoord (#9184) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-04 17:16:54 +08:00
zhenshan.cao 5fcae9d956
[skip ci] Fix golint error in datacoord (#9191) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-10-04 13:20:51 +08:00
godchen 2792f85211
Handle server error (#9032) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-03 22:17:56 +08:00
congqixia e20445987e
Add Datacoord Server implementation Assertion (#9143) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-03 19:44:11 +08:00
sunby 68b26326d3
[skip ci]Modify comment for Init in param table (#9142) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-03 17:51:55 +08:00
sunby c54599ae6f
[skip ci]Modify comment for SetState (#9141) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-03 17:50:03 +08:00
sunby 7448904c8a
[skip ci]Modify comment in param table (#9140) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-03 17:38:14 +08:00
godchen f18e0628ae
Make NewMeta private (#9057) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-10-02 23:09:56 +08:00
congqixia a5cd484ff2
Add Manager implemenation assertion (#9038) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-02 14:45:56 +08:00
congqixia 2044e5eacb
Add ClusterStore implementation assertion (#9037) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-01 23:48:54 +08:00
sunby 6f08430cb8
Check error in server test (#9012) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-01 21:00:46 +08:00
sunby 332025aace
Check error in server_test.go (#9011) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-10-01 20:58:10 +08:00
Xiaofan 2c2b800ff4
Change Log Name with NodeId (#8721) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 08:52:50 +08:00
congqixia a11f9b7eb5
Add log for Flush to print return segments with CollectionID (#8928) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-30 18:12:25 +08:00
congqixia 1cb2e2153f
[skip ci] Fix AllocationPolicy golint (#8883) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-29 20:52:09 +08:00
zhenshan.cao d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-29 20:26:00 +08:00
sunby 2ea7c0af25
Check error in datacoord server test (#8802) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-28 22:04:06 +08:00
sunby eee075b10e
Check error in server test (#8801) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-28 21:54:14 +08:00
congqixia d374ea71ba
Unify liveness check in datacoord and datanode (#8480) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-28 16:10:04 +08:00
sunby 745221e87d
Check error in segment_manager.go (#8705) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-27 22:46:12 +08:00
sunby e5bc8e7050
Check error in MoveSegmentBinlogs (#8704) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-27 22:44:18 +08:00
sunby c152cf2b6b
Check error in segment_manager_test.go (#8706) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-27 22:42:02 +08:00