Commit Graph

2787 Commits (ff7c107d4de82bf82000cd8240ceeac8957e0733)

Author SHA1 Message Date
zhenshan.cao 82983494a0
Fix golint error in proxy (#10622)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:44:21 +08:00
zhenshan.cao 4b0fd28de7
Fix golint error in proxy (#10621)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:42:29 +08:00
zhenshan.cao 9458e04538
Fix golint error in proxy (#10618)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:32:20 +08:00
godchen 095a2378ca
Add datanode ut (#10433)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 22:52:27 +08:00
godchen daaa9428ea
Fix delete msg hash error (#10599)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 22:20:20 +08:00
sunby 42480da5d3
[skip ci]Add comment for GetSegmentInfoChannel (#10606)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:24:22 +08:00
sunby 1888b7e1a1
[skip ci]Add comment for GetRecoveryInfo (#10605)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:22:31 +08:00
godchen 3030454eb9
[skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
godchen 6a0a5cf274
Add delete request hash values proto (#10601)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 21:20:44 +08:00
yukun 6c13008dc3
Fix sealed segment get deleted bitmap assert (#10572)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 21:18:47 +08:00
yukun 5f5949cf2f
[skip ci]Remove unused code (#10597)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:30:48 +08:00
XuanYang-cn 102bb36440
[skip ci]Update license for dc cluster (#10593)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:23:16 +08:00
XuanYang-cn fe955b888f
[skip ci]Update license for dc meta (#10592)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:21:18 +08:00
XuanYang-cn acb4dd2069
[skip ci]Update license for dc channel manager (#10591)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:19:25 +08:00
congqixia ae2a301662
Add injection logic for FlushManager (#10580)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 20:17:34 +08:00
yukun b8fd695838
Fix duplicate delete bug in growing segment (#10570)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:15:49 +08:00
XuanYang-cn 21d98c2825
Add binlog io for compaction (#10536)
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:13:51 +08:00
nameczz 80f1eb8356
[skip ci] Add IndexDescription comments in milvus.proto (#10246)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-10-25 19:58:18 +08:00
XuanYang-cn 23c7691d59
[skip ci]Update license for dc policy (#10590)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:48:23 +08:00
XuanYang-cn e5a88374bd
[skip ci]Update license for dc server (#10589)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:46:28 +08:00
XuanYang-cn 548634ff05
[skip ci]Update license for dc segmentinfo (#10588)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:44:37 +08:00
bigsheeper 2df20eaa5a
[skip ci] Add comment for freeAll (#10575)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:40:05 +08:00
bigsheeper 9ee77bbf01
[skip ci] Add comment for getCollectionIDs (#10574)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:37:55 +08:00
bigsheeper 75f1c2f230
[skip ci] Add comment for newCollectionReplica (#10573)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:36:12 +08:00
godchen d2e0943f21
Fix delete node flush error (#10549)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 18:49:20 +08:00
sunby 98be39bada
Add compaction field in querycoord segment info (#10565)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 18:09:15 +08:00
cai.zhang 8d38adc7a3
[skip ci]Fix golint error for GetMetrics in QueryNode (#10555)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 18:07:24 +08:00
cai.zhang 96e89a9d4c
[skip ci]Fix golint error for GetSegmentInfo in QueryNode (#10554)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 18:05:34 +08:00
congqixia 2713988ff2
Merge auto manual flush with same segment id (#10550)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 18:03:42 +08:00
congqixia bd90a3831c
Allow flushed segments trigger flushe process (#10539)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 18:01:50 +08:00
cai.zhang fb7d1271a4
[skip ci]Fix golint error for ReleaseSegments in QueryNode (#10553)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 17:59:30 +08:00
cai.zhang c3cce20413
Reset the msgstream threshold to PulsarMaxMessageSize (#10186)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 17:57:14 +08:00
Cai Yudong e4909c1c0b
Optimize segcore API GetResultData (#10548)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 17:53:20 +08:00
Cai Yudong 880e375b00
[skip ci] Remove comments (#10541)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 15:25:12 +08:00
Cai Yudong f6802589eb
Optimize proxy reduce code readability (#10537)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 14:29:12 +08:00
Cai Yudong be57e8fdd8
Remove redundant code (#10343)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 14:27:12 +08:00
xige-16 9ebabdac79
Add handoffTask (#10330)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
zhenshan.cao 66c1f7f197
Fix proxy unittest bug:failed to stop rootcoord (#10524)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-24 16:13:11 +08:00
zhenshan.cao 40750f03c7
Enhance querycoord log (#10523)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-24 15:16:00 +08:00
yukun 7acb48919b
Add Delete func in Segcore SegmentSealed (#10501)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-24 14:19:10 +08:00
cai.zhang e18debb3cf
Fix the bug of indexcoord meta returns the underlying pointer (#10504)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-24 13:29:10 +08:00
godchen f7d6fce513
[skip ci]Fix id typo error (#10500)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-24 10:45:10 +08:00
XuanYang-cn cd06f50645
Remove schema in delete codec (#10517)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-24 09:59:10 +08:00
zhenshan.cao 3af852eafb
Fix golint error in proxy (#10488)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 23:17:11 +08:00
cai.zhang 6ea7340dd5
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10510)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:27:27 +08:00
zhenshan.cao 51d82fc71d
Fix golint error in proxy (#10487)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 18:25:37 +08:00
zhenshan.cao 169359448f
Fix golint error in proxy (#10486)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 18:23:44 +08:00
cai.zhang 7669075ae3
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10509)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:21:38 +08:00
cai.zhang dc4ea15339
[skip ci]Fix golint error for LoadSegments in QueryNode (#10508)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:19:45 +08:00
edward.zeng ad667beb9a
[skip ci] Refine comments in metrics (#10511)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-23 18:15:12 +08:00
godchen 31393d8801
[skip ci]Fix datanode comment typo error (#10502)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-23 16:57:35 +08:00
godchen 3b8c17abf8
[skip ci]Fix global id typo error (#10499)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-23 16:55:44 +08:00
sunby 4036830b2d
Fix modify segment without clone (#10498)
issue: #10430
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-23 13:31:09 +08:00
zhenshan.cao 43ef5d5eb9
Fix golint error in proxy (#10485)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 10:53:12 +08:00
yukun 6949350b8b
Call segmentLoadDeletedRecord in segment_loader (#10472)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-23 09:31:10 +08:00
zhenshan.cao af8fc47518
[skip ci]Fix golint error in querynode (#10484)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-22 23:57:11 +08:00
congqixia f170658d5b
[skip ci] Add comment for types.go - Datacoord.GetRecoveryInfo (#10483)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 23:37:11 +08:00
yukun bc083950a8
Add delete in segcore segment sealed (#10470)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 23:35:18 +08:00
bigsheeper 5c58924420
Add cgroups to get container memory and check index memory in segment loader (#10363)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 20:49:10 +08:00
Xiangyu Wang 99ca6e4ba2
Improve comment in storage (#10448)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 20:45:12 +08:00
yukun 0304a8014b
Support delete in query (#10452)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 20:05:12 +08:00
cai.zhang bf10fc6e7c
[skip ci]Fix golint error for WatchDmChannels in QueryNode (#10476)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:37:30 +08:00
cai.zhang ebd7b4eee1
[skip ci]Fix golint error for AddQueryChannel in QueryNode (#10474)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:33:40 +08:00
cai.zhang edf0d0bb27
[skip ci]Fix golint error for RemoveQueryChannel in QueryNode (#10475)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:31:42 +08:00
xige-16 8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
bigsheeper 5a11175bea
[skip ci] Add comment for getExcludedSegments (#10465)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:05:14 +08:00
bigsheeper 83c835a1d6
[skip ci] Add comment for addExcludedSegments (#10464)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:03:31 +08:00
bigsheeper bad8a41494
[skip ci] Add comment for removeExcludedSegments (#10463)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:01:29 +08:00
yukun f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 18:51:14 +08:00
Xiangyu Wang 040be8da51
Improve comments in tso (#10446)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:37:12 +08:00
Xiangyu Wang 99d57beff8
Improve comment in storage (#10447)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:29:11 +08:00
congqixia 76b64a9d01
Remove not needed ctx from rocksmq client (#10416)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 17:25:12 +08:00
edward.zeng 29d1e45f3b
[skip ci] Refine the comments in metrics (#10435)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-22 16:19:20 +08:00
godchen ffc0c07610
Change delete data primary key to int64 (#10438)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 15:37:12 +08:00
congqixia 285c3f63e3
Trim segmentinfo binlog for VChaninfo usage (#10425)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 14:35:13 +08:00
groot 73c9ab43e0
Simplify cpp (#10413)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:33:11 +08:00
godchen d6bf0c928f
Get stats delta path from datacoord (#10362)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 14:31:13 +08:00
XuanYang-cn 2eff882245
[skip ci]Update license for distributed cm (#10424)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:19:12 +08:00
XuanYang-cn a111056fe4
[skip ci]Update license for distributed qc.client (#10422)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:17:26 +08:00
XuanYang-cn 64d0a2d37e
[skip ci]Update license for distributed qn.client (#10420)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:15:33 +08:00
XuanYang-cn a495ffc9f6
[skip ci]Update license for distributed rc.client (#10418)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:13:42 +08:00
groot 70eb275ef4
[skip ci] Fix typo (#10412)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:11:52 +08:00
groot 6db06ecf81
[skip ci] Fix typo (#10411)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:10:06 +08:00
XuanYang-cn a219026142
[skip ci]Update license for distributed qn (#10419)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:03:30 +08:00
XuanYang-cn d3cd3fc2af
[skip ci]Update license for distributed rc (#10423)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:01:21 +08:00
XuanYang-cn 2db93e70bc
[skip ci]Update license distributed qc (#10421)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 13:59:28 +08:00
yukun fe1927c05d
Support delete in SegmentSealed (#10181)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 13:11:11 +08:00
godchen e7738243b9
Fix stats log nil when not int64 field (#10417)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 12:51:11 +08:00
Xiangyu Wang d9abce6764
Fix unittest failed in schema_test.go (#10401)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 22:47:11 +08:00
yukun 319b3282d9
[skip ci]Add comments for rocksmq consumer_impl (#10389)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:45:22 +08:00
yukun 4a8619619b
[skip ci]Add comments for rocksmq (#10388)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:43:21 +08:00
cai.zhang ecfca29adb
[skip ci] Fix golint for GetTimeTickChannel in QueryNode (#10395)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:59:23 +08:00
cai.zhang 51b9a9cd5c
[skip ci] Fix golint for GetComponentStates in QueryNode (#10394)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:57:33 +08:00
sunby e98dee296f
[skip ci]Add comment for GetCollectionStatistics (#10393)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:55:40 +08:00
sunby dcd6c1f2b2
[skip ci]Add comment for GetPartitionStatistics (#10392)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:53:48 +08:00
sunby 4adccbf03e
[skip ci]Add comment for GetSegmentInfo (#10391)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:51:55 +08:00
cai.zhang 331c630947
[skip ci] Fix golint for GetStatisticsChannel in QueryNode (#10396)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:49:25 +08:00
godchen c1c3f47cc1
[skip ci]Fix allocator close comment typo (#10369)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-21 20:47:11 +08:00
edward.zeng 39b204374b
[skip ci] Fix rocksmq retention typo (#10376)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-21 19:56:10 +08:00
bigsheeper c7aea829d9
[skip ci] Add comment for getSegmentNum (#10372)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-21 19:54:17 +08:00