Commit Graph

3198 Commits (c416f1e71fce09abbda10df25d4c94e342fcda79)

Author SHA1 Message Date
XuanYang-cn a030c2a81b
[skip ci]Update license for ic node (#10758)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 19:00:48 +08:00
XuanYang-cn 46add09692
[skip ci]Update license for ic meta (#10757)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 18:04:47 +08:00
XuanYang-cn 92185a7465
[skip ci]Update license for ic ic (#10756)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 18:02:56 +08:00
yukun 788ea53f4f
[skip ci]Fix flow_graph_insert_node comment (#10749)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-27 18:01:15 +08:00
cai.zhang a4c11731ed
[skip ci] Fix golint for Stop in QueryCoord (#10748)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-27 17:59:26 +08:00
cai.zhang 9c82d7751e
[skip ci] Fix golint for start in QueryCoord (#10747)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-27 17:57:21 +08:00
cai.zhang 5974a8e78c
[skip ci] Fix golint for init in QueryCoord (#10746)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-27 17:55:29 +08:00
XuanYang-cn 4c46948a7d
[skip ci]Update license for ic task (#10759)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 17:44:48 +08:00
Cai Yudong 24f9411249
Optimize queryTask PostExecute (#10739)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-27 17:34:35 +08:00
groot f5323de208
Add log (#10720)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-27 17:32:33 +08:00
XuanYang-cn 42ce9b18d1
Add methods in segment replica (#10582)
see also: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 17:14:28 +08:00
congqixia ff7c107d4d
Filter index segment with empty index file paths (#10751)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-27 17:12:30 +08:00
XuanYang-cn bb7e3d3e70
Fix ParseHybridTs return type to int64 (#10583)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 16:30:28 +08:00
congqixia 169af67eb1
Fix segments not removed from flushingCache (#10738)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-27 16:06:24 +08:00
groot 84f5075452
Add log (#10719)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-27 14:58:38 +08:00
groot 4d41bbe32f
Add log (#10718)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-27 14:56:48 +08:00
groot 2c09891137
Add log (#10717)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-27 14:54:59 +08:00
groot 6496b624d9
Add log (#10716)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-27 14:53:15 +08:00
BIKI DAS d55d3d63eb
Improved empty string tests (#10429)
Signed-off-by: Biki-das <bikid475@gmail.com>
2021-10-27 14:44:24 +08:00
yukun 902e7172cb
Fix duplicate delete bugs (#10715)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-27 14:36:23 +08:00
yukun 5cd935729c
Fix bitmap merge in segcore (#10711)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-27 14:34:31 +08:00
congqixia 5317c8abab
Fix waitNewTSafe not waiting (#10724)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-27 14:22:22 +08:00
Cai Yudong c51155a542
Optimize decodeSearchResults (#10728)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-27 14:10:27 +08:00
congqixia 555912f40e
Fix create meta table fails for compatibility issue (#10703)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-26 23:00:27 +08:00
zhenshan.cao d598c78bbf
[skip ci]Fix golint error in minio_kv (#10702)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:42:25 +08:00
zhenshan.cao dcac9c71b1
[skip ci]Fix golint error in minio_kv (#10701)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:40:34 +08:00
zhenshan.cao 4ca4c81ce3
[skip ci]Fix golint error in minio_kv (#10700)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:38:44 +08:00
zhenshan.cao 58d202f200
[skip ci]Fix golint error in minio_kv (#10699)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:36:53 +08:00
zhenshan.cao 49e23ebc85
[skip ci]Fix golint error in basetable (#10698)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:35:05 +08:00
zhenshan.cao 373a4684b9
[skip ci]Fix golint error in data_codec (#10697)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 22:32:44 +08:00
congqixia 5c0b5c42ca
Fix merge caused compile error (#10693)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-26 21:46:21 +08:00
yukun 552efd4b7b
[skip ci]Add comments for rocksmq producer_impl Send (#10696)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 21:40:24 +08:00
yukun e8651a1cd9
[skip ci]Add comments for rocksmq producer_impl (#10695)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 21:38:29 +08:00
xige-16 dc9b37128f
Fix querycoord panic when upgrade querychannelInfo (#10681)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 20:25:05 +08:00
congqixia 656f9380b1
[skip ci] Add comment for types.go - Datacoord.GetFlushedSegments (#10676)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-26 20:23:12 +08:00
sunby 7fbb469081
Change channel's field to upper case to log details (#10567)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-26 20:15:41 +08:00
cai.zhang d6cc578d3f
[skip ci]Fix golint error for NewServer in QueryCoord (#10678)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 19:44:26 +08:00
cai.zhang 4ffa8458ed
[skip ci]Fix golint error for Server in QueryCoord (#10677)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 19:42:32 +08:00
sunby 2de3131bb3
Change default balance policy (#10563)
issue: #10198
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-26 19:40:44 +08:00
sunby 9b8e1c657e
Split watch operations to many transactions (#10655)
issue: #10633
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-26 19:38:20 +08:00
Cai Yudong 07fe3758c4
Remove core/src/utils/Log.h (#10675)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 19:34:22 +08:00
Cai Yudong 492dd1a66f
Remove redundant file (#10674)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 19:32:33 +08:00
Cai Yudong 403b41084f
Remove redundant head files for SegmentGrowingImpl.cpp (#10672)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 19:30:44 +08:00
yukun 471ddb07b2
Decide the final offset when repeated keys (#10671)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-26 19:28:52 +08:00
xige-16 fe8bfc3788
Fix empty getQuerySegmentInfos results (#10667)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 19:26:43 +08:00
xige-16 a06dab29d7
Fix query coord set seek position error (#10651)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 19:24:23 +08:00
cai.zhang a36c35d40e
[skip ci]Fix golint error for Run in QueryCoord (#10679)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 19:08:24 +08:00
cai.zhang 3734ff49ac
Add default value for the parameter roundDeciaml (#9626)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 18:24:23 +08:00
Cai Yudong 1227b9ebae
Rename utils/tools.h to utils/Utils.h (#10665)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 17:28:23 +08:00
Cai Yudong fa01a888a0
Remove redundant files under internal/core (#10658)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 17:26:30 +08:00
cai.zhang 5b42a3223c
Increase compatibility for EstimateMemorySize interface (#10603)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 15:34:21 +08:00
xige-16 0cedd9d47e
Compaction multiSegmentChangeInfo to a single info (#10587)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 15:18:22 +08:00
cai.zhang aff5cd9598
Supprot to read the configuration of minio from environment variables (#10534)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-26 15:10:03 +08:00
godchen 664da326e4
Add querynode delete ids in sealed segment (#10638)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-26 14:46:19 +08:00
congqixia 43caa19686
[skip ci] Add comment for types.go - Datacoord.SaveBinlogPaths (#10627)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-26 14:19:02 +08:00
Cai Yudong 04d34bfcd7
Remove redundant code (#10635)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:12:21 +08:00
Cai Yudong 4cd83e78ed
Reorder header files for segcore/Collection.cpp (#10634)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:10:30 +08:00
Cai Yudong 06dad68f91
Add common/Consts.h (#10631)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-26 13:08:18 +08:00
xige-16 a414d16c06
Fix remove segment when querynode receive segmentChangeInfo (#10619)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-26 13:04:18 +08:00
zhenshan.cao bb08df28f3
Fix golint error in proxy (#10620)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-26 10:38:41 +08:00
zhenshan.cao 5e00e9a05b
Fix golint error in proxy (#10623)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:56:19 +08:00
zhenshan.cao 82983494a0
Fix golint error in proxy (#10622)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:44:21 +08:00
zhenshan.cao 4b0fd28de7
Fix golint error in proxy (#10621)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:42:29 +08:00
zhenshan.cao 9458e04538
Fix golint error in proxy (#10618)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-25 23:32:20 +08:00
godchen 095a2378ca
Add datanode ut (#10433)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 22:52:27 +08:00
godchen daaa9428ea
Fix delete msg hash error (#10599)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 22:20:20 +08:00
sunby 42480da5d3
[skip ci]Add comment for GetSegmentInfoChannel (#10606)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:24:22 +08:00
sunby 1888b7e1a1
[skip ci]Add comment for GetRecoveryInfo (#10605)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 21:22:31 +08:00
godchen 3030454eb9
[skip ci]Fix datacoord package name missing (#10608) 2021-10-25 21:21:40 +08:00
godchen 6a0a5cf274
Add delete request hash values proto (#10601)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 21:20:44 +08:00
yukun 6c13008dc3
Fix sealed segment get deleted bitmap assert (#10572)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 21:18:47 +08:00
yukun 5f5949cf2f
[skip ci]Remove unused code (#10597)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:30:48 +08:00
XuanYang-cn 102bb36440
[skip ci]Update license for dc cluster (#10593)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:23:16 +08:00
XuanYang-cn fe955b888f
[skip ci]Update license for dc meta (#10592)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:21:18 +08:00
XuanYang-cn acb4dd2069
[skip ci]Update license for dc channel manager (#10591)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:19:25 +08:00
congqixia ae2a301662
Add injection logic for FlushManager (#10580)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 20:17:34 +08:00
yukun b8fd695838
Fix duplicate delete bug in growing segment (#10570)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-25 20:15:49 +08:00
XuanYang-cn 21d98c2825
Add binlog io for compaction (#10536)
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 20:13:51 +08:00
nameczz 80f1eb8356
[skip ci] Add IndexDescription comments in milvus.proto (#10246)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-10-25 19:58:18 +08:00
XuanYang-cn 23c7691d59
[skip ci]Update license for dc policy (#10590)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:48:23 +08:00
XuanYang-cn e5a88374bd
[skip ci]Update license for dc server (#10589)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:46:28 +08:00
XuanYang-cn 548634ff05
[skip ci]Update license for dc segmentinfo (#10588)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-25 19:44:37 +08:00
bigsheeper 2df20eaa5a
[skip ci] Add comment for freeAll (#10575)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:40:05 +08:00
bigsheeper 9ee77bbf01
[skip ci] Add comment for getCollectionIDs (#10574)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:37:55 +08:00
bigsheeper 75f1c2f230
[skip ci] Add comment for newCollectionReplica (#10573)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-25 19:36:12 +08:00
godchen d2e0943f21
Fix delete node flush error (#10549)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-25 18:49:20 +08:00
sunby 98be39bada
Add compaction field in querycoord segment info (#10565)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-25 18:09:15 +08:00
cai.zhang 8d38adc7a3
[skip ci]Fix golint error for GetMetrics in QueryNode (#10555)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 18:07:24 +08:00
cai.zhang 96e89a9d4c
[skip ci]Fix golint error for GetSegmentInfo in QueryNode (#10554)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 18:05:34 +08:00
congqixia 2713988ff2
Merge auto manual flush with same segment id (#10550)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 18:03:42 +08:00
congqixia bd90a3831c
Allow flushed segments trigger flushe process (#10539)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-25 18:01:50 +08:00
cai.zhang fb7d1271a4
[skip ci]Fix golint error for ReleaseSegments in QueryNode (#10553)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 17:59:30 +08:00
cai.zhang c3cce20413
Reset the msgstream threshold to PulsarMaxMessageSize (#10186)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-25 17:57:14 +08:00
Cai Yudong e4909c1c0b
Optimize segcore API GetResultData (#10548)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 17:53:20 +08:00
Cai Yudong 880e375b00
[skip ci] Remove comments (#10541)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 15:25:12 +08:00
Cai Yudong f6802589eb
Optimize proxy reduce code readability (#10537)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 14:29:12 +08:00
Cai Yudong be57e8fdd8
Remove redundant code (#10343)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-25 14:27:12 +08:00
xige-16 9ebabdac79
Add handoffTask (#10330)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-24 22:39:09 +08:00
zhenshan.cao 66c1f7f197
Fix proxy unittest bug:failed to stop rootcoord (#10524)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-24 16:13:11 +08:00
zhenshan.cao 40750f03c7
Enhance querycoord log (#10523)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-24 15:16:00 +08:00
yukun 7acb48919b
Add Delete func in Segcore SegmentSealed (#10501)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-24 14:19:10 +08:00
cai.zhang e18debb3cf
Fix the bug of indexcoord meta returns the underlying pointer (#10504)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-24 13:29:10 +08:00
godchen f7d6fce513
[skip ci]Fix id typo error (#10500)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-24 10:45:10 +08:00
XuanYang-cn cd06f50645
Remove schema in delete codec (#10517)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-24 09:59:10 +08:00
zhenshan.cao 3af852eafb
Fix golint error in proxy (#10488)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 23:17:11 +08:00
cai.zhang 6ea7340dd5
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10510)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:27:27 +08:00
zhenshan.cao 51d82fc71d
Fix golint error in proxy (#10487)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 18:25:37 +08:00
zhenshan.cao 169359448f
Fix golint error in proxy (#10486)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 18:23:44 +08:00
cai.zhang 7669075ae3
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10509)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:21:38 +08:00
cai.zhang dc4ea15339
[skip ci]Fix golint error for LoadSegments in QueryNode (#10508)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-23 18:19:45 +08:00
edward.zeng ad667beb9a
[skip ci] Refine comments in metrics (#10511)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-23 18:15:12 +08:00
godchen 31393d8801
[skip ci]Fix datanode comment typo error (#10502)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-23 16:57:35 +08:00
godchen 3b8c17abf8
[skip ci]Fix global id typo error (#10499)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-23 16:55:44 +08:00
sunby 4036830b2d
Fix modify segment without clone (#10498)
issue: #10430
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-23 13:31:09 +08:00
zhenshan.cao 43ef5d5eb9
Fix golint error in proxy (#10485)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-23 10:53:12 +08:00
yukun 6949350b8b
Call segmentLoadDeletedRecord in segment_loader (#10472)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-23 09:31:10 +08:00
zhenshan.cao af8fc47518
[skip ci]Fix golint error in querynode (#10484)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-22 23:57:11 +08:00
congqixia f170658d5b
[skip ci] Add comment for types.go - Datacoord.GetRecoveryInfo (#10483)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 23:37:11 +08:00
yukun bc083950a8
Add delete in segcore segment sealed (#10470)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 23:35:18 +08:00
bigsheeper 5c58924420
Add cgroups to get container memory and check index memory in segment loader (#10363)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 20:49:10 +08:00
Xiangyu Wang 99ca6e4ba2
Improve comment in storage (#10448)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 20:45:12 +08:00
yukun 0304a8014b
Support delete in query (#10452)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 20:05:12 +08:00
cai.zhang bf10fc6e7c
[skip ci]Fix golint error for WatchDmChannels in QueryNode (#10476)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:37:30 +08:00
cai.zhang ebd7b4eee1
[skip ci]Fix golint error for AddQueryChannel in QueryNode (#10474)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:33:40 +08:00
cai.zhang edf0d0bb27
[skip ci]Fix golint error for RemoveQueryChannel in QueryNode (#10475)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-22 19:31:42 +08:00
xige-16 8a046a6495
BroadCast sealedSegmentChangeInfo to queryChannel (#10084)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-22 19:07:15 +08:00
bigsheeper 5a11175bea
[skip ci] Add comment for getExcludedSegments (#10465)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:05:14 +08:00
bigsheeper 83c835a1d6
[skip ci] Add comment for addExcludedSegments (#10464)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:03:31 +08:00
bigsheeper bad8a41494
[skip ci] Add comment for removeExcludedSegments (#10463)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-22 19:01:29 +08:00
yukun f7c0f5b3da
Add segmentLoadDeletedRecord in querynode (#10449)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 18:51:14 +08:00
Xiangyu Wang 040be8da51
Improve comments in tso (#10446)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:37:12 +08:00
Xiangyu Wang 99d57beff8
Improve comment in storage (#10447)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-22 17:29:11 +08:00
congqixia 76b64a9d01
Remove not needed ctx from rocksmq client (#10416)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 17:25:12 +08:00
edward.zeng 29d1e45f3b
[skip ci] Refine the comments in metrics (#10435)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-22 16:19:20 +08:00
godchen ffc0c07610
Change delete data primary key to int64 (#10438)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 15:37:12 +08:00
congqixia 285c3f63e3
Trim segmentinfo binlog for VChaninfo usage (#10425)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-22 14:35:13 +08:00
groot 73c9ab43e0
Simplify cpp (#10413)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:33:11 +08:00
godchen d6bf0c928f
Get stats delta path from datacoord (#10362)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 14:31:13 +08:00
XuanYang-cn 2eff882245
[skip ci]Update license for distributed cm (#10424)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:19:12 +08:00
XuanYang-cn a111056fe4
[skip ci]Update license for distributed qc.client (#10422)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:17:26 +08:00
XuanYang-cn 64d0a2d37e
[skip ci]Update license for distributed qn.client (#10420)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:15:33 +08:00
XuanYang-cn a495ffc9f6
[skip ci]Update license for distributed rc.client (#10418)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:13:42 +08:00
groot 70eb275ef4
[skip ci] Fix typo (#10412)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:11:52 +08:00
groot 6db06ecf81
[skip ci] Fix typo (#10411)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:10:06 +08:00
XuanYang-cn a219026142
[skip ci]Update license for distributed qn (#10419)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:03:30 +08:00
XuanYang-cn d3cd3fc2af
[skip ci]Update license for distributed rc (#10423)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 14:01:21 +08:00
XuanYang-cn 2db93e70bc
[skip ci]Update license distributed qc (#10421)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-22 13:59:28 +08:00
yukun fe1927c05d
Support delete in SegmentSealed (#10181)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-22 13:11:11 +08:00
godchen e7738243b9
Fix stats log nil when not int64 field (#10417)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-22 12:51:11 +08:00
Xiangyu Wang d9abce6764
Fix unittest failed in schema_test.go (#10401)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 22:47:11 +08:00
yukun 319b3282d9
[skip ci]Add comments for rocksmq consumer_impl (#10389)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:45:22 +08:00
yukun 4a8619619b
[skip ci]Add comments for rocksmq (#10388)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 22:43:21 +08:00
cai.zhang ecfca29adb
[skip ci] Fix golint for GetTimeTickChannel in QueryNode (#10395)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:59:23 +08:00
cai.zhang 51b9a9cd5c
[skip ci] Fix golint for GetComponentStates in QueryNode (#10394)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:57:33 +08:00
sunby e98dee296f
[skip ci]Add comment for GetCollectionStatistics (#10393)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:55:40 +08:00
sunby dcd6c1f2b2
[skip ci]Add comment for GetPartitionStatistics (#10392)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:53:48 +08:00
sunby 4adccbf03e
[skip ci]Add comment for GetSegmentInfo (#10391)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-21 21:51:55 +08:00
cai.zhang 331c630947
[skip ci] Fix golint for GetStatisticsChannel in QueryNode (#10396)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-21 21:49:25 +08:00
godchen c1c3f47cc1
[skip ci]Fix allocator close comment typo (#10369)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-21 20:47:11 +08:00
edward.zeng 39b204374b
[skip ci] Fix rocksmq retention typo (#10376)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-10-21 19:56:10 +08:00
bigsheeper c7aea829d9
[skip ci] Add comment for getSegmentNum (#10372)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-21 19:54:17 +08:00
Cai Yudong 824005115a
Remove duplicated search results in proxy (#10355)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-21 19:52:28 +08:00
congqixia c2c2036154
Stop retention gracefully (#10367)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 19:50:26 +08:00
bigsheeper fd95ad8e4a
[skip ci] Add comment for hasSegmentPrivate (#10371)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-21 19:48:06 +08:00
godchen f7a7f41706
[skip ci]Fix allocator init comment typo (#10370)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-21 19:46:13 +08:00
Xiangyu Wang ff71f53877
[skip ci]Improve error message in schema (#10354)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 19:44:19 +08:00
Xiangyu Wang c3e8903dc2
[skip ci]Improve error message in schema (#10353)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 19:42:26 +08:00
Xiangyu Wang bbd558f509
[skip ci]Improve error messages in convension (#10352)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-21 19:40:35 +08:00
godchen c1ae837231
[skip ci]Fix allocator reset comment typo (#10368)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-21 19:25:11 +08:00
bigsheeper f35d342426
[skip ci] Add comment for getSegmentStatistics (#10373)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-21 19:22:50 +08:00
groot a91486e966
Fix a compile error (#10358)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-21 19:10:37 +08:00
zhenshan.cao a287bcf49d
Fix proxy unittest (#10289)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-21 15:30:36 +08:00
groot 0a1529cf7e
Fix a typo (#10339)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-21 14:16:37 +08:00
congqixia ed2b8d67c0
Reduce info saved in SnapshotMeta (#10288)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 14:04:36 +08:00
BIKI DAS 0120068d92
returning nill explicitly (#10349)
Signed-off-by: Biki-das <bikid475@gmail.com>
2021-10-21 13:46:35 +08:00
godchen cfe2546b0d
Fix retry error missed (#10318)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-21 12:20:35 +08:00
xige-16 f68a3358dd
Fix multiSave childTask failed to etcd (#10340)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-21 12:18:36 +08:00
congqixia f9408259b4
Add comment for shuffleSegmentsToQueryNode (#10336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 11:08:37 +08:00
congqixia 0c6d5098a0
Fix fieldID typo in typeutil (#10335)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 11:06:43 +08:00
yukun ac581c5a38
Fix bitmap bug when delete without expression (#10325)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 11:01:07 +08:00
yukun f15dc150f1
[skip ci]Add comments for retention (#10316)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-21 10:59:01 +08:00
godchen c2fa2e940d
Check cluster error (#10116)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-21 10:57:03 +08:00
bigsheeper 132f57f5b7
Set gracefulTime to 0 (#10114)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-21 10:55:12 +08:00
xige-16 ef6de3e122
Comment MaxSendSizeToEtcd (#10165)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-21 10:53:09 +08:00
xige-16 1103ca8fca
Fix golint error in condition of queryCoord (#10230)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-21 10:51:14 +08:00
Cai Yudong b099179ac0
Optimize proxy reduce search result data (#10327)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-21 10:46:36 +08:00
xige-16 c5bba3ec2d
Fix assign load segment req error (#10310)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-20 22:32:36 +08:00
sunby 3fe0604b18
[skip ci]Add comment for GetInsertBinlogPaths (#10321)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:30:43 +08:00
sunby d60cd6ec6e
[skip ci]Add comment for GetSegmentStates (#10320)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:28:49 +08:00
sunby 95644f71e8
[skip ci]Add comment for AssignSegmentID (#10319)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 21:26:55 +08:00
zhenshan.cao 83684628b2
Fix bug:Index building task canceled by indexcoord by mistake (#10314)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-20 21:02:35 +08:00
godchen 3610fe89c0
[skip ci ]Fix allocator comments (#10276)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-20 20:30:37 +08:00
cai.zhang e27c5357db
[skip ci]Fix golint error for Stop in QueryNode (#10306)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-20 19:58:49 +08:00
cai.zhang 505d3a51df
[skip ci]Fix golint error for Start in QueryNode (#10305)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-20 19:56:55 +08:00
cai.zhang 063c7859f5
[skip ci]Fix golint error for Init in QueryNode (#10304)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-20 19:55:07 +08:00
yukun 5c1733de26
Remove insertpks log in flow_graph_insert_node (#10302)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-20 19:51:23 +08:00
XuanYang-cn bd93d9f01d
[skip ci]Update license for distributed p.client (#10298)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-20 19:49:28 +08:00
bigsheeper 2d984ba0d1
Fix getSegmentInfo in query node (#9549)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-20 19:47:35 +08:00
XuanYang-cn b2bb5fc004
[skip ci]Update license on distributed ic.client (#10300)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-20 19:43:28 +08:00
XuanYang-cn 4a35fb1d45
[skip ci]Update license for distributed proxy (#10299)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-20 19:41:37 +08:00
XuanYang-cn 0c75101289
[skip ci]Update licens on distributed ic (#10297)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-20 19:39:49 +08:00
congqixia e8a7c482c8
Use proto Size to calculate req size (#10294)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 19:27:27 +08:00
bigsheeper 455172202a
[skip ci] Add comment for hasSegment (#10293)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-20 19:25:29 +08:00
bigsheeper ff4cd4925f
[skip ci] Add comment for getSegmentByID (#10291)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-20 19:23:28 +08:00
groot 525a85ef06
Remove unused code (#10285)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-20 19:21:18 +08:00
XuanYang-cn bb1086659b
Remove not in use datanode_test.go (#10164)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-20 19:13:26 +08:00
bigsheeper 31c222b723
[skip ci] Add comment for getSegmentByIDPrivate (#10292)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-20 19:05:04 +08:00
XuanYang-cn a7429cdd3a
[skip ci]Update license for distributed in (#10296)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-20 19:02:41 +08:00
Cai Yudong b40513b211
Use timerecord to calculate time span (#10287)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 17:56:38 +08:00
bigsheeper c18fa9b785
Watch changeInfo in query node (#10045)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-20 17:54:43 +08:00
Cai Yudong 8c67627150
[skip ci] Update comments (#10283)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:48:35 +08:00
Cai Yudong 0941c297e7
[skip ci] Fix typo (#10282)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:46:42 +08:00
Cai Yudong 0cd562d58b
[skip ci] Fix typo (#10281)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:44:49 +08:00
yukun e91eafd871
Fix Bitsetview bug in segcore (#10272)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-20 16:34:36 +08:00
congqixia f39e06b24e
Filters out nil BF stats (#10279)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 16:14:36 +08:00
godchen 42a85f6d9d
[skip ci]Fix allocator typo error (#10275)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-20 15:48:38 +08:00
Cai Yudong 983bd1d473
Reorder header files for LoadInfo.h (#10264)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 15:46:47 +08:00
Cai Yudong 597523bf40
Reorder header files for FieldMeta.h (#10263)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 15:44:41 +08:00
godchen d9010e684b
[skip ci]Fix allocator typo (#10274)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-20 15:42:45 +08:00
Cai Yudong 48648c818b
Remove duplicated search results in segcore reduce (#10117)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 15:40:49 +08:00
congqixia 7ce7cb7a5e
Add a timed flush trigger mechanism (#10197)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 15:02:36 +08:00
Cai Yudong ced29480cf
Format CGoHelper.h (#10261)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 14:56:35 +08:00
congqixia c3518b8c81
Fix nil stats from DeserializeStats (#10255)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 14:26:35 +08:00
congqixia fc22537774
Fix static-check fail due to proto (#10258)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-20 13:12:35 +08:00
groot 76b053a11c
Fix a typo (#10192)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-20 12:46:42 +08:00
sunby 54459ac3b3
Add compaction proto (#9874)
issue: #9873
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 11:58:35 +08:00
sunby db53eccec9
Add binlog iterators (#10173)
issue: #9530
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-20 11:52:35 +08:00
xige-16 c298a14e08
Fix golint error of PopTask in queryCoord (#10232)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-20 11:12:35 +08:00
Xiangyu Wang cd6a4a6704
[skip ci]Improve error message in mqclient (#10241)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:56:35 +08:00
Xiangyu Wang a2b8add4e2
[skip ci]Improve error message in mqclient (#10240)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:54:43 +08:00
Xiangyu Wang 1493aa1f65
[skip ci]Improve comments in mqclient (#10242)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-20 10:52:35 +08:00
xige-16 4d7252739d
[skip ci] Add comment for GetTimeTickChannel (#10231)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-20 09:14:37 +08:00
sunby 6d5671add8
[skip ci]Add comment for NewBgChecker (#10224)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-19 21:00:35 +08:00
sunby 0bad693cd1
[skip ci]Add comment for NewReassignPolicy (#10223)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-19 20:58:42 +08:00
sunby 7c74c0fda1
[skip ci]Add comment for NewAssignPolicy (#10222)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-19 20:56:48 +08:00
godchen 6279fb817a
Fix stats log load with prefix error (#10216)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-19 20:50:35 +08:00
cai.zhang a6ce06de6f
[skip ci]Fix golint error for NewClient in QueryNode (#10220)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-19 20:42:35 +08:00
cai.zhang 1d0e9dc6d7
[skip ci]Fix golint error for Client in QueryNode (#10219)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-19 20:40:40 +08:00
cai.zhang 9585aaa188
[skip ci]Fix golint error for GetMetrics in QueryNode (#10218)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-19 20:38:47 +08:00
yukun 81190c573a
[skip ci]Add comments for UpdateAckedInfo (#10213)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-19 20:34:50 +08:00
yukun 7c7a66df6d
[skip ci]Add comments for rocksmq Notify (#10212)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-19 20:32:48 +08:00
bigsheeper 26fe0d850e
[skip ci] Add comment for removeSegmentPrivate (#10203)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-19 20:30:56 +08:00
bigsheeper dc42fdb2f0
[skip ci] Add comment for removeSegment (#10202)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-19 20:28:59 +08:00
bigsheeper 24f6834192
[skip ci] Add comment for setSegment (#10201)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-19 20:27:09 +08:00
XuanYang-cn cc8a526105
[skip ci]Update license for distributed dc client (#10162)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 20:25:17 +08:00
XuanYang-cn d0710c5f7f
[skip ci]Update license for distributed dc (#10161)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 20:23:22 +08:00
godchen 8daeb0d519
Change bloom filter use pk (#10193)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-19 20:18:47 +08:00
sunby 4031b8746f
Fix panic when flushing segment (#10182)
issue: #10180
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-19 19:06:37 +08:00
Xiangyu Wang 736a2cc358
[skip ci]Improve error message in rocksmq (#10196)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:54:37 +08:00
Xiangyu Wang 88a2b2b07c
[skip ci]Improve error message in rocksmq (#10195)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:52:42 +08:00
Xiangyu Wang afa6eeecd7
[skip ci]Improve error message in rocksmq (#10194)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-19 17:50:49 +08:00
Cai Yudong 56f97aa07b
Move Log out of Milvus namespace (#10178)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 17:10:35 +08:00
XuanYang-cn 75cdba134b
[skip ci]update license for distributed dn (#10163)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 16:53:23 +08:00
XuanYang-cn 52e9d57f91
[skip ci]Update license for distributed dn client (#10160)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 16:51:32 +08:00
groot d33e810aa1
[skip ci] Fix a typo (#10155)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-19 16:24:35 +08:00
sunby 600768882c
[skip ci]Add comment for NewDeregisterPolicy (#10133)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-19 14:44:35 +08:00
sunby 09435300b6
[skip ci]Add comment for NewConsistentHashChannelPolicyFactory (#10131)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-19 14:42:42 +08:00
sunby 9847063a40
[skip ci]Add comment for NewRegisterPolicy (#10132)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-19 14:40:42 +08:00
congqixia ed4e516ce7
Save stats and delta logs from DataNode (#10159)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-19 14:34:35 +08:00
congqixia 6a886d63f2
Support stats and delta log SaveBinlog logic (#10156)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-19 14:32:41 +08:00
dragondriver 9140da3cc6
[skip ci] Add comment for time tick (#10145)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-19 14:16:58 +08:00
dragondriver e529012ab2
[skip ci] Add comment for cache (#10144)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-19 14:15:04 +08:00
dragondriver 7602962341
[skip ci] Add comment for proxy (#10143)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-19 14:13:12 +08:00
xige-16 a1902f5eec
[skip ci] Add comment for waitActivateTaskDone (#10140)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-19 14:11:18 +08:00
xige-16 500d3eef2b
[skip ci] Add comment for processLoop (#10139)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-19 14:09:00 +08:00
yukun e108476601
Support delete in SegmentGrowing (#10154)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-19 11:54:34 +08:00
Cai Yudong 39bf58d8cb
Remove deprecated API get_offset_opt (#10150)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 11:46:34 +08:00
Cai Yudong 693220fe0a
Remove dummy structure EntityResult (#10149)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 11:28:34 +08:00
nameczz 86a7378492
[skip ci] Add DescribeIndexRequest comments in milvus.proto (#9984)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-10-19 11:16:34 +08:00
Cai Yudong eda9d550a8
Code clean for test_timestamp_index (#10148)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-19 11:10:34 +08:00
congqixia 5737e0075f
Apply flush manager logic in datanode (#10142)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-19 11:04:34 +08:00
xige-16 f467260208
Split large loadSegmentReq to multi small reqs (#10125)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-19 10:40:35 +08:00
XuanYang-cn 2255fe0b45
Change deserialize deltelog from 1 blob to blobs (#10085)
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-19 10:28:35 +08:00
congqixia a7f7bff651
Modify SaveBinlogPaths proto to support delete logs (#10080)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-19 00:26:35 +08:00
zhenshan.cao dd24ea3737
[skip ci]Fix golint error in querynode (#10136)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:36:39 +08:00
zhenshan.cao d6f95f49e8
Fix golint error in querycoord (#10127)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:34:47 +08:00
zhenshan.cao 32a029fbed
[skip ci]Fix golint error in datacoord (#10135)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:32:49 +08:00
zhenshan.cao 39f043b08a
[skip ci]Fix golint error in allocator (#10134)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:30:56 +08:00
zhenshan.cao cfc9ba1e13
[skip ci]Fix golint error in allocator (#10130)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:29:00 +08:00
XuanYang-cn 40d3562ec0
Fix comment on SegmentInfo message (#10066)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-18 21:27:09 +08:00
zhenshan.cao d4e48fc4d1
[skip ci]Fix golint error in querycoord (#10137)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-18 21:24:34 +08:00
bigsheeper f8e7f3f549
[skip ci] Add comment for addSegmentPrivate (#10112)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-18 20:26:59 +08:00
bigsheeper 93ec046ef2
[skip ci] Add comment for addSegment (#10111)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-18 20:24:55 +08:00
bigsheeper 9ec4105a85
[skip ci] Add comment for getSegmentIDsPrivate (#10110)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-18 20:22:56 +08:00
cai.zhang cbb8236c05
[skip ci]Fix golint error for ReleaseSegments in QueryNode (#10064)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-18 20:20:53 +08:00
cai.zhang aba26a888a
[skip ci]Fix golint error for ReleasePartitions in QueryNode (#10063)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-18 20:19:01 +08:00
cai.zhang 62446f63d4
[skip ci]Fix golint error for GetSegmentInfo in QueryNode (#10065)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-18 20:17:03 +08:00
godchen 24a6fc096b
Update query node bloom filter (#10109)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-18 20:08:42 +08:00
yukun 401753dea0
[skip ci]Add comments for rocksmq SeekToLatest (#10120)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:52:49 +08:00
yukun ec667846f4
[skip ci]Add comments for rocksmq Seek (#10119)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:50:59 +08:00
yukun 8dccd0ca70
[skip ci]Add comments for rocksmq Consume (#10118)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-18 19:48:40 +08:00
Cai Yudong d54f3426e8
Reorder header files for test_segcore (#10051)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:38:47 +08:00
congqixia 3711fcd82f
Add more info for Delta log compaction (#10083)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-18 18:24:45 +08:00
Cai Yudong 027103b4f6
Reorder header files for test_span (#10053)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:10:57 +08:00
Cai Yudong 3e3f8b825a
Reorder header files for test_sealed (#10049)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-18 18:09:04 +08:00
groot 07599e6a35
[skip ci] Fix a typo (#10106)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-18 17:54:41 +08:00
congqixia 0438ed2bfe
Use single signal chan to notify flush (#10075)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-18 12:34:34 +08:00
congqixia 90f88c6559
Add flush manager structure (#9986)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-18 10:38:35 +08:00
dragondriver 353c4cc8ce
[skip ci] Add comment for stop proxy (#10032)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-16 22:08:52 +08:00
dragondriver 1211e286da
[skip ci] Add comment for start proxy (#10031)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-16 22:06:57 +08:00
yukun 65a1ae0210
[skip ci]Add comments for rocksmq produce (#10030)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 22:05:04 +08:00
yukun e8d5a1ee5f
[skip ci]Add comments for DestroyConsumerGroup (#10029)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 22:03:09 +08:00
xige-16 759603671c
[skip ci] Add comment for loadPartitionTask (#10028)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 22:01:15 +08:00
xige-16 59764d17bf
[skip ci] Add comment for ReleasePartitionTask (#10027)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 21:55:24 +08:00
bigsheeper a4a66341da
[skip ci] Add comment for getSegmentIDsByVChannel (#10022)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 21:51:32 +08:00
yukun 241acadce9
Remove error return when seek invalid messages in seekToLatest (#9967)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-16 21:49:40 +08:00
bigsheeper db534419f9
[skip ci] Add comment for getPartitionNum (#10021)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 21:47:44 +08:00
bigsheeper 9f958f4b00
[skip ci] Add comment for getSegmentIDs (#10020)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 21:45:40 +08:00
xige-16 1b50695a40
[skip ci] Add comment for ReleaseCollectionTask (#10026)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-16 21:43:32 +08:00
dragondriver 9d177593ae
[skip ci] Add comment for SetRootCoordClient (#10033)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-16 21:40:53 +08:00
cai.zhang b8d37034e7
[skip ci]Fix golint error for LoadSegments in QueryNode (#10004)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-16 17:16:45 +08:00
cai.zhang 3b13111280
[skip ci]Fix golint error for WatchDmChannels in QueryNode (#10003)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-16 17:14:51 +08:00
cai.zhang ea24a10dca
[skip ci]Fix golint error for ReleaseCollection in QueryNode (#10005)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-16 17:12:46 +08:00
bigsheeper 4c420dac21
Update excluded segments info when receive changeInfo (#10011)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-16 17:00:33 +08:00
congqixia b028dc3918
[skip ci] Fix golint issue for datacoord/channel_store.go (#9995)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-15 20:44:38 +08:00
dragondriver 0e58b3f70a
[skip ci] Fix golint warning of meta_table (#9993)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-15 20:42:45 +08:00
congqixia 1e11a11c27
[skip ci] Fix golint issue for datacoord/util.go (#9992)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-15 20:40:53 +08:00
dragondriver 977e98d21b
[skip ci] Fix golint warning of paramtable (#9991)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-15 20:38:58 +08:00
Cai Yudong dc0269cf4c
Optimize proxy getChannels (#9964)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 20:37:04 +08:00
bigsheeper ae5d2ee9ba
Init global sealed segments and seek query channel when AddQueryChannel (#9543)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-15 20:35:05 +08:00
Xiaofan d845153de4
Add Buffer for consumer channel (#9578)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-15 20:31:16 +08:00
xige-16 da5195aab8
[skip ci] Add comment for LoadCollectionTask (#9989)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 20:29:15 +08:00
zhenshan.cao f6a836c784
Fix golint error in proxy (#9905)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-15 20:27:09 +08:00
xige-16 56466508cc
[skip ci] Add comment for maxRetryNum (#9988)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 20:25:08 +08:00
Xiangyu Wang f8c52dd5bb
Fix golint warning in indexparamcheck (#9947)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-15 20:23:16 +08:00
xige-16 f6cd090106
[skip ci] Fix golint error for releasePartitions (#9987)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 20:21:12 +08:00
dragondriver 85b078e26a
[skip ci] Fix golint warning of log (#9994)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-15 20:18:41 +08:00
zwd1208 08ca551a75
[skip ci]Change etcd to lowercase (#9983)
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-10-15 18:58:37 +08:00
bigsheeper 14b77405f4
[skip ci] Add comment for collectionReplica (#9980)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-15 18:38:36 +08:00
bigsheeper 0f1de9757b
[skip ci] Add comment for hasPartition (#9979)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-15 18:36:42 +08:00
bigsheeper 3cff929be3
[skip ci] Add comment for getPartitionByIDPrivate (#9978)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-15 18:34:51 +08:00
XuanYang-cn 98ed253e2c
Update SegmentInfo proto to support deltalogs (#9925)
Resolves: #9922
See also: #9530

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:24:39 +08:00
cai.zhang ac7bacbbcc
[skip ci]Fix golint error for QueryNode (#9969)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-15 18:10:54 +08:00
XuanYang-cn d0e6b52ce9
[skip ci]Update license for datanode (#9963)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:09:00 +08:00
XuanYang-cn dcd56a575d
[skip ci]Update license for flowgraph of dn (#9962)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:07:09 +08:00
XuanYang-cn dd854bda4e
[skip ci]Update license for common.go (#9961)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:05:16 +08:00
XuanYang-cn 9c706c6dc3
[skip ci]Update license on datanode (#9960)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:03:25 +08:00
XuanYang-cn 880056e664
[skip ci]Update license for datesync (#9959)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-15 18:01:38 +08:00
cai.zhang 148b26cf40
[skip ci]Fix golint error for QueryNode (#9968)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-15 17:57:07 +08:00
cai.zhang af40606037
[skip ci]Fix golint error for QueryNode (#9970)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-15 17:52:56 +08:00
godchen 3f713a1104
Check server test error (#9954)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-15 17:12:35 +08:00
godchen bf71965f58
Check watchlist error (#9953)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-15 17:02:37 +08:00
Cai Yudong ffd67de9cb
Reorder header files for test_reduce (#9934)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 17:00:43 +08:00
godchen 9e9ad7c7e6
Check pk filter merge error (#9952)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-15 16:58:42 +08:00
Cai Yudong 356b7e36ba
Reorder header files for test_query (#9932)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 16:56:51 +08:00
yukun 55f148f17e
Add deleteMessage in flow_graph_filter_dm_node (#9504)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-15 16:54:43 +08:00
Cai Yudong bb721f1cf4
Format internal/core/CMakeLists.txt (#9931)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-15 16:52:43 +08:00
Xiangyu Wang 7ab109e57d
Fix golint warning in indexparamcheck (#9946)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-15 16:36:37 +08:00
sunby bfc9e47e2c
Fix data race in datacoord test (#9936)
issue: #9935
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-15 15:56:35 +08:00
yukun 2cfdf22897
Change retention ticker time to 10 minutes (#9933)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-15 15:44:35 +08:00
Xiaofan a0b98dacda
Skip reconsume tt msgstream when datacoord restart (#9684)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-15 11:46:33 +08:00
yukun 997e88d8c6
Add deleteMessage in flow_graph_insert_node (#9505)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-15 11:02:32 +08:00
xige-16 0ea1cdb555
[skip ci] Fix comment for loadPartitions (#9915)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 09:04:32 +08:00
xige-16 3d5f60fd4c
[skip ci] Add comment for getTimeTickChannel (#9914)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-15 09:02:40 +08:00
sunby 003a7ed7cc
[skip ci]Add comment for MarshalLogObject (#9920)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 21:26:33 +08:00
sunby 3a6f6d399f
[skip ci]Add comment for ChannelOpTypeNames (#9919)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 21:24:41 +08:00
sunby 2617b0f2a9
[skip ci]Improve code style (#9918)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 21:22:45 +08:00
congqixia 641e472b73
[skip ci] Add comment for ChannelPolicyFactoryv1 (#9913)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 20:28:33 +08:00
xige-16 e80fbd1f19
Fix golint error in the task of querycoord (#9866)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-14 20:18:33 +08:00
yukun 83f1b75293
[skip ci]Add comments for RegisterConsumer (#9912)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 20:02:37 +08:00
yukun a0d9991d6f
[skip ci]Add comments for CreateConsumerGroup (#9911)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 20:00:35 +08:00
cai.zhang 971e0ea91f
[skip ci]Fix golint for GetStatisticsChannel in distributed/querynode/service.go (#9909)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-14 19:38:36 +08:00
cai.zhang f054c82f7c
[skip ci]Fix golint for GetTimeTickChannel in distributed/querynode/service.go (#9908)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-14 19:36:41 +08:00
cai.zhang 02b65f7179
[skip ci]Fix golint for SetIndexCoord in distributed/querynode/service.go (#9907)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-14 19:34:51 +08:00
XuanYang-cn 83272a8b2d
[skip ci]Update license for global_id.go (#9897)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-14 19:27:11 +08:00
XuanYang-cn 268b4ff85d
[skip ci]Fix license of allocator.go (#9896)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-14 19:24:49 +08:00
XuanYang-cn 81f9c0b695
[skip ci]Update license for id.go (#9895)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-14 19:22:43 +08:00
congqixia 6b8ff60de3
Close event channel when watch event found error (#9819)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 19:20:35 +08:00
dragondriver 94e4dfd226
[skip ci] Add comment for getSystemInfoMetrics (#9899)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 19:18:34 +08:00
dragondriver 336869b46a
[skip ci] Add comments for proxy error (#9898)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 19:16:39 +08:00
dragondriver 7eab390927
[skip ci] Add comment for proxy Init (#9900)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 19:14:35 +08:00
bigsheeper c92706c75d
[skip ci] Add comment for getPartitionByID (#9892)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-14 18:54:34 +08:00
bigsheeper d59bb7dd29
[skip ci] Add comment for removePartitionPrivate (#9891)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-14 18:52:41 +08:00
bigsheeper 5ffe605865
[skip ci] Add comment for removePartition (#9890)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-14 18:50:51 +08:00
groot 95502ce0ca
Rename test object (#9887)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 18:48:56 +08:00
nameczz c992640176
[skip ci] Add create index comments in milvus.proto (#9852)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-10-14 18:46:59 +08:00
XuanYang-cn ea7abf49c3
Fix protobuf compilation error (#9881)
resolves:#9876

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-14 18:14:32 +08:00
groot bd7baf8912
Add unittest for distributed/proxy (#9875)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 17:48:34 +08:00
groot 7205fd3d9b
Remove unused interface (#9877)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 17:42:35 +08:00
godchen 2e0f7dfe42
Check data sync service error (#9856)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-14 17:40:42 +08:00
Cai Yudong 5a8aca01fd
Reorder header files for test_plan_proto (#9871)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 16:52:33 +08:00
congqixia ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
sunby 044b06421a
Use etcd to watch channel on datanode (#7115)
issue: #6578
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-14 15:44:34 +08:00
yukun 92815f4542
Change timestamp to timestamps in internalproto.DeleteRequest (#9802)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-14 14:48:34 +08:00
godchen 77a9b521c6
Check data sync service test error (#9854)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-14 14:12:34 +08:00
groot fad22067fc
Add comment for types (#9857)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-14 14:10:34 +08:00
zhenshan.cao bbafd05911
[skip ci]Fix golint error in paramtable (#9851)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-14 14:04:34 +08:00
zhenshan.cao 9eacfe719a
[skip ci]Fix golint error in querynode (#9849)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-14 14:02:41 +08:00
Cai Yudong 8dbc3db393
Remove dummy test_naive (#9850)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 12:52:33 +08:00
Cai Yudong 30661321f2
Remove dummy test_interface (#9848)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 12:50:37 +08:00
Xiangyu Wang 478daeaeea
Fix golint warnings in indexparamcheck (#9863)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-14 12:02:40 +08:00
Xiangyu Wang 274dd03a10
Fix golint warnings in indexparamcheck (#9861)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-14 11:52:40 +08:00
Xiangyu Wang 41bd393fe6
Fix golint warnings in indexparamcheck (#9862)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-14 11:30:39 +08:00
dragondriver 72d3d470ba
Use the server id as identifier in system topology graph (#9825)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 11:12:38 +08:00
Cai Yudong 937e59f6c3
Remove dummy test_load (#9847)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-14 11:06:39 +08:00
godchen a2dc0d8808
Init segment replica bloom filter (#9770)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-14 10:24:33 +08:00
Xiaofan 91d8f85df7
Refine log in task.go (#8992)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-13 23:24:32 +08:00
congqixia c50233639f
Add allocIDBatch for datanode allocator (#9782)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-13 22:12:32 +08:00
zhenshan.cao 609cc24309
Fix golint error in querycoord (#9836)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 21:46:32 +08:00
zhenshan.cao 3b230b5cd9
Fix golint error in proxy (#9834)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 21:44:37 +08:00
XuanYang-cn c2c927bd55
Use reader in the right way (#9790)
Avoid to mantaining the position myself.

Make Read bytes more easy to read and maintain.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 21:32:33 +08:00
xige-16 e481a2775a
[skip ci] Add comment for set child task (#9837)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:26:33 +08:00
xige-16 c84600a496
[skip ci] Add comment for set taskID (#9835)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:24:41 +08:00
xige-16 ddf0cd2174
[skip ci] Add comment for taskID (#9833)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-13 21:22:47 +08:00
bigsheeper 59daccf67c
Fix get memory info in getSystemInfoMetrics (#9809)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-13 21:20:33 +08:00
sunby 26a365c06d
Print more information when handling SaveBinlogPathsRequest (#9803)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-13 20:54:33 +08:00
yukun d2e2e0a63c
[skip ci]Add comments for ExistConsumerGroup (#9832)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 20:44:33 +08:00
yukun 67d38d6cf1
Fix retention datarace (#9828)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 20:38:33 +08:00
dragondriver 8f5bf46705
Fix golint warning of plan_parser.go (#9827)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-13 20:30:32 +08:00
zhenshan.cao e97b62cf67
Change RocksDBLRUCache size to 0 (#9820)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 20:28:34 +08:00
dragondriver 395a122678
[skip ci] Fix golint warning of metric_type.go (#9829)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-13 20:14:33 +08:00
cai.zhang 711dad2eae
[skip ci]Fix golint for SetRootCoord in distributed/querynode/service.go (#9814)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-13 19:36:33 +08:00
cai.zhang ba6ea3df7e
[skip ci]Fix golint for Run in distributed/querynode/service.go (#9816)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-13 19:30:34 +08:00
cai.zhang 0d03a2066e
[skip ci]Fix golint for Stop in distributed/querynode/service.go (#9815)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-13 19:24:41 +08:00
bigsheeper 4b77e6e047
[skip ci] Add comment for addPartitionPrivate (#9808)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-13 19:14:33 +08:00
bigsheeper 1a72d05a1b
[skip ci] Add comment for addPartition (#9807)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-13 19:12:39 +08:00
bigsheeper 71a6c5a7e6
[skip ci] Add comment for getFieldsByCollectionIDPrivate (#9806)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-13 19:10:46 +08:00
nameczz 7d49a48b47
[skip ci] Add ShowPartitionsResponse comments in milvus.proto (#9712)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-10-13 19:05:12 +08:00
XuanYang-cn 75dccad4fa
[skip ci]Fix const golint in data_codec (#9793)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:59:26 +08:00
XuanYang-cn 2659807826
[skip ci]Fix golint in data_codec (#9792)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 18:57:44 +08:00
ZhiShen 6a770e5c38
Make knowhere compile independently (#7606)
Make knowhere compile independently

1. Make knowhere compile independently
    * Add gtest, arrow, and some other libraries to index.
    * Add cache, log and some other files to knowhere.
    * Add CMakeLists files to index's thirdparty.

2. Modified the compilation content of knowhere
    * Delete some content of compile library.
    * Add IMPORTED_GLOBAL property to faiss.

3.  Change the compilation location of some libraries
    * Make OpenBLas compiled in thirdpartycore.cmake.
    * Make faiss compiled in thirdparty/CMakeLists.

Change the content of knowhere/CMakeLists

1. Change easyloggingpp and nlohmann into index/thirdparty.
2. Change MILVUS_THIRDPARTY_SRC into KNOWHERE_THIRDPARTY_SRC.

Delete FindOpenBLAS

1. Delete Openblas.cmake.

2. The search task for openBlas is assigned to ThirdpartyCore.

3. Some changes were made to build.sh in index.

Fix the openBLas compilation problem

Delete the if-else in compilation of faiss;

Now when complie faiss, it will find the Openblas as we wish.

Fix some problem:

1. delete arrow

2. set openblas_source to AUTO

3. change a include_dir

4. delete MKL

5. delete the CMakeLists in index/utils,cache,log

Change variable build_test to knowhere_build_test in index/build.sh

Change the include location of  GNUInstallDirs

set CMAKE_INSTALL_LIBDIR

Resolves: milvus-io#5183
See also: milvus-io#6604

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-10-13 17:06:33 +08:00
congqixia c90a97f95a
Fix Watch Channel canceled due to revision compacted (#9788)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-13 17:02:33 +08:00
yukun 6c88774624
Add get final filtered bitmap in SegmentGrowing (#9780)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-13 16:54:34 +08:00
Cai Yudong c7566345eb
Simplify meta_snapshot interface (#9778)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 15:54:33 +08:00
Cai Yudong a63ef91c74
Fix static-check (#9776)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 13:22:33 +08:00
godchen 31c3942ca7
[skip ci]Fix mqclient producer fmt (#9774)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 12:44:33 +08:00
XuanYang-cn aac6323cff
Use config as parameter (#9707)
Make functions in flowgraph lesser parameters

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-13 11:16:32 +08:00
jingkl 66e8583f86
[skip ci] Add producer.go description (#8748)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2021-10-13 11:14:39 +08:00
Cai Yudong 92c7eb5a09
Code clean for test_interface (#9767)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 11:06:33 +08:00
congqixia b0e038d0b3
Add proxy channelsMgr impl assertion (#9758)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-13 11:04:33 +08:00
zhenshan.cao b122fda325
[skip ci]Clarify the errors of DataCoord (#9771)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 11:02:34 +08:00
Cai Yudong ca5e3e8644
Code clean for test_indexing (#9765)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 11:00:39 +08:00
Cai Yudong 01db5dc6dd
Code clean for test_init (#9766)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 10:58:33 +08:00
zhenshan.cao 09421e6312
Fix golint error in datanode (#9746)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-13 10:56:40 +08:00
NotRyan 539fac4f83
Log language changes in Indexnode (#9692)
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
2021-10-13 10:54:33 +08:00
NotRyan 5d26d88f10
Change English verbage in rood-coord log messages (#9762)
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
2021-10-13 10:50:41 +08:00
godchen 59ab0e441c
Add bloom filter for stats (#9630)
* Add bloom filter for stats

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* trigger GitHub actions

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-13 10:22:33 +08:00
sunby e811a66527
Fix save binlog path timeout bug (#9573)
issue: #9559
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 23:46:35 +08:00
congqixia d8f490082c
Normalize dmInputNode seek log (#9714)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-12 23:44:35 +08:00
congqixia e9d2d0b17b
[skip ci] Add comment for types - Datacoord.GetSegmentInfo (#9754)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-12 23:42:35 +08:00
xige-16 c2731dddff
[skip ci] Add comment for task state (#9757)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-12 23:40:36 +08:00
xige-16 a0fb28fea4
[skip ci] Add comment for taskScheduler close (#9756)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-12 23:38:43 +08:00
xige-16 83c3a677cc
[skip ci] Add comment for taskScheduler start (#9755)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-12 23:36:47 +08:00
sunby aac60959d0
[skip ci]Add comment for NewClient (#9753)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:34:33 +08:00
sunby a0e1189333
[skip ci]Add comment for datacoord client (#9752)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:32:41 +08:00
sunby 2a5f94b4dc
[skip ci]Fix typo (#9751)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:30:49 +08:00
zhenshan.cao 0da7ed96f7
[skip ci]Fix golint error in querynode (#9747)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-12 20:25:02 +08:00
dragondriver 63ae5bd90c
Expose created time and updated time to querynode metrics (#9738)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:56:34 +08:00
zhenshan.cao c39bec7bd6
[skip ci]Fix golint error in logutil (#9743)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-12 19:52:43 +08:00
dragondriver 1f224c4b2e
Optimize the ut of storage utils (#9740)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:47:08 +08:00