Commit Graph

3213 Commits (4d58ff2df7d052041bf259dcd69016719c3c5ef8)

Author SHA1 Message Date
xige-16 82c199227c
Add execute logic for balancing sealed segments (#11343)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-06 15:22:56 +08:00
yukun 4e5c8811da
Add flow_graph for delta channel in querynode (#11293)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-06 11:02:58 +08:00
zhenshan.cao 0699176d24
[skip ci]Fix golint error in rootcoord (#11352)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 23:06:58 +08:00
XuanYang-cn 72c0711919
Refine minio kv test (#11255)
This PR refines the minio_kv_test, makes sure the minIO test
is in the scope of configed rootPath

See also: #11237

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-05 23:05:10 +08:00
zhenshan.cao fbb9a5a790
[skip ci]Fix golint error in datacoord (#11351)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 23:03:10 +08:00
congqixia 0c4e09e341
Add comment for datacoord Server.startDataNodeTtLoop (#11033)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-05 23:01:02 +08:00
congqixia 3ac7d7a9de
Add detailed comments for dataSyncService in DataNode (#11285)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-05 22:59:04 +08:00
zhenshan.cao eac21d89af
[skip ci]Fix golint error in package common (#11350)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 22:46:56 +08:00
zhenshan.cao 595322ed51
[skip ci]Fix golint error in proxy (#11349)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 22:42:57 +08:00
sunby c26cd79532
Add compaction (#9906)
issue: #9904
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-05 22:25:00 +08:00
xige-16 b7644c0c03
[skip ci] Add comments for GetMetrics (#11347)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 22:01:03 +08:00
yukun 2c215a0be3
[skip ci]Add rmq_producer comment (#11346)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-05 21:59:10 +08:00
yukun ab00fe90de
[skip ci]Add rmq_producer comment (#11345)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-05 21:57:21 +08:00
yukun 425c7e09d4
[skip ci]Add rmq retention comment (#11344)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-05 21:53:22 +08:00
bigsheeper a756fc78c1
[skip ci] Add comment for addExcludedSegments (#11336)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-05 19:57:35 +08:00
bigsheeper 3ba797fffc
[skip ci] Add comment for removeExcludedSegments (#11335)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-05 19:55:45 +08:00
bigsheeper 85ba05e7f3
[skip ci] Add comment for getSegmentStatistics (#11334)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-05 19:53:54 +08:00
dragondriver f67bd0ae0c
[skip ci] Add comment for HasCollection (#11333)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-05 19:52:07 +08:00
dragondriver 2064dde4cc
[skip ci] Add comment for DropCollection (#11332)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-05 19:50:22 +08:00
dragondriver 1aaf7ad298
[skip ci] Add comment for CreateCollection (#11331)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-05 19:46:19 +08:00
zhenshan.cao 9885838593
Add extra methods to convert between uint64 and big-endian bytes slice (#11338)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 19:10:59 +08:00
Cai Yudong db2a0a3bd3
Fix reduce panic (#11325)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-05 18:17:00 +08:00
cai.zhang 6024346195
[skip ci]Fix golint error for ShowCollections in QueryCoord (#11329)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-05 18:07:07 +08:00
cai.zhang 9cf68b1076
[skip ci]Fix golint error for GetStatisticsChannel in QueryCoord (#11328)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-05 18:05:23 +08:00
cai.zhang b624ced622
[skip ci]Fix golint error for GetTimeTickChannel in QueryCoord (#11327)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-05 18:03:10 +08:00
xige-16 1aa8bf404a
Fix querynode ut panic on getSegmentInfo (#11323)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 17:33:34 +08:00
xige-16 9fcfbde368
Add getNodeInfoByID and getSegmentInfoByNode function for cluster (#11247)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 16:00:55 +08:00
congqixia 0e5931a3da
Add mergedTimetickSender for datanode (#11297)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-05 14:59:32 +08:00
Xiaofan d81b15163f
Seek Query/Query Result channel to Latest (#10985)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:57:44 +08:00
Xiaofan a4715996ef
Fix Pulsar seek to latest may block forever (#11128)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-05 14:55:44 +08:00
godchen 09f8fa1040
Add query coord watch delta channel (#11218)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:47:19 +08:00
godchen 88c9067873
Add hashvalue warning (#10668)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 14:20:55 +08:00
godchen 9bf68ac3eb
Fix timestamp endian error (#11220)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 13:56:58 +08:00
godchen 9186d5527e
Forward delete msg (#11210)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-05 11:59:02 +08:00
XuanYang-cn 35e8779bd9
Rename IndexRootPath to IndexStorageRootPath (#11236)
IndexRootPath is index file's blob storage prefix.
But the name is confusing with the MetaRootPath, which is prefix of etcd.

This PR changes the IndexRootPath to IndexStorageRootPath to
elimilate the confusion.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-05 11:45:00 +08:00
Xiangyu Wang 60848029e1
Improve warning message in rocksmq (#11227)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-05 10:58:55 +08:00
xige-16 c216c5a387
[skip ci] Add comments for MarshaledHits (#11284)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 09:23:11 +08:00
xige-16 fdb32445f2
[skip ci] Add comments for SearchResult (#11283)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 09:21:21 +08:00
xige-16 4a8d1991b7
[skip ci] Add comments for InitSegCore (#11282)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-05 09:19:31 +08:00
bigsheeper c99d1a56bf
Refactor proxy ticker to fix guarantee_time not work (#11248)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-05 09:14:02 +08:00
yukun c05ed4c365
[skip ci]Add rmq_imple seek comments (#11273)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-04 20:51:10 +08:00
yukun 872f6f8a04
[skip ci]Add rmq client comments (#11271)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-04 20:49:20 +08:00
cai.zhang 7eca7aec13
[skip ci]Fix golint error for Stop in QueryCoord (#11241)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-04 20:47:28 +08:00
yukun eda65381c2
[skip ci]Add rmq producer comments (#11272)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-04 20:45:17 +08:00
bigsheeper e21068ffbc
Fix release collection block in query node (#11249)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-04 19:51:07 +08:00
XuanYang-cn d9ceb3b3ff
[skip ci]Update license for ms unmarshal (#11262)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-04 19:15:41 +08:00
XuanYang-cn 7a2877e2ab
[skip ci]Update license for ms msg (#11261)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-04 19:13:50 +08:00
XuanYang-cn 5b79c5ee92
[skip ci]Update license for ms mq (#11260)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-04 19:12:03 +08:00
dragondriver 50f51f4b0c
[skip ci] Add comment for ReleaseDQLMessageStream (#11259)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-04 19:10:19 +08:00
dragondriver ad46968840
[skip ci] Add comment for InvalidateCollectionMetaCache (#11258)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-04 19:08:30 +08:00
cai.zhang bb12c3d39e
[skip ci]Fix golint error for GetComponentStates in QueryCoord (#11242)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-04 19:06:30 +08:00
dragondriver 202ce08e12
[skip ci] Add comment for GetStatisticsChannel (#11257)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-04 19:04:17 +08:00
bigsheeper 4f03f27633
[skip ci] Add comment for getSegmentNum (#11252)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-04 19:02:04 +08:00
bigsheeper b028e58c8f
[skip ci] Add comment for hasSegment (#11251)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-04 18:59:29 +08:00
bigsheeper 3f2455d03f
[skip ci] Add comment for getSegmentByID (#11250)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-04 18:56:42 +08:00
Cai Yudong 0fac38000c
Correct empty retrieve result handling (#11219)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-04 18:08:32 +08:00
cai.zhang 23941954b1
[skip ci]Fix golint error for Start in QueryCoord (#11240)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-04 18:02:53 +08:00
XuanYang-cn 91be4b10cc
Make mq_msgstream_test log more infos (#11168)
See also: #11146

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-04 15:58:17 +08:00
XuanYang-cn 8863c01ff7
Make DN fail faster when watching an invalid chan (#11102)
See also: #11098

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-04 15:56:28 +08:00
congqixia 0ef95c5df1
Add timeticker logger for insert buffer node (#11216)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-04 15:40:14 +08:00
godchen b63a9521c2
Make gen msg private (#10115)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-04 15:36:19 +08:00
congqixia 3e793469ec
Fix log unit test (#11225)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-04 14:58:08 +08:00
Xiangyu Wang e8c858b545
Improve error message in util (#11137)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:36:35 +08:00
Xiangyu Wang 508f560527
Improve error message in util (#11135)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:34:45 +08:00
Xiangyu Wang cc6a08f097
Improve error message in util (#11136)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-04 13:32:46 +08:00
xige-16 b567a8e5b5
Add SystemInfo msgType for getMetricRequest (#11151)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-04 10:58:11 +08:00
zhenshan.cao d824e029b9
[skip ci]Fix golint error in datanode (#11204)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 23:57:27 +08:00
zhenshan.cao 34c4ef06fc
[skip ci]Fix golint error in segment.go (#11203)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 23:50:14 +08:00
zhenshan.cao 59277d6edc
[skip ci]Fix golint error in querynode (#11202)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 23:48:17 +08:00
sunby 1f2e0c68db
[skip ci]Add comment for Start in datacoord client (#11200)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:26:12 +08:00
sunby 8eb2700fa7
[skip ci]Add comment for Init (#11199)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:24:21 +08:00
sunby 087f05bca5
[skip ci]Add comment for GetMetrics (#11198)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-03 23:22:31 +08:00
yukun e817cfbae6
[skip ci]Add pulsar client comments (#11197)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-03 23:20:46 +08:00
bigsheeper a1106181c3
[skip ci] Add comment for setSegment (#11196)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-03 23:18:57 +08:00
bigsheeper d6fa46cfbb
[skip ci] Add comment for addSegment (#11194)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-03 23:17:02 +08:00
xige-16 7ea6b773e6
[skip ci] Add comments for Init (#11193)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-03 23:15:16 +08:00
xige-16 48fb8174fa
[skip ci] Add comments for ReleaseSegments (#11192)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-03 23:13:26 +08:00
bigsheeper 1ba39c61c9
[skip ci] Add comment for removeSegment (#11195)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-03 23:09:06 +08:00
Cai Yudong a2ad88237d
Add deltaChannels in rootcoord core (#11097)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 21:04:14 +08:00
Cai Yudong 628a3274bf
Use lazy mode to set dml msgstream as producer (#10993)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 20:18:48 +08:00
dragondriver 2c687d372e
[skip ci] Add comments for GetComponentStates (#11185)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-03 19:52:13 +08:00
dragondriver b3305da3fa
[skip ci] Add comments for NewServer (#11184)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-03 19:50:27 +08:00
dragondriver e581a6364c
[skip ci] Add comments for client (#11183)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-03 19:48:48 +08:00
cai.zhang c50616711e
[skip ci]Fix golint error for Init in QueryCoord (#11163)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-03 19:33:01 +08:00
cai.zhang c5bc54abd6
[skip ci]Fix golint error for Client in QueryCoord (#11162)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-03 19:31:12 +08:00
cai.zhang c97c4d77b3
[skip ci]Fix golint error for GetMetrics in QueryCoord (#11161)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-03 19:29:26 +08:00
XuanYang-cn d74e5688ba
[skip ci]Add license for metrics (#11150)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-03 19:27:24 +08:00
XuanYang-cn f6cb82fa9e
[skip ci]Update license for logutil (#11149)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-03 19:25:37 +08:00
XuanYang-cn cddbeedf07
[skip ci]Update license in log (#11147)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-03 19:23:28 +08:00
Cai Yudong f25def79ed
Add debug logs for search results handling (#11186)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 19:12:10 +08:00
congqixia 9c53375bba
Fix MqttMsgStream skip current msg logic (#11171)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-03 17:11:47 +08:00
BUPTAnderson 6b25ab5801
[skip ci] Remove duplicated code in ParamTable init (#11175)
Signed-off-by: BUPTAnderson <yunlongkong@126.com>
2021-11-03 17:06:18 +08:00
congqixia dddf84b194
Add unit test for pulsarClient Seek (#11107)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-03 16:34:12 +08:00
Ji Bin 68d6839ab0
Improvements: Some adaptation for gcc-10 (#7853)
Support windows compile with MSYS (partial). This part including:

- CMakeLists.txt using CMAKE_SHARED_LIBRARY_SUFFIX instead .so
- Replace finite() with std::isfinite()
  ref: https://github.com/facebookresearch/faiss/pull/1341
- Replace bzero (deprecated in POSIX 2001) with memset.
  ref: https://github.com/facebookresearch/faiss/pull/1340
- Some int types match.

Signed-off-by: Ji Bin <matrixji@live.com>
2021-11-03 16:00:16 +08:00
Xiaofan 2b0f1a14ac
Remove secretkey and accesskey log print for MinIO (#11130)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-03 13:04:09 +08:00
zhenshan.cao cd79fd07c4
Fix timetravel bug on sealed segment (#11152)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-03 12:40:12 +08:00
Cai Yudong e059c99ada
Reorder header files for segcore/load_index_c.h (#11143)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 12:16:12 +08:00
Cai Yudong 9531fc5adf
Reorder header files for segcore/load_index_c.cpp (#11140)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 11:46:12 +08:00
Cai Yudong 40d254d09c
Reorder header files for segcore/InsertRecord.h (#11139)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 11:42:12 +08:00
Cai Yudong 885e5f4210
Remove redundant empty lines (#11138)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 11:38:15 +08:00
cai.zhang c3d0795e81
[skip ci]Fix golint error for ReleasePartitions in QueryCoord (#11060)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-03 10:47:00 +08:00
xige-16 4df2c23780
[skip ci] Add comments for WatchDmChannels (#11119)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 22:00:38 +08:00
xige-16 7c588e5652
[skip ci] Add comments for LoadSegments (#11118)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 21:58:22 +08:00
xige-16 aa64b64214
[skip ci] Add comments for GetSegmentInfo (#11117)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-02 21:56:34 +08:00
bigsheeper 2bcaaa83a1
[skip ci] Add comment for getSegmentIDsByVChannel (#11101)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-02 21:54:48 +08:00
bigsheeper 29a2a15820
[skip ci] Add comment for getSegmentIDs (#11100)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-02 21:52:51 +08:00
bigsheeper 06607f6955
[skip ci] Add comment for getPartitionNum (#11099)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-02 21:50:42 +08:00
dragondriver 82b510eda2
[skip ci] Fix golint warning of binlog_iterator.go (#11091)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:45:53 +08:00
dragondriver ac2a276815
[skip ci] Fix golint warning of validate_util.go (#11089)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:43:08 +08:00
dragondriver 232f75a001
[skip ci] Fix golint warning of kv (#11087)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:40:12 +08:00
zhenshan.cao b768fb2e07
[skip ci]Fix golint error in indexparamcheck (#11046)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-02 21:18:55 +08:00
zhenshan.cao 84a538f4d6
[skip ci]Fix golint error in allocator (#11045)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-02 21:14:40 +08:00
dragondriver 7f00753074
[skip ci] Fix golint warning of time.go (#11025)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-02 21:05:45 +08:00
cai.zhang e1bb0fb797
[skip ci]Fix golint error for GetSegmentInfo in QueryCoord (#11062)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-02 21:01:14 +08:00
cai.zhang 60d1f60651
[skip ci]Fix golint error for CreateQueryChannel in QueryCoord (#11061)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-02 20:57:53 +08:00
edward.zeng a8e28df5ab
[skip ci] Refine comments in metrics (#11103)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-02 19:43:22 +08:00
godchen 0d97549d84
Remove useless log (#11105)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 19:20:29 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00
yukun 82e5d21317
Fix MB const size (#11088)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 18:06:28 +08:00
yukun ea6cd7d27c
Move topic lock to the front of final delete in retention expired cleanup (#11076)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 17:28:31 +08:00
yukun a8722797fe
Add topic lock for rocksmq Seek (#11083)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-02 17:00:31 +08:00
Xiaofan ca56290e85
Fix rocksdb retention ts not set (#11081)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-02 16:50:31 +08:00
Ji Bin c63b804606
Windows dummy metrics for container. (#10625)
In windows we do not have cgroups.
This changes for return a dummy metrics under windows.

Signed-off-by: Ji Bin <matrixji@live.com>
2021-11-02 16:36:31 +08:00
Xiangyu Wang 54be3c15bf
Improve error message in rootcoord (#11071)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:18:36 +08:00
Xiangyu Wang 260c0597cb
Improve error message in rootcoord (#11070)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:16:43 +08:00
Xiangyu Wang 394e8ad634
Improve error message in rootcoord (#11072)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:14:36 +08:00
Cai Yudong 66b9684fe5
Update ListCollectionPhysicalChannels and ListCollectionVirtualChannels (#11007)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 15:50:30 +08:00
Xiangyu Wang c29dc0be6a
[skip ci]Update OWNERS file (#11077)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 15:22:33 +08:00
Cai Yudong dca0f1a463
Reorder header files for segcore/DeletedRecord.h (#11064)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 14:16:31 +08:00
congqixia 7d671b14ff
Fix SeekToLatest memory leakage and remove redundant logic (#11057)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-02 14:14:40 +08:00
Cai Yudong 93339c7f49
Reorder header files for segcore/FieldIndexing.h (#11067)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 11:14:33 +08:00
Cai Yudong 5397449f2a
Reorder header files for segcore/FieldIndexing.cpp (#11066)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 11:06:30 +08:00
Cai Yudong 623a31ab42
Reorder header files for segcore/ConcurrentVector.h (#11063)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 11:02:28 +08:00
Cai Yudong 6d5755998b
Reorder header files for segcore/Collection.h (#11059)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 10:46:33 +08:00
Cai Yudong ca936affac
Reorder header files for segcore/AckResponder.h (#11058)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 10:44:34 +08:00
yukun af7a5ca50f
[skip ci]Add rocksmq client comments (#11052)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-01 23:02:33 +08:00
xige-16 90ceca8bb5
[skip ci] Add comments for ReleasePartitions (#11049)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-01 22:58:53 +08:00
xige-16 4f8083c48d
[skip ci] Add comments for RemoveQueryChannel (#11048)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-01 22:57:07 +08:00
XuanYang-cn a086042b45
[skip ci]Update in task (#11032)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 22:51:41 +08:00
XuanYang-cn 41e720aad8
[skip ci]Update license for in pt (#11031)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 22:49:57 +08:00
XuanYang-cn e6a87ba94f
[skip ci]Update license for in in (#11030)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 22:48:06 +08:00
XuanYang-cn 8566d64f4a
[skip ci]Update license for in errors (#11028)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 22:46:00 +08:00
dragondriver 66c255c02e
[skip ci] Fix golint warning of conf_adapter_mgr.go (#11026)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-01 22:43:48 +08:00
bigsheeper 5eb0b67fbc
[skip ci] Add comment for hasPartition (#11022)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-01 22:41:59 +08:00
bigsheeper b369061ab3
[skip ci] Add comment for getPartitionByID (#11021)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-01 22:40:01 +08:00
bigsheeper bbfc02e0ca
[skip ci] Add comment for removePartition (#11020)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-01 22:37:50 +08:00
xige-16 b632de8dd2
[skip ci] Add comments for AddQueryChannel (#11047)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-01 22:32:33 +08:00
sunby a55019825b
Fix stale segments selector (#11051)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-11-01 22:30:04 +08:00
congqixia be0daafdb0
Fix rocksmq SeekToLatest (#11029)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-01 19:35:51 +08:00
Cai Yudong 4241326524
Update test API CheckSearchResultDuplicate (#11019)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 18:31:59 +08:00
XuanYang-cn ca857d922c
Fix session util using the same context (#10981)
Before this PR, session_util used the same context for new session,
keepalive check, and etcd keep alive. So if we cancel this context
by ourselves, half the chances will the etcd keep-alive-channel be
closed by etcd, which will make session utils `think` there's something
wrong in connecting to etcd, and half the chances will our keepalive check
exit as expected.

To solve this problem, this PR seperates 2 contexts: etcd keep alive
channel context and our liveness check context. So that when we cancel
this liveness check context, session util will exit as expected.

Resolves: #10881

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 18:25:58 +08:00
cai.zhang 5e077fd261
Fix bug for indexnode load balancing (#10994)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-01 17:16:05 +08:00
cai.zhang 6956348633
[skip ci]Fix golint error for LoadPartitions in QueryCoord (#11001)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-01 17:03:59 +08:00
cai.zhang d96efac928
[skip ci]Fix golint error for GetPartitionStates in QueryCoord (#11000)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-01 17:02:03 +08:00
cai.zhang 4f5a71a475
[skip ci]Fix golint error for ShowPartitions in QueryCoord (#10999)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-11-01 16:55:53 +08:00
godchen 7108612398
[skip ci]Fix allocator typo (#10998)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-01 16:54:07 +08:00
godchen 0970aea7e7
[skip ci]Fix allocator typo (#10997)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-01 16:52:19 +08:00
godchen d0ee395de5
[skip ci]Fix allocator typo (#10996)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-01 16:50:33 +08:00
Xiangyu Wang 53b6b8d0fb
Improve error message in rootcoord (#10876)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:40:10 +08:00
Xiangyu Wang 07818ec26a
Improve error message in rootcoord (#10875)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:38:06 +08:00
Xiangyu Wang 1835a7cb0c
Improve error message in rootcoord (#10877)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:35:57 +08:00
groot 598df45094
[skip ci] Typo (#10992)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-11-01 15:49:55 +08:00
groot a6160bc79e
[skip ci] Add comment (#10991)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-11-01 15:48:02 +08:00
groot 815d67375a
[skip ci] Add comment (#10990)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-11-01 15:46:12 +08:00
yukun 9286abb9ae
Change LittleEndian to BigEndian in flow_graph_insert_node (#10982)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-01 15:23:50 +08:00
yukun d8044299a0
Add uids and seg_offsets check in segcore (#10983)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-01 15:21:52 +08:00
XuanYang-cn 225b2c66a0
Fix datanode ut using register bug (#10885)
Resolves: #10881
See also: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 11:01:49 +08:00
Cai Yudong 70188990dc
Remove primary key duplicated query result on proxy (#10967)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 10:27:56 +08:00
Xiaofan 385eed1d17
Remove knowhere config (#10614)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-01 10:26:03 +08:00
XuanYang-cn 1e3fc5076f
Change etcdkv clientv3 into MetaKv interface (#10903)
This pr:
- changed etcdkv clientv3 into MetaKv interface
- replaced fmt.Sprintf with path.Join for kv key

See also: #8058

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-01 10:19:55 +08:00
Cai Yudong 881e547802
[skip ci] Add copyright for query_collection_test.go (#10975)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 10:17:54 +08:00
Cai Yudong da0cb4a702
Use primary key only to check search result duplicate (#10949)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-01 10:06:03 +08:00
bigsheeper 4661ccea3a
[skip ci] Add comment foe addPartition (#10972)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-01 09:05:55 +08:00
bigsheeper 13be90ea97
[skip ci] Add comment foe getPKFieldIDsByCollectionID (#10971)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-01 09:04:06 +08:00
bigsheeper 51a3dcd64f
[skip ci] Add comment foe getVecFieldIDsByCollectionID (#10970)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-01 09:02:04 +08:00
congqixia 54738d2ac5
[skip ci] Fix lint for datacoord/channel_store.og (#10964)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-30 21:08:00 +08:00
congqixia 2b07876827
[skip ci] Fix lint for AvgAssignRegisterPolicy (#10965)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-30 21:03:52 +08:00
xige-16 7c9cab042b
[skip ci] Add comments for ReleaseCollection (#10959)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-30 19:02:41 +08:00
xige-16 74b6107f5e
[skip ci] Add comments for GetStatisticsChannel (#10958)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-30 19:00:52 +08:00
xige-16 ba40193d69
[skip ci] Add comments for GetComponentStates (#10957)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-30 18:58:59 +08:00
cai.zhang b179d239b1
[skip ci]Fix golint error for ReleaseCollection in QueryCoord (#10954)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-10-30 18:53:28 +08:00
cai.zhang b4e4a33b07
[skip ci]Fix golint error for LoadCollection in QueryCoord (#10953)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-10-30 18:51:20 +08:00
cai.zhang 166170f6fe
[skip ci]Fix golint error for ShowCollections in QueryCoord (#10952)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-10-30 18:49:01 +08:00
Cai Yudong 0fe88c0571
Update schema_test (#10932)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-30 15:16:39 +08:00
Cai Yudong 7763615780
Remove primary key duplicated query result on query node (#10834)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-30 15:12:41 +08:00
Xiaofan 2df2d488e1
Fix Unit test fatal fail (#10933)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
yukun 9016bd7e33
[skip ci]Add rocksmq comments (#10925)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-29 21:45:01 +08:00
congqixia 390fad4eb7
Fix LatestPosition option conflict with earliest patch (#10907)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-29 21:30:49 +08:00
xige-16 95159ec53c
[skip ci] Add comments for GetTimeTickChannel (#10924)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-29 20:10:43 +08:00
xige-16 373722d1ca
Load segment before watch dmCahnnel when load collection (#10831)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-29 18:36:40 +08:00
Cai Yudong 0049837dc4
Add utils API AppendFieldData (#10910)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-29 18:06:43 +08:00
xige-16 245874a970
Fix too many operations in txn request when save segmentInfo (#10909)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-29 18:04:49 +08:00
bigsheeper 9c80dc8fcf
[skip ci] Add comment for getPartitionIDs (#10916)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-29 17:56:55 +08:00
bigsheeper 62d58ee7bf
[skip ci] Add comment for getCollectionNum (#10915)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-29 17:55:04 +08:00
bigsheeper 6ba185ab06
[skip ci] Add comment for hasCollection (#10914)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-29 17:53:17 +08:00
dragondriver c208363b0d
[skip ci] Fix golint warning of MinIOKV (#10913)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-29 17:51:28 +08:00
dragondriver 42ff76d379
[skip ci] Fix golint warning of indexparamcheck (#10912)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-29 17:49:28 +08:00
dragondriver 614e95fbf8
[skip ci] Fix golint warning of metrics (#10911)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-29 17:47:39 +08:00
yukun 8153beffb2
[skip ci]Remove unused code in segcore (#10905)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-29 17:26:44 +08:00
yukun 64d5584670
[skip ci]Format segcore comments (#10904)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-29 17:24:51 +08:00