Commit Graph

2406 Commits (41bd393fe644c7e71e9aa20b27a0b733d49dba50)

Author SHA1 Message Date
xige-16 83c3a677cc
[skip ci] Add comment for taskScheduler start (#9755)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-12 23:36:47 +08:00
sunby aac60959d0
[skip ci]Add comment for NewClient (#9753)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:34:33 +08:00
sunby a0e1189333
[skip ci]Add comment for datacoord client (#9752)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:32:41 +08:00
sunby 2a5f94b4dc
[skip ci]Fix typo (#9751)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-12 20:30:49 +08:00
zhenshan.cao 0da7ed96f7
[skip ci]Fix golint error in querynode (#9747)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-12 20:25:02 +08:00
dragondriver 63ae5bd90c
Expose created time and updated time to querynode metrics (#9738)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:56:34 +08:00
zhenshan.cao c39bec7bd6
[skip ci]Fix golint error in logutil (#9743)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-12 19:52:43 +08:00
dragondriver 1f224c4b2e
Optimize the ut of storage utils (#9740)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:47:08 +08:00
dragondriver 5bbffeacfd
Expose created time and updated time to querycoord metrics (#9732)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:39:24 +08:00
yukun e3ce1696e7
[skip ci]Add comments for rocksmq DestroyTopic (#9735)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:37:20 +08:00
zwd1208 d5e179e70b
[skip ci]Change uppercase for minio (#9734)
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-10-12 19:35:14 +08:00
yukun 55c615b4e2
[skip ci]Add comments for rocksmq CreateTopic (#9733)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:33:24 +08:00
dragondriver 7543122186
Expose created time and updated time to proxy metrics (#9727)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 19:31:25 +08:00
cai.zhang 3437761108
[skip ci]Fix golint for UniqueID in distributed/querynode/service.go (#9730)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-12 19:29:22 +08:00
cai.zhang aae7e978af
[skip ci]Fix golint for init in distributed/querynode/service.go (#9729)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-12 19:27:30 +08:00
godchen 653ba91cc7
[skip ci ]Add join id path comment (#9718)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-12 19:23:39 +08:00
cai.zhang 806973fe83
[skip ci]Fix golint for Server in distributed/querynode/service.go (#9728)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-12 19:21:08 +08:00
bigsheeper 55193ec75a
[skip ci] Add comment for getVecFieldIDsByCollectionID (#9721)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-12 19:11:04 +08:00
yukun cdeb64d90a
Delete messages before delete meta data in rocksmq retention (#9694)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-12 19:09:22 +08:00
bigsheeper de14446286
[skip ci] Add comment for getPartitionIDs (#9720)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-12 19:07:12 +08:00
bigsheeper 8a4a232eff
[skip ci] Add comment for getCollectionNum (#9719)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-12 19:05:17 +08:00
godchen f496bc70c0
[skip ci]Fix delete node comment lint (#9717)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-12 18:32:33 +08:00
Cai Yudong 45340835a7
Fix CreateAlias/DropAlias/AlterAlias impl (#9701)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 17:40:34 +08:00
godchen 13c1a1c746
Add joinIDPath for reuse (#9650)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-12 17:20:33 +08:00
dragondriver f85271cf3f
Estimate memory size by descriptor event (#9688)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-12 17:00:34 +08:00
Cai Yudong 2d8e86692a
Format test_expr.cpp (#9698)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:48:34 +08:00
Cai Yudong e790ba3e41
Reorder header files (#9700)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:44:33 +08:00
Cai Yudong 6f7031111a
Update header file (#9696)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 12:42:33 +08:00
congqixia 80ac456cf8
Normalize dmInputNode log (#9652)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-11 21:54:33 +08:00
xige-16 f8054a409e
[skip ci] Add comment for scheduler's taskChan (#9686)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 21:42:33 +08:00
congqixia 56b0b3a57b
[skip ci] Add comment for types.go - Datacoord.GetParitionStatistics (#9665)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-11 21:40:40 +08:00
cai.zhang 62c65d234a
[skip ci]Fix golint error in distributed/querynode/client/param_table.go (#9645)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-11 21:38:49 +08:00
cai.zhang f73c04915b
[skip ci]Fix golint error in distributed/querynode/param_table.go (#9639)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-11 21:33:11 +08:00
nameczz 3cb286400f
[skip ci] Improve milvus.proto comments (#8885)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-10-11 21:23:50 +08:00
godchen 3e26c19bad
[skip ci]Fix segment replica comment (#9654)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-11 21:12:44 +08:00
xige-16 0855347576
[skip ci] Add comment for newTaskScheduler (#9687)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 21:08:30 +08:00
sunby aba9aa450d
[skip ci]Add comment for SetFlushTime (#9668)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-11 21:06:37 +08:00
sunby 6fc64b836a
[skip ci]Add comment for SetBinlogs (#9667)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-11 21:04:42 +08:00
dragondriver abb8c2b9ed
Fix the way that binlog store the original size (#9681)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 21:02:37 +08:00
sunby 4b7e024245
[skip ci]Add comment for Client (#9669)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-11 19:28:37 +08:00
cai.zhang 6938e7b8e6
[skip ci]Fix golint in indexnode/param_table.go (#9629)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-11 19:17:02 +08:00
bigsheeper dd77e08b9e
[skip ci] Add comment for hasCollection (#9660)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-11 19:04:37 +08:00
bigsheeper 1b128c3fbf
[skip ci] Add comment for getCollectionByIDPrivate (#9659)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-11 19:02:45 +08:00
groot 2cba5053a8
Add comment for QueryCoordComponent (#9648)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-11 19:00:46 +08:00
bigsheeper ba998b1673
[skip ci] Add comment for hasCollectionPrivate (#9661)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-11 18:56:37 +08:00
XuanYang-cn f0bedc7046
Add ut for data_node.go (#9489)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-11 18:50:30 +08:00
xige-16 7aa0942b11
Add init info for AddQueryChannelRequest (#9606)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 18:48:29 +08:00
dragondriver 7daa319dc2
[skip ci] Rename EstimateMemorySize to GetBinlogSize (#9651)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 18:20:30 +08:00
congqixia e05877f828
Change datanode cache implementation to sync.Map (#9607)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-11 17:32:30 +08:00
dragondriver 9a7a060484
Store original memory size of binlog file to extra information (#9628)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 17:28:30 +08:00
groot 0d49316103
Add unittest for distributed/querynode (#9608)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-11 17:16:30 +08:00
Cai Yudong 9229d56c96
Clear redundant code line for test_bitmap (#9632)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 17:08:29 +08:00
Cai Yudong b8519416c0
Clear redundant code line (#9631)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 17:04:29 +08:00
cai.zhang 7801357dd3
Retry index building task in case of internal error such as minio failure (#9552)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-11 16:38:33 +08:00
Cai Yudong 4908b1c461
Update header file (#9625)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 16:35:52 +08:00
Cai Yudong 84e568ee32
Support Delete in datanode (#8505)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 16:31:44 +08:00
bigsheeper d567b21fd4
Add globalSegmentManager and consume changeInfoMsg (#9575)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-11 15:40:38 +08:00
bigsheeper 8c510a52b2
Use replica memory size and cacheSize in getSystemInfoMetrics (#9579)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-11 15:06:43 +08:00
dragondriver 1bc4b36617
Estimate the memory size of binlog file (#9612)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-11 14:10:48 +08:00
xige-16 e99ecc8cab
Add ProduceMark interface to return messageID (#9556)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 11:38:57 +08:00
groot 1277bb659a
Add unittest for distributed/querycoord (#9567)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-11 10:02:25 +08:00
xige-16 235d736a49
Add max number of retries for interTask in querycoord (#8215)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-11 09:54:37 +08:00
Cai Yudong bd3a8ed3cf
Support delete in proxy (#9588)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-11 07:48:55 +08:00
yukun b6b4b784cc
Delete end key after rocksdb DeleteRange (#9572)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-10 21:50:33 +08:00
zhenshan.cao a7dc9bdf15
Fix golint error in querynode (#9597)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-09 22:52:59 +08:00
Xiangyu Wang 75716e0deb
Update partition name validation in DeleteTask (#9560)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-09 22:50:39 +08:00
zhenshan.cao 3b8ed4774d
[skip ci]Fix golint error in datacoord (#9598)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-09 21:03:29 +08:00
congqixia af1402dcb8
Add comment and implementation assertion for proxy condition.go (#9576)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-09 21:01:18 +08:00
congqixia 02dc2a2453
Add GetVChanPosition new cases ut (#9544)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-09 20:57:33 +08:00
zhenshan.cao f6e4d8680e
[skip ci]Fix golint error in querycoord (#9596)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-10-09 20:53:10 +08:00
xige-16 b6cc36894b
[skip ci] Add comment for popTask (#9592)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-09 20:19:10 +08:00
xige-16 152d7dfa92
[skip ci] Add comment for enqueue (#9593)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-10-09 19:54:16 +08:00
Xiaofan 91641b75d3
Refine index coord logs (#9492)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-09 19:49:53 +08:00
yukun 12b985c32e
Add resource free in err process (#9564)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 19:39:16 +08:00
dragondriver 6eb2fe6993
[skip ci] Fix go lint warning of hardware_info.go (#9589)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:35:02 +08:00
dragondriver 41bd866ff6
Support LoadPartial interface for DataKV (#9554)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:33:03 +08:00
dragondriver dedf745b76
Rename IndexParamsFile to IndexParamsKey (#9563)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 19:27:02 +08:00
bigsheeper cc1801fa98
Add comment for removeCollectionPrivate (#9584)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-09 18:41:32 +08:00
bigsheeper 1b3a7b129b
Add comment for removeCollection (#9583)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-09 18:39:48 +08:00
congqixia 4a6a71020e
[skip ci] Add Comment for types - Datacoord GetCollectionStatistics (#9581)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-09 18:36:04 +08:00
bigsheeper 5865ead978
[skip ci] Add comment for getCollectionByID (#9585)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-09 18:33:32 +08:00
cai.zhang 6b58c5930e
[skip ci]Fix golint for BaseTask in indexnode.go (#9495)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-09 18:27:00 +08:00
cai.zhang e368b51d3e
[skip ci]Fix golint for task executing in indexnode.go (#9494)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-09 18:24:58 +08:00
cai.zhang c49122457d
[skip ci]Fix golint for IndexAddTask in indexcoord.go (#9557)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-09 18:15:19 +08:00
cai.zhang efd17aad74
Fix golint for BaseTask in indexcoord.go (#9550)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-10-09 18:13:30 +08:00
godchen d0bc0cd697
Skip data sync service test (#9571)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 17:41:00 +08:00
yukun b6ec1783e4
Remove acked infos in memory for retention (#8735)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 17:24:55 +08:00
dragondriver 302ca04d6c
Describe collection by collection ID (#9471)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 16:10:56 +08:00
dragondriver 28a90f9e7a
Store index parameters to descriptor event (#9451)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-09 16:08:56 +08:00
groot dd09ded49a
Modify package name of distributed/datacoord (#9551)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-09 16:00:56 +08:00
godchen faac37e726
Remove index registration after ut (#9558)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 15:47:00 +08:00
godchen 5e7648fc7c
Check data node test error (#9532)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 15:45:15 +08:00
godchen 376be1b532
Add data sync service error check (#9498)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 15:38:57 +08:00
bigsheeper 3a4df03b70
Add SealedSegmentsChangeInfo and changeInfoMsg (#9479)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-10-09 14:45:00 +08:00
godchen 55ec988544
[skip ci]Fix data node comment lint (#9534)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-10-09 11:28:57 +08:00
zwd1208 9ceb1c73db
[skip ci]Change uppercase of MinIO (#9539)
Signed-off-by: Weida Zhu <weida.zhu@zilliz.com>
2021-10-09 11:22:58 +08:00
yukun a6e97e0d44
Change LRUCache size of rocksdb to 512MB (#9509)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-10-09 11:08:56 +08:00
groot 735b02cf2b
Add unittest for distributed/datanode (#9503)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-09 10:10:59 +08:00
sunby 1e0c3cbcb9
[skip ci]Add comment for SetCurrentRows (#9526)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-09 00:16:56 +08:00
sunby 7834649dbc
[skip ci]Add comment for AddAllocation (#9525)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-10-09 00:15:13 +08:00