Commit Graph

6060 Commits (8f13fcd612dc75a59c095f1e322f8cea5257a849)

Author SHA1 Message Date
yah01 8f13fcd612
Only log if the refresh actually happens (#20505)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 14:37:05 +08:00
yah01 faa2df3aac
Clear stale replicas (#20487)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-11 10:25:06 +08:00
cai.zhang 47951a81a5
Drop fail jobs on indexnode (#20425) (#20496)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-11 09:57:04 +08:00
XuanYang-cn b565145ad1
Remove too frequent logs (#20454) (#20476)
Half of the log messages come from this log if DataNode in stale.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-10 21:11:03 +08:00
xige-16 0d5fbe8922
Fix GetDiskUsedSize not work (#20469)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-10 20:37:04 +08:00
yah01 ea45a2aa4b
Refine QueryCoordV2 metrics (#20471)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-10 17:09:06 +08:00
Jiquan Long 14a544d631
Fix delete log (#20407) (#20446)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:21:04 +08:00
Jiquan Long dd4eb8ba0b
Fix some unreasonable logs in Proxy (#20411) (#20436)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:19:08 +08:00
Jiquan Long d63e082a34
Fix log of RootCoord (#20412) (#20435)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:17:14 +08:00
Jiquan Long dc147357d9
Fix log of alter collection (#20413) (#20428)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-10 11:15:04 +08:00
groot a1cd03ddca
Dont expire pending import tasks (#20432)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-10 10:25:08 +08:00
Jiquan Long 13dbc0902b
Fix querycoord metrics (#20429) (#20448)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:13:04 +08:00
Jiquan Long e34acf5f4e
Fix rootcoord metrics (#20427) (#20447)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:11:04 +08:00
Jiquan Long 6faa579928
Fix rpc log of Proxy (#20409) (#20441)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-09 22:03:05 +08:00
groot a1bc8c2bb2
Fix an error message (#20404)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-09 14:51:03 +08:00
cai.zhang 2c69b9e9e6
Add goroutine pool for creating index (#20391) (#20408)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-09 14:47:03 +08:00
xige-16 17071ce9e2
Fix cache disk index error (#20417)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-09 09:42:01 +08:00
yah01 2e78872be8
Refresh targets if haven't make progress for 5mins (#20382)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-08 19:05:03 +08:00
shaoyue e32b5e3711
Fix gcp oauth token not cached (#20396)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-11-08 15:15:03 +08:00
wei liu e9d34d421d
skip handoff event on unloaded partition (#20379)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-08 14:41:02 +08:00
congqixia 7f574bff58
Filter segments when doing FromDmlCPLoadDelete (#20388) (#20392)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-08 14:21:03 +08:00
wayblink 7a392d6019
Pass backup flag through Import request options (#20374)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-11-08 11:35:03 +08:00
congqixia 65a2b1c5a8
Add healthy check for InvalidateCollectionMetaCache (#20368) (#20378)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 19:53:03 +08:00
congqixia 9523a778c1
Fix version not deleted if expired by loadSegment (#20361) (#20377)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 19:51:06 +08:00
groot 57d96a11d9
Fix listImportTasks bug (#20372)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-07 18:53:02 +08:00
yah01 261bfeebfd
Refine task's priority (#20364) (#20370)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-07 17:23:03 +08:00
Xiaofan 3f67fad59a
Fix GC Tuner when memory is too large (#20353)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-07 12:17:05 +08:00
congqixia a4b3a53123
Remove KeyLock from querynode task (#20344) (#20349)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 09:45:01 +08:00
xige-16 16c8642b18
Delete RAW_DATA copy when load IVF_FLAT index data (#20348)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-05 17:33:05 +08:00
Xiaofan bb4777cf6e
Add GCTuner (#20351)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-05 12:07:00 +08:00
zhagnlu 1dac462cae
Change default thread core coefficient (#20120) (#20328) (#20333)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-04 17:49:35 +08:00
congqixia f557af1143
Verify target id for FlushSegments request in datanode (#20308)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-03 22:47:35 +08:00
SimFG deb9963d0e
Delete unused messages for the mq (#20295)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-03 21:41:35 +08:00
yah01 e0506352a4
Fix search failed with nil result (#20304)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 21:15:35 +08:00
zhagnlu 39212bc04c
Fix get cpu num for segcore (#20120) (#20307)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 19:29:36 +08:00
cai.zhang 6c4658db22
Don't build BIN_FLAT index really (#20309)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-03 18:23:37 +08:00
Jiquan Long e7103310b8
Fix log when building index (#20302)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-03 18:19:35 +08:00
bigsheeper d528aa3d90
Print seek postion time and seek elapse (#20271)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-03 15:03:35 +08:00
yah01 c08f11420f
Fix Release tasks may end with incorrect status (#20263)
If the resource has been removed, the release tasks should end with
Succeeded status, not stale

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 15:01:35 +08:00
XuanYang-cn 22fb1d3b93
Remove dup mock_kv.go and mock_txn_kv.go (#20267)
Replace them with mockery generated mocks in kv/mocks

See also: #19289

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-03 14:41:35 +08:00
zhagnlu cb2591d1fe
Parallel operations of disk-ann file manager (#20120) (#20122)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 14:39:40 +08:00
MrPresent-Han e0baf1536e
[skip e2e] Improve a commment for initial pr (#20287)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-03 14:05:36 +08:00
yah01 5143df1809
Fix Proxy never updates the shard leaders cache (#20286)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 12:27:36 +08:00
Xiaofan 766957e75a
Recuce memory consumption in MinioChunkManager (#20284)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-03 12:19:35 +08:00
Ten Thousand Leaves 5708352a80
Improve DataCoord and DataNode logs (#20265)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-03 12:15:35 +08:00
Ten Thousand Leaves 9751bec04c
Split large Etcd operations while altering segment info (#20278)
/kind bug

issue: #20275
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-03 11:01:35 +08:00
congqixia e1e3ed486e
Fix rmq consumer cancel may block forever (#20269)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-02 19:01:35 +08:00
jaime b7ee057d6b
Fix querynode panic during stop (#20242)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-02 14:59:34 +08:00
bigsheeper 51acba7d99
Add role name to ttDelay metric (#20239)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-02 10:55:34 +08:00
groot cd3b3d3da6
Only allow one file for row-based import (#20234)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-02 10:23:35 +08:00