Commit Graph

15981 Commits (2e78872be87b58e55b063646a8c5e2bfe72d6c32)

Author SHA1 Message Date
yah01 2e78872be8
Refresh targets if haven't make progress for 5mins (#20382)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-08 19:05:03 +08:00
shaoyue e32b5e3711
Fix gcp oauth token not cached (#20396)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>

Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-11-08 15:15:03 +08:00
wei liu e9d34d421d
skip handoff event on unloaded partition (#20379)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-08 14:41:02 +08:00
congqixia 7f574bff58
Filter segments when doing FromDmlCPLoadDelete (#20388) (#20392)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-08 14:21:03 +08:00
wayblink 7a392d6019
Pass backup flag through Import request options (#20374)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-11-08 11:35:03 +08:00
congqixia 65a2b1c5a8
Add healthy check for InvalidateCollectionMetaCache (#20368) (#20378)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 19:53:03 +08:00
congqixia 9523a778c1
Fix version not deleted if expired by loadSegment (#20361) (#20377)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 19:51:06 +08:00
groot 57d96a11d9
Fix listImportTasks bug (#20372)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-07 18:53:02 +08:00
yah01 261bfeebfd
Refine task's priority (#20364) (#20370)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-07 17:23:03 +08:00
Xiaofan 3f67fad59a
Fix GC Tuner when memory is too large (#20353)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-07 12:17:05 +08:00
congqixia a4b3a53123
Remove KeyLock from querynode task (#20344) (#20349)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-07 09:45:01 +08:00
xige-16 16c8642b18
Delete RAW_DATA copy when load IVF_FLAT index data (#20348)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-05 17:33:05 +08:00
Xiaofan bb4777cf6e
Add GCTuner (#20351)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-05 12:07:00 +08:00
xige-16 3c814f8999
Open c++ log (#20347)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-11-04 20:37:01 +08:00
Jenny Li 353c09acb2
[skip e2e] Disable ConcurrentBuilds for publish image to reducee resources (#20345) (#20346)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-04 19:31:39 +08:00
zhagnlu 1dac462cae
Change default thread core coefficient (#20120) (#20328) (#20333)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-04 17:49:35 +08:00
yanliang567 d732a33938
Remove teardown for bulk_insert tests (#20314)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-11-04 10:13:35 +08:00
congqixia f557af1143
Verify target id for FlushSegments request in datanode (#20308)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-03 22:47:35 +08:00
SimFG deb9963d0e
Delete unused messages for the mq (#20295)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-03 21:41:35 +08:00
yah01 e0506352a4
Fix search failed with nil result (#20304)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 21:15:35 +08:00
sre-ci-robot 151e0c42c5
Update Pytest image changes (#20311)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-11-03 20:01:36 +08:00
sre-ci-robot af44078a3b Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-11-03 12:00:42 +00:00
zhagnlu 39212bc04c
Fix get cpu num for segcore (#20120) (#20307)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 19:29:36 +08:00
cai.zhang 6c4658db22
Don't build BIN_FLAT index really (#20309)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-11-03 18:23:37 +08:00
Jiquan Long e7103310b8
Fix log when building index (#20302)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-03 18:19:35 +08:00
Jenny Li 7d188ea39a
[skip e2e] Update pytest image tag for the right ci yaml (#20300)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-03 17:47:36 +08:00
zhuwenxing e2b1cb6a44
[test]Update test cases for deploy and chaos test (#20180)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-11-03 15:49:35 +08:00
bigsheeper d528aa3d90
Print seek postion time and seek elapse (#20271)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-03 15:03:35 +08:00
yah01 c08f11420f
Fix Release tasks may end with incorrect status (#20263)
If the resource has been removed, the release tasks should end with
Succeeded status, not stale

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 15:01:35 +08:00
Jenny Li f4a9761e6b
[skip e2e] Add sign for auto pytest pr && change the e2e image (#20292)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-03 14:53:35 +08:00
XuanYang-cn 22fb1d3b93
Remove dup mock_kv.go and mock_txn_kv.go (#20267)
Replace them with mockery generated mocks in kv/mocks

See also: #19289

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-11-03 14:41:35 +08:00
zhagnlu cb2591d1fe
Parallel operations of disk-ann file manager (#20120) (#20122)
Signed-off-by: zhagnlu <lu.zhang@zilliz.com>

Signed-off-by: zhagnlu <lu.zhang@zilliz.com>
Co-authored-by: zhagnlu <lu.zhang@zilliz.com>
2022-11-03 14:39:40 +08:00
Jenny Li fdefcff84a
Refactor Makefile to reduce duplicate steps for ci-ut (#20288)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-03 14:19:35 +08:00
MrPresent-Han e0baf1536e
[skip e2e] Improve a commment for initial pr (#20287)
Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>

Signed-off-by: MrPresent-Han <jamesharden11122@gmail.com>
2022-11-03 14:05:36 +08:00
yah01 5143df1809
Fix Proxy never updates the shard leaders cache (#20286)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-11-03 12:27:36 +08:00
Xiaofan 766957e75a
Recuce memory consumption in MinioChunkManager (#20284)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-11-03 12:19:35 +08:00
Ten Thousand Leaves 5708352a80
Improve DataCoord and DataNode logs (#20265)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-03 12:15:35 +08:00
Jiquan Long d9081980e2
[skip e2e] Exit migration after session expired (#20282)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-11-03 11:47:36 +08:00
Ten Thousand Leaves 9751bec04c
Split large Etcd operations while altering segment info (#20278)
/kind bug

issue: #20275
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-11-03 11:01:35 +08:00
yanliang567 94aafb50c9
Update pymilvus version in requirements.txt (#20279)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-11-03 10:17:35 +08:00
yanliang567 3ac87fe025
Update bulk_insert to do_bulk_insert (#20277)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>

Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2022-11-02 20:35:35 +08:00
sre-ci-robot c2744bdf49
[create-pull-request] automated change (#20210)
Co-authored-by: sre-ci-robot <sre-ci-robot@users.noreply.github.com>
2022-11-02 19:21:36 +08:00
congqixia e1e3ed486e
Fix rmq consumer cancel may block forever (#20269)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-02 19:01:35 +08:00
Jenny Li fc7e7256f8
Add install support to mac (#20261)
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-11-02 15:39:35 +08:00
jaime b7ee057d6b
Fix querynode panic during stop (#20242)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-11-02 14:59:34 +08:00
bigsheeper 51acba7d99
Add role name to ttDelay metric (#20239)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-02 10:55:34 +08:00
groot cd3b3d3da6
Only allow one file for row-based import (#20234)
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-11-02 10:23:35 +08:00
NicoYuan1986 de45db0475
Modify test cases due to update of drop index (#20223)
Signed-off-by: nico <cheng.yuan@zilliz.com>

Signed-off-by: nico <cheng.yuan@zilliz.com>
2022-11-02 10:17:34 +08:00
binbin 0ec9118ca9
[skip e2e] Modify kafka configuration for nightly (#20237)
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
2022-11-02 10:03:34 +08:00
SimFG 56605980df
Make sure the query node isn't created repeatedly in concurrent situation (#20197)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-11-02 09:37:34 +08:00