Commit Graph

14698 Commits (ea2c395a389cb7f0c85a5b03a0835fdb7a70c432)

Author SHA1 Message Date
congqixia 2c03287e79
Improve log level in proxy QueryTask (#16234)
Use warn instead of debug in error case

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-28 23:11:26 +08:00
XuanYang-cn a77dd1034c
Adopt the extended state in DataCoord (#16200)
ChannelWatchInfo with ToWatch, ToRelease will trigger a timer.
ChannelManager now reacts to different ChannelWatch states.

- WatchSuccess > log this info

- WatchFailure/WatchTimeout > ToRelease

- ReleaseSuccess > Delete, reassign if not from DropCollection

- ReleaseFailure/ReleaseTimeout > Cleanup subscription and Delete,
  reassgin if not from DropCollection.

Some Notes:
1. Reassignment will add this channel to buffer if there's only one node.

See also: #15846

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-28 22:33:27 +08:00
Jenny Li 3936637e2e
[skip e2e]Fix robot fight (#16239)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-03-28 22:14:18 +08:00
Jiquan Long 973ea406ca
Improve log of show collections (#16233)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-28 21:47:27 +08:00
Jiquan Long 3353da7c94
Add m4 and autoconf to builder image (#16228)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-28 21:29:27 +08:00
cai.zhang c8688a6275
Organize log for GetIndexFilePaths (#16230)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-28 21:27:27 +08:00
Jenny Li 6ac1415eac
[skip e2e]Add url for issue also (#16215)
Signed-off-by: Jenny Li <jing.li@zilliz.com>
2022-03-28 21:25:31 +08:00
sre-ci-robot a5cd2970fc
Update Builder image changes (#16207)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-03-28 18:09:26 +08:00
Ji Bin 4f08f6d8c6
Workaround for knowhere under windows (#16214)
issue #16205

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-28 17:41:27 +08:00
sre-ci-robot 1cebf13b5f
Update Pytest image changes (#16223)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-03-28 17:31:27 +08:00
yah01 178eb8cce1
Modify proto to support replicas (#16218)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-28 16:43:27 +08:00
Ten Thousand Leaves 40c703dacd
Support check index state in root coord, for bulk load feature. (#16198)
issue: #15604

/kind feature

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-28 16:41:28 +08:00
zhuwenxing 974371c06c
[test]Add performance monitor for ApiCollectionWrapper (#16221)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-28 16:25:27 +08:00
Bingyi Sun e0ffe54547
Add interface to get replications by collection ID (#16213)
issue: #16158
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2022-03-28 14:35:27 +08:00
Cai Yudong 3e3756d3dc
Upgrade to knowhere v1.1.1 to support Mac M1 build (#16210)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-28 14:33:26 +08:00
zhuwenxing 4ad89df014
[skip e2e]Fix deploy config (#16206)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-28 10:17:26 +08:00
Jiquan Long 9cf96abbd3
Add libtool to builder image (#16194)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-28 10:11:26 +08:00
godchen 478f6ca11e
Add cache for vector chunk (#15912)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-03-26 22:05:26 +08:00
zhuwenxing 25ac724d55
[skip e2e]Add more check step in jenkins pipline (#16188)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-25 14:35:25 +08:00
sre-ci-robot 54bae78130
Update Pytest image changes (#16187)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-03-25 14:33:29 +08:00
Xiaofan f434e99c0a
Update README.md 2022-03-25 14:28:04 +08:00
xige-16 205c92e54b
Support insert string data (#15993)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-25 14:27:25 +08:00
yah01 227889b0d0
Add replica interfaces for Meta and Cluster (#16190)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-25 14:03:25 +08:00
Cai Yudong f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-25 13:49:25 +08:00
XuanYang-cn a00968fdfe
Fix unregister in datacoord cluster (#16182)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-25 12:09:25 +08:00
yah01 0d16ecf0dd
Add protobuf messages to support multi memory replica (#16153)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-25 11:13:25 +08:00
Ten Thousand Leaves a23ca745bb
Add Etcd support for Import Tasks. (#16164)
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-25 11:03:25 +08:00
jingkl ed9d3c32ff
[test]Modify the testcase with collection (#16184)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-03-25 09:23:25 +08:00
zhuwenxing 0524802648
[skip e2e]Fix deploy config (#16185)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-24 21:19:25 +08:00
bigsheeper 2fcf7b9760
Fix GetMemoryCount, get min as total memory (#15931)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-24 20:41:25 +08:00
yah01 9deb245d77
Fix data race in unittest (#16165)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-24 20:19:25 +08:00
bigsheeper 7fee4743f5
Improve log print in OOM error info (#16170)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-24 20:17:25 +08:00
sre-ci-robot 92b5436bbd Update all contributors
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2022-03-24 12:01:02 +00:00
Jiquan Long 48706f416f
Migrate scalar index from knowhere (#16174)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-24 14:57:26 +08:00
congqixia 661469445c
Copy index file content to c memory (#16162)
Might be the root cause of #15896
The index content bytes were passed via unsafe.Pointer,
which shall be copy to cpp managed memory inmediately

This solution might cause a lot of memory consumption.
Maybe we need to store the index bytes in cpp memory in the first place.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-24 14:55:25 +08:00
yah01 63a71e247a
Loading segments concurrency level fallbacks to the value that won't cause OOM (#16172)
Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-03-24 13:39:25 +08:00
xiyichan ca129d4308
Support configurable msgstream (#16131)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
groot 478890a700
modify import proto (#16155)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-23 19:29:25 +08:00
Letian Jiang 321105cc01
Add column-based insert interface in segcore (#16100)
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-23 19:05:25 +08:00
groot 1c4b949a1d
modify import rpc interface (#16129)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-22 15:11:24 +08:00
zhuwenxing 2e708a2910
[skip e2e]Add docker restart step for deploy test (#16125)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-21 17:33:25 +08:00
zhuwenxing 8572be4f9a
[skip e2e]Add more check steps after chaos (#16120)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2022-03-21 17:31:28 +08:00
sre-ci-robot d72129a39f
Update Pytest image changes (#16118)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2022-03-21 17:29:32 +08:00
groot 2078b24dca
Prepare for import (#16083)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-21 15:47:23 +08:00
Jiquan Long f8d9bc919d
Unify interface of vector index & scalar index. (#15959)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
XuanYang-cn c16195c747
Remove redundent requirement in python test (#16093)
grpcio-tools, grpcio, pandas, and numpy are all required
by pymilvus, so no need to add in requirements.txt in python
test.

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-21 12:01:24 +08:00
XuanYang-cn ad41e2a082
Tidy getQueryChannel for readability (#16096)
- Remove useless codes in query_coord.go
- Tidy slice initialization in LoadCollection task
- Add ut for getQueryChannel

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-21 11:25:24 +08:00
shaoyue 97e5d77953
implements restful entities api (#15916)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2022-03-21 11:21:23 +08:00
XuanYang-cn 15a3fe41c5
[skip e2e]Fix comments of exposed functions in QC (#16094)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-03-21 11:17:24 +08:00
jingkl 19baa7b282
[test]Add testcase of consistency (#16099)
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
2022-03-21 09:03:24 +08:00