7f7379d55f
Fix DML channel AsProducer after Close ( #16352 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-02 13:09:29 +08:00
45be3deb3f
Implement RC, DC, DN calling path for import. ( #16321 )
...
/kind feature
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-01 11:33:28 +08:00
0d54697d42
Implement ReportImport related logic. ( #16312 )
...
/kind feature
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-31 13:51:28 +08:00
ba37531456
Add support for loading multiple indexes ( #16138 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
40c703dacd
Support check index state in root coord, for bulk load feature. ( #16198 )
...
issue: #15604
/kind feature
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-28 16:41:28 +08:00
a23ca745bb
Add Etcd support for Import Tasks. ( #16164 )
...
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-25 11:03:25 +08:00
ca129d4308
Support configurable msgstream ( #16131 )
...
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
1c4b949a1d
modify import rpc interface ( #16129 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-22 15:11:24 +08:00
2078b24dca
Prepare for import ( #16083 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-21 15:47:23 +08:00
f8d9bc919d
Unify interface of vector index & scalar index. ( #15959 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
3cd28420f1
Support compile under windows ( #15786 )
...
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
* using gofrs/flock instead of syscall.Flock
* using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`
issue #7706
Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
f3eeecf146
Reduce the number of metrics ( #16030 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
c51c8c0a74
Fix get flused segment errror handling ( #15155 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-15 18:51:21 +08:00
97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API ( #15971 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-15 14:45:22 +08:00
29975a7a26
Remove Consume() API from mqstream interface ( #15886 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-11 20:09:59 +08:00
89356ebcb9
Modify import rpc interfaces ( #16006 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig ( #15843 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
7a3a721380
Reconstruct mqstream module ( #15784 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
9f4c59e621
Add prometheus metrics for RootCoord ( #15684 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-02 21:11:57 +08:00
f43d96b58d
[skip e2e] Modify code comments according to the naming conventions ( #15173 )
...
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
2022-02-09 10:19:56 +08:00
1f337891e1
Rename base_param to service_param, rename global_param to component_param ( #15463 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable ( #15434 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
4bccc85534
Use MsgChannelConfig in GlobalParams for all components ( #15163 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
eef295465a
Fix timetick inconsistency in drop collection ( #15408 )
...
When rootcoord drops a collection, it'll produce a `drop-collection DDL` msg
and one last timetick into DML channels of this collection.
So that when DataNode receives this msg, DN can release the resources for the specific collection.
Before this PR, RootCoord produced these two msgs with an older timestamp, generated
before many time-consuming RPCs.
Once these RPCs spend more time than timetick producing interval, the timetick of these 2 msgs are
older to the channel current timestamp, causing in-consistency in time, thus
making msgstream fail to consume the last `drop-collection DDL` msg.
This PR generates a new timestamp for `drop-collection DDL` msg and timetick msg after those time-consuming
RPCs
Fixes : #15406
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-28 20:49:41 +08:00
dee1961b4d
Make SearchResults and QueryResults return collectionID ( #15377 )
...
* Make SearchResults and QueryResults return collectionID
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
* add return collection name from QueryRequest and SearchRequest
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
* remove comment
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
2022-01-27 22:55:41 +08:00
885ecaf222
Refine time sync logic log ( #15251 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-27 11:25:41 +08:00
3a024307f4
Release collection first when drop collection ( #15370 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-24 21:51:22 +08:00
356efee492
Rename timetickSync APIs and variables for better readability ( #15264 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-18 14:47:36 +08:00
f564ea7fc7
RootCoord set healthy state after registered service ( #15261 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-18 12:09:37 +08:00
1b1d4e502b
Remove session from timetickSync ( #15255 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-18 00:07:37 +08:00
f36e02dfbb
Add more log when tt failed ( #15227 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-15 18:53:34 +08:00
f617c8887b
Time Tick Failed need log ( #15225 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
6323907566
Use CommonConfig in GlobalParams for all components ( #15106 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 19:03:35 +08:00
7efb02a4c5
Use PulsarConfig in GlobalParams for all components ( #15046 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-09 23:45:33 +08:00
f8f61fb116
Use BaseParams etcd configuration for all components ( #15012 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
18d36d78d2
[skip e2e] Add comment for rootCood.Core ( #14665 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-31 14:23:55 +08:00
e7e40c2328
RootCoord should get all binlog paths for vector field ( #14621 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-30 19:39:21 +08:00
d5e6adf381
Add log for timetickSync ( #14517 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 10:32:03 +08:00
69087ff8dd
Support embedded etcd ( #14333 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
1408926cd9
Remove logs without enough info ( #14440 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
2faf35707e
[skip e2e] Refine rootcoord comment ( #14447 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-28 19:47:21 +08:00
8b7af673a8
[skip e2e] Grammar correction ( #14417 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:24:17 +08:00
7ff9ed33ad
[skip e2e] Grammar correction ( #14416 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:21:18 +08:00
0759538855
[skip e2e] Grammar correction ( #14415 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:18:20 +08:00
30382d8bf9
Let rootcoord share proxy.TimeTickInterval ( #14326 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 21:38:45 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
f2d25ce338
[skip e2e] Refine rootcoord comment ( #14045 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-23 14:34:13 +08:00
9e9475b4fe
[skip e2e] Fix grammar mistake in meta_table ( #14017 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-22 21:31:15 +08:00
8a63dba149
Add consistency level field in collection meta ( #13766 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-21 19:49:02 +08:00
3c2605f174
[skip e2e]Update license for rc util ( #13889 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 19:19:21 +08:00
Xiaofan
Ten Thousand Leaves
Jiquan Long
xiyichan
groot
Ji Bin
zhenshan.cao
jaime
Cai Yudong
cai.zhang
guoxiangzhou
XuanYang-cn
Filipe Caixeta
xige-16
shaoyue
edward.zeng
cxytz01
jaime