2078b24dca
Prepare for import ( #16083 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-21 15:47:23 +08:00
f8d9bc919d
Unify interface of vector index & scalar index. ( #15959 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
3cd28420f1
Support compile under windows ( #15786 )
...
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
* using gofrs/flock instead of syscall.Flock
* using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`
issue #7706
Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
f3eeecf146
Reduce the number of metrics ( #16030 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
c51c8c0a74
Fix get flused segment errror handling ( #15155 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-15 18:51:21 +08:00
97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API ( #15971 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-15 14:45:22 +08:00
29975a7a26
Remove Consume() API from mqstream interface ( #15886 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-11 20:09:59 +08:00
89356ebcb9
Modify import rpc interfaces ( #16006 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig ( #15843 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
7a3a721380
Reconstruct mqstream module ( #15784 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
9f4c59e621
Add prometheus metrics for RootCoord ( #15684 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-02 21:11:57 +08:00
f43d96b58d
[skip e2e] Modify code comments according to the naming conventions ( #15173 )
...
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
2022-02-09 10:19:56 +08:00
1f337891e1
Rename base_param to service_param, rename global_param to component_param ( #15463 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable ( #15434 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
4bccc85534
Use MsgChannelConfig in GlobalParams for all components ( #15163 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
eef295465a
Fix timetick inconsistency in drop collection ( #15408 )
...
When rootcoord drops a collection, it'll produce a `drop-collection DDL` msg
and one last timetick into DML channels of this collection.
So that when DataNode receives this msg, DN can release the resources for the specific collection.
Before this PR, RootCoord produced these two msgs with an older timestamp, generated
before many time-consuming RPCs.
Once these RPCs spend more time than timetick producing interval, the timetick of these 2 msgs are
older to the channel current timestamp, causing in-consistency in time, thus
making msgstream fail to consume the last `drop-collection DDL` msg.
This PR generates a new timestamp for `drop-collection DDL` msg and timetick msg after those time-consuming
RPCs
Fixes : #15406
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-28 20:49:41 +08:00
dee1961b4d
Make SearchResults and QueryResults return collectionID ( #15377 )
...
* Make SearchResults and QueryResults return collectionID
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
* add return collection name from QueryRequest and SearchRequest
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
* remove comment
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
2022-01-27 22:55:41 +08:00
885ecaf222
Refine time sync logic log ( #15251 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-27 11:25:41 +08:00
3a024307f4
Release collection first when drop collection ( #15370 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-24 21:51:22 +08:00
356efee492
Rename timetickSync APIs and variables for better readability ( #15264 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-18 14:47:36 +08:00
f564ea7fc7
RootCoord set healthy state after registered service ( #15261 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-18 12:09:37 +08:00
1b1d4e502b
Remove session from timetickSync ( #15255 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-18 00:07:37 +08:00
f36e02dfbb
Add more log when tt failed ( #15227 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-15 18:53:34 +08:00
f617c8887b
Time Tick Failed need log ( #15225 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
6323907566
Use CommonConfig in GlobalParams for all components ( #15106 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 19:03:35 +08:00
7efb02a4c5
Use PulsarConfig in GlobalParams for all components ( #15046 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-09 23:45:33 +08:00
f8f61fb116
Use BaseParams etcd configuration for all components ( #15012 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
18d36d78d2
[skip e2e] Add comment for rootCood.Core ( #14665 )
...
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-31 14:23:55 +08:00
e7e40c2328
RootCoord should get all binlog paths for vector field ( #14621 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-30 19:39:21 +08:00
d5e6adf381
Add log for timetickSync ( #14517 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 10:32:03 +08:00
69087ff8dd
Support embedded etcd ( #14333 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
1408926cd9
Remove logs without enough info ( #14440 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
2faf35707e
[skip e2e] Refine rootcoord comment ( #14447 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-28 19:47:21 +08:00
8b7af673a8
[skip e2e] Grammar correction ( #14417 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:24:17 +08:00
7ff9ed33ad
[skip e2e] Grammar correction ( #14416 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:21:18 +08:00
0759538855
[skip e2e] Grammar correction ( #14415 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:18:20 +08:00
30382d8bf9
Let rootcoord share proxy.TimeTickInterval ( #14326 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 21:38:45 +08:00
891c202b73
Use GlobalParamTable for all components ( #13885 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
f2d25ce338
[skip e2e] Refine rootcoord comment ( #14045 )
...
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-23 14:34:13 +08:00
9e9475b4fe
[skip e2e] Fix grammar mistake in meta_table ( #14017 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-22 21:31:15 +08:00
8a63dba149
Add consistency level field in collection meta ( #13766 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-21 19:49:02 +08:00
3c2605f174
[skip e2e]Update license for rc util ( #13889 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 19:19:21 +08:00
83df76d7af
[skip e2e]Update license for rc timetick ( #13888 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 18:50:59 +08:00
9fa2d757a2
[skip e2e]Update license for rc timestamp ( #13748 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 19:01:12 +08:00
907f554a0b
[skip e2e]Update license for rc suffix ( #13747 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 18:49:06 +08:00
33f326d576
[skip e2e]Update license for rc root_coord ( #13746 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 17:45:37 +08:00
8f8021eeb8
[skip e2e]Update license for rc proxyclient manager ( #13572 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:23:29 +08:00
67d99490ed
[skip e2e]Update license for rc paramtable ( #13571 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:21:31 +08:00
fc67e4bc93
[skip e2e]Update license for rc proxymanager ( #13570 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:19:36 +08:00
dea0e0277c
[skip e2e] Update root_coord imports ( #13593 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 14:13:16 +08:00
807aab3dd8
[skip e2e] Update metrics_info imports ( #13591 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 14:11:26 +08:00
12173f94f0
[skip ci]Update license for rc meta table ( #13498 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:07:10 +08:00
c544bb21ac
[skip ci]Update license for rc dml channels ( #13497 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:03:23 +08:00
12766540bd
[skip ci]Update license for rc meta snapshot ( #13496 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:01:35 +08:00
42ac5f76ed
Add constraints to the combination of load and release ( #13110 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 22:11:09 +08:00
769b05682a
[skip ci] Fix grammar mistake in suffix_snapshot ( #13420 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 12:07:44 +08:00
9f23fc7f2a
Register the service when the component state is healthy ( #13248 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
829077ad0c
Optimize reSentDdMsg logic ( #13378 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-15 08:59:08 +08:00
30e18cb5a7
Optimize rootcoord reSendDdMsg ( #13363 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-14 19:15:06 +08:00
405b3cd932
Use the same lint rules with golint in revive ( #13324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
2b59e15ef4
Use typeutil.RootCoordRole instead of Params.RoleName in rootcoord ( #13215 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-13 09:59:27 +08:00
2905182282
[skip ci]Fix error log output format in task.go ( #13131 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:19:10 +08:00
3ddcec79b4
[skip ci]Fix error log output format in root_coord_test.go ( #13130 )
...
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:17:30 +08:00
342200ce13
Estimate the memory size of the index before building the index ( #12973 )
...
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
a9a332dbcf
Fix empty segment compact and load ( #12710 )
...
1. Fix compaction save empty segment bug
2. Fix load empty segment bug
3. Add UT for dmlchannels to 100%
Resolves : #12450
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:03:08 +08:00
c289a19fb8
Remove log string concat in root_coord.go ( #12932 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 14:23:05 +08:00
e4de86ba42
Update rootcoord state to unhealthy before stopping ( #12845 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-07 18:39:03 +08:00
92eff1565c
Fix unlocked mutex in rootcoord ( #12772 )
...
issue: #12297
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-06 17:25:35 +08:00
1a806a174a
Support load collection with multiple vector column ( #12630 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-03 11:29:33 +08:00
9af7e179f2
Fix zero length slice declaration in timeticksync.go ( #12372 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 20:21:41 +08:00
a05a74fca2
Improve proxy manager in rootcoord ( #12303 )
...
issue: #11275
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-29 17:33:41 +08:00
cbbeb2a383
Add debug log when proxy idle for a long time ( #12319 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-27 13:57:16 +08:00
6188ac280b
Fix drop alias error ( #12281 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 18:03:17 +08:00
858e95f377
Move dmlChannel and deltaChannel into timeticksync ( #12254 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 10:07:15 +08:00
6c4c0ef6b5
Add more deploy metrics ( #12248 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
1f27eb604e
Remove all index when drop collection ( #12227 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 23:01:15 +08:00
4121e31df1
Send SIGINT to runner goroutine after etcd disconnects ( #12163 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
99b3c56b3e
Update rootcoord debug log ( #12160 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-22 16:01:14 +08:00
d4c297b1a8
Enhance dml channel operations ( #12143 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-21 21:33:13 +08:00
ee0f753f7a
Fix datarace between GetComponentStates and Register ( #11935 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-19 13:57:12 +08:00
074687e32e
Unify rootcoord debug log ( #12080 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-19 12:11:12 +08:00
27715c15f4
Fix 0 len slice declaration for dml_channels.go ( #12094 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-18 22:33:26 +08:00
5edbb82610
Add session revoke ( #11908 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
b0f268e087
Add more debug log for proxy registry in rootcoord ( #11899 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 19:21:49 +08:00
12f50cb22c
[skip ci]Update OWNERS files ( #11898 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
29e9adc7be
Fix golint warnings for rootcoord ( #11872 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:27:11 +08:00
173e7b3808
Fix golint warnings for rootcoord/root_coord.go ( #11871 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:25:17 +08:00
959d8c2ce1
Fix golint warnings for rootcoord/meta_table.go ( #11870 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:19:20 +08:00
3a9d6ee070
[skip ci] Add a log ( #11729 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-15 19:26:49 +08:00
3cd47cd89e
Remove common.yaml and component.yaml ( #11662 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 18:53:11 +08:00
5357e301f4
Fix retrieve search error ( #11501 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
5f08b67156
Move node.yaml to component.yaml ( #11363 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-10 14:27:37 +08:00
639800241d
Make flow graph for delta channel ( #11379 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
0699176d24
[skip ci]Fix golint error in rootcoord ( #11352 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 23:06:58 +08:00
a2ad88237d
Add deltaChannels in rootcoord core ( #11097 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 21:04:14 +08:00
628a3274bf
Use lazy mode to set dml msgstream as producer ( #10993 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 20:18:48 +08:00
54be3c15bf
Improve error message in rootcoord ( #11071 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:18:36 +08:00
260c0597cb
Improve error message in rootcoord ( #11070 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:16:43 +08:00
394e8ad634
Improve error message in rootcoord ( #11072 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:14:36 +08:00
66b9684fe5
Update ListCollectionPhysicalChannels and ListCollectionVirtualChannels ( #11007 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 15:50:30 +08:00
53b6b8d0fb
Improve error message in rootcoord ( #10876 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:40:10 +08:00
07818ec26a
Improve error message in rootcoord ( #10875 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:38:06 +08:00
1835a7cb0c
Improve error message in rootcoord ( #10877 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:35:57 +08:00
2df2d488e1
Fix Unit test fatal fail ( #10933 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
93f205b49e
Rename param names ( #10853 )
...
* Rename param names
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
* Rename configs
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-28 23:16:40 +08:00
a7d55229f0
Improve error message in rootcoord ( #10836 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-28 20:03:29 +08:00
77b94b3bcf
Improve log message in rootcoord ( #10838 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-28 19:59:27 +08:00
76ef1c9657
Fix Root Start hang ( #10765 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 22:00:27 +08:00
6fddcb3925
Fix Session checker for proxy ( #10737 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
bb7e3d3e70
Fix ParseHybridTs return type to int64 ( #10583 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 16:30:28 +08:00
555912f40e
Fix create meta table fails for compatibility issue ( #10703 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-26 23:00:27 +08:00
6db06ecf81
[skip ci] Fix typo ( #10411 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:10:06 +08:00
ed2b8d67c0
Reduce info saved in SnapshotMeta ( #10288 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 14:04:36 +08:00
8c67627150
[skip ci] Update comments ( #10283 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:48:35 +08:00
0941c297e7
[skip ci] Fix typo ( #10282 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:46:42 +08:00
0cd562d58b
[skip ci] Fix typo ( #10281 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:44:49 +08:00
0e58b3f70a
[skip ci] Fix golint warning of meta_table ( #9993 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-15 20:42:45 +08:00
ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order ( #9860 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
72d3d470ba
Use the server id as identifier in system topology graph ( #9825 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 11:12:38 +08:00
c7566345eb
Simplify meta_snapshot interface ( #9778 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 15:54:33 +08:00
5d26d88f10
Change English verbage in rood-coord log messages ( #9762 )
...
Signed-off-by: NotRyan <ryan.chan@zilliz.com>
Co-authored-by: NotRyan <ryan.chan@zilliz.com>
2021-10-13 10:50:41 +08:00
45340835a7
Fix CreateAlias/DropAlias/AlterAlias impl ( #9701 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 17:40:34 +08:00
49198dbce1
Disable dropping collection via alias ( #8850 )
...
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-10-08 17:37:53 +08:00
ed6101198b
[skip ci] Update order of header files ( #8964 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-01 11:08:24 +08:00
2c2b800ff4
Change Log Name with NodeId ( #8721 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal ( #8542 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
4b53a7fc05
Fix GetIndexByName ( #8780 )
...
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-28 21:52:20 +08:00
1edc00cd82
Add a log ETCD path ( #8739 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-28 13:54:03 +08:00
88e319acda
Save start position in collection meta ( #8682 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-27 18:10:00 +08:00
d38adda8c2
Rename log file based on node id ( #8517 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 21:18:11 +08:00
a20a9c71e2
Reduce go unittest time cost ( #8556 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-26 12:56:07 +08:00
177a465913
Clean golint warnings for rootcoord ( #8383 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 15:10:00 +08:00
f5173b595f
Add a channel prefix for all channels ( #8166 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-23 10:53:53 +08:00
a62bce360b
Replace MarshalTextString with Marshal in rootcoord ( #8341 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-23 10:37:54 +08:00
9ebfd43195
Add comment for proxyManager ( #8266 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-22 23:55:53 +08:00
c676979217
Add error detail when ddl fail ( #8304 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-22 19:50:15 +08:00
bdfb78e936
Add aliases to DescribeCollection ( #8268 )
...
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-22 16:20:48 +08:00
c314b2b4a8
Remove unused label rules ( #7929 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-18 18:19:51 +08:00
ccb57ba4b2
add collection alias ( #7255 )
...
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-18 11:13:51 +08:00
b3f965c7d4
Add unrecoverable error for retry. ( #7828 )
...
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-09-18 10:49:51 +08:00
d10c6abc9e
Apply for msgstream from pool when creating collection ( #7738 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-18 09:13:50 +08:00
c3eb6f9761
Expose created time and updated time to rootcoord metrics ( #8174 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-17 21:52:00 +08:00
1ee17464e8
Fix possible datarace in rootcoord ( #8120 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-17 12:37:50 +08:00
675b71cc30
Replace metaSnapshot with suffixSnapshot ( #7975 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 22:05:49 +08:00
55c47ab508
Add suffixSnapshot implementing SnapshotKV ( #7948 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-15 15:23:49 +08:00
ab84f95e66
[skip ci] Update debug log ( #7956 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-15 14:39:48 +08:00
7d53e44f3b
Depress gosec false positive ( #7899 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-14 18:37:48 +08:00
e5e4b24954
Fix bug: describe collection return wrong shard number ( #7841 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-14 11:59:47 +08:00
8a458b7a38
Add log for building index about num rows ( #7811 )
...
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-09-14 10:27:06 +08:00
8d239b6473
Add test cases for search task ( #7796 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-13 17:12:19 +08:00
a953c912b2
Add unittest for timeticksync ( #7793 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-13 16:32:44 +08:00
4c18910acd
Improve log print in rootcoord ( #7354 )
...
issue: #7306
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-09-13 11:56:42 +08:00
c8f860dcfb
Add unittest for proxy_client_manager ( #7729 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-10 18:10:00 +08:00
020f109dd8
Add unittest for rootcoord util ( #7688 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-09-10 16:41:48 +08:00
4e23ed9a18
Revert apply physical channels from pool ( d5f7e358 and 3b960969) ( #7687 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-10 13:00:00 +08:00
d5f7e358aa
Let dml tolerant physical channels generated by old version ( #7644 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-09 18:08:02 +08:00
29e5138274
Fix unittest: timeout caused by excessive use of resources ( #7653 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-09 17:39:30 +08:00
b0524adbd8
Support specified shard number when create collection ( #7482 )
...
Add shards_num to CollectionInfo
Modify dmlChannelNum config
Compatible with old meta
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-08 15:00:00 +08:00
d15d3fa0ac
Improve rootcoord codecov ( #7518 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-09-07 11:16:37 +08:00
86afde4598
Fix unittest for rootcoord, should filter out timetick msg first ( #7490 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-06 11:52:41 +08:00
960741ee16
Support more detailed metrics information ( #7472 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 19:35:47 +08:00
1db573731b
Cache the system information metrics ( #7436 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-03 17:15:26 +08:00
acf4354b83
Add logs in rootcoord ( #7457 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-09-03 14:10:10 +08:00
3721cbfea1
Proxy metrics integrates with other coordinators ( #7400 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-09-01 17:35:00 +08:00
3b9609692b
Apply for msgstream from pool when creating collection ( #7377 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 18:35:58 +08:00
f0dbdd7f13
Expose metrics of root coordinator ( #7228 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-08-31 11:45:59 +08:00
f4b53df727
Revert "Apply for msgstream from pool when creating collection ( #7323 )" ( #7376 )
...
This reverts commit e6de86a433
2021-08-31 11:07:58 +08:00
e6de86a433
Apply for msgstream from pool when creating collection ( #7323 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-31 09:47:58 +08:00
c62f23e201
[skip ci]Remove neza2017 from reviewers ( #7324 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-27 00:27:36 +08:00
4d9f89df09
Add unit test for 7150 fix ( #7276 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-25 14:41:52 +08:00
d83bc7fb54
Fix 0 ts when build index ( #7272 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-24 21:15:52 +08:00
58b2089692
Import Embedded Etcd Kv Part 1( #7112 ) ( #7174 )
...
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-08-24 09:45:51 +08:00
8405d90f5e
proxy add illegal check for search result ( #7227 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-23 17:03:51 +08:00
ec9ccd8bd1
Fix DropCollection not processed by datanode ( #7151 )
...
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-08-19 15:06:12 +08:00
305fa9c17e
Fix timestamp go back issue for timeticksync ( #7123 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-18 14:36:10 +08:00
21117241ec
Let system panic if kv operation fail ( #7143 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-08-17 23:06:10 +08:00
847586eb95
Add rocksmq retention ( #6617 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-08-16 18:46:10 +08:00
6c5be83ea1
Refactor NewEtcdKV API ( #7075 )
...
This PR mainly did the following 3 things:
- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision
The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.
Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.
Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.
Resolves : #6955
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-13 11:04:09 +08:00
5e78fd6a97
[skip ci]Update approvers ( #7063 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-08-12 19:36:09 +08:00
09199170a4
sync call querycoord releaseXXXX ( #6978 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-08-03 21:47:24 +08:00
47df4a2e57
Fix DataNode BackGroudGC problem ( #6551 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-08-03 09:59:24 +08:00
5adb69161f
Set CollectionInfo.CreateTime to the timestamp when save the metadata into etcd, ( #6763 )
...
not the timestamp when RootCoord receive the CreateCollection Request
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-23 14:36:12 +08:00
67c1fdd2c0
Show/Describe collections/partitions with created timestamp ( #6700 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-07-21 18:00:14 +08:00
cbb4052fdb
Support search and query output fields using wildcard ( #6671 )
...
* update wildcard polocy for search and query
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* mark xfail cases
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* mark xfail cases
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* optimize debug log
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-21 14:52:12 +08:00
fac350cc58
fix tso ( #6500 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-14 17:11:54 +08:00
b66157358c
add more log for create collection ( #6478 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-13 22:19:55 +08:00
d4239f0cd8
masterservice -> rootcoord ( #6447 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-13 09:37:40 +08:00
8b89744c6b
search with exp ( #6409 )
...
* process float vector and binary vector field
on the search result
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add more debug info on etcd
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add debug info when grpc failed
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-10 10:21:52 +08:00
21a9bcd844
Create default partition when receive CreateCollectionMsg ( #6305 )
...
* create default partition when create collection
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* adjust sleep time for unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-06 09:16:03 +08:00
ca4a562a72
simplify AddIndex, remove collID,PartID from parameters ( #6291 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-05 10:08:02 +08:00
bc8392eb1e
Add collectionID and partitionID into SegmentIndexInfo ( #6289 )
...
* add collectionID and partitionID into SegmentIndexInfo
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add partID2SegID into meta table
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update DropIndex
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-07-03 20:00:40 +08:00
f8fa025dcc
start background go routine to check if all the segments have indexed ( #6290 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-03 17:54:25 +08:00
111a24a49f
remove msgstream of segment info ( #6280 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-03 14:36:18 +08:00
07b0989628
Add GetFlushedSegments in data coordinator ( #6253 )
...
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-07-02 11:16:20 +08:00
6019c193fc
add grpc interface to process NewSegment And FlushSegmentCompleted ( #6247 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-07-01 14:58:17 +08:00
49a0528d53
Fix trace ( #6218 )
...
* Fix trace
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-06-30 16:18:13 +08:00
95ad498822
check proxy if exist before connect to it ( #6165 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-28 15:08:12 +08:00
a9a806ace0
optimize WatchProxy ( #6153 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-06-28 11:04:14 +08:00
b22ab71222
fix rmq ( #6147 )
...
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-26 22:26:20 +08:00
6d7edc6015
fix typo ( #6142 )
...
* fix typo
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
* add log
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2021-06-26 18:04:12 +08:00
groot
Jiquan Long
Ji Bin
zhenshan.cao
Xiaofan
jaime
Cai Yudong
cai.zhang
guoxiangzhou
XuanYang-cn
Filipe Caixeta
xige-16
shaoyue
edward.zeng
cxytz01
jaime
Xiangyu Wang
JackLCL
congqixia
Bingyi Sun
godchen
NotRyan
Yusup
sunby
yukun
neza2017