milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
18,100 Commits
127 Branches
115 Tags
560 MiB
Commit Graph

545 Commits (7d0dd0047dc72c8f7c44f7beab9cde5c90f4d1c8)

Author SHA1 Message Date
Ten Thousand Leaves 242f08fb67
Refine import task related logic (#16601) 
issue: #16600

/kind bug

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-24 11:29:45 +08:00
groot a6a3b69d91
Report bulk load state (#16555) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-04-21 21:37:42 +08:00
codeman 91e84ffedf
fix: not create user root if exists, optimize log & imports (#16554) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-21 19:57:42 +08:00
Ten Thousand Leaves 289e468a7a
Make bulk load fully work (#16512) 
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-20 14:03:40 +08:00
codeman 3a1b2cedd2
create default root user for authentication (#16545) (#16549) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-20 13:03:40 +08:00
codeman f5e1ded854
fix #16504 (#16523) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-19 16:35:39 +08:00
Xiaofan fce8f6cfab
Remove Timetick channel (#16449) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-17 23:47:36 +08:00
jaime ed3c29eae7
Support Kafka (#16149) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-04-12 19:47:33 +08:00
Ten Thousand Leaves 442c73a544
Support passing channel names to DataNode (#16424) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-12 13:25:34 +08:00
codeman 4e12271d79
Support login with username and password (#15656) (#16341) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-11 19:49:34 +08:00
godchen bb7a0766fe
Add dependency factory (#16204) 
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
 2022-04-07 22:05:32 +08:00
Ten Thousand Leaves 1e6f6bd072
Implement set segment state call from RootCoord to DataCoord. (#16374) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-06 15:33:32 +08:00
Ten Thousand Leaves 2bd0a9526a
Implement task expiring logic and make all deadlines configurable. (#16355) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-03 11:37:29 +08:00
Xiaofan 7f7379d55f
Fix DML channel AsProducer after Close (#16352) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-02 13:09:29 +08:00
Ten Thousand Leaves 45be3deb3f
Implement RC, DC, DN calling path for import. (#16321) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-04-01 11:33:28 +08:00
Ten Thousand Leaves 0d54697d42
Implement ReportImport related logic. (#16312) 
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-31 13:51:28 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
Ten Thousand Leaves 40c703dacd
Support check index state in root coord, for bulk load feature. (#16198) 
issue: #15604

/kind feature

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-28 16:41:28 +08:00
Ten Thousand Leaves a23ca745bb
Add Etcd support for Import Tasks. (#16164) 
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-03-25 11:03:25 +08:00
xiyichan ca129d4308
Support configurable msgstream (#16131) 
Signed-off-by: xiyichan <2863768433@qq.com>
 2022-03-24 10:15:25 +08:00
groot 1c4b949a1d
modify import rpc interface (#16129) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-22 15:11:24 +08:00
groot 2078b24dca
Prepare for import (#16083) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-03-21 15:47:23 +08:00
Jiquan Long f8d9bc919d
Unify interface of vector index & scalar index. (#15959) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-21 14:23:24 +08:00
Ji Bin 3cd28420f1
Support compile under windows (#15786) 
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
 2022-03-17 17:17:22 +08:00
zhenshan.cao f3eeecf146
Reduce the number of metrics (#16030) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 21:51:21 +08:00
Xiaofan c51c8c0a74
Fix get flused segment errror handling (#15155) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-03-15 18:51:21 +08:00
jaime 97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API (#15971) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-15 14:45:22 +08:00
jaime 29975a7a26
Remove Consume() API from mqstream interface (#15886) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-11 20:09:59 +08:00
groot 89356ebcb9
Modify import rpc interfaces (#16006) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-03-11 17:13:59 +08:00
Cai Yudong 3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-03-04 11:17:56 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-03-03 21:57:56 +08:00
cai.zhang 9f4c59e621
Add prometheus metrics for RootCoord (#15684) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-03-02 21:11:57 +08:00
guoxiangzhou f43d96b58d
[skip e2e] Modify code comments according to the naming conventions (#15173) 
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
 2022-02-09 10:19:56 +08:00
Cai Yudong 1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-08 20:57:47 +08:00
Cai Yudong f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-07 10:09:45 +08:00
Cai Yudong 4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-02-02 00:35:43 +08:00
XuanYang-cn eef295465a
Fix timetick inconsistency in drop collection (#15408) 
When rootcoord drops a collection, it'll produce a `drop-collection DDL` msg
and one last timetick into DML channels of this collection.
So that when DataNode receives this msg, DN can release the resources for the specific collection.

Before this PR, RootCoord produced these two msgs with an older timestamp, generated
before many time-consuming RPCs.

Once these RPCs spend more time than timetick producing interval, the timetick of these 2 msgs are
older to the channel current timestamp, causing in-consistency in time, thus
making msgstream fail to consume the last `drop-collection DDL` msg.

This PR generates a new timestamp for `drop-collection DDL` msg and timetick msg after those time-consuming
RPCs

Fixes: #15406

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-01-28 20:49:41 +08:00
Filipe Caixeta dee1961b4d
Make SearchResults and QueryResults return collectionID (#15377) 
* Make SearchResults and QueryResults return collectionID

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* add return collection name from QueryRequest and SearchRequest

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* remove comment

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
 2022-01-27 22:55:41 +08:00
Xiaofan 885ecaf222
Refine time sync logic log (#15251) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-01-27 11:25:41 +08:00
xige-16 3a024307f4
Release collection first when drop collection (#15370) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-01-24 21:51:22 +08:00
Cai Yudong 356efee492
Rename timetickSync APIs and variables for better readability (#15264) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-18 14:47:36 +08:00
cai.zhang f564ea7fc7
RootCoord set healthy state after registered service (#15261) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-01-18 12:09:37 +08:00
Cai Yudong 1b1d4e502b
Remove session from timetickSync (#15255) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-18 00:07:37 +08:00
Xiaofan f36e02dfbb
Add more log when tt failed (#15227) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-01-15 18:53:34 +08:00
Xiaofan f617c8887b
Time Tick Failed need log (#15225) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-01-14 23:55:34 +08:00
Cai Yudong 6323907566
Use CommonConfig in GlobalParams for all components (#15106) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-10 19:03:35 +08:00
Cai Yudong 7efb02a4c5
Use PulsarConfig in GlobalParams for all components (#15046) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-09 23:45:33 +08:00
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-07 16:15:26 +08:00
shaoyue 18d36d78d2
[skip e2e] Add comment for rootCood.Core (#14665) 
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
 2021-12-31 14:23:55 +08:00
cai.zhang e7e40c2328
RootCoord should get all binlog paths for vector field (#14621) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-30 19:39:21 +08:00
Jiquan Long d5e6adf381
Add log for timetickSync (#14517) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-30 10:32:03 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-12-29 14:35:21 +08:00
Xiaofan 1408926cd9
Remove logs without enough info (#14440) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-12-29 10:06:47 +08:00
edward.zeng 2faf35707e
[skip e2e] Refine rootcoord comment (#14447) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-28 19:47:21 +08:00
cxytz01 8b7af673a8
[skip e2e] Grammar correction (#14417) 
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
 2021-12-28 19:24:17 +08:00
cxytz01 7ff9ed33ad
[skip e2e] Grammar correction (#14416) 
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
 2021-12-28 19:21:18 +08:00
cxytz01 0759538855
[skip e2e] Grammar correction (#14415) 
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
 2021-12-28 19:18:20 +08:00
Cai Yudong 30382d8bf9
Let rootcoord share proxy.TimeTickInterval (#14326) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-27 21:38:45 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 18:39:11 +08:00
edward.zeng f2d25ce338
[skip e2e] Refine rootcoord comment (#14045) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-23 14:34:13 +08:00
jaime 9e9475b4fe
[skip e2e] Fix grammar mistake in meta_table (#14017) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-22 21:31:15 +08:00
Jiquan Long 8a63dba149
Add consistency level field in collection meta (#13766) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-21 19:49:02 +08:00
XuanYang-cn 3c2605f174
[skip e2e]Update license for rc util (#13889) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-21 19:19:21 +08:00
XuanYang-cn 83df76d7af
[skip e2e]Update license for rc timetick (#13888) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-21 18:50:59 +08:00
XuanYang-cn 9fa2d757a2
[skip e2e]Update license for rc timestamp (#13748) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-20 19:01:12 +08:00
XuanYang-cn 907f554a0b
[skip e2e]Update license for rc suffix (#13747) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-20 18:49:06 +08:00
XuanYang-cn 33f326d576
[skip e2e]Update license for rc root_coord (#13746) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-20 17:45:37 +08:00
XuanYang-cn 8f8021eeb8
[skip e2e]Update license for rc proxyclient manager (#13572) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-17 14:23:29 +08:00
XuanYang-cn 67d99490ed
[skip e2e]Update license for rc paramtable (#13571) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-17 14:21:31 +08:00
XuanYang-cn fc67e4bc93
[skip e2e]Update license for rc proxymanager (#13570) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-17 14:19:36 +08:00
Cai Yudong dea0e0277c
[skip e2e] Update root_coord imports (#13593) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-17 14:13:16 +08:00
Cai Yudong 807aab3dd8
[skip e2e] Update metrics_info imports (#13591) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-17 14:11:26 +08:00
XuanYang-cn 12173f94f0
[skip ci]Update license for rc meta table (#13498) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-16 10:07:10 +08:00
XuanYang-cn c544bb21ac
[skip ci]Update license for rc dml channels (#13497) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-16 10:03:23 +08:00
XuanYang-cn 12766540bd
[skip ci]Update license for rc meta snapshot (#13496) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-16 10:01:35 +08:00
xige-16 42ac5f76ed
Add constraints to the combination of load and release (#13110) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-12-15 22:11:09 +08:00
jaime 769b05682a
[skip ci] Fix grammar mistake in suffix_snapshot (#13420) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-15 12:07:44 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-15 11:47:10 +08:00
Cai Yudong 829077ad0c
Optimize reSentDdMsg logic (#13378) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-15 08:59:08 +08:00
Cai Yudong 30e18cb5a7
Optimize rootcoord reSendDdMsg (#13363) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-14 19:15:06 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-14 15:31:07 +08:00
Cai Yudong 2b59e15ef4
Use typeutil.RootCoordRole instead of Params.RoleName in rootcoord (#13215) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-13 09:59:27 +08:00
JackLCL 2905182282
[skip ci]Fix error log output format in task.go (#13131) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-10 10:19:10 +08:00
JackLCL 3ddcec79b4
[skip ci]Fix error log output format in root_coord_test.go (#13130) 
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
 2021-12-10 10:17:30 +08:00
cai.zhang 342200ce13
Estimate the memory size of the index before building the index (#12973) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2021-12-09 14:19:40 +08:00
XuanYang-cn a9a332dbcf
Fix empty segment compact and load (#12710) 
1. Fix compaction save empty segment bug
2. Fix load empty segment bug
3. Add UT for dmlchannels to 100%

Resolves: #12450

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-09 11:03:08 +08:00
congqixia c289a19fb8
Remove log string concat in root_coord.go (#12932) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-08 14:23:05 +08:00
congqixia e4de86ba42
Update rootcoord state to unhealthy before stopping (#12845) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-07 18:39:03 +08:00
Bingyi Sun 92eff1565c
Fix unlocked mutex in rootcoord (#12772) 
issue: #12297
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-12-06 17:25:35 +08:00
Cai Yudong 1a806a174a
Support load collection with multiple vector column (#12630) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-03 11:29:33 +08:00
congqixia 9af7e179f2
Fix zero length slice declaration in timeticksync.go (#12372) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-29 20:21:41 +08:00
Bingyi Sun a05a74fca2
Improve proxy manager in rootcoord (#12303) 
issue: #11275
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2021-11-29 17:33:41 +08:00
Cai Yudong cbbeb2a383
Add debug log when proxy idle for a long time (#12319) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-27 13:57:16 +08:00
Cai Yudong 6188ac280b
Fix drop alias error (#12281) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-25 18:03:17 +08:00
Cai Yudong 858e95f377
Move dmlChannel and deltaChannel into timeticksync (#12254) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-25 10:07:15 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-24 15:43:15 +08:00
Cai Yudong 1f27eb604e
Remove all index when drop collection (#12227) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-23 23:01:15 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-22 16:23:17 +08:00
Cai Yudong 99b3c56b3e
Update rootcoord debug log (#12160) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-22 16:01:14 +08:00
Cai Yudong d4c297b1a8
Enhance dml channel operations (#12143) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-21 21:33:13 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-11-19 13:57:12 +08:00
Cai Yudong 074687e32e
Unify rootcoord debug log (#12080) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-19 12:11:12 +08:00
congqixia 27715c15f4
Fix 0 len slice declaration for dml_channels.go (#12094) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-18 22:33:26 +08:00
congqixia 5edbb82610
Add session revoke (#11908) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-11-16 22:31:14 +08:00
Cai Yudong b0f268e087
Add more debug log for proxy registry in rootcoord (#11899) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-16 19:21:49 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-16 15:41:11 +08:00
Cai Yudong 29e9adc7be
Fix golint warnings for rootcoord (#11872) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-16 14:27:11 +08:00
Cai Yudong 173e7b3808
Fix golint warnings for rootcoord/root_coord.go (#11871) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-16 14:25:17 +08:00
Cai Yudong 959d8c2ce1
Fix golint warnings for rootcoord/meta_table.go (#11870) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-16 14:19:20 +08:00
jaime 3a9d6ee070
[skip ci] Add a log (#11729) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-11-15 19:26:49 +08:00
Xiaofan 3cd47cd89e
Remove common.yaml and component.yaml (#11662) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-12 18:53:11 +08:00
godchen 5357e301f4
Fix retrieve search error (#11501) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-11 00:54:45 +08:00
Xiaofan 5f08b67156
Move node.yaml to component.yaml (#11363) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-11-10 14:27:37 +08:00
godchen 639800241d
Make flow graph for delta channel (#11379) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-11-09 09:27:04 +08:00
zhenshan.cao 0699176d24
[skip ci]Fix golint error in rootcoord (#11352) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-11-05 23:06:58 +08:00
Cai Yudong a2ad88237d
Add deltaChannels in rootcoord core (#11097) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 21:04:14 +08:00
Cai Yudong 628a3274bf
Use lazy mode to set dml msgstream as producer (#10993) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-03 20:18:48 +08:00
Xiangyu Wang 54be3c15bf
Improve error message in rootcoord (#11071) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-02 16:18:36 +08:00
Xiangyu Wang 260c0597cb
Improve error message in rootcoord (#11070) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-02 16:16:43 +08:00
Xiangyu Wang 394e8ad634
Improve error message in rootcoord (#11072) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-02 16:14:36 +08:00
Cai Yudong 66b9684fe5
Update ListCollectionPhysicalChannels and ListCollectionVirtualChannels (#11007) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 15:50:30 +08:00
Xiangyu Wang 53b6b8d0fb
Improve error message in rootcoord (#10876) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-01 16:40:10 +08:00
Xiangyu Wang 07818ec26a
Improve error message in rootcoord (#10875) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-01 16:38:06 +08:00
Xiangyu Wang 1835a7cb0c
Improve error message in rootcoord (#10877) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-01 16:35:57 +08:00
Xiaofan 2df2d488e1
Fix Unit test fatal fail (#10933) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-30 10:24:38 +08:00
Xiaofan 93f205b49e
Rename param names (#10853) 
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-28 23:16:40 +08:00
Xiangyu Wang a7d55229f0
Improve error message in rootcoord (#10836) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-28 20:03:29 +08:00
Xiangyu Wang 77b94b3bcf
Improve log message in rootcoord (#10838) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-10-28 19:59:27 +08:00
Xiaofan 76ef1c9657
Fix Root Start hang (#10765) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-27 22:00:27 +08:00
Xiaofan 6fddcb3925
Fix Session checker for proxy (#10737) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-27 21:58:33 +08:00
XuanYang-cn bb7e3d3e70
Fix ParseHybridTs return type to int64 (#10583) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-10-27 16:30:28 +08:00
congqixia 555912f40e
Fix create meta table fails for compatibility issue (#10703) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-26 23:00:27 +08:00
groot 6db06ecf81
[skip ci] Fix typo (#10411) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-10-22 14:10:06 +08:00
congqixia ed2b8d67c0
Reduce info saved in SnapshotMeta (#10288) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-21 14:04:36 +08:00
Cai Yudong 8c67627150
[skip ci] Update comments (#10283) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 16:48:35 +08:00
Cai Yudong 0941c297e7
[skip ci] Fix typo (#10282) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 16:46:42 +08:00
Cai Yudong 0cd562d58b
[skip ci] Fix typo (#10281) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 16:44:49 +08:00
dragondriver 0e58b3f70a
[skip ci] Fix golint warning of meta_table (#9993) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-15 20:42:45 +08:00
congqixia ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-14 16:40:35 +08:00
dragondriver 72d3d470ba
Use the server id as identifier in system topology graph (#9825) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-14 11:12:38 +08:00
Cai Yudong c7566345eb
Simplify meta_snapshot interface (#9778) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 15:54:33 +08:00
NotRyan 5d26d88f10
Change English verbage in rood-coord log messages (#9762) 
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
 2021-10-13 10:50:41 +08:00
Cai Yudong 45340835a7
Fix CreateAlias/DropAlias/AlterAlias impl (#9701) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 17:40:34 +08:00
Yusup 49198dbce1
Disable dropping collection via alias (#8850) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-10-08 17:37:53 +08:00
Cai Yudong ed6101198b
[skip ci] Update order of header files (#8964) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-01 11:08:24 +08:00
Xiaofan 2c2b800ff4
Change Log Name with NodeId (#8721) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-10-01 08:52:50 +08:00
zhenshan.cao d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-29 20:26:00 +08:00
Yusup 4b53a7fc05
Fix GetIndexByName (#8780) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-28 21:52:20 +08:00
Xiaofan 1edc00cd82
Add a log ETCD path (#8739) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-28 13:54:03 +08:00
congqixia 88e319acda
Save start position in collection meta (#8682) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-27 18:10:00 +08:00
Xiaofan d38adda8c2
Rename log file based on node id (#8517) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-26 21:18:11 +08:00
groot a20a9c71e2
Reduce go unittest time cost (#8556) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-26 12:56:07 +08:00
Cai Yudong 177a465913
Clean golint warnings for rootcoord (#8383) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 15:10:00 +08:00
Xiaofan f5173b595f
Add a channel prefix for all channels (#8166) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-23 10:53:53 +08:00
Cai Yudong a62bce360b
Replace MarshalTextString with Marshal in rootcoord (#8341) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 10:37:54 +08:00
congqixia 9ebfd43195
Add comment for proxyManager (#8266) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-22 23:55:53 +08:00
congqixia c676979217
Add error detail when ddl fail (#8304) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-22 19:50:15 +08:00
Yusup bdfb78e936
Add aliases to DescribeCollection (#8268) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-22 16:20:48 +08:00
Xiangyu Wang c314b2b4a8
Remove unused label rules (#7929) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-18 18:19:51 +08:00
Yusup ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
godchen b3f965c7d4
Add unrecoverable error for retry. (#7828) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-09-18 10:49:51 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 09:13:50 +08:00
dragondriver c3eb6f9761
Expose created time and updated time to rootcoord metrics (#8174) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-17 21:52:00 +08:00
Xiangyu Wang 1ee17464e8
Fix possible datarace in rootcoord (#8120) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-17 12:37:50 +08:00
congqixia 675b71cc30
Replace metaSnapshot with suffixSnapshot (#7975) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 22:05:49 +08:00
congqixia 55c47ab508
Add suffixSnapshot implementing SnapshotKV (#7948) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-15 15:23:49 +08:00
Cai Yudong ab84f95e66
[skip ci] Update debug log (#7956) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-15 14:39:48 +08:00
congqixia 7d53e44f3b
Depress gosec false positive (#7899) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-09-14 18:37:48 +08:00
zhenshan.cao e5e4b24954
Fix bug: describe collection return wrong shard number (#7841) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-14 11:59:47 +08:00
cai.zhang 8a458b7a38
Add log for building index about num rows (#7811) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-09-14 10:27:06 +08:00
dragondriver 8d239b6473
Add test cases for search task (#7796) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-13 17:12:19 +08:00
groot a953c912b2
Add unittest for timeticksync (#7793) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-13 16:32:44 +08:00
sunby 4c18910acd
Improve log print in rootcoord (#7354) 
issue: #7306
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-13 11:56:42 +08:00
groot c8f860dcfb
Add unittest for proxy_client_manager (#7729) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-10 18:10:00 +08:00
groot 020f109dd8
Add unittest for rootcoord util (#7688) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2021-09-10 16:41:48 +08:00
Cai Yudong 4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-10 13:00:00 +08:00
Cai Yudong d5f7e358aa
Let dml tolerant physical channels generated by old version (#7644) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-09 18:08:02 +08:00
zhenshan.cao 29e5138274
Fix unittest: timeout caused by excessive use of resources (#7653) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-09 17:39:30 +08:00
zhenshan.cao b0524adbd8
Support specified shard number when create collection (#7482) 
Add shards_num to CollectionInfo

Modify dmlChannelNum config

Compatible with old meta

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-08 15:00:00 +08:00
Cai Yudong d15d3fa0ac
Improve rootcoord codecov (#7518) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-07 11:16:37 +08:00
zhenshan.cao 86afde4598
Fix unittest for rootcoord, should filter out timetick msg first (#7490) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-06 11:52:41 +08:00
dragondriver 960741ee16
Support more detailed metrics information (#7472) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 19:35:47 +08:00
dragondriver 1db573731b
Cache the system information metrics (#7436) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-03 17:15:26 +08:00
Xiangyu Wang acf4354b83
Add logs in rootcoord (#7457) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-09-03 14:10:10 +08:00
dragondriver 3721cbfea1
Proxy metrics integrates with other coordinators (#7400) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-01 17:35:00 +08:00
Cai Yudong 3b9609692b
Apply for msgstream from pool when creating collection (#7377) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 18:35:58 +08:00
dragondriver f0dbdd7f13
Expose metrics of root coordinator (#7228) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-08-31 11:45:59 +08:00
Cai Yudong f4b53df727
Revert "Apply for msgstream from pool when creating collection (#7323)" (#7376) 
This reverts commit e6de86a433.
 2021-08-31 11:07:58 +08:00
Cai Yudong e6de86a433
Apply for msgstream from pool when creating collection (#7323) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 09:47:58 +08:00
Xiangyu Wang c62f23e201
[skip ci]Remove neza2017 from reviewers (#7324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-27 00:27:36 +08:00
congqixia 4d9f89df09
Add unit test for 7150 fix (#7276) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-25 14:41:52 +08:00
congqixia d83bc7fb54
Fix 0 ts when build index (#7272) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-24 21:15:52 +08:00
Xiaofan 58b2089692
Import Embedded Etcd Kv Part 1(#7112) (#7174) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-08-24 09:45:51 +08:00
Cai Yudong 8405d90f5e
proxy add illegal check for search result (#7227) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-23 17:03:51 +08:00
congqixia ec9ccd8bd1
Fix DropCollection not processed by datanode (#7151) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-19 15:06:12 +08:00
Cai Yudong 305fa9c17e
Fix timestamp go back issue for timeticksync (#7123) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-18 14:36:10 +08:00
Cai Yudong 21117241ec
Let system panic if kv operation fail (#7143) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-17 23:06:10 +08:00
yukun 847586eb95
Add rocksmq retention (#6617) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-08-16 18:46:10 +08:00
XuanYang-cn 6c5be83ea1
Refactor NewEtcdKV API (#7075) 
This PR mainly did the following 3 things:

- Refactor NewEtcdKV API
- Add unittests for `kv/etcd/`, raise the coverage
up to 94%
- Correct some APIs from version to revision

The old NewEtcdKV() API took `clientv3.Client` as
one of the input, making everyone who using this API
had to create a new `clientv3.Client`. So there're a lot
of repeated codes everywhere.

Meanwhile, someplace didn't even check whether the
`clientv3.New()` returned error or not, and the old API
also didn't check whether the clientv3.Client was Nil.
This caused issue#6955.

Ectd's version and revision have nothing alike, they
represent different concepts, but our APIs kind of
mixed them all up. So I correct those APIs' names.

Resolves: #6955

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-13 11:04:09 +08:00
Xiangyu Wang 5e78fd6a97
[skip ci]Update approvers (#7063) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-08-12 19:36:09 +08:00
xige-16 09199170a4
sync call querycoord releaseXXXX (#6978) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-03 21:47:24 +08:00
XuanYang-cn 47df4a2e57
Fix DataNode BackGroudGC problem (#6551) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-08-03 09:59:24 +08:00
neza2017 5adb69161f
Set CollectionInfo.CreateTime to the timestamp when save the metadata into etcd, (#6763) 
not the timestamp when RootCoord receive the CreateCollection Request

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-23 14:36:12 +08:00
dragondriver 67c1fdd2c0
Show/Describe collections/partitions with created timestamp (#6700) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-21 18:00:14 +08:00
Cai Yudong cbb4052fdb
Support search and query output fields using wildcard (#6671) 
* update wildcard polocy for search and query

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* mark xfail cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* mark xfail cases

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* optimize debug log

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-21 14:52:12 +08:00
neza2017 fac350cc58
fix tso (#6500) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-14 17:11:54 +08:00
neza2017 b66157358c
add more log for create collection (#6478) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-13 22:19:55 +08:00
neza2017 d4239f0cd8
masterservice -> rootcoord (#6447) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-13 09:37:40 +08:00
neza2017 8b89744c6b
search with exp (#6409) 
* process float vector and binary vector field
on the search result

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add more debug info on etcd

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add debug info when grpc failed

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-10 10:21:52 +08:00
Cai Yudong 21a9bcd844
Create default partition when receive CreateCollectionMsg (#6305) 
* create default partition when create collection

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* adjust sleep time for unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-06 09:16:03 +08:00
neza2017 ca4a562a72
simplify AddIndex, remove collID,PartID from parameters (#6291) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-05 10:08:02 +08:00
Cai Yudong bc8392eb1e
Add collectionID and partitionID into SegmentIndexInfo (#6289) 
* add collectionID and partitionID into SegmentIndexInfo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add partID2SegID into meta table

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DropIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-03 20:00:40 +08:00
neza2017 f8fa025dcc
start background go routine to check if all the segments have indexed (#6290) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 17:54:25 +08:00
neza2017 111a24a49f
remove msgstream of segment info (#6280) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 14:36:18 +08:00
sunby 07b0989628
Add GetFlushedSegments in data coordinator (#6253) 
Send segment flush message by grpc and add a new interface
`GetFlushedSegments`

Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-07-02 11:16:20 +08:00
neza2017 6019c193fc
add grpc interface to process NewSegment And FlushSegmentCompleted (#6247) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-01 14:58:17 +08:00
godchen 49a0528d53
Fix trace (#6218) 
* Fix trace

Signed-off-by: godchen <qingxiang.chen@zilliz.com>

* fix go fmt

Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-30 16:18:13 +08:00
neza2017 95ad498822
check proxy if exist before connect to it (#6165) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-28 15:08:12 +08:00
Cai Yudong a9a806ace0
optimize WatchProxy (#6153) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-28 11:04:14 +08:00
neza2017 b22ab71222
fix rmq (#6147) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 22:26:20 +08:00
neza2017 6d7edc6015
fix typo (#6142) 
* fix typo

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* add log

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 18:04:12 +08:00
zhenshan.cao 42be531f9c
Add InsertCnt (#6131) 
* Add InsertCnt

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

* Enhance log

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-06-26 14:02:12 +08:00
neza2017 a1d0e5c980
remove task scheduler (#6123) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 09:22:11 +08:00
yukun 39614aa8eb
Add rocksmq_path in config and paramtable (#6099) 
* Add rocksmq_path in config and paramtable

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add rocksdbPath in NewRmsFactory

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change rdb default path to /vat/lib/milvus/rdb_data

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2021-06-25 19:44:11 +08:00
congqixia 384f440dbf
Fix panic when BuildIndex 0 while err = nil (#6125) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-06-25 17:58:09 +08:00
neza2017 da12e55c6c
rootcoord connect to other components in go routines (#6117) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-25 16:48:10 +08:00
Cai Yudong 64d1fa2de2
Banner use UTC time (#6102) 
* banner use UTC time

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-25 10:24:11 +08:00
Cai Yudong f633d48ccc
fix rootcoord unittest (#6090) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-24 19:44:08 +08:00
Cai Yudong a09a3a1905
rename service to coord (#6020) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 16:14:08 +08:00
neza2017 9ebca59099
fix time tick (#6017) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-23 15:28:09 +08:00
Cai Yudong ba5aacd3f2
Remove GetChanNameByVirtualChan (#5999) 
* remove redundant ctx

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* remove GetChanNameByVirtualChan

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 11:18:05 +08:00
godchen 99be4c09a5
change retry (#5996) 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-06-23 09:24:10 +08:00
Cai Yudong 7dbf33b788
Update component names in config files (#5989) 
* rename master/indexService in .yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxyNode to proxy in config files

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move master.yaml to root_coord.yaml, move proxy_node.yaml to proxy.yaml

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proto/query_service.proto to proto/query_coord.proto

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move proxy_node_manager.go to proxy_manager.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add query_coord.pb.go

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 19:08:03 +08:00
xige-16 2af1c27811
Rename queryservice to querycoordinator (#5931) 
* Rename queryservice to querycoordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix param table

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix unittest

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* service to coordinator

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* code format

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* set querycoord in ci

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-06-22 16:44:09 +08:00
Cai Yudong d5f4ee6f44
Rename proto master/index_service/proxy_service (#5973) 
* rename proto proxy_service to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto index_service to index_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proto master to root_coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 16:14:09 +08:00
neza2017 80bb418136
Release partition (#5971) 
* add debug info

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>

* notify query coord to release partitions after drop partition

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-22 16:08:08 +08:00
Cai Yudong 2926a78968
Rename proxynode to proxy (#5961) 
* rename package name from proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/proxynode to distributed/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/proxynode to internal/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 14:40:07 +08:00
sunby 7f2d7c1da3
Rename dataservice to datacoordinator (#5912) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 18:22:13 +08:00
Cai Yudong 92e429d812
Rename IndexService to IndexCoord (#5932) 
* rename package indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix queryservice static-check

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/indexservice to distributed/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/indexservice to internal/indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename indexservice to indexcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename MasterComponent to RootCoordComponent

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for queryservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for dataservice

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for datanode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for proxynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord for querynode

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename master to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename IndexService to IndexCoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix rebase issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-21 17:28:03 +08:00
sunby da1f9f9241
Rename dataservice to datacoordinator (#5904) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-06-21 11:40:15 +08:00
dragondriver 82053fbbf7
Fix timesync bug of dealing with default timestmap (#5895) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-06-19 17:40:04 +08:00
neza2017 143b54143c
get pchannel name from vchannel name (#5892) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-19 14:18:08 +08:00
XuanYang-cn ab7f642740
Add alias in paramtable (#5878) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-06-19 12:38:06 +08:00
neza2017 26b8d5966f
add debug info (#5887) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-19 11:34:08 +08:00
Cai Yudong 5a1f7e4feb
rename masterservice to rootcoord (#5875) 
* rename masterservice to rootcoord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename service to coord

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename package

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename masterservice to rootcoord under distributed

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update scripts

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* enable more unittests

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-18 21:30:08 +08:00