Commit Graph

544 Commits (6ff4ffa6c204e7ca8666d949ad09ef1c2cec6dc1)

Author SHA1 Message Date
bigsheeper 3a5aaeb7ad
Fix read queue metrics and memory protection (#19787)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-14 18:05:24 +08:00
xige-16 a1db9038fb
Move disk index params to config file (#19714)
Signed-off-by: xige-16 <xi.ge@zilliz.com>

Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-10-14 17:51:24 +08:00
Jiquan Long cb51d410a2
Limit max shard num to 64 (#19776)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-10-14 14:51:23 +08:00
bigsheeper efdce464f5
Fix ttProtection.enabled and memProtection (#19756)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-13 16:15:25 +08:00
bigsheeper f1e330a997
Add read result rate protection (#19728)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-13 14:57:24 +08:00
Jiquan Long a8a074162f
Add meta migration tool (#19709)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-10-12 11:37:23 +08:00
bigsheeper e6c76aba0e
Force deny writing if disk quota exceeded (#19680)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-10-12 10:03:22 +08:00
jaime 10c03de628
Refine method name from BroadCastXx to BroadcastXx (#19700)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-11 21:07:23 +08:00
jaime 31db01b6ae
Support TTL for collection level (#19383)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-10-10 20:31:22 +08:00
wayblink 85e04d845c
Move GetComponentStates to milvus.proto, make it an external interface (#19594)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-10-10 15:55:22 +08:00
congqixia d64f318a80
Add collection schema in watch channel info (#19663)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-10-10 01:37:21 +08:00
Jiquan Long bdd6171231
Make creating collection/partition follow tt mechanism (#19628)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-10-09 12:32:57 +08:00
Xiaofan 6826964e60
Rename some interface and files in id allocator (#19605)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-09 10:06:58 +08:00
zhenshan.cao 0ac4bc32a5
Add logic of autoindex (#19570)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-10-08 15:38:58 +08:00
Ten Thousand Leaves ccecd6a76a
Fix malformed error log (#19589)
issue: #19553

/kind bug

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-30 17:22:54 +08:00
Ten Thousand Leaves d827391af1
Fix on busy node list not updated when services restart (#19561)
issue: #19544

/kind bug

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-30 16:54:55 +08:00
wayblink 54e2c079c4
MEP-30:Support basic coordinators active-standby mechanism #16901 (#19166)
Signed-off-by: wayblink <anyang.wang@zilliz.com>

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-09-29 18:35:02 +08:00
Jiquan Long 1817627316
Fix create collection failed to assign channels (#19551)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-29 15:54:54 +08:00
Jiquan Long 5550f883de
Fix get collection by id (#19507)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-28 19:26:54 +08:00
Jiquan Long 73463d030d
Fix dml stream leakage in Proxy (#19450)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-27 19:18:54 +08:00
Ten Thousand Leaves 67b95597ed
Deprecated old RootCoord methods in Bulk Load (#19449)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-27 10:44:53 +08:00
Ten Thousand Leaves b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-09-26 18:06:54 +08:00
bigsheeper 804c18df68
Update quota params (#19351)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-09-26 16:48:53 +08:00
Jiquan Long 4e521438c3
Optimize read ddl (#19352)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-24 12:42:51 +08:00
Jiquan Long 22477d4601
UnWatch channels if failed to create collection (#19390)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-23 16:56:50 +08:00
cai.zhang 17f5e3c7fe
Drop segment indexes when drop partition (#19022)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-23 09:36:51 +08:00
Jiquan Long cfd01a188c
Fix drop collection failed due to etcd txn limit. (#19362)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-22 17:36:52 +08:00
Jiquan Long 42d371fd41
Make ddl follow tt mechanism (#19279)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-09-21 15:46:51 +08:00
SimFG d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
bigsheeper 5cdd6ca251
Add quotaCenter, rateLimiter and rateCollector (#18636)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-09-16 09:56:47 +08:00
Jiquan Long a5e2d6b6fb
Refactor RootCoord (#18930)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>
2022-09-05 13:29:11 +08:00
SimFG 9cd19f5396
Return nil error when handling grpc request (#18955)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-02 21:12:59 +08:00
SimFG 69c0b2fb49
Improve the storage method of the grant info in the metastore (#18817)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-26 19:22:56 +08:00
cai.zhang c924f73105
Refactor for IndexCoord to support cloud (#18643)
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-25 15:48:54 +08:00
codeman 90de312d4b
Separate create & update user in mysql (#18785) (#18786)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-08-24 14:32:56 +08:00
SimFG 226bcc16eb
Support concurrent situations for the metastore (#18792)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-24 10:02:52 +08:00
Zach 0c9a10e8f8
1. refine logging interfaces (#18692)
2. adjust logs for query/search requests

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>

Signed-off-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-23 10:44:52 +08:00
SimFG ce434b496e
Implement the mysql metastore of the rbac (#18704)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-23 10:26:53 +08:00
Jiquan Long 641afae22f
Watch channels with start positions (#18744)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-08-22 14:42:52 +08:00
codeman 70254c3ec5
Unified catalog interface for segment (#18289) (#18290)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-08-20 10:24:51 +08:00
congqixia b62cb82ebe
Simplify Dml-DeltaChannel mapping logic (#18702)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-18 14:24:50 +08:00
SimFG 447ce8ee48
Handle some apis about the default role (#18647)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-15 16:40:48 +08:00
aoiasd 8a70f2badb
Add ShowConfigurations for all remaining session (#18594)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2022-08-12 13:20:39 +08:00
codeman 6c3dbf0a07
Support meta storing on database (#17236) (#18541)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-08-11 12:12:38 +08:00
SimFG 1366f130a2
Add a specific `KeyNotExistError` err for the metastore `load` interface (#18582)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-10 17:20:41 +08:00
Jiquan Long e7b3bacbec
Refine catalog of partition & alias. (#18546)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-08-10 10:22:38 +08:00
SimFG c267ad612d
Support Role-Based Access Control II (#18528)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-05 16:28:35 +08:00
SimFG ff0200210a
Support Role-Based Access Control (#18425)
Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-08-04 11:04:34 +08:00
congqixia 318cdbebe9
Add heap for dmlChannels to get next channel (#18451)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-08-01 16:36:33 +08:00
wayblink c198e6c2d9
Add some debug log to explore ocassionally channel name mismatch issue in create collection (#18414)
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2022-07-27 13:06:30 +08:00
jaime 9672eae62c
Unify metastore catalog interface (#17772)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-07-22 10:20:29 +08:00
congqixia f37e07b0f8
Use Get method of request in GetMetrics to avoid panicking (#18356)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-07-21 20:52:27 +08:00
codeman 5fda8261d0
Fix: Unable to list newly created credential users (#18117) (#18153)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-07-07 21:16:22 +08:00
cai.zhang 01fc411566
Handle etcd compacted error (#17886)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-30 18:54:19 +08:00
zhenshan.cao 0baeb609dc
Fix bugs in monitoring metrics (#17894)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-06-30 17:26:19 +08:00
yah01 ef6859a4d6
Refactor handoff handler (#17806)
Signed-off-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-29 23:26:19 +08:00
codeman 95a3830dc6
fix password comparison too slow (#17874) (#17897)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-06-29 20:02:18 +08:00
xing.zhao 3904a78211
Remove genReqID function in import manager bacause the request ID is useless (#17853)
Signed-off-by: xingzhao <xing.zhao@zilliz.com>

Co-authored-by: xingzhao <xing.zhao@zilliz.com>
2022-06-28 18:20:18 +08:00
cai.zhang b883d1f5dd
Make sure indexes are successfully dropped when DropCollection (#17780)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-28 11:24:21 +08:00
cai.zhang 4efdd0929c
Get index status based on segment generation time (#17659)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-21 18:44:12 +08:00
cai.zhang 3610cc77bf
Fix bug for align segments (#17652)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-20 20:16:12 +08:00
cai.zhang f123d657ed
Fix bug for dropping index (#17635)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-20 15:22:13 +08:00
Xiaofan 144f7a2d80
Refine meta, remove redundant proxy data (#17631)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-18 12:50:11 +08:00
Letian Jiang b15c24a554
Acquire reference lock of compacted from segments during index building (#17619)
- Accquire reference lock during index building
- Keep dropped segment record

Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-06-18 01:24:11 +08:00
groot 7c69f4b338
Fix bulkload failed bug caused by dropping collection (#17624)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-06-17 21:14:11 +08:00
cai.zhang 141a3bbe00
Mark deleted before drop index (#17490)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-17 18:08:12 +08:00
Jiquan Long 0e29c37499
Forbid system fields in user schema (#17613)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-17 14:10:11 +08:00
cai.zhang 53a49a9255
GetIndexState only get the state generated call CreateIndex (#17549)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-16 20:12:11 +08:00
Jiquan Long 8e2797fe30
Print error when failed to broadcast message (#17595)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-16 18:32:10 +08:00
groot b5e62023ea
Return error when bulkload pending list hit limit (#17570)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-06-16 13:02:10 +08:00
cai.zhang ea5041aec2
Acquiring the segment reference lock on task level (#17544)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-15 21:38:10 +08:00
xing.zhao 76523b313b
Fix bug #17403 by double check collmeta prefix and alias prefix (#17548)
Signed-off-by: xingzhao <xing.zhao@zilliz.com>

Co-authored-by: xingzhao <xing.zhao@zilliz.com>
2022-06-15 19:14:10 +08:00
Ten Thousand Leaves 65ab847815
Add segment reference lock for bulk load (#17457)
So we can support DataQueryable and DataIndexed states

issue: #16607
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-06-15 12:20:10 +08:00
groot ab9b186f15
Change bulkload bufsize for row-based parser (#17473)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-06-14 16:18:09 +08:00
jaime b64a467311
Revert "Use unified catalog interface to reconstruct metastore (#17042)" (#17480)
This reverts commit 218326bafe.

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-10 13:10:08 +08:00
Xiaofan 05a918e0ab
Refine logs (#17438)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-09 21:04:07 +08:00
jaime 218326bafe
Use unified catalog interface to reconstruct metastore (#17042)
Co-authored-by: kejiang ke.jiang@zilliz.com
Co-authored-by: yun.zhang yun.zhang@zilliz.com

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-06-07 12:00:07 +08:00
Xiaofan af994b5e1c
Fix etcd watch error (#17364)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-06 16:26:06 +08:00
cai.zhang bcf3b7426a
Add distributed lock for segment refgerence (#16782)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-31 16:36:03 +08:00
groot affcc2acad
Fix bulkload entity number bug (#17278)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-05-31 15:40:04 +08:00
bigsheeper 9eeec4a2d5
Add collection load cache and InvalidateCollMetaCache by collID (#16882)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-19 10:13:56 +08:00
cai.zhang d6bb86dd46
Return buildID when creating index if the index alreay exists (#17045)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-17 15:21:57 +08:00
Ten Thousand Leaves 63385b7c12
Make data queryable and data indexed states as independent flags (#16837)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-12 19:23:53 +08:00
Jiquan Long be688d894a
Forbid multiple indexes on same field (#16875)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-05-10 21:07:53 +08:00
Ten Thousand Leaves 5afdf3d49f
Move locks back to meta table methods (#16848)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-09 20:47:52 +08:00
xige-16 8fcf349609
Fix create index failed after drop index (#16836)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-09 11:35:53 +08:00
Ten Thousand Leaves 6b2d3c3ec1
Make each dataNode only accept one bulk load task simultaneously (#16820)
issue: #16674

/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-07 14:05:52 +08:00
Ten Thousand Leaves 31ddff2056
Some minor fixes and improvements (#16814)
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-06 21:35:51 +08:00
xige-16 7cc995d085
Prohibit creating diff indexes with same index_name on a collection (#16774)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-05 21:33:51 +08:00
Ten Thousand Leaves 1acd256481
Add DataQueryable and DataIndexed states for bulk load tasks (#16725)
issue: #16607

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-05-05 21:17:50 +08:00
cai.zhang 2be46a01c0
Reduce the number of retries and add error log (#16754)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-05-05 09:31:51 +08:00
jaime c25b337c36
Remove AddTenant from meta table (#16717)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-05-05 09:23:51 +08:00
xige-16 515d0369de
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
groot 21b5973253
Refine list import task api (#16690)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-28 17:21:47 +08:00
zhenshan.cao 0a953948af
Simplify monitoring metrics (#16687)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-27 23:03:47 +08:00
Xiaofan b657b10eb5
Remove useless log (#16624)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-27 10:01:47 +08:00
zhenshan.cao a3f7bb5f2d
Remove the collectionID label from metrics (#16571)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-26 17:29:45 +08:00
groot bc5e9ec929
Add list import tasks api (#16605)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-25 17:37:46 +08:00
Ten Thousand Leaves e66ac6a77c
Resolve an issue with bulk load where segments in flow graph replica are not updated (#16609)
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-25 11:07:47 +08:00
Ten Thousand Leaves 242f08fb67
Refine import task related logic (#16601)
issue: #16600

/kind bug

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-24 11:29:45 +08:00
groot a6a3b69d91
Report bulk load state (#16555)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-04-21 21:37:42 +08:00
codeman 91e84ffedf
fix: not create user root if exists, optimize log & imports (#16554)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-04-21 19:57:42 +08:00
Ten Thousand Leaves 289e468a7a
Make bulk load fully work (#16512)
issue: #15604

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-20 14:03:40 +08:00
codeman 3a1b2cedd2
create default root user for authentication (#16545) (#16549)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-04-20 13:03:40 +08:00
codeman f5e1ded854
fix #16504 (#16523)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-04-19 16:35:39 +08:00
Xiaofan fce8f6cfab
Remove Timetick channel (#16449)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-17 23:47:36 +08:00
jaime ed3c29eae7
Support Kafka (#16149)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-04-12 19:47:33 +08:00
Ten Thousand Leaves 442c73a544
Support passing channel names to DataNode (#16424)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-12 13:25:34 +08:00
codeman 4e12271d79
Support login with username and password (#15656) (#16341)
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
2022-04-11 19:49:34 +08:00
godchen bb7a0766fe
Add dependency factory (#16204)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2022-04-07 22:05:32 +08:00
Ten Thousand Leaves 1e6f6bd072
Implement set segment state call from RootCoord to DataCoord. (#16374)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-06 15:33:32 +08:00
Ten Thousand Leaves 2bd0a9526a
Implement task expiring logic and make all deadlines configurable. (#16355)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-03 11:37:29 +08:00
Xiaofan 7f7379d55f
Fix DML channel AsProducer after Close (#16352)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-04-02 13:09:29 +08:00
Ten Thousand Leaves 45be3deb3f
Implement RC, DC, DN calling path for import. (#16321)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-04-01 11:33:28 +08:00
Ten Thousand Leaves 0d54697d42
Implement ReportImport related logic. (#16312)
/kind feature

issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-31 13:51:28 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-30 21:11:28 +08:00
Ten Thousand Leaves 40c703dacd
Support check index state in root coord, for bulk load feature. (#16198)
issue: #15604

/kind feature

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-28 16:41:28 +08:00
Ten Thousand Leaves a23ca745bb
Add Etcd support for Import Tasks. (#16164)
issue: #15604
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-25 11:03:25 +08:00
xiyichan ca129d4308
Support configurable msgstream (#16131)
Signed-off-by: xiyichan <2863768433@qq.com>
2022-03-24 10:15:25 +08:00
groot 1c4b949a1d
modify import rpc interface (#16129)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-22 15:11:24 +08:00
groot 2078b24dca
Prepare for import (#16083)
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-21 15:47:23 +08:00
Jiquan Long f8d9bc919d
Unify interface of vector index & scalar index. (#15959)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
Ji Bin 3cd28420f1
Support compile under windows (#15786)
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
zhenshan.cao f3eeecf146
Reduce the number of metrics (#16030)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-03-15 21:51:21 +08:00
Xiaofan c51c8c0a74
Fix get flused segment errror handling (#15155)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-03-15 18:51:21 +08:00
jaime 97b1ed7bca
Remove reader API from Mqstream and replace it with consumer API (#15971)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-15 14:45:22 +08:00
jaime 29975a7a26
Remove Consume() API from mqstream interface (#15886)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-11 20:09:59 +08:00
groot 89356ebcb9
Modify import rpc interfaces (#16006)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
Cai Yudong 3e862ecdfb
Merge msgChannelConfig and knowhereConfig into commonConfig (#15843)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-04 11:17:56 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
cai.zhang 9f4c59e621
Add prometheus metrics for RootCoord (#15684)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-02 21:11:57 +08:00
guoxiangzhou f43d96b58d
[skip e2e] Modify code comments according to the naming conventions (#15173)
Signed-off-by: guoxiangzhou <xiangzhou.guo@zilliz.com>
2022-02-09 10:19:56 +08:00
Cai Yudong 1f337891e1
Rename base_param to service_param, rename global_param to component_param (#15463)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-08 20:57:47 +08:00
Cai Yudong f1ea9613ae
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-07 10:09:45 +08:00
Cai Yudong 4bccc85534
Use MsgChannelConfig in GlobalParams for all components (#15163)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-02 00:35:43 +08:00
XuanYang-cn eef295465a
Fix timetick inconsistency in drop collection (#15408)
When rootcoord drops a collection, it'll produce a `drop-collection DDL` msg
and one last timetick into DML channels of this collection.
So that when DataNode receives this msg, DN can release the resources for the specific collection.

Before this PR, RootCoord produced these two msgs with an older timestamp, generated
before many time-consuming RPCs.

Once these RPCs spend more time than timetick producing interval, the timetick of these 2 msgs are
older to the channel current timestamp, causing in-consistency in time, thus
making msgstream fail to consume the last `drop-collection DDL` msg.

This PR generates a new timestamp for `drop-collection DDL` msg and timetick msg after those time-consuming
RPCs

Fixes: #15406

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2022-01-28 20:49:41 +08:00
Filipe Caixeta dee1961b4d
Make SearchResults and QueryResults return collectionID (#15377)
* Make SearchResults and QueryResults return collectionID

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* add return collection name from QueryRequest and SearchRequest

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>

* remove comment

Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
2022-01-27 22:55:41 +08:00
Xiaofan 885ecaf222
Refine time sync logic log (#15251)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-27 11:25:41 +08:00
xige-16 3a024307f4
Release collection first when drop collection (#15370)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-24 21:51:22 +08:00
Cai Yudong 356efee492
Rename timetickSync APIs and variables for better readability (#15264)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-18 14:47:36 +08:00
cai.zhang f564ea7fc7
RootCoord set healthy state after registered service (#15261)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-01-18 12:09:37 +08:00
Cai Yudong 1b1d4e502b
Remove session from timetickSync (#15255)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-18 00:07:37 +08:00
Xiaofan f36e02dfbb
Add more log when tt failed (#15227)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-15 18:53:34 +08:00
Xiaofan f617c8887b
Time Tick Failed need log (#15225)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
Cai Yudong 6323907566
Use CommonConfig in GlobalParams for all components (#15106)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 19:03:35 +08:00
Cai Yudong 7efb02a4c5
Use PulsarConfig in GlobalParams for all components (#15046)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-09 23:45:33 +08:00
Cai Yudong f8f61fb116
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-07 16:15:26 +08:00
shaoyue 18d36d78d2
[skip e2e] Add comment for rootCood.Core (#14665)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-12-31 14:23:55 +08:00
cai.zhang e7e40c2328
RootCoord should get all binlog paths for vector field (#14621)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-30 19:39:21 +08:00
Jiquan Long d5e6adf381
Add log for timetickSync (#14517)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-30 10:32:03 +08:00
Xiaofan 69087ff8dd
Support embedded etcd (#14333)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 14:35:21 +08:00
Xiaofan 1408926cd9
Remove logs without enough info (#14440)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
edward.zeng 2faf35707e
[skip e2e] Refine rootcoord comment (#14447)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-28 19:47:21 +08:00
cxytz01 8b7af673a8
[skip e2e] Grammar correction (#14417)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:24:17 +08:00
cxytz01 7ff9ed33ad
[skip e2e] Grammar correction (#14416)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:21:18 +08:00
cxytz01 0759538855
[skip e2e] Grammar correction (#14415)
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-28 19:18:20 +08:00
Cai Yudong 30382d8bf9
Let rootcoord share proxy.TimeTickInterval (#14326)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 21:38:45 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
edward.zeng f2d25ce338
[skip e2e] Refine rootcoord comment (#14045)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-23 14:34:13 +08:00
jaime 9e9475b4fe
[skip e2e] Fix grammar mistake in meta_table (#14017)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-22 21:31:15 +08:00
Jiquan Long 8a63dba149
Add consistency level field in collection meta (#13766)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-12-21 19:49:02 +08:00
XuanYang-cn 3c2605f174
[skip e2e]Update license for rc util (#13889)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 19:19:21 +08:00
XuanYang-cn 83df76d7af
[skip e2e]Update license for rc timetick (#13888)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-21 18:50:59 +08:00
XuanYang-cn 9fa2d757a2
[skip e2e]Update license for rc timestamp (#13748)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 19:01:12 +08:00
XuanYang-cn 907f554a0b
[skip e2e]Update license for rc suffix (#13747)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 18:49:06 +08:00
XuanYang-cn 33f326d576
[skip e2e]Update license for rc root_coord (#13746)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-20 17:45:37 +08:00
XuanYang-cn 8f8021eeb8
[skip e2e]Update license for rc proxyclient manager (#13572)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:23:29 +08:00
XuanYang-cn 67d99490ed
[skip e2e]Update license for rc paramtable (#13571)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:21:31 +08:00
XuanYang-cn fc67e4bc93
[skip e2e]Update license for rc proxymanager (#13570)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-17 14:19:36 +08:00
Cai Yudong dea0e0277c
[skip e2e] Update root_coord imports (#13593)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 14:13:16 +08:00
Cai Yudong 807aab3dd8
[skip e2e] Update metrics_info imports (#13591)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-17 14:11:26 +08:00
XuanYang-cn 12173f94f0
[skip ci]Update license for rc meta table (#13498)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:07:10 +08:00
XuanYang-cn c544bb21ac
[skip ci]Update license for rc dml channels (#13497)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:03:23 +08:00
XuanYang-cn 12766540bd
[skip ci]Update license for rc meta snapshot (#13496)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-16 10:01:35 +08:00
xige-16 42ac5f76ed
Add constraints to the combination of load and release (#13110)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-15 22:11:09 +08:00
jaime 769b05682a
[skip ci] Fix grammar mistake in suffix_snapshot (#13420)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-12-15 12:07:44 +08:00
cai.zhang 9f23fc7f2a
Register the service when the component state is healthy (#13248)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-15 11:47:10 +08:00
Cai Yudong 829077ad0c
Optimize reSentDdMsg logic (#13378)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-15 08:59:08 +08:00
Cai Yudong 30e18cb5a7
Optimize rootcoord reSendDdMsg (#13363)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-14 19:15:06 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-12-14 15:31:07 +08:00
Cai Yudong 2b59e15ef4
Use typeutil.RootCoordRole instead of Params.RoleName in rootcoord (#13215)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-13 09:59:27 +08:00
JackLCL 2905182282
[skip ci]Fix error log output format in task.go (#13131)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:19:10 +08:00
JackLCL 3ddcec79b4
[skip ci]Fix error log output format in root_coord_test.go (#13130)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-10 10:17:30 +08:00
cai.zhang 342200ce13
Estimate the memory size of the index before building the index (#12973)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 14:19:40 +08:00
XuanYang-cn a9a332dbcf
Fix empty segment compact and load (#12710)
1. Fix compaction save empty segment bug
2. Fix load empty segment bug
3. Add UT for dmlchannels to 100%

Resolves: #12450

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-09 11:03:08 +08:00
congqixia c289a19fb8
Remove log string concat in root_coord.go (#12932)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-08 14:23:05 +08:00
congqixia e4de86ba42
Update rootcoord state to unhealthy before stopping (#12845)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-07 18:39:03 +08:00
Bingyi Sun 92eff1565c
Fix unlocked mutex in rootcoord (#12772)
issue: #12297
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-12-06 17:25:35 +08:00
Cai Yudong 1a806a174a
Support load collection with multiple vector column (#12630)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-03 11:29:33 +08:00
congqixia 9af7e179f2
Fix zero length slice declaration in timeticksync.go (#12372)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-29 20:21:41 +08:00
Bingyi Sun a05a74fca2
Improve proxy manager in rootcoord (#12303)
issue: #11275
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-29 17:33:41 +08:00
Cai Yudong cbbeb2a383
Add debug log when proxy idle for a long time (#12319)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-27 13:57:16 +08:00
Cai Yudong 6188ac280b
Fix drop alias error (#12281)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 18:03:17 +08:00
Cai Yudong 858e95f377
Move dmlChannel and deltaChannel into timeticksync (#12254)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-25 10:07:15 +08:00
dragondriver 6c4c0ef6b5
Add more deploy metrics (#12248)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-24 15:43:15 +08:00
Cai Yudong 1f27eb604e
Remove all index when drop collection (#12227)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-23 23:01:15 +08:00
congqixia 4121e31df1
Send SIGINT to runner goroutine after etcd disconnects (#12163)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-22 16:23:17 +08:00
Cai Yudong 99b3c56b3e
Update rootcoord debug log (#12160)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-22 16:01:14 +08:00
Cai Yudong d4c297b1a8
Enhance dml channel operations (#12143)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-21 21:33:13 +08:00
dragondriver ee0f753f7a
Fix datarace between GetComponentStates and Register (#11935)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-19 13:57:12 +08:00
Cai Yudong 074687e32e
Unify rootcoord debug log (#12080)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-19 12:11:12 +08:00
congqixia 27715c15f4
Fix 0 len slice declaration for dml_channels.go (#12094)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-18 22:33:26 +08:00
congqixia 5edbb82610
Add session revoke (#11908)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
Cai Yudong b0f268e087
Add more debug log for proxy registry in rootcoord (#11899)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 19:21:49 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
Cai Yudong 29e9adc7be
Fix golint warnings for rootcoord (#11872)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:27:11 +08:00
Cai Yudong 173e7b3808
Fix golint warnings for rootcoord/root_coord.go (#11871)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:25:17 +08:00
Cai Yudong 959d8c2ce1
Fix golint warnings for rootcoord/meta_table.go (#11870)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:19:20 +08:00
jaime 3a9d6ee070
[skip ci] Add a log (#11729)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-15 19:26:49 +08:00
Xiaofan 3cd47cd89e
Remove common.yaml and component.yaml (#11662)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-12 18:53:11 +08:00
godchen 5357e301f4
Fix retrieve search error (#11501)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-11 00:54:45 +08:00
Xiaofan 5f08b67156
Move node.yaml to component.yaml (#11363)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-10 14:27:37 +08:00
godchen 639800241d
Make flow graph for delta channel (#11379)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
zhenshan.cao 0699176d24
[skip ci]Fix golint error in rootcoord (#11352)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-11-05 23:06:58 +08:00
Cai Yudong a2ad88237d
Add deltaChannels in rootcoord core (#11097)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 21:04:14 +08:00
Cai Yudong 628a3274bf
Use lazy mode to set dml msgstream as producer (#10993)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-03 20:18:48 +08:00
Xiangyu Wang 54be3c15bf
Improve error message in rootcoord (#11071)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:18:36 +08:00
Xiangyu Wang 260c0597cb
Improve error message in rootcoord (#11070)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:16:43 +08:00
Xiangyu Wang 394e8ad634
Improve error message in rootcoord (#11072)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-02 16:14:36 +08:00
Cai Yudong 66b9684fe5
Update ListCollectionPhysicalChannels and ListCollectionVirtualChannels (#11007)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-02 15:50:30 +08:00
Xiangyu Wang 53b6b8d0fb
Improve error message in rootcoord (#10876)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:40:10 +08:00
Xiangyu Wang 07818ec26a
Improve error message in rootcoord (#10875)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:38:06 +08:00
Xiangyu Wang 1835a7cb0c
Improve error message in rootcoord (#10877)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-01 16:35:57 +08:00
Xiaofan 2df2d488e1
Fix Unit test fatal fail (#10933)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-30 10:24:38 +08:00
Xiaofan 93f205b49e
Rename param names (#10853)
* Rename param names

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

* Rename configs

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-28 23:16:40 +08:00
Xiangyu Wang a7d55229f0
Improve error message in rootcoord (#10836)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-28 20:03:29 +08:00
Xiangyu Wang 77b94b3bcf
Improve log message in rootcoord (#10838)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-10-28 19:59:27 +08:00
Xiaofan 76ef1c9657
Fix Root Start hang (#10765)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 22:00:27 +08:00
Xiaofan 6fddcb3925
Fix Session checker for proxy (#10737)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-27 21:58:33 +08:00
XuanYang-cn bb7e3d3e70
Fix ParseHybridTs return type to int64 (#10583)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-27 16:30:28 +08:00
congqixia 555912f40e
Fix create meta table fails for compatibility issue (#10703)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-26 23:00:27 +08:00
groot 6db06ecf81
[skip ci] Fix typo (#10411)
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2021-10-22 14:10:06 +08:00
congqixia ed2b8d67c0
Reduce info saved in SnapshotMeta (#10288)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-21 14:04:36 +08:00
Cai Yudong 8c67627150
[skip ci] Update comments (#10283)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:48:35 +08:00
Cai Yudong 0941c297e7
[skip ci] Fix typo (#10282)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:46:42 +08:00
Cai Yudong 0cd562d58b
[skip ci] Fix typo (#10281)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-20 16:44:49 +08:00
dragondriver 0e58b3f70a
[skip ci] Fix golint warning of meta_table (#9993)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-15 20:42:45 +08:00
congqixia ec6e8e4127
Hide liveChn into sessionutil and fix liveness init order (#9860)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-10-14 16:40:35 +08:00
dragondriver 72d3d470ba
Use the server id as identifier in system topology graph (#9825)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-10-14 11:12:38 +08:00
Cai Yudong c7566345eb
Simplify meta_snapshot interface (#9778)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-13 15:54:33 +08:00
NotRyan 5d26d88f10
Change English verbage in rood-coord log messages (#9762)
Signed-off-by: NotRyan <ryan.chan@zilliz.com>

Co-authored-by: NotRyan <ryan.chan@zilliz.com>
2021-10-13 10:50:41 +08:00
Cai Yudong 45340835a7
Fix CreateAlias/DropAlias/AlterAlias impl (#9701)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-12 17:40:34 +08:00
Yusup 49198dbce1
Disable dropping collection via alias (#8850)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-10-08 17:37:53 +08:00
Cai Yudong ed6101198b
[skip ci] Update order of header files (#8964)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-10-01 11:08:24 +08:00
Xiaofan 2c2b800ff4
Change Log Name with NodeId (#8721)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-10-01 08:52:50 +08:00
zhenshan.cao d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-09-29 20:26:00 +08:00
Yusup 4b53a7fc05
Fix GetIndexByName (#8780)
Signed-off-by: Yusup <yusup@lsgrep.com>
2021-09-28 21:52:20 +08:00
Xiaofan 1edc00cd82
Add a log ETCD path (#8739)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-28 13:54:03 +08:00
congqixia 88e319acda
Save start position in collection meta (#8682)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-09-27 18:10:00 +08:00
Xiaofan d38adda8c2
Rename log file based on node id (#8517)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-09-26 21:18:11 +08:00