milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
21,884 Commits
174 Branches
147 Tags
627 MiB
Commit Graph

153 Commits (eb046863485fdf3e130fc60484485c901b81276b)

Author SHA1 Message Date
Enwei Jiao 697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-26 11:31:49 +08:00
jaime d7bb908148
Fix rename collection data race (#21827) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-01-24 10:01:46 +08:00
jaime 1dcd9eeb79
Support rename collection (#21693) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-01-19 14:13:43 +08:00
SimFG b307ee8c07
Make the rbac error message clearer (#21645) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-01-12 13:55:42 +08:00
Jiquan Long 9fd9bed2b9
Remove collection meta after GC finished (#21595) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-12 09:55:42 +08:00
Jiquan Long ff2a68e65a
Fix collection not exist when tried to do recovery (#21471) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2023-01-04 16:37:35 +08:00
Enwei Jiao 89b810a4db
Refactor all params into ParamItem (#20987) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-12-07 18:01:19 +08:00
XuanYang-cn 7fbe0c4df2
Remove mockTestKv in metatable test (#20689) 
See also: #19289

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-11-25 11:07:12 +08:00
Jiquan Long 0edb49209d
Fix rootcoord metrics (#20427) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-11-09 17:49:04 +08:00
groot 39a6397043
Fix an error message (#20403) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-11-09 14:49:03 +08:00
SimFG 9c6436d72d
Add time log for methods of starting the node (#20313) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-11-08 20:13:03 +08:00
wgcn bf5fb3cd99
improve show collection (#20124) 
Signed-off-by: wgcn <1026688210@qq.com>
 2022-10-31 13:25:35 +08:00
groot bee66631e3
Refine bulkload (#19671) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-10-27 16:21:34 +08:00
Jiquan Long 14ddfe679f
Fix failed to show partitions (#20007) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-10-24 15:57:29 +08:00
Jiquan Long a1a74e3891
Optimize ddl case when collection not exist (#19950) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-10-21 16:37:29 +08:00
SimFG a55f739608
Separate public proto files (#19782) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-10-16 20:49:27 +08:00
Jiquan Long a8a074162f
Add meta migration tool (#19709) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-10-12 11:37:23 +08:00
jaime 31db01b6ae
Support TTL for collection level (#19383) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-10-10 20:31:22 +08:00
Ten Thousand Leaves ccecd6a76a
Fix malformed error log (#19589) 
issue: #19553

/kind bug

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-09-30 17:22:54 +08:00
Jiquan Long 5550f883de
Fix get collection by id (#19507) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-09-28 19:26:54 +08:00
Jiquan Long 73463d030d
Fix dml stream leakage in Proxy (#19450) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-09-27 19:18:54 +08:00
Ten Thousand Leaves 67b95597ed
Deprecated old RootCoord methods in Bulk Load (#19449) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-09-27 10:44:53 +08:00
Ten Thousand Leaves b30c9d4f60
Support Bulk Load in Milvus 2.2 (#18982) 
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-09-26 18:06:54 +08:00
Jiquan Long 4e521438c3
Optimize read ddl (#19352) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-09-24 12:42:51 +08:00
Jiquan Long cfd01a188c
Fix drop collection failed due to etcd txn limit. (#19362) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-09-22 17:36:52 +08:00
SimFG d7f38a803d
Separate some proto files (#19218) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-16 16:56:49 +08:00
Jiquan Long a5e2d6b6fb
Refactor RootCoord (#18930) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
Co-authored-by: xaxys <tpnnghd@163.com>
 2022-09-05 13:29:11 +08:00
SimFG 69c0b2fb49
Improve the storage method of the grant info in the metastore (#18817) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-08-26 19:22:56 +08:00
cai.zhang c924f73105
Refactor for IndexCoord to support cloud (#18643) 
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
 2022-08-25 15:48:54 +08:00
codeman 90de312d4b
Separate create & update user in mysql (#18785) (#18786) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-08-24 14:32:56 +08:00
SimFG 226bcc16eb
Support concurrent situations for the metastore (#18792) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-08-24 10:02:52 +08:00
SimFG ce434b496e
Implement the mysql metastore of the rbac (#18704) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-08-23 10:26:53 +08:00
codeman 70254c3ec5
Unified catalog interface for segment (#18289) (#18290) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-08-20 10:24:51 +08:00
codeman 6c3dbf0a07
Support meta storing on database (#17236) (#18541) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Signed-off-by: kejiang <ke.jiang@zilliz.com>
Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-08-11 12:12:38 +08:00
Jiquan Long e7b3bacbec
Refine catalog of partition & alias. (#18546) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-08-10 10:22:38 +08:00
SimFG ff0200210a
Support Role-Based Access Control (#18425) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-08-04 11:04:34 +08:00
jaime 9672eae62c
Unify metastore catalog interface (#17772) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-07-22 10:20:29 +08:00
cai.zhang 4efdd0929c
Get index status based on segment generation time (#17659) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-06-21 18:44:12 +08:00
cai.zhang 3610cc77bf
Fix bug for align segments (#17652) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-06-20 20:16:12 +08:00
cai.zhang f123d657ed
Fix bug for dropping index (#17635) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-06-20 15:22:13 +08:00
Xiaofan 144f7a2d80
Refine meta, remove redundant proxy data (#17631) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-06-18 12:50:11 +08:00
cai.zhang 141a3bbe00
Mark deleted before drop index (#17490) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-06-17 18:08:12 +08:00
cai.zhang 53a49a9255
GetIndexState only get the state generated call CreateIndex (#17549) 
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
 2022-06-16 20:12:11 +08:00
xing.zhao 76523b313b
Fix bug #17403 by double check collmeta prefix and alias prefix (#17548) 
Signed-off-by: xingzhao <xing.zhao@zilliz.com>

Co-authored-by: xingzhao <xing.zhao@zilliz.com>
 2022-06-15 19:14:10 +08:00
groot ab9b186f15
Change bulkload bufsize for row-based parser (#17473) 
Signed-off-by: groot <yihua.mo@zilliz.com>
 2022-06-14 16:18:09 +08:00
jaime b64a467311
Revert "Use unified catalog interface to reconstruct metastore (#17042)" (#17480) 
This reverts commit 218326bafe.

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-06-10 13:10:08 +08:00
jaime 218326bafe
Use unified catalog interface to reconstruct metastore (#17042) 
Co-authored-by: kejiang ke.jiang@zilliz.com
Co-authored-by: yun.zhang yun.zhang@zilliz.com

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-06-07 12:00:07 +08:00
Jiquan Long be688d894a
Forbid multiple indexes on same field (#16875) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-05-10 21:07:53 +08:00
Ten Thousand Leaves 5afdf3d49f
Move locks back to meta table methods (#16848) 
/kind improvement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-05-09 20:47:52 +08:00
xige-16 8fcf349609
Fix create index failed after drop index (#16836) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-05-09 11:35:53 +08:00
xige-16 7cc995d085
Prohibit creating diff indexes with same index_name on a collection (#16774) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2022-05-05 21:33:51 +08:00
Ten Thousand Leaves 1acd256481
Add DataQueryable and DataIndexed states for bulk load tasks (#16725) 
issue: #16607

/kind enhancement

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-05-05 21:17:50 +08:00
jaime c25b337c36
Remove AddTenant from meta table (#16717) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-05-05 09:23:51 +08:00
xige-16 515d0369de
Support string type in segcore (#16546) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
 2022-04-29 13:35:49 +08:00
Xiaofan b657b10eb5
Remove useless log (#16624) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-27 10:01:47 +08:00
codeman 91e84ffedf
fix: not create user root if exists, optimize log & imports (#16554) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-21 19:57:42 +08:00
codeman f5e1ded854
fix #16504 (#16523) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-19 16:35:39 +08:00
codeman 4e12271d79
Support login with username and password (#15656) (#16341) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-11 19:49:34 +08:00
Jiquan Long ba37531456
Add support for loading multiple indexes (#16138) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-03-30 21:11:28 +08:00
Cai Yudong 6323907566
Use CommonConfig in GlobalParams for all components (#15106) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-01-10 19:03:35 +08:00
cxytz01 8b7af673a8
[skip e2e] Grammar correction (#14417) 
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
 2021-12-28 19:24:17 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-12-23 18:39:11 +08:00
jaime 9e9475b4fe
[skip e2e] Fix grammar mistake in meta_table (#14017) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-22 21:31:15 +08:00
XuanYang-cn 12173f94f0
[skip ci]Update license for rc meta table (#13498) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-12-16 10:07:10 +08:00
Xiangyu Wang 405b3cd932
Use the same lint rules with golint in revive (#13324) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-12-14 15:31:07 +08:00
Cai Yudong 959d8c2ce1
Fix golint warnings for rootcoord/meta_table.go (#11870) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-16 14:19:20 +08:00
Cai Yudong 66b9684fe5
Update ListCollectionPhysicalChannels and ListCollectionVirtualChannels (#11007) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-11-02 15:50:30 +08:00
Xiangyu Wang 53b6b8d0fb
Improve error message in rootcoord (#10876) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-01 16:40:10 +08:00
Xiangyu Wang 07818ec26a
Improve error message in rootcoord (#10875) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-01 16:38:06 +08:00
Xiangyu Wang 1835a7cb0c
Improve error message in rootcoord (#10877) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-11-01 16:35:57 +08:00
congqixia 555912f40e
Fix create meta table fails for compatibility issue (#10703) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-26 23:00:27 +08:00
congqixia ed2b8d67c0
Reduce info saved in SnapshotMeta (#10288) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-10-21 14:04:36 +08:00
Cai Yudong 0cd562d58b
[skip ci] Fix typo (#10281) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-20 16:44:49 +08:00
dragondriver 0e58b3f70a
[skip ci] Fix golint warning of meta_table (#9993) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-15 20:42:45 +08:00
Cai Yudong c7566345eb
Simplify meta_snapshot interface (#9778) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-13 15:54:33 +08:00
Cai Yudong 45340835a7
Fix CreateAlias/DropAlias/AlterAlias impl (#9701) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-10-12 17:40:34 +08:00
Yusup 49198dbce1
Disable dropping collection via alias (#8850) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-10-08 17:37:53 +08:00
zhenshan.cao d1d5f9e409
Replace proto.MarshalTextString with proto.Marshal (#8542) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-09-29 20:26:00 +08:00
Yusup 4b53a7fc05
Fix GetIndexByName (#8780) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-28 21:52:20 +08:00
Cai Yudong 177a465913
Clean golint warnings for rootcoord (#8383) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 15:10:00 +08:00
Cai Yudong a62bce360b
Replace MarshalTextString with Marshal in rootcoord (#8341) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-23 10:37:54 +08:00
Yusup bdfb78e936
Add aliases to DescribeCollection (#8268) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-22 16:20:48 +08:00
Yusup ccb57ba4b2
add collection alias (#7255) 
Signed-off-by: Yusup <yusup@lsgrep.com>
 2021-09-18 11:13:51 +08:00
Cai Yudong d10c6abc9e
Apply for msgstream from pool when creating collection (#7738) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-18 09:13:50 +08:00
sunby 4c18910acd
Improve log print in rootcoord (#7354) 
issue: #7306
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-09-13 11:56:42 +08:00
Cai Yudong 4e23ed9a18
Revert apply physical channels from pool (d5f7e358 and 3b960969) (#7687) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-09-10 13:00:00 +08:00
Cai Yudong 3b9609692b
Apply for msgstream from pool when creating collection (#7377) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-31 18:35:58 +08:00
congqixia d83bc7fb54
Fix 0 ts when build index (#7272) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-08-24 21:15:52 +08:00
Cai Yudong 305fa9c17e
Fix timestamp go back issue for timeticksync (#7123) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-18 14:36:10 +08:00
Cai Yudong 21117241ec
Let system panic if kv operation fail (#7143) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-08-17 23:06:10 +08:00
neza2017 5adb69161f
Set CollectionInfo.CreateTime to the timestamp when save the metadata into etcd, (#6763) 
not the timestamp when RootCoord receive the CreateCollection Request

Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-23 14:36:12 +08:00
dragondriver 67c1fdd2c0
Show/Describe collections/partitions with created timestamp (#6700) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-07-21 18:00:14 +08:00
neza2017 d4239f0cd8
masterservice -> rootcoord (#6447) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-13 09:37:40 +08:00
Cai Yudong 21a9bcd844
Create default partition when receive CreateCollectionMsg (#6305) 
* create default partition when create collection

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* adjust sleep time for unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-06 09:16:03 +08:00
neza2017 ca4a562a72
simplify AddIndex, remove collID,PartID from parameters (#6291) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-05 10:08:02 +08:00
Cai Yudong bc8392eb1e
Add collectionID and partitionID into SegmentIndexInfo (#6289) 
* add collectionID and partitionID into SegmentIndexInfo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add partID2SegID into meta table

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DropIndex

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-07-03 20:00:40 +08:00
neza2017 f8fa025dcc
start background go routine to check if all the segments have indexed (#6290) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 17:54:25 +08:00
neza2017 111a24a49f
remove msgstream of segment info (#6280) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-07-03 14:36:18 +08:00
neza2017 b22ab71222
fix rmq (#6147) 
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
 2021-06-26 22:26:20 +08:00
Cai Yudong a09a3a1905
rename service to coord (#6020) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-23 16:14:08 +08:00