milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
21,884 Commits
174 Branches
147 Tags
630 MiB
Commit Graph

154 Commits (eb046863485fdf3e130fc60484485c901b81276b)

Author SHA1 Message Date
zhenshan.cao 020ad9a6bc
Rectify wrong exception messages associated with Array datatype (#27769) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-10-19 17:24:07 +08:00
jaime 7f7c71ea7d
Decoupling client and server API in types interface (#27186) 
Co-authored-by:: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-09-26 09:57:25 +08:00
SimFG 26f06dd732
Format the code (#27275) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-09-21 09:45:27 +08:00
yah01 168e82ee10
Fix panic while handling with the nil status (#27040) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-15 10:09:21 +08:00
yah01 00c65fa0d7
Refine QueryNode errors (#27013) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-12 16:07:18 +08:00
yah01 3349db4aa7
Refine errors to remove changes breaking design (#26521) 
Signed-off-by: yah01 <yah2er0ne@outlook.com>
 2023-09-04 09:57:09 +08:00
jaime d001133bd2
[skip e2e] Refine collection not exists error (#26707) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-08-31 17:29:03 +08:00
smellthemoon 248bbc749d
Fix GetCollectionID to return err (#26239) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-08-11 10:21:29 +08:00
wei liu f9823e039f
fix describe rg with non exist collection (#26227) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-08-10 18:43:16 +08:00
SimFG 4e1b65d38f
Refine the rbac cache update process (#26150) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-07 11:59:07 +08:00
SimFG d2649b63db
Delete the user-role mapping info when deleting the user (#25988) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2023-08-04 18:37:08 +08:00
chyezh f915f1739a
[Fixup] Short-term fix metacache data race (#25802) 
Signed-off-by: chyezh <ye.zhen@zilliz.com>
 2023-08-04 17:47:07 +08:00
smellthemoon 9614e61f14
Fix collection and channel not match (#25859) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-08-01 17:33:06 +08:00
Enwei Jiao 66fdc71479
Refactor logs in DataCoord & DataNode (#25574) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-07-14 15:56:31 +08:00
wei liu 986208bca0
fix set wrong consistency level in proxy (#25458) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-07-11 10:06:28 +08:00
xige-16 33c2012675
Add more metrics (#25081) 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2023-06-26 17:52:44 +08:00
jaime 18df2ba6fd
[Cherry-Pick] Support Database (#24769) 
Support Database(#23742)
Fix db nonexists error for FlushAll (#24222)
Fix check collection limits fails (#24235)
backward compatibility with empty DB name (#24317)
Fix GetFlushAllState with DB (#24347)
Remove db from global meta cache after drop database (#24474)
Fix db name is empty for describe collection response (#24603)
Add RBAC for Database API (#24653)
Fix miss load the same name collection during recover stage (#24941)

RBAC supports Database validation (#23609)
Fix to list grant with db return empty (#23922)
Optimize PrivilegeAll permission check (#23972)
Add the default db value for the rbac request (#24307)

Signed-off-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: SimFG <bang.fu@zilliz.com>
Co-authored-by: longjiquan <jiquan.long@zilliz.com>
 2023-06-25 17:20:43 +08:00
Enwei Jiao d143682d7d
Refactor logs in proxy package. (#24936) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-06-19 13:28:41 +08:00
wei liu a3437e0ab5
refactor replica selection and retry policy on channel (#24367) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-06-13 10:20:37 +08:00
congqixia 864c1bbcee
Use collInfo instead of reading again (#24784) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 20:26:35 +08:00
congqixia 41af0a98fa
Use go-api/v2 for milvus-proto (#24770) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-06-09 01:28:37 +08:00
yah01 fa69c71d35
Fix data race in MetaCache (#24739) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-06-08 13:58:35 +08:00
yihao.dai d6dea8bcbb
Fix getting partitions in Proxy meta cache (#24719) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-06-08 11:14:35 +08:00
zhenshan.cao f7924724b0
Add consistency_level paramter in search/query request (#24499) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2023-05-30 21:01:29 +08:00
cai.zhang 008285f849
Support dynamic schema for create collection (#24176) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2023-05-18 09:33:24 +08:00
yihao.dai 3827ac30bc
Remove load cache (#23287) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2023-05-09 10:36:41 +08:00
jaime c9d0c157ec
Move some modules from internal to public package (#22572) 
Signed-off-by: jaime <yun.zhang@zilliz.com>
 2023-04-06 19:14:32 +08:00
smellthemoon 3dae84f065
Use merr in proxy (#22904) 
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
 2023-03-24 15:27:58 +08:00
wei liu 6b5dfa6db2
deprecate shard cache immediately if query failed (#22779) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-17 16:25:55 +08:00
wei liu 69cc68caff
support first or random strategy (#22766) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-16 14:25:55 +08:00
congqixia 3ffa6d5302
Mark cache deprecated instead of removing it (#22674) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-03-10 10:19:53 +08:00
yah01 90a5aa6265
Refine errors, re-define error codes (#22501) 
Signed-off-by: yah01 <yang.cen@zilliz.com>
 2023-03-09 15:47:52 +08:00
wei liu 1a1a5caafa
update shard leader cache periodically (#22595) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-03-08 15:13:51 +08:00
Enwei Jiao 697dedac7e
Use cockroachdb/errors to replace other error pkg (#22390) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2023-02-26 11:31:49 +08:00
congqixia abbf1efa0e
[Cherry-Pick] Fix read wrong variable caused nil error (#22297) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2023-02-21 18:38:26 +08:00
wei liu 73c44d4b29
resource group impl (#21609) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2023-01-30 10:19:48 +08:00
zhenshan.cao ce3e0fcf9e
Fixbug: proxy meta_cache partially update (#21232) (#21242) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-12-14 20:45:23 +08:00
Enwei Jiao 956c5e1b9d
Make Params singleton (#20088) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-11-04 14:25:38 +08:00
cai.zhang c551de8f72
Catch errors on gloabl meta cache (#20023) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-10-25 11:29:30 +08:00
Xiaofan 3d3289ce3e
Fix collection metrics leakage (#19944) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-10-21 10:13:28 +08:00
congqixia b15e97a61a
Improve proxy leader cache lock logic (#19917) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-10-20 16:11:27 +08:00
smellthemoon 108e51b2f0
[test]Create index before load and fix error message (#19874) (#19857) 
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
 2022-10-19 10:01:26 +08:00
Xiaofan 5b9988b627
Support collection level monitoring metrics (#19686) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-10-18 19:17:27 +08:00
Ten Thousand Leaves db33f401fd
Fix proxy crash issue when meta cache miss (#19844) 
issue: #19557

/kind bug

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>

Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
 2022-10-18 13:11:26 +08:00
SimFG a55f739608
Separate public proto files (#19782) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-10-16 20:49:27 +08:00
Jiquan Long 73463d030d
Fix dml stream leakage in Proxy (#19450) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-09-27 19:18:54 +08:00
Bingyi Sun 72346f31b0
Add collectionID when checking collection load (#19322) 
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
 2022-09-22 15:08:50 +08:00
SimFG d7f38a803d
Separate some proto files (#19218) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-09-16 16:56:49 +08:00
SimFG 69c0b2fb49
Improve the storage method of the grant info in the metastore (#18817) 
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-08-26 19:22:56 +08:00
jaime 516fd928f9
Fix password verification miss cache (#18730) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
 2022-08-19 19:42:50 +08:00
SimFG c267ad612d
Support Role-Based Access Control II (#18528) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-08-05 16:28:35 +08:00
SimFG ff0200210a
Support Role-Based Access Control (#18425) 
Signed-off-by: SimFG <bang.fu@zilliz.com>
 2022-08-04 11:04:34 +08:00
codeman 5fda8261d0
Fix: Unable to list newly created credential users (#18117) (#18153) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-07-07 21:16:22 +08:00
codeman 6ab850bedf
Fix update credential failure (#17963) (#17970) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-06-30 21:34:18 +08:00
codeman 95a3830dc6
fix password comparison too slow (#17874) (#17897) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-06-29 20:02:18 +08:00
zhenshan.cao 5f44e45480
Add metrics on QueryNode and Proxy (#17328) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-06-02 16:06:03 +08:00
zhenshan.cao 2763efc9b0
Add cache of grpc client of ShardLeader in proxy (#17301) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-06-02 12:16:03 +08:00
Letian Jiang f2a27e0e64
Retry GetShardLeaders until service available or timeout (#17183) 
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
 2022-05-26 20:28:02 +08:00
congqixia e06d6d7cc6
Returns collection instead of copy to make leaderMutex work (#17206) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-25 15:20:00 +08:00
congqixia 90ee23df22
Fix shardLeader cache concurrent access (#17120) 
Fix  write map without mutex control
Also GetShards returns a copy of leader list instead of original one

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-05-20 14:33:57 +08:00
bigsheeper 9eeec4a2d5
Add collection load cache and InvalidateCollMetaCache by collID (#16882) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-05-19 10:13:56 +08:00
XuanYang-cn 127dd34b37
Make proxy use roundrobin to choose replica (#17063) 
Fixes: #17055

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-05-17 22:35:57 +08:00
XuanYang-cn a1480aaf76
Clear shard leaders cache when releasing (#16942) 
See also: #16926

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-05-17 11:11:56 +08:00
Xiaofan 89b4a34892
Fix Data race in NodeID (#16603) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-04-24 22:03:44 +08:00
congqixia 69252f812d
Implement memory replica in Proxy, QueryNode and QueryCoord (#16470) 
Related to #16298 #16291 #16154
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Letian Jiang <letian.jiang@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-04-20 16:15:41 +08:00
codeman 4e12271d79
Support login with username and password (#15656) (#16341) 
Signed-off-by: kejiang <ke.jiang@zilliz.com>

Co-authored-by: kejiang <ke.jiang@zilliz.com>
 2022-04-11 19:49:34 +08:00
zhenshan.cao f3eeecf146
Reduce the number of metrics (#16030) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-03-15 21:51:21 +08:00
cai.zhang d183748484
Add some prometheus metrics for proxy (#15582) 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2022-03-02 16:23:55 +08:00
Jiquan Long 5d91fb3c70
[skip e2e] Add comment for MetaCache (#15169) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-12 10:57:41 +08:00
Jiquan Long ff60bb8bfc
[skip e2e] Add comment for GetCollectionSchema (#15113) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-10 22:37:58 +08:00
Jiquan Long 149e049f04
[skip e2e] Add implementation assertion for Cache (#15022) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-07 17:51:33 +08:00
Jiquan Long 72e3352366
[skip e2e] Add comment for GetPartitionInfo (#15021) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-07 17:49:43 +08:00
Jiquan Long 6a8d8f43c4
[skip e2e] Add comment for GetPartitions (#14954) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-06 23:32:00 +08:00
Jiquan Long a18744346a
[skip e2e] Add comment for GetPartitionID (#14872) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2022-01-05 23:19:21 +08:00
congqixia 36a43e647d
[skip e2e] Add comment for GetCollectionInfo of proxy meta cache (#14824) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-05 14:27:42 +08:00
congqixia cd43b12a77
[skip e2e] Add comment for meta_cache.go (#14746) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-01-04 14:07:56 +08:00
Jiquan Long 700546708c
[skip e2e] Add comment for GetCollectionInfo (#14636) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-12-30 20:43:26 +08:00
congqixia 53784b5237
[skip e2e] Add comment for NewMetaCache (#14477) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-29 11:55:02 +08:00
congqixia 12bd3ade4c
[skip e2e] Add comment for proxy Cache and MetaCache struct (#14076) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2021-12-23 18:13:30 +08:00
edward.zeng 21ad57c3da
[skip e2e] Add comment to proxy meta cache (#14021) 
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
 2021-12-23 15:08:45 +08:00
jaime f479381c39
[skip ci] Add a comment for describeCollection function in meta_cache (#13018) 
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
 2021-12-09 10:51:19 +08:00
XuanYang-cn d4f77253e6
[skip ci]Update license for proxy meta (#11607) 
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2021-11-10 23:56:35 +08:00
dragondriver e529012ab2
[skip ci] Add comment for cache (#10144) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-10-19 14:15:04 +08:00
dragondriver 8d239b6473
Add test cases for search task (#7796) 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-09-13 17:12:19 +08:00
Xiaofan 619c4393f3
Refine logs in proxy search path(#7357) (#7753) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2021-09-12 17:54:01 +08:00
xige-16 87c5a49d9a
Refactor showCollection/showPartition to get load state in memory (#6935) 
* refactor showCollection/showPartition to get load state in memory

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update milvus.proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* add show result log to debug

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix wrong err message

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update pymilvus-orm version

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix repeated load error

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* update proto

Signed-off-by: xige-16 <xi.ge@zilliz.com>

* fix status nil error

Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-08-02 22:39:25 +08:00
Cai Yudong 2926a78968
Rename proxynode to proxy (#5961) 
* rename package name from proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move distributed/proxynode to distributed/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move internal/proxynode to internal/proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename proxynode to proxy

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2021-06-22 14:40:07 +08:00
quicksilver 7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-15 14:38:36 +08:00
neza2017 56ab2bda2d Update proto:add partition id 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-15 11:53:22 +08:00
zhenshan.cao 63b21321d6 Refactor indexservice and update doc 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-15 13:50:27 +08:00
godchen 7ab5b5d80d Add MinIO kv implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-12-03 19:00:11 +08:00
neza2017 cec903da19 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-02 18:31:56 +08:00
zhenshan.cao 23aebe7e2a Fix proxy unittest 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-01 19:53:53 +08:00
neza2017 17cc7bc337 Use MetaRootPath instead 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-01 17:03:39 +08:00
dragondriver 84b15c1f5c Fix the bug of meta cache in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-01 16:41:25 +08:00
cai.zhang c1fbc4f8fa Open the tests for insert 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-01 15:18:57 +08:00
FluorineDog 6b74d82259 Support some validation for dsl parser 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-01 02:16:53 +08:00
dragondriver 2358fae703 Check the status of search results before reduce in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-30 19:08:32 +08:00
bigsheeper 0cd3e8d86c Use exception instead of runtime error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-30 17:58:23 +08:00
dragondriver 51a9f49d35 Fix the topk check when deal with the search result in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-30 17:46:00 +08:00