Commit Graph

79 Commits (41b19c6b1d821e69734b3daf8add44bc3c55e76e)

Author SHA1 Message Date
sthuang a65d395ecd
fix: grant v2 collection name and privilege error typo ()
issue: https://github.com/milvus-io/milvus/issues/38042

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-04 16:14:38 +08:00
sthuang 23dc313c44
fix: fix grant/revoke v2 meta and unclear error messages ()
related issue: https://github.com/milvus-io/milvus/issues/37031

fixed issues:
: better error messages for grant v2 interface
: fix meta built-in privilege group object name
: better error messages for custom privilege group interface 
: fix built-in privilege group meta to pass proxy interceptor
check
: fix revoke v2 to support revoking v1 granted privileges

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-02 11:36:39 +08:00
yihao.dai b6612e02b4
enhance: Reduce GetIndexInfos calls ()
Batch `GetIndexInfos` calls for segments to reduce RPC calls.

issue: https://github.com/milvus-io/milvus/issues/37634

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-11-19 14:24:31 +08:00
Zhen Ye 9a0e1c82bc
fix: repeated error code in milvus and segcore ()
issue: 

Signed-off-by: chyezh <chyezh@outlook.com>
2024-11-05 16:28:23 +08:00
aoiasd da227ff9a1
feat: Support create collection with functions ()
relate: https://github.com/milvus-io/milvus/issues/35853
Support create collection with functions. Prepare for support bm25
function.

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-09-12 10:43:06 +08:00
cai.zhang 2c9bb4dfa3
feat: Support stats task to sort segment by PK ()
issue:  

This PR includes the following changes:
1. Added a new task type to the task scheduler in datacoord: stats task,
which sorts segments by primary key.
2. Implemented segment sorting in indexnode.
3. Added a new field `FieldStatsLog` to SegmentInfo to store token index
information.

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-09-02 14:19:03 +08:00
Chun Han 031ee6f155
enhance: support httpv1/v2 throttle and add it for httpV2() ()
related: 

Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-08-20 16:16:55 +08:00
smellthemoon c4a240acb1
enhance: memory value are displayed in MB ()
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-08-09 14:14:25 +08:00
wayblink c79d1af390
enhance: Add compaction task slot usage logic ()


Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-07-18 10:27:41 +08:00
jaime 60be454db0
enhance: add disk quota and max collections into db properties ()
issue: 

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-07-05 18:22:17 +08:00
aoiasd 186757e622
enhance: support mark error as user error ()
relate: https://github.com/milvus-io/milvus/issues/33492

---------

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-07-01 14:56:12 +08:00
jaime 0426390f06
enhance: improve check health ()
issue: 

Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-07-01 10:16:06 +08:00
wayblink 73ffc1b424
Refine clustering_compaction_task retry mechanism ()


Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-06-30 20:22:09 +08:00
wayblink f9a0f7bb25
Add an option to enable/disable vector field clustering key ()


Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-06-25 18:52:04 +08:00
wayblink a1232fafda
feat: Major compaction ()


Signed-off-by: wayblink <anyang.wang@zilliz.com>
Co-authored-by: MrPresent-Han <chun.han@zilliz.com>
2024-06-10 21:34:08 +08:00
chyezh f53ab54c5d
enhance: async cgo utility ()
issue: , 

- implement future-based cgo utility.

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2024-06-09 22:55:53 +08:00
zhenshan.cao ac4f3997ce
enhance: Reconstructing Compaction to possess persistence capability ()
issue 

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2024-06-05 10:17:50 +08:00
Bingyi Sun fecd9c21ba
feat: LRU cache implementation ()
issue: https://github.com/milvus-io/milvus/issues/32783
This pr is the implementation of lru cache on branch lru-dev.

Signed-off-by: sunby <sunbingyi1992@gmail.com>
Co-authored-by: chyezh <chyezh@outlook.com>
Co-authored-by: MrPresent-Han <chun.han@zilliz.com>
Co-authored-by: Ted Xu <ted.xu@zilliz.com>
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: wayblink <anyang.wang@zilliz.com>
2024-05-06 20:29:30 +08:00
chyezh b287fbaa2e
fix: return collection on recovering but not collection not loaded when target is not recovered ()
issue: 

Signed-off-by: chyezh <chyezh@outlook.com>
2024-04-25 11:21:26 +08:00
SimFG 8594b55ad5
enhance: add `max insert request size` and `must use partition key` configs ()
issue: https://github.com/milvus-io/milvus/issues/30577
/kind improvement

Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-04-19 10:31:20 +08:00
chyezh 48fe977a9d
enhance: declarative resource group api ()
issue: 

- Add declarative resource group api

- Add config for resource group management

- Resource group recovery enhancement

---------

Signed-off-by: chyezh <chyezh@outlook.com>
2024-04-15 08:13:19 +08:00
cai.zhang 1b767669a4
enhance: Throw error instead of crash when index cannot be built ()
issue: 

---------

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-04-09 11:51:18 +08:00
wei liu 92971707de
enhance: Add restful api for devops to execute rolling upgrade ()
issue: 
This PR Add restful api for devops to execute rolling upgrade, including
suspend/resume balance and manual transfer segments/channels.

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-03-27 16:15:19 +08:00
yihao.dai c4ace0f9d2
fix: Return specific error code when encountering incomplete requery results ()
During requery, segments may change (e.g., due to compaction), so we
need to return specific error codes when encountering incomplete requery
results. Clients can then retry to avoid this issue.

issue: https://github.com/milvus-io/milvus/issues/29656

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-03-18 14:15:04 +08:00
wei liu 9cfe183253
enhance: remove duplicated target node id check ()
issue: 
This PR remove duplicate target node id check, due to server id has
already been checked in rpc's interceptor

---------

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-03-11 15:31:02 +08:00
SimFG 229fc4f755
enhance: retry to read when the s3 get the unexpect eof error ()
/kind improvement
issue: 

Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-02-28 16:28:53 +08:00
yiwangdr c6665c2a4c
test: support multiple data/querynodes in integration test ()
issue: https://github.com/milvus-io/milvus/issues/29507

Signed-off-by: yiwangdr <yiwangdr@gmail.com>
2024-02-21 11:54:53 +08:00
yah01 8f083e45cb
enhance: enable converting segcore error to merr ()
this converts the segcore error to merr if possible

Signed-off-by: yah01 <yang.cen@zilliz.com>
2024-01-17 11:28:53 +08:00
MrPresent-Han 2a0eb1d2e6
feat: support general capacity restrict for cloud-side resoure contro… ()
related: 

Signed-off-by: MrPresent-Han <chun.han@zilliz.com>
2024-01-16 16:32:53 +08:00
wayblink 1df3f90696
feat: Implement DescribeAlias and ListAliases interfaces ()

/kind feature

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-01-11 19:12:51 +08:00
wayblink 635a7f777c
feat: add clustering key in create/describe collection ()

/kind feature

Signed-off-by: wayblink <anyang.wang@zilliz.com>
2024-01-07 19:56:48 +08:00
yah01 a0e1a1eb31
feat: support enable/disable mmap for index ()
support enable/disable mmap for index, the user could alter the index's
mode by `AlterIndex` method
related: https://github.com/milvus-io/milvus/issues/21866

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
Signed-off-by: yah01 <yang.cen@zilliz.com>
2023-12-21 18:07:24 +08:00
yihao.dai f457b9f7c9
fix: Return time tick delay error and refine quota error messages ()
This pr:
1. Handles the time tick delay error when converting old error codes to
milvus errors.
2. Enhances quota error messages by eliminating "force deny" and
substituting it with "quota exceeded."

issue: https://github.com/milvus-io/milvus/issues/29288

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-12-20 22:52:44 +08:00
cai.zhang 1b7a503f89
enhance: Revert import support csv format ()
Revert import support csv format.
issue: 

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2023-11-28 14:32:27 +08:00
cai.zhang c29b60e18e
enhance: Support Array DataType for bulk_insert ()
issue:  
Support array DataType for bulk_insert with json, binlog files.

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2023-11-27 13:50:27 +08:00
yah01 bfccfcd0ca
enhance: refine error messages ()
- Split the simple reason and full detail
- Refine existing error messages
related: 

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-21 17:02:24 +08:00
congqixia bf2f62c1e7
Add `WriteBuffer` to provide abstraction for delta policy ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-11-04 12:10:17 +08:00
yah01 9658367a3c
Refine chunk manager errors ()
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-31 12:18:15 +08:00
SimFG 9b0ecbdca7
Support to replicate the mq message ()
Signed-off-by: SimFG <bang.fu@zilliz.com>
2023-10-20 14:26:09 +08:00
zhenshan.cao 020ad9a6bc
Rectify wrong exception messages associated with Array datatype ()
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-10-19 17:24:07 +08:00
yihao.dai 49b3a12804
Return newly defined merr instead of grpc unimplemented err ()
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-10-18 15:32:11 +08:00
wayblink e3f2122618
Expose metrics of stanby coordinators ()
Signed-off-by: wayblink <anyang.wang@zilliz.com>
2023-10-16 15:04:09 +08:00
yah01 be980fbc38
Refine state check ()
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-11 21:01:35 +08:00
yah01 2df9908c6a
Map old error code to new error ()
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-11 12:43:33 +08:00
yah01 3759857bc5
Refine Proxy errors ()
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-09 10:09:33 +08:00
yah01 41495ed266
Improve the error message for getting all indexes of collection ()
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-08 21:23:32 +08:00
congqixia 80eb5434d3
Fix var-naming caused by old PRs ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-10-07 14:43:32 +08:00
yah01 8394b3a1ec
Block creating new error from status reason ()
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-10-07 11:29:32 +08:00
yah01 63ac43a3b8
Refine errors for import ()
Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-09-30 10:31:28 +08:00
congqixia a3dd2756cf
Add predicates for TxnKV operations ()
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2023-09-27 10:21:26 +08:00