Commit Graph

90 Commits (hotfix-2.5.9)

Author SHA1 Message Date
congqixia cbae425511 enhance: [2.5][GoSDK] Cherry-pick commits and bump version to 2.5.2 (#41235)
Cherry-pick from master
pr: #41161 #41197 #41234

Related to #41108 #40928

Also this PR bump milvusclient go SDK version to v2.5.2

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-16 11:02:37 +08:00
congqixia d679195a5a
enhance: Bump milvus & proto version to v2.5.9 (#41144)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-04-07 20:37:35 +08:00
congqixia e0f274a1b8
enhance: Bump milvus & proto version to v2.5.8 (#41019)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-31 22:27:12 +08:00
congqixia 51efe9a60c
fix: [2.5][GoSDK] Set nullable according to fieldSchema for RowBased insert (#40928) (#40962)
Cherry-pick from master
pr: #40928

Related to #40737

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-28 10:30:20 +08:00
congqixia 2411c184a8
enhance: [2.5] Support detailed manual compaction criterion (#40892) (#40924)
Cherry-pick from master
pr: #40892
Related to #40866

This PR:
- update go-api/v2 and support partition id/channel/segment level manual
compaction
- refines the compaction trigger implementation
- unify the compaction signal usage

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-27 10:36:22 +08:00
ThreadDao 635f6c5300
[GoSDK][2.5] test: Cherry-pick gosdk test commits from master branch (#40778)
pr: #39694 #40352 #40775 #40787

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-03-21 14:30:14 +08:00
congqixia 50241e4cf9
enhance: [2.5][GoSDK] Support JSON Path index (#40754) (#40791)
Cherry-pick from master
pr: #40754 
Related to #35528

---------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-21 10:28:13 +08:00
congqixia d1359010d0
enhance: [2.5][GoSDK] Add README and examples for milvusclient (#40747)
Cherry-pick from master
pr: #40630 #40643
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-19 18:02:18 +08:00
congqixia 6d25fc56aa
enhance: Bump milvus & proto version to v2.5.7 (#40728)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-18 19:58:15 +08:00
congqixia 9cf2cb66e1
fix: [2.5][GoSDK] move metaheader to client in case of race (#40444)
Cherry-pick from master
pr: #40443
See failure run in #40352

This PR:
- move metaheader map to client struct from config
- set default value for field schema

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-10 11:18:04 +08:00
congqixia 54a2509220
enhance: [2.5][GoSDK] Support index properties API & bump version (#40434)
Cherry-pick from master
pr: #40417 
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-07 01:46:06 +08:00
congqixia 629da61617
enhance: [2.5][GoSDK] sync milvusclient patches for 2.5.1 (#40410)
Cherry pick from master
pr: #40268 #40284 #40328 #40373 #40381

------------------------------------------
#### fix: [GoSDK] Pass base64 passwd content instead of raw data
(#40268)

Related to #40261

Also add some options for create collection options and refine some
behavior

------------------------------------------
#### fix: [GoSDK] Return role without grants (#40284)

Related to #40274

Previousy DescribeRole returns only roles with grants, this PR add
select role action to check role existence.

Also added database properties related option

-----------------------------------------
#### fix: [GoSDK] Pass only valid data for nullable column (#40328)

Related to #40327

-----------------------------------------
#### enhance: [GoSDK] Add DescribeReplica API & sync rbac v2 (#40373)

Related to #31293 #37031

This PR:
- Add DescribeReplica API
- Add unified RBAC v2 API names(AddPrivilegesToGroup,
RemovePrivilegesFromGroup, GrantPrivilegeV2, RevokePrivilegeV2)
- Mark old ones deprecated

-----------------------------------------
#### enhance: [GoSDK] support update ts caching policy(#40381)

Related to #39093

This PR add update timestamp check and retry policy according to the
design of the related issue

-----------------------------------------

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-06 17:48:03 +08:00
congqixia 4272703de4
enhance: Bump milvus & proto version to v2.5.6 (#40293)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-03 16:52:00 +08:00
SimFG a945345110
fix: [2.5] use the different msg type for the OperatePrivilegeV2 api (#40193)
- issue: #40178
- pr: #40192

Signed-off-by: SimFG <bang.fu@zilliz.com>
2025-03-03 10:20:01 +08:00
congqixia 3f76e1c6d1
enhance: [GoSDK][2.5] Use pkg v2 module path (#40134) (#40269)
Cherry-pick from master
pr: #40134
Related to #39095
Previous PR #39990 update pkg module path using "/v2" package name, this
PR update milvusclient go sdk dependency for this update

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-03-01 11:00:01 +08:00
ThreadDao 7fb69960d1
test: [GoSDK][2.5] Sync gosdk test commits from master branch (#39838)
Cherry-pick from master
pr: #39484 #39570 #39537 #39824 #39579

---------

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
Signed-off-by: zhuwenxing <wxzhuyeah@gmail.com>
Co-authored-by: zhuwenxing <wenxing.zhu@zilliz.com>
2025-02-18 11:11:08 +08:00
congqixia aa74e8ba3d
enhance: [2.5][GoSDK] Add WithEnableMatch syntactic sugar (#39837) (#39853)
Cherry-pick from master
pr: #39837
Related to #35922

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-13 19:28:15 +08:00
congqixia 7ca5e8309b
enhance: [GoSDK][2.5] Sync gosdk commits from master branch (#39823)
Cherry-pick from master
pr: #38791 #38812 #38940 #39515 #39580 #39662 #39665 #39751

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-02-12 18:46:47 +08:00
Xianhui Lin 20c6de156e
feat: update milvusproto version to 2.5.5 (#39478)
feat: update milvusproto version to 2.5
issue: https://github.com/milvus-io/milvus/issues/39093

Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2025-01-21 15:11:05 +08:00
congqixia e68d161e60
enhance: Bump milvus & proto version to v2.5.4 (#39330)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-16 15:39:03 +08:00
zhenshan.cao 99a8274326
enhance: Add primary field name in SearchResult and QueryResults (#39222)
pr: https://github.com/milvus-io/milvus/pull/39220
issue: https://github.com/milvus-io/milvus/issues/39219

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2025-01-14 16:10:58 +08:00
congqixia ac730be5aa
enhance: Bump milvus & proto version to v2.5.3 (#39198)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-13 12:56:57 +08:00
congqixia a67b57275c
enhance: Bump milvus & proto version to v2.5.1 (#38774)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-26 16:36:50 +08:00
sthuang a4901ef7ec
fix: [2.5] fix privilege group list and list collections (#38738)
cherry-pick from: https://github.com/milvus-io/milvus/pull/38684
related: https://github.com/milvus-io/milvus/issues/37031

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-25 18:06:50 +08:00
congqixia b132438c03
enhance: Bump milvus & proto verison to v2.5.0 (#38610)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-20 14:30:46 +08:00
congqixia c39db11509
enhance: [GoSDK] Sync API names and add missing APIs (#38603)
Related to #31293

- Rename `UsingDatabase` to `UseDatabase`
- Uncomment default value methods
- Add missing RBAC APIs
- Add some resource group APIs

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-20 11:52:46 +08:00
congqixia a728646534
enhance: [GoSDK] Add content-type header for bulk import req (#38581)
Related to #31293
Previous PR: #38493

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-20 10:28:47 +08:00
congqixia 01cfb1fd97
enhance: [GoSDK] support expression template (#38568)
Related to #36672

This PR add
- Expression template for search, query & hybrid search
- fix hybrid search rerank param
- add reranker interface(migrate from go sdk old repo)

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-19 11:20:47 +08:00
congqixia 1ec858434f
enhance: [GoSDK] Refine search params and add some examples (#38523)
Related to #31293

This PR
- Add some example test code for some basic operations
- Refine search params and add some predefined one
- Split search & hybrid search option

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-17 20:52:44 +08:00
congqixia e19a4f764a
enhance: [GoSDK] Add bulk import restful API wrapper (#38493)
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-17 16:56:47 +08:00
congqixia fe79babdb3
enhance: Bump golang/x/crypto for all packages (#38445)
Related to #38446
See also https://github.com/milvus-io/milvus/security/dependabot/103

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-13 19:12:42 +08:00
congqixia aa4eb2f6df
enhance: [GoSDK] Handle dynamic column & partial load output (#38258)
Related to #37853

Previous logic cannot handle partial load due to dynamic column
handling. This PR unifies the output translate logic.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-06 16:46:41 +08:00
sthuang 6f1b1ad78b
enhance: [GoSDK] add operate privilege & privilege group API (#38141)
related issue: https://github.com/milvus-io/milvus/issues/37031

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-12-03 18:32:40 +08:00
congqixia fdea7a7898
enhance: [GoSDK] Refine float point conversion precision loss ut (#38097)
Previous PR: #37978

This unit test is unable due to dim is a random number. When dim is
large enough precision loss will be greater than 0.04

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-29 16:54:36 +08:00
congqixia fd94f12fb9
enhance: [GoSDK] Support nullable generic column (#38076)
Related to #31728 #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-29 10:40:37 +08:00
Yinzuo Jiang 1ce609834a
feat: [GoSDK] fp32 <-> fp16/bf16 vector conversion (#37978)
Add the following methods for convenient fp32 vector <-> fp16/bf16
vector conversion

fp32 <-> fp16/bf16 vector conversion:

- `func (fv FloatVector) ToFloat16Vector() Float16Vector`
- `func (fv FloatVector) ToBFloat16Vector() BFloat16Vector`
- `func (fv Float16Vector) ToFloat32Vector() FloatVector`
- `func (fv BFloat16Vector) ToFloat32Vector() FloatVector`

`columnBasedDataOption`:

- `func (opt *columnBasedDataOption) WithFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
- `func (opt *columnBasedDataOption) WithBFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`

`ColumnFloat16Vector`/`ColumnBFloat16Vector`:

- `func NewColumnFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnFloat16Vector`
- `func NewColumnBFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnBFloat16Vector`
- support []float32 or `entity.FloatVector` in
    - `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
    - `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`

issue: #37448

Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-11-29 08:00:37 +08:00
congqixia 8c9dab5cf7
enhance: [GoSDK] Add Slice method for Vector Columns (#37951)
Related to #37768

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-24 14:48:33 +08:00
congqixia 175f49ea60
enhance: [GoSDK] Use generic column base and add unit tests (#37768)
Related to #31293

Previous column is written using go before 1.18, which does not support
generic type. After migrating client pkg to main repo, generic base
could be used to reduce lots of duplicated code.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-19 10:40:31 +08:00
congqixia 24c6a4bb29
enhance: [GoSDK] support Doc-in-doc-out APIs (#37590)
Related to #35853

This PR contains following changes:

- Add function and related proto and helper functions
- Remove the insert column missing check and leave it to server
- Add text as search input data
- Add some unit tests for logic above

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-12 10:58:28 +08:00
congqixia 83d2729f94
enhance: Generate milvusclient mockery with latest proto (#37567)
Related to #37558

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-11 14:28:30 +08:00
sthuang 70605cf5b3
enhance: Support custom privilege group for RBAC (#37087)
issue: #37031

---------

Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-11-09 08:44:28 +08:00
congqixia 11f4fe0177
enhance: [GoSDK] move client pkg go files to sub one (#37492)
Related to #31293

Client source files under client pkg cannot be evaluate correctly by
codecov. This PR moves them to `milvusclient` sub-package to fix this
issue and follow go major version best practice.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-08 07:32:26 +08:00
wei liu 00f6d0ec51
fix: watch channel stuck due to misuse of timer.Reset (#37433)
issue: #37166
cause the misuse of timer.Reset, which cause dispatcher failed to send
msg to virtual channel buffer, and dispatcher do splitting again and
again, which hold the dispatcher manager's lock, block watching channel
progress.

This PR fix the misuse of timer.Reset

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-11-07 14:34:24 +08:00
congqixia f813fb4563
enhance: [GoSDK] Remove example in main pkg to make ut script work (#37472)
Related to #31293

Example with main func/package causes `go list` command failed with vcs
error. This PR removes example files with main package. The example
snippet shall be added back in runnable test format.

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-07 10:50:25 +08:00
congqixia c83b93946e
enhance: [GoSDK] Add alter collection API & expose options (#37365)
Related to #31293

This PR:

- Add `AlterCollection` API for collection property modification
- Expose hidden or missing option methods

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-06 14:36:25 +08:00
foxspy d7b2ffe5aa
enhance: add an unify vector index config checker (#36844)
issue: #34298

Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-10-28 10:11:37 +08:00
congqixia e6cb7d6695
enhance: [GoSDK] Add collection alias & rename API (#36990)
Related to #31293

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-21 18:45:33 +08:00
congqixia b7ffa8383c
enhance: [GoSDK] write back auto id value to row based input (#36964)
Related to #33460

---------

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-18 11:19:24 +08:00
congqixia eb62433973
enhance: [GoSDK] Set default max send recv size (#36945)
Related to milvus-io/milvus-sdk-go#831

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-17 14:33:23 +08:00
congqixia e5948bd039
enhance: [GoSDK] Use variadic params for options (#36912)
Use variadic parameter function for options make client options easier
to use.

Related to #31293

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-16 19:33:23 +08:00