461c376b46
test: add test cases for template param ( #38867 )
...
issue: #33419
- add case for Get
- add case for TemplateParam
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2025-01-10 09:38:58 +08:00
ee9a2793da
fix: [skip-e2e] Remove valid expressions from invalid expressions ( #39012 )
...
issue: #39014
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2025-01-06 18:06:54 +08:00
af08b5b311
enhance: Update Knowhere version ( #38942 )
...
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2025-01-03 14:28:53 +08:00
80fefadf27
enhance: TestDeleteComplexExpr may failure because of timeout ( #38935 )
...
issue: #33419
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2025-01-03 12:25:26 +08:00
d3a5282eaa
enhance: add param for tuning max VARCHAR length and restore limit to 65535 ( #38884 )
...
issue: #38882
Signed-off-by: Patrick Weizhi Xu <weizhi.xu@zilliz.com>
(cherry picked from commit 8e740e004151dd2c11918aad2857c1c8d1bd98f5)
2025-01-02 14:42:53 +08:00
19a5c31907
enhance: Bump golang/x/net to v0.33 fixing security alarm ( #38850 )
...
Related to https://github.com/milvus-io/milvus/security/dependabot/106
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2025-01-02 10:50:55 +08:00
ba0c7b8fff
test: update cases for search params support and groupby issue fix ( #38852 )
...
issue: #38343 #33419
- update cases for WithSearchParam
- remove skip for groupby search issue
- update output query dynamic case for server changes
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-12-31 14:14:52 +08:00
a882f341f4
enhance: [GoSDK] Add APIs for backup tool ( #38791 )
...
Related to #31291
This PR:
- Add Backup&Restore RBAC APIs
- Add GetPersistentSegmentInfo API
- Add GetServerVersion API
- Add flush task stats
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-27 14:20:51 +08:00
90de37e60a
enhance: field stringtype maxlength raise to 1M ( #38592 )
...
enhance: field stringtype maxlength raise to 1M
issue: https://github.com/milvus-io/milvus/issues/37436
Signed-off-by: Xianhui.Lin <xianhui.lin@zilliz.com>
2024-12-20 14:32:45 +08:00
c39db11509
enhance: [GoSDK] Sync API names and add missing APIs ( #38603 )
...
Related to #31293
- Rename `UsingDatabase` to `UseDatabase`
- Uncomment default value methods
- Add missing RBAC APIs
- Add some resource group APIs
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-20 11:52:46 +08:00
ca7ec23198
enhance: Use partitionID when delete by partitionKey ( #38231 )
...
When delete by partition_key, Milvus will generates L0 segments
globally. During L0 Compaction, those L0 segments will touch all
partitions collection wise. Due to the false-positive rate of segment
bloomfilters, L0 compactions will append false deltalogs to completed
irrelevant partitions, which causes *partition deletion amplification.
This PR uses partition_key to set targeted partitionID when producing
deleteMsgs into MsgStreams. This'll narrow down L0 segments scope to
partition level, and remove the false-positive influence
collection-wise.
However, due to DeleteMsg structure, we can only label one partition to
one deleteMsg, so this enhancement fails if user wants to delete over 2
partition_keys in one deletion.
See also: #34665
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-12-20 11:18:46 +08:00
894c203f27
enhance: allow hyphen in partition name ( #38494 )
...
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-12-18 15:04:45 +08:00
8794ec966e
test: add go case for groupby search ( #38411 )
...
issue: #33419
---------
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-12-16 10:44:43 +08:00
fe79babdb3
enhance: Bump golang/x/crypto for all packages ( #38445 )
...
Related to #38446
See also https://github.com/milvus-io/milvus/security/dependabot/103
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-12-13 19:12:42 +08:00
59234a3350
test: add log level for go sdk test and update part cases ( #38385 )
...
- add log level for go sdk cases
- update cases for issue #33460 & #37853
---------
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-12-12 16:58:43 +08:00
1ce609834a
feat: [GoSDK] fp32 <-> fp16/bf16 vector conversion ( #37978 )
...
Add the following methods for convenient fp32 vector <-> fp16/bf16
vector conversion
fp32 <-> fp16/bf16 vector conversion:
- `func (fv FloatVector) ToFloat16Vector() Float16Vector`
- `func (fv FloatVector) ToBFloat16Vector() BFloat16Vector`
- `func (fv Float16Vector) ToFloat32Vector() FloatVector`
- `func (fv BFloat16Vector) ToFloat32Vector() FloatVector`
`columnBasedDataOption`:
- `func (opt *columnBasedDataOption) WithFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
- `func (opt *columnBasedDataOption) WithBFloat16VectorColumn(colName
string, dim int, data [][]float32) *columnBasedDataOption`
`ColumnFloat16Vector`/`ColumnBFloat16Vector`:
- `func NewColumnFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnFloat16Vector`
- `func NewColumnBFloat16VectorFromFp32Vector(fieldName string, dim int,
data [][]float32) *ColumnBFloat16Vector`
- support []float32 or `entity.FloatVector` in
- `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
- `func (c *ColumnFloat16Vector) AppendValue(i interface{}) error`
issue: #37448
Signed-off-by: Yinzuo Jiang <yinzuo.jiang@zilliz.com>
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-11-29 08:00:37 +08:00
c5327ff150
test: add cases for gosdk v2 partial load ( #37924 )
...
issue: #33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-11-26 15:08:34 +08:00
6b23e668b0
test: Update go_client version & update latest changes ( #37793 )
...
Related to #37768
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-26 10:26:40 +08:00
bc131a911c
test: add cases for gosdk v2 load release ( #37831 )
...
issue: #33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-11-22 10:54:32 +08:00
a654487995
fix: some error in restful ( #37487 )
...
#37370
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-11-13 17:12:39 +08:00
83d2729f94
enhance: Generate milvusclient mockery with latest proto ( #37567 )
...
Related to #37558
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-11 14:28:30 +08:00
f42869c0ce
test: remove case skip label ( #37539 )
...
[test] remove case skip label
issue: #33952
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-11-10 16:14:27 +08:00
11f4fe0177
enhance: [GoSDK] move client pkg go files to sub one ( #37492 )
...
Related to #31293
Client source files under client pkg cannot be evaluate correctly by
codecov. This PR moves them to `milvusclient` sub-package to fix this
issue and follow go major version best practice.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-08 07:32:26 +08:00
c83b93946e
enhance: [GoSDK] Add alter collection API & expose options ( #37365 )
...
Related to #31293
This PR:
- Add `AlterCollection` API for collection property modification
- Expose hidden or missing option methods
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-06 14:36:25 +08:00
eaf86f7649
fix: optimize invalid datatype error msg ( #37376 )
...
issue: #37151
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-11-04 11:46:28 +08:00
be71b98146
enhance: Fix case error msg after knowhere upgrade ( #37339 )
...
Previous PR: #37315
Error message updated after knowhere behavior change, this PR update
corresponding test error message.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-11-01 14:00:22 +08:00
2ef6cbbf59
feat: The expression supports filling elements through templates ( #37033 )
...
issue: #36672
The expression supports filling elements through templates, which helps
to reduce the overhead of parsing the elements.
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-10-31 14:20:22 +08:00
d7b2ffe5aa
enhance: add an unify vector index config checker ( #36844 )
...
issue: #34298
Signed-off-by: xianliang.li <xianliang.li@zilliz.com>
2024-10-28 10:11:37 +08:00
3628593d20
feat: Implement custom function module in milvus expr ( #36560 )
...
OSPP 2024 project:
https://summer-ospp.ac.cn/org/prodetail/247410235?list=org&navpage=org
Solutions:
- parser (planparserv2)
- add CallExpr in planparserv2/Plan.g4
- update parser_visitor and show_visitor
- grpc protobuf
- add CallExpr in plan.proto
- execution (`core/src/exec`)
- add `CallExpr` `ValueExpr` and `ColumnExpr` (both logical and
physical) for function call and function parameters
- function factory (`core/src/exec/expression/function`)
- create a global hashmap when starting milvus (see server.go)
- the global hashmap stores function signatures and their function
pointers, the CallExpr in execution engine can get the function pointer
by function signature.
- custom functions
- empty(string)
- starts_with(string, string)
- add cpp/go unittests and E2E tests
closes : #36559
Signed-off-by: Yinzuo Jiang <jiangyinzuo@foxmail.com>
2024-10-25 15:25:30 +08:00
e5948bd039
enhance: [GoSDK] Use variadic params for options ( #36912 )
...
Use variadic parameter function for options make client options easier
to use.
Related to #31293
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-16 19:33:23 +08:00
db34572c56
feat: support load and query with bm25 metric ( #36071 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-10-11 10:23:20 +08:00
f068729a26
test: fix repeated random partition name ( #35805 )
...
/kind improvement
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-09-03 17:13:12 +08:00
a90133cdf5
test: Optimize sparse vector case ( #35661 )
...
/kind improvement
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-08-26 14:54:57 +08:00
570a8879e7
test: update gosdk case for valid empty sparse vector ( #35621 )
...
/kind improvement
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-08-22 10:54:56 +08:00
6e29d713b3
enhance: [skip e2e]dockerfile for milvus-sdk-go test ( #35426 )
...
https://github.com/milvus-io/milvus/issues/35567
---------
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-08-20 09:48:55 +08:00
b4743b4ca8
enhance: [GoSDK] Sync latest milvus proto and mockery ( #35511 )
...
Related to #35443
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-08-19 16:22:55 +08:00
635e9ddb0e
test: fix go sdk cases parallel context deadline ( #35519 )
...
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-08-16 20:32:53 +08:00
a62118ca33
test: update cases for index describe and upsert with autoID ( #35191 )
...
issue: #33419
---------
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-08-05 18:00:16 +08:00
d8668fe405
enhance: upgrade go version to 1.21.11 ( #35257 )
...
issue: #35142
Signed-off-by: shaoting-huang <shaoting.huang@zilliz.com>
2024-08-05 16:12:15 +08:00
db06b86594
enhance: Sync otlp dependency version to fix security issue ( #35192 )
...
Related to #34434
otelgrpc DoS vulnerability due to unbound cardinality metrics
https://github.com/milvus-io/milvus/security/dependabot/91
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-08-02 16:22:20 +08:00
de8a266d8a
enhance: Enable linux code checker ( #35084 )
...
See also #34483
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-30 15:53:51 +08:00
c45f38aa61
enhance: Update protobuf-go to protobuf-go v2 ( #34394 )
...
issue: #34252
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-07-29 11:31:51 +08:00
4ee6c69217
enhance: Add Segment Level in milvus segment info APIs ( #34763 )
...
See also #34746
This PR add segment level field in response of
`GetPersistentSegmentInfo` and `GetQuerySegmentInfo`
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-26 10:01:46 +08:00
482373b3d3
enhance: Sync go e2e package proto dependency ( #34913 )
...
Go e2e package point to a lower verion of milvus-proto and may cause
compile error locally.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-23 16:09:43 +08:00
e4115485b6
test: add cases for gosdk v2 partitions ( #34593 )
...
issue: #33419 #34426
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-07-11 16:49:36 +08:00
3333160b8d
enhance: Fix lint issues from recent PRs ( #34482 )
...
See also #34483
Some lint issues are introduced due to lack of static check run. This PR
fixes these problems.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-09 10:06:24 +08:00
67747245f4
test: add test cases for gosdk v2 index ( #34431 )
...
issue: #33419
- Add test cases for gosdk v2 index
- Add sparse index for go client
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-07-05 09:10:09 +08:00
e4cece8de8
test: add cases for gosdk v2 upsert ( #34400 )
...
- test: add cases for gosdk v2 upsert
- test: update clientv2 to client reference
issue: #33419
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-07-04 14:26:09 +08:00
0fd0fcfe1d
enhance: Fix lint issues & sdk testcase ( #34399 )
...
Some lint issue is not detect due to recent static check pipeline issue.
This PR fixes these problem and Go milvusclient testcases.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-07-03 19:42:10 +08:00
be23495233
test: add cases got gosdk v2 search and databases ( #34204 )
...
issue: #33952 #33627 #33419
---------
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-06-27 09:40:08 +08:00
ThreadDao
cai.zhang
foxspy
Zhen Ye
Patrick Weizhi Xu
congqixia
Xianhui Lin
XuanYang-cn
Bingyi Sun
Yinzuo Jiang
smellthemoon
Yinzuo Jiang
aoiasd
yellow-shine
sthuang
wei liu