c03eb6f664
fix: streaming node consume blocks if recv message is too large ( #36151 )
...
issue: #36081
Signed-off-by: chyezh <chyezh@outlook.com>
2024-09-13 16:41:08 +08:00
2e434b2358
test: Add group size tests ( #36240 )
...
related issue: #36146
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-09-13 16:13:08 +08:00
c22a2cebb6
fix: split stream query result to avoid grpc response too large error ( #36090 )
...
relate: https://github.com/milvus-io/milvus/issues/36089
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-09-13 15:07:09 +08:00
f0f2fb4cf0
enhance: span tracing of c++ part ( #36205 )
...
fix: https://github.com/milvus-io/milvus/issues/36204
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-09-13 11:19:09 +08:00
06a706e5f0
fix: fix ReadWrite privilege group deny all global API ( #36144 )
...
issue: #35471
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-09-13 10:33:08 +08:00
c6eb6c7cb2
enhance: Add error handler for write buffer ( #36216 )
...
Related to #36215
This PR add error handler setting option providing the possibility to
change error handling behavior other than panicking.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-13 10:11:09 +08:00
b9c037f558
feat: adding cache to expression parse ( #36185 )
...
See #36122
This PR improves the proxy node performance by adding cache to
expression parse.
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-09-13 10:03:09 +08:00
1833f2d516
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-09-13 00:01:28 +00:00
8395c8a8db
enhance: Update stats task to optional ( #35947 )
...
issue: #33744
---------
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-09-12 20:37:08 +08:00
e8840a1b41
enhance: Add metrics for Delete entries num of L0seg ( #36175 )
...
- Add metrics *DataCoordL0DeleteEntriesNum*
- Remove metrics *DataCoordRateStoredL0Segment*
See also: #36147
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-09-12 18:07:08 +08:00
b5ff348906
test: Add part of test cases for default and null support ( #36186 )
...
issue : #36129
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-09-12 17:29:13 +08:00
5e5e87cc2f
enhance: rename some params and reduce default bitmapCardinalityLimit… ( #36138 )
...
#32900
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-09-12 12:09:08 +08:00
11dbe1e755
enhance: Add L0 forward policy to support remote load ( #36189 )
...
Related to #35303
This PR add a param item to support change l0 forward behavior from bf
filtering and forward to remote load.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-12 12:01:08 +08:00
da227ff9a1
feat: Support create collection with functions ( #35973 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
Support create collection with functions. Prepare for support bm25
function.
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-09-12 10:43:06 +08:00
08e681174a
fix: [GoSDK] Sync empty result set handling ( #36177 )
...
Related to #33952
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-12 10:27:08 +08:00
700a443e85
enhance: Check ANN field loaded in proxy ( #36172 )
...
Related to #35415
Currently ANN field is loaded in Parital load is not performed in proxy,
this cause error message not clear and no error returned when collection
is empty
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-11 17:43:06 +08:00
e7ea1d7a04
enhance: improve log encoding performance on proxy nodes ( #36123 )
...
See #36122
This PR is designed to enhance log performance through two improvements:
1. Optimize JSON encoding by switching JSON serializer to
`json-iterator`.
2. Adding support of lazy initialization `WithLazy`.
---------
Signed-off-by: Ted Xu <ted.xu@zilliz.com>
2024-09-11 14:51:07 +08:00
3f75bf1f20
fix: clustering compact not support null ( #36152 )
...
#36055
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-09-11 14:49:06 +08:00
f31264c02c
fix: Change l0SegmentsRowCount limits to a reasonable value ( #36014 )
...
See also: #36028
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-09-11 11:55:08 +08:00
d9c8d1ea90
test: Add part of test cases for default and null support ( #36130 )
...
issue: #36129
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-09-11 10:59:07 +08:00
dbe03a6151
test: add check after altering cardinality limit ( #36158 )
...
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-11 10:49:06 +08:00
42eef4900d
test: update test cases and sdk version ( #36148 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-09-11 10:45:07 +08:00
229f969560
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-09-10 12:00:39 +00:00
2694551757
enhance: fix a security vulnerability ( #36154 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-10 19:09:27 +08:00
1d22de140a
enhance: [pipeline] list all status before uninstall helm release ( #36040 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-10 19:07:08 +08:00
29ddb10e8c
enhance: timer instead of ticker ( #36133 )
...
https://github.com/milvus-io/milvus/issues/36132
Signed-off-by: fengjun2016 <jornfeng@gmail.com>
2024-09-10 15:23:06 +08:00
9d10f378e1
enhance: [skip e2e] [mergify]replace branch by reference ( #36139 )
...
https://github.com/milvus-io/milvus/issues/36140
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-10 15:21:07 +08:00
9aa01c69f8
enhance: add a env ( #36142 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-10 15:19:13 +08:00
89bf226f0b
feat: support keyword text match ( #35923 )
...
fix : #35922
---------
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2024-09-10 15:11:08 +08:00
b0939fd20e
enhance: Reset task check interval configuration ( #36121 )
...
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2024-09-10 14:35:08 +08:00
9d0aa5c202
fix: empty result when having only one subReq( #36098 ) ( #36128 )
...
related: #36098
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-09-10 14:25:07 +08:00
53a8a24554
fix: fix empty indices of sparse float ( #35403 )
...
https://github.com/milvus-io/milvus/issues/35401
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-09-10 14:23:07 +08:00
4850641943
fix: BinlogDeserializeReader leak ( #36087 )
...
https://github.com/milvus-io/milvus/issues/36086
Signed-off-by: fengjun2016 <jornfeng@gmail.com>
2024-09-10 12:43:07 +08:00
f4d0c589fa
test: set bulk insert test fail fast ( #36039 )
...
/kind improvement
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-09-10 11:43:06 +08:00
c9f7512e6d
enhance: [skip e2e] fix mergify ( #36135 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-10 10:59:06 +08:00
53a87825f3
test: add more bitmap test cases ( #36131 )
...
1. verified issues #36054 and #35971
2. add mix scenes test cases for BITMAP index
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-10 10:55:07 +08:00
5aedc169cd
fix: Revert "enhance: avoid the coexistence of the old coordinator and the new node/proxy ( #35720 )" ( #36113 )
...
issue: #36100
This reverts commit 73be0ba941
2024-09-10 10:23:07 +08:00
851f3b9883
fix: Make legacy non-lexicographic branch break swtich ( #36125 )
...
Related to #35941
Previous PR: #36034
This patch makes the switch branching logic correct and make the unit
test work for cases which does not select the whole dataset.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-10 10:15:07 +08:00
c0c12c6c5b
fix: Use SliceSetEqual to compare load field list ( #36051 )
...
Related to #36037
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-10 10:13:14 +08:00
c916407f37
test: add query expr test cases ( #36073 )
...
1. query with expr under different scalar index types
2. test framework supports preparing one piece of data and multiple
parameter queries
Signed-off-by: wangting0128 <ting.wang@zilliz.com>
2024-09-09 19:55:06 +08:00
3a381bc247
enhance: Bulkinsert supports null in csv formats ( #35912 )
...
see details in this issue
https://github.com/milvus-io/milvus/issues/35911
---------
Signed-off-by: OxalisCu <2127298698@qq.com>
2024-09-09 19:17:07 +08:00
aaa8487590
enhance: Remove duplicated log in proxy service ( #36110 )
...
Remove duplicate identical log in proxy/service.go
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-09 17:19:05 +08:00
51870aef08
enhance: Use stats Handler to record request/response size metrics ( #36107 )
...
Related to #36102
This PR use newly added `grpcSizeStatsHandler` to reduce calling
`proto.Size` since the request & response size info is recorded by grpc
framework.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-09 17:13:05 +08:00
73a34a5a71
enhance: [skip e2e] add a rule to label ci-pass when go-sdk check status ( #36105 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-09-09 16:17:06 +08:00
3123093dd7
enhance: Use `MARISA_LABEL_ORDER` when building trie index ( #36034 )
...
Related to #35941
Previous PR: #35943
This PR make `Trie` index using `MARISA_LABEL_ORDER`, which make
predictive search iterating in lexicographic order.
When trie index is build in label order, lexicographc could be utilized
accelerating `Range` operations.
However according to the official document, using `MARISA_LABEL_ORDER`
will make "exact match lookup, common prefix search, and predictive
search" slower.
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-09-09 14:29:05 +08:00
2687747278
fix: Set an empty segment if compaction deleted all inserts ( #36044 )
...
See also: #36038
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-09-09 14:23:05 +08:00
99817953eb
fix: delay to start the metric server port ( #36080 )
...
- issue: #36083
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-09-09 14:01:05 +08:00
8787e65b1f
fix: lifeTime not released in time ( #36093 )
...
https://github.com/milvus-io/milvus/issues/36092
Signed-off-by: fengjun2016 <jornfeng@gmail.com>
2024-09-09 11:25:05 +08:00
30a99b66c1
fix: Fix logic dead lock when delegator has high memory usage ( #36065 )
...
issue: #36064
when delegator has high memory usage, load l0 segment will failed. and
balance segment task will blocked by load segment task, then delegator
cann't free memory by moving out some segment, causes a logic dead lock.
this PR remove the limit for balance, we permit segment and balance
execute in parallel. which won't cause side effect due to:
1. one segment can only has one task in qc's scheduler, and load/release
task will replace balance task if necessary
2. balance speed has been limited, and it won't block load segment task.
3. if collection has load task and balance task at same time, load task
will be scheduled first due to high proirity.
---------
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-09-09 10:21:06 +08:00
208c8a2328
fix:support config index offsetcache and fix create same index again ( #35985 )
...
#35971
Signed-off-by: luzhang <luzhang@zilliz.com>
Co-authored-by: luzhang <luzhang@zilliz.com>
2024-09-08 18:23:05 +08:00
Zhen Ye
yanliang567
aoiasd
Jiquan Long
wei liu
congqixia
Ted Xu
sre-ci-robot
cai.zhang
XuanYang-cn
binbin
zhagnlu
smellthemoon
wt
nico
yellow-shine
CharlesFeng
Chun Han
Bingyi Sun
zhuwenxing
OxalisCu
SimFG