463c47ced1
enhance: support default value in import ( #36700 )
...
https://github.com/milvus-io/milvus/issues/31728
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-10-17 12:05:24 +08:00
1375d690dd
enhance: adjust some err msg ( #36840 )
...
related with #36495
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-10-17 12:01:25 +08:00
b172ea1093
fix: Remove enableLevelZeroSegment config ( #36535 )
...
See also: #36504
---------
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2024-10-17 11:59:24 +08:00
4d08eec1af
Update all contributors
...
Signed-off-by: sre-ci-robot <sre-ci-robot@zilliz.com>
2024-10-16 12:01:07 +00:00
06b5e186a7
fix: return error if searching against BM25 output field with incorrect metric type ( #36910 )
...
issue: https://github.com/milvus-io/milvus/issues/36835
currently searching BM25 output field using IP will end up in an error
in segcore which is hard to understand. now returning error in query
node delegator and provide more useful error message
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-16 19:45:23 +08:00
51f13ba7cf
fix: add checks for bm25 k1 and b in sparse index checker ( #36907 )
...
issue: https://github.com/milvus-io/milvus/issues/36883 ,
https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-16 19:43:24 +08:00
e5948bd039
enhance: [GoSDK] Use variadic params for options ( #36912 )
...
Use variadic parameter function for options make client options easier
to use.
Related to #31293
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-16 19:33:23 +08:00
903450f5c6
enhance: add ts support for iterator( #22718 ) ( #36572 )
...
related: #22718
Signed-off-by: MrPresent-Han <chun.han@gmail.com>
Co-authored-by: MrPresent-Han <chun.han@gmail.com>
2024-10-16 18:51:23 +08:00
c271c21f17
enhance: improve scripts standalone_embed,add upgrade ( #36924 )
...
[[skip ci] improve scripts standalone_embed,add upgrade](enhance:
improvement scripts standalone_embed,add upgrade #36921 )
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
2024-10-16 17:51:23 +08:00
447ff342fb
fix: Direct forward delta exclude l0 segments ( #36899 )
...
Related to #36887
Forward delete to L0 segment will return error and mark l0 segment
offline causing delegator unserviceable
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-16 14:05:23 +08:00
caeab0cc1f
enhance: Fill start pos & level for growing segment ( #36888 )
...
Start position & level info is missing for growing segment loaded in
watch dml channel operation.
Level is important for metrics and start position is crucial for growing
exclude logic.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-16 14:03:31 +08:00
44d80c1355
fix: not return err if consistencyLevel is not set to a valid value ( #36714 )
...
https://github.com/milvus-io/milvus/issues/36444
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-10-16 13:23:22 +08:00
72dc07ba48
fix: bm25 search failed when nq > 1 and remove idf oracle when no bm25 field exist. ( #36886 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-10-16 12:51:23 +08:00
b2037c95a8
fix: use chunk_row_nums to iterate ( #36882 )
...
Fix segmentation fault error and remove useless codes.
https://github.com/milvus-io/milvus/issues/36834
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-10-16 11:15:25 +08:00
9997c5de34
fix: remove excessive logging ( #36859 )
...
issue: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-16 10:47:22 +08:00
f3b6792a25
enhance: Enhance segment log ( #36848 )
...
/kind improvement
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-10-15 20:43:30 +08:00
ba25320aea
fix: Unify loaded partition check to delegator ( #36879 )
...
Related to #36370
---------
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-15 19:15:23 +08:00
2291d0c9f5
test: update test cases ( #36878 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-10-15 19:13:24 +08:00
e43af16e93
enhance: [ci] separate ccache by branch for e2e pipeline ( #36870 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-15 17:21:22 +08:00
1bd3228635
enhance: Ignore db not found error in quota center ( #36821 )
...
In quota center, ignore the "DB not found error" to prevent it from
affecting the rate limiting of other databases.
/kind improvement
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-10-15 15:55:22 +08:00
b0d5866507
enhance: add checkers for Faiss-based HNSW ( #36857 )
...
Knowhere introduced FAISS-based HNSQ Flat/SQ/PQ/PRQ. This PR adds param
check in Milvus side.
This PR actually do nothing but let the check pass, since:
1. All indexes param check will be moved to Knowhere recently. @foxspy
2. The index name will be changed from `FAISS_HNSW_xx` to `HNSW_xx`
after QA test. @alexanderguzhva
Signed-off-by: Li Liu <li.liu@zilliz.com>
2024-10-15 12:29:22 +08:00
aa904be6ec
enhance: support sparse vector mmap in growing segment type ( #36566 )
...
issue: https://github.com/milvus-io/milvus/issues/32984
related pr: https://github.com/milvus-io/milvus/pull/36565
Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2024-10-15 10:59:23 +08:00
bb3ef5349f
enhance: update the expr version to support automatic conversion of variable types ( #36832 )
...
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-10-15 10:53:22 +08:00
65608ca8d9
enhance: able to upload pytest logs when test is done ( #36842 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-15 10:39:22 +08:00
744a36c287
enhance: [GoSDK] support unmarshal result set into orm receiver ( #36789 )
...
Related to milvus-io/milvus-sdk-go#800
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-15 10:37:23 +08:00
0ec92513a5
test: Update Diskann supporting group by ( #36853 )
...
related issue: #36813
milvus diskann does not support group_search before, it supports now.
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-15 10:35:23 +08:00
c9752bd2e6
enhance: refactor createCollection in RESTful API ( #36790 )
...
1. support isClusteringKey in restful api;
2. throw err if passed invalid 'enableDynamicField' params
3. parameters in indexparams are not processed properly, related with
#36365
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2024-10-15 10:29:22 +08:00
d566b0ceff
test: add stats task feature cases and DefaultVectorSearchParams ( #36768 )
...
issue: #36767
---------
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2024-10-14 19:15:23 +08:00
937ebec2ce
test: update test cases ( #36841 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-10-14 19:13:23 +08:00
af2da8d8d6
[automated] Update Pytest image changes ( #36845 )
...
Update Pytest image changes
See changes:
c96bbe19basre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-10-14 19:11:23 +08:00
f46c3acea9
fix: heap buffer overflow when unittest at index wrapper ( #36838 )
...
issue: #35852
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2024-10-14 18:13:22 +08:00
5ec4163d0f
feat: support bm25 logs mixcompaction ( #36072 )
...
relate: https://github.com/milvus-io/milvus/issues/35853
---------
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2024-10-14 16:57:22 +08:00
c96bbe19ba
test: Add upsert in rows tests ( #36820 )
...
related issue: #36710
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-10-14 16:41:22 +08:00
f0f5147aef
fix: streaming consumer may get stucked when handler is un-consumed ( #36818 )
...
issue: #36378
Signed-off-by: chyezh <chyezh@outlook.com>
2024-10-14 15:23:23 +08:00
8905b042f1
fix: add proportion for capacity seal policy in streaming flusher ( #36761 )
...
issue: #36760
---------
Signed-off-by: chyezh <chyezh@outlook.com>
2024-10-14 14:47:22 +08:00
00e7e8c661
enhance: enable macos checker ( #36833 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-14 14:09:21 +08:00
3a09b438c2
fix: fix macos code checker ( #36817 )
...
https://github.com/milvus-io/milvus/issues/36829
---------
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-10-14 11:11:51 +08:00
d230b91bd1
enhance: Add PreallocatedSegmentIDs for the compaction task ( #36734 )
...
Add `PreallocatedSegmentIDs` field to the compaction task, allowing the
`ResultSegments` in the compaction task to represent the final segments
produced by the compaction.
issue: https://github.com/milvus-io/milvus/issues/36733
also related: https://github.com/milvus-io/milvus/issues/36686
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-10-13 17:59:21 +08:00
383350c120
feat: added more checks for function creation check ( #36766 )
...
issue: https://github.com/milvus-io/milvus/issues/35853
* BM25 Function now takes no params, k1, b should be passed via index
params
* support BM25 full text search when metric type is not present in
search request
* add more strict validation with functions at collection creation time
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-13 17:43:22 +08:00
16b533cbf0
feat: Restful support for BM25 function ( #36713 )
...
issue: https://github.com/milvus-io/milvus/issues/35853
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-13 17:41:21 +08:00
e170991a10
[automated] Update Knowhere Commit ( #36823 )
...
Update Knowhere Commit
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-10-13 01:21:20 +08:00
ef0c649bda
enhance: update knowhere version to support diskann iterator ( #36813 )
...
issue: #36812
Signed-off-by: min.tian <min.tian.cn@gmail.com>
2024-10-12 18:05:22 +08:00
82c5cf2fa2
feat: add bulk insert support for Functions ( #36715 )
...
issue: https://github.com/milvus-io/milvus/issues/35853 and
https://github.com/milvus-io/milvus/issues/35856
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-10-12 17:19:20 +08:00
d45e2677b9
[automated] Bump milvus version to v2.4.13 ( #36801 )
...
Bump milvus version to v2.4.13
Signed-off-by: sre-ci-robot sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-10-12 15:07:24 +08:00
a75bb85f3a
feat: support chunked column for sealed segment ( #35764 )
...
This PR splits sealed segment to chunked data to avoid unnecessary
memory copy and save memory usage when loading segments so that loading
can be accelerated.
To support rollback to previous version, we add an option
`multipleChunkedEnable` which is false by default.
Signed-off-by: sunby <sunbingyi1992@gmail.com>
2024-10-12 15:04:52 +08:00
5713620825
enhance: skip alter operation when no change are detected ( #36785 )
...
issue: #36784
Signed-off-by: jaime <yun.zhang@zilliz.com>
2024-10-12 11:25:20 +08:00
5b2658327d
enhance: change way to bump milvus bersion ( #36776 )
...
Signed-off-by: Yellow Shine <sammy.huang@zilliz.com>
2024-10-12 10:41:25 +08:00
03a78ecc3d
enhance: gc in the snapshot kv ( #36792 )
...
issue: #36770
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-10-12 04:03:20 +08:00
7acf724185
enhance: support to execute the method which contains the ctx param ( #36797 )
...
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-10-12 00:01:20 +08:00
bfe5c651d6
doc: Update go version in DEVELOPMENT.md ( #36796 )
...
go 1.22 is needed for master branch. Update document for developer guide
markdown.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-10-11 21:25:20 +08:00
smellthemoon
XuanYang-cn
sre-ci-robot
Buqian Zheng
congqixia
Chun Han
Linkwei
aoiasd
Bingyi Sun
yihao.dai
nico
yellow-shine
liliu-z
cqy123456
SimFG
yanliang567
ThreadDao
sre-ci-robot
Zhen Ye
Min Tian
jaime