Commit Graph

2591 Commits (cb7b1d1d515e563d565c7687c0687ac72ac2fe0b)

Author SHA1 Message Date
cqy123456 8fd38c8eea
enhance:[cherry-pick] Use binlog index for better search performance (#29012)
this pr is cherry-pick from master:
pr: https://github.com/milvus-io/milvus/pull/28528
pr: https://github.com/milvus-io/milvus/pull/27673
related issue:
issue: https://github.com/milvus-io/milvus/issues/27678

Signed-off-by: cqy123456 <qianya.cheng@zilliz.com>
2023-12-07 09:52:34 +08:00
yihao.dai 51614073ec
enhance: Update pymilvus (#28922) (#28991)
issue: https://github.com/milvus-io/milvus/issues/17614

pr: https://github.com/milvus-io/milvus/pull/28922

---------

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2023-12-06 11:56:34 +08:00
nico 609800a5b7
test: modify test cases for error msg update(2.3) (#28849)
pr: #28846
issue: #23075

Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-12-04 11:20:47 +08:00
nico a3aceb97a4
test: update test cases and pymilvus version (#28746)
pr: #28706

Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-11-29 10:28:29 +08:00
groot ecfa0a9b10
test: Unskip a bulkinsert test case (#28780)
Unskip a bulkinsert test case which is skipped by #28209

pr: https://github.com/milvus-io/milvus/pull/28679

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-11-28 13:00:27 +08:00
groot d20328bc05
test: Avoid unstable case of bulkinsert (#28757)
test: There are too many test cases for bulkinsert+partition_key. Each
case creates 10 bulkinsert tasks to import a file with 100~200 rows. The
default num_partitions is 64 for partition_key. So, each task will
generate 64 tiny segments. There are 10 cases, each case 10 tasks, each
task 64 tiny segment, totally there are 6400 tiny segments generated.
And all these segment row count is less than 1024, no need to build
index, and take part in compaction. There will be lots of compaction
tasks generated. It costs too much time to process these compaction
tasks. Eventually, some cases are timeout after waiting 5 minutes for
their segments to be ready and cases fail.

Specifying the num_partitions to a small value can avoid this problem.

pr: https://github.com/milvus-io/milvus/pull/28679

```
[2023-11-21T03:41:16.187Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_json_file[int_scalar-True-True] PASSED [ 54%]
[2023-11-21T03:41:42.796Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_json_file[int_scalar-False-True] PASSED [ 57%]
[2023-11-21T03:42:04.694Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_json_file[string_scalar-True-True] PASSED [ 60%]
[2023-11-21T03:42:31.205Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_json_file[string_scalar-False-True] PASSED [ 63%]
[2023-11-21T03:43:38.876Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_multi_numpy_files[10-150-13-True] XPASS [ 66%]
[2023-11-21T03:49:00.357Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_multi_numpy_files[10-150-13-False] XFAIL [ 69%]
[2023-11-21T03:53:51.811Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_csv_file[int_scalar-True] FAILED [ 72%]
[2023-11-21T03:58:58.283Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_csv_file[int_scalar-False] FAILED [ 75%]
[2023-11-21T04:02:04.696Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_csv_file[string_scalar-True] PASSED [ 78%]
[2023-11-21T04:02:26.608Z] testcases/test_bulk_insert.py::TestBulkInsert::test_partition_key_on_csv_file[string_scalar-False] PASSED [ 81%]
```

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2023-11-28 10:34:31 +08:00
yah01 5ca7851f4a
enhance: refine error messages (#28424) (#28614)
- Split the simple reason and full detail
- Refine existing error messages related: #28422
related: https://github.com/milvus-io/milvus/issues/28422
pr: #28424

---------

Signed-off-by: yah01 <yah2er0ne@outlook.com>
2023-11-24 10:04:24 +08:00
zhuwenxing 558e301236
test:skip a bulk insert testcase temporarily (#28621)
skip a bulk insert test case temporarily.
It is a known issue but needs more time to solve. skip the test case is
for not blocking other PR

Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-11-21 19:12:22 +08:00
PowderLi 92e5f96064
fix: symbol 'GetStorageMetrics' and 'enableDynamicField' (#28581)
issue: #28579 #28504
pr: #28580

1. replace enableDynamic with enableDynamicField
2. cgo directly link to milvus_storage

Signed-off-by: PowderLi <min.li@zilliz.com>
2023-11-21 15:30:23 +08:00
ThreadDao d582193772
Add test cases for L0 delete (#28382)
- test delete records in delta logs, WAL, L0 segment

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2023-11-14 10:26:24 +08:00
zhuwenxing c7fe443b93
[test]Remove xfail for a bulk insert testcase (#28283)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-11-13 11:48:18 +08:00
nico 9451720a31
update test cases for 2.3 branch (#28335)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-11-13 09:34:20 +08:00
sre-ci-robot 2ae60d72f8
Update Pytest image changes (#28321)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-11-13 09:32:30 +08:00
cai.zhang c8cab4dfc3
No hit when the index exceeds the array length (#28302)
Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
2023-11-09 22:10:32 +08:00
nico 4d95a7368d
update pymilvus version (#28299)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-11-09 19:04:22 +08:00
zhuwenxing 765aaf3e88
[skip e2e][cherry-pick]Mark a case as xfail (#28248)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-11-07 18:22:05 +08:00
nico 7616414083
update pymilvus version (#27918)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-26 09:46:09 +08:00
yanliang567 8b5b33fce0
Update simd compatibility test (#27880)
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2023-10-25 17:20:14 +08:00
nico de26231976
update nightly test cases (#27911)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-25 17:18:12 +08:00
sre-ci-robot 0cdd5818ac
Update Pytest image changes (#27871)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-10-25 09:44:11 +08:00
nico ec99eb1759
Add test cases of array contains (#27889)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-24 19:24:19 +08:00
zhuwenxing 906b348e00
[skip e2e]Update chaos duration time (#27879)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-24 11:47:59 +08:00
nico 6e6de17a8c
update pymilvus version (#27791)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-24 09:28:21 +08:00
nico a693af014f
Add test cases of array (#27603)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-24 09:26:31 +08:00
zhuwenxing 0c33ddb7c5
[skip e2e]Skip creating index when it was already created (#27849)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-23 11:48:09 +08:00
zhuwenxing 5923f109a0
[test]Add concurrent test in ci (#27633)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-23 11:46:21 +08:00
zhuwenxing 38fc652fdd
[test]Reduce some op frequency (#27826)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-23 11:44:22 +08:00
nico 6b33420b3a
modify error code nightly cases (#27788)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-23 10:14:10 +08:00
zhuwenxing 5247ea3fd1
[skip e2e]Update the method whether vector field is indexed (#27820)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-20 14:02:07 +08:00
nico d52a74f78f
add senario: rename collection in a new db (#27400)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-20 10:42:07 +08:00
nico 02d5aeaf2b
Add test cases of scann index (#27784)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-20 09:58:07 +08:00
sre-ci-robot 7858ca62cd
Update Pytest image changes (#27805)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-10-20 09:52:09 +08:00
zhenshan.cao 020ad9a6bc
Rectify wrong exception messages associated with Array datatype (#27769)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2023-10-19 17:24:07 +08:00
dependabot[bot] d3d79c0ff4
Bump urllib3 from 1.26.16 to 1.26.18 in /tests/restful_client (#27754)
Bumps [urllib3](https://github.com/urllib3/urllib3) from 1.26.16 to 1.26.18.
- [Release notes](https://github.com/urllib3/urllib3/releases)
- [Changelog](https://github.com/urllib3/urllib3/blob/main/CHANGES.rst)
- [Commits](https://github.com/urllib3/urllib3/compare/1.26.16...1.26.18)

---
updated-dependencies:
- dependency-name: urllib3
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-19 07:20:09 +08:00
aoiasd 177d0351ec
fix unstable unit test of delete (#27738)
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
2023-10-19 07:18:16 +08:00
sre-ci-robot eff773aa9b
Update Pytest image changes (#27739)
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2023-10-18 19:10:11 +08:00
nico 9ed3cfd925
add test cases (#27376)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-17 14:16:08 +08:00
Sheldon 217e5224db
add gpu support (#27427)
add gpu support

Signed-off-by: Sheldon <chuanfeng.liu@zilliz.com>
2023-10-17 11:44:09 +08:00
nico 5dbcdf777d
update pymilvus verison (#27724)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-17 10:38:10 +08:00
nico 76bb0a7bd8
update pymilvus version and modify Error code & msg improvement (#27609)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-16 09:16:07 +08:00
zhuwenxing 6a2b16fd6c
[skip e2e]Fix get image tag for 2.2.0 branch (#27674)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-12 18:03:36 +08:00
zhuwenxing 5b405ca28a
[skip e2e]Remove compact in concurrent test (#27666)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-12 15:13:34 +08:00
nico 2a7d3d8dd2
Add test cases of COSINE logic optimize (#27647)
Signed-off-by: nico <cheng.yuan@zilliz.com>
2023-10-12 13:01:34 +08:00
ThreadDao 722e3db6b8
Add case query filter json field (#27575)
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
2023-10-11 17:01:40 +08:00
zhuwenxing 1bad19a121
[test]Fix apply chaos condition (#27625)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-11 14:11:33 +08:00
Gao 7a65b6fb85
Limit faiss ivf index build thread num and fix ut (#27567)
Signed-off-by: chasingegg <chao.gao@zilliz.com>
2023-10-11 10:33:33 +08:00
smellthemoon 3b8d1ec5fd
Modify unstable ut (#27602)
Signed-off-by: lixinguo <xinguo.li@zilliz.com>
Co-authored-by: lixinguo <xinguo.li@zilliz.com>
2023-10-10 20:01:32 +08:00
zhuwenxing 11ddb7c794
[skip e2e]Fix get image when short tag is out of date (#27599)
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2023-10-10 16:19:38 +08:00
Bennu 211880f0da
update e2e for log archive (#27585)
Signed-off-by: Bennu-Li <yunmei.li@zilliz.com>
2023-10-10 16:17:34 +08:00
nico f9137d880b
Modify nightly test cases (#27517)
Signed-off-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
Co-authored-by: zilliz <zilliz@zillizdeMacBook-Pro.local>
2023-10-10 11:53:34 +08:00