4004e4c545
enhance: Optimize bulk insert unittest ( #33224 )
...
Issue: #22837
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2024-05-24 10:23:41 +08:00
7730b910b9
enhance: Decouple compaction from shard ( #33138 )
...
Decouple compaction from shard, remove dependencies on shards (e.g.
SyncSegments, injection).
issue: https://github.com/milvus-io/milvus/issues/32809
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-05-24 09:07:41 +08:00
6c186112bd
test: add sparse vector datatype for import test ( #33166 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-23 17:57:40 +08:00
00cd88e164
test: Add index names tests for mulitple vectors support ( #33250 )
...
Related issue: https://github.com/milvus-io/milvus/issues/32653
1. Update index name tests
2. remove some time.sleep
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-05-23 14:29:40 +08:00
229a6b942b
test: add check for partition key for import test ( #33253 )
...
see https://github.com/milvus-io/milvus/issues/33237
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-23 14:03:40 +08:00
9ff023ee35
fix: Fix filtering by partition key fails for importing data ( #33274 )
...
Before executing the import, partition IDs should be reordered according
to partition names. Otherwise, the data might be hashed to the wrong
partition during import. This PR corrects this error.
issue: https://github.com/milvus-io/milvus/issues/33237
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-05-23 11:13:40 +08:00
7ab7e3a004
feat: support arm-based image build and pull request ( #33219 )
...
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-05-21 16:54:38 +08:00
555df49d25
[automated] Update Pytest image changes ( #33126 )
...
Update Pytest image changes
See changes:
0d0eda24f8sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-05-20 11:43:37 +08:00
0d0eda24f8
test: modify some test cases ( #33096 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-05-17 15:07:37 +08:00
b560602885
enhance: Store SparseFloatVector into parquet as JSON string ( #33101 )
...
Issue: #22837
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2024-05-17 15:01:37 +08:00
be87ae6424
test: update pymilvus version ( #33079 )
...
issue: #17614
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-05-16 14:53:34 +08:00
4ef163fb70
enhance: Support readable JSON file import for Float16/BFloat16/SparseFloat ( #33064 )
...
Issue: #22837
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2024-05-16 14:47:35 +08:00
6fc00e42d7
fix: Fix binlog import ( #33027 )
...
binlog import should only import into one partition.
issue: https://github.com/milvus-io/milvus/issues/32807
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-05-14 21:45:32 +08:00
ba3b2a91a0
test: Remove useless common types and refine error assert in negative cases ( #33023 )
...
Related issue: #32653
1. Remove some meaningless common types
2. Refine error assertion in negative cases
3. Remove some dup tests
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-05-14 15:03:33 +08:00
4fc7915c70
enhance: unify data generation test APIs ( #32955 )
...
Issue: #22837
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2024-05-14 14:33:33 +08:00
3871009cf5
test: add timeout for GetMetrics grpc interface ( #33024 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-14 10:29:32 +08:00
9e3f3d99f7
test: add timeout for import testcases ( #33006 )
...
add timeout for import testcases
---------
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-13 19:35:32 +08:00
4031abd2fa
enhance: change default partition num to 16 when using partition key ( #32950 )
...
/kind improvement
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-05-13 14:19:31 +08:00
e2332bdc17
enhance: Enable channel exclusive balance policy ( #32911 )
...
issue: #32910
* split replica's node list to channels when create replicas
* balance nodes among channels when node change happens
* implement channel level balance, let balance happens in channel level
Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2024-05-10 17:27:31 +08:00
dc89c6f810
enhance: remove duplicated data generation APIs for bulk insert test ( #32889 )
...
Issue: #22837
including following changes:
1. Add API CreateInsertData() and BuildArrayData() in
internal/util/testutil
2. Remove duplicated test APIs from importutilv2 unittest and bulk
insert integration test
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2024-05-10 15:27:31 +08:00
82a1e1ebe1
test: Update insert data tests and refactor some data gen functions ( #32924 )
...
related issue: #32653
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-05-10 14:57:32 +08:00
e776c807c4
test: add more json datatype in restful test cases ( #32930 )
...
add more json datatype in restful test cases
related to https://github.com/milvus-io/milvus/issues/31051
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-10 14:11:30 +08:00
9a269f1489
test: add import checker to chaos test ( #32908 )
...
add import checker to chaos test
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-10 11:43:30 +08:00
bcdbd1966e
feat: Support sparse float vector bulk insert for binlog/json/parquet ( #32649 )
...
Issue: #22837
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2024-05-07 18:43:30 +08:00
53874ce245
fix: Fix cannot specify partition name in binlog import ( #32730 )
...
issue: https://github.com/milvus-io/milvus/issues/32807
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-05-07 17:19:30 +08:00
b1eacb2ae8
feat: datacoord/node watch based on rpc ( #32036 )
...
issue: https://github.com/milvus-io/milvus/issues/25309
Signed-off-by: yiwangdr <yiwangdr@gmail.com>
2024-05-07 15:49:30 +08:00
29f3cb692b
test:fix retry for network error ( #32804 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-07 14:01:29 +08:00
e1eb03ad0d
test: add testcase for import without meta when enabled dynamic ( #32706 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-05-07 13:59:36 +08:00
4de063ae14
fix: Make the dynamic column optional in parquet import ( #32738 )
...
issue: https://github.com/milvus-io/milvus/issues/32729
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-05-07 11:21:29 +08:00
7da1ca9efb
enhance: check the partition num when creating collection with partition key ( #32670 )
...
issue: #30577
Signed-off-by: SimFG <bang.fu@zilliz.com>
2024-05-07 10:43:29 +08:00
c5191e9b28
[automated] Update Pytest image changes ( #32697 )
...
Update Pytest image changes
See changes:
1a6293df09sre-ci-robot@users.noreply.github.com
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
2024-05-06 21:03:29 +08:00
37a99ca23e
fix: remove flaky sparse integration test ( #32767 )
...
issue: https://github.com/milvus-io/milvus/issues/32766
this test is outdated, thus removing it instead of fixing it.
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-05-06 19:19:29 +08:00
b0ebc50097
test: update test cases ( #32780 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-05-06 17:41:29 +08:00
b9713f96fd
test: Fix a deep copy issue when getting search params ( #32781 )
...
related issue: #32653
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-05-06 17:11:29 +08:00
5bb672d70d
test: Add a new range search test for all indexes and align some index params ( #32724 )
...
related issue: https://github.com/milvus-io/milvus/issues/32653
1. align some default index params
2. add a new range search tests for all indexes and float vectors
---------
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-04-30 17:37:27 +08:00
c70c21e70b
test: modify test cases ( #32727 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-04-30 17:13:31 +08:00
e346714bf2
test: add reruns params in pytest command ( #32720 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-04-30 17:11:26 +08:00
ecd8e52b53
fix: Use default integration case timeout for `TestBinlogImport` ( #32701 )
...
See also #32700
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-29 19:07:27 +08:00
083bd38c77
test: add test cases for code change ( #32289 )
...
issue: #31368
Signed-off-by: binbin lv <binbin.lv@zilliz.com>
2024-04-29 14:29:26 +08:00
4e01591158
enhance: use soft node affinity instead of hard nodeSelector ( #32677 )
...
issue: #32627
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-29 14:25:36 +08:00
1a6293df09
test: update some test cases ( #32687 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-04-29 14:23:26 +08:00
1594122c0a
enhance: Make the dynamic field file optional during numpy import ( #32596 )
...
1. Make the dynamic field file optional during numpy import
2. Add integration importing test with dynamic
3. Disallow file of pk when autoID=true during numpy import
issue: https://github.com/milvus-io/milvus/issues/32542
---------
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2024-04-28 19:39:25 +08:00
8c4fc1e61c
enhance: Close singleton etcd client in integration teardown ( #32664 )
...
Found lots of `failed to updateTimeTick` with error `skip
ChannelTimeTickMsg from un-recognized session 1` The reason was etcd
client became singleton and used last root path in multiple cases are
run in one suite.
This PR add close singleton client invocation to fix this problem.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-28 18:17:26 +08:00
c7807afe71
test: Remove some lower priority e2e test params to reduce tests ( #32654 )
...
related issue: #32653
1. reduce test params in search.py
2. skip all the xfail test to save running time
Signed-off-by: yanliang567 <yanliang.qiao@zilliz.com>
2024-04-28 16:13:25 +08:00
2ab57ca10c
test: remove re-building index ( #32534 )
...
Signed-off-by: zhuwenxing <wenxing.zhu@zilliz.com>
2024-04-28 14:19:25 +08:00
96efa18cf4
test: update test cases ( #32568 )
...
Signed-off-by: nico <cheng.yuan@zilliz.com>
2024-04-28 11:29:28 +08:00
11bde38063
test: [cherry-pick]add test cases for sparse vector ( #32155 )
...
issue : https://github.com/milvus-io/milvus/issues/31483
Signed-off-by: elstic <hao.wang@zilliz.com>
2024-04-28 11:27:28 +08:00
9083f6999d
enhance: bind dependency of miluvs during e2e to dedicated nodes ( #32600 )
...
#32627
Signed-off-by: Liang Huang <sammy.huang@zilliz.com>
2024-04-26 11:43:25 +08:00
0ff7a46e95
fix: [skip e2e] Disable compaction for balance integration test ( #32603 )
...
See also #31468
Balance test suite may assert segment number based on test setup.
However the compaction may reduce the number and cause test cases
unstable.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2024-04-25 16:55:23 +08:00
8a1017a152
enhance: add helpers to parse sparse float vector in JSON ( #32543 )
...
issue: #29419
added helper functions to parse JSON representation of sparse float
vectors, will be used by both the restful server and the import utils.
Signed-off-by: Buqian Zheng <zhengbuqian@gmail.com>
2024-04-25 14:47:24 +08:00
Cai Yudong
yihao.dai
zhuwenxing
yanliang567
sammy.huang
sre-ci-robot
nico
binbin
SimFG
wei liu
yiwangdr
Buqian Zheng
congqixia
elstic