milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
15,223 Commits
169 Branches
151 Tags
612 MiB
Commit Graph

15223 Commits (perf)

Author SHA1 Message Date
bigsheeper c28f1a24f8
Disable cgo pool in QueryNode (#19501) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-09-28 16:51:50 +08:00
bigsheeper e5a67682ef
Fix Cgo lock os thread failed (#19148) (#19487) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Co-authored-by: Xiaofan <83447078+xiaofan-luan@users.noreply.github.com>
Co-authored-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-09-28 10:58:54 +08:00
Jiquan Long 0ecf2045ed
Fix dml stream leakage in Proxy (#19486) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-09-27 20:56:54 +08:00
bigsheeper ec5c2c03f5
Set cgopool's ExpiryDuration to infinite duration (#19465) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-09-27 19:42:56 +08:00
XuanYang-cn fe2e3dcf4f
Cherry Pick of SyncSegments (#19312) (#19476) 
Add a SyncSegments to sync meta between DN and DC
Add SyncSegments into proto (#19312)

See also: #19072

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
 2022-09-27 18:16:54 +08:00
aoiasd b85118cc03
Fix queryCoord init deadlock when restart (#19402) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-09-27 12:00:54 +08:00
aoiasd 6e9c8f7cf3
Optimize large memory usage of InsertRecord (#19197 #19245) (#19421) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-09-27 11:50:56 +08:00
sre-ci-robot 2753e05457
Update Pytest image changes (#19426) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2022-09-26 18:04:57 +08:00
Cai Yudong e5f70676ac
Ignore cases when comparing metric type in segcore (#19436) 
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
 2022-09-26 17:54:53 +08:00
binbin 4afb909b89
Upgrade pymilvus version (#19406) 
Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>

Signed-off-by: Binbin Lv <binbin.lv@zilliz.com>
 2022-09-26 09:20:54 +08:00
congqixia 0375e8029f
Fix L2 string test case for 2.1 branch (#19391) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-23 12:30:52 +08:00
Enwei Jiao 4798fa789c
fix test_compact_manual_and_auto random failed (#19371) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-09-22 19:18:51 +08:00
Xiaofan 546d0887d5
Fix garbage collection on the wrong path (#19353) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-09-22 14:10:52 +08:00
Jiquan Long a6c28cd713
Set default slice size for scalar index (#19326) 
Signed-off-by: longjiquan <jiquan.long@zilliz.com>

Signed-off-by: longjiquan <jiquan.long@zilliz.com>
 2022-09-22 11:36:51 +08:00
jingkl a0ab90eade [cherry-pick]Add the string testcase 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-09-21 14:50:03 +08:00
congqixia 268b0d989e
Handle multiple parquet RowGroup/Column (#19309) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-21 14:20:52 +08:00
congqixia 3c3ba55cd7
Fix bloom filter size not match (#19173) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-13 17:18:30 +08:00
wei liu 4078f45449
Add describe in ci logs (#18983) (#19131) 
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
(cherry picked from commit 1bb2fdfbe8)

Co-authored-by: Jenny Li <jing.li@zilliz.com>
 2022-09-13 10:30:31 +08:00
congqixia e9534d5804
Remove debug log in minio chunk manager (#19135) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-13 10:20:33 +08:00
sre-ci-robot 9f8dd3c4aa
Update Pytest image changes (#19136) 
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
 2022-09-10 11:34:36 +08:00
groot 36e333d062
Support input empty string (#19111) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-09-09 18:28:38 +08:00
ThreadDao 6e8d959f76
[test] Update query with bool field case (#19132) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2022-09-09 15:50:37 +08:00
congqixia a99a96691e
Make minioChunkManager ListObject level by level when recursive is true (#19096) (#19112) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-08 17:48:35 +08:00
bigsheeper 4d77b4b721
Schedule index building tasks orderly instead of randomly (#19076) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-09-08 17:28:37 +08:00
groot ea0f57e835
Not allow '$' in collection/partition/field name (#19091) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-09-08 11:22:37 +08:00
congqixia 7b4dde4ac4
Add triggerQueue check for handoff verifyReq (#19064) (#19080) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-07 18:18:34 +08:00
NicoYuan1986 7affd9399d
Fix the error of the search case reporting unmatched limit (#19045) 
Signed-off-by: “nico” <cheng.yuan@zilliz.com>

Signed-off-by: “nico” <cheng.yuan@zilliz.com>
 2022-09-06 19:25:13 +08:00
zhenshan.cao 815b4d26b8
Execute triggerTask in order of generation time (#19060) 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2022-09-06 19:23:14 +08:00
congqixia 1d8d9195ff
Set insert&stats binlog timestamp range (#19005) (#19010) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-06 09:53:12 +08:00
ThreadDao 4043a37cf2
[test] Add load balance verify in querynode scale test (#19028) 
Signed-off-by: ThreadDao <yufen.zong@zilliz.com>

Signed-off-by: ThreadDao <yufen.zong@zilliz.com>
 2022-09-06 09:03:14 +08:00
congqixia a67e2c071b
Use segment statslog instead of separate statslog (#18991) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-05 19:19:11 +08:00
Jenny Li c955860320
[skip e2e] Add push for 2.*.* (#19021) 
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
 2022-09-05 18:33:11 +08:00
congqixia cf36cebdc8
Unify rootPath in configs and ChunkManager (#18996) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-05 15:55:11 +08:00
bigsheeper 853793ad40
Make DescribeCollection return collectionName (#19002) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-09-02 19:25:00 +08:00
Enwei Jiao e9410d8059
fix restart querycoord blocking issue (#18801) (#18947) 
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
 2022-09-02 16:27:01 +08:00
congqixia 8286afa5db
Add InvalidNodeID logic to remove segments from offline segments (#18975) (#18990) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-09-02 16:06:59 +08:00
Xiaofan 494445b406
Fix RocksMQ flaky test (#18953) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-09-01 16:59:03 +08:00
groot b276c1c4fa
Fix random test case failure by empty string (#18934) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-09-01 11:50:58 +08:00
bigsheeper d29c9d638d
Set max read concurrency ratio to improve concurrent read performance (#18919) 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2022-09-01 10:22:58 +08:00
congqixia 41fa06869d
Fix test compact logic and data race (#18937) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-31 19:20:59 +08:00
wei liu 0733aece2d
fix remove offline nodes in watchDmChannel (#18906) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2022-08-30 19:34:57 +08:00
jingkl e1227b343d Add the tescase of insert string with empty 
Signed-off-by: jingkl <jingjing.jia@zilliz.com>
 2022-08-30 15:37:21 +08:00
wei liu a926a7d23a
fix watch dml channel remove offline node (#18886) 
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
 2022-08-30 09:38:57 +08:00
Jenny Li 3de4af4356
Add new CI for 2.1.0 branch (#18889) 
Signed-off-by: Jenny Li <jing.li@zilliz.com>

Signed-off-by: Jenny Li <jing.li@zilliz.com>
 2022-08-29 21:02:56 +08:00
Xiaofan 5e5f64b136
add manual compaction periodically to clean up deleted rocksmq data. (#18895) 
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
 2022-08-29 20:58:56 +08:00
yah01 2c4e20a886
Fix load segment hangs forever (#18844) 
Caused if the context is timeout

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-08-29 19:44:56 +08:00
yah01 9953072d58
Add unit test for case of stream closed (#18858) 
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
 2022-08-29 18:16:56 +08:00
congqixia 2801904e64
Fix DefaultFactory using wrong rootPath config (#18876) (#18884) 
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
 2022-08-29 18:10:56 +08:00
aoiasd 72db64571f
Fix func checkIfLoaded in proxy (#18769) (#18797) 
Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>

Signed-off-by: aoiasd <zhicheng.yue@zilliz.com>
 2022-08-29 16:08:56 +08:00
groot 21ee85455c
Fix #18872 milvus crahsed when inserting empty string(not allow inserting empty string) (#18881) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>

Signed-off-by: yhmo <yihua.mo@zilliz.com>
 2022-08-29 15:52:56 +08:00