1f5850a4a7
close lockfile when server stop ( #3737 )
...
* close lockfile when server stop
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
* fix something error
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
3b8a69a3e2
#3756 ignore deleted docs file if it doesnt exist ( #3766 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
b5ffb46d21
fix trace level log files missing ( #3769 )
...
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
2a0bf43445
New operation named MultiSegmentsOperation support multi-segments during flush ( #3733 )
...
* Add multiSegmentsOpera
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* rish test
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Add new operation MultiSegmentsOperation
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Recoveray ut itls
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* fix judeg bug
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
ade8bb3f23
fix config usage ( #3747 )
...
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
41dbcf7986
(db/snapshot): fix GC PartitionCommit ( #3750 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
b62a05cb9b
Improve code of dabloom ( #3694 )
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
52b0181e89
Apply more stale check rules for Operations ( #3721 )
...
* (db/snapshot): Update Operations to handle stale errors
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add some print in ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
82711d6065
rename segment_row_count to segment_row_limit ( #3724 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
dd31d87c4c
GET_PAGE_ENTITY sometimes failed in test_web ( #3735 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
5f9a7405f6
[skip ci] disable two compact cases ( #3731 )
...
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
8a4d8c4d51
add some check to avoid server crash ( #3715 )
...
* add some check to avoid server crash
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* rm useless code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
3b29ae776f
fix delete entity performance issue ( #3667 )
...
* fix delete entity performance issue
Signed-off-by: groot <yihua.mo@zilliz.com>
* force flush for delete
Signed-off-by: groot <yihua.mo@zilliz.com>
* improve delete performance
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix delete performce issue
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix hang
Signed-off-by: groot <yihua.mo@zilliz.com>
* segment row count min limit
Signed-off-by: groot <yihua.mo@zilliz.com>
* merge 0.11.0
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix python test failed
Signed-off-by: groot <yihua.mo@zilliz.com>
* add log
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
be67ef32f9
(db/snapshot): Implement FlushableMappingField for better metadata snapshot ( #3655 )
...
* Update metadata for mappings
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 4
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 5
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 6
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* Update metadata for mappings 7
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): optimize PartitionCommit metadata implementation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): optimize PartitionCommit metadata implementation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update mock logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): small change
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): small change
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
2e564700d7
Fix#3689 Client get stuck if drop collection during creating index ( #3714 )
...
* fix jaccard distance compute
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* edit changelog
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
b2377762d1
fix snapshot not release bug ( #3708 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-17 14:15:56 +08:00
36da3045f6
Set a timeout for a whole job on Github action pipeline ( #3745 )
...
* Archive dev test logs in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-09-15 19:24:28 +08:00
eb6954d506
remove set config case ( #3587 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
13103a6dd4
add log ( #3680 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
aba62ad25f
fix3626 ( #3699 )
...
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
d03a8e4354
(db/snapshot): update LSN logic ( #3682 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
76fa7aa4c6
fix #3672 0.11.0 docker image is 200M larger due to the un-expected installation of openblas ( #3686 )
...
* fix #3672
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix #3672
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: quicksilver <zhifeng.zhang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
b79f9f0775
avoid dabloom warning ( #3674 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
23b9081923
add memory limit check ( #3669 )
...
* add memory limit check
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* format code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* add changelog
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* change the implementation of memory check
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* revert code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* revert code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
1dadc4e4f9
Fix loadcollection memory usage is one times larger than expect ( #3664 )
...
* rm new rearanged_data to avoid additional memory usage
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix cpu version
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix data_ deconstruct twice error
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
8b92021a27
fix nprobe error ( #3658 )
...
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
4882113eb0
set wal lsn to meta ( #3638 )
...
* wal lsn
Signed-off-by: groot <yihua.mo@zilliz.com>
* temp comment
Signed-off-by: groot <yihua.mo@zilliz.com>
* recovery from meta lsn
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
6e3b32e2f6
Clear cache after merge ( #3645 )
...
* rewrite merge code
Signed-off-by: groot <yihua.mo@zilliz.com>
* clear cache after merge
Signed-off-by: groot <yihua.mo@zilliz.com>
* clear cache after drop
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix bug
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest
Signed-off-by: groot <yihua.mo@zilliz.com>
* clear index cache after drop
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
a6ccffc35a
Proto of C++ sdk is different from milvus server ( #3654 )
...
* Fix getEntity when no query_params and payload is provided in webserver
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change entities object to json::array
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Proto of C++ sdk is different from milvus server
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
b2bbf7b847
add build option -rdynamic in CMakeList.txt ( #3632 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
11c68b20c2
rewrite dabloom ( #3629 )
...
* rewrite dabloom
Signed-off-by: groot <yihua.mo@zilliz.com>
* refine code
Signed-off-by: groot <yihua.mo@zilliz.com>
* unittest
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
08d5c145f0
fix building index check ( #3628 )
...
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
4305cfc65f
Fix crash where getting octets information ( #3625 )
...
* Fix crash where getting octets information
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Code format
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
cd414877bf
(db/snapshot): fix InActiveResourcesGCEvent bug ( #3611 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
ae27d94c80
add to check query dim ( #3620 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
e4fcbf96c0
fix aws build error ( #3607 )
...
* fix aws build
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix aws include directories
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
a94c72becd
fix cache not clear bug in ut ( #3595 )
...
* fix cache not clear bug in ut
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* add todo
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
b806440985
Fix getEntity when no query_params and payload is provided in webserver ( #3600 )
...
* Fix getEntity when no query_params and payload is provided in webserver
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Change entities object to json::array
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
feb0cf3daf
update output message if collection is not existed fix #3427 ( #3598 )
...
update changelog
Signed-off-by: Wang Xiangyu <xy.wang@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
4b5a259ac5
refine code for insert mem ( #3593 )
...
* refine code for insert mem
Signed-off-by: groot <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
1a238b1270
Update ConfigMgr::Set behavior ( #3546 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
fc8580760b
Fix ut DeleteEntitiesTest where delete entity failed ( #3589 )
...
* add commit id to ingo log
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Fix ut delete fail
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
7088d721bf
Fix Server crashed during stability test ( #3563 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
1769082846
Fix field_name duplicate problem ( #3548 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
8b778d104f
Opt delete logic ( #3540 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
0dc47e2e95
Normalize http method in web sever ( #3504 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-09-12 15:54:55 +08:00
6a37e3ec71
Update mergify config
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-09-11 10:12:23 +08:00
1790c51db1
add parameter for NGT index ( #3676 )
...
* add NGT index
Signed-off-by: fenglv <fenglv15@mails.ucas.ac.cn>
2020-09-10 21:01:46 +08:00
b72c9d0070
fix: tests/milvus-java-test/pom.xml to reduce vulnerabilities ( #3663 )
...
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-JAVA-COMBEUST-174815
2020-09-09 16:01:19 +08:00
c2459614df
Optimize snapshot GC executor ( #3528 )
...
* Optimize gc event executor (#3465 )
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-09-09 14:52:56 +08:00
Wang Xiangyu
groot
BossZou
XuPeng-SH
Jin Hai
yukun
del-zhenwu
chen qingxiang
XuanYang-cn
quicksilver
Xiaohai Xu
Cai Yudong
shengjun.li
groot
flynn
Snyk bot