b548b38222
Fix the result merging of IVF_PQ IP ( #2955 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-22 09:53:08 +00:00
d4f305aa7b
(db/snapshot) Add root path for snapshot store ( #2945 )
...
* Add root path for snapshot GC
Signed-off-by: yhz <413554850@qq.com>
* Change Fun name from GetResPath to GetRootPath
Signed-off-by: yhz <413554850@qq.com>
2020-07-22 09:00:01 +00:00
0e0a731ddd
fix a bug of annoy search parameter exisitence check ( #2958 )
...
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-22 08:11:59 +00:00
efe1034f5b
(db/snapshot): Update DropAllIndexOperation ( #2947 )
...
* (db/snapshot): update for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bug in NewSegmentOperation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove dummy print
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add some test for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic related ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): rollback if operation is not done
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): clean store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove some dependency
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update for store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update Store.h
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update store related code
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add field element modification operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): change new operation name
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add Segment File Operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): crtp for BaseResource
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add InActiveResourcesGCEvent
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix ut error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): small change
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update snapshot segmentcommit operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update drop all index operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-22 15:39:38 +08:00
b3608e1ae7
snapshot scheduler ( #2961 )
...
* update interface
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add test_ss_job
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update Query
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add dir_root for SSSearchJob and SSBuildIndexJob
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-22 06:11:28 +00:00
21ea715b78
fix cuda version requirement ( #2909 )
...
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
2020-07-22 11:04:33 +08:00
097635ecdf
Minor editorial updates. ( #2946 )
...
Signed-off-by: Amy Hong <yun.hong@zilliz.com>
2020-07-21 22:18:56 +08:00
d85b3f95fb
#2890 Fix wrong index size ( #2942 )
...
* fix NM index size
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add raw data size of hnsw_nm and nsg_nm
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-21 09:53:14 +00:00
525257a2d7
scheduler support snapshot ( #2944 )
...
* using BlockingQueue in JobMgr
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update SSDBImpl::HybridQuery
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add QueryTest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add SearchJob interface
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add SSSearchJob and SSSearchTask
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update AddSegmentVisitor
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add SSBuildIndexTask and SSBuildIndexJob
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add SSTestTask
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add test_ss_job and test_ss_task
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update TaskCreator
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-21 09:32:56 +00:00
7ba30c7830
#2890 Fix wrong index size ( #2930 )
...
* fix update index size
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add GetSize() interface 4 SPTAG
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix index size of index hnsw, annoy and nsg
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix clang
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add sdk 4 non-ivf index test
Signed-off-by: cmli <chengming.li@zilliz.com>
* remove std::cout and make clang-format
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix cout
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* checkout sdk
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix binary ivf
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix hnsw
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-21 06:02:44 +00:00
2bfc108f5a
(db/snapshot) Add root path for snapshot GC ( #2936 )
...
* Add root path for snapshot GC
Signed-off-by: yhz <413554850@qq.com>
* Add subfolder db in root path
Signed-off-by: yhz <413554850@qq.com>
2020-07-21 05:26:32 +00:00
6c301be1bf
(db/snapshot): add GC event and implement crtp for base resource ( #2926 )
...
* (db/snapshot): update for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bug in NewSegmentOperation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove dummy print
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add some test for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic related ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): rollback if operation is not done
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): clean store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove some dependency
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update for store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update Store.h
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update store related code
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add field element modification operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): change new operation name
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add Segment File Operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): crtp for BaseResource
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add InActiveResourcesGCEvent
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix ut error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): small change
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-21 02:01:34 +00:00
dc93524df0
refine code ( #2927 )
...
* refine code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* excution engine
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-21 09:40:42 +08:00
88f0f64fd1
[skip ci] Update cases for the resources changed ( #2907 )
...
* update cron on 0.10.1
Signed-off-by: zw <zw@milvus.io>
* enable ivf_pq <ip> search cases on GPU
Signed-off-by: zw <zw@milvus.io>
* [skip ci] debug
Signed-off-by: zw <zw@milvus.io>
* [skip ci] add artifacts
Signed-off-by: zw <zw@milvus.io>
* update shards ci && enable pq case
Signed-off-by: zw <zw@milvus.io>
* update assertion for pq
Signed-off-by: zw <zw@milvus.io>
* disable rnsg: issue #2813
Signed-off-by: zw <zw@milvus.io>
* add binary version in log file name
Signed-off-by: zw <zw@milvus.io>
* enable rnsg case
Signed-off-by: zw <zw@milvus.io>
* [skip ci] Update config cases for the resources changed
Signed-off-by: zw <zw@milvus.io>
* [skip ci] Fix limit
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-07-20 17:50:00 +08:00
e0dfc5e147
add web_impl testcase ( #2920 )
...
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-07-20 15:30:40 +08:00
29fab296b1
Rearrange core cmakelists ( #2900 )
...
* sort out cmake commands in before project
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* update
Signed-off-by: Xiangyu Wang <xy.wang@zilliz.com>
* rearrange core CmakeLists.txt
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix conflict
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* fix bugs on ENABLE_FIU
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: Xiangyu Wang <xy.wang@zilliz.com>
2020-07-20 15:24:00 +08:00
924960b69d
(db/snapshot) Optimize snapshot mock db ( #2896 )
...
* Add mysql time statices
Signed-off-by: yhz <413554850@qq.com>
* Add detail timestamp recorder
Signed-off-by: yhz <413554850@qq.com>
* Optimize snapshot mock DB
Signed-off-by: yhz <413554850@qq.com>
* Remove surplus space
Signed-off-by: yhz <413554850@qq.com>
* Updat meta test
Signed-off-by: yhz <413554850@qq.com>
2020-07-20 05:17:56 +00:00
e8bbe5a322
fix: upgrade com.alibaba:fastjson from 1.2.71 to 1.2.72 ( #2925 )
...
Snyk has created this PR to upgrade com.alibaba:fastjson from 1.2.71 to 1.2.72.
See this package in NPM:
https://www.npmjs.com/package/com.alibaba:fastjson
See this project in Snyk:
https://app.snyk.io/org/cxie/project/2f701ce6-b421-4bbf-aaad-9d2bdb8569e4?utm_source=github&utm_medium=upgrade-pr
2020-07-20 10:28:49 +08:00
f8cb9e3d43
(db/snapshot): add AddSegmentFileOperation ( #2924 )
...
* (db/snapshot): update for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bug in NewSegmentOperation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove dummy print
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add some test for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic related ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): rollback if operation is not done
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): clean store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove some dependency
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update for store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update Store.h
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update store related code
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add field element modification operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): change new operation name
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add Segment File Operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-19 16:11:02 +08:00
482bc53950
(db/snapshot): Update Store ( #2897 )
...
* (db/snapshot): update for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bug in NewSegmentOperation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove dummy print
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add some test for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic related ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): rollback if operation is not done
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): clean store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove some dependency
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update for store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update Store.h
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update store related code
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add field element modification operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): change new operation name
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-18 19:30:45 +08:00
d402322781
add testcase of empty vector insert ( #2850 )
...
* add testcase of empty vector insert
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
* format python code
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
2020-07-18 15:30:51 +08:00
d0018307b8
Add python functional tests about timeout ( #2793 )
...
* Add python tests about param timeout
Signed-off-by: yangxuan <jumpthepig@gmail.com>
* add faiss configure args msg print
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* change assertion conditions
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-18 15:30:27 +08:00
b9380bca24
[0.10.1] update shards ci && enable pq case ( #2804 )
...
* update cron on 0.10.1
Signed-off-by: zw <zw@milvus.io>
* enable ivf_pq <ip> search cases on GPU
Signed-off-by: zw <zw@milvus.io>
* [skip ci] debug
Signed-off-by: zw <zw@milvus.io>
* [skip ci] add artifacts
Signed-off-by: zw <zw@milvus.io>
* update shards ci && enable pq case
Signed-off-by: zw <zw@milvus.io>
* update assertion for pq
Signed-off-by: zw <zw@milvus.io>
* disable rnsg: issue #2813
Signed-off-by: zw <zw@milvus.io>
* add binary version in log file name
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-07-18 15:29:58 +08:00
f80c592679
fix #2768 ( #2809 )
...
* fix #2752
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix #2768
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo again
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-18 15:24:10 +08:00
01437cef39
Fix warning master ( #2894 )
...
* fix clean unused variable warning in knowhere
Signed-off-by: cqy <yaya645@126.com>
* clean unused variable warning in knowhere
Signed-off-by: cqy <yaya645@126.com>
* clean unused variable warning in knowhere
Signed-off-by: cqy <yaya645@126.com>
* clean unused variable warning in knowhere
Signed-off-by: cqy <yaya645@126.com>
* fix konwhere warning
Signed-off-by: cqy <yaya645@126.com>
2020-07-18 04:47:29 +00:00
74aa4cdc04
Set MySQL host ip to 127.0.0.1 in jenkins unittest step ( #2905 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-07-18 10:38:05 +08:00
154c7ba838
Fixed broken links. ( #2902 )
...
Signed-off-by: PahudPlus <haimeng.cai@zilliz.com>
2020-07-17 21:07:30 +08:00
708bad368a
segment writer ( #2873 )
...
* redefine SegmentWriter
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* redefine SegmentWriter
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* refine code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* mem insert
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* unittest
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix some issues
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* segment reader
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* segment writer
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* remove files
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* remove code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* merge
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* fix merge
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* get entities
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-17 20:53:45 +08:00
771585ba0c
use BlockingQueue in JobMgr ( #2885 )
...
* using BlockingQueue in JobMgr
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-17 09:37:00 +08:00
52ab18fe0e
opt faiss build ( #2883 )
...
* opt faiss build
Signed-off-by: cqy <yaya645@126.com>
2020-07-17 09:34:34 +08:00
96e9ef235d
Add some cpp unittests about scheduler algorithm ( #2888 )
...
* add some testcases
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* reformat code
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
(cherry picked from commit 8135cee414
2020-07-16 19:49:08 +08:00
7a39a00498
Fix Prometheus rebuild problem ( #2878 )
...
* Solve prometheus repeatedly build problem
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* recover build.sh
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* refactor build.sh
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* altering changelog
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
* rm not-useful comments
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-16 19:45:24 +08:00
285f849137
(db/snapshot) Add snapshot DB unittest ( #2856 )
...
* (snapshot) Add snapshot DB unittest
Signed-off-by: yhz <413554850@qq.com>
* Optimize mock db
Signed-off-by: yhz <413554850@qq.com>
* correct server context file name
Signed-off-by: yhz <413554850@qq.com>
2020-07-16 08:06:34 +00:00
3dddbb72f7
(db/snapshot): update size related logic ( #2877 )
...
* (db/snapshot): update for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bug in NewSegmentOperation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove dummy print
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add some test for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update size logic related ut
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): rollback if operation is not done
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): clean store
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove some dependency
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-16 15:33:56 +08:00
38dfdf4034
# 2828 opt faiss build ( #2855 )
...
* add FAISS_USE_FLOAT16
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix faiss build
Signed-off-by: cqy <yaya645@126.com>
Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-16 09:03:26 +08:00
1d9ccd9bb7
add MILVUS_SUPPORT_SPTAG for some code ( #2866 )
...
* add MILVUS_SUPPORT_SPTAG for some code
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* use knowhere::IndexEnum in db
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* keep EngineType order
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 17:42:44 +08:00
5bf9b8f030
(db/snapshot): Update row count related logic ( #2862 )
...
* (db/snapshot): update for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix bug in NewSegmentOperation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): remove dummy print
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): Add some test for row count
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-15 17:31:00 +08:00
77cf783d4c
#2802 Add new index: IVFSQ8NR_NM ( #2865 )
...
* add ivfsq8nr_nm
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* refactor
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix error
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* [skip ci] remove unused param
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-07-15 16:46:39 +08:00
d473c7ad2b
snapshot integrate ( #2854 )
...
* add test_segment
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update interface GetResPath
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry ci
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update SSSegmentWriter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 14:32:09 +08:00
4cb8383775
move index type try2 ( #2860 )
...
* move EngineType and MetricType to MetaTypes.h
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move IndexType
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 11:37:05 +08:00
7bd60398a2
redefine SegmentWriter ( #2853 )
...
* redefine SegmentWriter
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* redefine SegmentWriter
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* refine code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-15 02:02:31 +00:00
a8033a5954
(db/snapshot) Add snapshot DB module ( #2851 )
...
* New db impl
Signed-off-by: yhz <413554850@qq.com>
* Add db impl for snapshot
Signed-off-by: yhz <413554850@qq.com>
* Update operations step holders
Signed-off-by: yhz <413554850@qq.com>
* Update snapshot dbimpl & create collection test pass
Signed-off-by: yhz <413554850@qq.com>
* Delete operation pass
Signed-off-by: yhz <413554850@qq.com>
* Add constraints for db table
Signed-off-by: yhz <413554850@qq.com>
* Update index operation steps behavior
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Add lock in mysql engine and remove lock in store
Signed-off-by: yhz <413554850@qq.com>
* Index unittest case pass
Signed-off-by: yhz <413554850@qq.com>
* Add merge operation step context
Signed-off-by: yhz <413554850@qq.com>
* Remove constraints in DB and snapshot ut pass
Signed-off-by: yhz <413554850@qq.com>
* update DBImple
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Add DBHelper to generate sql & add mock Mem db & snaoshot ut pass
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Add mock db engine
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Update DB select API using template for resource
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* Update snapshot db name and move them under folder meta
Signed-off-by: yhz <413554850@qq.com>
* clang-format
Signed-off-by: yhz <413554850@qq.com>
2020-07-14 19:11:24 +08:00
6779ee29da
Update sqlite_6_to_4.sql ( #2832 )
...
Simplify SQL statements
Signed-off-by: dddddai <853238012@qq.com>
2020-07-14 15:36:20 +08:00
66add7b9d1
remove old api ( #2833 )
...
* remove old api
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* refine insert code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* refine code
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-14 09:48:53 +08:00
dc31742538
Hnsw sq8 support ( #2835 )
...
* modify for SQ8
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* add hnsw-sq8-support
Signed-off-by: cmli <chengming.li@zilliz.com>
* add unittest 4 hnsw_sq8nr and fix several bugs
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-14 09:45:08 +08:00
777c76c87a
Fix rnsg master ( #2831 )
...
* fix rnsg ip
Signed-off-by: cqy <yaya645@126.com>
* fix rnsg search in master
Signed-off-by: cqy <yaya645@126.com>
2020-07-14 09:30:26 +08:00
e79cbf098e
(db/snapshot): update visitors ( #2837 )
...
* (db/snapshot): add more visitors
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add some Iterators
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update visitors
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): add event handler factory
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): process lsn
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): fix lint error
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): small change
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): precheck duplicate collection in create collection operation
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update visitor
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update visitor 2
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* (db/snapshot): update visitor 3
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-13 11:08:30 +00:00
0d20f8a9ca
snapshot integrate ( #2830 )
...
* update HybridQuery
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add IterateHandler
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* IterateHandler opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* opt
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add SSSegmentReader
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add src/codecs/snapshot
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update latest code
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update SSSegmentReader interface
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add SSSegmentWriter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update SSSegmentWriter interface
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest/db build fail
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* use SSSegmentReader and SSSegmentWriter in SSDBImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* add test_segment
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-13 06:08:15 +00:00
5c040baf84
[skip ci] Update README_CN
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-07-13 09:55:58 +08:00
6ec09ccb05
[skip ci] Update README
...
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-07-13 09:53:34 +08:00
shengjun.li
BossZou
op-hunter
XuPeng-SH
Cai Yudong
Wang XiangYu
AmyYH
Xiaohai Xu
groot
del-zhenwu
godchen0212
XuanYang-cn
Snyk bot
cqy123456
quicksilver
PahudPlus
dwq
JinHai-CN