Commit Graph

1195 Commits (f80c592679b9c147a706580080f3868876c0aa99)

Author SHA1 Message Date
groot f80c592679 fix #2768 (#2809)
* fix #2752

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix #2768

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo again

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-18 15:24:10 +08:00
cqy123456 01437cef39
Fix warning master (#2894)
* fix clean unused variable warning in knowhere

Signed-off-by: cqy <yaya645@126.com>

* clean unused variable warning in knowhere

Signed-off-by: cqy <yaya645@126.com>

* clean unused variable warning in knowhere

Signed-off-by: cqy <yaya645@126.com>

* clean unused variable warning in knowhere

Signed-off-by: cqy <yaya645@126.com>

* fix konwhere warning

Signed-off-by: cqy <yaya645@126.com>
2020-07-18 04:47:29 +00:00
groot 708bad368a
segment writer (#2873)
* redefine SegmentWriter

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* redefine SegmentWriter

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* mem insert

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* unittest

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix some issues

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* segment reader

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* segment writer

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove files

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* remove code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* merge

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix merge

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* get entities

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-17 20:53:45 +08:00
Cai Yudong 771585ba0c
use BlockingQueue in JobMgr (#2885)
* using BlockingQueue in JobMgr

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-17 09:37:00 +08:00
cqy123456 52ab18fe0e
opt faiss build (#2883)
* opt faiss build

Signed-off-by: cqy <yaya645@126.com>
2020-07-17 09:34:34 +08:00
XuanYang-cn 96e9ef235d Add some cpp unittests about scheduler algorithm (#2888)
* add some testcases

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* reformat code

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
(cherry picked from commit 8135cee414)
2020-07-16 19:49:08 +08:00
XuanYang-cn 7a39a00498
Fix Prometheus rebuild problem (#2878)
* Solve prometheus repeatedly build problem

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* recover build.sh

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* refactor build.sh

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* altering changelog

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

* rm not-useful comments

Signed-off-by: yangxuan <xuan.yang@zilliz.com>

Co-authored-by: yangxuan <xuan.yang@zilliz.com>
2020-07-16 19:45:24 +08:00
BossZou 285f849137
(db/snapshot) Add snapshot DB unittest (#2856)
* (snapshot) Add snapshot DB unittest

Signed-off-by: yhz <413554850@qq.com>

* Optimize mock db

Signed-off-by: yhz <413554850@qq.com>

* correct server context file name

Signed-off-by: yhz <413554850@qq.com>
2020-07-16 08:06:34 +00:00
XuPeng-SH 3dddbb72f7
(db/snapshot): update size related logic (#2877)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update size logic related ut

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): rollback if operation is not done

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): clean store

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some dependency

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-16 15:33:56 +08:00
cqy123456 38dfdf4034
# 2828 opt faiss build (#2855)
* add FAISS_USE_FLOAT16

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix faiss build

Signed-off-by: cqy <yaya645@126.com>

Co-authored-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-16 09:03:26 +08:00
Cai Yudong 1d9ccd9bb7
add MILVUS_SUPPORT_SPTAG for some code (#2866)
* add MILVUS_SUPPORT_SPTAG for some code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use knowhere::IndexEnum in db

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* keep EngineType order

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 17:42:44 +08:00
XuPeng-SH 5bf9b8f030
(db/snapshot): Update row count related logic (#2862)
* (db/snapshot): update for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix bug in NewSegmentOperation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove dummy print

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add some test for row count

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-15 17:31:00 +08:00
Xiaohai Xu 77cf783d4c
#2802 Add new index: IVFSQ8NR_NM (#2865)
* add ivfsq8nr_nm

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* refactor

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix error

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* [skip ci] remove unused param

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-07-15 16:46:39 +08:00
Cai Yudong d473c7ad2b
snapshot integrate (#2854)
* add test_segment

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update interface GetResPath

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry ci

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update SSSegmentWriter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 14:32:09 +08:00
Cai Yudong 4cb8383775
move index type try2 (#2860)
* move EngineType and MetricType to MetaTypes.h

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* move IndexType

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-15 11:37:05 +08:00
groot 7bd60398a2
redefine SegmentWriter (#2853)
* redefine SegmentWriter

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* redefine SegmentWriter

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-15 02:02:31 +00:00
BossZou a8033a5954
(db/snapshot) Add snapshot DB module (#2851)
* New db impl

Signed-off-by: yhz <413554850@qq.com>

* Add db impl for snapshot

Signed-off-by: yhz <413554850@qq.com>

* Update operations step holders

Signed-off-by: yhz <413554850@qq.com>

* Update snapshot dbimpl & create collection test pass

Signed-off-by: yhz <413554850@qq.com>

* Delete operation pass

Signed-off-by: yhz <413554850@qq.com>

* Add constraints for db table

Signed-off-by: yhz <413554850@qq.com>

* Update index operation steps behavior

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add lock in mysql engine and remove lock in store

Signed-off-by: yhz <413554850@qq.com>

* Index unittest case pass

Signed-off-by: yhz <413554850@qq.com>

* Add merge operation step context

Signed-off-by: yhz <413554850@qq.com>

* Remove constraints in DB and snapshot ut pass

Signed-off-by: yhz <413554850@qq.com>

* update DBImple

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add DBHelper to generate sql & add mock Mem db & snaoshot ut pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add mock db engine

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update DB select API using template for resource

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update snapshot db name and move them under folder meta

Signed-off-by: yhz <413554850@qq.com>

* clang-format

Signed-off-by: yhz <413554850@qq.com>
2020-07-14 19:11:24 +08:00
dwq 6779ee29da
Update sqlite_6_to_4.sql (#2832)
Simplify SQL statements

Signed-off-by: dddddai <853238012@qq.com>
2020-07-14 15:36:20 +08:00
groot 66add7b9d1
remove old api (#2833)
* remove old api

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine insert code

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine code

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-14 09:48:53 +08:00
op-hunter dc31742538
Hnsw sq8 support (#2835)
* modify for SQ8

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* add hnsw-sq8-support

Signed-off-by: cmli <chengming.li@zilliz.com>

* add unittest 4 hnsw_sq8nr and fix several bugs

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-14 09:45:08 +08:00
cqy123456 777c76c87a
Fix rnsg master (#2831)
* fix rnsg ip

Signed-off-by: cqy <yaya645@126.com>

* fix rnsg search in master

Signed-off-by: cqy <yaya645@126.com>
2020-07-14 09:30:26 +08:00
XuPeng-SH e79cbf098e
(db/snapshot): update visitors (#2837)
* (db/snapshot): add more visitors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add some Iterators

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update visitors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add event handler factory

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): process lsn

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): precheck duplicate collection in create collection operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update visitor

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update visitor 2

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update visitor 3

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-13 11:08:30 +00:00
Cai Yudong 0d20f8a9ca
snapshot integrate (#2830)
* update HybridQuery

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add IterateHandler

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* IterateHandler opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add SSSegmentReader

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add src/codecs/snapshot

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update latest code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update SSSegmentReader interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add SSSegmentWriter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update SSSegmentWriter interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest/db build fail

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use SSSegmentReader and SSSegmentWriter in SSDBImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add test_segment

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-13 06:08:15 +00:00
XuPeng-SH 6c5f42f9f1
(db/snapshot): LSN logic change and design EventHandlerFactory (#2815)
* (db/snapshot): add more visitors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add some Iterators

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update visitors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add event handler factory

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): process lsn

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): small change

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): precheck duplicate collection in create collection operation

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-12 14:18:12 +00:00
Xiaohai Xu 141835a7c7
Add SDK support for IVFSQ8NR (#2821)
* add c++ sdk

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* fix clang

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-07-12 20:23:25 +08:00
Cai Yudong 2c3b3a5cfa
snapshot integrate (#2814)
* update HybridQuery

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add IterateHandler

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* IterateHandler opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add SSSegmentReader

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add src/codecs/snapshot

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update latest code

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update SSSegmentReader interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add SSSegmentWriter

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update SSSegmentWriter interface

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update unittest

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix unittest/db build fail

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* use SSSegmentReader and SSSegmentWriter in SSDBImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix clang-format

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix build issue

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-11 13:26:31 +00:00
op-hunter d004d273ad
add unittest 4 hnsw_sq8nr and fix some bug in passing (#2819)
* modify for SQ8

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* add hnsw-sq8-support

Signed-off-by: cmli <chengming.li@zilliz.com>

* make clang-format and update changelog

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

* hide unittest error temporary

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix ut error

Signed-off-by: cmli <chengming.li@zilliz.com>

* add unittest 4 hnsw_sq8nr and fix several bugs

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-11 10:24:34 +00:00
cqy123456 6e16967b83
fix task_search (#2808)
* fix task_search

Signed-off-by: cqy <yaya645@126.com>

* fix unit test

Signed-off-by: cqy <yaya645@126.com>
2020-07-11 15:44:51 +08:00
Xiaohai Xu fce41e738d
#2802 Add new index: IVFSQ8NR (#2805)
* support new index ivfsq8nr

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>

* remove timeout

Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-07-11 13:40:14 +08:00
groot f94592ecdf fix #2752 (#2789)
* fix #2752

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>
(cherry picked from commit d7c47a7905)
2020-07-11 11:18:05 +08:00
XuPeng-SH 9d4febde7f
(db/snapshot): Add some visitors (#2800)
* (db/snapshot): add more visitors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add some Iterators

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update visitors

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-10 16:49:00 +08:00
groot 5857f6401e
rewrite merge manager 1 (#2797)
* rewrite merge manager 1

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* rewrite merge manager 2

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-10 06:07:09 +00:00
op-hunter 7bf3e6e1c3
Hnsw sq8 support (#2799)
* modify for SQ8

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* add hnsw-sq8-support

Signed-off-by: cmli <chengming.li@zilliz.com>

* make clang-format and update changelog

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix lint error

Signed-off-by: cmli <chengming.li@zilliz.com>

* hide unittest error temporary

Signed-off-by: cmli <chengming.li@zilliz.com>

* fix ut error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-10 13:42:24 +08:00
op-hunter b221cd6898 fix a bug of getting wrong nprobe limitation in knowhere on GPU version (#2788)
* fix a bug of getting wrong nprobe limitation in knowhere on GPU version

Signed-off-by: cmli <chengming.li@zilliz.com>

* update changelog and fix build error

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
2020-07-10 09:33:53 +08:00
shengjun.li a8bd2cf4a6 fix too many data copies (#2784)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-09 11:18:37 +08:00
groot e587c28644
rewrite mem manager 1 (#2762)
* rewrite mem manager

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* rewrite mem manager 2

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* refine

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* rewrite mem manager 3

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* merge manager 1

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-09 03:12:44 +00:00
Cai Yudong 523d97af6d
snapshot integrate (#2782)
* update HybridQuery

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add IterateHandler

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* IterateHandler opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-08 15:08:08 +00:00
XuPeng-SH af573f93c9
(db/snapshot): Add some helper visitors (#2777)
* (db/snapshot): add Segment related visitors

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-08 08:56:56 +00:00
Cai Yudong b7d9c2a4db
(db/snapshot) snapshot integrate (#2770)
* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add some APIs for SSDBImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* partially add GetVectorById

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* snapshot opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix typo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update GetVectorByID framework

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename GetResFiles to GetResPath

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update GetVectorByIdSegmentHandler

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add GetEntityByID

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DataType

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ParamField

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update GetEntityByIDSegmentHandler

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* support INT8 and INT16 in GetEntityById

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add GetIDsInSegment

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update FieldType

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add InsertEntities and DeleteEntities

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add HybridQuery

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-07 15:36:38 +00:00
XuPeng-SH 5964adef49
(db/snapshot): Implement operation rollback (#2760)
* (db/snapshot): refactor Operations

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): refactor Operations

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add rollback for operations

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-07 11:38:30 +00:00
Cai Yudong 1b4e49a3f4
snapshot integrate GetEntityByID (#2753)
* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add some APIs for SSDBImpl

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* partially add GetVectorById

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* snapshot opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix typo

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update GetVectorByID framework

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* rename GetResFiles to GetResPath

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update GetVectorByIdSegmentHandler

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* add GetEntityByID

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update DataType

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update ParamField

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-07-07 02:23:04 +00:00
groot 43496d5c0f
add background threads to SSDBImpl (#2751)
* add background threads to SSDBImpl

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* code format

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-07 01:45:58 +00:00
XuPeng-SH a49665fe85
(db/snapshot): add more APIs for Snapshot (#2747)
* (db/snapshot): Add more APIs for Snapshot

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Refactor field element related code

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): fix lint error

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): remove some prints

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-06 11:08:07 +00:00
XuPeng-SH ef8171b90c
(db/snapshot): Bug fix in operations and unittest (#2744)
* (db/snapshot): fix bugs and update UT

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): update Snapshot ToString

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): add DropIndex API

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* (db/snapshot): Add DropIndex API UT

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-07-04 16:02:12 +00:00
shengjun.li 36cb2479ba
Let codec singleton (#2742)
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-07-04 15:25:27 +00:00
JinHai-CN 62e437dc85 Fix compiling error
Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-07-04 16:18:22 +08:00
groot aa549f0fba * #2642 Create index failed caused by server crashed.
Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* changelog

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* #2692 Milvus hangs during multi-thread concurrent search

Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-07-04 15:02:05 +08:00
Jin Hai c594cf11c1 Increase GRPC concurrency (#2671)
* Increase GRPC concurrency

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Add limitation

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compilation error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-07-04 14:55:07 +08:00
groot 3cbb5ceee9 typo
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-04 14:46:06 +08:00
groot 5015557999 search combine configable
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-07-04 14:45:55 +08:00