Commit Graph

5262 Commits (b458034ad514a0cd739ec599667bfc9441225d55)

Author SHA1 Message Date
HesterG ba191b263a
rename table_schema_array ()
Signed-off-by: HesterG <hestergong@gmail.com>
2020-04-22 12:01:01 +08:00
Jin Hai aca299166c
Merge pull request from mileyzjq/code_polish
Fix unused code and clarify params
2020-04-22 11:59:29 +08:00
Peng Gao f7351e7482 Delete CommandDto class and remove file CmdDto.hpp
Signed-off-by: Peng Gao <peng.gao.dut@gmail.com>
2020-04-22 11:46:54 +08:00
sahuang 9e78cde3f2 Fix
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
2020-04-22 10:47:12 +08:00
Lin-gh-Saint 04db47fa66
fix warning: no return statement ()
Signed-off-by: Lin-gh-Saint <linguanhaohyq@gmail.com>
2020-04-22 10:03:11 +08:00
HesterG 68f7a0fa77
rename table_schema to collection_schema ()
Signed-off-by: HesterG <hestergong@gmail.com>
2020-04-22 10:02:19 +08:00
Accagain c7eb9b0fa2
add safty check 4 annoy load index ()
Signed-off-by: cms <chenmaosen0@gmail.com>
2020-04-22 10:00:46 +08:00
nezha2017 00e76219f6
use #include "segment/SegmentWriter.h" instead ()
Signed-off-by: yefu.chen <yefu.chen@zilliz.com>
2020-04-22 09:46:33 +08:00
mileyzjq 72d80aca74 fix unused code and clarify params
Signed-off-by: mileyzjq <mileyzha@gmail.com>
2020-04-21 22:08:50 +08:00
shiyu09 0320259976
rename table_info into collection_info ()
Signed-off-by: shiyu09 <39143280+shiyu09@users.noreply.github.com>
2020-04-21 20:30:16 +08:00
adream307 a3d99de5de
Context-head-file ()
* Context-head-file

Signed-off-by: adream307 <adream307@163.com>

* clang-format

Signed-off-by: adream307 <adream307@163.com>

Co-authored-by: adream307 <adream307@163.com>
2020-04-21 19:04:06 +08:00
del-zhenwu 7b6ff08466
Update timeout strategy in CI ()
Signed-off-by: zw <zw@zilliz.com>
2020-04-21 18:46:21 +08:00
break2017 65a6d8cce7
[skip-ci] remove redundant code in test cases ()
Signed-off-by: break2017 <zhenxiang0708@163.com>
2020-04-21 16:40:02 +08:00
nameczz 5bcd3034c6
remove unused function "normalize_vector" ()
Signed-off-by: nameczz <nameczz@126.com>
2020-04-21 15:53:17 +08:00
bo huang 574ff66c01
add safty check 4 annoy load index ()
Signed-off-by: bo-huang <1013767522@qq.com>
2020-04-21 14:23:42 +08:00
Cai Yudong f039032c8c
Caiyd 1965 unify metric cal ()
*  add metric algorithm benchmark for FAISS

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  add metric algorithm benchmark for NSG

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  add metric algorithm benchmark for ANNOY

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  add metric algorithm benchmark for HNSW

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* code opt

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* calculate average time

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  annoy/nsg/hnsw all use faiss distance algorithm

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  support AVX512/AVX2/SSE42

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

*  fix hnsw ip calculation error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-04-21 14:22:33 +08:00
groot a5eec9d7b4
create index notify ()
* create index notify

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-04-21 14:22:18 +08:00
xudalin0609 9e30c468ff
remove unused var ()
Signed-off-by: xudl <isxudl@163.com>

Co-authored-by: xudl <isxudl@163.com>
2020-04-21 12:13:23 +08:00
Jin Hai 7350337884
Update readme cn ()
* Update README.md

Signed-off-by: Jin Hai <haijin.chn@gmail.com>

* [skip ci] Update README_CN.md

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2020-04-21 11:42:27 +08:00
Jin Hai 23526f0d72
[skip ci] Update README.md ()
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2020-04-21 11:39:58 +08:00
Morry Niu 75ca0d96b6
keep bitset naming consistent ()
Signed-off-by: Xinyao Niu <morryniu123@gmail.com>
2020-04-21 09:40:49 +08:00
del-zhenwu 55cc6be6c9
Set case level ()
* add mishards test stage

Signed-off-by: zw <zw@zilliz.com>

* add clean up

Signed-off-by: zw <zw@zilliz.com>

* Set case level

Signed-off-by: zw <zw@zilliz.com>

* update test timeout

Signed-off-by: zw <zw@zilliz.com>

* remove some test cases

Signed-off-by: zw <zw@zilliz.com>

* udpate

Signed-off-by: zw <zw@zilliz.com>

* remove connect

Signed-off-by: zw <zw@zilliz.com>

* update case

Signed-off-by: zw <zw@zilliz.com>
2020-04-21 01:33:05 +00:00
JUN a2e7a91964
Modify data type in CommonUtil.cpp ()
Signed-off-by: JUN <gujun720@foxmail.com>
2020-04-20 20:42:16 +08:00
Jin Hai 315dac3338
Automerge1 ()
* [skip ci] remove auto-merge git-action

Signed-off-by: jinhai <hai.jin@zilliz.com>

* [skip ci] update CHANGELOG.md

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Stop strip the binary

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Improve code

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix warning

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-20 20:39:22 +08:00
Yaning Zhong 814b8f0c53
move const char* to .cpp file ()
Signed-off-by: ynzhong <zhongyn522@gmail.com>

Co-authored-by: ynzhong <zhongyn522@gmail.com>
2020-04-20 15:41:38 +08:00
Tracy199 c50de3de9a
use TimeRecorder instead of chrono ()
Signed-off-by: Tracy199 <houkx@vip.sina.com>
2020-04-20 01:29:11 +00:00
HuangHua 008f24a7c2
replace metaOptions with meta_options ()
* replace metaOptions with meta_options

Signed-off-by: huanghua <bruce.huang@hotmail.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

Co-authored-by: groot <yihua.mo@zilliz.com>
2020-04-19 08:00:50 +00:00
smiling849 50ddc49332
fix hnsw code format ()
Signed-off-by: Zhonglei Song <szl_84@sina.com>
2020-04-19 12:00:45 +08:00
bigbraver e8f759c22b
code optimize ()
Signed-off-by: bigbraver <bigbraver@qq.com>
2020-04-19 03:54:23 +00:00
Hanyang Ke 25b6efc8e8
fix warning ()
Signed-off-by: kehycs <kehycs@foxmail.com>
2020-04-19 11:12:01 +08:00
anchun 29acf6a594
update some variables in validation utils. ()
Signed-off-by: anchun <nkterry@163.com>
2020-04-18 21:59:26 +08:00
Jin Hai ecafa5ab3f
[skip ci] update mergify ()
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-18 20:38:49 +08:00
zaqwsxqwer111 54fb8ef357
remove pragma once from .cpp files ()
Signed-off-by: zaqwsxqwer111 <2536173042@qq.com>
2020-04-18 20:28:10 +08:00
Jin Hai 930df204f6
Automerge ()
* [skip ci] add mergify config

Signed-off-by: jinhai <hai.jin@zilliz.com>

* [skip ci] update mergify config

Signed-off-by: jinhai <hai.jin@zilliz.com>

* [skip ci] update changelog

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-18 20:23:35 +08:00
mergify[bot] 06335ad80b
Merge pull request from zhangch5n/master
not to printf the log when record type is None
2020-04-18 11:49:07 +00:00
mergify[bot] b97682529a
Merge pull request from JinHai-CN/test1
[skip ci] update change log
2020-04-18 11:31:57 +00:00
Jin Hai e89c231c84
[skip ci] add mergify config ()
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-18 19:22:56 +08:00
zhangchen b02a37d79d not to printf the log when record type is None
Signed-off-by: zhangchen <zhangch5n@163.com>
2020-04-18 17:29:12 +08:00
Rayn Wei 375fd709a9
. ()
Signed-off-by: RyanWei <rainmanwy@gmail.com>
2020-04-18 13:22:47 +08:00
groot 85de706d22
Skip mysql meta schema field width check ()
*  Skip mysql meta schema field width check

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* merge master

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-04-18 10:26:22 +08:00
Jin Hai 59035d9892
Improve code quality ()
* Improve code quality

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Improve code quality

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Improve code quality

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix issue

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>
2020-04-17 21:05:17 +08:00
jinhai b6a8477629 [skip ci] update change log
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-17 12:20:18 +08:00
jinhai 35ab255f59 [skip ci] update change log
Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-17 11:46:28 +08:00
Jin Hai 6b106cbef1
[skip ci] Update CHANGELOG ()
* [skip ci] Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

* [skip ci] update auto merge

Signed-off-by: jinhai <hai.jin@zilliz.com>
2020-04-17 11:45:22 +08:00
del-zhenwu f33ba8f8c9
add mishards test stage ()
* add mishards test stage

Signed-off-by: zw <zw@zilliz.com>

* add clean up

Signed-off-by: zw <zw@zilliz.com>
2020-04-16 23:35:48 +08:00
XuPeng-SH 753c2ff906
Mishards k8s fix ()
* [skip ci](shards): update kubernetes related

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add pending buff in kubernetes provider

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): some bug fix in k8s provider

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): update log

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): update k8s config

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): update Makefile

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-04-16 22:04:47 +08:00
yukun 3e1b2ab4a0
Filtering by numeric scalar fields prototype ()
* Add hybrid request handler

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add C++ sdk for createcollection and insertentities

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add RequestHandler

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add test case for hybrid insert

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix sqlite bug for createcollection

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add HybridQuery Handler DBImpl and ExecBinaryQuery

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add HybridSearch sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add HybridSearch test case

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix HybridSearch bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix HybridSearch crash bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change void* to vector<uint8_t> in Attr codec

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add context and new search task

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add merge for Hybrid

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add AST validation

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add unittest for hybrid

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix hybrid search nq bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix bugs after merge master

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix clang format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix unittest bugs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix Codacy

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix compact unittest bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove grpc request in hybridsearchcontext

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix some codacy quality issue

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix HYBRID_DB_TEST bug

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Annotate new search task

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add Hybrid RPC handler unittest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix logs

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add HybridSearch unittest

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-04-16 14:54:12 +08:00
quicksilver 6a36eaa982
Implement a retry option for helm deploy failed stages in Jenkins Pipeline () 2020-04-16 09:37:29 +08:00
groot 93244a2a79
Limit the insert data batch size ()
*  Limit the insert data batch size

Signed-off-by: groot <yihua.mo@zilliz.com>

* typo

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix unittest

Signed-off-by: groot <yihua.mo@zilliz.com>
2020-04-16 00:18:23 +08:00
Jin Hai 0323aa1aad
Merge 080 ()
*  C++ SDK GetIDsInSegment could not work for large dataset ()

Signed-off-by: groot <yihua.mo@zilliz.com>

*  Fix invalid annoy result ()

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

* : Partition max size should be 4096 ()

Signed-off-by: jinhai <hai.jin@zilliz.com>

* add log ()

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* add log

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix ut

Signed-off-by: groot <yihua.mo@zilliz.com>

* partition limit 4096

Signed-off-by: groot <yihua.mo@zilliz.com>

* fix py test

Signed-off-by: groot <yihua.mo@zilliz.com>

* update server version ()

Signed-off-by: zw <zw@zilliz.com>

* Update to 0.8.0 ()

* Create new branch 0.8.0 and change preload_table to preload_collection

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix format

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

* update helm version

Signed-off-by: zw <zw@zilliz.com>

* Update CHANGELOG

Signed-off-by: jinhai <hai.jin@zilliz.com>

Co-authored-by: zw <zw@zilliz.com>

* fix issue 1901 ()

* fix issue 1901

Signed-off-by: cmli <chengming.li@zilliz.com>

* update change log

Signed-off-by: cmli <chengming.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>

*  ()

* add log

Signed-off-by: yhmo <yihua.mo@zilliz.com>

* fix 

Signed-off-by: groot <yihua.mo@zilliz.com>

* Upgrade mishards to 0.8.0 ()

* update grpc server of milvus & rename table name to collection

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] Skip CI

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] Update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Caiyd 1883 fix rw ()

*  use DiskIO

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* fix logic error

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* retry CI

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

* Update CHANGELOG

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* update changelog

Signed-off-by: yudong.cai <yudong.cai@zilliz.com>

Co-authored-by: JinHai-CN <hai.jin@zilliz.com>

*  Too many data and uid copies when loading files ()

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: Jin Hai <hai.jin@zilliz.com>

* Update mishards configure files ()

* Update web readme

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] update configure files

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] rename table to collection

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Update test.groovy

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Update test.groovy

Signed-off-by: jinhai <hai.jin@zilliz.com>

* Fix lint

Signed-off-by: JinHai-CN <hai.jin@zilliz.com>

* Fix compiling error

Signed-off-by: jinhai <hai.jin@zilliz.com>

Co-authored-by: groot <yhmo@zeronedata.com>
Co-authored-by: shengjun.li <49774184+shengjun1985@users.noreply.github.com>
Co-authored-by: del-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: zw <zw@zilliz.com>
Co-authored-by: op-hunter <ophunter52@gmail.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: BossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
2020-04-15 21:32:20 +08:00