Commit Graph

67 Commits (4b996cd6229f345847a371268e257285eb6e3524)

Author SHA1 Message Date
BossZou 5a83ba4e49
Optimize behavior to get file ids from metadata in mishards (#1754) (#1755)
* update mishards get file ids

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update behaviour for getting file ids

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* check default partition

Signed-off-by: yhz <413554850@qq.com>

* remove exception when file id not found

Signed-off-by: yhz <413554850@qq.com>

* Optimize behavior to get file ids from metadata in mishards (fix #1754)

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] Update changlog

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-26 12:28:20 +08:00
BossZou 3c3617fd81
Mishards 070 (#1699)
* update mishards to 0.7.0

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update mishards to 0.7.0

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix search bug and example pass

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add new api

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add segment stat

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix table info issue

Signed-off-by: yhz <413554850@qq.com>

* fix mishards api issue

Signed-off-by: yhz <413554850@qq.com>

* update mishards

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update all_in_one docker images

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* fix delete_by_id param parser & remove some comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update yaml config file

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update all_in_one config

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* remove delete_by_range comments

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update cmd api

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* add warning when search

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update service_handler

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* update shrads requiremtns

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] remove surplus log info

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-20 20:21:11 +08:00
XuPeng-SH b520e60b8a
[skip ci](shards): fix #1679 (#1681)
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-03-17 11:06:51 +08:00
Snyk bot bb6ce0abe1
fix: shards/requirements.txt to reduce vulnerabilities (#1680)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-URLLIB3-559452
2020-03-17 10:30:31 +08:00
XuPeng-SH 4173626088
[skip ci](shards): fix low concurrency issue (#1672)
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-03-17 09:57:36 +08:00
XuPeng-SH 5f2f8bdc8b
[skip ci] (shards) Upgrade Mishards for #1569 (#1570)
* [skip ci](shards): export MAX_WORKERS as configurable parameter

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): skip mishards .env git info

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): support more robust static discovery host configuration

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): update static provider that terminate server if connection to downstream server error during startup

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add topology.py

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add connection pool

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add topology test

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): refactory using topo

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): refactory static discovery using topo

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): refactory kubernetes discovery using topo

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add more test for connection pool

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): export 19541 and 19542 for all_in_one demo

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): check version on new connection

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): mock connections

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* [skip ci](shards): update tests

Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-03-14 13:30:21 +08:00
snyk-bot bdb87db380 fix: shards/requirements.txt to reduce vulnerabilities
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-URLLIB3-559452
2020-03-07 02:46:33 +00:00
quicksilver 5ec1baaede run hadolint with reviewdog (#1060)
* run hadolint with reviewdog

* add LINCENSE in Dockerfile

* run hadolint with reviewdog

* Reporter of reviewdog command is "github-pr-check"

* format Dockerfile

* ignore DL3007 in hadolint
2020-01-16 19:59:26 +08:00
milvus 54435fc03b [skip ci] fix broken links (#985)
Co-authored-by: JackLCL <53512883+JackLCL@users.noreply.github.com>
2020-01-10 19:23:30 +08:00
XuPeng-SH 0a134dab82 Mishards synced to 0.6.0 release (#725)
* [skip ci](shards): update to support milvus 0.6.0

* [skip ci](shards): add show partitions

* [skip ci](shards): add drop partition

* [skip ci](shards): add create partition

* [skip ci](shards): update search for partition

* [skip ci](shards): fix search partion bugs

* [skip ci](shards): update all in one demo

* [skip ci](shards/doc): update image in readme
2019-12-09 10:55:32 +08:00
peng.xu d98e673fdc [skip ci](shards): remove color decorator in log file, fixes #573 2019-11-27 14:53:24 +08:00
peng.xu dc96690a71 [skip ci](shards): format log, fixes #568 2019-11-27 12:57:25 +08:00
peng.xu b734491698 [skip ci](shards): fix search result bug, fixes #564 2019-11-27 10:58:34 +08:00
yhz 2d5b908c05 fix changlog conflict 2019-11-26 18:33:50 +08:00
yhz 55b4acc27b [skip ci]afix shards bug when serch result is empty 2019-11-26 14:40:02 +08:00
peng.xu 10d1f21d59 [skip ci](shards): fix db create engine typo and exception errors 2019-11-26 14:29:20 +08:00
peng.xu 06394c39fd [skip ci](shards): update makefile 2019-11-26 13:43:28 +08:00
peng.xu 646802e53f [skip ci](shards): update git ignore and docker ignore 2019-11-26 13:36:27 +08:00
peng.xu e2e6cb11b3 [skip ci](shards): update Makefile for all in one with mysql 2019-11-26 13:36:00 +08:00
peng.xu 8b00b11fe5 [skip ci](shards): fix bug in search 2019-11-26 13:35:02 +08:00
peng.xu 2cce773589 [skip ci](shards): add all_in_one_with_mysql 2019-11-26 13:34:32 +08:00
peng.xu ba50927d6e [skip ci](shards): bug fix for mysql startup 2019-11-26 11:31:50 +08:00
peng.xu 046c5543b8 [skip ci] (doc/shards): update doc and demo 2019-11-21 13:59:41 +08:00
yhz 3d788fce0a update requirements 2019-11-20 11:57:29 +08:00
yhz 692b211031 update requirements only pymilvus 2019-11-20 11:51:23 +08:00
yhz 359197eaaf update requirements.txt 2019-11-20 11:35:36 +08:00
yhz b552b77a7e [skip ci] add comments in shards 2019-11-20 10:53:28 +08:00
yhz 2f8be3d058 finish results reduce in mishards 2019-11-20 10:47:52 +08:00
yhz 83d9bf6966 modify shards for v0.5.3 2019-11-20 10:47:31 +08:00
赖龙 b36905055b update add configurable DB settings 2019-11-18 17:25:38 +08:00
jielinxu 285788eba8
[skip ci] Add link to CN README 2019-11-12 19:06:51 +08:00
jielinxu eedb67270d
[skip ci] Update README_CN 2019-11-12 19:04:35 +08:00
jielinxu 4493a6248d
[skip ci] Create Mishards README 2019-11-12 18:55:32 +08:00
peng.xu b7030040b0 (shards/refactor): remove start_services.yml 2019-11-07 14:08:17 +08:00
peng.xu ca3447fae2 (shards/refactor): remove README.md under kubernetes_demo 2019-11-07 14:06:05 +08:00
peng.xu 066952ca23 (shards): remove build.sh 2019-11-07 14:01:18 +08:00
peng.xu df8a018549 (shards): all all missing changes after pick-cherry from xupeng's branch 2019-11-06 17:01:16 +08:00
peng.xu 013566dec4 (shards): clean cluster 2019-11-06 16:55:43 +08:00
peng.xu 275462eaf9 (shards): update cn doc 2019-11-06 16:55:38 +08:00
peng.xu 13c445ccaa (shards): update makefile for cluster 2019-11-06 16:55:26 +08:00
peng.xu 58a31cfe22 (shards): update makefile 2019-11-06 16:55:08 +08:00
peng.xu f05f7b94df (mishards): update for tutorial and all_in_one yml 2019-11-06 16:53:01 +08:00
peng.xu 084215b248 (mishards): update for makefile 2019-11-06 16:52:15 +08:00
peng.xu 2205d0129e (mishards): add Makefile 2019-11-06 16:52:04 +08:00
peng.xu 4167cecc9f changes for code style check 2019-11-06 16:51:55 +08:00
peng.xu 3403dcc5a8 update kubernetes demo for changes 2019-11-06 16:51:33 +08:00
peng.xu 7830809684 update CN tutorial 2019-11-06 16:50:54 +08:00
peng.xu 3c38ac29da update env example 2019-11-06 16:50:45 +08:00
peng.xu c2400f3167 change all_in_one.yml for updated source changes 2019-11-06 16:50:31 +08:00
peng.xu 9f52316704 change static discovery init from env 2019-11-06 16:49:36 +08:00