milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,180 Commits
135 Branches
115 Tags
565 MiB
Commit Graph

6180 Commits (experimental)

Author SHA1 Message Date
Wang Xiangyu b12309f742
add configuration log.rotation_age (#4432) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2020-12-10 03:30:15 +00:00
Wang Xiangyu a10c794daf
add Time type (#4431) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2020-12-10 01:55:36 +00:00
Wang Xiangyu 8c9d5b2bf3
Change log filename format (#4424) 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2020-12-09 10:14:22 +00:00
Wang Xiangyu cb4d94c72b
add configuration cluster.node_id (#4419) 
* add configuration cluster.node_id

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* add valid function for cluster.node_id

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2020-12-09 07:40:39 +00:00
Wang Xiangyu 1b14664fa4
Implement new log macro (#4410) 
* save

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* implement new log macro

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* support gettid() with glibc 2.0

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* fix compile warning

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2020-12-09 10:44:42 +08:00
yukun 0406f4b438
Add an optional parameter naming 'client_tag' on client constructor in c++ sdk (#4377) 
* Add an optional parameter naming  on client constructor in c++ sdk

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix wrong indent

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-12-09 10:36:31 +08:00
del-zhenwu b6e78f700f
pick test cases from 0.11.1 (#4406) 
* pick test cases from 0.11.1

Signed-off-by: zw <zw@milvus.io>

* update version in case

Signed-off-by: zw <zw@milvus.io>

Co-authored-by: zw <zw@milvus.io>
 2020-12-08 21:30:14 +08:00
XuPeng-SH b86822fd81
add mutex in OnReaderTimer (#4411) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-08 12:38:38 +00:00
XuPeng-SH b964a90226
fix readonly mode crash issue (#4396) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-07 18:46:04 +08:00
yukun d868370c32
Add metrics and put starting process of prometheus and grafana into docker-compose (#4364) 
* Add db_info metrics

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove logs from metrics endpoint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Put starting process of prometheus and grafana into docker-compose

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_segment

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
 2020-12-07 03:16:13 +00:00
BossZou 0367bf8246
Configure log to output to single file (#4371) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-12-07 02:38:10 +00:00
op-hunter a7a301415e
slice index file into specified size (#4374) 
* slice index file into specified size

Signed-off-by: cmli <chengming.li@zilliz.com>

* define the key string

Signed-off-by: shengjun.li <shengjun.li@zilliz.com>

Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-07 09:48:39 +08:00
BossZou b213303757
Allow cpplint pass for if-constexpr expression (#4382) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
 2020-12-07 09:41:55 +08:00
inull ae787457b4
Convert to relative path in case user needs using this path as toolkit. (#4345) 
* docs: fix c++ client development process.

Signed-off-by: innerNULL <lyt697@outlook.com>

* Convert to relative path in case user needs using this path as toolkit.

Signed-off-by: innerNULL <lyt697@outlook.com>
 2020-12-04 10:11:16 +08:00
Wang Xiangyu 4f74a68f87
Rename logs.level to log.min_messages (#4360) 
* rename logs.level to log.min_messages

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* fix ut fail

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2020-12-03 13:09:23 +00:00
XuPeng-SH 1040ad3f26
fix compile error from latest compiler version (#4359) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-03 11:28:20 +08:00
BossZou 936a300275 Fix deleted docs blacklist size setting error (#4341) 
* Fix deleted docs blacklist size setting error

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Remove clear resource operation when unref snapshot

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix error when get delete docs count during generating blacklist

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Add comments for modification

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-12-02 15:42:56 +08:00
BossZou 9e011c9f07 Remove log src in index module unittest CMakeLists.txt (#4339) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
 2020-12-02 15:42:56 +08:00
peng.xu 45e9522259 fix crash issue 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-01 19:40:31 +08:00
yukun 364c19bb9f C++ sdk sdk_binary needs to update (#4330) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
yukun 002d339cb8 [skip ci]Delete removed api doc in webserver readme.md (#4319) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
shengjun.li 2646ce7c18 fix leak (#4324) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
yukun 8263a50aa3 Setting DSL fields is invalid in restful api, fields are not returned (#4312) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
XuPeng-SH 8341138404 fix memcheck leak issue (#4308) 
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
FluorineDog 178289e0bb fix virtual (#4304) 
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
BossZou d7bdcdf0fe Fix 'Illegal instruction' when running index tests at GitHub action (#4294) 
* Fix 'Illegal instruction' when running index tests at GitHub action

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* index module ignore ccache

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* add ill signal

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
yukun 55f38278e2 Program exit abnormally (#4275) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
yukun 10b0073882 It should raise InvalidDsl exception when search with multi vectors (#4255) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-12-01 19:40:31 +08:00
inull d4db732767
docs: fix c++ client development process. (#4334) 
Signed-off-by: innerNULL <lyt697@outlook.com>
 2020-12-01 09:45:13 +00:00
XuPeng-SH ee2b8205a8
Phase 2 of implementation of read-write seperation (#4299) 
* ro mode impl 1

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* ro mode impl 2

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* add TimerContext.h

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* Add Timer in Server

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 2

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 3

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 4

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 5

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 6

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 7

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 8

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 9

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 10

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 11

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 12

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 13

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 14

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 15

Signed-off-by: peng.xu <peng.xu@zilliz.com>

* update for timer integration 16

Signed-off-by: peng.xu <peng.xu@zilliz.com>
 2020-12-01 03:27:17 +00:00
del-zhenwu 63758f40da
add read-write mode in CI (#4278) 
Co-authored-by: zw <zw@milvus.io>
 2020-11-25 16:33:40 +08:00
Wang Xiangyu e04194313a
Rewrite the metrics module (#4249) 
* remove metrics

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* add metric rpc_request_total

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* add ScopedTimer and metric operation_lantency_seconds

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Add metrics endpoint in httpserver

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add return string in metrics endpoint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Add SystemInfo

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add SystemInfoCollector

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* clang-format

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Fix client sdk simple

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add systeminfo metric cpu_utilization_ratio

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Add SystemInfoCollector

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add metric cache_gets_total, cache_hits_total

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* update metric rpc_request_total

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Cpu temperature return nan if not right

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* add prefix for all metrics, add metric valid range

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Add range annotation

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* remove config metric

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* update metric network receive and transport

Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>

* Fix cpu utilization

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix test_web

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Fix cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Change helm_branch to 0.12.0

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Remove metrics test cases

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

Co-authored-by: fishpenguin <kun.yu@zilliz.com>
 2020-11-24 17:14:39 +08:00
quicksilver da4e071c19
Use single-quotes instead of double-quotes in jenkinsfile (#4257) 
* Use single-quotes instead of double-quotes in jenkinsfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Use single-quotes instead of double-quotes in jenkinsfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Use single-quotes instead of double-quotes in jenkinsfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

* Use single-quotes instead of double-quotes in jenkinsfile

Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-20 16:18:17 +08:00
yukun 98336c6bf2 improve QueryUtil code (#4247) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-20 11:46:08 +08:00
BossZou c71a16fb8d Remove blacklist index from VecIndex (#4239) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-20 11:46:08 +08:00
shengjun.li 3c181d8f74 remove setting omp thread num (#4244) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-20 11:46:08 +08:00
BossZou bd8b5f25f7 Opt some code (#4238) 
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-20 11:46:08 +08:00
yukun b030f3f5ad Fix metrics (#4237) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-20 11:46:08 +08:00
BossZou 3f53ee3fbe The scalar field value of search result is wrong after deleted (#4209) 
* The scalar field information of search result is wrong after some entities deleted

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code format

Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>

* Fix bitset count passing error

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* code style

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add more db del test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* Add test

Signed-off-by: Yhz <yinghao.zou@zilliz.com>

* [skip ci] add ()

Signed-off-by: Yhz <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-20 11:46:08 +08:00
XuPeng-SH b028d75e17
Phase 1 of implementation of read-write seperation (#4214) 
* (db/snapshot): add SnapshotPolicy

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* (db/snapshot): add some snapshot policy

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* (db/snapshot): add policy factory

Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* add ut

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* implement ut for snapshot policy

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* fix clang format

Signed-off-by: XuPeng-SH <xupeng3112@163.com>

* add some comments

Signed-off-by: XuPeng-SH <xupeng3112@163.com>
 2020-11-14 10:12:12 +08:00
Jin Hai 8605a7f122
Update Mergify config (#4228) 
Signed-off-by: jinhai <hai.jin@zilliz.com>
 2020-11-12 18:24:16 +08:00
Kate Shao fc8da4724f
Remove Hacktoberfest from README.md (#4217) 2020-11-12 16:24:16 +08:00
shengjun.li ba11f8e65a In GPU mode, faiss::LOG should be set though GPU is disabled (#4218) 
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-12 13:04:33 +08:00
groot d16f44c599 merge segments at startup (#4215) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-12 13:04:33 +08:00
yukun c18e70fab3 Restful API error: When the specified partition is retrieved, the partition_tag is not valid (#4206) 
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-12 13:04:33 +08:00
yukun 9d0099ad2d ResfulApi Search return null (#4117) 
* ResfulApi Search return null

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Use milvus::json instead

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* dummy commit

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* cpplint

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-12 13:04:33 +08:00
groot ebd9998bac #4193 Milvus hangs after continually insert to non-exist partition (#4199) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-12 13:04:33 +08:00
yukun 9799bf05f4 [skip ci]Update C++ sdk search interface (#4164) 
* [skip ci]Update C++ sdk search interface

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* Must_not query check failed in dsl

Signed-off-by: fishpenguin <kun.yu@zilliz.com>

* code format

Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-12 13:04:33 +08:00
groot 247a9544fc #4154 Incorrect collection data size when row count larger than 2610000 (#4155) 
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-12 13:04:33 +08:00
BossZou 3e1ab51367 Set synchronous = NORMAL for sqlite (#4120) 
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
 2020-11-12 13:04:33 +08:00