a11842c05d
optimization for read node sync metadata ( #4556 )
...
* optimize read-write mode sync logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
update 2
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
optimize read node sync logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* update for optimization
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-01-09 14:49:53 +08:00
1d6668156c
use envoy and headless service to get `low latency、high throughput` support ( #4544 )
...
* init deploy
Signed-off-by: sunyaofei <sunyaofei@ke.com>
* deploy with envoy
Signed-off-by: sunyaofei <sunyaofei@ke.com>
* fix markdown format issues
Signed-off-by: sunyaofei <sunyaofei@ke.com>
* configuration piece error fix
Signed-off-by: sunyaofei <sunyaofei@ke.com>
Co-authored-by: sunyaofei <sunyaofei@ke.com>
2021-01-06 03:52:37 +00:00
83800eb232
Meta filter 0111 ( #4538 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-31 13:30:38 +08:00
8db412cccc
enable config reader/writer interval by env variable ( #4529 )
...
* support change reader/writer interval by env variable
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* optimize db query
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-31 13:30:38 +08:00
74e0c373d8
restful api /collections/{collection_name}/partitions (DELETE) didn't work ( #4539 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-31 13:30:38 +08:00
1210296ce2
rm wrong index type ( #4550 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-30 10:27:58 +00:00
d07ae649d5
fix write node snapshot eject logic bug ( #4523 )
...
* fix snapshot eject logic error for write node
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
* fix code static check
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
ee6693d133
add some debug info for readonly node ( #4514 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
068e5449bd
#4511 Insert should be failed if field type not matched ( #4517 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
0ee16cdbba
fix table not exist issue ( #4502 )
...
* fix table not exist issue
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix snapshot policy issue
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
7fd76c4072
#4488 get_entity_by_id() performance is poor in 0.11.0 ( #4489 )
...
* #4488 get_entity_by_id() performance is poor in 0.11.0
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* add changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
4466ebd4ad
modificate name to id data structure in Snapshots ( #4483 )
...
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
002ad231f2
If no build build type is specified, default to release builds ( #4520 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-26 11:53:20 +08:00
f9bec87c39
reduce the index file size of IndexRHNSWFlat ( #4510 )
...
* reduce the index file size of IndexRHNSWFlat
Signed-off-by: cmli <chengming.li@zilliz.com>
* refactor meta info read and write
Signed-off-by: cmli <chengming.li@zilliz.com>
* update unittest of index rhnswflat since Serialize and Load changed
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix Load
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 09:51:34 +08:00
934c90bf26
[skip ci] Update links and fix dead links. ( #4496 )
...
* [skip ci] Update links and fix dead links.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Delete spaces.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Delete spaces.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
2020-12-25 11:55:36 +00:00
1de2d4b8c7
Optimize the process of indexing and querying ( #4500 )
...
* fix knowhere
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix engine
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-24 10:54:21 +08:00
8f4e1d3851
solve server exit stuck problem ( #4452 )
...
* update ThreadPool api
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* update notify position
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* update ThreadPool Stop API
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-12-23 02:54:05 +00:00
fc005d8133
[skip ci] Added a space for readability ( #4465 )
...
Added a space between the heart emoji and the word for better readability.
Signed-off-by: Mark Berger <maberger0811@gmail.com>
2020-12-23 02:47:29 +00:00
a09f17c5ea
add more check during build snapshot ( #4434 )
...
* add more check during build snapshot
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-12-18 07:02:21 +00:00
f96352d374
Fix search when there are multiple vector fields ( #4420 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-18 14:47:51 +08:00
5ca3a65eca
Add new method called EntireRowCount to get count of uid ( #4365 )
...
* Fix may logout memory leak
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Add new method called EntireRowCount to get count of uid
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-18 14:47:51 +08:00
9345db2dd4
[skip ci] Update the foundation name. ( #4438 )
...
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
2020-12-18 06:26:51 +00:00
1a444e8c04
Add flat structured index unittest ( #4473 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-18 14:25:03 +08:00
1c48f7f4e4
Add index statistics ( #4336 )
...
* add statistics info 4 index hnsw
Signed-off-by: lichengming <chengming.li@zilliz.com>
* update code 4 the updated requirements
Signed-off-by: cmli <chengming.li@zilliz.com>
* add interface to index statistics
Signed-off-by: cmli <chengming.li@zilliz.com>
* modify the config item name
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* modify the pure virtual method
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* add lock for statistics
Signed-off-by: cmli <chengming.li@zilliz.com>
* test index statistics and fix errors
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: cqy123456 <yaya645@126.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-12 16:18:55 +08:00
3c2f8954da
Add flat structured index ( #4448 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-11 08:53:40 +00:00
ba7ef9a6f9
Publish image using Docker-in-Docker ( #4441 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 21:04:49 +08:00
8053ac44b5
Change status proto to remove enum ErrorCode and replace it as int type & Remove ErrorMap in Server ( #4399 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-10 15:03:04 +08:00
8375e659cb
add configuration log.rotation_size ( #4435 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2020-12-10 06:16:08 +00:00
33dba268d5
use BitsetView instead of ConcurrentBitsetptr ( #4428 )
...
* use bitsetview instead of concurrentbitsetptr
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
* fix cpplint check
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix gpu
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-10 04:57:08 +00:00
b12309f742
add configuration log.rotation_age ( #4432 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2020-12-10 03:30:15 +00:00
a10c794daf
add Time type ( #4431 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2020-12-10 01:55:36 +00:00
8c9d5b2bf3
Change log filename format ( #4424 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2020-12-09 10:14:22 +00:00
cb4d94c72b
add configuration cluster.node_id ( #4419 )
...
* add configuration cluster.node_id
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
* add valid function for cluster.node_id
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2020-12-09 07:40:39 +00:00
1b14664fa4
Implement new log macro ( #4410 )
...
* save
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
* implement new log macro
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
* support gettid() with glibc 2.0
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
* fix compile warning
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2020-12-09 10:44:42 +08:00
0406f4b438
Add an optional parameter naming 'client_tag' on client constructor in c++ sdk ( #4377 )
...
* Add an optional parameter naming on client constructor in c++ sdk
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix wrong indent
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-09 10:36:31 +08:00
b6e78f700f
pick test cases from 0.11.1 ( #4406 )
...
* pick test cases from 0.11.1
Signed-off-by: zw <zw@milvus.io>
* update version in case
Signed-off-by: zw <zw@milvus.io>
Co-authored-by: zw <zw@milvus.io>
2020-12-08 21:30:14 +08:00
b86822fd81
add mutex in OnReaderTimer ( #4411 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-12-08 12:38:38 +00:00
b964a90226
fix readonly mode crash issue ( #4396 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-12-07 18:46:04 +08:00
d868370c32
Add metrics and put starting process of prometheus and grafana into docker-compose ( #4364 )
...
* Add db_info metrics
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Remove logs from metrics endpoint
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Put starting process of prometheus and grafana into docker-compose
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
* Fix test_segment
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-07 03:16:13 +00:00
0367bf8246
Configure log to output to single file ( #4371 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-07 02:38:10 +00:00
a7a301415e
slice index file into specified size ( #4374 )
...
* slice index file into specified size
Signed-off-by: cmli <chengming.li@zilliz.com>
* define the key string
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-07 09:48:39 +08:00
b213303757
Allow cpplint pass for if-constexpr expression ( #4382 )
...
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-12-07 09:41:55 +08:00
ae787457b4
Convert to relative path in case user needs using this path as toolkit. ( #4345 )
...
* docs: fix c++ client development process.
Signed-off-by: innerNULL <lyt697@outlook.com>
* Convert to relative path in case user needs using this path as toolkit.
Signed-off-by: innerNULL <lyt697@outlook.com>
2020-12-04 10:11:16 +08:00
4f74a68f87
Rename logs.level to log.min_messages ( #4360 )
...
* rename logs.level to log.min_messages
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
* fix ut fail
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2020-12-03 13:09:23 +00:00
1040ad3f26
fix compile error from latest compiler version ( #4359 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-12-03 11:28:20 +08:00
936a300275
Fix deleted docs blacklist size setting error ( #4341 )
...
* Fix deleted docs blacklist size setting error
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Remove clear resource operation when unref snapshot
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Fix error when get delete docs count during generating blacklist
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Add comments for modification
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-02 15:42:56 +08:00
9e011c9f07
Remove log src in index module unittest CMakeLists.txt ( #4339 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
2020-12-02 15:42:56 +08:00
45e9522259
fix crash issue
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-12-01 19:40:31 +08:00
364c19bb9f
C++ sdk sdk_binary needs to update ( #4330 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-01 19:40:31 +08:00
002d339cb8
[skip ci]Delete removed api doc in webserver readme.md ( #4319 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-01 19:40:31 +08:00
XuPeng-SH
sunyaofei
BossZou
yukun
shengjun.li
groot
quicksilver
op-hunter
ireneontheway5
Mark Berger
Wang Xiangyu
FluorineDog
del-zhenwu
inull
peng.xu