9d5d49c95c
fix headers ( #4796 )
...
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
2021-03-10 18:21:39 +08:00
2f15969d18
fix knowhere error ( #4769 )
...
* fix knowhere error
(1) fix hnsw uninitialized variable access
(2) fix memory leak when creating IVFSQ8 on GPU
(3) fix memory leak when querying by IVFSQ8H
(4) fix minor memory leak when building NSG
(5) fix minor memory leak when querying by BinaryFlat
(6) fix memory leak in UT
(7) fix CheckGPUPQParams
(8) fix memory leak in QueryByDistance
(9) fix result merge in QueryByDistance
(10) fix RHNSW::Reset
(11) fix RHNSW max_level
(11) fix memory leak if exception occur
(12) fix mismatch malloc/free new[]/delete[]
(13) fix IVFHNSW load
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix docker
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-03-05 11:03:08 +08:00
7211d5bae4
Hnsw optimization ( #4708 )
...
* remove useless code in hnswalg.h
Signed-off-by: cmli <chengming.li@zilliz.com>
* update the interface hnsw.addPoint, remove the useless parameter
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix unittest error
Signed-off-by: cmli <chengming.li@zilliz.com>
2021-02-09 16:59:49 +08:00
8bb8bc07c0
fix compatibility issus ( #4701 )
...
Signed-off-by: FluorineDog <fluorinedog@gmail.com>
2021-02-08 14:52:10 +08:00
981d8380ee
fix knowhere conf ( #4699 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-07 11:16:15 +08:00
d0d159a094
Update CODEOWNERS
2021-02-07 11:15:03 +08:00
a3d4158fc6
modify bitset ref to value ( #4697 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-05 13:22:18 +00:00
afe19a1a66
remove binary index on avx512 because of the performance ( #4691 )
...
* remove binary index on avx512 because of the performance
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix sub and super
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-04 11:45:56 +08:00
00d0967162
Binary range search ( #4680 )
...
* stash local work, merge remote
Signed-off-by: cmli <chengming.li@zilliz.com>
* add unittest 4 binary range search and test ok
Signed-off-by: cmli <chengming.li@zilliz.com>
* set the default value of radius to be 0 when metric type is superstructure or substructure
Signed-off-by: cmli <chengming.li@zilliz.com>
* update code by review comments
Signed-off-by: cmli <chengming.li@zilliz.com>
2021-02-03 19:13:31 +08:00
94b01282a1
avoid negative zero in Tanimoto ( #4686 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-02-03 10:38:48 +08:00
c5b2d185c3
remove hamming M8 M4 ( #4675 )
...
* remove hamming M8M4
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix the bug of superstructure substructure default
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-01-30 17:53:35 +08:00
31b6701372
Terms of must and must_not together are not working ( #4624 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-01-29 20:51:13 +08:00
2e60da4acc
Using AVX2 or AVX512 in binary distance acculation ( #4649 )
...
* fix binary distance
Signed-off-by: cqy123456 <yaya645@126.com>
* add license
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix binary_distance_knn_hc
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2021-01-29 18:11:22 +08:00
3075213712
add interfaces 4 knowhere configurations ( #4658 )
...
* add interfaces 4 knowhere configurations
Signed-off-by: cmli <chengming.li@zilliz.com>
2021-01-26 09:53:53 +08:00
d64b1dd165
Single query by distance ( #4648 )
...
* IndexFlat::QueryByDistance unittest passed
Signed-off-by: cmli <chengming.li@zilliz.com>
* change the datastructure of DynamicResultSet
Signed-off-by: cmli <chengming.li@zilliz.com>
* unittest of IndexFlat::QueryByDistance and IndexBinaryFalt::QueryByDistance has passed
Signed-off-by: cmli <chengming.li@zilliz.com>
* update the datastructure of DynamicResultSet...
Signed-off-by: cmli <chengming.li@zilliz.com>
* update the interface and the data structure of dynamic result set, compile passed
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix unittest, add test for new data structure, to be debug...
Signed-off-by: cmli <chengming.li@zilliz.com>
* unittest passed
Signed-off-by: cmli <chengming.li@zilliz.com>
* add MapUids
Signed-off-by: cmli <chengming.li@zilliz.com>
* update code by the advise from review
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2021-01-26 09:44:52 +08:00
e644680dd6
remove repo source because ci cannot download source ( #4654 )
...
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
2021-01-23 16:35:40 +08:00
c44cd67577
[skip ci] Update dead links and bootcamp links ( #4617 )
...
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
2021-01-15 02:51:37 +00:00
df500c923e
Add IVF_HNSW index ( #4613 )
...
* Add IVF_HNSW index
Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>
* Fix serialize-load bug
Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>
2021-01-15 10:48:22 +08:00
91a1494b57
Use early stop strategy in K-Means ( #4608 )
...
* Use early stop strategy
Signed-off-by: sahuang <xiaohaix@student.unimelb.edu.au>
2021-01-13 14:30:17 +08:00
bb79e896aa
[skip ci] Update README.md. ( #4589 )
...
* [skip ci] Update README.md.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Update links.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Update the format.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Update.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Update.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Update
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Update
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
2021-01-12 02:59:17 +00:00
32f88b8676
Fix C++ sdk ConstructTopkQueryResult ( #4580 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-01-09 14:49:53 +08:00
a11842c05d
optimization for read node sync metadata ( #4556 )
...
* optimize read-write mode sync logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
update 2
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
optimize read node sync logic
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* update for optimization
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2021-01-09 14:49:53 +08:00
1d6668156c
use envoy and headless service to get `low latency、high throughput` support ( #4544 )
...
* init deploy
Signed-off-by: sunyaofei <sunyaofei@ke.com>
* deploy with envoy
Signed-off-by: sunyaofei <sunyaofei@ke.com>
* fix markdown format issues
Signed-off-by: sunyaofei <sunyaofei@ke.com>
* configuration piece error fix
Signed-off-by: sunyaofei <sunyaofei@ke.com>
Co-authored-by: sunyaofei <sunyaofei@ke.com>
2021-01-06 03:52:37 +00:00
83800eb232
Meta filter 0111 ( #4538 )
...
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-31 13:30:38 +08:00
8db412cccc
enable config reader/writer interval by env variable ( #4529 )
...
* support change reader/writer interval by env variable
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* optimize db query
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-31 13:30:38 +08:00
74e0c373d8
restful api /collections/{collection_name}/partitions (DELETE) didn't work ( #4539 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-31 13:30:38 +08:00
1210296ce2
rm wrong index type ( #4550 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-30 10:27:58 +00:00
d07ae649d5
fix write node snapshot eject logic bug ( #4523 )
...
* fix snapshot eject logic error for write node
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
* fix code static check
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
ee6693d133
add some debug info for readonly node ( #4514 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
068e5449bd
#4511 Insert should be failed if field type not matched ( #4517 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
0ee16cdbba
fix table not exist issue ( #4502 )
...
* fix table not exist issue
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix snapshot policy issue
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
7fd76c4072
#4488 get_entity_by_id() performance is poor in 0.11.0 ( #4489 )
...
* #4488 get_entity_by_id() performance is poor in 0.11.0
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* add changelog
Signed-off-by: yhmo <yihua.mo@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
4466ebd4ad
modificate name to id data structure in Snapshots ( #4483 )
...
Signed-off-by: XuPeng-SH <xupeng3112@163.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 17:36:51 +08:00
002ad231f2
If no build build type is specified, default to release builds ( #4520 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-26 11:53:20 +08:00
f9bec87c39
reduce the index file size of IndexRHNSWFlat ( #4510 )
...
* reduce the index file size of IndexRHNSWFlat
Signed-off-by: cmli <chengming.li@zilliz.com>
* refactor meta info read and write
Signed-off-by: cmli <chengming.li@zilliz.com>
* update unittest of index rhnswflat since Serialize and Load changed
Signed-off-by: cmli <chengming.li@zilliz.com>
* fix Load
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: cmli <chengming.li@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-26 09:51:34 +08:00
934c90bf26
[skip ci] Update links and fix dead links. ( #4496 )
...
* [skip ci] Update links and fix dead links.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Delete spaces.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
* [skip ci] Delete spaces.
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
2020-12-25 11:55:36 +00:00
1de2d4b8c7
Optimize the process of indexing and querying ( #4500 )
...
* fix knowhere
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix engine
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-24 10:54:21 +08:00
8f4e1d3851
solve server exit stuck problem ( #4452 )
...
* update ThreadPool api
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* update notify position
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* update ThreadPool Stop API
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-12-23 02:54:05 +00:00
fc005d8133
[skip ci] Added a space for readability ( #4465 )
...
Added a space between the heart emoji and the word for better readability.
Signed-off-by: Mark Berger <maberger0811@gmail.com>
2020-12-23 02:47:29 +00:00
a09f17c5ea
add more check during build snapshot ( #4434 )
...
* add more check during build snapshot
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* fix format
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-12-18 07:02:21 +00:00
f96352d374
Fix search when there are multiple vector fields ( #4420 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-18 14:47:51 +08:00
5ca3a65eca
Add new method called EntireRowCount to get count of uid ( #4365 )
...
* Fix may logout memory leak
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
* Add new method called EntireRowCount to get count of uid
Signed-off-by: yinghao.zou <yinghao.zou@zilliz.com>
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-18 14:47:51 +08:00
9345db2dd4
[skip ci] Update the foundation name. ( #4438 )
...
Signed-off-by: ireneontheway5 <qingying.hu@zilliz.com>
2020-12-18 06:26:51 +00:00
1a444e8c04
Add flat structured index unittest ( #4473 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-18 14:25:03 +08:00
1c48f7f4e4
Add index statistics ( #4336 )
...
* add statistics info 4 index hnsw
Signed-off-by: lichengming <chengming.li@zilliz.com>
* update code 4 the updated requirements
Signed-off-by: cmli <chengming.li@zilliz.com>
* add interface to index statistics
Signed-off-by: cmli <chengming.li@zilliz.com>
* modify the config item name
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* modify the pure virtual method
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* add lock for statistics
Signed-off-by: cmli <chengming.li@zilliz.com>
* test index statistics and fix errors
Signed-off-by: cmli <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: cqy123456 <yaya645@126.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-12 16:18:55 +08:00
3c2f8954da
Add flat structured index ( #4448 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-11 08:53:40 +00:00
ba7ef9a6f9
Publish image using Docker-in-Docker ( #4441 )
...
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 21:04:49 +08:00
8053ac44b5
Change status proto to remove enum ErrorCode and replace it as int type & Remove ErrorMap in Server ( #4399 )
...
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2020-12-10 15:03:04 +08:00
8375e659cb
add configuration log.rotation_size ( #4435 )
...
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2020-12-10 06:16:08 +00:00
33dba268d5
use BitsetView instead of ConcurrentBitsetptr ( #4428 )
...
* use bitsetview instead of concurrentbitsetptr
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
* fix cpplint check
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix gpu
Signed-off-by: fluorinedog <fluorinedog@gmail.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
2020-12-10 04:57:08 +00:00
FluorineDog
shengjun.li
op-hunter
Wang Xiangyu
yukun
cqy123456
op-hunter
ireneontheway5
Xiaohai Xu
XuPeng-SH
sunyaofei
BossZou
groot
quicksilver
Mark Berger