fe2595fa38
#1686 API search_in_files cannot work correctly when vectors is store… ( #1701 )
...
* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition
Signed-off-by: yhmo <yihua.mo@zilliz.com>
* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-20 12:14:07 +08:00
5950deddfc
#1678 remove CUSTOMIZATION macro ( #1707 )
...
* #1678 remove CUSTOMIZATION macro
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* disable faiss_benchmark
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-20 10:24:27 +08:00
588ef95d76
Caiyd refactor knowhere ( #1687 )
...
* add new knowhere
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* build pass
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* rename algo
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* update...
Signed-off-by: xiaojun.lin <xiaojun.lin@zilliz.com>
* add archive
Signed-off-by: Nicky <nicky.xj.lin@gmail.com>
* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* all unittest pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* test_binary pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move knowhere into namespace milvus
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update hnsw
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ConfAdapterMgr
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ExecutionEngineImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move SetBlacklist/GetBlacklist to VecIndex
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update VectorAdapter and rename SearchById to QueryById
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update interface in ExecutionEngineImpl
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* milvus build pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* milvus IDMAP sdk_simple pass
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_server
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_schedule
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version Milvus build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update BinaryIVF BuildAll
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update VecIndexFactory
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update ConfAdapter
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* update changelog
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix knowhere unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix SPTAG unittest
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version unittest build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix db_test
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_engine
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_delete
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix CPU version build issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change BinarySet key back
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* change IndexType to string, and add compatible API for 0.7.0
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix IndexHNSW build warning
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix clang-format
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix test_cache
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix write_index error
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* code clean
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix unittest
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
Co-authored-by: Nicky <nicky.xj.lin@gmail.com>
Co-authored-by: xiaojun.lin <xiaojun.lin@zilliz.com>
2020-03-19 19:24:20 +08:00
72ad100a90
modify bitset from deque to vector ( #1696 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-19 16:16:14 +08:00
fdd51400d2
#1660 support IVFPQ CPU delete ( #1695 )
...
* support IVFPQ CPU delete
Signed-off-by: lichengming <chengming.li@zilliz.com>
* update CHANGELOG.md
Signed-off-by: lichengming <chengming.li@zilliz.com>
Co-authored-by: lichengming <chengming.li@zilliz.com>
2020-03-19 12:26:03 +08:00
504a9e30ab
Optimize config cpu_cache_capacity / gpu_cache_capacity setter ( #1572 ) ( #1629 )
...
* add gpu cache config handler
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* remove cpu/gpu cache mgr from Config class by using cache config handler (fix #1572 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* remove 0.8.0 from config version map
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* clean config header reference
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix bug in web readme
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* reduce gpu config handler to gpu resources handler
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* add engine config
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify handler hook(fix #1572 )
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* update changlog
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* initalize value in handler by config default
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* code style format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* fix compile error in release mode
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* resolve faiss blas threshold init in DBWrapper
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* modify cache header
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* remove comments
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* order headers
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* convert gpu res config to lower case
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* CI retry
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* adjust header order in cpu cache mar file
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* improve config test case
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
* code format
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-19 10:17:53 +08:00
616fd13612
Add more information to INSTALL.md ( #1694 )
...
* [skip ci] Update README_CN.md
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
* [skip ci] Update INSTALL.md.
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-03-19 10:17:31 +08:00
1543f8dc37
#1653 IndexFlat performance improvement for NQ < thread_number ( #1690 )
...
* optimize sse
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* optimizer BinaryDistance
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* fix superstructure
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-18 18:27:57 +08:00
55ecfd5930
#1663 PQ index parameter m validation ( #1677 )
...
* #1663 PQ index parameter m validation
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failure
Signed-off-by: groot <yihua.mo@zilliz.com>
* fix unittest failure
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-18 18:26:38 +08:00
400446351c
[skip ci] Update README_CN.md ( #1684 )
...
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-03-17 18:45:55 +08:00
b520e60b8a
[skip ci](shards): fix #1679 ( #1681 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-03-17 11:06:51 +08:00
8644d341c4
#1656 Add timeout for whole Jenkins job ( #1676 )
...
* Increase memory limit in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Add pod tolerations to slave pods
* Refactor ci/scripts/build.sh
* Refactor ci/scripts/build.sh
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Add timeout for whole Jenkins job
* cuda yum repository temporarily disabled
2020-03-17 10:36:24 +08:00
bb6ce0abe1
fix: shards/requirements.txt to reduce vulnerabilities ( #1680 )
...
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-URLLIB3-559452
2020-03-17 10:30:31 +08:00
4173626088
[skip ci](shards): fix low concurrency issue ( #1672 )
...
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-03-17 09:57:36 +08:00
21c7b8f09c
Add structure cases ( #1675 )
...
* enable nsg case
Signed-off-by: zhenwu <zw@zilliz.com>
* enable sub/superstructure
Signed-off-by: zhenwu <zw@zilliz.com>
2020-03-16 21:33:25 +08:00
59dab6cb84
#1653 IndexFlat performance improvement for NQ < thread_number ( #1674 )
...
* Optimize index flat L2/IP for SSE
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* parallel optimization
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* fix threshold
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
* add changelog
Signed-off-by: sahuang <xiaohai.xu@zilliz.com>
Co-authored-by: sahuang <xiaohai.xu@zilliz.com>
2020-03-16 21:32:05 +08:00
3de34d3831
#1619 ( #1620 )
...
* update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
* update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
* update
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-16 19:33:28 +08:00
51cfc8978a
enable nsg case ( #1670 )
...
Signed-off-by: zhenwu <zw@zilliz.com>
2020-03-16 19:32:14 +08:00
332de07944
Add GUI link to readme ( #1669 )
...
* [skip ci] Update README.md.
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
* [skip ci] Update README_CN.md.
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
* [skip ci] Update README_JP.md.
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-03-16 16:26:21 +08:00
802d62eb24
#1651 Check validity of dimension when collection metric type is binary one ( #1666 )
...
* #1648 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1646 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1646 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1651 Check validity of dimension when collection metric type is binary one
Signed-off-by: groot <yihua.mo@zilliz.com>
* typo
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2020-03-16 16:26:12 +08:00
6c826c1308
#1648 The cache cannot be used all when the type is binary ( #1648 )
...
* #1648 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1646 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
* #1646 The cache cannot be used all when the type is binary
Signed-off-by: groot <yihua.mo@zilliz.com>
2020-03-15 20:45:11 +08:00
1b60e3bca6
Refactor CI workflow ( #1657 )
...
* Increase memory limit in Jenkins CI
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
* Add pod tolerations to slave pods
* Refactor ci/scripts/build.sh
* Refactor ci/scripts/build.sh
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
* Refactor CI
2020-03-14 18:14:04 +08:00
512fe6233c
#1649 fix Milvus crash on old cpu ( #1652 )
...
* #1649 fix Milvus crash on old cpu
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* #1649 update debug log
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* retry CI
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-14 18:03:23 +08:00
5f2f8bdc8b
[skip ci] (shards) Upgrade Mishards for #1569 ( #1570 )
...
* [skip ci](shards): export MAX_WORKERS as configurable parameter
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): skip mishards .env git info
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): support more robust static discovery host configuration
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): update static provider that terminate server if connection to downstream server error during startup
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): add topology.py
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): add connection pool
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): add topology test
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): refactory using topo
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): refactory static discovery using topo
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): refactory kubernetes discovery using topo
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): add more test for connection pool
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): export 19541 and 19542 for all_in_one demo
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): check version on new connection
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): mock connections
Signed-off-by: peng.xu <peng.xu@zilliz.com>
* [skip ci](shards): update tests
Signed-off-by: peng.xu <peng.xu@zilliz.com>
2020-03-14 13:30:21 +08:00
4088f5e9a2
#1603 BinaryFlat add 2 Metrics: Substructure and Superstructure ( #1647 )
...
* add substructure & superstructure
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* support c++sdk by lin.xiaojun
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
* optimizer omp for BinaryFlat; add tutorial
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
2020-03-14 10:03:00 +08:00
b1f0e51d6b
skip some cases in http mode ( #1633 )
...
* skip some cases in http mode
Signed-off-by: del-zhenwu <zw@zilliz.com>
* reset config
Signed-off-by: del-zhenwu <zw@zilliz.com>
* fix case for http mode
Signed-off-by: del-zhenwu <zw@zilliz.com>
2020-03-13 20:21:23 +08:00
7c3a673bfe
check table lsn ( #1622 )
...
Signed-off-by: shengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Jin Hai <hai.jin@zilliz.com>
2020-03-13 11:56:12 +08:00
dfa25f88e2
fix demo bug in HTTP doc ( fix #1634 ) ( #1640 )
...
Signed-off-by: Yhz <yinghao.zou@zilliz.com>
2020-03-13 11:16:55 +08:00
24c39535be
Merge pull request #1639 from dvzubarev/fix-crashes
...
Fix crashes with sptag index
2020-03-13 00:11:33 +08:00
055041881c
fix crashes
...
Signed-off-by: denin <dvzubarev@yandex.ru>
2020-03-12 17:29:54 +03:00
45c66b3cd5
Merge pull request #1585 from cydrain/caiyd_1548_move_store
...
Caiyd 1548 move store
2020-03-12 21:33:21 +08:00
4cf2b2b392
Merge remote-tracking branch 'main/master' into caiyd_1548_move_store
2020-03-12 20:05:57 +08:00
cedfc84d09
Merge pull request #1638 from youny626/fix#1635
...
Fix#1635
2020-03-12 18:41:22 +08:00
7ec0444dc0
update
...
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-12 16:57:52 +08:00
7ac4e95e86
update
...
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-12 16:44:43 +08:00
04f00bbe91
update
...
Signed-off-by: Zhiru Zhu <zzhu@fandm.edu>
2020-03-12 16:43:18 +08:00
058c993a99
update header file
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 16:26:56 +08:00
7fc237f4bd
retry CI
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 14:49:11 +08:00
03c1b03dd0
Merge pull request #1626 from yamasite/master
...
Fix some broken links
2020-03-12 14:37:31 +08:00
acfd6415a8
retry CI
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 14:36:12 +08:00
a279da832e
#1548 move store/Directory to storage and add FSHandler
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 11:43:50 +08:00
817ea8b9e1
#1548 add FSHandler
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 11:40:12 +08:00
28a0f1de01
#1548 move store/Directory.cpp to storage
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 11:38:17 +08:00
4b9dc0263b
Merge remote-tracking branch 'main/master' into caiyd_1547_rename_storage_file
2020-03-12 09:37:54 +08:00
68ba8baa4e
#1547 update changelog
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2020-03-12 09:37:14 +08:00
c24e2a0111
Update README.md
...
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-03-12 09:34:25 +08:00
b6234ff028
Merge pull request #1624 from del-zhenwu/ci_update
...
Update ci pip install
2020-03-12 09:32:19 +08:00
6f0afa7c40
Update README_JP.md
...
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-03-12 09:25:52 +08:00
8534497100
Update README_CN.md
...
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-03-12 09:25:03 +08:00
7d1c8d9f45
Update README.md
...
Signed-off-by: Lutkin Wang <lu.wang@zilliz.com>
2020-03-12 09:24:48 +08:00
groot
Cai Yudong
shengjun.li
op-hunter
BossZou
Lutkin Wang
Xiaohai Xu
XuPeng-SH
quicksilver
Snyk bot
del-zhenwu
Xiaohai Xu
Zhiru Zhu
Jin Hai
denin