Commit Graph

52 Commits (440bce9d45e1274e6606bbb21f7b48b4974be416)

Author SHA1 Message Date
bigsheeper 2d9a52206d
Use jemalloc in QueryNode, DataNode and IndexNode (#17470)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-10 11:24:08 +08:00
Jiquan Long e88ffb8a57
Enable marisa trie ut on MacOS (#17316)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-02 10:48:03 +08:00
Xiaofan 9579a645c6
Support compile marisa on Macos (#17261)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-31 13:28:02 +08:00
Enwei Jiao d28a2db46c
move arrow from storage to core (#17061)
Signed-off-by: Enwei Jiao <jiaoew2011@gmail.com>
2022-05-22 20:03:58 +08:00
Cai Yudong 35e7ed45b3
Upgrade to knowhere v1.1.5 to fully support MinGW build (#16498)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-15 09:53:34 +08:00
zhenshan.cao 58ea38142f
Use boost dynamic_bitset in segcore (#16476)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-04-14 22:37:34 +08:00
Ji Bin a5ac637ba5
Adaptation windows for Knowhere 1.1.3 (#16444)
fixes #16443

Signed-off-by: Ji Bin <matrixji@live.com>
2022-04-13 14:39:34 +08:00
Cai Yudong 71cd7ba67a
Add configuration common.indexSliceSize (#16438)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-04-08 20:29:33 +08:00
Cai Yudong a37479d728
Upgrade to knowhere-v1.1.2 to support all index types for mac (#16416)
Signed-off-by: Cai Yudong <yudong.cai@zilliz.com>
2022-04-08 15:29:31 +08:00
Jiquan Long fd589baca7
Integrates marisa trie index (#16192)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-04-01 15:31:29 +08:00
Cai Yudong 0baa8c60a5
Fix MinGW build error (#16267)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-30 00:15:27 +08:00
Cai Yudong 1160693e4c
Fix centos build error (#16251)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-29 15:13:30 +08:00
Cai Yudong 2ac53c89e9
Revert #16242 (#16247)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-29 00:53:27 +08:00
Cai Yudong 9a6b2b8806
Fix centos build error (#16242)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-28 23:23:27 +08:00
Ji Bin 4f08f6d8c6
Workaround for knowhere under windows (#16214)
issue #16205

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-28 17:41:27 +08:00
Cai Yudong 3e3756d3dc
Upgrade to knowhere v1.1.1 to support Mac M1 build (#16210)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-28 14:33:26 +08:00
Cai Yudong f4ebd3a9ce
Upgrade to knowhere v1.1.0 (#16186)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-25 13:49:25 +08:00
Ji Bin 3cd28420f1
Support compile under windows (#15786)
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
  * using gofrs/flock instead of syscall.Flock
  * using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`

issue #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
Cai Yudong d65cf5309f
Remove useless LogMgr (#16080)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-16 21:19:21 +08:00
Cai Yudong 529098fd87
[skip ci] Update knowhere/CMakeLists.txt (#15804)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-01 17:55:55 +08:00
Cai Yudong adca79facc
Fix centos build error (#15760)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-25 18:49:54 +08:00
Nemo dc65b1aeea
Switch to knowhere v1.0.1. Also switch to forked gorocksdb v0.0.1 (#15603)
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-02-17 19:05:49 +08:00
jaime 307a8ce535
Support compile and run on Mac (#15491)
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
Ji Bin d83f69bb21
Support windows compliation (#15448)
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS

issue: #7706

Signed-off-by: Ji Bin <matrixji@live.com>
2022-02-07 23:43:46 +08:00
Xieql bdbeac2204
[skip e2e] Improve annotation (#14562)
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-30 14:15:38 +08:00
Cai Yudong 1ae249adb5
Update profiler CMakeLists.txt (#13001)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 23:23:06 +08:00
Cai Yudong 85efcd8582
Move fiu nlohmann and easylogging to core/thirdparty (#12981)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 18:45:07 +08:00
Cai Yudong 45bac3e4ec
Move profiler under core/thirdparty (#12949)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 13:01:04 +08:00
Cai Yudong df875c5985
Clean useless thirdparty version (#12944)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 12:15:03 +08:00
Cai Yudong 7b97b155e8
Remove duplicated thirdparty (#12925)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-08 10:37:37 +08:00
XuanYang-cn ea7abf49c3
Fix protobuf compilation error (#9881)
resolves:#9876

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-10-14 18:14:32 +08:00
ZhiShen 6a770e5c38
Make knowhere compile independently (#7606)
Make knowhere compile independently

1. Make knowhere compile independently
    * Add gtest, arrow, and some other libraries to index.
    * Add cache, log and some other files to knowhere.
    * Add CMakeLists files to index's thirdparty.

2. Modified the compilation content of knowhere
    * Delete some content of compile library.
    * Add IMPORTED_GLOBAL property to faiss.

3.  Change the compilation location of some libraries
    * Make OpenBLas compiled in thirdpartycore.cmake.
    * Make faiss compiled in thirdparty/CMakeLists.

Change the content of knowhere/CMakeLists

1. Change easyloggingpp and nlohmann into index/thirdparty.
2. Change MILVUS_THIRDPARTY_SRC into KNOWHERE_THIRDPARTY_SRC.

Delete FindOpenBLAS

1. Delete Openblas.cmake.

2. The search task for openBlas is assigned to ThirdpartyCore.

3. Some changes were made to build.sh in index.

Fix the openBLas compilation problem

Delete the if-else in compilation of faiss;

Now when complie faiss, it will find the Openblas as we wish.

Fix some problem:

1. delete arrow

2. set openblas_source to AUTO

3. change a include_dir

4. delete MKL

5. delete the CMakeLists in index/utils,cache,log

Change variable build_test to knowhere_build_test in index/build.sh

Change the include location of  GNUInstallDirs

set CMAKE_INSTALL_LIBDIR

Resolves: milvus-io#5183
See also: milvus-io#6604

Signed-off-by: Shen Zhi <m13120163046@163.com>
2021-10-13 17:06:33 +08:00
quicksilver 3db653f2d0
Update cpp thirdparty source URL (#5295)
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>

Resolves: #5293
2021-05-19 09:39:29 +00:00
XuanYang-cn 46d27e37d7 Skip install gtest when build with test
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-04-08 10:01:18 +08:00
FluorineDog af1900b42a Remove ConcurrentBitsetPtr in segcore
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-09 16:16:43 +08:00
FluorineDog ef98dab2a9 Support segcore config
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-03-04 17:09:48 +08:00
FluorineDog 66146223ca Support flat
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-27 12:46:37 +08:00
xige-16 4c491471ee Add release collection and release partition interface for query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-24 15:58:55 +08:00
xige-16 7a7a73e89c Fix high memory usage in pulsarTtStream
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-02-23 11:40:12 +08:00
FluorineDog 15dd17488e Support benchmark
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-02-23 10:47:21 +08:00
GuoRentong 1104f059ee Update doc:module interfaces
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2021-01-13 11:08:03 +08:00
quicksilver 8e9d8e36e1 Update run_go_unittest.sh
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-13 10:40:46 +08:00
FluorineDog 4cd42c553f Rename field_name, make field_id strongly typed, skip multithread test
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-12 18:31:52 +08:00
XuanYang-cn e6f726e73a Add cache for thirdparty files cache
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 18:51:07 +08:00
zhenshan.cao 6eee7d1342 Fix bug and update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 19:55:57 +08:00
quicksilver d66d48c6b6 Enable UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-27 15:51:16 +08:00
shengjh 77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master)
Signed-off-by: shengjh <1572099106@qq.com>
2020-10-27 12:01:27 +08:00
quicksilver eb64839aef Update build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-26 15:45:18 +08:00
FluorineDog a48ca80286 Format Code and duplicate class Segment
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-24 18:04:57 +08:00
FluorineDog e84b0180c9 Refactor cmake and build script and add timed benchmark
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-23 18:01:24 +08:00