661469445c
Copy index file content to c memory ( #16162 )
...
Might be the root cause of #15896
The index content bytes were passed via unsafe.Pointer,
which shall be copy to cpp managed memory inmediately
This solution might cause a lot of memory consumption.
Maybe we need to store the index bytes in cpp memory in the first place.
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-03-24 14:55:25 +08:00
478890a700
modify import proto ( #16155 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-23 19:29:25 +08:00
321105cc01
Add column-based insert interface in segcore ( #16100 )
...
Signed-off-by: Letian Jiang <letian.jiang@zilliz.com>
2022-03-23 19:05:25 +08:00
1c4b949a1d
modify import rpc interface ( #16129 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-22 15:11:24 +08:00
2078b24dca
Prepare for import ( #16083 )
...
Signed-off-by: groot <yihua.mo@zilliz.com>
2022-03-21 15:47:23 +08:00
f8d9bc919d
Unify interface of vector index & scalar index. ( #15959 )
...
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-21 14:23:24 +08:00
3cd28420f1
Support compile under windows ( #15786 )
...
This patch makes compile milvus under windows(MSYS), including:
- some cpp adaptation for compile under msys/gcc-10.3
- install toolchain scripts for setup from MinGW/MSYS `scripts/install_deps_msys.sh`
- adaptation for POSIX API use in golang
* using gofrs/flock instead of syscall.Flock
* using x/exp/mmap instead of syscall.Mmap
- introducing github actions for build milvus.exe under windows/MSYS
- rocksdb's patch for MSYS
- adaptation for compile knowhere under windows
- a windows package script for pack zip file, `scripts/package_windows.sh`
issue #7706
Signed-off-by: Ji Bin <matrixji@live.com>
2022-03-17 17:17:22 +08:00
d65cf5309f
Remove useless LogMgr ( #16080 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-16 21:19:21 +08:00
a3a29fed06
Add entry point for embedded Milvus. ( #16008 )
...
/kind feature
issue: #15711
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-16 16:51:22 +08:00
09b2c46b61
Support create collection with VarChar field ( #15904 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-14 23:20:02 +08:00
89356ebcb9
Modify import rpc interfaces ( #16006 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-11 17:13:59 +08:00
5fdef607d5
Add rpc interfaces for import ( #15930 )
...
Signed-off-by: yhmo <yihua.mo@zilliz.com>
2022-03-09 18:33:59 +08:00
503724be19
Optimize CMakeLists.txt under internal/core ( #15770 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-03-01 10:31:55 +08:00
a77e0562b2
Make C++ log level configurable and add log configuration while building embedded milvus. ( #15743 )
...
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
2022-03-01 10:15:55 +08:00
54b8b24151
Rename variable names for better readibility ( #15700 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-22 22:15:52 +08:00
9a6ee61731
Change all fields in Expr to const to avoid modification ( #15663 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-02-22 14:45:51 +08:00
142848fcc3
Abandon using protobuf to pass binaryset parameter ( #15626 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2022-02-18 18:39:50 +08:00
cb9c63d039
Remove index dir ( #15467 )
...
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-02-09 16:07:45 +08:00
307a8ce535
Support compile and run on Mac ( #15491 )
...
Co-authored-by: jaime <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
Co-authored-by: Jenny Li <jing.li@zilliz.com>
Co-authored-by: Nemo <yuchen.gao@zilliz.com>
2022-02-09 14:27:46 +08:00
d83f69bb21
Support windows compliation ( #15448 )
...
- remove dl dependency while compiling some lib under MSYS
- int types aligement in golang
- core/src/utils adaptation for compile under MSYS
issue: #7706
Signed-off-by: Ji Bin <matrixji@live.com>
2022-02-07 23:43:46 +08:00
dee1961b4d
Make SearchResults and QueryResults return collectionID ( #15377 )
...
* Make SearchResults and QueryResults return collectionID
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
* add return collection name from QueryRequest and SearchRequest
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
* remove comment
Signed-off-by: Filipe Caixeta <filipecaixeta@gmail.com>
2022-01-27 22:55:41 +08:00
390cdd2515
Remove tmporary debug log in core ( #15330 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-24 10:03:41 +08:00
cc5bee4684
Stop handoff if segment has been compacted ( #15181 )
...
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-01-13 21:49:35 +08:00
ebed1a68ff
Add log for segcore search ( #15159 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-01-11 18:07:34 +08:00
e8c2869e6d
[skip e2e] Reorder header files for indexbuilder/utils.h ( #15076 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 13:30:12 +08:00
caa4ba6392
[skip e2e] Reorder header files for indexbuilder/IndexWrapper.h ( #15075 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 13:28:21 +08:00
e9fe927f5d
[skip e2e] Reorder header files for indexbuilder/IndexWrapper.cpp ( #15074 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 12:53:44 +08:00
8e3f258d80
[skip e2e] Remove duplicated copyright ( #15073 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-10 12:51:42 +08:00
c992659234
[skip e2e] Improve annotation ( #14898 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2022-01-06 13:21:02 +08:00
5efb234f41
[skip e2e] Reorder header files for common/SystemProperty.h ( #14828 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 12:03:20 +08:00
446f5e1b15
[skip e2e] Remove discard ( #14827 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 12:01:24 +08:00
6f7696549e
[skip e2e] Reorder header files for common/SystemProperty.cpp ( #14823 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 11:59:29 +08:00
6c1c42f18d
[skip e2e] Reorder header files for common/Span.h ( #14821 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 11:57:34 +08:00
ca7f1c1038
[skip e2e] Reorder header files for common/Schema.cpp ( #14808 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 11:55:20 +08:00
2520e57ebf
[skip e2e] Reorder header files for ShowExprVisitor.cpp ( #14730 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 09:43:35 +08:00
96a4450f2e
[skip e2e] Reorder header files for ShowPlanNodeVisitor.cpp ( #14731 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-05 09:07:24 +08:00
606b613318
[skip e2e] Reorder header files for VerifyPlanNodeVisitor.cpp ( #14732 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-04 20:03:33 +08:00
9f04855588
[skip e2e] Remove redundant code ( #14725 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-04 20:01:37 +08:00
d5c285ed5b
[skip e2e] Reorder header files for ExecExprVisitor.cpp ( #14719 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-04 19:59:35 +08:00
ec40959b24
[skip e2e] Optimize ExecPlanNodeVisitor.cpp ( #14722 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-04 19:19:28 +08:00
feb620f6c4
[skip e2e] Remove redundant code ( #14728 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2022-01-04 19:05:34 +08:00
8a3a1b556a
Free OS memory in QueryNode and IndexNode ( #14305 )
...
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-30 20:03:29 +08:00
778383ff4a
[skip e2e] Improve annotation ( #14561 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-30 14:11:42 +08:00
7f6b7998db
Let FAISS support all CPU SIMD ( #14587 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-30 12:09:46 +08:00
76eba2cb1f
[skip e2e] Remove redundant extern ( #14554 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-29 22:33:45 +08:00
7316d77559
Remove FaissAssert from distances_simd_avx ( #14525 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-29 19:53:45 +08:00
cb7301f1df
[skip e2e] Remove redundant includes ( #14537 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-29 18:57:45 +08:00
1a76707e36
Abstract distances_simd.h from distances.h ( #14512 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-29 16:13:20 +08:00
95709b6aa8
[skip e2e] Improve annotation ( #14480 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-29 12:00:31 +08:00
d7b4884474
[skip e2e] Improve annotation ( #14479 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-29 11:58:37 +08:00
722f95df02
Abstract range search APIs into distances_range.cpp ( #14485 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-29 11:43:24 +08:00
b9a8190cef
[skip e2e]Update license ( #14376 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-28 22:20:57 +08:00
2c0b89c6c9
[skip e2e]Update license ( #14377 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-28 22:04:46 +08:00
9c1c7bc54b
[skip e2e] Improve annotation ( #14386 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-28 13:27:17 +08:00
88b125643f
[skip e2e] Remove ConcurrentBitset.h reference ( #14387 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-28 12:04:09 +08:00
5b8b68c9f2
[skip e2e] Remove redundant files ( #14346 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-28 00:08:07 +08:00
fdfa93d385
Merge ConcurrentBit.h into BitsetView.h ( #14353 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-28 00:02:06 +08:00
b6383a5e77
[skip e2e]Update license ( #14379 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-27 23:12:06 +08:00
8ee2965459
[skip e2e]Update license ( #14378 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-27 23:04:06 +08:00
2b99889861
[skip e2e]Update license ( #14374 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-27 23:02:06 +08:00
8d707dc921
[skip e2e]Update license ( #14375 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-27 23:00:07 +08:00
0dae260a9c
[skip e2e] Re-organize header files included under query ( #14272 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 14:12:11 +08:00
8def3c44dc
[skip e2e] Reorder header files for query/SearchOnGrowing.cpp ( #14263 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 14:10:21 +08:00
d9cac2b3f0
[skip e2e] Reorder header files for query/SearchBruteForce.h ( #14261 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 14:08:18 +08:00
3a6e240fae
[skip e2e] Remove redundant header files for query/SubSearchResult.cpp ( #14276 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 11:30:11 +08:00
6fd109dc61
[skip e2e] Reorder header files for query/SearchOnIndex.h ( #14269 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 11:20:14 +08:00
390bff5e1c
[skip e2e] Remove redundant header files for query/visitors/ExecPlanNodeVisitor.cpp ( #14266 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-27 11:18:23 +08:00
b022615b2c
[skip e2e] improve annotation ( #14127 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-27 10:24:17 +08:00
89f3bbf454
[skip e2e] improve annotation ( #14125 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-27 10:22:18 +08:00
132b3c2248
Remove redundant ConcurrentBitset dependency ( #14230 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-26 01:20:18 +08:00
025bf610a6
[skip e2e]Update license ( #14250 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-25 23:54:26 +08:00
0d0cf43a61
[skip e2e]Update license ( #14249 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-25 23:52:45 +08:00
95a723f043
[skip e2e]Update license ( #14248 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-25 23:50:40 +08:00
afa5c7af4c
[skip e2e]Update license ( #14247 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-25 23:48:28 +08:00
4be6a442e8
Remove index build suspend support ( #14219 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-25 21:38:20 +08:00
a3942571c4
[skip e2e]Update license ( #14215 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-24 20:00:22 +08:00
7519a7de7f
[skip e2e]Update license ( #14214 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-24 19:58:28 +08:00
d2b15f8d61
[skip e2e]Update license ( #14213 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-24 19:46:22 +08:00
1fa825675a
[skip e2e]Update license ( #14112 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-23 22:11:20 +08:00
12d0062072
[skip e2e]Update license ( #14111 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-23 22:09:27 +08:00
f9e6709839
[skip e2e]Update license ( #14110 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-23 21:31:28 +08:00
86de70a4ba
[skip e2e] Disable FAISS GPU build ( #14084 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 21:13:21 +08:00
583fc21e15
[skip e2e] Fix core/src/index build issue ( #14083 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 21:11:16 +08:00
c141b2a242
[skip e2e] Reorder header files for query/SearchBruteForce.cpp ( #14054 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 19:19:24 +08:00
18c0ff116b
[skip e2e] improve annotation ( #14074 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-23 15:25:13 +08:00
c769c77d98
[skip e2e] improve annotation ( #14056 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-23 15:14:11 +08:00
e6e58b69d5
[skip e2e] improve annotation ( #14055 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-23 14:40:14 +08:00
370b878857
[skip e2e] Grammar correction ( #14050 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-23 14:38:14 +08:00
1dca18d3d3
Use std::numeric_limits instead of MAXFLOAT to fix porting issue ( #13954 )
...
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 10:31:15 +08:00
73b00c7754
[skip e2e]Update license ( #14014 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-22 21:29:18 +08:00
9a0edf20f2
[skip e2e]Update license ( #14016 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-22 21:27:19 +08:00
09bb8f0019
[skip e2e]Update license ( #14015 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-22 21:25:19 +08:00
4dafe15f5c
[skip e2e] Grammar correction ( #13931 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-22 20:12:26 +08:00
3440f129be
[skip e2e] Grammar correction ( #13930 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-22 20:10:32 +08:00
756a09a44b
[skip e2e] Grammar correction ( #13929 )
...
Signed-off-by: cxytz01 <xueyou.chen@zilliz.com>
2021-12-22 20:08:25 +08:00
ac8ae914b4
[skip e2e] improve annotation ( #13965 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-22 17:05:42 +08:00
c36439b13e
[skip e2e] improve annotation ( #13949 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-22 14:25:12 +08:00
6af7741c5f
[skip e2e] improve annotation ( #13948 )
...
Signed-off-by: Xieql <qianglong.xie@zilliz.com>
2021-12-22 14:23:23 +08:00
a275417b54
[skip e2e]Update license ( #13921 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-21 22:03:03 +08:00
4415095e08
[skip e2e]Update license ( #13920 )
...
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-12-21 22:01:12 +08:00
congqixia
groot
Letian Jiang
Jiquan Long
Ji Bin
Cai Yudong
Ten Thousand Leaves
xige-16
zhenshan.cao
jaime
Filipe Caixeta
bigsheeper
Xieql
cxytz01