milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
15,826 Commits
126 Branches
113 Tags
558 MiB
Commit Graph

280 Commits (aa6b8af80dd2a0a35691b04db20453358aad0468)

Author SHA1 Message Date
quicksilver c249137757 Optimize the workflow for build Devcontainer 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-02-25 19:22:21 +08:00
neza2017 c36c532c70 Remove unused test code 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-02-25 19:12:40 +08:00
zhenshan.cao bbfcbbdd68 Fix ci: paramstable and startup logic refactor 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-23 11:40:30 +08:00
cai.zhang 4c5a898e9a Add masterservice docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2021-02-20 11:15:19 +08:00
zhenshan.cao 2c9e226703 Add log for segment logic in proxy 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-02-07 16:44:11 +08:00
dragondriver 7e1887da12 Add start.sh and stop.sh, remove them later 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-02-05 14:31:40 +08:00
neza2017 854accf95b Remove master and writenode 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-30 16:41:47 +08:00
Xiangyu Wang 99cef4b5c8 Add Distributed main entrypoint 
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
 2021-01-29 17:08:31 +08:00
bigsheeper 73d2b6a101 Get index param from minio and filter by vector fields 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-29 15:22:24 +08:00
neza2017 bdf84f08ab Add watcher_test and fix some bugs 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-29 14:40:19 +08:00
sunby f088467dde Add watcher_test and fix some bugs 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-28 10:14:31 +08:00
XuanYang-cn b597a637f3 Add datanode metatable tests 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-29 12:03:10 +08:00
zhenshan.cao ee0faddb07 Refactor proxy 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-29 09:27:26 +08:00
dragondriver c6a6b1436c Add soft time tick in proxy service 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-26 13:41:41 +08:00
XuanYang-cn b794921b7e Add enum Role in internal.proto 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-23 18:56:08 +08:00
neza2017 e2b45f9866 Init param table and open unittest at ci 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-23 17:56:57 +08:00
dragondriver eba6bb288c Refactor the sructure of proto file 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-22 09:36:18 +08:00
xige-16 d22c2cd203 Add proto for query service loading collection 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-18 19:32:08 +08:00
xige-16 0164e78bb5 Add query service module 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2021-01-16 15:31:10 +08:00
zhenshan.cao bfe720bfec Update doc 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-15 18:03:16 +08:00
godchen 0971cf65b2 Remove opentracing stdlog 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-15 15:28:27 +08:00
quicksilver 7fe061b846 Raneme init_devcontainer.sh to devcontainer.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-15 14:38:36 +08:00
neza2017 56ab2bda2d Update proto:add partition id 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2021-01-15 11:53:22 +08:00
zhenshan.cao 63b21321d6 Refactor indexservice and update doc 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-15 13:50:27 +08:00
XuanYang-cn fb63983eb2 Modify rocksdb compilation 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-14 15:12:08 +08:00
yukun 6e36f10a26 Fix rocksdb illegal instruction in some machine 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-14 14:24:14 +08:00
FluorineDog 63ca5f8031 Add span and segment interface, rename segment_growing and use interface as base 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2021-01-13 18:46:25 +08:00
GuoRentong 1104f059ee Update doc:module interfaces 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-13 11:08:03 +08:00
quicksilver 8e9d8e36e1 Update run_go_unittest.sh 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-13 10:40:46 +08:00
bigsheeper 2d2af1505a Improve mutex usage in query node 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-12 18:03:24 +08:00
GuoRentong f3d2afa4f4 Update doc:detailed interface definition 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-11 18:35:54 +08:00
quicksilver a6690dbc99 Fix syntax error: Bad fd number 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-11 15:25:19 +08:00
yukun 18cfd31d40 Fix Load and Remove with prefix 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-11 15:17:06 +08:00
quicksilver 0c2f40f580 Archive milvus distributed server logs in Jenkins CI 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-10 12:10:11 +08:00
zhenshan.cao 02df310fa5 Fix data race 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-09 12:30:22 +08:00
sunby 5dfe9448ae Modify test_index 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2021-01-08 16:00:16 +08:00
yukun d11f00cd9f Add rocksdb in kv 
Signed-off-by: yukun <kun.yu@zilliz.com>
 2021-01-08 19:07:57 +08:00
GuoRentong 82ad488555 Update doc: rocksmq 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 18:37:24 +08:00
XuanYang-cn 65089ea362 Fix flush sync test bug and remove unecessary lock in meta_table 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2021-01-08 17:20:59 +08:00
GuoRentong c4599e26de Update doc: node api 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2021-01-08 16:59:19 +08:00
bigsheeper e13822043d Fix search test when partition not exists, add binary vector search validation 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2021-01-08 16:41:27 +08:00
godchen fa73f17f94 Add opentracing doc 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2021-01-08 15:32:38 +08:00
quicksilver f6d4214bbe Optimize the workflow for cache go mod 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-08 15:00:58 +08:00
zhenshan.cao 6a3ec57fef Fix docker lib dependency 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2021-01-07 21:08:23 +08:00
dragondriver a4860beae2 Parse type params and index params when buildindex is invoked 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2021-01-07 17:38:46 +08:00
quicksilver c7d31825c6 Fix connect to multiple containers at once with VSCode bug 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-07 17:14:33 +08:00
quicksilver 6bcca0a9b7 Connect to multiple containers at once with VSCode 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-06 18:16:37 +08:00
quicksilver ca89ece576 Fix go format bug 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2021-01-05 14:20:45 +08:00
bigsheeper b7fc945aca Add flush msg unmarshal function register 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-12-31 17:25:45 +08:00
xige-16 bfb18df7e7 Parse result_id from target entry 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-31 16:53:57 +08:00
quicksilver 1927eaf88b Add revive linter 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-12-31 16:38:37 +08:00
quicksilver b1b8747477 Add logic of incremental check for go code 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-12-29 17:19:44 +08:00
xige-16 be32a33eff Refactor loadIndexTest to test diffrent index params 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-29 14:43:40 +08:00
cai.zhang 37a55f3c1d Update sdk version 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-29 12:51:19 +08:00
cai.zhang f80536ed77 Update the logic of running go unittest 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-12-29 11:56:37 +08:00
neza2017 0afeaa78c8 Fix unittest of flow graph 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-24 14:10:00 +08:00
dragondriver d023c1afba Refactor index wrapper, use protobuf instead of json to pass data 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-12-21 16:36:07 +08:00
zhenshan.cao 9694203f8b Add writer client and metatable for writer 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-21 10:06:46 +08:00
zhenshan.cao fc054874d3 Add index_builder 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-10 17:55:55 +08:00
XuanYang-cn 881be7f3e3 Impl minimum runable writenode and writenode flowgraph 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-09 20:07:27 +08:00
XuanYang-cn e6f726e73a Add cache for thirdparty files cache 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-12-08 18:51:07 +08:00
zhenshan.cao 7bbbc14637 Fix bug: address already used 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-07 15:22:20 +08:00
xige-16 37d7526d31 Fix search test failure 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-12-07 14:37:42 +08:00
neza2017 32ec689510 Run storage unittest 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-06 16:58:15 +08:00
neza2017 aeca8f85a5 Run cwrapper unittest in ci 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 17:39:58 +08:00
neza2017 70710dee47 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-05 16:11:03 +08:00
FluorineDog 6412ebc0d4 Add support of metric type in schema, enable binary vector, fix segfault 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-12-05 06:46:01 +08:00
godchen 7ab5b5d80d Add MinIO kv implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-12-03 19:00:11 +08:00
neza2017 cec903da19 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-02 18:31:56 +08:00
zhenshan.cao 23aebe7e2a Fix proxy unittest 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-01 19:53:53 +08:00
FluorineDog 77fa75b1ec Add binary insert and warper of binary search, rename vector 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-30 05:18:44 +08:00
neza2017 32445dd02b Add cpu profile 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 16:01:31 +08:00
cai.zhang 57da66ba72 Update read config logic in docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-26 15:18:36 +08:00
zhenshan.cao 045fc3d808 Fix segment fault 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-26 14:29:01 +08:00
XuanYang-cn 0a16a9a651 Add logic of getting milvus distributed config from master by grpc 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-26 13:21:06 +08:00
sunby f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default" 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-25 18:39:05 +08:00
bigsheeper 4ed11d9775 Reopen segment test assertion 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-25 16:24:57 +08:00
bigsheeper 3b24c52a8c Catch cpp runtime error 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-25 16:20:07 +08:00
cai.zhang 4bcb460c98 Add clang-format 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-25 15:25:00 +08:00
bigsheeper 41fb2d2991 fix lock usage 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-24 16:12:39 +08:00
bigsheeper 8ec7e4576e Add dropPartition and createPartition 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-24 15:59:51 +08:00
quicksilver 3ead70ac6e Add Code check workflow 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-24 11:20:44 +08:00
cai.zhang a13638b172 Add cpplint and optimize the check of c++ code 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-23 19:57:05 +08:00
dragondriver c7a49c97cc Add repack function of InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-23 16:52:17 +08:00
cai.zhang 71beaadaf4 Update README for script 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-23 16:40:42 +08:00
neza2017 dab1afa3cc Add unittest and fix a bug in segment manager 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-21 17:53:05 +08:00
quicksilver 859ff62bc9 Unify Network for UnitTest 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-21 16:54:20 +08:00
cai.zhang 8ff82c2fd5 Add judgement when executing clang-format 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-21 16:37:48 +08:00
dragondriver a18ac17a98 Increase timeout interval of task in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-18 15:44:17 +08:00
cai.zhang 3ae7cd59e5 Enable the unittest of proxy in the CI progress 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-18 10:07:33 +08:00
cai.zhang c7861c2dba Add the check of C++ code in the CI progress 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-18 10:07:05 +08:00
FluorineDog f47fc7fef1 Using std::string instead of char * for PlaceholderGroup 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-13 19:37:59 +08:00
godchen 4a3ca1632b Add master partition task implementation 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-13 17:20:13 +08:00
FluorineDog ff843689ee Add show executor and dsl unittests 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-13 17:07:05 +08:00
XuanYang-cn 88cb274644 Refactor master scheduler: drop_collection 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-13 12:46:24 +08:00
godchen 4a11a6431b Add time sync producer 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-12 11:21:21 +08:00
bigsheeper c9c8fb9def Close pulsar channel 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-12 11:18:23 +08:00
cai.zhang 3b2c86c42d Fix bug for cmake_build dir was changed 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 10:45:46 +08:00
XuanYang-cn a2289d3ce6 Add softTimeTickBarrier and hardTimeTickBarrier 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-11 16:41:53 +08:00
cai.zhang a2f2284932 Add code coverage for go files 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-10 15:56:57 +08:00
cai.zhang 62a59d094b Run unittest in CI 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-09 18:47:37 +08:00
zhenshan.cao 87a4495c59 Fix proxy bug 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-09 17:52:47 +08:00
neza2017 d18c17e786 Add Meta table implementation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-04 16:28:14 +08:00
godchen bade037fb2 Add meta_table implementation 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-04 16:01:28 +08:00
cai.zhang 4194cb5d56 Add cmake_build directory to gitignore and optimize the logic of golangci-lint 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-03 20:19:08 +08:00
quicksilver 5429614462 Add make all command in docker-compose.yml 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-31 16:30:20 +08:00
quicksilver b5dd9ddd69 Change base image in Build environment Dockerfile 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-30 16:25:06 +08:00
zhenshan.cao 6eee7d1342 Fix bug and update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-29 19:55:57 +08:00
quicksilver d66d48c6b6 Enable UnitTest 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-27 15:51:16 +08:00
shengjh 77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master) 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-10-27 12:01:27 +08:00
quicksilver eb64839aef Update build environment 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-26 15:45:18 +08:00
FluorineDog a48ca80286 Format Code and duplicate class Segment 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-10-24 18:04:57 +08:00
quicksilver 1b31b85ef7 Refactor the build and scripts folders 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-24 11:36:42 +08:00
zhenshan.cao 4965a315ad Refact proto generating procedure 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-19 10:36:40 +08:00
shengjh 3d7181617b Add ci and format code for proxy 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-10-15 16:32:22 +08:00
xige-16 d7e6b99394 Add config reader 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-10-13 15:03:46 +08:00
neza2017 bb517eeca1 Add test for proxy-go 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-10-12 13:54:00 +08:00
bigsheeper d4e485d37a Add pulsar authentication 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-10-10 11:06:07 +08:00
neza2017 b0189c2450 Update time sync 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-10-09 15:37:24 +08:00
xige-16 917dc677af Add time sync for query node and write node 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-09-15 17:41:05 +08:00
cai.zhang 71950d44a8 Fix bug for aggregation 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-09-15 16:37:43 +08:00
FluorineDog 99ef484273 Format Unittest 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-09-15 16:23:29 +08:00
FluorineDog 7062b64fce Support blacklist using concurrentBitset 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-09-15 16:16:43 +08:00
bigsheeper d7056ce046 Fix test when search failed 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-09-15 15:53:10 +08:00
zhenshan.cao be58ccb65e Delete unused 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-12 16:57:37 +08:00
shengjh 4cf6e079bc Add etcd watcher 
Signed-off-by: shengjh <1572099106@qq.com>
 2020-09-11 18:55:43 +08:00
zhenshan.cao 7479aedf07 Add export path 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-10 20:23:51 +08:00
FluorineDog b4e76c9490 Add testcase for deleted record 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-09-10 17:57:33 +08:00
zhenshan.cao cae0f36bdd Add config of pulsar 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-07 16:56:57 +08:00
zhenshan.cao 8992611898 refactor proto logic 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-09-06 21:13:06 +08:00