milvus-io
/
milvus
mirror of https://github.com/milvus-io/milvus.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,163 Commits
136 Branches
115 Tags
566 MiB
Commit Graph

210 Commits (7f044fff822591086ef4a31e87cdba981b7fc3fe)

Author SHA1 Message Date
zhenshan.cao 0b6fe0a8cf Refactor paramtable 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-04 14:18:17 +08:00
godchen 7ab5b5d80d Add MinIO kv implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-12-03 19:00:11 +08:00
neza2017 cec903da19 Add parquet payload 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-02 18:31:56 +08:00
zhenshan.cao 23aebe7e2a Fix proxy unittest 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-12-01 19:53:53 +08:00
neza2017 17cc7bc337 Use MetaRootPath instead 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-12-01 17:03:39 +08:00
neza2017 d3858500c6 Add static check 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-30 19:38:23 +08:00
quicksilver 86573d0053 Create Jenkins pipeline 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-30 10:07:04 +08:00
FluorineDog 77fa75b1ec Add binary insert and warper of binary search, rename vector 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-30 05:18:44 +08:00
cai.zhang 85a544b79b Add dockerfile for each component 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 19:06:48 +08:00
cai.zhang 115d0732af Update docker-compose file for unittest 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-28 16:43:39 +08:00
dragondriver eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-28 15:57:49 +08:00
godchen 92bf09c7e6 Add ddstream and scheduler implements 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-28 15:26:39 +08:00
FluorineDog c9fb34142c Enable primary_key switch 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-28 09:16:00 +08:00
dragondriver 235e723eb6 Read proxy id from param table instead of hardcode 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-27 11:17:12 +08:00
XuanYang-cn 3e605ae25f Rename reader to querynode 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-27 10:56:53 +08:00
bigsheeper 1decc1a4ca Add metaRootPath and kvRootPath 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-27 09:59:40 +08:00
neza2017 c507abdeaa Fix start time sync 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 16:51:44 +08:00
dragondriver 72a7af3f4a Add time tick logic to Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 17:47:46 +08:00
neza2017 32445dd02b Add cpu profile 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 16:01:31 +08:00
cai.zhang 57da66ba72 Update read config logic in docker 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-26 15:18:36 +08:00
zhenshan.cao 045fc3d808 Fix segment fault 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-26 14:29:01 +08:00
XuanYang-cn 0a16a9a651 Add logic of getting milvus distributed config from master by grpc 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-26 13:21:06 +08:00
dragondriver 8ce0deca4e Add default partition tag to InsertTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-26 11:38:04 +08:00
xige-16 ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-26 11:12:33 +08:00
neza2017 ae26a81550 Change to use Marshal as text 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-26 10:13:23 +08:00
sunby f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default" 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-25 18:39:05 +08:00
dragondriver a7b3efecd7 Read query node num from param table instead of hardcode 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-25 16:17:33 +08:00
cai.zhang 4bcb460c98 Add clang-format 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-25 15:25:00 +08:00
sunby 24b29bec30 Add collectionName/partitionTag/fieldName validation. 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-25 14:44:30 +08:00
bigsheeper 84f3d974fa Delete pulsar address test and refactor master param table 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-23 18:04:09 +08:00
FluorineDog 76001b29b6 Support Range Query 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-23 11:56:45 +08:00
sunby 578e952c60 Add segment threshold factor 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-23 10:20:30 +08:00
sunby 2ebf3b55e4 Modify pulsar address in unittest 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-21 18:36:14 +08:00
sunby 3afab6ecb9 Add unittest and fix a bug in segment manager 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-21 17:11:05 +08:00
dragondriver e36b565ec0 Normalize the naming of variable and function in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-21 16:31:38 +08:00
FluorineDog 9f35dee2df Support range executor 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-21 15:56:13 +08:00
neza2017 73e3ff09f5 Refactor variable name in Master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-21 15:53:01 +08:00
XuanYang-cn 03c996d71a Fix timesync bug 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-21 15:25:23 +08:00
cai.zhang 17c3a70d64 update ParameterTable 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-21 15:06:46 +08:00
neza2017 2514e8b8a9 Optimize code in Master module 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-20 17:46:49 +08:00
bigsheeper dd3654f953 Fix query node param table 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-20 17:10:24 +08:00
quicksilver 1728a4f419 Update .devcontainer.json 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-20 15:02:26 +08:00
neza2017 cda47a9252 Remove unused code 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-20 09:13:29 +08:00
zhenshan.cao 50d59d91ee Add segmentIDAssigner for proxy 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-19 21:02:31 +08:00
neza2017 ce89f64bb3 Set master config 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-19 10:46:17 +08:00
neza2017 c3de667bf5 Implement segment management in master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-18 19:46:18 +08:00
bigsheeper 99ea7e9f05 Update param table 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-18 19:33:56 +08:00
sunby 9e4ce8454e Implement segment management in master 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-18 15:04:17 +08:00
dragondriver a18ac17a98 Increase timeout interval of task in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-18 15:44:17 +08:00
neza2017 544c701f98 Start timeSyncMsgProducer in master 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-18 10:14:11 +08:00
dragondriver b32e55d5f0 Add timeout logic to task in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-17 20:00:23 +08:00
quicksilver 72ed65d7f8 Check builder images 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-17 18:36:03 +08:00
godchen 4f04be4a28 Add master dd task unittest 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-17 17:17:10 +08:00
xige-16 4e8efe85df Delete wrong useage of *TsMsg 
Signed-off-by: xige-16 <xi.ge@zilliz.com>
 2020-11-17 14:10:07 +08:00
cai.zhang 5bcabffdaf Replace conf struct with ParamsTable 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-16 21:10:43 +08:00
dragondriver aff1e79f82 Fix SearchTask in Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-16 17:01:10 +08:00
FluorineDog 8c48cf30c0 Format and and extra parameters for checking 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-11-16 15:41:56 +08:00
neza2017 9d3a21a9c9 Rewrite NewTSOKVBase 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-16 12:37:46 +08:00
zhenshan.cao 9f948d3095 Remove mockmaster 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-14 16:40:10 +08:00
quicksilver 00b4b67a1f Update the version of build environment 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-11-14 16:01:12 +08:00
neza2017 e349508e78 Fix list-collections 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-14 15:57:39 +08:00
XuanYang-cn fd6d0c78e5 Refactor master scheduler: show_collections 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-14 15:37:07 +08:00
zhenshan.cao e94138816f Add tsLoop for master 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-14 15:26:14 +08:00
neza2017 ce969e9568 Update segment 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-14 14:39:52 +08:00
XuanYang-cn 27032cc126 Refactor master scheduler: describe_collection 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-14 13:06:41 +08:00
neza2017 74f8c45a23 Add ListCollection for meta table 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-14 11:50:57 +08:00
dragondriver c2382adf04 Initialize the task scheduler of Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-14 11:24:49 +08:00
godchen 4a3ca1632b Add master partition task implementation 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-13 17:20:13 +08:00
zhenshan.cao 595d827155 Add grpc check logic for master 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-13 16:53:55 +08:00
XuanYang-cn 1b48e84c35 Refactor master scheduler: has_collection 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-13 15:44:02 +08:00
cai.zhang 0b478b614a Change Id to ID in go files according to golint check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-13 15:17:18 +08:00
sunby e541041b28 Add QueryNodeSegStats proto 
Signed-off-by: sunby <bingyi.sun@zilliz.com>
 2020-11-13 14:20:51 +08:00
XuanYang-cn 88cb274644 Refactor master scheduler: drop_collection 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-13 12:46:24 +08:00
cai.zhang cfee642a11 Add ruleguard and open ruleguard check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-13 10:00:32 +08:00
cai.zhang b68322d469 Open golangci-lint check 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 17:58:05 +08:00
neza2017 14d4a400dd Load etcd port from etcd 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-12 17:15:01 +08:00
XuanYang-cn 85db2c0438 Fix timesync tests 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-12 15:56:23 +08:00
cai.zhang 1cd2fd9954 Add the standard of golangci-lint 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 12:04:12 +08:00
godchen 4a11a6431b Add time sync producer 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-12 11:21:21 +08:00
bigsheeper c9c8fb9def Close pulsar channel 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-12 11:18:23 +08:00
cai.zhang 3b2c86c42d Fix bug for cmake_build dir was changed 
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
 2020-11-12 10:45:46 +08:00
neza2017 d71083bf6b Change master scheduler: CreateCollection 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-11 20:01:04 +08:00
zhenshan.cao 057563d936 Refactor master 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-11 17:53:54 +08:00
XuanYang-cn a2289d3ce6 Add softTimeTickBarrier and hardTimeTickBarrier 
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
 2020-11-11 16:41:53 +08:00
zhenshan.cao c442d50c08 Add global tsoAllocator 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-11 14:17:33 +08:00
bigsheeper b4bd9cf9d6 Add collection, segment, and partition unittest 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-11-11 11:22:19 +08:00
neza2017 980084ff15 Enable github action for go unittest 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-09 17:08:48 +08:00
neza2017 202ded96b9 Update time tick 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-09 14:09:10 +08:00
zhenshan.cao db9957d48b Add unittest for master 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-07 18:03:52 +08:00
dragondriver b8ccbc1c97 Add InsertTask and SearchTask to Proxy 
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
 2020-11-07 16:18:23 +08:00
zhenshan.cao 86d2d36053 Add MemoryKV, mockkv and tso test 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-06 16:47:18 +08:00
zhenshan.cao 9c490a209b Delete unused code 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-05 19:11:12 +08:00
zhenshan.cao e9122921b9 Use type alias 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-04 17:58:43 +08:00
neza2017 d18c17e786 Add Meta table implementation 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-04 16:28:14 +08:00
godchen bade037fb2 Add meta_table implementation 
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
 2020-11-04 16:01:28 +08:00
zhenshan.cao 2e2e059f8a Add msgheader and change ReqType to MsgType 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-04 15:13:42 +08:00
zhenshan.cao e962b57fbb Add timestamp allocator 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-11-03 14:53:36 +08:00
neza2017 10217f9485 Add test for etcd kv 
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
 2020-11-02 10:26:33 +08:00
zhenshan.cao 27b9a51938 Add logic of allocate id 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-30 16:27:58 +08:00
zhenshan.cao 6eee7d1342 Fix bug and update proto 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-29 19:55:57 +08:00
bigsheeper 9131a5554a Add etcd, metaTable and scheduler in master 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-10-29 12:39:41 +08:00
zhenshan.cao bbecf51f8c Move kv directory 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-29 11:46:34 +08:00
zhenshan.cao f0cc9c8ad3 Add tso for master and add timestamp 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-29 09:31:08 +08:00
bigsheeper 2df04b6947 Add collection creation, and refactor master 
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
 2020-10-28 15:38:24 +08:00
quicksilver eb64839aef Update build environment 
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
 2020-10-26 15:45:18 +08:00
FluorineDog a48ca80286 Format Code and duplicate class Segment 
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
 2020-10-24 18:04:57 +08:00
zhenshan.cao 251bc2a19e Fix conf.LoadConfig failed to load yaml file 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-19 18:31:00 +08:00
GuoRentong 974496a2b2 Update issue templates 
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
 2020-10-19 17:45:56 +08:00
zhenshan.cao 6a136c1a76 Change import path 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-19 17:39:51 +08:00
zhenshan.cao 64295db471 Refact master and proxy and add etcdutil 
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
 2020-10-15 21:31:50 +08:00