Commit Graph

10009 Commits (update_knowhere_commit_032292a4329e1c569f7919fce7e8984d301a3e4a)

Author SHA1 Message Date
xige-16 acdf8cc9e1 Fix memory leak in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-04 19:32:30 +08:00
cai.zhang 18a9ffb617 Increase timeout for golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-04 17:57:24 +08:00
zhenshan.cao 0b6fe0a8cf Refactor paramtable
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-04 14:18:17 +08:00
godchen 7ab5b5d80d Add MinIO kv implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-03 19:00:11 +08:00
neza2017 cec903da19 Add parquet payload
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-02 18:31:56 +08:00
xige-16 36cf8a8ea7 Support return primary key when doing search
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-03 17:18:06 +08:00
quicksilver 0530fdf62f Open regression test
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-03 14:05:52 +08:00
bigsheeper 707a6a366e Fix issue about collection cannot be found
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-02 17:13:16 +08:00
zhenshan.cao 569057251c Add support of custom ID
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-02 16:12:21 +08:00
zhenshan.cao 23aebe7e2a Fix proxy unittest
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-01 19:53:53 +08:00
neza2017 17cc7bc337 Use MetaRootPath instead
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-01 17:03:39 +08:00
dragondriver 84b15c1f5c Fix the bug of meta cache in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-01 16:41:25 +08:00
cai.zhang c1fbc4f8fa Open the tests for insert
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-01 15:18:57 +08:00
FluorineDog 6b74d82259 Support some validation for dsl parser
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-01 02:16:53 +08:00
zhenshan.cao fda8d62b38 Fix make error
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-30 22:14:19 +08:00
neza2017 d3858500c6 Add static check
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-30 19:38:23 +08:00
dragondriver 2358fae703 Check the status of search results before reduce in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-30 19:08:32 +08:00
bigsheeper 0cd3e8d86c Use exception instead of runtime error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-30 17:58:23 +08:00
dragondriver 51a9f49d35 Fix the topk check when deal with the search result in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-30 17:46:00 +08:00
cai.zhang 546beb333d Compile master and proxy without cgo
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-30 16:40:13 +08:00
zhenshan.cao 24942c3d6d Fix insert failed to return correct id range
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-30 12:08:47 +08:00
bigsheeper d88a654db8 Fix search result
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-30 11:22:59 +08:00
quicksilver 86573d0053 Create Jenkins pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-30 10:07:04 +08:00
FluorineDog 77fa75b1ec Add binary insert and warper of binary search, rename vector
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-30 05:18:44 +08:00
cai.zhang 85a544b79b Add dockerfile for each component
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 19:06:48 +08:00
cai.zhang 115d0732af Update docker-compose file for unittest
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-28 16:43:39 +08:00
dragondriver eb6c0e0a28 Fix the bug when reduce the multiple search result from query nodes
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-28 15:57:49 +08:00
godchen 92bf09c7e6 Add ddstream and scheduler implements
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-28 15:26:39 +08:00
dragondriver 568cef0730 Fix InsertTask and SearchTask
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-28 10:48:29 +08:00
FluorineDog c9fb34142c Enable primary_key switch
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-28 09:16:00 +08:00
dragondriver 235e723eb6 Read proxy id from param table instead of hardcode
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-27 11:17:12 +08:00
XuanYang-cn 3e605ae25f Rename reader to querynode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-27 10:56:53 +08:00
bigsheeper 1decc1a4ca Add metaRootPath and kvRootPath
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-27 09:59:40 +08:00
neza2017 c507abdeaa Fix start time sync
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:51:44 +08:00
bigsheeper f21c0ef2e9 Reduce cpu usage
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-26 17:58:08 +08:00
dragondriver 72a7af3f4a Add time tick logic to Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-26 17:47:46 +08:00
neza2017 32445dd02b Add cpu profile
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 16:01:31 +08:00
cai.zhang 57da66ba72 Update read config logic in docker
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-26 15:18:36 +08:00
dragondriver ab75438abf Fix bug of repack function of InsertTask in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-26 15:17:20 +08:00
neza2017 d9e5a8774d Add dimension validation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 15:07:47 +08:00
FluorineDog 8ae573b580 Fix bool bug
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-26 14:56:58 +08:00
sunby e8e21a0308 Add dimension validation.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-26 14:54:03 +08:00
zhenshan.cao 045fc3d808 Fix segment fault
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-26 14:29:01 +08:00
XuanYang-cn 0a16a9a651 Add logic of getting milvus distributed config from master by grpc
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-26 13:21:06 +08:00
dragondriver 8ce0deca4e Add default partition tag to InsertTask in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-26 11:38:04 +08:00
xige-16 ae78aa1ac1 Warp cpp reduce and repack searchResultMsg to specified pulsar channel
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-26 11:12:33 +08:00
neza2017 ae26a81550 Change to use Marshal as text
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-26 10:13:23 +08:00
sunby f4c643f1bd Add number limitation of partition and field. And Change default partition tag to "_default"
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-25 18:39:05 +08:00
zhenshan.cao f12366342f Fix bug and delete unused code
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-25 16:45:42 +08:00
bigsheeper 4ed11d9775 Reopen segment test assertion
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-25 16:24:57 +08:00
bigsheeper 3b24c52a8c Catch cpp runtime error
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-25 16:20:07 +08:00
dragondriver a7b3efecd7 Read query node num from param table instead of hardcode
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-25 16:17:33 +08:00
cai.zhang 4bcb460c98 Add clang-format
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-25 15:25:00 +08:00
FluorineDog a6f950e5b6 Fix boost::dynamic_bitset misuse
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-25 15:17:17 +08:00
sunby 24b29bec30 Add collectionName/partitionTag/fieldName validation.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-25 14:44:30 +08:00
FluorineDog a38f539b9b Move c headers to segcore folder
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-25 10:31:51 +08:00
FluorineDog df1dcf81b9 Update cpplint.py and lint all files
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-24 21:28:38 +08:00
xige-16 1a929ac655 Fix memory leak when running query node’s unites
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-24 20:14:51 +08:00
FluorineDog 83379977b2 Enable structured index
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-24 19:09:57 +08:00
quicksilver d1f31c7b4e Cache Docker volumes in code-checker.yaml
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-24 17:04:48 +08:00
bigsheeper 41fb2d2991 fix lock usage
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-24 16:12:39 +08:00
bigsheeper 8ec7e4576e Add dropPartition and createPartition
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-24 15:59:51 +08:00
neza2017 ad0078c07a Load grpc port of proxy from config
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-24 11:50:21 +08:00
cai.zhang a13638b172 Add cpplint and optimize the check of c++ code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-23 19:57:05 +08:00
bigsheeper 84f3d974fa Delete pulsar address test and refactor master param table
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-23 18:04:09 +08:00
dragondriver c7a49c97cc Add repack function of InsertTask in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-23 16:52:17 +08:00
cai.zhang 71beaadaf4 Update README for script
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-23 16:40:42 +08:00
FluorineDog 76001b29b6 Support Range Query
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-23 11:56:45 +08:00
neza2017 3277987898 Add segment threshold factor
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-23 11:41:53 +08:00
sunby 578e952c60 Add segment threshold factor
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-23 10:20:30 +08:00
zhenshan.cao 7c39fc24a9 Simplify proxy config
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-21 19:12:59 +08:00
sunby 2ebf3b55e4 Modify pulsar address in unittest
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-21 18:36:14 +08:00
sunby 3afab6ecb9 Add unittest and fix a bug in segment manager
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-21 17:11:05 +08:00
quicksilver 859ff62bc9 Unify Network for UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-21 16:54:20 +08:00
cai.zhang 8ff82c2fd5 Add judgement when executing clang-format
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-21 16:37:48 +08:00
dragondriver e36b565ec0 Normalize the naming of variable and function in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-21 16:31:38 +08:00
FluorineDog 9f35dee2df Support range executor
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-21 15:56:13 +08:00
neza2017 73e3ff09f5 Refactor variable name in Master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-21 15:53:01 +08:00
XuanYang-cn 03c996d71a Fix timesync bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-21 15:25:23 +08:00
cai.zhang 17c3a70d64 update ParameterTable
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-21 15:06:46 +08:00
GuoRentong 8b88a9c306 Update docs: master::syncMsgProducer
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-21 11:39:23 +08:00
dragondriver aabe9afd75 Add meta cache in Proxy and use meta cache to generate id in InsertTask
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-20 17:53:31 +08:00
neza2017 2514e8b8a9 Optimize code in Master module
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-20 17:46:49 +08:00
bigsheeper dd3654f953 Fix query node param table
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-20 17:10:24 +08:00
quicksilver 1728a4f419 Update .devcontainer.json
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-20 15:02:26 +08:00
neza2017 cda47a9252 Remove unused code
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-20 09:13:29 +08:00
zhenshan.cao 50d59d91ee Add segmentIDAssigner for proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-19 21:02:31 +08:00
dragondriver 0b2add0d7b Fix query result loop logic in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-19 18:45:24 +08:00
neza2017 429c94e18b Add grpc for proxy
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-19 17:09:22 +08:00
xige-16 cf11212932 Refactor reduce using cgo in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-19 14:13:39 +08:00
neza2017 ce89f64bb3 Set master config
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-19 10:46:17 +08:00
neza2017 c3de667bf5 Implement segment management in master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-18 19:46:18 +08:00
bigsheeper 99ea7e9f05 Update param table
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-18 19:33:56 +08:00
sunby 9e4ce8454e Implement segment management in master
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-18 15:04:17 +08:00
FluorineDog e7dd30a884 Add framework of ExecExprVisitor
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-18 17:32:52 +08:00
quicksilver 057673edc9 Fix permission denied in gdbserver container
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-18 16:38:28 +08:00
dragondriver a18ac17a98 Increase timeout interval of task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-18 15:44:17 +08:00
neza2017 544c701f98 Start timeSyncMsgProducer in master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-18 10:14:11 +08:00
cai.zhang c7861c2dba Add the check of C++ code in the CI progress
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-18 10:07:05 +08:00
dragondriver b32e55d5f0 Add timeout logic to task in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-17 20:00:23 +08:00
quicksilver 72ed65d7f8 Check builder images
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-17 18:36:03 +08:00
godchen 4f04be4a28 Add master dd task unittest
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-17 17:17:10 +08:00
bigsheeper e117a6097a Fix pulsar url
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-17 16:32:34 +08:00
xige-16 4e8efe85df Delete wrong useage of *TsMsg
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-17 14:10:07 +08:00
XuanYang-cn 14ad7dc4a2 Add ccache and optimize index unittest compilation
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-17 11:05:15 +08:00
xige-16 833fee59d9 Add searchService for query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-17 10:07:42 +08:00
cai.zhang 5bcabffdaf Replace conf struct with ParamsTable
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-16 21:10:43 +08:00
dragondriver aff1e79f82 Fix SearchTask in Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-16 17:01:10 +08:00
FluorineDog 8c48cf30c0 Format and and extra parameters for checking
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-16 15:41:56 +08:00
neza2017 9d3a21a9c9 Rewrite NewTSOKVBase
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-16 12:37:46 +08:00
xige-16 d59f6ac6ca Add queryNodeSegStatsMsg for msgStream
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-16 10:55:49 +08:00
dragondriver 23d9ddb4a3 Add unittest to grpc service that Proxy provide
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-14 18:18:10 +08:00
zhenshan.cao 9f948d3095 Remove mockmaster
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-14 16:40:10 +08:00
quicksilver 00b4b67a1f Update the version of build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-14 16:01:12 +08:00
neza2017 e349508e78 Fix list-collections
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-14 15:57:39 +08:00
XuanYang-cn fd6d0c78e5 Refactor master scheduler: show_collections
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-14 15:37:07 +08:00
zhenshan.cao e94138816f Add tsLoop for master
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-14 15:26:14 +08:00
neza2017 ce969e9568 Update segment
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-14 14:39:52 +08:00
XuanYang-cn 27032cc126 Refactor master scheduler: describe_collection
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-14 13:06:41 +08:00
neza2017 74f8c45a23 Add ListCollection for meta table
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-14 11:50:57 +08:00
dragondriver c2382adf04 Initialize the task scheduler of Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-14 11:24:49 +08:00
FluorineDog f47fc7fef1 Using std::string instead of char * for PlaceholderGroup
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-13 19:37:59 +08:00
godchen 4a3ca1632b Add master partition task implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-13 17:20:13 +08:00
zhenshan.cao 595d827155 Add grpc check logic for master
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-13 16:53:55 +08:00
bigsheeper 83e37d6e36 Add RWMutex to container, use container interface
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-13 16:47:47 +08:00
XuanYang-cn 1b48e84c35 Refactor master scheduler: has_collection
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-13 15:44:02 +08:00
cai.zhang 0b478b614a Change Id to ID in go files according to golint check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-13 15:17:18 +08:00
sunby e541041b28 Add QueryNodeSegStats proto
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-13 14:20:51 +08:00
XuanYang-cn 88cb274644 Refactor master scheduler: drop_collection
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-13 12:46:24 +08:00
quicksilver 792f0679e5 Running as root is not permitted on build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-13 12:27:41 +08:00
cai.zhang cfee642a11 Add ruleguard and open ruleguard check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-13 10:00:32 +08:00
cai.zhang b68322d469 Open golangci-lint check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 17:58:05 +08:00
neza2017 14d4a400dd Load etcd port from etcd
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-12 17:15:01 +08:00
XuanYang-cn 85db2c0438 Fix timesync tests
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-12 15:56:23 +08:00
bigsheeper 93bd786506 Update getPartitionByTag api with collectionName
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 14:46:02 +08:00
bigsheeper b059b02d7f Format id to ID
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 14:34:20 +08:00
FluorineDog f0ec7a8c78 Support Placeholder Parser and refine CreatePlan on predicate-less
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-12 12:18:07 +08:00
cai.zhang 1cd2fd9954 Add the standard of golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 12:04:12 +08:00
godchen 4a11a6431b Add time sync producer
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-12 11:21:21 +08:00
bigsheeper c9c8fb9def Close pulsar channel
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 11:18:23 +08:00
cai.zhang 3b2c86c42d Fix bug for cmake_build dir was changed
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 10:45:46 +08:00
xige-16 205abfbbcd Add pulsar message stream for system
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-11 20:14:20 +08:00
neza2017 d71083bf6b Change master scheduler: CreateCollection
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-11 20:01:04 +08:00
zhenshan.cao 170792d9bc Unify proto package and version
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-11 18:13:20 +08:00
zhenshan.cao 057563d936 Refactor master
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-11 17:53:54 +08:00
XuanYang-cn a2289d3ce6 Add softTimeTickBarrier and hardTimeTickBarrier
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-11 16:41:53 +08:00
dragondriver fb1e24ade8 Refactor task interface of Proxy and fix the wait logic of task
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-11 16:00:56 +08:00
zhenshan.cao c442d50c08 Add global tsoAllocator
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-11 14:17:33 +08:00
bigsheeper b4bd9cf9d6 Add collection, segment, and partition unittest
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-11 11:22:19 +08:00
zhenshan.cao 3b5765ae47 Add proxy timetick
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-11 09:54:01 +08:00
cai.zhang a2f2284932 Add code coverage for go files
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-10 15:56:57 +08:00
FluorineDog 5e67e5eb43 Enable Query Executor without predicates
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-10 13:17:31 +08:00
bigsheeper be409b29c8 Refactor cgo collection, partition and segment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-09 18:07:15 +08:00
zhenshan.cao 87a4495c59 Fix proxy bug
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-09 17:52:47 +08:00
dragondriver be0a2e7e5f Add other data definition related task to Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-09 17:25:53 +08:00
neza2017 980084ff15 Enable github action for go unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-09 17:08:48 +08:00
bigsheeper b441685635 Refactor segment, partition and collection, refactor search and services
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-09 16:27:11 +08:00
neza2017 202ded96b9 Update time tick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-09 14:09:10 +08:00
zhenshan.cao db9957d48b Add unittest for master
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-07 18:03:52 +08:00
dragondriver b8ccbc1c97 Add InsertTask and SearchTask to Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-07 16:18:23 +08:00
neza2017 7e182a230a Fix bug :GetTimeTick not return error if TimeBarrier is closed
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-07 13:19:31 +08:00
zhenshan.cao 86d2d36053 Add MemoryKV, mockkv and tso test
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-06 16:47:18 +08:00
FluorineDog 3ff3a5b659 Add ShowPlanNodeVisitor under visitor pattern
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-06 15:34:39 +08:00
zhenshan.cao 9c490a209b Delete unused code
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-05 19:11:12 +08:00
dragondriver c732c267e1 Refactor proxy framework and add CreateCollection Task
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-05 18:01:33 +08:00
FluorineDog e45df02874 Add Generator for visitor pattern (#89)
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-05 14:30:52 +08:00
bigsheeper 88a3fa31fa Refactor query node and services
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-05 10:52:50 +08:00
XuanYang-cn 425f57e1c7 Replace hand-drawing pictures with OminiGraffle
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-05 10:10:16 +08:00
zhenshan.cao e9122921b9 Use type alias
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-04 17:58:43 +08:00
neza2017 d18c17e786 Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 16:28:14 +08:00
godchen bade037fb2 Add meta_table implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-04 16:01:28 +08:00
zhenshan.cao 2e2e059f8a Add msgheader and change ReqType to MsgType
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-04 15:13:42 +08:00
neza2017 1bd7938d72 Modify logic of time tick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 14:52:03 +08:00
cai.zhang 4194cb5d56 Add cmake_build directory to gitignore and optimize the logic of golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-03 20:19:08 +08:00
bigsheeper 5cc4f7d6be Format go code of reader
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-03 20:16:56 +08:00
bigsheeper d6fe379143 Add insertNode and serviceTimeNode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-03 17:09:51 +08:00
zhenshan.cao da18bc4952 Update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-03 16:38:16 +08:00
zhenshan.cao d587b95361 Fix parameter unmatch
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-03 15:29:59 +08:00
XuanYang-cn 3de52a51c2 Add interface for EtcdKV
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-03 15:08:50 +08:00
zhenshan.cao e962b57fbb Add timestamp allocator
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-03 14:53:36 +08:00
FluorineDog d7ef21c644 Remove message.pb and reformat
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-03 12:42:13 +08:00
GuoRentong fbdc5df96f Update docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-03 12:40:13 +08:00
FluorineDog 9d2fa4e430 Add SyntaxTree of QueryNode and Expr
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-03 11:45:48 +08:00
cai.zhang 9d212505d8 Add Makefile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-03 11:25:47 +08:00
bigsheeper f49c98ed85 Add reader flowgraph about nodes and messages
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-02 19:30:12 +08:00
bigsheeper 8020dc2256 Add flow graph
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-02 16:44:54 +08:00
zhenshan.cao 3e596fa474 Update proto and doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-02 16:01:04 +08:00
neza2017 10217f9485 Add test for etcd kv
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-02 10:26:33 +08:00
GuoRentong 15b6963be0 Replace pdf figs with png figs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-31 15:11:47 +08:00
zhenshan.cao 27b9a51938 Add logic of allocate id
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-30 16:27:58 +08:00
GuoRentong f7bd6ebfad Add docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-29 20:42:47 +08:00
zhenshan.cao 6eee7d1342 Fix bug and update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 19:55:57 +08:00
zhenshan.cao 8324f8853e Fix knowhere build test cache
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 15:50:24 +08:00
bigsheeper 9131a5554a Add etcd, metaTable and scheduler in master
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-29 12:39:41 +08:00
zhenshan.cao bbecf51f8c Move kv directory
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 11:46:34 +08:00
zhenshan.cao f0cc9c8ad3 Add tso for master and add timestamp
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 09:31:08 +08:00
bigsheeper 2df04b6947 Add collection creation, and refactor master
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-28 15:38:24 +08:00
GuoRentong 1cfc6c7f86 Add docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-28 10:09:35 +08:00
quicksilver d66d48c6b6 Enable UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-27 15:51:16 +08:00
shengjh 77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master)
Signed-off-by: shengjh <1572099106@qq.com>
2020-10-27 12:01:27 +08:00
quicksilver eb64839aef Update build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-26 15:45:18 +08:00
FluorineDog a48ca80286 Format Code and duplicate class Segment
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-24 18:04:57 +08:00
bigsheeper 52932da551 Remove segment status
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-24 10:45:57 +08:00
FluorineDog e84b0180c9 Refactor cmake and build script and add timed benchmark
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-23 18:01:24 +08:00
zhenshan.cao 251bc2a19e Fix conf.LoadConfig failed to load yaml file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 18:31:00 +08:00
GuoRentong 974496a2b2 Update issue templates
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-19 17:45:56 +08:00
zhenshan.cao 6a136c1a76 Change import path
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 17:39:51 +08:00
zhenshan.cao 4965a315ad Refact proto generating procedure
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 10:36:40 +08:00
zhenshan.cao 64295db471 Refact master and proxy and add etcdutil
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-15 21:31:50 +08:00