Commit Graph

2886 Commits (0b8fb70bff69b02051e731d5b3fc3213ecb9eee7)

Author SHA1 Message Date
zhenshan.cao 595d827155 Add grpc check logic for master
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-13 16:53:55 +08:00
bigsheeper 83e37d6e36 Add RWMutex to container, use container interface
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-13 16:47:47 +08:00
XuanYang-cn 1b48e84c35 Refactor master scheduler: has_collection
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-13 15:44:02 +08:00
cai.zhang 0b478b614a Change Id to ID in go files according to golint check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-13 15:17:18 +08:00
sunby e541041b28 Add QueryNodeSegStats proto
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-11-13 14:20:51 +08:00
XuanYang-cn 88cb274644 Refactor master scheduler: drop_collection
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-13 12:46:24 +08:00
quicksilver 792f0679e5 Running as root is not permitted on build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-11-13 12:27:41 +08:00
cai.zhang cfee642a11 Add ruleguard and open ruleguard check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-13 10:00:32 +08:00
cai.zhang b68322d469 Open golangci-lint check
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 17:58:05 +08:00
neza2017 14d4a400dd Load etcd port from etcd
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-12 17:15:01 +08:00
XuanYang-cn 85db2c0438 Fix timesync tests
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-12 15:56:23 +08:00
bigsheeper 93bd786506 Update getPartitionByTag api with collectionName
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 14:46:02 +08:00
bigsheeper b059b02d7f Format id to ID
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 14:34:20 +08:00
FluorineDog f0ec7a8c78 Support Placeholder Parser and refine CreatePlan on predicate-less
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-12 12:18:07 +08:00
cai.zhang 1cd2fd9954 Add the standard of golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 12:04:12 +08:00
godchen 4a11a6431b Add time sync producer
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-12 11:21:21 +08:00
bigsheeper c9c8fb9def Close pulsar channel
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-12 11:18:23 +08:00
cai.zhang 3b2c86c42d Fix bug for cmake_build dir was changed
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-12 10:45:46 +08:00
xige-16 205abfbbcd Add pulsar message stream for system
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-11-11 20:14:20 +08:00
neza2017 d71083bf6b Change master scheduler: CreateCollection
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-11 20:01:04 +08:00
zhenshan.cao 170792d9bc Unify proto package and version
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-11 18:13:20 +08:00
zhenshan.cao 057563d936 Refactor master
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-11 17:53:54 +08:00
XuanYang-cn a2289d3ce6 Add softTimeTickBarrier and hardTimeTickBarrier
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-11 16:41:53 +08:00
dragondriver fb1e24ade8 Refactor task interface of Proxy and fix the wait logic of task
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-11 16:00:56 +08:00
zhenshan.cao c442d50c08 Add global tsoAllocator
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-11 14:17:33 +08:00
bigsheeper b4bd9cf9d6 Add collection, segment, and partition unittest
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-11 11:22:19 +08:00
zhenshan.cao 3b5765ae47 Add proxy timetick
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-11 09:54:01 +08:00
cai.zhang a2f2284932 Add code coverage for go files
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-10 15:56:57 +08:00
FluorineDog 5e67e5eb43 Enable Query Executor without predicates
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-10 13:17:31 +08:00
bigsheeper be409b29c8 Refactor cgo collection, partition and segment
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-09 18:07:15 +08:00
zhenshan.cao 87a4495c59 Fix proxy bug
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-09 17:52:47 +08:00
dragondriver be0a2e7e5f Add other data definition related task to Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-09 17:25:53 +08:00
neza2017 980084ff15 Enable github action for go unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-09 17:08:48 +08:00
bigsheeper b441685635 Refactor segment, partition and collection, refactor search and services
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-09 16:27:11 +08:00
neza2017 202ded96b9 Update time tick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-09 14:09:10 +08:00
zhenshan.cao db9957d48b Add unittest for master
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-07 18:03:52 +08:00
dragondriver b8ccbc1c97 Add InsertTask and SearchTask to Proxy
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-07 16:18:23 +08:00
neza2017 7e182a230a Fix bug :GetTimeTick not return error if TimeBarrier is closed
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-07 13:19:31 +08:00
zhenshan.cao 86d2d36053 Add MemoryKV, mockkv and tso test
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-06 16:47:18 +08:00
FluorineDog 3ff3a5b659 Add ShowPlanNodeVisitor under visitor pattern
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-06 15:34:39 +08:00
zhenshan.cao 9c490a209b Delete unused code
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-05 19:11:12 +08:00
dragondriver c732c267e1 Refactor proxy framework and add CreateCollection Task
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-11-05 18:01:33 +08:00
FluorineDog e45df02874 Add Generator for visitor pattern (#89)
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-05 14:30:52 +08:00
bigsheeper 88a3fa31fa Refactor query node and services
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-05 10:52:50 +08:00
XuanYang-cn 425f57e1c7 Replace hand-drawing pictures with OminiGraffle
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-05 10:10:16 +08:00
zhenshan.cao e9122921b9 Use type alias
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-04 17:58:43 +08:00
neza2017 d18c17e786 Add Meta table implementation
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 16:28:14 +08:00
godchen bade037fb2 Add meta_table implementation
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-11-04 16:01:28 +08:00
zhenshan.cao 2e2e059f8a Add msgheader and change ReqType to MsgType
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-04 15:13:42 +08:00
neza2017 1bd7938d72 Modify logic of time tick
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-04 14:52:03 +08:00
cai.zhang 4194cb5d56 Add cmake_build directory to gitignore and optimize the logic of golangci-lint
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-03 20:19:08 +08:00
bigsheeper 5cc4f7d6be Format go code of reader
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-03 20:16:56 +08:00
bigsheeper d6fe379143 Add insertNode and serviceTimeNode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-03 17:09:51 +08:00
zhenshan.cao da18bc4952 Update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-03 16:38:16 +08:00
zhenshan.cao d587b95361 Fix parameter unmatch
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-03 15:29:59 +08:00
XuanYang-cn 3de52a51c2 Add interface for EtcdKV
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-11-03 15:08:50 +08:00
zhenshan.cao e962b57fbb Add timestamp allocator
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-03 14:53:36 +08:00
FluorineDog d7ef21c644 Remove message.pb and reformat
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-03 12:42:13 +08:00
GuoRentong fbdc5df96f Update docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-11-03 12:40:13 +08:00
FluorineDog 9d2fa4e430 Add SyntaxTree of QueryNode and Expr
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-11-03 11:45:48 +08:00
cai.zhang 9d212505d8 Add Makefile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-11-03 11:25:47 +08:00
bigsheeper f49c98ed85 Add reader flowgraph about nodes and messages
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-02 19:30:12 +08:00
bigsheeper 8020dc2256 Add flow graph
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-11-02 16:44:54 +08:00
zhenshan.cao 3e596fa474 Update proto and doc
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-11-02 16:01:04 +08:00
neza2017 10217f9485 Add test for etcd kv
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-11-02 10:26:33 +08:00
GuoRentong 15b6963be0 Replace pdf figs with png figs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-31 15:11:47 +08:00
zhenshan.cao 27b9a51938 Add logic of allocate id
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-30 16:27:58 +08:00
GuoRentong f7bd6ebfad Add docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-29 20:42:47 +08:00
zhenshan.cao 6eee7d1342 Fix bug and update proto
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 19:55:57 +08:00
zhenshan.cao 8324f8853e Fix knowhere build test cache
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 15:50:24 +08:00
bigsheeper 9131a5554a Add etcd, metaTable and scheduler in master
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-29 12:39:41 +08:00
zhenshan.cao bbecf51f8c Move kv directory
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 11:46:34 +08:00
zhenshan.cao f0cc9c8ad3 Add tso for master and add timestamp
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-29 09:31:08 +08:00
bigsheeper 2df04b6947 Add collection creation, and refactor master
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-28 15:38:24 +08:00
GuoRentong 1cfc6c7f86 Add docs
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-28 10:09:35 +08:00
quicksilver d66d48c6b6 Enable UnitTest
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-27 15:51:16 +08:00
shengjh 77b2fcf015 Refactor manipulationreq and add tso(pre-alloc from master)
Signed-off-by: shengjh <1572099106@qq.com>
2020-10-27 12:01:27 +08:00
quicksilver eb64839aef Update build environment
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-10-26 15:45:18 +08:00
FluorineDog a48ca80286 Format Code and duplicate class Segment
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-24 18:04:57 +08:00
bigsheeper 52932da551 Remove segment status
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-10-24 10:45:57 +08:00
FluorineDog e84b0180c9 Refactor cmake and build script and add timed benchmark
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-10-23 18:01:24 +08:00
zhenshan.cao 251bc2a19e Fix conf.LoadConfig failed to load yaml file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 18:31:00 +08:00
GuoRentong 974496a2b2 Update issue templates
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-10-19 17:45:56 +08:00
zhenshan.cao 6a136c1a76 Change import path
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 17:39:51 +08:00
zhenshan.cao 4965a315ad Refact proto generating procedure
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-19 10:36:40 +08:00
zhenshan.cao 64295db471 Refact master and proxy and add etcdutil
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-10-15 21:31:50 +08:00