Commit Graph

6115 Commits (9038521aa3ac5ea459781eb6998aa1dc514b77ec)

Author SHA1 Message Date
dragondriver adfb5187cf Dock build index task with storage & indexbuilder
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-22 00:14:36 +00:00
cai.zhang 05918f55d2 Impl CreateIndex interface for proxy server
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-22 15:39:10 +08:00
GuoRentong 9d5c93744c Fix figure path
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-22 14:47:55 +08:00
sunby 3a1c210098 Add runtime stats to record field stats
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 20:24:40 +08:00
godchen 8f87ee632e Add field id when create collection
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-21 19:31:24 +08:00
godchen e90ef211c2 Add flush, build index, load index scheduler
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-21 19:30:24 +08:00
cai.zhang b582cf7b8e Add the interface of index in proto
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-21 19:28:54 +08:00
dragondriver d023c1afba Refactor index wrapper, use protobuf instead of json to pass data
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-21 16:36:07 +08:00
XuanYang-cn 87521adfbd Add logic of deserilize rawData into InsertData
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-21 16:27:03 +08:00
FluorineDog d5daa18392 Enable most DSL-related cases
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-21 14:45:00 +08:00
sunby 06620935ab Move expire timestamp to SegIDAssignment
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 10:51:37 +08:00
zhenshan.cao 9694203f8b Add writer client and metatable for writer
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-21 10:06:46 +08:00
sunby f360ed7004 Add unittests
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-21 09:56:35 +08:00
sunby c71cd40f68 Refactor segment manager
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-19 12:55:24 +08:00
FluorineDog e65cfe1e3d Enable complex dsl parser
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-19 10:36:49 +08:00
zhenshan.cao 0d75840ed6 Fix missing file
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-18 18:35:03 +08:00
neza2017 0110ba6bd2 List events of binlog
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-12 16:52:09 +08:00
dragondriver da9ea7d2b9 Add cgo wrapper to index builder
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-18 15:44:27 +08:00
godchen 475d36a2c9 Add data codec
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-18 15:21:25 +08:00
zhenshan.cao 3f6e926aef Refactor indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-13 06:48:05 +08:00
FluorineDog 1540cffbb1 Add executor for expression
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-12 18:17:53 +08:00
cai.zhang 54f2b79f1b Add indexbuilder client
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-12 17:10:42 +08:00
neza2017 07d68de2a3 Fix data codec
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-11 18:14:19 +08:00
bigsheeper 585d3f9831 Refactor param table, and add ddNode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-11 17:20:14 +08:00
neza2017 8df05714a8 Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-11 12:01:38 +08:00
FluorineDog e54d5ccf19 Fix push failed because git hook detects "wrong error"
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-11 14:59:13 +08:00
XuanYang-cn d64aa37db3 Add KFlush msg type
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-11 12:01:20 +08:00
zhenshan.cao ca34353e9b Add writernode client
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-11 11:38:32 +08:00
xige-16 0067e2d989 Add load index client in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-11 11:29:54 +08:00
cai.zhang 62e9002348 Add git-hooks for check code
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-11 11:29:07 +08:00
FluorineDog 02f855359a Fix term bug and add todo note
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-10 20:13:37 +08:00
zhenshan.cao fc054874d3 Add index_builder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-10 17:55:55 +08:00
bigsheeper 762b1e1f1f Add ddService, fieldID, requestID and refactor params table, fix nil hits search result bug
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-10 16:31:09 +08:00
neza2017 9585819154 Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-10 15:50:09 +08:00
quicksilver 046aa3529f Publish image using Docker-in-Docker
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 15:27:30 +08:00
neza2017 9cbebc0221 Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-10 14:52:42 +08:00
sunby 16071d92b5 Modify metatable close segment interface.
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-10 13:35:09 +08:00
quicksilver e805be5e9c Show ccache statistics
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 10:20:39 +08:00
quicksilver 21721d2e03 Cache go mod workflow for jenkins pipeline
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-10 09:57:14 +08:00
neza2017 5512ce8d8a Add binlog unittest
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-10 09:31:29 +08:00
XuanYang-cn 881be7f3e3 Impl minimum runable writenode and writenode flowgraph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-09 20:07:27 +08:00
neza2017 de12fa5a10 Add binlog event
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-09 11:18:13 +08:00
FluorineDog 968ddc6016 Fix thrift.a not found
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-09 14:57:07 +08:00
sunby ed54d3e26c Fix binlog reader bug
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-09 09:55:56 +08:00
quicksilver d09ad77fb2 Add archiving file workflow for cache thirdparty
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-08 19:53:22 +08:00
sunby 8ace1c3837 Add binlog serialization and deserialization
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-08 19:13:39 +08:00
XuanYang-cn e6f726e73a Add cache for thirdparty files cache
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 18:51:07 +08:00
sunby 6fddb992f4 Add binlog desgin to chap08_binlog.md
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-03 10:16:22 +08:00
XuanYang-cn 32977e270c Add impl cgo of parquet
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-08 14:41:04 +08:00
zhenshan.cao 65ce1f97e7 Fix bug: pulsar dirty msg
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-07 19:41:39 +08:00