Commit Graph

33 Commits (810be533ab40ffc45a8a3649bfe8c9c9347219a4)

Author SHA1 Message Date
bigsheeper 810be533ab Add gcNode, and remove msg's downstream index
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-06 14:02:25 +08:00
cai.zhang 1cfc2ff0a5 Add make clean in Makefile
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-01-06 13:50:48 +08:00
zhenshan.cao b06e01f523 Initmate querynode collection manager
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2021-01-06 11:31:36 +08:00
godchen 1c87faf8b3 Add insert request opentracing
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-01-06 11:17:35 +08:00
FluorineDog e16a7478da Add verifier
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2021-01-05 20:13:54 +08:00
XuanYang-cn 05f1350e19 Add writenode to ci
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-05 15:14:59 +08:00
quicksilver ca89ece576 Fix go format bug
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2021-01-05 14:20:45 +08:00
neza2017 8b39643e44 Fix write node crashed if collection meta not existed
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2021-01-05 12:20:46 +08:00
sunby 95b162ccfd Refactor flush scheduler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2021-01-05 10:57:59 +08:00
bigsheeper d5d9fa03ea Disable the dropCollection filtering
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-04 20:46:00 +08:00
bigsheeper 33e1e17045 Fix writer client DescribeSegment api
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-04 20:16:15 +08:00
bigsheeper cb3ca1ab7c Refactor kvPath param and unify the segment flush kvPath in write node
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-04 14:17:59 +08:00
XuanYang-cn 03b5d32569 Add default fields when create collection
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2021-01-04 12:03:29 +08:00
XuanYang-cn 3a2e2a04b6 Fix writenode bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-29 21:15:00 +08:00
XuanYang-cn 9577da9fce Add writenode main
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-28 18:52:34 +08:00
FluorineDog eb8717188e Enable load index
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-28 17:55:48 +08:00
bigsheeper 5b9e8c4f60 Add write node client segment flushing
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-28 15:25:16 +08:00
XuanYang-cn aab6dede4a Add Flush for DDBuffer and insertBuffer
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-28 11:29:17 +08:00
neza2017 7e8b203fe2 Add time tick in wite node
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-26 17:05:24 +08:00
XuanYang-cn e316533a3a Add Flush Sync service
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-26 16:28:55 +08:00
XuanYang-cn c0797333ce Add ddl binlog metaTable in writenode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-24 20:55:40 +08:00
neza2017 4dbf4ade41 Add test for master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 16:19:42 +08:00
zhenshan.cao a0244b7683 Add segment expire logic for proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-24 16:53:31 +08:00
bigsheeper 4ecdea698f Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog.
2. Trans to insertData.
3. Change dataFields data to Data, dim to Dim4. Add float vector and binary vector.5. Deserialize data and convert to InsertData.6. Move all data into InsertData.7. Add insert buffer and hash string.
8. Add minIOkV in insertBuffer node.
9. Init write node insertBuffer maxSize from writeNode.yaml.
10. Add ddBuffer.
11. Add ddBuffer binLog and minio.
12. Add ddNode unittest.
13. Remove redundant call.
14. Increase test time.
15. Delete ddl const, use request's timestamp instead.

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-24 15:38:29 +08:00
XuanYang-cn 7ce0f27ebc Add buffer to minIO for binlogs
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-23 18:06:04 +08:00
zhenshan.cao 11316525e5 Fix bug of running unittest in parallel
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-22 22:08:03 +08:00
XuanYang-cn 87521adfbd Add logic of deserilize rawData into InsertData
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-21 16:27:03 +08:00
zhenshan.cao 9694203f8b Add writer client and metatable for writer
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-21 10:06:46 +08:00
zhenshan.cao 3f6e926aef Refactor indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-13 06:48:05 +08:00
bigsheeper 585d3f9831 Refactor param table, and add ddNode
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-11 17:20:14 +08:00
XuanYang-cn d64aa37db3 Add KFlush msg type
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-11 12:01:20 +08:00
zhenshan.cao ca34353e9b Add writernode client
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-11 11:38:32 +08:00
XuanYang-cn 881be7f3e3 Impl minimum runable writenode and writenode flowgraph
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-09 20:07:27 +08:00