Commit Graph

6524 Commits (c875fdf913205852d75c6f9d3608b6600763c676)

Author SHA1 Message Date
dragondriver e61903ea36 Add query interface for cgo index wrapper
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-01-04 10:42:51 +08:00
bigsheeper 1ba47ac433 Check system field in segCore
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-01-04 10:13:01 +08:00
bigsheeper b7fc945aca Add flush msg unmarshal function register
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-31 17:25:45 +08:00
xige-16 bfb18df7e7 Parse result_id from target entry
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-31 16:53:57 +08:00
quicksilver 1927eaf88b Add revive linter
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-31 16:38:37 +08:00
zhenshan.cao 59878b1dbb Add lazy connect logic for indexbuilder
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-31 15:44:06 +08:00
dragondriver 6cd8c2528d Add parameter check for almost all index type
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-31 15:16:03 +08:00
xige-16 29b21b4bf2 Refactor reduce strategy in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-31 14:49:27 +08:00
sunby 4808b46246 Filter indexable fields in flush scheduler
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-30 19:56:54 +08:00
dragondriver 2e198e2783 Add support for idmap, nsg, sq8
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-30 19:37:45 +08:00
FluorineDog 09620efadf Merge from master
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-30 18:50:56 +08:00
zhenshan.cao adf77c423c Update knowhere
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-30 18:30:51 +08:00
bigsheeper 4835d82060 Add index builder test cases
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-30 18:16:34 +08:00
sunby e7998da797 Fix bug when starting indexbuilder
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-30 16:41:24 +08:00
neza2017 e05c441fc9 Modify Makefile to compile binlog
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-30 14:09:00 +08:00
XuanYang-cn 3a2e2a04b6 Fix writenode bug
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-29 21:15:00 +08:00
GuoRentong 1abc69277b Update doc: service api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-29 18:02:44 +08:00
bigsheeper bb8da15691 Return status and add try catch exception in index builder
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-29 17:53:27 +08:00
quicksilver b1b8747477 Add logic of incremental check for go code
Signed-off-by: quicksilver <zhifeng.zhang@zilliz.com>
2020-12-29 17:19:44 +08:00
dragondriver 243346247b Add unittest case which used in regression to index builder
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-29 16:31:03 +08:00
bigsheeper 1e3b7cd55e Fix binary vector metric type validation
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-29 16:14:52 +08:00
xige-16 be32a33eff Refactor loadIndexTest to test diffrent index params
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-29 14:43:40 +08:00
XuanYang-cn 884f66d56d Fix timesync start twice in master
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-29 14:10:22 +08:00
cai.zhang 37a55f3c1d Update sdk version
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-29 12:51:19 +08:00
cai.zhang f80536ed77 Update the logic of running go unittest
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-29 11:56:37 +08:00
XuanYang-cn 9577da9fce Add writenode main
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-28 18:52:34 +08:00
FluorineDog eb8717188e Enable load index
Signed-off-by: FluorineDog <guilin.gou@zilliz.com>
2020-12-28 17:55:48 +08:00
dragondriver f67aae9596 Fix the codec bug of cgo wrapper of index builder
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-28 16:55:50 +08:00
bigsheeper 5b9e8c4f60 Add write node client segment flushing
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-28 15:25:16 +08:00
godchen d489183798 Random generate querynode channel in unittest
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2020-12-28 15:24:20 +08:00
XuanYang-cn aab6dede4a Add Flush for DDBuffer and insertBuffer
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-28 11:29:17 +08:00
dragondriver 11cef6e978 Add support to build binary index
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-28 10:00:02 +08:00
GuoRentong e8ec0424d8 Update doc: service api
Signed-off-by: GuoRentong <rentong.guo@zilliz.com>
2020-12-27 09:05:24 +08:00
neza2017 7e8b203fe2 Add time tick in wite node
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-26 17:05:24 +08:00
XuanYang-cn e316533a3a Add Flush Sync service
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-26 16:28:55 +08:00
bigsheeper 5acc9681d6 Fix search error about metric type
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-26 15:29:48 +08:00
xige-16 d599407e2b Add unittest for loadIndex service
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-26 14:16:51 +08:00
cai.zhang 2031c54746 Add unittest about index in proxy
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2020-12-26 11:51:07 +08:00
sunby a56f8f7b9e Add runtime stats in master
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-25 18:32:03 +08:00
sunby e21397d68a Add runtime stats unittest
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-25 16:08:35 +08:00
sunby a03ab05c6c Add DescribeIndex and DescribeIndexProgress RPC
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-25 15:39:56 +08:00
dragondriver 84a0cf7097 Add unittest to c index wrapper
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2020-12-25 11:10:31 +08:00
XuanYang-cn c0797333ce Add ddl binlog metaTable in writenode
Signed-off-by: XuanYang-cn <xuan.yang@zilliz.com>
2020-12-24 20:55:40 +08:00
neza2017 4dbf4ade41 Add test for master
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 16:19:42 +08:00
zhenshan.cao a0244b7683 Add segment expire logic for proxy
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>
2020-12-24 16:53:31 +08:00
bigsheeper 4ecdea698f Refactor query node and query serviceMain changes:1. Add ddBuffer and save binLog.
2. Trans to insertData.
3. Change dataFields data to Data, dim to Dim4. Add float vector and binary vector.5. Deserialize data and convert to InsertData.6. Move all data into InsertData.7. Add insert buffer and hash string.
8. Add minIOkV in insertBuffer node.
9. Init write node insertBuffer maxSize from writeNode.yaml.
10. Add ddBuffer.
11. Add ddBuffer binLog and minio.
12. Add ddNode unittest.
13. Remove redundant call.
14. Increase test time.
15. Delete ddl const, use request's timestamp instead.

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2020-12-24 15:38:29 +08:00
xige-16 f5198bcaee Add LoadIndexService in query node
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:51:55 +08:00
sunby add31188ba Add CreateIndex RPC
Signed-off-by: sunby <bingyi.sun@zilliz.com>
2020-12-24 14:50:16 +08:00
xige-16 14332d49fb Add minio for regression
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2020-12-24 14:34:14 +08:00
neza2017 0afeaa78c8 Fix unittest of flow graph
Signed-off-by: neza2017 <yefu.chen@zilliz.com>
2020-12-24 14:10:00 +08:00