Commit Graph

120 Commits (3c9840d6d3daff609a57cf71f44642c657f60e60)

Author SHA1 Message Date
Enwei Jiao 89b810a4db
Refactor all params into ParamItem (#20987)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-12-07 18:01:19 +08:00
congqixia a8e6d5d47e
Fix delete operation scope to vchannel (#20866)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-11-29 15:15:15 +08:00
wei liu c5cd92d36e
update target (#19296)
Signed-off-by: Wei Liu <wei.liu@zilliz.com>

Signed-off-by: Wei Liu <wei.liu@zilliz.com>
2022-11-07 19:37:04 +08:00
bigsheeper d528aa3d90
Print seek postion time and seek elapse (#20271)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>

Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-11-03 15:03:35 +08:00
Xiaofan 2bfecf5b4e
Refine bloomfilter and memory usage (#20168)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-31 17:41:34 +08:00
yah01 404fc68afa
Fix dead locks (#20121)
the collection's lock and meta replica's lock

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-27 20:53:32 +08:00
Xiaofan 3d316fc052
Fix Query Log Level (#19995)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-25 19:29:36 +08:00
yah01 a4fb3cc3e2
Fix panic while applying deletions (#19956)
Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-10-21 14:25:29 +08:00
SimFG a55f739608
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
Xiaofan db3f4be49d
Simplify flow graph node to pipeline mode (#19667)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>

Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-10-10 22:15:22 +08:00
congqixia d79f88c5f6
Fix segmentPtr concurrent visit and destroy (#19560)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-29 21:54:55 +08:00
yah01 51eb12a034
Fix QueryNode panics (#19541)
Applying delete messages during the segment was compacted,
the QueryNode would panic.

Signed-off-by: yah01 <yang.cen@zilliz.com>

Signed-off-by: yah01 <yang.cen@zilliz.com>
2022-09-29 18:02:54 +08:00
Enwei Jiao fc8061bb86
improve logs to debug growing segment load failed (#19419)
Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>

Signed-off-by: Enwei Jiao <enwei.jiao@zilliz.com>
2022-09-26 17:36:54 +08:00
SimFG d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
Bingyi Sun 626854cf0c
Refactor QueryCoord (#18836)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>

Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: yah01 <yang.cen@zilliz.com>
Co-authored-by: Wei Liu <wei.liu@zilliz.com>
Co-authored-by: Congqi Xia <congqi.xia@zilliz.com>
2022-09-15 18:48:32 +08:00
bigsheeper 7d6624fcad
Improve flow graph node name and log msgID in QueryCoord (#18043)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-07-05 16:46:23 +08:00
Jiquan Long 875b6f88b0
Add channel information to flow graph node (#17349)
Signed-off-by: longjiquan <jiquan.long@zilliz.com>
2022-06-15 21:04:10 +08:00
xige-16 dd483beefd
Delete the log that prints a lot of deleteMsg.timestamps (#17543)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-06-15 20:46:14 +08:00
bigsheeper 7a59a80506
Remove segmentPtr lock and use collection lock instead (#17303)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-06-02 14:00:04 +08:00
bigsheeper f55fe6be3c
Merge historical replica and streaming replica in QueryNode (#17217)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-31 13:42:03 +08:00
bigsheeper a4ea2fb18a
Handle errors in DataNode and QueryNode flow graph (#17096)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-24 21:11:59 +08:00
zhenshan.cao 08a4dff41d
Add logic for search merging and a simple task scheduler for read tasks (#17022)
Signed-off-by: zhenshan.cao <zhenshan.cao@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>

Co-authored-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: bigsheeper <yihao.dai@zilliz.com>
2022-05-23 16:41:58 +08:00
xige-16 c2f1d65fa1
Print err info when insert msg not aligned (#16305)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-05-17 13:01:57 +08:00
Xiaofan 92b6293be4
Fix QueryNode log level (#16604)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-05-07 10:27:51 +08:00
xige-16 515d0369de
Support string type in segcore (#16546)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
Co-authored-by: dragondriver <jiquan.long@zilliz.com>

Co-authored-by: dragondriver <jiquan.long@zilliz.com>
2022-04-29 13:35:49 +08:00
xige-16 99984b88e1
Support delete varChar value (#16229)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-04-02 17:43:29 +08:00
bigsheeper 9d673006e0
Improve primary keys print (#16232)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-28 23:15:27 +08:00
xige-16 205c92e54b
Support insert string data (#15993)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2022-03-25 14:27:25 +08:00
bigsheeper 9ad5c14a4a
Return error when create message stream failed in QueryNode (#15317)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2022-03-09 15:17:59 +08:00
Jiquan Long f71651e294
Support column-based insert data in message stream (#15802)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2022-03-04 15:09:56 +08:00
jaime 7a3a721380
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-03-03 21:57:56 +08:00
Cai Yudong 891c202b73
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-12-23 18:39:11 +08:00
bigsheeper 1ca08d9138
Simplify flow graph in QueryNode (#13613)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-17 20:12:42 +08:00
xige-16 8b2cd271c7
Improve querynode log (#13158)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-12-10 18:51:08 +08:00
bigsheeper 61d910b219
[skip ci] Add comment for newInsertNode (#13117)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 22:19:40 +08:00
bigsheeper acd59cd380
[skip ci] Add comment for getPrimaryKeys (#13116)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 22:17:50 +08:00
bigsheeper cbf284ab35
[skip ci] Add comment for insertNode delete (#13115)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 22:16:03 +08:00
bigsheeper 3e9e7f707b
[skip ci] Add comment for insertNode insert (#13037)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:13:53 +08:00
bigsheeper b206980feb
[skip ci] Add comment for filterSegmentsByPKs (#13036)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:12:00 +08:00
bigsheeper e858006fd8
[skip ci] Add comment for processDeleteMessages (#13035)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-09 14:10:06 +08:00
bigsheeper 0ba224dbf6
[skip ci] Add comment for insertData (#12821)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 13:53:13 +08:00
bigsheeper c85a21edef
[skip ci] Add comment for insertNode operate (#12908)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 09:27:31 +08:00
bigsheeper 2b74d22b72
[skip ci] Add comment for insertNode name (#12907)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-08 09:25:40 +08:00
bigsheeper 4d80ea2b11
[skip ci] Add comment for deleteData (#12906)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-07 21:29:21 +08:00
bigsheeper 7149a9f23c
[skip ci] Add comment for insertNode (#12820)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-12-06 21:15:48 +08:00
XuanYang-cn 16c1fe8098
[skip ci]Update license for qn fg insert (#12555)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-12-01 18:43:32 +08:00
godchen c4f0837d84
Fix insert pks overwrite (#12365)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-29 22:01:41 +08:00
bigsheeper 93149c5ad9
Load growing segment in query node (#11664)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-12 18:27:10 +08:00
godchen 639800241d
Make flow graph for delta channel (#11379)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-09 09:27:04 +08:00
godchen a0a3a889e7
Add common endian for global use (#11092)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-02 18:16:32 +08:00