SimFG
|
d7f38a803d
|
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>
Signed-off-by: SimFG <bang.fu@zilliz.com>
|
2022-09-16 16:56:49 +08:00 |
congqixia
|
91663a6603
|
Fix bloom filter size not match (#19140)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-13 14:12:31 +08:00 |
|
congqixia
|
68a6587374
|
Set insert&stats binlog timestamp range (#19005)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-09-04 09:05:09 +08:00 |
|
congqixia
|
f0846fb79b
|
Handles DropPartitionMsg in datanode flowgraph (#18292)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2022-07-15 17:12:27 +08:00 |
Ten Thousand Leaves
|
5e1e7a6896
|
Fix an issue that causes flush hanging (#17169)
issue: #16628
Signed-off-by: Yuchen Gao <yuchen.gao@zilliz.com>
|
2022-05-25 14:34:00 +08:00 |
bigsheeper
|
a4ea2fb18a
|
Handle errors in DataNode and QueryNode flow graph (#17096)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
|
2022-05-24 21:11:59 +08:00 |
godchen
|
bb7a0766fe
|
Add dependency factory (#16204)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-04-07 22:05:32 +08:00 |
xige-16
|
99984b88e1
|
Support delete varChar value (#16229)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-04-02 17:43:29 +08:00 |
|
xige-16
|
205c92e54b
|
Support insert string data (#15993)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
|
2022-03-25 14:27:25 +08:00 |
xiyichan
|
ca129d4308
|
Support configurable msgstream (#16131)
Signed-off-by: xiyichan <2863768433@qq.com>
|
2022-03-24 10:15:25 +08:00 |
|
godchen
|
78557ca6d7
|
Replace minio kv with minio chunk manager (#15936)
Signed-off-by: godchen0212 <qingxiang.chen@zilliz.com>
|
2022-03-17 18:03:23 +08:00 |
jaime
|
7a3a721380
|
Reconstruct mqstream module (#15784)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
|
2022-03-03 21:57:56 +08:00 |
|
bigsheeper
|
13177a90af
|
Add prometheus metrics for DataNode (#15650)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
Co-authored-by: Cai Yudong <yudong.cai@zilliz.com>
|
2022-02-28 19:11:55 +08:00 |
Cai Yudong
|
f1ea9613ae
|
Add EtcdConfig and move PulsarConfig/RocksdbConfig/MinioConfig into BaseParamTable (#15434)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-02-07 10:09:45 +08:00 |
|
Cai Yudong
|
7efb02a4c5
|
Use PulsarConfig in GlobalParams for all components (#15046)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-01-09 23:45:33 +08:00 |
|
Cai Yudong
|
f8f61fb116
|
Use BaseParams etcd configuration for all components (#15012)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2022-01-07 16:15:26 +08:00 |
|
Cai Yudong
|
891c202b73
|
Use GlobalParamTable for all components (#13885)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-12-23 18:39:11 +08:00 |
Bingyi Sun
|
0c39e0370c
|
Move segment statistics update to datanode tt loop (#13233)
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2021-12-15 10:53:16 +08:00 |
XuanYang-cn
|
dbf757e08b
|
Change genKey into JoinIDPath (#12959)
1. Simplify genKey(), make genKey a rpc call
2. Unify the usage of JoinIDPath
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-12-09 11:09:06 +08:00 |
|
congqixia
|
8f9e62fa18
|
Apply DropVirtualChannel and FlushManager drop mode (#12563)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-12-02 16:39:33 +08:00 |
|
congqixia
|
e813867652
|
Implement Drop mode for flush manager (#12469)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-12-01 10:11:39 +08:00 |
|
congqixia
|
579416e3d3
|
Apply retry for flush manager execution (#11808)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-15 17:19:10 +08:00 |
|
Bingyi Sun
|
5c8978e5d6
|
Fix drop segment bug (#11709)
issue: #11708
Signed-off-by: sunby <bingyi.sun@zilliz.com>
Co-authored-by: sunby <bingyi.sun@zilliz.com>
|
2021-11-12 17:31:11 +08:00 |
|
XuanYang-cn
|
c4bb73dc74
|
Complete drop collection procedure in DN (#11552)
drop, cancel compaction, flush all buffers and release fg
See also: #11426
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-11-11 20:56:49 +08:00 |
|
congqixia
|
0e5931a3da
|
Add mergedTimetickSender for datanode (#11297)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-05 14:59:32 +08:00 |
|
congqixia
|
0ef95c5df1
|
Add timeticker logger for insert buffer node (#11216)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-11-04 15:40:14 +08:00 |
|
godchen
|
b63a9521c2
|
Make gen msg private (#10115)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-11-04 15:36:19 +08:00 |
|
XuanYang-cn
|
21d98c2825
|
Add binlog io for compaction (#10536)
See also: #9530
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-25 20:13:51 +08:00 |
|
congqixia
|
2713988ff2
|
Merge auto manual flush with same segment id (#10550)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-25 18:03:42 +08:00 |
|
congqixia
|
5737e0075f
|
Apply flush manager logic in datanode (#10142)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-19 11:04:34 +08:00 |
|
congqixia
|
0438ed2bfe
|
Use single signal chan to notify flush (#10075)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-10-18 12:34:34 +08:00 |
|
XuanYang-cn
|
dcd56a575d
|
[skip ci]Update license for flowgraph of dn (#9962)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-15 18:07:09 +08:00 |
|
godchen
|
a2dc0d8808
|
Init segment replica bloom filter (#9770)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-14 10:24:33 +08:00 |
|
XuanYang-cn
|
aac6323cff
|
Use config as parameter (#9707)
Make functions in flowgraph lesser parameters
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-10-13 11:16:32 +08:00 |
|
godchen
|
59ab0e441c
|
Add bloom filter for stats (#9630)
* Add bloom filter for stats
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* trigger GitHub actions
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-10-13 10:22:33 +08:00 |
|
Cai Yudong
|
84e568ee32
|
Support Delete in datanode (#8505)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-11 16:31:44 +08:00 |
|
Cai Yudong
|
b9f5a6bb1e
|
Rename some variables in unittest (#9484)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-08 17:47:25 +08:00 |
|
Cai Yudong
|
ec9ec97cec
|
Fix typo (#9482)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-10-08 17:45:35 +08:00 |
|
XuanYang-cn
|
ebd894d8b7
|
Refactor buffer size calculation (#8565)
This PR changes the datanode insertBufSize config
from 32000 number of rows to 16MB
Resolves: #7741
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-26 20:55:59 +08:00 |
|
Cai Yudong
|
b2e5627061
|
Rename insertMsg to flowGraphMsg in datanode flow graph (#8546)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-09-26 10:43:57 +08:00 |
|
XuanYang-cn
|
d816a81ee3
|
Make FlushSegments async (#8159)
Resolves: #8122
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-23 16:03:54 +08:00 |
|
XuanYang-cn
|
46c72c57c2
|
Add BufferData in insertbufferNode (#8138)
Optimize bufferInsertMsg param to avoid a second transfer
of endposition
See also: #8058, #7741
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-18 14:25:50 +08:00 |
|
XuanYang-cn
|
6c434b4801
|
Improve codes in insertbuffernode (#8054)
Add error handling in insertbuffernode
See also: #7624, #7684
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-17 16:27:56 +08:00 |
|
XuanYang-cn
|
82d4d19337
|
Remove not in use segmentCheckPoints (#8039)
Resolves: #8037
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-09-17 16:25:55 +08:00 |
|
congqixia
|
69794fd32d
|
Refactor insertBufferNode and add unit tests (#7621)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-09-09 15:00:00 +08:00 |
|
congqixia
|
65f168eac1
|
Fix datanode corner cases (#7336)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
|
2021-08-30 10:03:58 +08:00 |
sunby
|
4f7c3e7d3a
|
Save binlog path in SegmentInfo (#6590)
issue: #6589
Signed-off-by: sunby <bingyi.sun@zilliz.com>
|
2021-08-19 13:00:12 +08:00 |
|
godchen
|
db94d7771f
|
Read vector from disk (#6707)
* Read vector from disk
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* go fmt
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix git action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix test error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix caculate error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change var name
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix len error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* remove unused code
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change bytes to float method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* change float to bytes method
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
* fix action error
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
|
2021-07-24 09:25:22 +08:00 |
|
Cai Yudong
|
92e429d812
|
Rename IndexService to IndexCoord (#5932)
* rename package indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix queryservice static-check
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move distributed/indexservice to distributed/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* move internal/indexservice to internal/indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename indexservice to indexcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename MasterComponent to RootCoordComponent
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for queryservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for dataservice
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for datanode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for proxynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord for querynode
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename master to rootcoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* rename IndexService to IndexCoord
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
* fix rebase issue
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
|
2021-06-21 17:28:03 +08:00 |
|
XuanYang-cn
|
441300140d
|
Tidy replica (#5920)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
|
2021-06-21 16:00:22 +08:00 |