Commit Graph

3359 Commits (ac175b6f00f55c50a86a793f7a54d7ac784547b8)

Author SHA1 Message Date
yukun 18b9f7810c
[skip ci]Format rocksdbkv (#12033)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-17 22:01:31 +08:00
yukun d482f8aa9f
[skip ci]Add license in reader.go (#12032)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-17 21:59:38 +08:00
congqixia b7de3bda3b
Fix mem_kv.go slice 0 length declaration (#11996)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-17 20:57:17 +08:00
bigsheeper 7df9600e5d
[skip ci] Add comment for removePartitionFlowGraph (#12027)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-17 20:27:24 +08:00
bigsheeper f07b3ff8cb
[skip ci] Add comment for startPartitionFlowGraph (#12026)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-17 20:25:29 +08:00
dragondriver aa17f561fe
[skip ci] Add comment for AlterAlias (#12020)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-17 19:57:12 +08:00
congqixia bc765ea65b
Fix start position for seek into a mark (#12008)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-17 19:55:16 +08:00
dragondriver c4adca9773
[skip ci] Add comment for DropAlias (#12019)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-17 19:53:18 +08:00
dragondriver 2d4f691905
[skip ci] Add comment for CreateAlias (#12018)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-17 19:51:24 +08:00
XuanYang-cn 3acb73ebe6
[skip ci]Update license for qc task (#12016)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:49:32 +08:00
XuanYang-cn de95a6c866
[skip ci]Update license for qc qn (#12015)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:47:36 +08:00
XuanYang-cn ed8cfed18a
[skip ci]Update license for qc mock (#12014)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:45:45 +08:00
XuanYang-cn 403be89420
[skip ci]Update license for qc meta (#12013)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:43:50 +08:00
XuanYang-cn e8398eb02d
[skip ci]Update license for qc impl (#12012)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:41:41 +08:00
XuanYang-cn 360d89d2cf
[skip ci]Update license for qc cluster (#12011)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 19:39:17 +08:00
edward.zeng 2b566eb622
[skip ci] Refine comments in mem kv (#12006)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-17 19:27:27 +08:00
edward.zeng bcb7cce026
[skip ci] Refine comment in minio kv (#12004)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-17 19:25:20 +08:00
edward.zeng 776a01b5b9
[skip ci] Add comment to embed etcd kv (#12003)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-11-17 19:23:25 +08:00
XuanYang-cn 7dbb4d10e5
Fix DeltaLogs empty yet appending a deltaInfo bug (#11984)
- Add more logs for startpositions

Fixes: #11970

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 17:57:11 +08:00
Baiqiang Zhao ba9977951a
Fix log in indexnode (#11988)
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-11-17 16:41:13 +08:00
shaoyue b231965e15
[skip ci] Add comments for exported funcs in internal/proxy/task.go (#11980)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-17 16:13:17 +08:00
shaoyue 6e5334ab11
[skip ci] Add comments for exported funcs in mem_kv.go (#11979)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-17 16:11:16 +08:00
shaoyue 585d9be439
[skip ci] Add comments for exported funcs in etcd_kv.go (#11975)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-17 16:09:23 +08:00
xige-16 55d162356b
Fix wrong set of segmentLoadInfo.enableIndex (#11964)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 14:37:11 +08:00
Xiaofan d37fdf9379
Remove component.yaml (#11959)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 14:35:10 +08:00
godchen a1d1b3d0b6
Add reader interface (#11973)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-17 14:11:11 +08:00
xige-16 53012efbe4
Fix query coord panic when handoff (#11962)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 12:27:10 +08:00
Xiaofan f654621650
Remove the etcd deletion of segment data path on querynode (#11863)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-11-17 12:13:10 +08:00
congqixia 5e550a8793
Add close for flushManager (#11874)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-17 10:39:15 +08:00
XuanYang-cn 9bd3664672
Fix compaction bug (#11816)
This PR fixes:
- timeout in compaction
- BinlogIterator using rawID as PKField bug

See also: #11757

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-17 10:07:13 +08:00
xige-16 8a0ee27799
Estimate segment size according index and binlog file header (#11875)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-17 09:47:12 +08:00
congqixia 5edbb82610
Add session revoke (#11908)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 22:31:14 +08:00
xige-16 7908045a28
[skip ci] Fix golint of removeQueryChannel in queryCoord (#11941)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:53:13 +08:00
xige-16 544f1da95b
[skip ci] Fix golint of addQueryChannel in queryCoord (#11940)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:51:18 +08:00
xige-16 acd75c312a
[skip ci] Fix golint of WatchDeltaChannels in queryCoord (#11939)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 21:49:25 +08:00
Bingyi Sun e3e4dc7153
Improve GetVChanPosistion and fix unit tests (#11888)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 21:41:50 +08:00
bigsheeper 77b6dc2081
[skip ci] Add comment for getPartitionFlowGraphs (#11930)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:39:49 +08:00
bigsheeper b79bf56226
[skip ci] Add comment for addPartitionFlowGraph (#11929)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:37:57 +08:00
bigsheeper 6e22d079ee
[skip ci] Add comment for removeCollectionDeltaFlowGraph (#11928)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 21:36:03 +08:00
cai.zhang 95bd08961e
[skip ci]Fix golint for DescribeIndex in rootcoord (#11927)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 21:34:05 +08:00
cai.zhang 247049a65e
[skip ci]Fix golint for DropIndex in rootcoord (#11926)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 21:32:15 +08:00
cai.zhang 171228f3ec
[skip ci]Fix golint for ShowPartitions in rootcoord (#11925)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 21:28:00 +08:00
dragondriver eaea788b6b
[skip ci] Add comment for Query (#11905)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 19:25:35 +08:00
dragondriver b265ac0dd7
[skip ci] Add comment for Flush (#11904)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 19:23:40 +08:00
Cai Yudong b0f268e087
Add more debug log for proxy registry in rootcoord (#11899)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 19:21:49 +08:00
dragondriver ef7575fe29
[skip ci] Add comment for Search (#11903)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 19:19:31 +08:00
dragondriver 8c951217ee
Fix wrong distances caused by metric type (#11901)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 19:11:10 +08:00
shaoyue 6542b092b2
[skip ci] Add comments of exported items in etcd_kv.go (#11884)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-16 17:41:11 +08:00
yukun 79fc84f3db
Optimize updatePageInfo in rocksmq (#11711)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 17:13:10 +08:00
yukun da9228ab37
Add topic lock for DestroyTopic (#11786)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 17:07:10 +08:00
Xiangyu Wang 12f50cb22c
[skip ci]Update OWNERS files (#11898)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-16 15:41:11 +08:00
yukun 897d6b5fc8
Check rmq retention only by page (#11508)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 14:49:11 +08:00
Cai Yudong 29e9adc7be
Fix golint warnings for rootcoord (#11872)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:27:11 +08:00
Cai Yudong 173e7b3808
Fix golint warnings for rootcoord/root_coord.go (#11871)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:25:17 +08:00
congqixia 7e43b568ee
Add dropped ts and apply when gc scan dropped segments (#11838)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-16 14:23:21 +08:00
yukun 27d711e5d2
Insert task hash by primarykeys (#11819)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 14:21:27 +08:00
Cai Yudong 959d8c2ce1
Fix golint warnings for rootcoord/meta_table.go (#11870)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 14:19:20 +08:00
shaoyue 5b50731ff4
Fix searchResultBufFlags & queryResultBufFlags memory leak (#11585)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-16 14:13:12 +08:00
shaoyue 53c29088b0
[skip ci] Add comment for exported funcs in mem_key.go (#11877)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-16 13:23:10 +08:00
shaoyue 6322eb31e7
[skip ci] Add comments for exported things in policy.go (#11876)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-16 13:21:16 +08:00
Bingyi Sun b8c5239784
Add compaction retention config (#11793)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 11:47:10 +08:00
Bingyi Sun 8b60aa8c4e
Skip single compaction if there's no delta log in a segment (#11806)
Signed-off-by: sunby <bingyi.sun@zilliz.com>

Co-authored-by: sunby <bingyi.sun@zilliz.com>
2021-11-16 11:23:11 +08:00
Cai Yudong fd45a7ee5f
Remove redundant header file in segcore/SegmentGrowingImpl.cpp (#11831)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 10:37:12 +08:00
Cai Yudong a58f6b4820
Reorder header files for segcore/SegmentGrowing.h (#11829)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 10:35:16 +08:00
Cai Yudong e920b6d6ff
Reorder header files for segcore/SegmentGrowingImpl.h (#11830)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-16 10:33:16 +08:00
xige-16 1278f4f356
[skip ci] Fix golint of watchDmChannels in queryCoord (#11861)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:35:14 +08:00
xige-16 354fd03729
[skip ci] Fix golint of releaseSegments in queryCoord (#11860)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:33:20 +08:00
xige-16 20a1c9774b
[skip ci] Fix golint of loadSegments in queryCoord (#11859)
Signed-off-by: xige-16 <xi.ge@zilliz.com>
2021-11-16 09:31:24 +08:00
bigsheeper 94d516bc61
[skip ci] Fix golint error for MockRootCoord (#11857)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:29:29 +08:00
bigsheeper 698071de6f
[skip ci] Fix golint error for segmentInsert (#11856)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:27:36 +08:00
bigsheeper fc0a34f40d
[skip ci] Fix golint error for segmentDelete (#11855)
Signed-off-by: bigsheeper <yihao.dai@zilliz.com>
2021-11-16 09:25:40 +08:00
yukun 5e19629b3b
[skip ci]Format rocksdbkv (#11854)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 09:23:45 +08:00
yukun 36966504b1
[skip ci]Format rocksdbkv (#11853)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 09:21:48 +08:00
yukun 8593d75fd1
[skip ci]Format rocksdbkv (#11852)
Signed-off-by: fishpenguin <kun.yu@zilliz.com>
2021-11-16 09:19:55 +08:00
cai.zhang 2ea70b6ead
[skip ci]Fix golint error for HasPartition in rootcoord (#11850)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 09:18:00 +08:00
cai.zhang a7be2e1943
[skip ci]Fix golint error for DropPartition in rootcoord (#11849)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 09:16:08 +08:00
cai.zhang 42ffb26e64
[skip ci]Fix golint error for GetComponentStates in rootcoord (#11848)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-11-16 09:14:00 +08:00
dragondriver da854d783e
[skip ci] Add comment for Delete (#11844)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 09:10:20 +08:00
dragondriver e551283634
[skip ci] Add comment for Insert (#11843)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 09:08:08 +08:00
dragondriver 471ce979e3
[skip ci] Add comment for GetIndexState (#11842)
Signed-off-by: dragondriver <jiquan.long@zilliz.com>
2021-11-16 09:05:35 +08:00
congqixia fa6314393a
Fix compactor loop closure captured (#11814)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-15 19:44:10 +08:00
shaoyue 513ea9fa40
[skip ci] Add Comments for exported datacoord.Server methods (#11797)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-15 19:30:38 +08:00
jaime 3a9d6ee070
[skip ci] Add a log (#11729)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Co-authored-by: yun.zhang <yun.zhang@zilliz.com>
2021-11-15 19:26:49 +08:00
Xiangyu Wang f26ab5c29a
[skip ci]Improve import statements (#11635)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-15 19:24:52 +08:00
Xiangyu Wang ad09fb70ba
[skip ci]Improve import statements (#11634)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-15 19:22:45 +08:00
Xiangyu Wang 537e302e22
[skip ci]Improve import statements (#11633)
Signed-off-by: Xiangyu Wang <xiangyu.wang@zilliz.com>
2021-11-15 19:20:34 +08:00
shaoyue f8583bb582
[skip ci] Add comment for exported struct Allocator (#11795)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-15 19:18:14 +08:00
shaoyue 6fd3b376e9
[skip ci] Add comment for export method in DataNode.Compaction (#11794)
Signed-off-by: shaoyue.chen <shaoyue.chen@zilliz.com>
2021-11-15 19:15:56 +08:00
congqixia 304bbd3e71
Add ConsumeAfterSeek interface (#11818)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-15 18:17:10 +08:00
Cai Yudong ecae18ad40
Use LOG_SEGCORE_ERROR_ instead of std::cout (#11802)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 18:13:09 +08:00
congqixia 579416e3d3
Apply retry for flush manager execution (#11808)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-11-15 17:19:10 +08:00
Cai Yudong b0054f1b48
Update C API NewSegment (#11809)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:57:09 +08:00
Cai Yudong 1f28dba497
Use API HandleCStatus to handle CStatus returned by CGo in querynode (#11789)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 16:13:10 +08:00
Cai Yudong 106ed4d4ee
Reorder header files for segcore/segment_c.cpp (#11800)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 15:43:10 +08:00
Cai Yudong 95fff75dec
Use API HandleCStatus to handle CStatus returned by CGo in indexnode (#11788)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 15:27:10 +08:00
XuanYang-cn f3852c1db0
Add more specific logs (#11724)
Signed-off-by: yangxuan <xuan.yang@zilliz.com>
2021-11-15 15:25:09 +08:00
godchen 4d58ff2df7
Fix reload delta channel error (#11783)
Signed-off-by: godchen <qingxiang.chen@zilliz.com>
2021-11-15 15:17:09 +08:00
Cai Yudong b3d85adb6e
Use API HandleCStatus to handle CStatus returned by CGo in storage (#11782)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 13:27:09 +08:00
nameczz be18922a19
[skip ci] Add GetIndexBuildProgressRequest comments in milvus.proto (#10652)
Signed-off-by: Gitea <zizhao.chen@zilliz.com>
2021-11-15 11:25:09 +08:00
Cai Yudong 34ae61d8e2
Move HandleCProto into query node (#11763)
Signed-off-by: yudong.cai <yudong.cai@zilliz.com>
2021-11-15 11:05:09 +08:00