Commit Graph

77 Commits (4d1ab28d4f56d44af80c7b8f25c89466c38a133f)

Author SHA1 Message Date
SimFG a55f739608
Separate public proto files (#19782)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-10-16 20:49:27 +08:00
SimFG 45f5007410
Improve the `DescribeIndex` RPC about the state and row num (#19528)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-30 10:56:54 +08:00
cai.zhang b648034cee
Fix bug for statistical metrics is incorrect (#19357)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-28 11:02:54 +08:00
cai.zhang 1c489a85b2
Add ut for IndexCoord (#19349)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-23 09:58:51 +08:00
cai.zhang 17f5e3c7fe
Drop segment indexes when drop partition (#19022)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-23 09:36:51 +08:00
cai.zhang fc3309b8b8
All indexes segments both write handoff (#19230)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-21 16:34:51 +08:00
SimFG d7f38a803d
Separate some proto files (#19218)
Signed-off-by: SimFG <bang.fu@zilliz.com>

Signed-off-by: SimFG <bang.fu@zilliz.com>
2022-09-16 16:56:49 +08:00
cai.zhang 525201decc
Mark index meta as deleted when segment is compacted (#19163)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-15 15:44:31 +08:00
cai.zhang e65ba6331e
Only store segmentID for flushed segments event (#19075)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-09 15:52:35 +08:00
cai.zhang 11b4f4e901
Fix typo for index code (#18971)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-05 17:37:11 +08:00
cai.zhang 6d37b1db17
Fix bug for umarshal index model (#18959)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-09-01 17:18:57 +08:00
cai.zhang 34c9eae16f
Add IndexCoord ut and fix data race (#18897)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-08-31 10:23:04 +08:00
cai.zhang c924f73105
Refactor for IndexCoord to support cloud (#18643)
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>

Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
Co-authored-by: Zach41 <zongmei.zhang@zilliz.com>
2022-08-25 15:48:54 +08:00
jaime 0e95f8a690
Refine indexcoord logs (#18589)
Signed-off-by: yun.zhang <yun.zhang@zilliz.com>

Signed-off-by: yun.zhang <yun.zhang@zilliz.com>
2022-08-11 10:00:38 +08:00
cai.zhang 90faf4a212
Fix bug for IndexCoord recycles index files (#18168)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-08 16:54:22 +08:00
cai.zhang 0ad15a22c8
IndexCoord handle events correctly (#17878)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-07-07 14:44:21 +08:00
Xiaofan a9b1d71a8f
change the etcd compareAndSwap interface (#18068)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-07-06 13:54:21 +08:00
cai.zhang 899a9bf86d
IndexNode still writes finished state to ETCD when task was deleted (#17761)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-28 12:08:17 +08:00
cai.zhang ef0fc37ad7
Fixed the bug that IndexCoord lost some meta information (#17818)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-27 21:52:17 +08:00
cai.zhang e8f53af749
When the task is canceled, reduce the load of node (#17735)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-23 19:22:15 +08:00
cai.zhang 1fbdafc943
IndexCoord does not assign task to IndexNode prematurely (#17717)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-23 10:40:13 +08:00
cai.zhang 141a3bbe00
Mark deleted before drop index (#17490)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-06-17 18:08:12 +08:00
Xiaofan af994b5e1c
Fix etcd watch error (#17364)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-06-06 16:26:06 +08:00
cai.zhang bcf3b7426a
Add distributed lock for segment refgerence (#16782)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-31 16:36:03 +08:00
cai.zhang b37b87eb97
The GetIndexFilePaths interface judges whether the index is complete (#17052)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2022-05-17 20:41:56 +08:00
cai.zhang c8688a6275
Organize log for GetIndexFilePaths (#16230)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-03-28 21:27:27 +08:00
cai.zhang b435c422c1
Add prometheus metrics for IndexCoord (#15638)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2022-02-21 17:15:51 +08:00
Xiaofan f617c8887b
Time Tick Failed need log (#15225)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2022-01-14 23:55:34 +08:00
Xiaofan 1408926cd9
Remove logs without enough info (#14440)
Signed-off-by: xiaofan-luan <xiaofan.luan@zilliz.com>
2021-12-29 10:06:47 +08:00
cai.zhang df82dcc783
[skip e2e]Add log for HasSameReq in indexcoord (#14233)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 23:14:50 +08:00
cai.zhang 74cf787c1d
[skip e2e]Format log for LoadMetaFromETCD in indexcoord (#14234)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 14:58:19 +08:00
cai.zhang 33afe1b576
[skip e2e]Add log for GetUnassignedTasks in indexcoord (#14232)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 14:56:24 +08:00
cai.zhang 0b77c4455e
[skip e2e]Add log for GetUnusedIndexFiles in indexcoord (#14223)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-25 11:42:21 +08:00
cai.zhang 2e70326f31
[skip e2e]Format log for DeleteIndex in indexcoord (#14068)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 21:40:25 +08:00
cai.zhang 62b7e09163
[skip e2e]Add log for GetIndexFilePathInfo in indexcoord (#14067)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 21:38:34 +08:00
cai.zhang a53140bd39
[skip e2e]Add log for GetIndexStates in indexcoord (#14066)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-23 17:13:15 +08:00
JackLCL bf66721ea3
[skip e2e]Fix error log output format in meta_table.go (#14027)
Signed-off-by: JackLCL <chenglong.li@zilliz.com>
2021-12-23 14:25:53 +08:00
congqixia ef3b71f22b
Use indexInfo SerializedSize when estimating segment size (#13969)
Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
2021-12-22 20:27:34 +08:00
cai.zhang e2da1ae598
Adjust the order of import packages for meta_table.go (#13501)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-16 15:31:52 +08:00
cai.zhang 70fdee850c
[skip ci]Add comment for HasSameReq in indexcoord (#13344)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 18:39:09 +08:00
edward.zeng 1858ef9924
[skip ci] Refine indexcoord meta table comment (#13360)
Signed-off-by: Edward Zeng <jie.zeng@zilliz.com>
2021-12-14 18:33:32 +08:00
cai.zhang f604d13090
[skip ci]Add comment for GetUnassignedTasks in indexcoord (#13347)
Signed-off-by: cai.zhang <cai.zhang@zilliz.com>
2021-12-14 16:55:07 +08:00
cai.zhang f6c17ce4b6
[skip ci]Add comment for LoadMetaFromETCD (#13343)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 16:45:34 +08:00
cai.zhang 4d578f6c13
[skip ci]Add comment for GetIndexMetaByIndexBuildID (#13345)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 16:39:46 +08:00
cai.zhang 259a728a4e
[skip ci]Add comment for GetNodeTaskStats (#13342)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-14 16:37:58 +08:00
cai.zhang a2a9f47575
[skip ci]Add comment for DeleteIndex in indexcoord (#13171)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-10 21:09:00 +08:00
cai.zhang d6ed860a67
[skip ci]Add comment for GetUnusedIndexFiles in indexcoord (#13175)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-10 17:09:08 +08:00
cai.zhang 9a8e1be36e
[skip ci]Add comment for UpdateRecycleState in indexcoord (#13173)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-10 17:07:22 +08:00
cai.zhang 29f4a209c0
[skip ci]Add comment for GetIndexFilePathInfo in indexcoord (#13059)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 15:49:51 +08:00
cai.zhang 6f71bf42d4
[skip ci]Add comment for GetIndexStates in indexcoord (#13058)
Signed-off-by: Cai.Zhang <cai.zhang@zilliz.com>
2021-12-09 15:47:51 +08:00