d982058d3b
Merge pull request #7588 from ywk253100/240329_ut
...
Improve the UT code coverage for pkg/podvolume
2024-03-29 15:36:54 +08:00
18976c0a62
kopia: index compaction during maintenance
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-29 15:24:47 +08:00
beb221b15c
Merge pull request #7587 from blackpiglet/move_actions
...
Add actions directory for backup and restore.
2024-03-29 15:10:38 +08:00
039fc20b65
Improve the UT code coverage for pkg/podvolume
...
Improve the UT code coverage for pkg/podvolume
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-29 15:02:30 +08:00
5462035469
Delete the unneeded pvRestorer action in
...
handleSkippedPVHasRetainPolicy
According to comment, calling executePVAction aims to reset PV's
claimRef, but the reset logic was moved into resetVolumeBindingInfo
since release-1.4.
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-03-29 14:12:12 +08:00
08c93b4145
Add actions directory for backup and restore.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-03-29 13:21:50 +08:00
81da8e67c7
Merge pull request #7585 from Lyndon-Li/issue-fix-7535
...
Issue fix 7535
2024-03-29 10:48:48 +08:00
9b74643b3a
Merge branch 'main' into issue-fix-7535
2024-03-29 10:28:53 +08:00
070e99da3d
issue 7535: don't exclude resources in MustHave list during restore
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-29 10:14:54 +08:00
8d10b68eda
Improve the concurrency for PVBs in different pods
...
Improve the concurrency for PVBs in different pods
Fixes #6676
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-29 09:58:50 +08:00
b06d7a467f
Support update the backup VolumeInfos by the Async ops result.
...
1. Add PutBackupVolumeInfos method.
2. Add CompletionTimestamp in VolumeInfo.
3. Add Size in SnapshotDataMovementInfo.
4. Update CompletionTimpstmap, SnapshotHandle, RetainedSnapshot
and Size in VolumeInfo on DataUpload Operation completes.
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-03-28 19:52:44 +08:00
65e8ddb89b
Merge branch 'main' into issue-fix-7535
2024-03-28 18:37:39 +08:00
d640cc16ab
Merge pull request #7573 from mmorel-35/golangci-lint-exclude-rules
...
golangci-lint: use exclude-rules instead of skip-files and skip-dirs
2024-03-28 16:39:40 +08:00
e80bdcf2e2
Merge pull request #7451 from qiuming-best/maintenance-job
...
Add repository maintenance job
2024-03-28 14:47:15 +08:00
8d63c76c92
Add maintenance job
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-03-28 03:22:06 +00:00
ef04ef6361
golangci-lint: use exclude-rules instead of skip-files and skip-dirs
...
Signed-off-by: Matthieu MOREL <matthieu.morel35@gmail.com>
2024-03-27 20:17:34 +00:00
3c704ba1b1
linter(testifylint): use Len or Empty for arrays testing ( #7555 )
...
Signed-off-by: Matthieu MOREL <matthieu.morel35@gmail.com>
2024-03-27 14:16:58 -04:00
35d2534e19
Check the existence of the namespaces provided in the "--include-namespaces" option
...
Check the existence of the namespaces provided in the "--include-namespaces" opt
ion and reports validation error if not found
Fixes #7431
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-27 18:37:03 +08:00
cd0632c5db
Merge pull request #7549 from ywk253100/240318_cert
...
Support certificate-based authentication for Azure
2024-03-27 18:15:32 +08:00
a2c87fc8b2
Merge pull request #7438 from Lyndon-Li/batch-delete-snapshot
...
Issue 7281: batch delete snapshot
2024-03-27 13:31:07 +08:00
d538fc87ad
batch delete snapshot
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-27 11:21:51 +08:00
25188248d6
Merge pull request #7559 from Lyndon-Li/open-kopia-with-no-index-change
...
Bump up Kopia to v0.16.0 and open kopia repo with no index change
2024-03-26 13:08:27 +08:00
3c243653c4
Add confirm flag to velero plugin add
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2024-03-26 05:56:11 +07:00
5d48e36b55
open kopia with no index change
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-25 18:14:43 +08:00
929731cf8b
issue 7535: don't exclude resources in MustHave list during restore
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-25 16:23:34 +08:00
19e5f38cbc
update after review
...
Signed-off-by: lou <alex1988@outlook.com>
2024-03-25 12:42:28 +08:00
365423d220
Merge pull request #7512 from qiuming-best/support-parallel-restore
...
Make parallel restore configurable
2024-03-25 10:49:40 +08:00
4c95edd8ba
Support certificate-based authentication for Azure
...
Support certificate-based authentication for Azure
Fixes #6735
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-21 15:59:37 +08:00
efb94ae610
Refactor the native snapshot definition code.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-03-20 15:38:07 +08:00
67c06e613a
Merge pull request #7504 from allenxu404/pv-patch-in-finalizing-phase
...
Patch newly dynamically provisioned PV with volume info to restore PV's custom setting
2024-03-20 09:56:03 +08:00
64a3f2aa3a
Make parallel restore configurable
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-03-19 15:15:47 +08:00
67b5e82d49
Patch newly dynamically provisioned PV with volume info to restore custom setting of PV
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-03-18 17:32:35 +08:00
dccde10368
issue-7036: make affinity as list and take 1st one
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-18 11:25:27 +08:00
7ce35ece4a
Issue 7529: fix gvr `Group` and `Version` field missing in `KindFor` method
...
Signed-off-by: zhouhao <zhouhao@cmss.chinamobile.com>
2024-03-15 10:07:03 +08:00
6c0cb4bf89
Merge pull request #7521 from qiuming-best/data-mover-empty-dir
...
Fix DataDownload fails during restore for empty PVC workload
2024-03-14 16:07:43 +08:00
74ffa50bb4
Fix DataDownload fails during restore for empty PVC workload
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-03-14 07:22:59 +00:00
00b9869369
do not ignore unknown gvr at the beginning and get new gr when kind is changed
...
Signed-off-by: lou <alex1988@outlook.com>
2024-03-14 15:21:00 +08:00
4d01c7ffa3
Check whether the VolumeSnapshot's source PVC is nil before using it.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-03-13 11:21:48 +08:00
79e9e31d8d
Merge pull request #7489 from ywk253100/240229_lib
...
Bump up the versions of several Kubernetes-related libs
2024-03-12 16:12:56 +08:00
84c1eca66c
Merge pull request #7497 from qiuming-best/resource-polices-log-adjust
...
Adjust resource policies logic in BackupPodVolumes
2024-03-08 14:21:53 +08:00
6e76e03a8b
Adjust resource policies log
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-03-07 05:43:28 +00:00
8752c3a820
Bump up the versions of severel Kubernetes-related libs
...
Bump up the versions of severel Kubernetes-related libs
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-05 13:09:38 +08:00
f274fe7bfc
Merge pull request #7488 from Lyndon-Li/issue-fix-7391
...
Issue 7391:remove the default constraint for node-agent pods
2024-03-04 13:18:17 +08:00
d558e49288
issue 7391:remove the default constraint for node-agent pods
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-04 11:01:02 +08:00
97d276caa7
Merge pull request #7452 from Lyndon-Li/issue-fix-7211
...
Issue 7211: support concatenate objects
2024-03-04 10:34:37 +08:00
157984279b
Merge pull request #7472 from blackpiglet/7045_fix
...
Skip pvb creation when pvc excluded
2024-03-01 10:09:37 +08:00
2b8bb871d3
Add the finalization phase to the restore workflow
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-02-29 13:51:45 +08:00
e727d29bcd
Merge pull request #7467 from blackpiglet/7464_fix
...
Modify the label used by the restore CLI to filter the PVR.
2024-02-29 10:07:36 +08:00
36d58943cd
Skip pvb creation when pvc excluded
...
Signed-off-by: Shahaf Bahar <sbahar@redhat.com>
2024-02-27 16:30:29 +08:00
bb4a62f3a7
Modify the label used by the restore CLI to filter the PVR.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-02-26 10:41:51 +08:00
e1bcdf0f63
issue 7308: change the data path requeue time to 5 second
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-02-22 10:10:33 +08:00
24c4eb075f
issue 7211: support concatenate objects
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-02-21 17:34:04 +08:00
74bf4c3d80
Merge pull request #7443 from ywk253100/240219_credential
...
Don't return error when no credential file found
2024-02-21 16:03:55 +08:00
84fb88c19c
Adjust the logic for the backup_last_status metrics to stop incorrectly incrementing over time
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-02-21 13:21:03 +08:00
f6383916a2
Don't return error when no credential file found
...
Don't return error when no credential file found
Fixes #7395
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-02-19 17:02:30 +08:00
57879357fc
Merge branch 'main' into batch-delete-snapshot
2024-02-18 14:54:01 +08:00
32d92ca964
batch delete snapshot
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-02-18 14:49:21 +08:00
7bf7fb9fc1
issue 7036: fail early by peek expose
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-02-18 14:34:35 +08:00
27348ca039
Fix the `velero repo get` nil pointer issue.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-02-08 14:25:29 +08:00
a5c72a4866
BackupRepositories associated with a BSL are invalidated when BSL is (re-)created. ( #7380 )
...
* Add BackupRepositories invalidation on BSL Create
Simplify comments
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
* Simplify
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
---------
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2024-02-06 10:13:30 -05:00
9649619a6f
Put credential related config into getStorageCredentials function
...
Put credential related config into getStorageCredentials function
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-02-05 16:09:15 +08:00
9a907a21f2
issue-7036:data mover load affinties
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-02-05 14:13:10 +08:00
30728c248c
Respect the config in BSL when IRSA is configured
...
This commit makes sure when kopia connects to the repository the
crendentials file specified in BSL.spec.config has the higher priority over
Pod Environment credentials when IRSA is configured.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2024-02-01 16:33:10 +08:00
08a020ebcd
Merge pull request #7370 from blackpiglet/add_uploader_config_for_schedule
...
Add `ParallelFilesUpload` for schedule creation.
2024-01-31 11:22:17 +08:00
7aaf62442a
Add `ParallelFilesUpload` for schedule creation.
...
Modify restore-helper print information.
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-01-31 07:52:11 +08:00
b30a679e5b
Merge pull request #7368 from qiuming-best/bsl-bug-fix
...
Fix server start failure when no default BSL
2024-01-30 16:26:45 +08:00
5fc8b3f426
Fix server start failure when no default BSL
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-01-30 06:09:15 +00:00
c8ad69ab04
Check whether the API resource exists before creating the informer cache
...
Check whether the API resource exists before creating the informer cache
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-24 12:41:00 +08:00
673bfefd45
Log the error got from the discovery helper
...
Log the error got from the discovery helper
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-22 15:24:53 +08:00
270b1de6a1
Do not attempt restore resource with no available GVK in cluster ( #7322 )
...
Check for GVK before attempting restore.
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2024-01-22 09:50:13 +08:00
427a254136
Specify the Kind explicitly in the API resource
...
Specify the Kind explicitly in the API resource to avoid wrong Kind conversion
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-19 12:51:56 +08:00
3ac48a43c2
Merge pull request #7329 from kart2/uk/spell-check
...
fix typo maintenance of log message
2024-01-18 14:25:50 +08:00
198fbf6873
fix typo maintenance of log message
...
Signed-off-by: Karthick Udayakumar <kudayakumar@vmware.com>
2024-01-17 22:30:41 -05:00
956248e8a6
Create informer per resources to avoid huge memory consumption
...
Create informer per resources to avoid huge memory consumption
Fixes #7323
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-18 10:47:00 +08:00
cbe5a36a3c
Merge pull request #7254 from learner0810/reduce-backup-deepCopy
...
Returns directly when backup status is BackupPhaseFailedValidation No need for DeepCopy
2024-01-17 21:41:24 +08:00
f66aa9f3b3
Merge pull request #7284 from learner0810/fix-item-operation-timeout-explain
...
Update itemOperationTimeout Default Timeout Note
2024-01-17 14:58:15 +08:00
d676bfde22
Increase the k8s client QPS/burst
...
Increase the k8s client QPS/burst to avoid throttling request errors
Fixes #7127
Fixes #3191
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-12 15:02:05 +08:00
e498ea99a3
Merge pull request #7295 from josemarevalo/main
...
Add CRD name to error message when it is not ready to use
2024-01-12 14:59:48 +08:00
0b307ca035
Add CRD name to error message when it is not ready to use
...
When debugging this error it is currently hard to identify what
CRD is causing the issue. This is particularly difficult when
dealing with over a hundred CRDs.
Signed-off-by: Jose Arevalo <jose.matias.arevalo@gmail.com>
2024-01-10 12:11:47 +10:00
9a1be6f53f
Make "disable-informer-cache" option false(enabled) by default to keep it consistent with the help message
...
Make "disable-informer-cache" option false(enabled) by default to keep it consi
stent with the help message
Fixes #7264
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-10 09:49:54 +08:00
306a8fda3e
fix-item-operation-timeout-explain
...
Signed-off-by: zhongjun.li <zhongjun.li@daocloud.io>
2024-01-08 15:00:06 +08:00
200fd80448
isue 6928: remove snapshot deletion timeout for PVB
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-01-08 11:28:23 +08:00
a5d08ac5f0
Do not set "targetNamespace" to namepsace items
...
fixes #7263
This commit makes the data structures more consistent, that namespaces,
as cluster scoped resource will not have "targetNamespace" in the
"restoreableItem" instance.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2024-01-05 14:01:16 +08:00
e84a51deec
Merge pull request #7262 from qiuming-best/intermediate-pv-delete
...
Fix intermediate PV delete for data mover
2024-01-04 15:45:32 +08:00
c3c4c97914
Merge pull request #7265 from Lyndon-Li/change-node-agent-config-name
...
Change node-agent-config name
2024-01-04 15:43:43 +08:00
92fdf407c7
Fix intermediate pv delete for data mover
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-01-04 03:26:47 +00:00
58ead55fd1
change node-agent-config name
...
Signed-off-by: Lyndon-Li <yonghui.li@broadcom.com>
2024-01-03 22:02:04 +08:00
08dedd8b66
Rename volumeinfo metadata file.
...
Change from <backup-name>-volumeinfos.json.gz to
<backup-name>-volumeinfo.json.gz.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2024-01-03 11:22:49 +08:00
8e4cefbb0d
Reduce backup DeepCopy
...
Signed-off-by: zhongjun.li <zhongjun.li@daocloud.io>
2024-01-02 11:34:40 +08:00
8c84836644
Fix pvc assignment
...
Signed-off-by: zhongjun.li <zhongjun.li@daocloud.io>
2023-12-29 15:09:41 +08:00
60d2c62c1a
issue 7244: delete incomplete snapshot automatically for kopia uploader
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-22 16:44:00 +08:00
ee345cf281
Adjust the newline output of resource list in restore describer ( #7238 )
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-12-22 10:53:29 +05:30
7d2c749abf
Merge pull request #7231 from blackpiglet/update_volumeinfo_json_tag
...
Don't generate empty structure.
2023-12-21 16:32:58 +08:00
9be8eb0c6d
Don't generate empty structure.
...
VolumeInfo contains several sub-structures. They are filled for
different scenarios. Do not generate empty structure for the
not filled sub-structures.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-21 14:53:03 +08:00
210838267f
issue 7237: add pvc namespace to backup describe
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-21 10:02:27 +08:00
0da01842ad
remove csi feature check from backup describe
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-20 14:51:21 +08:00
a44cd4be33
Merge pull request #7222 from qiuming-best/adjust-bsl-setting-logic
...
Adjust velero server side default backup location setting logic
2023-12-20 10:29:59 +08:00
8f6d46be87
Remove the redundant newline in backup describe output
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-12-19 15:25:37 +08:00
7d2be128ae
Move velero server side default backup location setting logic to server startup
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-12-19 05:43:29 +00:00
ee879fdcc3
Merge pull request #7221 from blackpiglet/schedule_cli_fix
...
Fix shedule get and describe CLI nil pointer issue
2023-12-18 20:44:03 +08:00
Xun Jiang/Bruce Jiang
Lyndon-Li
qiuming
Wenkai Yin(尹文开)
Xun Jiang
lyndon-li
Matthieu MOREL
Tiger Kaovilai
lou
allenxu404
zhouhao
Shahaf Bahar
Daniel Jiang
Karthick Udayakumar
Jose Arevalo
zhongjun.li
Lyndon-Li
Xun Jiang
Qi Xu