28d64c2c52
Merge pull request #7775 from blackpiglet/add_volume_backup_result
...
Add volume backup result
2024-07-02 13:42:32 +08:00
ff634862b4
issue 7903: add a limitation clarification for waitForSingleConsumer PVC ( #7948 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-07-01 17:58:20 -04:00
df28134e25
Add result in backup VolumeInfo.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-07-02 00:20:36 +08:00
20676c1ae7
new data path for data mover ms
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-07-01 19:07:00 +08:00
9c20b5ca15
Merge pull request #7576 from Lyndon-Li/data-mover-micro-service-design
...
Data mover micro service design
2024-07-01 13:48:48 +08:00
544d7965c6
data mover micro service design
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-06-27 11:28:32 +08:00
9614ead033
Don't consider unschedulable pods unrecoverable
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2024-06-17 10:05:52 -04:00
2b57b4ca03
Update release note of 1.14
...
Signed-off-by: Daniel Jiang <daniel.jiang@broadcom.com>
2024-06-13 11:21:00 +08:00
bd68bb4936
Update changelog for v1.14
...
Signed-off-by: Daniel Jiang <daniel.jiang@broadcom.com>
2024-05-23 17:20:57 +08:00
a91d2cb036
Modify the volume helper logic.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-05-23 09:57:21 +08:00
49eab81807
Merge pull request #7805 from piny940/fix-backuplog-error
...
Fix backup log to show error string, not index
2024-05-21 14:07:42 +08:00
5943d385c1
Merge pull request #7779 from shubham-pampattiwar/vol-policy-extension-docs
...
Add documentation for extension of volume policy feature
2024-05-21 13:38:20 +08:00
2706667750
add documentation for extension of volume policy feature
...
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
add changelog
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
add more examples
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
remove snapshotVolumes flag req
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
fix intendation
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
add more notes re:snapshot action
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2024-05-20 11:54:35 -07:00
059effce97
Add change log 7805
...
Signed-off-by: piny940 <83708535+piny940@users.noreply.github.com>
2024-05-18 11:08:18 +09:00
65a831ed67
Merge pull request #7762 from kaovilai/waitBackupRepoErrsVerbose
...
Surface errors when waiting for backupRepository
2024-05-17 10:03:19 +08:00
6c2b66b480
Modify the wrong ConfigMap name in v1.13 node-agent-concurrency document. ( #7715 )
...
Fix condition matching in resource modifier when there are multiple rules
Signed-off-by: lou <alex1988@outlook.com>
Co-authored-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-05-14 17:01:50 -04:00
7e19cdbcc6
Merge pull request #7757 from kaovilai/addExistingResourcePolicyRestoreCRValidation
...
Add existingResourcePolicy restore CR validation to controller.
2024-05-14 11:35:58 +08:00
14e98b89ad
Migrate from github.com/Azure/azure-storage-blob-go to github.com/Azure/azure-sdk-for-go/sdk/storage/azblob
...
Signed-off-by: Matthieu MOREL <matthieu.morel35@gmail.com>
2024-05-10 09:24:35 +00:00
2c6853b6e8
Surface errors when waiting for backupRepository
...
Make errors such as those found in https://github.com/vmware-tanzu/velero/issues/6928#issuecomment-1759369183
Makes errors easier to understand than "timed out waiting for the condition"
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2024-05-09 17:20:33 -04:00
e1bef5b6c2
Add existingResourcePolicy restore CR validation to controller.
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2024-05-01 11:39:03 -04:00
01a2d952ac
Merge pull request #7664 from shubham-pampattiwar/vol-policy-extension-impl
...
Extend Volume Policies feature to support more actions
2024-04-24 13:39:36 +08:00
8d2bef2486
Extend Volume Policies feature to support more actions
...
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
fix volume policy action execution
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
remove unused files
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
add changelog file
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
fix CI linter errors
fix linter errors
address pr review comments
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
fix via make update cmd
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
address PR feedback and add tests
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
fix codespell
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
fix ci linter checks
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
remove volsToExclude processing from volume policy logic and add tests
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
fix ci linter issue
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2024-04-23 12:54:14 -07:00
da2267fa3d
Bump up the version of KinD and k8s in github actions
...
Signed-off-by: Daniel Jiang <daniel.jiang@broadcom.com>
2024-04-22 18:17:15 +08:00
884bcbec98
Fix the typecheck error reported by the lint GitHub action.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-04-19 18:41:16 +08:00
2eeaf4d55e
Modify namespace filter logic for backup with label selector.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-04-18 10:30:59 +08:00
f04fbbcc41
Merge pull request #7687 from reasonerjt/restore-desc-vol-info
...
Display CSI snapshot restores in restore describe
2024-04-17 15:39:55 +08:00
224fc61987
Merge pull request #7680 from ywk253100/240415_azure
...
Use specific credential rather than the credential chain for Azure
2024-04-17 13:21:50 +08:00
498a239e5b
Modify hook docs for clarity on displaying hook execution results ( #7679 )
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-04-17 09:37:04 +05:30
2197cab3db
Display CSI snapshot restores in restore describe
...
This commit makes change to CLI so `velero restore describe` will
download restore volume info and render the CSI snapshot restores based
on its content.
Signed-off-by: Daniel Jiang <daniel.jiang@broadcom.com>
2024-04-16 17:08:05 +08:00
bc29471ed6
Merge pull request #7619 from allenxu404/post_restore_hook_enhancement
...
Wait for results of restore exec hook executions in Finalizing phase instead of InProgress phase
2024-04-16 15:54:46 +08:00
facfb9552f
migrating to sdk/resourcemanager/**/arm** from services/**/mgmt/** ( #7596 )
...
Signed-off-by: Matthieu MOREL <matthieu.morel35@gmail.com>
2024-04-15 09:55:52 -04:00
40b0683dfc
Use specific credential rather than the credential chain for Azure
...
Use specific credential rather than the credential chain for Azure
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-04-15 19:27:30 +08:00
28552258ae
Wait for results of restore exec hook executions in Finalizing phase instead of InProgress phase
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-04-15 17:49:36 +08:00
1b3fe95980
Bump up golang to v1.22
...
This commit bumps up the golang for building and testing velero to v1.22
It also updates controller-gen to v0.14.0 to fix an issue under new
versino of go.
More details see https://github.com/golang/go/issues/65637
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2024-04-14 20:15:51 +08:00
c888f51817
Merge pull request #7662 from Lyndon-Li/issue-fix-7648
...
Issue fix 7648: avoid snapshot leak on expose failure
2024-04-12 17:28:27 +08:00
3c377bc3ec
Merge pull request #7630 from reasonerjt/restore-vol-info
...
Track and persist restore volume info
2024-04-12 11:24:05 +08:00
dcf760d5f1
issue 7648:avoid snapshot leak on expose failure
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-04-12 10:41:39 +08:00
f25c154709
Merge pull request #7569 from ywk253100/240326_namespace
...
Check the existence of the namespaces provided in the "--include-namespaces" option
2024-04-11 19:00:33 +08:00
0a280e5786
Track and persist restore volume info
...
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2024-04-11 17:32:18 +08:00
6ef38365ea
Merge pull request #7609 from blackpiglet/merge_csi
...
Merge CSI plugin code.
2024-04-11 10:38:58 +08:00
bbb5d7da03
Merge pull request #7640 from Lyndon-Li/data-mover-node-selection-doc
...
Data mover node selection doc
2024-04-11 10:33:15 +08:00
218aa8655f
Merge pull request #7523 from 27149chen/fix-for-resource-conversion
...
do not skip unknown gvr at the beginning and get new gr when kind is changed
2024-04-11 10:31:14 +08:00
8df4e6aded
Merge branch 'main' into merge_csi
...
Signed-off-by: Xun Jiang/Bruce Jiang <59276555+blackpiglet@users.noreply.github.com>
2024-04-10 18:54:16 +08:00
7935236db0
Merge pull request #7584 from mmorel-35/json-patch/v5
...
build(deps): bump json-patch to v5.8.0
2024-04-10 18:40:16 +08:00
31e140919a
Merge CSI plugin code.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-04-10 14:53:29 +08:00
d631517298
Merge pull request #7610 from reasonerjt/restore-vol-info-design
...
Add design to introduce restore volume info
2024-04-09 15:10:11 +08:00
080a61b43d
data mover node selection doc
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-04-09 10:23:02 +08:00
b755433f26
Merge pull request #7594 from mmorel-35/dependabot/github-actions
...
dependabot: support github-actions updates
2024-04-09 10:02:37 +08:00
f85f87759c
add design for Extending VolumePolicies to support more actions ( #6956 )
...
add changelog
fix codespell
update codeblocks for language syntax rendering
redo design
update volume policies design
add notes and modify design based on community feedback
add future scope
add bia csi snapshot action details
add volumehelper package in implementation section
fix codespell
introduce volumehelper interface and volumepolicyhelper struct
address feedback regarding volumehelper interface and its funcs
fix codespell
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2024-04-03 11:38:42 -04:00
d66d00a82c
issue 7246: document the behavior for repo snapshot deletion
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-04-03 13:53:24 +08:00
711609e00e
issue 7583: set backupName optional for Restore CRD
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-04-03 10:00:55 +08:00
ab5ee7b6ff
Add design to introduce restore volume info
...
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2024-04-02 14:58:07 +08:00
3465e8cddf
Merge pull request #7558 from qiuming-best/uploader-fast-fail
...
Fix snapshot leak for backup
2024-04-01 15:24:34 +08:00
58effeb879
Merge pull request #7566 from kaovilai/biaOperationErrorsPluginName
...
Add confirm flag to velero plugin add
2024-04-01 12:47:53 +08:00
75962653c5
Merge pull request #7554 from blackpiglet/7357_fix
...
Support update the backup VolumeInfos by the Async ops result.
2024-04-01 11:05:33 +08:00
3d5282e12b
Fix snapshot leak for backup
...
Signed-off-by: Ming Qiu <ming.qiu@broadcom.com>
2024-04-01 03:02:24 +00:00
b52b0a9650
dependabot: support github-actions updates
...
Signed-off-by: Matthieu MOREL <matthieu.morel35@gmail.com>
2024-03-30 14:05:05 +01:00
a9085033b2
build(deps): bump json-patch to v5.8.0
...
Signed-off-by: Matthieu MOREL <matthieu.morel35@gmail.com>
2024-03-29 14:08:33 +00:00
67bd694d1b
Merge pull request #7437 from Lyndon-Li/issue-fix-7036
...
Issue 7036: node selection for data mover backup
2024-03-29 17:04:40 +08:00
81da8e67c7
Merge pull request #7585 from Lyndon-Li/issue-fix-7535
...
Issue fix 7535
2024-03-29 10:48:48 +08:00
9b74643b3a
Merge branch 'main' into issue-fix-7535
2024-03-29 10:28:53 +08:00
070e99da3d
issue 7535: don't exclude resources in MustHave list during restore
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-29 10:14:54 +08:00
8d10b68eda
Improve the concurrency for PVBs in different pods
...
Improve the concurrency for PVBs in different pods
Fixes #6676
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-29 09:58:50 +08:00
b06d7a467f
Support update the backup VolumeInfos by the Async ops result.
...
1. Add PutBackupVolumeInfos method.
2. Add CompletionTimestamp in VolumeInfo.
3. Add Size in SnapshotDataMovementInfo.
4. Update CompletionTimpstmap, SnapshotHandle, RetainedSnapshot
and Size in VolumeInfo on DataUpload Operation completes.
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-03-28 19:52:44 +08:00
e80bdcf2e2
Merge pull request #7451 from qiuming-best/maintenance-job
...
Add repository maintenance job
2024-03-28 14:47:15 +08:00
8d63c76c92
Add maintenance job
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-03-28 03:22:06 +00:00
35d2534e19
Check the existence of the namespaces provided in the "--include-namespaces" option
...
Check the existence of the namespaces provided in the "--include-namespaces" opt
ion and reports validation error if not found
Fixes #7431
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-27 18:37:03 +08:00
cd0632c5db
Merge pull request #7549 from ywk253100/240318_cert
...
Support certificate-based authentication for Azure
2024-03-27 18:15:32 +08:00
a2c87fc8b2
Merge pull request #7438 from Lyndon-Li/batch-delete-snapshot
...
Issue 7281: batch delete snapshot
2024-03-27 13:31:07 +08:00
25188248d6
Merge pull request #7559 from Lyndon-Li/open-kopia-with-no-index-change
...
Bump up Kopia to v0.16.0 and open kopia repo with no index change
2024-03-26 13:08:27 +08:00
3c243653c4
Add confirm flag to velero plugin add
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2024-03-26 05:56:11 +07:00
5d48e36b55
open kopia with no index change
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-25 18:14:43 +08:00
365423d220
Merge pull request #7512 from qiuming-best/support-parallel-restore
...
Make parallel restore configurable
2024-03-25 10:49:40 +08:00
4c95edd8ba
Support certificate-based authentication for Azure
...
Support certificate-based authentication for Azure
Fixes #6735
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-21 15:59:37 +08:00
efb94ae610
Refactor the native snapshot definition code.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-03-20 15:38:07 +08:00
64a3f2aa3a
Make parallel restore configurable
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-03-19 15:15:47 +08:00
67b5e82d49
Patch newly dynamically provisioned PV with volume info to restore custom setting of PV
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-03-18 17:32:35 +08:00
6ec1701b27
Merge pull request #7383 from Lyndon-Li/data-mover-node-selection
...
Design for data mover node selection
2024-03-18 11:00:44 +08:00
6c0cb4bf89
Merge pull request #7521 from qiuming-best/data-mover-empty-dir
...
Fix DataDownload fails during restore for empty PVC workload
2024-03-14 16:07:43 +08:00
f25004cd9c
fix changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2024-03-14 15:29:57 +08:00
25c006f536
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2024-03-14 15:27:44 +08:00
74ffa50bb4
Fix DataDownload fails during restore for empty PVC workload
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-03-14 07:22:59 +00:00
2f9d8ae4bd
design for data mover node selection
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-14 09:55:32 +08:00
f8deea1617
Skip populate VolumeInfo for data-moved PV when CSI is not enabled.
...
Signed-off-by: Xun Jiang <blackpigletbruce@gmail.com>
2024-03-13 15:47:43 +08:00
79e9e31d8d
Merge pull request #7489 from ywk253100/240229_lib
...
Bump up the versions of several Kubernetes-related libs
2024-03-12 16:12:56 +08:00
8752c3a820
Bump up the versions of severel Kubernetes-related libs
...
Bump up the versions of severel Kubernetes-related libs
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-03-05 13:09:38 +08:00
f274fe7bfc
Merge pull request #7488 from Lyndon-Li/issue-fix-7391
...
Issue 7391:remove the default constraint for node-agent pods
2024-03-04 13:18:17 +08:00
d558e49288
issue 7391:remove the default constraint for node-agent pods
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-03-04 11:01:02 +08:00
97d276caa7
Merge pull request #7452 from Lyndon-Li/issue-fix-7211
...
Issue 7211: support concatenate objects
2024-03-04 10:34:37 +08:00
157984279b
Merge pull request #7472 from blackpiglet/7045_fix
...
Skip pvb creation when pvc excluded
2024-03-01 10:09:37 +08:00
2b8bb871d3
Add the finalization phase to the restore workflow
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-02-29 13:51:45 +08:00
36d58943cd
Skip pvb creation when pvc excluded
...
Signed-off-by: Shahaf Bahar <sbahar@redhat.com>
2024-02-27 16:30:29 +08:00
e1bcdf0f63
issue 7308: change the data path requeue time to 5 second
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-02-22 10:10:33 +08:00
24c4eb075f
issue 7211: support concatenate objects
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-02-21 17:34:04 +08:00
84fb88c19c
Adjust the logic for the backup_last_status metrics to stop incorrectly incrementing over time
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-02-21 13:21:03 +08:00
57879357fc
Merge branch 'main' into batch-delete-snapshot
2024-02-18 14:54:01 +08:00
7bf7fb9fc1
issue 7036: fail early by peek expose
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-02-18 14:34:35 +08:00
cf460d51c3
Ignore missing path error in conditional match
...
Signed-off-by: Sean Blong <seanblong@gmail.com>
2024-02-08 18:06:36 -08:00
a5c72a4866
BackupRepositories associated with a BSL are invalidated when BSL is (re-)created. ( #7380 )
...
* Add BackupRepositories invalidation on BSL Create
Simplify comments
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
* Simplify
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
---------
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2024-02-06 10:13:30 -05:00
2f25c25908
Merge pull request #7317 from allenxu404/restore-finalizing-design
...
Design for adding the finalization phase to the restore workflow
2024-02-02 13:35:32 +08:00
cc9c954d8f
Merge pull request #7374 from reasonerjt/bypass-irsa-kopia
...
Force to Credentials file when IRSA is configured
2024-02-02 11:26:37 +08:00
b509df5172
Upgrade the version of go plugin related libs/tools ( #7373 )
...
Upgrade the version of go plugin related libs/tools
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-02-01 13:02:42 -05:00
30728c248c
Respect the config in BSL when IRSA is configured
...
This commit makes sure when kopia connects to the repository the
crendentials file specified in BSL.spec.config has the higher priority over
Pod Environment credentials when IRSA is configured.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2024-02-01 16:33:10 +08:00
8f84f50711
Include the design for adding the finalization phase to the restore workflow
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2024-02-01 14:44:25 +08:00
270b1de6a1
Do not attempt restore resource with no available GVK in cluster ( #7322 )
...
Check for GVK before attempting restore.
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2024-01-22 09:50:13 +08:00
bc526b99b1
Add release note for the informer cache memory consumption
...
Add release note for the informer cache memory consumption
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-18 15:29:21 +08:00
6a4c661735
Merge pull request #7307 from guikcd/aws_sdk_upgrade
2024-01-17 16:25:38 -08:00
373b24e2c1
Upgrade AWS SDK
...
Signed-off-by: Guillaume Delacour <delacoug@amazon.com>
2024-01-16 23:35:33 +01:00
d676bfde22
Increase the k8s client QPS/burst
...
Increase the k8s client QPS/burst to avoid throttling request errors
Fixes #7127
Fixes #3191
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-12 15:02:05 +08:00
e498ea99a3
Merge pull request #7295 from josemarevalo/main
...
Add CRD name to error message when it is not ready to use
2024-01-12 14:59:48 +08:00
ac4c9ed919
Add changelog for v1.13.0
...
Add changelog for v1.13.0
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-10 13:36:51 +08:00
0b307ca035
Add CRD name to error message when it is not ready to use
...
When debugging this error it is currently hard to identify what
CRD is causing the issue. This is particularly difficult when
dealing with over a hundred CRDs.
Signed-off-by: Jose Arevalo <jose.matias.arevalo@gmail.com>
2024-01-10 12:11:47 +10:00
9a1be6f53f
Make "disable-informer-cache" option false(enabled) by default to keep it consistent with the help message
...
Make "disable-informer-cache" option false(enabled) by default to keep it consi
stent with the help message
Fixes #7264
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-10 09:49:54 +08:00
200fd80448
isue 6928: remove snapshot deletion timeout for PVB
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-01-08 11:28:23 +08:00
a5d08ac5f0
Do not set "targetNamespace" to namepsace items
...
fixes #7263
This commit makes the data structures more consistent, that namespaces,
as cluster scoped resource will not have "targetNamespace" in the
"restoreableItem" instance.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2024-01-05 14:01:16 +08:00
60d2c62c1a
issue 7244: delete incomplete snapshot automatically for kopia uploader
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-22 16:44:00 +08:00
ee345cf281
Adjust the newline output of resource list in restore describer ( #7238 )
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-12-22 10:53:29 +05:30
8f6d46be87
Remove the redundant newline in backup describe output
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-12-19 15:25:37 +08:00
cf7d27c4bc
issue 7189: generic restore - don't assume the first volume as the restore volume
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-12 10:04:31 +08:00
e4bd59727f
Schedule SkipImmediately
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-12-08 09:12:08 +07:00
4070934f85
Merge pull request #7125 from Lyndon-Li/issue-fix-6695
...
Issue fix 6695: add describe for data mover backups
2023-12-07 16:23:30 +08:00
759e8a9c63
Merge pull request #7184 from blackpiglet/7163_fix
...
Update CSIVolumeSnapshotsCompleted in backup's status and the metric
2023-12-07 11:14:28 +08:00
edb0860dd2
Fix issue #7163 .
...
Update CSIVolumeSnapshotsCompleted in backup's status and the metric
during backup finalize stage according to async operations content.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-07 09:43:10 +08:00
099acd2527
Merge pull request #7141 from qiuming-best/support-restore-sparse
...
Allow sparse option for Kopia & Restic restore
2023-12-06 18:25:34 +08:00
8d8d68d649
Merge pull request #7175 from blackpiglet/download_request
...
Refactor DownloadRequest Stream function
2023-12-06 10:28:44 +08:00
ea04a86eb2
Merge pull request #6771 from qiuming-best/bsl-fix
...
Fix default BSL setting not work
2023-12-05 19:09:50 +08:00
6093e651cb
Merge pull request #7161 from Lyndon-Li/node-agent-config-doc
...
Add node-agent concurrency doc
2023-12-05 16:52:29 +08:00
ac5d030ab4
Merge branch 'main' into issue-fix-6695
2023-12-05 16:46:31 +08:00
2fa785a3dd
Merge pull request #7052 from qiuming-best/data-mover-fail-early
...
Make data mover fail early
2023-12-05 16:33:46 +08:00
45ae68575d
Merge pull request #7153 from allenxu404/hooktracker-update
...
Enhance hooks tracker by adding an returned error to record function
2023-12-05 13:43:38 +08:00
c8e76f4602
Fix the DownloadRequest context error.
...
Clean the DownloadRequest Stream function.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-05 13:29:23 +08:00
6051b3cbe0
Enhance hooks tracker by adding a returned error to record function
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-12-05 12:56:42 +08:00
ca97248f2a
Use VolumeInfo to help restore the PV.
...
Add VolumeInfo for left PVs during backup.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-04 08:33:37 +08:00
c6cba300fb
Fix default BSL setting not work
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-12-01 02:06:35 +00:00
0afaa70e9b
Merge branch 'main' of https://github.com/qiuming-best/velero into support-restore-sparse
2023-11-30 10:55:55 +00:00
5cbfd9fffd
Merge pull request #7150 from Lyndon-Li/issue-fix-7135
...
Issue 7135: check pod status before checking node-agent pod status
2023-11-29 15:47:23 +08:00
81183f683e
Merge branch 'main' into issue-fix-6695
2023-11-29 15:12:21 +08:00
f5bbe82e78
Merge pull request #7152 from reasonerjt/track-skipped-SnapshotVolumes-false
...
Track the skipped PV when SnapshotVolumes set as false
2023-11-29 14:46:23 +08:00
33b570d5cd
Merge branch 'main' into node-agent-config-doc
2023-11-29 14:45:20 +08:00
8968ae5ec4
add node-agent concurrency doc
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-29 14:33:51 +08:00
e416b20148
issue 7135: check pod status before checking node-agent pod status
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-29 13:46:50 +08:00
f5c159ce56
Resolve linter issues.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-29 11:15:43 +08:00
03dff100a3
Make data mover fail early
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-11-29 03:03:53 +00:00
b8604b6a89
Treat namespace as a regular restorable item ( #7143 )
...
Fixes #1970
Namespaces will be handled as cluster-scope resource, but for
consistency they will still created via "Ensure namespace" flow for
consistency.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-11-28 11:20:36 -05:00
b759877f5b
Track the skipped PV when SnapshotVolumes set as false
...
This commit makes sure if a PV is not taken snapshot b/c the flag
SnapshotVolumes is set to false in a backup CR, the PV is also also
tracked as skipped in the tracker.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-11-28 22:52:17 +08:00
b57dde1572
Allow sparse option for Kopia & Restic restore
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-11-28 13:48:09 +00:00
85482aefaf
Merge pull request #7117 from allenxu404/issue6567
...
Add hook status to backup/restore CR
2023-11-28 16:54:11 +08:00
5d1a632be4
Add hook status to backup/restore CR
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-11-28 14:47:31 +08:00
6ac7ff1230
Merge pull request #7130 from qiuming-best/data-mover-recoverbility
...
Node agent restart enhancement
2023-11-28 14:25:47 +08:00
98a56eb5c7
Node agent restart enhancement
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-11-28 05:50:46 +00:00
3fdb3ec7c5
Merge pull request #7069 from 27149chen/imporve-discovery-refresh
...
improve discoveryHelper.Refresh() in restore
2023-11-27 18:02:36 +08:00
d336e2812e
Merge pull request #6958 from blackpiglet/5156_list_option_fix
...
Change controller-runtime List option from MatchingFields to ListOpti…
2023-11-27 17:38:12 +08:00
1815c1691f
Merge branch 'main' into issue-fix-6695
2023-11-27 09:46:22 +08:00
c2d4495efe
Merge branch 'main' of https://github.com/qiuming-best/velero into kopia-parallelism
2023-11-22 03:52:20 +00:00
5c958d820d
Merge pull request #7100 from blackpiglet/6595_volumeinfo_generate
...
6595 volumeinfo generate
2023-11-22 11:14:36 +08:00
fea22bbbc9
Merge branch 'main' of https://github.com/qiuming-best/velero into kopia-parallelism
2023-11-22 01:42:39 +00:00
7f52321772
Generate VolumeInfo.
...
Remove CSI VolumeSnapshot listter and the informer.
Add download the VolumeInfos metadata for backup.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-22 09:40:38 +08:00
e3fb94833d
Merge pull request #7115 from reasonerjt/wrap-bia-err
...
Include plugin name in the error message by operations
2023-11-20 14:48:18 +08:00
ca57756ff6
Include plugin name in the error message by operations
...
fixes #6512
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-11-20 12:12:02 +08:00
4e4f0aa1da
issue 6695: add backup describe for CSI snapshot data movement 02
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-20 12:11:21 +08:00
939dd7149a
Merge pull request #7070 from blackpiglet/6595_interface
...
Add VolumeInfo metadata structures.
2023-11-17 19:31:29 +08:00
b440a4f53f
Add VolumeInfo metadata structures and object get method.
...
Modify design according to comments.
Add PVInfo structure.
Add backup VolumeInfo's object storage's put and get methods.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-17 17:23:47 +08:00
c283edf4a5
Merge pull request #7032 from deefdragon/main
...
Add check for owner references in backup sync, removing if missing
2023-11-17 09:32:50 +08:00
8eec6865d1
Check only schedules, and verify UIDs are the same
...
Signed-off-by: Jeffrey Koehler <koehler@streem.tech>
2023-11-16 02:29:56 -06:00
d42505ddd0
Merge pull request #7102 from Lyndon-Li/issue-fix-7068-2
...
Issue 7068: add a finalizer to protect retained VSC
2023-11-15 17:13:44 +08:00
067984b13c
Issue 7068: add a finalizer to protect retained VSC
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-15 16:04:07 +08:00
d345bda3a1
Merge pull request #7081 from ywk253100/231110_sync
...
Skip syncing the backup which doesn't contain backup metadata
2023-11-15 16:00:06 +08:00
2a533d01bf
Merge pull request #7046 from kaovilai/backup-patch-status-unittest
...
Update Backup.Status.CSIVolumeSnapshotsCompleted during finalize
2023-11-15 15:32:51 +08:00
9b5678f32a
Merge pull request #7096 from Lyndon-Li/issue-fix-7094
...
Issue 7094: fallback to full backup if previous snapshot is not found
2023-11-14 11:45:32 +08:00
50f8acda79
issue 7094: fallback to full backup if previous snapshot is not found
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-14 11:28:09 +08:00
cb651d0436
issue 7068: add a finalizer to protect retained VSC
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-14 10:18:07 +08:00
84c96047b9
Skip syncing the backup which doesn't contain backup metadata
...
Skip syncing the backup which doesn't contain backup metadata
Fixes #6849
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-11-10 10:22:27 +08:00
2841be7681
Merge branch 'main' into issue-fix-6693
2023-11-10 10:04:27 +08:00
cb5ffe2753
Merge pull request #7061 from blackpiglet/6595_backward_compatability
...
Add DataUpload Result and CSI VolumeSnapshot check for restore PV.
2023-11-10 09:37:19 +08:00
873197ff50
issue 6693: partially fail restore if CSI snapshot is involved but CSI feature is not ready
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-09 17:37:23 +08:00
76e89f7dc5
Merge pull request #7059 from Lyndon-Li/issue-fix-6663
...
Issue 6663: changes for configurable data path concurrency
2023-11-09 14:37:28 +08:00
c638ca557e
Merge branch 'main' into issue-fix-6663
2023-11-08 10:45:40 +08:00
5a10f9090a
Truncate the credential file to avoid the change of secret content messing it up
...
Truncate the credential file to avoid the change of secret content messing it up
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-11-08 09:33:56 +08:00
866fbb5cdb
Merge pull request #6950 from Lyndon-Li/issue-fix-6663-design
...
Design for node-agent concurrency
2023-11-08 09:04:05 +08:00
ebb21303ab
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2023-11-07 19:50:35 +08:00
1fb0529d98
Add DataUpload Result and CSI VolumeSnapshot check for restore PV.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-06 22:40:03 +08:00
262f10ff49
Merge branch 'main' into issue-fix-6663
2023-11-06 16:52:41 +08:00
04a9851ee9
configurable data path concurrency: all in cm
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-06 16:46:13 +08:00
6b7ce6655d
Merge pull request #7022 from allenxu404/i6721
...
Fix inconsistent behavior of Backup and Restore hook execution
2023-11-06 14:01:30 +05:30
56b5e982d9
Remove dependency of generated client part 3
...
Replace generated discovery client with client-go client.
Remove generated client from PVR action.
Remove generated client from pkg/cmd directory.
Delete velero generate client from client factory.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-06 11:34:39 +08:00
d6146ecff4
Merge pull request #7041 from blackpiglet/6190_part_2
...
Remove dependency of generated client part 2
2023-11-03 17:43:10 +08:00
a221a88945
Remove dependency of generated client part 2
...
Remove dependecy of generate client from pkg/cmd/cli/snapshotLocation.
Remove the Velero generated informer from PVB and PVR.
Remove dependency of generated client from pkg/podvolume directory.
Replace generated codec with runtime codec.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-03 17:11:36 +08:00
6896a1ffe4
update changelog to reflect removed waits
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 16:22:30 -04:00
10245b05de
restore: Use warning when Create IsAlreadyExist and Get error ( #7004 )
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 15:53:47 -04:00
9311a4269b
refactor backup snapshot status updates into UpdateBackupSnapshotsStatus() and run in backup_finalizer_controller
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 15:30:35 -04:00
3a3527553a
Fix inconsistent behavior of Backup and Restore hook execution
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-11-02 12:31:53 +08:00
166a58bddc
Merge pull request #6962 from blackpiglet/6595_design
...
Add the PV backup information design document.
2023-11-02 10:50:56 +08:00
73c948d6bd
Merge pull request #6917 from 27149chen/rm-improvement
...
support JSON Merge Patch and Strategic Merge Patch in Resource Modifiers
2023-11-02 10:36:40 +08:00
23b9484370
Add the PV backup information design document.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-02 10:14:16 +08:00
a0edad94db
design for node-agent concurrency
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-01 11:35:06 +08:00
38e1ae0405
Merge pull request #7034 from ywk253100/231030_cred
...
Read information from the credential specified by BSL
2023-11-01 09:41:25 +08:00
8e442407c3
issue 7027: backup exposer -- don't assume first volume as the backup volume
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-31 12:11:34 +08:00
03e582cb6c
Merge pull request #6995 from kaovilai/kopias3profilecred
...
kopia/repository/config/aws.go: Set session.Options profile from config
2023-10-30 09:11:15 -07:00
49a85e1636
Read information from the credential specified by BSL
...
Read information from the credential specified by BSL
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-10-30 17:28:10 +08:00
929af4f734
Add check for owner reference in backup sync, removing if missing
...
Signed-off-by: Jeffrey Koehler <koehler@streem.tech>
2023-10-29 22:06:14 -05:00
lyndon-li
Xun Jiang
Lyndon-Li
Scott Seago
Daniel Jiang
Xun Jiang/Bruce Jiang
Shubham Pampattiwar
piny940
Guang Jiong Lou
Daniel Jiang
Matthieu MOREL
Tiger Kaovilai
qiuming
Qi Xu
Wenkai Yin(尹文开)
allenxu404
Ming Qiu
lou
Shahaf Bahar
Sean Blong
Shubham Pampattiwar
Guillaume Delacour
Jose Arevalo
Xun Jiang
Jeffrey Koehler
Anshul Ahuja