3fdb3ec7c5
Merge pull request #7069 from 27149chen/imporve-discovery-refresh
...
improve discoveryHelper.Refresh() in restore
2023-11-27 18:02:36 +08:00
d336e2812e
Merge pull request #6958 from blackpiglet/5156_list_option_fix
...
Change controller-runtime List option from MatchingFields to ListOpti…
2023-11-27 17:38:12 +08:00
1815c1691f
Merge branch 'main' into issue-fix-6695
2023-11-27 09:46:22 +08:00
c2d4495efe
Merge branch 'main' of https://github.com/qiuming-best/velero into kopia-parallelism
2023-11-22 03:52:20 +00:00
5c958d820d
Merge pull request #7100 from blackpiglet/6595_volumeinfo_generate
...
6595 volumeinfo generate
2023-11-22 11:14:36 +08:00
fea22bbbc9
Merge branch 'main' of https://github.com/qiuming-best/velero into kopia-parallelism
2023-11-22 01:42:39 +00:00
7f52321772
Generate VolumeInfo.
...
Remove CSI VolumeSnapshot listter and the informer.
Add download the VolumeInfos metadata for backup.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-22 09:40:38 +08:00
e3fb94833d
Merge pull request #7115 from reasonerjt/wrap-bia-err
...
Include plugin name in the error message by operations
2023-11-20 14:48:18 +08:00
ca57756ff6
Include plugin name in the error message by operations
...
fixes #6512
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-11-20 12:12:02 +08:00
4e4f0aa1da
issue 6695: add backup describe for CSI snapshot data movement 02
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-20 12:11:21 +08:00
939dd7149a
Merge pull request #7070 from blackpiglet/6595_interface
...
Add VolumeInfo metadata structures.
2023-11-17 19:31:29 +08:00
b440a4f53f
Add VolumeInfo metadata structures and object get method.
...
Modify design according to comments.
Add PVInfo structure.
Add backup VolumeInfo's object storage's put and get methods.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-17 17:23:47 +08:00
c283edf4a5
Merge pull request #7032 from deefdragon/main
...
Add check for owner references in backup sync, removing if missing
2023-11-17 09:32:50 +08:00
8eec6865d1
Check only schedules, and verify UIDs are the same
...
Signed-off-by: Jeffrey Koehler <koehler@streem.tech>
2023-11-16 02:29:56 -06:00
d42505ddd0
Merge pull request #7102 from Lyndon-Li/issue-fix-7068-2
...
Issue 7068: add a finalizer to protect retained VSC
2023-11-15 17:13:44 +08:00
067984b13c
Issue 7068: add a finalizer to protect retained VSC
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-15 16:04:07 +08:00
d345bda3a1
Merge pull request #7081 from ywk253100/231110_sync
...
Skip syncing the backup which doesn't contain backup metadata
2023-11-15 16:00:06 +08:00
2a533d01bf
Merge pull request #7046 from kaovilai/backup-patch-status-unittest
...
Update Backup.Status.CSIVolumeSnapshotsCompleted during finalize
2023-11-15 15:32:51 +08:00
9b5678f32a
Merge pull request #7096 from Lyndon-Li/issue-fix-7094
...
Issue 7094: fallback to full backup if previous snapshot is not found
2023-11-14 11:45:32 +08:00
50f8acda79
issue 7094: fallback to full backup if previous snapshot is not found
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-14 11:28:09 +08:00
cb651d0436
issue 7068: add a finalizer to protect retained VSC
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-14 10:18:07 +08:00
84c96047b9
Skip syncing the backup which doesn't contain backup metadata
...
Skip syncing the backup which doesn't contain backup metadata
Fixes #6849
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-11-10 10:22:27 +08:00
2841be7681
Merge branch 'main' into issue-fix-6693
2023-11-10 10:04:27 +08:00
cb5ffe2753
Merge pull request #7061 from blackpiglet/6595_backward_compatability
...
Add DataUpload Result and CSI VolumeSnapshot check for restore PV.
2023-11-10 09:37:19 +08:00
873197ff50
issue 6693: partially fail restore if CSI snapshot is involved but CSI feature is not ready
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-09 17:37:23 +08:00
76e89f7dc5
Merge pull request #7059 from Lyndon-Li/issue-fix-6663
...
Issue 6663: changes for configurable data path concurrency
2023-11-09 14:37:28 +08:00
c638ca557e
Merge branch 'main' into issue-fix-6663
2023-11-08 10:45:40 +08:00
5a10f9090a
Truncate the credential file to avoid the change of secret content messing it up
...
Truncate the credential file to avoid the change of secret content messing it up
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-11-08 09:33:56 +08:00
866fbb5cdb
Merge pull request #6950 from Lyndon-Li/issue-fix-6663-design
...
Design for node-agent concurrency
2023-11-08 09:04:05 +08:00
ebb21303ab
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2023-11-07 19:50:35 +08:00
1fb0529d98
Add DataUpload Result and CSI VolumeSnapshot check for restore PV.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-06 22:40:03 +08:00
262f10ff49
Merge branch 'main' into issue-fix-6663
2023-11-06 16:52:41 +08:00
04a9851ee9
configurable data path concurrency: all in cm
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-06 16:46:13 +08:00
6b7ce6655d
Merge pull request #7022 from allenxu404/i6721
...
Fix inconsistent behavior of Backup and Restore hook execution
2023-11-06 14:01:30 +05:30
56b5e982d9
Remove dependency of generated client part 3
...
Replace generated discovery client with client-go client.
Remove generated client from PVR action.
Remove generated client from pkg/cmd directory.
Delete velero generate client from client factory.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-06 11:34:39 +08:00
d6146ecff4
Merge pull request #7041 from blackpiglet/6190_part_2
...
Remove dependency of generated client part 2
2023-11-03 17:43:10 +08:00
a221a88945
Remove dependency of generated client part 2
...
Remove dependecy of generate client from pkg/cmd/cli/snapshotLocation.
Remove the Velero generated informer from PVB and PVR.
Remove dependency of generated client from pkg/podvolume directory.
Replace generated codec with runtime codec.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-03 17:11:36 +08:00
6896a1ffe4
update changelog to reflect removed waits
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 16:22:30 -04:00
10245b05de
restore: Use warning when Create IsAlreadyExist and Get error ( #7004 )
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 15:53:47 -04:00
9311a4269b
refactor backup snapshot status updates into UpdateBackupSnapshotsStatus() and run in backup_finalizer_controller
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 15:30:35 -04:00
3a3527553a
Fix inconsistent behavior of Backup and Restore hook execution
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-11-02 12:31:53 +08:00
166a58bddc
Merge pull request #6962 from blackpiglet/6595_design
...
Add the PV backup information design document.
2023-11-02 10:50:56 +08:00
73c948d6bd
Merge pull request #6917 from 27149chen/rm-improvement
...
support JSON Merge Patch and Strategic Merge Patch in Resource Modifiers
2023-11-02 10:36:40 +08:00
23b9484370
Add the PV backup information design document.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-02 10:14:16 +08:00
a0edad94db
design for node-agent concurrency
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-01 11:35:06 +08:00
38e1ae0405
Merge pull request #7034 from ywk253100/231030_cred
...
Read information from the credential specified by BSL
2023-11-01 09:41:25 +08:00
8e442407c3
issue 7027: backup exposer -- don't assume first volume as the backup volume
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-31 12:11:34 +08:00
03e582cb6c
Merge pull request #6995 from kaovilai/kopias3profilecred
...
kopia/repository/config/aws.go: Set session.Options profile from config
2023-10-30 09:11:15 -07:00
49a85e1636
Read information from the credential specified by BSL
...
Read information from the credential specified by BSL
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-10-30 17:28:10 +08:00
929af4f734
Add check for owner reference in backup sync, removing if missing
...
Signed-off-by: Jeffrey Koehler <koehler@streem.tech>
2023-10-29 22:06:14 -05:00
23921e5d29
add description markers for dataupload and datadownload CRDs ( #7028 )
...
add changelog file
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-10-27 11:05:10 -04:00
9ff4b1e079
Merge pull request #7026 from blackpiglet/6376_fix
...
Add HealthCheckNodePort deletion logic in Serivce restore
2023-10-27 16:40:04 +08:00
a94918026c
Add HealthCheckNodePort deletion logic in Service restore.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-27 14:13:52 +08:00
1e0fc77e4d
Fix issue 6913 ( #6914 )
...
add changelog file
keep canceling phase const
fix data download as well
address PR feedback
minor fixes
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-10-26 09:39:38 -04:00
481cb60493
Make Kopia file parallelism configurable
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-10-26 02:28:36 +00:00
45ed3bf613
Record platform limitation of the Kopia block mode uploader in docs. ( #7013 )
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-25 19:43:46 +05:30
30bf6bd28c
Merge pull request #7011 from Lyndon-Li/issue-fix-6964-2
...
Issue 6964: use preparingTimeout for snapshot readiness wait
2023-10-25 11:11:27 +08:00
0eade6c615
issue 6964: use preparingTimeout for snapshot readiness wait
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-25 10:51:08 +08:00
d5f238c83c
kopia/repository/config/aws.go: Set session.Options profile from config
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-10-24 14:05:47 -04:00
941dd0039f
Merge pull request #6968 from blackpiglet/6585_fix
...
Check whether the action is a CSI action and whether CSI feature is
2023-10-25 00:39:58 +08:00
317db25d20
Merge pull request #6923 from reasonerjt/aws-sdk-v2
...
Bump up aws sdk to aws-sdk-go-v2
2023-10-24 23:53:16 +08:00
b71d2b3898
Bump up aws sdk to aws-sdk-go-v2
...
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-10-24 17:01:26 +08:00
61d333a31a
Merge pull request #6989 from blackpiglet/support_windows_build_main
...
[cherry-pick][main]Make Windows build skip BlockMode code.
2023-10-24 16:58:03 +08:00
908e2c63ba
Check whether the action is a CSI action and whether CSI feature is
...
enabled, before executing the action.
The DeleteItemAction is not checked, because the DIA doesn't have a
method to get the action's plugin name.
This should be OK, because the CSI will check whether the VS and VSC
have a backup name annotation. If the VS and VSC is not handled by
the CSI plugin, then they don't have the annotation.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-24 16:54:38 +08:00
d3a1a83c6d
bump to kopia 0.15.0
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-23 12:03:21 +08:00
3d841dd8f1
udmrepo use region specified in BSL when s3URL is empty
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-20 19:58:54 +08:00
ecc6e1621e
Make Windows build skip BlockMode code.
...
PVC block mode backup and restore introduced some OS specific
system calls. Those calls are not available for Windows, so
add both non Windows version and Windows version code, and
return error for block mode on the Windows platform.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-20 19:39:44 +08:00
79c75718ca
Change controller-runtime List option from MatchingFields to ListOptions.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-19 17:09:12 +08:00
fd8350f919
Merge pull request #6976 from Lyndon-Li/issue-fix-6964
...
Issue 6964: get volume size from source PVC if it is invalid in VS
2023-10-19 13:53:57 +08:00
329c128279
issue 6964: get volume size from source PVC if it is invalid in VS
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-19 11:50:28 +08:00
19f38f9623
Merge pull request #6947 from 0x113/SGLAB-CLOUDCASA-oidc-auth
...
Issue #6933 : Import auth provider plugins
2023-10-18 16:01:50 +08:00
265d285b1d
Import auth provider plugins
...
Signed-off-by: Sebastian Glab <sglab@catalogicsoftware.com>
2023-10-18 08:53:35 +02:00
5ff5073cc3
Add volume types filter in resource policies ( #6863 )
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-10-16 17:36:54 -04:00
7ca33f8f12
Add MSI Support for Azure plugin. ( #6938 )
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-16 09:47:53 +05:30
b4fb2d9644
Merge pull request #6918 from Ripolin/main
...
Add WaitForReady flag to check container readiness state before exec a hook
2023-10-15 13:27:34 +08:00
069c280f03
Fix node-agent missing metrics-addr parms to define the server start.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-13 03:33:18 +01:00
e5af7f5cea
Add WaitForReady flag to check container readiness state before exec a hook
...
Signed-off-by: Ripolin <florent.david@gmail.com>
2023-10-12 20:31:36 +02:00
ad114f8f65
Merge pull request #6723 from sseago/restore-get-perf
2023-10-12 07:57:40 -07:00
741b696180
Merge pull request #6946 from Lyndon-Li/issue-fix-6668
...
Issue fix 6668: add a limitation for fs restore parallelism with other types of restore
2023-10-12 14:53:29 +08:00
b14bd2cd75
issue 6668: add a limitation for fs restore parallelism with other types of restores
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-12 11:58:26 +08:00
74ed994e5e
Merge pull request #6830 from sseago/retry-generateName
...
issue #6807 : Retry failed create when using generateName
2023-10-11 08:50:14 -07:00
7750e12151
Perf improvements for existing resource restore
...
Use informer cache with dynamic client for Get calls on restore
When enabled, also make the Get call before create.
Add server and install parameter to allow disabling this feature,
but enable by default
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-10-11 10:51:39 -04:00
19d5bee572
Merge branch 'main' into rm-improvement
2023-10-10 19:02:16 +08:00
09be1f7995
issue #6807 : Retry failed create when using generateName
...
When creating resources with generateName, apimachinery
does not guarantee uniqueness when it appends the random
suffix to the generateName stub, so if it fails with
already exists error, we need to retry.
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-10-09 17:38:37 -04:00
e5e99c75a0
Fix dep package describe and ci words spell. ( #6924 )
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-09 12:12:14 +05:30
d8d66381e7
issue 6734: spread backup pod evenly
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-08 20:01:12 +08:00
0d4e61eb24
Merge pull request #6649 from sseago/orphaned-partially-failed
2023-10-06 10:35:57 -07:00
06ed9dcc71
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2023-10-04 16:02:23 +08:00
7f73acab16
Proposal to support JSON Merge Patch and Strategic Merge Patch in Resource Modifiers ( #6797 )
...
* Proposal to support JSON Merge Patch and Strategic Merge Patch in Resource Modifiers
Signed-off-by: lou <alex1988@outlook.com>
* add changelog
Signed-off-by: lou <alex1988@outlook.com>
* add conditional patches
Signed-off-by: lou <alex1988@outlook.com>
* update design
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
2023-10-04 09:29:09 +05:30
0d79afe049
Replace the base image with paketobuildpacks image ( #6883 )
...
Replace the base image with paketobuildpacks image
Fixes #6851
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-29 12:19:51 -04:00
8e01d1b9be
Add support for block volumes ( #6680 )
...
Signed-off-by: David Zaninovic <dzaninovic@catalogicsoftware.com>
2023-09-28 09:44:46 -04:00
af43d96ac9
Merge pull request #6885 from Lyndon-Li/issue-fix-6880
...
Issue 6880: set ParallelUploadAboveSize as MaxInt64
2023-09-28 14:24:08 +08:00
3e3ffec7cd
issue 6880: set ParallelUploadAboveSize as MaxInt64
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-28 12:34:30 +08:00
73ea00b477
issue 6861: fill repoIdentifier only for restic repo ( #6872 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-27 16:49:35 -04:00
563f1ccee1
Merge pull request #6475 from nilesh-akhade/main
...
Add `--or-selector` for backup and restore command
2023-09-27 20:09:07 +08:00
2e71cffe0e
issue: move plugin depdending podvolume functions to util pkg
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-26 16:39:33 +08:00
c3ec7b71c5
Merge pull request #6715 from nilesh-akhade/metric
...
Remove schedule-related metrics on schedule delete
2023-09-25 10:24:04 -07:00
cda722cf9d
Fix the metrics backup_last_status not report right value when the schedule down unexpectation.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-09-19 15:25:21 +08:00
3a291e368a
Make Kopia support Azure AD
...
This commit introduces our own Azure storage provider by wrapping Kopia's implementation rather than contributing to upstream based on the following considerations:
1. Velero needs the capability to interact with the repository concurrently while Kopia doesn't, this will increase the complexity of Kopia if we contribute to upstream
2. The configuration items provided by Velero and Kopia are conflict, e.g. Velero supports customizing storage account URI which is a full path while Kopia supports customizing storage account domain which is part of the URI. We need to consider the backward compatibility and upgrade case if we contribute to upstream which needs extra efforts
3. Contribute to upstream is a longer cycle when we need to introduce new changes. With this commit, we no longer depends on upstream for the Azure storage provider part and is easy for us to maintain
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-19 11:28:04 +08:00
5af664d361
bump kopia to v0.14 ( #6833 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-18 21:05:21 +08:00
cf3cb9c4ed
Merge pull request #6712 from kaovilai/jobs-label-k8s1.27
...
On restore, delete Kubernetes 1.27 job controller uid label
2023-09-18 16:49:50 +08:00
c85638ddb6
Merge pull request #6827 from Lyndon-Li/issue-fix-6786
...
Issue 6786:always delete VSC regardless of the deletion policy
2023-09-15 14:18:38 +08:00
53489b10ad
issue 6786:always delete VSC regardless of the deletion policy
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-15 12:10:20 +08:00
9b1cffc007
check pod status before hook ( #5211 )
...
Signed-off-by: cleverhu <shouping.hu@daocloud.io>
Co-authored-by: cleverhu <shouping.hu@daocloud.io>
2023-09-13 14:49:46 +08:00
246831de7b
use old namespace in resource modifier ( #6724 )
...
* use old namespace in resource modifier
Signed-off-by: lou <alex1988@outlook.com>
* add changelog
Signed-off-by: lou <alex1988@outlook.com>
* update docs
Signed-off-by: lou <alex1988@outlook.com>
* updated after review
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
2023-09-08 15:29:46 +05:30
a4b5b0a79e
add csi snapshot data mover doc ( #6637 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-08 17:17:42 +08:00
f72afc8a5a
Merge pull request #6760 from blackpiglet/6752_fix
...
Fix #6752 : add namespace exclude check.
2023-09-06 15:44:20 +08:00
79b810ed25
Fix #6752 : add namespace exclude check.
...
Add PSA audit and warn labels.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-09-06 14:44:30 +08:00
da6ac026d1
Update restore controller logic for restore deletion
...
1. Skip deleting the restore files from storage if the backup/BSL is not found
2. Allow deleting the restore files from storage even though the BSL is readonly
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-06 09:19:42 +08:00
8cb04d4f69
Merge pull request #6751 from Lyndon-Li/issue-fix-6647
...
Fix issue 6647
2023-09-06 09:03:00 +08:00
c9e1ade1f7
fix issue 6753 ( #6757 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-05 10:58:28 +08:00
778feba3ae
fix issue 6647
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-04 16:55:36 +08:00
5dd7c5cd46
add label selector in Resource Modifiers ( #6704 )
...
* add label selector in resource modifier
Signed-off-by: lou <alex1988@outlook.com>
* add ut
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
2023-08-31 10:36:59 +05:30
c7c441364c
Remove schedule-related metrics on schedule delete
...
Signed-off-by: Nilesh Akhade <nakhade@catalogicsoftware.com>
2023-08-28 20:52:32 +05:30
f6e8c208ad
changelog
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-08-28 10:45:55 -04:00
3e613862e6
Merge pull request #6635 from 27149chen/skip-subresource
...
skip subresource in resource discovery
2023-08-22 13:39:12 +08:00
8d0a8bac34
Update changelogs/unreleased/6649-sseago
...
Co-authored-by: Tiger Kaovilai <passawit.kaovilai@gmail.com>
Signed-off-by: Xun Jiang/Bruce Jiang <59276555+blackpiglet@users.noreply.github.com>
2023-08-22 10:37:59 +08:00
9e2acc987d
Add v1.12 changelog
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-08-18 16:05:50 +08:00
0b30adb35a
Merge pull request #6608 from shawn-hurley/feature/add-provider-interface-blockmod
...
Feature/add provider interface for block mode
2023-08-16 11:09:36 +08:00
563a16c10f
adding block mode to uploader/provider interfaces
...
Signed-off-by: Shawn Hurley <shawn@hurley.page>
2023-08-15 15:33:23 -04:00
f890033ee8
Merge branch 'main' of https://github.com/qiuming-best/velero into perf-test
2023-08-15 07:57:01 +00:00
3b45830012
Add performance E2E test
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-08-15 01:46:36 +00:00
441a32a861
Deal with PartiallyFailed orphaned backups as well as Completed ones
...
Fixes https://github.com/vmware-tanzu/velero/issues/6648
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-08-14 13:40:32 -04:00
797267c89a
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2023-08-11 10:11:24 +08:00
0f9e582fd9
add changelog
...
Signed-off-by: lou <alex1988@outlook.com>
2023-08-11 10:05:23 +08:00
28c5dc9fda
fix: load AWS config and assume role
...
Signed-off-by: Luis Davim <dluis@vmware.com>
2023-08-09 13:26:30 +01:00
f78dd073bf
Merge pull request #6558 from kaovilai/s3profilefix
...
GetS3Credentials pass profile from config to NewSharedCredentials
2023-08-07 16:38:25 +08:00
69bc84cf0c
fix issue 6571
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-08-03 14:46:02 +08:00
bb96c2155c
fix issue 6575 ( #6587 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-08-02 10:27:05 -04:00
289aae1581
GetS3Credentials pass profile from config to NewSharedCredentials
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-07-28 11:26:40 -04:00
a6d79fc272
Merge pull request #6481 from blackpiglet/6444_fix
...
Remove PVC's selector in backup's PVC action.
2023-07-27 15:43:27 +08:00
f666667e5b
Merge pull request #6547 from reasonerjt/del-moved-snapshot
...
Delete moved snapshots when the backup is deleted
2023-07-27 15:10:33 +08:00
b0a343cd48
Delete moved snapshots when the backup is deleted
...
This commit introduces a deleteItemAction which writes a temporary configmap to
record the snapshot info so that the controller can trigger repo manager
to remove the snapshot
This process is a bit chatty and we should consider to refactor the code
so it's easier to connect to the repo directly in the DIA
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-07-27 13:27:33 +08:00
33b21a380c
Remove PVC's selector in backup's PVC action.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-07-27 10:09:00 +08:00
6997e4a694
Merge pull request #6476 from reasonerjt/del-inprog-dbr
...
Delete the expired deletebackuprequests that are stuck in "InProgress"
2023-07-26 16:13:58 +08:00
6dbdc54dc7
check if restore crd exist before operating restore
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-07-25 18:54:42 +08:00
9c8275eda7
Merge pull request #6533 from Lyndon-Li/data-mover-wrong-bsl-after-sync
...
Data mover wrong bsl after sync
2023-07-25 14:20:10 +08:00
74bf03b272
data mover wrong bsl after sync
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-07-25 12:38:09 +08:00
913b610196
fix: Typos and add more spell checking rules to CI ( #6415 )
...
* fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
* fixup! fix: Typos and add more spell checking rules to CI
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
---------
Signed-off-by: Mateus Oliveira <msouzaol@redhat.com>
2023-07-21 17:25:24 -04:00
8396163e77
add missing CompletionTimestamp and metrics when restore moved into terminal phase ( #6397 )
...
Signed-off-by: Nutrymaco <efim7299@icloud.com>
2023-07-21 17:22:01 -04:00
32262babc4
Merge pull request #6479 from allenxu404/i2697
...
add restore finalizer to clean up external resources
2023-07-20 19:07:02 +08:00
2548b20db9
Track the skipped PV in a backup and print the summary in backup log ( #6496 )
...
Partially address the requirements in #5834
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-07-20 16:13:48 +08:00
b4181ef803
restict namespace to node-agent cache ( #6523 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-07-19 16:23:28 -04:00
0bb509ccdd
add restore finalizer to clean up external resources
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-07-19 18:56:35 +08:00
d9a7e2b6ca
Add 'orLabelSelector' for backup, restore command
...
Signed-off-by: Nilesh Akhade <nakhade@catalogicsoftware.com>
2023-07-19 16:16:35 +05:30
c8f970a4f1
Merge branch 'main' into resourcemodifier
...
Signed-off-by: Anshul Ahuja <anshul.ahu@gmail.com>
2023-07-19 11:11:40 +05:30
9e515ac397
Remove dependency of the legacy client code from pkg/cmd directory part 2.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-07-17 17:04:53 +08:00
b5bd55fc56
fix issue 6490 ( #6491 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-07-14 14:05:51 -04:00
dfd7970219
Merge pull request #6469 from blackpiglet/6190_fix
...
Remove dependency of the legacy client code from pkg/cmd directory part 1
2023-07-14 17:15:56 +08:00
89d3ad4864
Remove dependency of the legacy client code from pkg/cmd directory.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-07-14 15:55:09 +08:00
084fd66586
add data upload/download metrics
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-07-14 10:47:53 +08:00
05722876b9
Moving kopia logging to remove kopia from indirect dependency in velero plugins
...
when running `go mod why -m github.com/kopia/kopia` in velero-plugins prior to this change you will see following
```
❯ go mod why -m github.com/kopia/kopia
github.com/konveyor/openshift-velero-plugin/velero-plugins
github.com/vmware-tanzu/velero/pkg/plugin/framework
github.com/vmware-tanzu/velero/pkg/util/logging
github.com/kopia/kopia/repo/logging
```
after
```
❯ go mod why -m github.com/kopia/kopia
(main module does not need module github.com/kopia/kopia)
```
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-07-12 10:44:33 -04:00
8db88bd392
Merge branch 'main' into resourcemodifier
2023-07-10 11:33:49 +05:30
c500e8dc34
Delete the expired deletebackuprequests that are stuck in "InProgress"
...
state
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-07-10 10:15:19 +08:00
7deae4cbf5
Merge pull request #6459 from blackpiglet/6001_fix
...
Add exit code log and possible memory shortage warning log for Restic command failure
2023-07-07 09:24:16 +08:00
e71ee0cc5f
Add support for OpenStack CSI drivers topology keys
...
Signed-off-by: kayrus <kayrus@users.noreply.github.com>
2023-07-05 17:27:24 +02:00
d7f1ea4fbd
Add exit code log and possible memory shortage warning log for Restic command failure.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-07-05 21:35:52 +08:00
e54a8af0ad
Merge pull request #6433 from blackpiglet/6010_fix
...
Modify DownloadRequest controller logic
2023-07-05 10:48:13 +08:00
5171ab0dca
Merge pull request #6434 from allenxu404/i6038
...
Fix hook filter display issue for backup describer
2023-07-03 17:54:40 +08:00
40b2ee1323
Modify DownloadRequest controller logic
...
1. Avoid patch DownloadRequest when it's deleted.
2. Add periodic enqueue resource for reconcile.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-07-03 17:11:48 +08:00
bb20d0d2f2
add changelog
...
Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>
2023-07-03 14:02:58 +05:30
3bdca9fe63
Merge pull request #5774 from anshulahuja98/csimultivscprop
...
Design to add support for Multiple VolumeSnapshotClasses in CSI Plugin
2023-07-03 14:56:47 +08:00
ec4bb42117
Retrieve DataUpload into backup result ConfigMap during volume snapshot restore.
...
Fix issue #6117 .
Add CSI plugin needs builder functions.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-30 11:13:04 +08:00
75833eaa5b
fix hook filter display issue for backup describer
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-06-29 16:37:34 +08:00
c1ca9a0245
clarify the deletion frequency for gc controller
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-06-21 19:14:29 +08:00
6f3adcf728
Restore Endpoints before Services ( #6315 )
...
Restore Endpoints before Services
Fixes #6280
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-06-20 14:35:25 +08:00
d3785e529f
Merge pull request #6396 from allenxu404/archive-ut
...
Add unit test for pkg/archive
2023-06-16 17:52:10 +08:00
41ab949659
add unit test for pkg/archive
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-06-15 18:58:30 +08:00
e3e0ce32ed
Merge pull request #6368 from Lyndon-Li/issue-fix-6341
...
Add UT for pkg/util
2023-06-15 14:05:53 +08:00
75b7599178
add UT for pkg/util 02
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-06-15 12:17:05 +08:00
cace72787e
Merge pull request #6394 from qiuming-best/UT-pkg/discovry
...
Add UT for pkg/discovery
2023-06-15 11:17:19 +08:00
e2bb5b3fe8
Add UT for pkg/discovery
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-06-15 02:45:34 +00:00
6bbdc846ff
Merge pull request #6357 from Lyndon-Li/data-mover-restore-expose-03
...
Data mover restore expose
2023-06-15 09:48:17 +08:00
57bcd8c8dc
Merge pull request #6298 from shubham-pampattiwar/add-default-values
...
Add default values for defaultItemOperationTimeout and itemOperationSyncFrequency in velero CLI
2023-06-13 23:14:14 -07:00
78025a09b6
Add UT for uploader ( #6374 )
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-06-13 16:58:47 +08:00
a5c28ad423
Add warning message for volume snapshotter in data mover case.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-12 17:57:01 +08:00
89c10ddcc0
Update metrics when backup failed with validation error ( #6318 )
...
Update metrics when backup failed with validation error
Fixes #6265
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-06-09 11:19:26 +08:00
8e8c340dd1
Propose a deprecation process for velero
...
As discussed in the velero community call [1]
This is a proposed deprecation policy for the
velero project based on the goharbor project.
[1] https://hackmd.io/Jq6F5zqZR7S80CeDWUklkA
Update GOVERNANCE.md
definitive deprecation times, well done
Co-authored-by: Orlix <OrlinVasilev@users.noreply.github.com>
Signed-off-by: Wesley Hayutin <weshayutin@gmail.com>
Update GOVERNANCE.md
Co-authored-by: Ivan Sim <1330522+ihcsim@users.noreply.github.com>
Signed-off-by: Orlix <OrlinVasilev@users.noreply.github.com>
Update GOVERNANCE.md
Co-authored-by: Ivan Sim <1330522+ihcsim@users.noreply.github.com>
Signed-off-by: Orlix <OrlinVasilev@users.noreply.github.com>
add note regarding deprecation window
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
add changelog file
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-06-08 14:24:46 -07:00
9743a7ce56
Fix #6118 : Do not persist VolumeSnapshot and VolumeSnapshotContent for snapshot DataMover case. ( #6366 )
...
1. Because VolumeSnapshot and VolumeSnapshotContent CRs are not kept after backup completed,
don't persist them in the backup metadata.
2. Add some builder methods needed by CSI plugin.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-08 17:05:17 +08:00
7175283b19
change kopia as the default path of PVB
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-06-08 13:57:24 +08:00
b2f2ba0d0a
Merge pull request #6365 from ywk253100/230607_cli
...
Add data mover related options in CLI
2023-06-08 09:28:34 +08:00
9f2f563568
Add data mover related options in CLI
...
Add data mover related options in CLI
Fixes #6128
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-06-07 16:34:40 +08:00
4227a824cd
Merge pull request #6327 from blackpiglet/6099_fix
...
Remove Wait VolumeSnapshot to ReadyToUse logic.
2023-06-07 14:56:26 +08:00
ad8f69bcb1
Merge pull request #6337 from qiuming-best/data-upload-controller
...
Data upload controller
2023-06-07 11:32:23 +08:00
2ea6ffb63f
data mover restore expose
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-06-06 16:14:58 +08:00
2aaa85bc58
add default values for defaultItemOperationTimeout and itemOperationSyncFrequency in velero CLI
...
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
add changelog
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
update default value for itemOperationsSyncFrequency
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-06-06 00:25:08 -07:00
b3e99a7eb2
Add Dataupload controller
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-06-06 05:46:38 +00:00
ebe064f693
Merge pull request #6336 from Lyndon-Li/issue-fix-6255
...
Fix issue 6255
2023-06-05 21:44:17 +08:00
45d7cc9783
fix issue 6255
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-06-02 16:11:23 +08:00
7491ab1ec5
Remove Wait VolumeSnapshot to ReadyToUse logic.
...
Due to the logic moving to plugin, and the plugin cannot read the
Velero server's resourceTimeout setting, add the resourceTimeout
in the backup annotation to pass to plugin.
Remove VolumeSnapshotContent reset code from Velero server.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-02 14:43:43 +08:00
8427a9fdb3
Merge pull request #6308 from Lyndon-Li/data-mover-backup-expose-02
...
Data mover backup expose
2023-06-02 12:07:37 +08:00
25624d3030
data mover backup expose
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-06-02 11:51:36 +08:00
80db04e08b
Merge pull request #6320 from blackpiglet/6302-fix
...
Include namespace resource needed by namespaced-scope resource in backup
2023-06-02 09:46:59 +08:00
8766a4dbd4
Make namespace resource doesn't honor label selector filters anymore.
...
For some use cases, namespaced-scope resources are inluded into backup,
but the namespaces are not included due to filters setting.
To do this, removing label selector filter from namespace resource.
Namespace resource only honor namespace exclude/include filters.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-06-01 16:59:18 +08:00
59965af775
Merge pull request #6296 from Lyndon-Li/issue-fix-6258
...
Fix issue 6258
2023-06-01 16:03:52 +08:00
7243efdb7c
fix issue 6258
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-06-01 14:27:10 +08:00
97fbc52cfb
fix-issue-6297
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-31 16:48:11 +08:00
4322ae14e3
Skip updating status when CRDs are restored ( #6325 )
...
This commit skips updating the restore progress, in the first loop for
restoration when CRDs are handled, so that the misleading "totalItem"
will not appear in the CR.
Fixes #5990
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-05-31 11:45:57 +08:00
3ad091dc38
Merge pull request #5968 from Lyndon-Li/velero-data-movement-design
...
Volume Snapshot Data Movement Design
2023-05-24 08:33:20 +08:00
53623a75ff
Merge pull request #6303 from Lyndon-Li/data-mover-generic-data-path-issue-fix
...
Fix PVR issue for generic data path
2023-05-23 18:09:07 +08:00
6c16020a3e
fix pvr issue for generic data path
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-23 15:20:13 +08:00
7fa91060bd
Merge pull request #6276 from kkothule/backupstatusprogressupdate
...
Fix status.progress not getting updated for backup
2023-05-22 11:38:33 -04:00
5cb721764f
Merge pull request #6283 from Lyndon-Li/issue-fix-5875
...
Fix issue 5875
2023-05-22 13:46:00 +08:00
25fb08b3c2
Merge pull request #6226 from Lyndon-Li/data-mover-generic-data-path
...
Add code change for async generic data path
2023-05-22 09:47:47 +08:00
6a569ca5b5
Fix status.progress not getting updated for backup
...
Signed-off-by: kkothule <kkothule@catalogicsoftware.com>
2023-05-18 15:31:07 +05:30
660fbfab71
Merge branch 'main' into issue-fix-5875
2023-05-18 16:04:00 +08:00
124e142583
fix issue 5875
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-18 15:48:08 +08:00
b8910749d2
Merge pull request #6111 from eemcmullan/pvc-dataref
...
Remove dataSource from PVC on backup for prior CSI restore case
2023-05-18 14:31:43 +08:00
5f008d18fa
Merge branch 'main' into data-mover-generic-data-path
2023-05-17 10:15:52 +08:00
5b75f35262
Add data mover CRD under v2alpha1 ( #6176 )
...
* add data mover CRD under v1alpha1
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
* data mover CRDs to v2alpha1
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
* data mover crd changes
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
---------
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-16 15:09:54 -04:00
dd40f7b777
velero data movement design
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-16 18:42:58 +08:00
78db01753e
add change log
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-15 11:19:08 +08:00
ea4e49f503
Merge pull request #6248 from Lyndon-Li/bump-up-kopia-v0.13
...
Bump up kopia v0.13
2023-05-15 10:44:19 +08:00
307b82a2ec
bump up kopia v0.13.0
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-15 07:23:38 +08:00
623da51494
add shared generic data path
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-12 12:01:59 +08:00
9fea274fca
bump up kopia v0.13.0
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-05-10 10:26:10 +08:00
f6cea372fd
log volumes to backup to help debug why `IsPodRunning` is called.
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-05-05 13:41:17 -04:00
f051ecaee9
Enable errcheck linter and resolve found issues.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-28 09:33:42 +08:00
fbba4e5c77
Merge pull request #6151 from kaovilai/expose-getpluginconfig
...
Make GetPluginConfig accessible from other packages.
2023-04-26 17:42:19 +08:00
a8a17d725a
Merge pull request #6194 from blackpiglet/linter_more
...
Enable more linters, and remove mal-functioned milestoned issue action.
2023-04-26 14:12:47 +08:00
0d1c2dc831
Merge pull request #6173 from blackpiglet/linter_revive
...
Enable linter revive and resolve found errors: part1
2023-04-26 14:09:33 +08:00
e106bbf06b
Enable linter revive and resolve found errors: part 2. ( #6177 )
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
Co-authored-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-26 14:05:22 +08:00
443f732e51
Enable more linters, and remove mal-functioned milestoned issue action.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-25 23:31:51 +08:00
180cc4e31d
Enable linter revive and resolve found errors: part 1
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-25 23:15:15 +08:00
51c67089f5
Merge branch 'main' into linter_staticcheck
...
Signed-off-by: Xun Jiang/Bruce Jiang <59276555+blackpiglet@users.noreply.github.com>
2023-04-25 15:49:05 +08:00
30140d6b1a
Merge pull request #6184 from Lyndon-Li/issue-fix-6182
...
Fix issue 6182
2023-04-25 15:31:08 +08:00
d928124b01
fix issue 6182
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-04-25 15:00:08 +08:00
bbc1e2e151
Enable stylecheck linter and resolve found issues.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-25 14:37:02 +08:00
cb0ada1e1c
Enable staticcheck and resolve found issues.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-25 11:33:40 +08:00
1fd28e8a36
Fix usestdlibvars and whitespace linters issues. ( #6162 )
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
Co-authored-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-24 09:10:55 +08:00
14f31eed8c
Merge pull request #6109 from blackpiglet/modify_goreleaser
...
Fix goreleaser issues and add new goreleaser action.
2023-04-18 15:00:41 +08:00
6b67504a98
Merge pull request #6158 from blackpiglet/update_golang_main
...
Update Golang to v1.20 for main branch.
2023-04-18 14:53:44 +08:00
0be3f5a3e7
Update Golang to v1.20 for main branch.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-17 13:26:46 +08:00
08f7f555f3
mv pkg/restore/pod_volume_restore_action.go/getPluginConfig pkg/plugin/framework/common/plugin_config.go/GetPluginConfig
...
Fixes Expose GetPluginConfig #4865
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
Signed-off-by: Tiger Kaovilai <passawit.kaovilai@gmail.com>
2023-04-15 07:04:42 +00:00
61c8e58fef
remove datasource from pvc if prior csi restore
...
Signed-off-by: Emily McMullan <emcmulla@redhat.com>
2023-04-12 10:52:30 -04:00
b4aa0b8f5f
Ignore not found error during patching managedFields
...
Ignore not found error during patching managedFields
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-04-12 17:17:13 +08:00
e779cd2b76
Fix goreleaser issues and add new goreleaser action.
...
Fix goreleaser script's bug.
Add a new Github action to verify goreleaser related modification.
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-11 17:03:20 +08:00
0c1a57af72
Add changelog for v1.11.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-07 15:19:05 +08:00
56f93393d8
Modify new scope resource filters name.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-06 18:11:55 +08:00
73f1740407
Merge pull request #6062 from blackpiglet/5862_fix
...
Make Velero not exits when EnableCSI is on and CSI snapshot not installed
2023-04-04 15:52:48 +08:00
42ec72146d
Merge branch 'main' into update_golang_version_new
...
Signed-off-by: Xun Jiang/Bruce Jiang <59276555+blackpiglet@users.noreply.github.com>
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-04 05:56:05 +00:00
fc692c49e6
Update Golang version to v1.19 for branch main.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-04-04 12:00:19 +08:00
c1acd9c6c5
Make Velero server continue to work, when CSI feature is enabled and Snapshot CRD group is missing.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-03-31 17:47:27 +08:00
cccbd2f8c0
Restore Services before Clusters
...
Restore Services before Clusters so they can be adopted by AKO-operator and no new Services will be created for the same clusters
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-03-31 14:26:07 +08:00
05c4e35ae7
Fixed backup deletion bug related to async operations
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-29 09:27:04 -04:00
2dc8a920ca
fix issue 5972
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-03-24 14:41:22 +08:00
15d44724e7
Modify golangci.yaml file. Resolve found lint issues. ( #6008 )
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
Co-authored-by: Xun Jiang <blackpiglet@gmail.com>
2023-03-24 12:15:08 +08:00
433d2d5e57
BIA/RIAv2 -- distinguish between New and InProgress operations
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-21 18:55:59 -04:00
2ad43194aa
Merge pull request #5900 from blackpiglet/5416_limit_concurrent_goroutine
...
Limit the concurrent number for backup's VolumeSnapshot operation
2023-03-21 18:07:27 +08:00
458560795b
Remove Reference of itemsnapshotter ( #5997 )
...
It will be removed as we choose to use BIAv2 for progress monitoring.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-03-21 09:05:29 +08:00
2c26c1d5fe
Merge pull request #5996 from sseago/biav2-second-followon
...
minor fixes for backup_operations_controller:
2023-03-20 08:42:33 -07:00
e500e2d8e5
minor fixes for backup_operations_controller:
...
1) default frequency 10s
2) per-reconcile log is now Debug not info
3) added predicate to reduce reconcile events
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-20 09:42:15 -04:00
2155b2b215
RIAv2 async operations controller work
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-17 14:30:39 -04:00
c677c433e0
Limit the concurrent number of go routine for VolumeSnapshot and VolumeSnapshotContent operations.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-03-16 11:42:38 +08:00
a0dac73c95
Add warning/error result to cmd `velero backup describe`
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-03-15 14:20:47 +08:00
f527a1fc62
Merge pull request #5933 from sseago/additional-items-ready-main
...
Wait for additional items to be ready before restoring current item
2023-03-15 11:00:41 +08:00
a1e4f54488
Add new resource filters can separate cluster and namespace scope resources.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-03-14 07:07:22 +00:00
a2621caa74
Wait for additional items to be ready before restoring current item
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-13 15:26:45 -04:00
dd63e8182c
Follow-on fixes for BIAv2 controller work
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-13 10:29:36 -04:00
ec4a7072b3
add server setting for default timeouts
...
Signed-off-by: Emily McMullan <emcmulla@redhat.com>
2023-03-10 10:15:09 -05:00
54042c3b01
Merge pull request #5773 from qiuming-best/volumes-filter-design
...
Design for Handling backup of volumes by resources filters
2023-03-10 09:19:37 +08:00
7d7e3fff0d
Refoctor backup controller with controller-runtime. ( #5969 )
...
Signed-off-by: Ming <mqiu@vmware.com>
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
Co-authored-by: Ming <mqiu@vmware.com>
2023-03-10 08:59:40 +08:00
6d8f086283
Merge pull request #5956 from Lyndon-Li/issue-fix-5935
...
Fix issue 5935
2023-03-09 15:28:47 +08:00
40aae5ebdd
fix issue 5935
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-03-09 14:24:51 +08:00
c6059a93d2
Merge pull request #5873 from blackpiglet/add_psa_support
2023-03-08 17:41:53 -08:00
28d636bd71
fix client wait problem
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-03-08 09:29:16 +08:00
8bed159023
Merge pull request #5849 from sseago/async-backup-controller
...
BIAv2 async operations controller work
2023-03-06 18:10:08 -08:00
99c622331a
Switch the base image to distroless/base-nossl-debian11 to reduce the CVE triage efforts
...
Switch the base image to distroless/base-nossl-debian11 to reduce the CVE triage efforts
Fixes #5902
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-03-02 15:45:08 +08:00
c3d1d83da5
BIAv2 async operations controller work
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-03-01 11:49:17 -05:00
7b3b2c28d2
Merge pull request #5907 from kaovilai/client-go-v0.25.0
...
Upgrade to k8s.io/client-go v0.25.6
2023-02-28 16:43:39 +08:00
357a917c4e
Merge pull request #5899 from anshulahuja98/goreleaser
...
upgrade and fix goreleaser issue
2023-02-28 16:40:48 +08:00
eb4ecd3767
Add restored resource list in the output of restore describe command
...
Add restored resource list in the output of restore describe command
Fixes #5199
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-02-28 10:43:03 +08:00
c2ac76165e
Make restore controller adopting the controller-runtime framework.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-02-25 11:55:02 +08:00
a467488f1a
Merge pull request #5894 from Lyndon-Li/issue-fix-5881
...
Fix issue 5881
2023-02-24 17:23:10 +08:00
6163df5da2
`go get k8s.io/client-go@v0.25.6 && go mod tidy`
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-02-23 16:41:29 -05:00
b23c541010
Merge pull request #5859 from hezhizhen/clock
...
Replace k8s.io/apimachinery/pkg/util/clock with k8s.io/utils/clock
2023-02-23 13:37:33 -08:00
0a2aed8967
Fix Dependabot alerts. Update Dockerfile. Modify Trivy daily scan.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-02-23 14:04:59 +08:00
1730f8bcb4
upgrade and fix goreleaser issue
...
Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>
2023-02-22 06:36:51 +00:00
08b8498afb
fix issue 5881
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-02-21 19:17:38 +08:00
5555f7d4e7
Merge pull request #5865 from allenxu404/issue4816
...
Add a json output to velero backup describe
2023-02-21 18:19:06 +08:00
16bf3e2d90
Add a json output to velero backup describe
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-02-21 17:16:34 +08:00
fb1dc110f2
Replace k8s.io/apimachinery/pkg/util/clock with k8s.io/utils/clock
...
Signed-off-by: Zhizhen He <hezhizhen.yi@gmail.com>
2023-02-21 11:56:17 +08:00
6be07a1df3
Add labels for created namespace during velero installation to adopt k8s v1.25's PSS and PSA.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-02-20 21:27:04 +08:00
4d0c3ac83f
Restore finalizer and managedFields ( #5853 )
...
Restore finalizer and managedFields of metadata during the restoration
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-02-20 10:26:45 +08:00
fa58a775e8
Merge pull request #5576 from anshulahuja98/backupresults
...
Publish backup results to enhance error info
2023-02-18 17:00:49 -05:00
8c3ddf0f73
Publish backup results extracted from backup logs
...
Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>
2023-02-16 09:57:53 +05:30
c5efb542d0
Merge pull request #5786 from qiuming-best/unsupport-type-error
...
Set Kopia IgnoreUnknownTypes in ErrorHandlingPolicy to True
2023-02-13 15:08:48 +08:00
8f76907aff
Merge pull request #5843 from ywk253100/230208_secret
...
Add secret restore item action to handle service account token secret
2023-02-13 11:57:32 +08:00
0be05c9bc8
Merge pull request #5788 from blackpiglet/enable_staticcheck
...
Enable staticcheck linter. Disable check for folder /pkg and /test by…
2023-02-08 19:26:22 -05:00
7bf5b507f7
Design to add support for Multiple VolumeSnapshotClasses in CSI Plugin
...
Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>
2023-02-08 16:31:24 +05:30
731a484275
Add secret restore item action to handle service account token secret
...
Add secret restore item action to handle service account token secret:
1. Skip the restoration for the auto-created service account token secret
2. Remove several fields for non-auto-created service account token secret to make sure the secret can be restored
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-02-08 15:52:11 +08:00
7139daf07a
Merge pull request #5769 from Lyndon-Li/issue-fix-5458
...
Issue fix 5458
2023-02-08 09:59:15 +08:00
6257060bb6
Merge pull request #5333 from blackpiglet/5120_seperate_exlude_include_resource_parameter
...
Proposal to separate resource filter into cluster scope and namespace…
2023-02-08 09:11:51 +08:00
53c3f4b436
Issue fix 5226 ( #5768 )
...
* fix issue 5226
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-02-07 17:47:25 +08:00
0fd5af3300
Set Kopia IgnoreUnknownTypes in ErrorHandlingPolicy to True for ignoring backup unknown file type
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-02-07 08:30:58 +00:00
5db9437f5e
Merge pull request #5540 from wenterjoy/main
...
change image repository by configmap
2023-02-06 20:31:47 -05:00
19b855660a
Merge pull request #5828 from kaovilai/pvb-pvr-should-fail-during-startup
...
Use updated PVB/PVR for patching Failed Phase during startup
2023-02-06 15:08:59 -05:00
53f3d13d7c
Merge pull request #5807 from shubham-pampattiwar/update-crd-desc
...
Update CRD descriptions for SnapshotVolumes and restorePVs
2023-02-06 14:56:28 -05:00
218fd76411
Add mapped selected-node existence check. ( #5806 )
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-02-06 17:03:35 +08:00
d7738532c8
Use updated PVB/PVR for patching Failed Phase during startup
...
Use the same pvb/pvr update functions across pkg/controller and pkg/cli/nodeagent for consistency of behavior
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-02-03 14:22:56 -05:00
0b6b841f2a
Remove redundant client from restore controller. ( #5759 )
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-02-03 15:57:43 +08:00
745d573dfa
Merge pull request #5812 from Lyndon-Li/bump-up-golang-net
...
[Main] bump up golang net
2023-02-02 17:10:02 +08:00
9d1ccedd44
modified according to review comments
...
Signed-off-by: wenterjoy <zhaoxin26@lenovo.com>
2023-02-02 02:27:31 +00:00
8b0afa3c44
Add option "--service-account-name" to install cmd ( #5802 )
...
The option "--service-account-name" is to be added to that user can use
an existing service account for velero and node-agent pods. This is
helpful for users who wanna use IRSA.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-02-01 17:12:24 +08:00
2b043f7bdf
bump up golang net
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-02-01 15:33:53 +08:00
a0891c6f44
add channgelog
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-02-01 06:30:09 +00:00
51568525cb
Merge pull request #5779 from allenxu404/issue-matrics
...
add prometheus metrics to record warning total and last status of backups
2023-01-31 16:02:30 +08:00
428415c004
update CRD descriptions for SnapshotVolumes and restorePVs
...
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
add changelog file
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-01-31 00:01:40 -08:00
a5a165b0c3
add prometheus metrics to record warning total and last status of backups
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-01-30 15:40:59 +08:00
fb5ee2e7bf
Proposal to add resource filters for backup can distinguish whether resource is cluster scope or namespace scope.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-01-20 15:29:03 +08:00
955eec7033
Enable staticcheck linter. Disable check for folder /pkg and /test by now.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-01-20 13:52:13 +08:00
d14879ff74
Merge pull request #5752 from sseago/itemoperations-json
...
Define itemoperations.json format and update DownloadRequest API.
2023-01-19 13:24:24 -05:00
b0a16ceac1
Merge pull request #5760 from Lyndon-Li/issue-fix-5043
...
Issue fix 5043
2023-01-19 16:44:14 +08:00
e6c8f3afa5
Bump up restic version to 0.15.0
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-01-19 02:43:09 +00:00
cf2b482c97
Merge pull request #5569 from sseago/riav2-impl
...
Restore Item Action v2 API implementation
2023-01-18 10:09:27 -05:00
d23418b5b5
add change log
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-01-17 18:23:43 +08:00
601f4a9985
Add GOARM in Restic builder. Add PR container build action.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-01-17 17:24:21 +08:00
2574229fb0
add change log for 5769
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-01-16 19:15:49 +08:00
46bcdb2c50
Merge pull request #5764 from blackpiglet/add_restic_builder
...
[cherry-pick][main] Add restic builder
2023-01-13 16:35:51 +08:00
01c4e9b0c9
Fix Dockerfile issue.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-01-13 14:37:55 +08:00
7d916485ec
Add Restic builder in Dockerfile.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-01-13 14:32:22 +08:00
e8ea414af7
Merge pull request #5740 from blackpiglet/add_trivy_nightly_scan
...
Add Trivy nightly scan.
2023-01-12 01:43:49 -05:00
9f6f13f0c5
RestoreItemAction v2 API implementation
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-01-10 16:26:28 -05:00
ab642ffff2
Merge pull request #5442 from sseago/biav2-impl2
...
BackupItemAction v2 API implementation
2023-01-10 09:34:03 -05:00
9a54142257
BackupItemAction v2 API implementation
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-01-09 18:36:47 -05:00
70b4238013
Define itemoperations.json format and update DownloadRequest API.
...
This is to support uploading async operation metadata to
object storage to support progress monitoring.
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-01-09 18:19:21 -05:00
b10503b351
Add Trivy nightly scan.
...
Signed-off-by: Xun Jiang <blackpiglet@gmail.com>
2023-01-05 20:06:21 +08:00
78682d7cc3
Merge pull request #5710 from sseago/async-cr-phases
...
backup/restore phases for async plugin operations
2023-01-03 13:24:58 +08:00
5b03da2637
Merge pull request #5715 from Lyndon-Li/issue-fix-5696
...
[Main] Fix issue 5696
2022-12-22 10:49:25 +08:00
2abb176bd8
backup/restore phases for async plugin operations
...
Signed-off-by: Scott Seago <sseago@redhat.com>
2022-12-21 10:15:32 -05:00
32eb8655cc
fix issue 5696
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2022-12-21 12:49:23 +08:00
3b903e678f
[Cherry-Pick]Fix error with Restic backup empty volumes
...
Signed-off-by: Ming <mqiu@vmware.com>
2022-12-20 06:33:22 +00:00
55873c1c37
Prevent nil panic on exec restore hooks ( #5675 )
...
* Prevent nil panic on exec restore hooks
Signed-off-by: Dylan Murray <dymurray@redhat.com>
2022-12-13 13:45:52 +08:00
2f3732fa44
Fix CVEs scanned by trivy
...
Signed-off-by: Ming <mqiu@vmware.com>
2022-12-02 06:57:49 +00:00
a462bef9c3
cut v1.10 docs on main
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2022-11-25 17:14:52 +08:00
8194e8d723
Restore ClusterBootstrap before Cluster
...
Restore ClusterBootstrap before Cluster otherwise a new default ClusterBootstrap object is create for the cluster
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2022-11-22 17:25:13 +08:00
16ecc7c7b1
update 1.10 release notes
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2022-11-17 16:46:45 +08:00
efb4002522
1.10 changelog and doc ( #5583 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2022-11-11 19:37:44 +08:00
fc0c470395
Add compile restic binary for CVE fix
...
Signed-off-by: Ming <mqiu@vmware.com>
2022-11-09 07:29:18 +00:00
bf1122b633
Fix controller problematic log output
...
Signed-off-by: Ming <mqiu@vmware.com>
2022-11-09 06:46:45 +00:00
c4c5f016f6
Merge pull request #5468 from qiuming-best/upgrade-doc
...
Add v1.10 velero upgrade doc
2022-11-07 10:08:07 +08:00
1865aab28d
Merge pull request #5535 from ywk253100/221102_order
...
[cherry-pick]Enhance the restore priorities list to support specifying the low prioritized resources that need to be restored in the last
2022-11-03 14:53:10 +08:00
c186a7d193
Enhance the restore priorities list to support specifying the low prioritized resources that need to be restored in the last
...
Enhance the restore priorities list to support specifying the low prioritized resources that need to be r
estored in the last
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2022-11-03 10:53:32 +08:00
345abb3142
Merge pull request #5534 from qiuming-best/backup-progress
...
fix restic backup progress error
2022-11-02 17:15:30 +08:00
32637da16b
fix restic backup progress error
...
Signed-off-by: Ming <mqiu@vmware.com>
2022-11-02 07:49:00 +00:00
5db3da5aea
Merge pull request #5512 from Lyndon-Li/issue-fix-5505
...
Issue fix 5505
2022-11-01 19:38:39 +08:00
ae1e42cfd7
Merge pull request #5478 from Lyndon-Li/s3-compatible-provider
...
Issue fix 5477
2022-11-01 19:38:26 +08:00
e6ba774841
remove restic in docs ( #5499 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2022-11-01 18:11:21 +08:00
52a49d1945
fix backup failure with self-signed certification
...
Signed-off-by: Ming <mqiu@vmware.com>
2022-11-01 07:05:20 +00:00
502b058282
Merge pull request #5521 from blackpiglet/add-credential-store-in-back-deletion-controller
...
Add credential file store in the backup deletion controller.
2022-11-01 09:16:57 +08:00
qiuming
Xun Jiang/Bruce Jiang
Lyndon-Li
Wenkai Yin(尹文开)
Xun Jiang
Daniel Jiang
Jeffrey Koehler
lou
Anshul Ahuja
lyndon
Tiger Kaovilai
allenxu404
Shubham Pampattiwar
Sebastian Glab
Yang Gang
Ripolin
Shubham Pampattiwar
Scott Seago
Guang Jiong Lou
David Zaninovic
Clever Hu
Nilesh Akhade
Shawn Hurley
Luis Davim
Mateus Oliveira
Efim Smykov
Anshul Ahuja
kayrus
Wesley Hayutin
Xun Jiang
kkothule
Emily McMullan
Zhizhen He
wenterjoy
Dylan Murray