e498ea99a3
Merge pull request #7295 from josemarevalo/main
...
Add CRD name to error message when it is not ready to use
2024-01-12 14:59:48 +08:00
0b307ca035
Add CRD name to error message when it is not ready to use
...
When debugging this error it is currently hard to identify what
CRD is causing the issue. This is particularly difficult when
dealing with over a hundred CRDs.
Signed-off-by: Jose Arevalo <jose.matias.arevalo@gmail.com>
2024-01-10 12:11:47 +10:00
9a1be6f53f
Make "disable-informer-cache" option false(enabled) by default to keep it consistent with the help message
...
Make "disable-informer-cache" option false(enabled) by default to keep it consi
stent with the help message
Fixes #7264
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2024-01-10 09:49:54 +08:00
306a8fda3e
fix-item-operation-timeout-explain
...
Signed-off-by: zhongjun.li <zhongjun.li@daocloud.io>
2024-01-08 15:00:06 +08:00
200fd80448
isue 6928: remove snapshot deletion timeout for PVB
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2024-01-08 11:28:23 +08:00
a5d08ac5f0
Do not set "targetNamespace" to namepsace items
...
fixes #7263
This commit makes the data structures more consistent, that namespaces,
as cluster scoped resource will not have "targetNamespace" in the
"restoreableItem" instance.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2024-01-05 14:01:16 +08:00
e84a51deec
Merge pull request #7262 from qiuming-best/intermediate-pv-delete
...
Fix intermediate PV delete for data mover
2024-01-04 15:45:32 +08:00
c3c4c97914
Merge pull request #7265 from Lyndon-Li/change-node-agent-config-name
...
Change node-agent-config name
2024-01-04 15:43:43 +08:00
92fdf407c7
Fix intermediate pv delete for data mover
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2024-01-04 03:26:47 +00:00
58ead55fd1
change node-agent-config name
...
Signed-off-by: Lyndon-Li <yonghui.li@broadcom.com>
2024-01-03 22:02:04 +08:00
08dedd8b66
Rename volumeinfo metadata file.
...
Change from <backup-name>-volumeinfos.json.gz to
<backup-name>-volumeinfo.json.gz.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2024-01-03 11:22:49 +08:00
8e4cefbb0d
Reduce backup DeepCopy
...
Signed-off-by: zhongjun.li <zhongjun.li@daocloud.io>
2024-01-02 11:34:40 +08:00
8c84836644
Fix pvc assignment
...
Signed-off-by: zhongjun.li <zhongjun.li@daocloud.io>
2023-12-29 15:09:41 +08:00
60d2c62c1a
issue 7244: delete incomplete snapshot automatically for kopia uploader
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-22 16:44:00 +08:00
ee345cf281
Adjust the newline output of resource list in restore describer ( #7238 )
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-12-22 10:53:29 +05:30
7d2c749abf
Merge pull request #7231 from blackpiglet/update_volumeinfo_json_tag
...
Don't generate empty structure.
2023-12-21 16:32:58 +08:00
9be8eb0c6d
Don't generate empty structure.
...
VolumeInfo contains several sub-structures. They are filled for
different scenarios. Do not generate empty structure for the
not filled sub-structures.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-21 14:53:03 +08:00
210838267f
issue 7237: add pvc namespace to backup describe
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-21 10:02:27 +08:00
0da01842ad
remove csi feature check from backup describe
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-20 14:51:21 +08:00
a44cd4be33
Merge pull request #7222 from qiuming-best/adjust-bsl-setting-logic
...
Adjust velero server side default backup location setting logic
2023-12-20 10:29:59 +08:00
8f6d46be87
Remove the redundant newline in backup describe output
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-12-19 15:25:37 +08:00
7d2be128ae
Move velero server side default backup location setting logic to server startup
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-12-19 05:43:29 +00:00
ee879fdcc3
Merge pull request #7221 from blackpiglet/schedule_cli_fix
...
Fix shedule get and describe CLI nil pointer issue
2023-12-18 20:44:03 +08:00
6222891d5b
Fix shedule get and describe CLI issue.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-18 16:41:10 +08:00
0313c2add0
issue 7214: data mover backup describe for legacy backups
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-18 11:07:01 +08:00
ea6c8ca127
fix finalizer typo in logs ( #7204 )
...
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-12-13 11:46:21 -05:00
5f14628d69
Merge pull request #7201 from Lyndon-Li/issue-fix-7189
...
Issue 7189: generic restore - don't assume the first volume as the restore volume
2023-12-12 12:47:25 +08:00
cf7d27c4bc
issue 7189: generic restore - don't assume the first volume as the restore volume
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-12 10:04:31 +08:00
2bd9bf2903
Merge pull request #7076 from shubham-pampattiwar/update-backup-log
...
Update backup log to reflect appropriate backup phase
2023-12-11 12:49:06 -08:00
804b9a8d91
Merge pull request #7171 from kaovilai/tests-explicit-enableCSI
...
Add explicit enableCSI to TestProcessBackupCompletions
2023-12-11 14:11:37 +08:00
c0613f1cf6
Merge pull request #7195 from reasonerjt/fix-7190
...
Use a new variable for resource path
2023-12-11 10:47:19 +08:00
0f49935720
Use a new variable for resource path
...
This commit avoids mistakes when checking the type of the resource
Fixes #7190
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-12-10 23:19:52 +08:00
52d3fca652
Merge pull request #7191 from qiuming-best/uploader-configmapkey
...
Modify uploader config map key
2023-12-08 13:49:34 +08:00
df82691097
Modify uploader config map key
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-12-08 03:07:13 +00:00
eaba99b92e
Add test skipImmediately is switched to false after reconcile
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-12-08 09:12:08 +07:00
9e016c568a
Address requeue feedback
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-12-08 09:12:08 +07:00
e4bd59727f
Schedule SkipImmediately
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-12-08 09:12:08 +07:00
4070934f85
Merge pull request #7125 from Lyndon-Li/issue-fix-6695
...
Issue fix 6695: add describe for data mover backups
2023-12-07 16:23:30 +08:00
759e8a9c63
Merge pull request #7184 from blackpiglet/7163_fix
...
Update CSIVolumeSnapshotsCompleted in backup's status and the metric
2023-12-07 11:14:28 +08:00
edb0860dd2
Fix issue #7163 .
...
Update CSIVolumeSnapshotsCompleted in backup's status and the metric
during backup finalize stage according to async operations content.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-07 09:43:10 +08:00
099acd2527
Merge pull request #7141 from qiuming-best/support-restore-sparse
...
Allow sparse option for Kopia & Restic restore
2023-12-06 18:25:34 +08:00
1a237d3e4c
Update API
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-12-06 08:59:12 +00:00
72fcd84a51
csi data mover backup describe
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-06 10:53:09 +08:00
8d8d68d649
Merge pull request #7175 from blackpiglet/download_request
...
Refactor DownloadRequest Stream function
2023-12-06 10:28:44 +08:00
ea04a86eb2
Merge pull request #6771 from qiuming-best/bsl-fix
...
Fix default BSL setting not work
2023-12-05 19:09:50 +08:00
6093e651cb
Merge pull request #7161 from Lyndon-Li/node-agent-config-doc
...
Add node-agent concurrency doc
2023-12-05 16:52:29 +08:00
ac5d030ab4
Merge branch 'main' into issue-fix-6695
2023-12-05 16:46:31 +08:00
2fa785a3dd
Merge pull request #7052 from qiuming-best/data-mover-fail-early
...
Make data mover fail early
2023-12-05 16:33:46 +08:00
434e073c67
csi data mover backup describe, support legacy backups
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-12-05 15:49:35 +08:00
c8e76f4602
Fix the DownloadRequest context error.
...
Clean the DownloadRequest Stream function.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-05 13:29:23 +08:00
f2ba625229
Merge pull request #7138 from blackpiglet/6595_volumeinfo_restore
...
Use VolumeInfo to help restore the PV.
2023-12-05 10:19:16 +08:00
28df14d9d5
Modify restore logic.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-05 10:01:16 +08:00
3b42abd139
Merge pull request #7174 from reasonerjt/snapshot-flag-skip-csi
...
Make sure the PVs skipped by CSI plugin due to settings in backup spec are tracked
2023-12-05 09:31:21 +08:00
c77bec73bb
Move VolumesInformation to an independant package.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-04 08:33:37 +08:00
ca97248f2a
Use VolumeInfo to help restore the PV.
...
Add VolumeInfo for left PVs during backup.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-12-04 08:33:37 +08:00
2132506e8c
Add explicit enableCSI to TestProcessBackupCompletions
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-12-01 14:22:40 -05:00
266ea5d55a
Make sure the PVs skipped by CSI plugin due to settings in backup spec
...
are tracked
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-12-01 14:19:54 +08:00
a318e1da99
Fix floatation of error/message in the backup result. ( #7159 )
...
* Fix floatation of error/message in the backup/restore result
Signed-off-by: Shashank Singh <shashank1306s@gmail.com>
* fix for checkgates
Signed-off-by: Shashank Singh <shashank1306s@gmail.com>
* refactoring
Signed-off-by: Shashank Singh <shashank1306s@gmail.com>
---------
Signed-off-by: Shashank Singh <shashank1306s@gmail.com>
2023-12-01 09:50:01 +05:30
c6cba300fb
Fix default BSL setting not work
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-12-01 02:06:35 +00:00
0afaa70e9b
Merge branch 'main' of https://github.com/qiuming-best/velero into support-restore-sparse
2023-11-30 10:55:55 +00:00
5cbfd9fffd
Merge pull request #7150 from Lyndon-Li/issue-fix-7135
...
Issue 7135: check pod status before checking node-agent pod status
2023-11-29 15:47:23 +08:00
81183f683e
Merge branch 'main' into issue-fix-6695
2023-11-29 15:12:21 +08:00
f5bbe82e78
Merge pull request #7152 from reasonerjt/track-skipped-SnapshotVolumes-false
...
Track the skipped PV when SnapshotVolumes set as false
2023-11-29 14:46:23 +08:00
33b570d5cd
Merge branch 'main' into node-agent-config-doc
2023-11-29 14:45:20 +08:00
8968ae5ec4
add node-agent concurrency doc
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-29 14:33:51 +08:00
e416b20148
issue 7135: check pod status before checking node-agent pod status
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-29 13:46:50 +08:00
f5c159ce56
Resolve linter issues.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-29 11:15:43 +08:00
d70535b6d2
Add nolintlint linter.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-29 11:13:46 +08:00
ec03d1ebce
Add noctx linter.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-29 11:13:46 +08:00
dbd1a12d9f
Add nilerr and ginkgolinter linter.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-29 11:13:46 +08:00
cddc11e000
Enable linter errchkjson.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-29 11:13:46 +08:00
3805a470a9
Enable dupword linter.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-29 11:13:46 +08:00
03dff100a3
Make data mover fail early
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-11-29 03:03:53 +00:00
b8604b6a89
Treat namespace as a regular restorable item ( #7143 )
...
Fixes #1970
Namespaces will be handled as cluster-scope resource, but for
consistency they will still created via "Ensure namespace" flow for
consistency.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-11-28 11:20:36 -05:00
b759877f5b
Track the skipped PV when SnapshotVolumes set as false
...
This commit makes sure if a PV is not taken snapshot b/c the flag
SnapshotVolumes is set to false in a backup CR, the PV is also also
tracked as skipped in the tracker.
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-11-28 22:52:17 +08:00
b57dde1572
Allow sparse option for Kopia & Restic restore
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-11-28 13:48:09 +00:00
85482aefaf
Merge pull request #7117 from allenxu404/issue6567
...
Add hook status to backup/restore CR
2023-11-28 16:54:11 +08:00
5d1a632be4
Add hook status to backup/restore CR
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-11-28 14:47:31 +08:00
6ac7ff1230
Merge pull request #7130 from qiuming-best/data-mover-recoverbility
...
Node agent restart enhancement
2023-11-28 14:25:47 +08:00
98a56eb5c7
Node agent restart enhancement
...
Signed-off-by: Ming Qiu <mqiu@vmware.com>
2023-11-28 05:50:46 +00:00
3fdb3ec7c5
Merge pull request #7069 from 27149chen/imporve-discovery-refresh
...
improve discoveryHelper.Refresh() in restore
2023-11-27 18:02:36 +08:00
179faf3e33
update after review
...
Signed-off-by: lou <alex1988@outlook.com>
2023-11-27 17:39:37 +08:00
d336e2812e
Merge pull request #6958 from blackpiglet/5156_list_option_fix
...
Change controller-runtime List option from MatchingFields to ListOpti…
2023-11-27 17:38:12 +08:00
8ab0c017a9
issue 6695: add backup description for data mover
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-27 16:19:34 +08:00
ccd3f220ad
Merge pull request #7090 from qiuming-best/perf-test-0
...
Enhance perf test
2023-11-27 16:10:26 +08:00
507157f812
Add perf test namespace mapping when restore
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-11-27 02:11:13 +00:00
1815c1691f
Merge branch 'main' into issue-fix-6695
2023-11-27 09:46:22 +08:00
c2d4495efe
Merge branch 'main' of https://github.com/qiuming-best/velero into kopia-parallelism
2023-11-22 03:52:20 +00:00
5c958d820d
Merge pull request #7100 from blackpiglet/6595_volumeinfo_generate
...
6595 volumeinfo generate
2023-11-22 11:14:36 +08:00
fea22bbbc9
Merge branch 'main' of https://github.com/qiuming-best/velero into kopia-parallelism
2023-11-22 01:42:39 +00:00
7f52321772
Generate VolumeInfo.
...
Remove CSI VolumeSnapshot listter and the informer.
Add download the VolumeInfos metadata for backup.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-22 09:40:38 +08:00
b8a5859fe7
Merge pull request #7091 from anshulahuja98/recoverplugin
...
Don't fail backup/restore on velero server restart in PhaseWaitingFor…
2023-11-20 14:49:15 +08:00
e0edc8ee93
Merge pull request #7107 from yanggangtony/update-configmaps
...
Fix docs: Use camel case for API objects: configmaps and secrets
2023-11-20 14:48:47 +08:00
e3fb94833d
Merge pull request #7115 from reasonerjt/wrap-bia-err
...
Include plugin name in the error message by operations
2023-11-20 14:48:18 +08:00
ca57756ff6
Include plugin name in the error message by operations
...
fixes #6512
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-11-20 12:12:02 +08:00
4e4f0aa1da
issue 6695: add backup describe for CSI snapshot data movement 02
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-20 12:11:21 +08:00
582be97a63
Merge branch 'main' into issue-fix-6695
2023-11-18 00:12:25 +08:00
b99ac448ae
issue 6695: add backup describe for CSI snapshot data movement
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-18 00:11:29 +08:00
939dd7149a
Merge pull request #7070 from blackpiglet/6595_interface
...
Add VolumeInfo metadata structures.
2023-11-17 19:31:29 +08:00
b440a4f53f
Add VolumeInfo metadata structures and object get method.
...
Modify design according to comments.
Add PVInfo structure.
Add backup VolumeInfo's object storage's put and get methods.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-17 17:23:47 +08:00
c283edf4a5
Merge pull request #7032 from deefdragon/main
...
Add check for owner references in backup sync, removing if missing
2023-11-17 09:32:50 +08:00
c78e8980d8
Use camel case for API objects: configmaps and secrets.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-11-16 22:17:35 +00:00
292aa34a48
move filtering code to seperate method, add tests
...
Signed-off-by: Jeffrey Koehler <koehler@streem.tech>
2023-11-16 03:57:36 -06:00
8eec6865d1
Check only schedules, and verify UIDs are the same
...
Signed-off-by: Jeffrey Koehler <koehler@streem.tech>
2023-11-16 02:29:56 -06:00
d42505ddd0
Merge pull request #7102 from Lyndon-Li/issue-fix-7068-2
...
Issue 7068: add a finalizer to protect retained VSC
2023-11-15 17:13:44 +08:00
067984b13c
Issue 7068: add a finalizer to protect retained VSC
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-15 16:04:07 +08:00
d345bda3a1
Merge pull request #7081 from ywk253100/231110_sync
...
Skip syncing the backup which doesn't contain backup metadata
2023-11-15 16:00:06 +08:00
2a533d01bf
Merge pull request #7046 from kaovilai/backup-patch-status-unittest
...
Update Backup.Status.CSIVolumeSnapshotsCompleted during finalize
2023-11-15 15:32:51 +08:00
9b5678f32a
Merge pull request #7096 from Lyndon-Li/issue-fix-7094
...
Issue 7094: fallback to full backup if previous snapshot is not found
2023-11-14 11:45:32 +08:00
50f8acda79
issue 7094: fallback to full backup if previous snapshot is not found
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-14 11:28:09 +08:00
cb651d0436
issue 7068: add a finalizer to protect retained VSC
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-14 10:18:07 +08:00
dd6ab8c32a
Don't fail backup/restore on velero server restart in PhaseWaitingForPluginOperation
...
Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>
2023-11-13 11:13:32 +05:30
efc5319c1c
Issue 6693: partially fail restore if CSI snapshot is involved but CSI feature is not ready
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-10 12:40:41 +08:00
84c96047b9
Skip syncing the backup which doesn't contain backup metadata
...
Skip syncing the backup which doesn't contain backup metadata
Fixes #6849
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-11-10 10:22:27 +08:00
2841be7681
Merge branch 'main' into issue-fix-6693
2023-11-10 10:04:27 +08:00
cb5ffe2753
Merge pull request #7061 from blackpiglet/6595_backward_compatability
...
Add DataUpload Result and CSI VolumeSnapshot check for restore PV.
2023-11-10 09:37:19 +08:00
ea7f249e90
Update backup log to reflect appropriate backup phase
...
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
use infof instead of sprintf
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-11-09 04:55:24 -08:00
873197ff50
issue 6693: partially fail restore if CSI snapshot is involved but CSI feature is not ready
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-09 17:37:23 +08:00
db43200cc8
configurable data path concurrency: all in one json
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-08 12:02:02 +08:00
70483ded90
improve discoveryHelper.Refresh() in restore
...
Signed-off-by: lou <alex1988@outlook.com>
2023-11-07 19:12:30 +08:00
1fb0529d98
Add DataUpload Result and CSI VolumeSnapshot check for restore PV.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-06 22:40:03 +08:00
68579448d6
configurable data path concurrency: UT
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-06 20:29:33 +08:00
262f10ff49
Merge branch 'main' into issue-fix-6663
2023-11-06 16:52:41 +08:00
04a9851ee9
configurable data path concurrency: all in cm
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-11-06 16:46:13 +08:00
6b7ce6655d
Merge pull request #7022 from allenxu404/i6721
...
Fix inconsistent behavior of Backup and Restore hook execution
2023-11-06 14:01:30 +05:30
56b5e982d9
Remove dependency of generated client part 3
...
Replace generated discovery client with client-go client.
Remove generated client from PVR action.
Remove generated client from pkg/cmd directory.
Delete velero generate client from client factory.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-06 11:34:39 +08:00
d6146ecff4
Merge pull request #7041 from blackpiglet/6190_part_2
...
Remove dependency of generated client part 2
2023-11-03 17:43:10 +08:00
a221a88945
Remove dependency of generated client part 2
...
Remove dependecy of generate client from pkg/cmd/cli/snapshotLocation.
Remove the Velero generated informer from PVB and PVR.
Remove dependency of generated client from pkg/podvolume directory.
Replace generated codec with runtime codec.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-11-03 17:11:36 +08:00
8c727429c4
revert test changes
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 17:06:19 -04:00
cd0ad74d31
`make update`
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 16:46:15 -04:00
1c138b8f55
CSIFeatureFlag enable check
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 16:20:46 -04:00
18acf005d6
remove waiting during finalize
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 16:16:27 -04:00
f9e716a8c9
skip this if SnapshotMoveData
...
https://github.com/vmware-tanzu/velero/pull/7046/files#r1380708644
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 16:14:55 -04:00
10245b05de
restore: Use warning when Create IsAlreadyExist and Get error ( #7004 )
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 15:53:47 -04:00
9311a4269b
refactor backup snapshot status updates into UpdateBackupSnapshotsStatus() and run in backup_finalizer_controller
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-02 15:30:35 -04:00
3a3527553a
Fix inconsistent behavior of Backup and Restore hook execution
...
Signed-off-by: allenxu404 <qix2@vmware.com>
2023-11-02 12:31:53 +08:00
73c948d6bd
Merge pull request #6917 from 27149chen/rm-improvement
...
support JSON Merge Patch and Strategic Merge Patch in Resource Modifiers
2023-11-02 10:36:40 +08:00
886e074b55
Add PatchResource unit test for backup status
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-11-01 15:28:56 -04:00
38e1ae0405
Merge pull request #7034 from ywk253100/231030_cred
...
Read information from the credential specified by BSL
2023-11-01 09:41:25 +08:00
8e442407c3
issue 7027: backup exposer -- don't assume first volume as the backup volume
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-31 12:11:34 +08:00
03e582cb6c
Merge pull request #6995 from kaovilai/kopias3profilecred
...
kopia/repository/config/aws.go: Set session.Options profile from config
2023-10-30 09:11:15 -07:00
49a85e1636
Read information from the credential specified by BSL
...
Read information from the credential specified by BSL
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-10-30 17:28:10 +08:00
929af4f734
Add check for owner reference in backup sync, removing if missing
...
Signed-off-by: Jeffrey Koehler <koehler@streem.tech>
2023-10-29 22:06:14 -05:00
23921e5d29
add description markers for dataupload and datadownload CRDs ( #7028 )
...
add changelog file
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-10-27 11:05:10 -04:00
0f765ceef2
Merge branch 'main' into issue-fix-6663
2023-10-27 17:44:17 +08:00
c44a9b8956
issue 6663: changes for configurable data path concurrency
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-27 17:37:29 +08:00
9ff4b1e079
Merge pull request #7026 from blackpiglet/6376_fix
...
Add HealthCheckNodePort deletion logic in Serivce restore
2023-10-27 16:40:04 +08:00
a94918026c
Add HealthCheckNodePort deletion logic in Service restore.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-27 14:13:52 +08:00
1e0fc77e4d
Fix issue 6913 ( #6914 )
...
add changelog file
keep canceling phase const
fix data download as well
address PR feedback
minor fixes
Signed-off-by: Shubham Pampattiwar <spampatt@redhat.com>
2023-10-26 09:39:38 -04:00
20a1118acf
Make configmapref check case insensitive ( #6804 )
...
* Make configmapref check case insensitive
Signed-off-by: Anshul Ahuja <anshul.ahu@gmail.com>
* update resourcemodfier test case to validate case
Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>
---------
Signed-off-by: Anshul Ahuja <anshul.ahu@gmail.com>
Signed-off-by: Anshul Ahuja <anshulahuja@microsoft.com>
Co-authored-by: Anshul Ahuja <anshulahuja@microsoft.com>
2023-10-26 15:30:21 +05:30
481cb60493
Make Kopia file parallelism configurable
...
Signed-off-by: Ming <mqiu@vmware.com>
2023-10-26 02:28:36 +00:00
30bf6bd28c
Merge pull request #7011 from Lyndon-Li/issue-fix-6964-2
...
Issue 6964: use preparingTimeout for snapshot readiness wait
2023-10-25 11:11:27 +08:00
0eade6c615
issue 6964: use preparingTimeout for snapshot readiness wait
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-25 10:51:08 +08:00
d5f238c83c
kopia/repository/config/aws.go: Set session.Options profile from config
...
Signed-off-by: Tiger Kaovilai <tkaovila@redhat.com>
2023-10-24 14:05:47 -04:00
941dd0039f
Merge pull request #6968 from blackpiglet/6585_fix
...
Check whether the action is a CSI action and whether CSI feature is
2023-10-25 00:39:58 +08:00
317db25d20
Merge pull request #6923 from reasonerjt/aws-sdk-v2
...
Bump up aws sdk to aws-sdk-go-v2
2023-10-24 23:53:16 +08:00
b71d2b3898
Bump up aws sdk to aws-sdk-go-v2
...
Signed-off-by: Daniel Jiang <jiangd@vmware.com>
2023-10-24 17:01:26 +08:00
61d333a31a
Merge pull request #6989 from blackpiglet/support_windows_build_main
...
[cherry-pick][main]Make Windows build skip BlockMode code.
2023-10-24 16:58:03 +08:00
908e2c63ba
Check whether the action is a CSI action and whether CSI feature is
...
enabled, before executing the action.
The DeleteItemAction is not checked, because the DIA doesn't have a
method to get the action's plugin name.
This should be OK, because the CSI will check whether the VS and VSC
have a backup name annotation. If the VS and VSC is not handled by
the CSI plugin, then they don't have the annotation.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-24 16:54:38 +08:00
27f301cb89
Merge pull request #7001 from Lyndon-Li/bump-to-kopia-0.15.0
...
Bump kopia to 0.15.0
2023-10-24 08:40:46 +08:00
d3a1a83c6d
bump to kopia 0.15.0
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-23 12:03:21 +08:00
b85dc271ef
Merge pull request #6978 from yanggangtony/fix-tiny-errors
...
Fix wrong logs , add missiong license file.
2023-10-22 20:52:18 -07:00
3d841dd8f1
udmrepo use region specified in BSL when s3URL is empty
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-20 19:58:54 +08:00
ecc6e1621e
Make Windows build skip BlockMode code.
...
PVC block mode backup and restore introduced some OS specific
system calls. Those calls are not available for Windows, so
add both non Windows version and Windows version code, and
return error for block mode on the Windows platform.
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-20 19:39:44 +08:00
1efd533d0d
Fix wrong logs in markDataDownloadsCancel() and add missiong license file.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-19 14:04:41 +01:00
79c75718ca
Change controller-runtime List option from MatchingFields to ListOptions.
...
Signed-off-by: Xun Jiang <jxun@vmware.com>
2023-10-19 17:09:12 +08:00
fd8350f919
Merge pull request #6976 from Lyndon-Li/issue-fix-6964
...
Issue 6964: get volume size from source PVC if it is invalid in VS
2023-10-19 13:53:57 +08:00
329c128279
issue 6964: get volume size from source PVC if it is invalid in VS
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-19 11:50:28 +08:00
19f38f9623
Merge pull request #6947 from 0x113/SGLAB-CLOUDCASA-oidc-auth
...
Issue #6933 : Import auth provider plugins
2023-10-18 16:01:50 +08:00
265d285b1d
Import auth provider plugins
...
Signed-off-by: Sebastian Glab <sglab@catalogicsoftware.com>
2023-10-18 08:53:35 +02:00
7ca33f8f12
Add MSI Support for Azure plugin. ( #6938 )
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-16 09:47:53 +05:30
b4fb2d9644
Merge pull request #6918 from Ripolin/main
...
Add WaitForReady flag to check container readiness state before exec a hook
2023-10-15 13:27:34 +08:00
069c280f03
Fix node-agent missing metrics-addr parms to define the server start.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-13 03:33:18 +01:00
e5af7f5cea
Add WaitForReady flag to check container readiness state before exec a hook
...
Signed-off-by: Ripolin <florent.david@gmail.com>
2023-10-12 20:31:36 +02:00
ad114f8f65
Merge pull request #6723 from sseago/restore-get-perf
2023-10-12 07:57:40 -07:00
74ed994e5e
Merge pull request #6830 from sseago/retry-generateName
...
issue #6807 : Retry failed create when using generateName
2023-10-11 08:50:14 -07:00
7750e12151
Perf improvements for existing resource restore
...
Use informer cache with dynamic client for Get calls on restore
When enabled, also make the Get call before create.
Add server and install parameter to allow disabling this feature,
but enable by default
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-10-11 10:51:39 -04:00
19d5bee572
Merge branch 'main' into rm-improvement
2023-10-10 19:02:16 +08:00
0a6c89abc6
Merge branch 'main' into backup-pod-spread-evenly
2023-10-10 09:45:52 +08:00
09be1f7995
issue #6807 : Retry failed create when using generateName
...
When creating resources with generateName, apimachinery
does not guarantee uniqueness when it appends the random
suffix to the generateName stub, so if it fails with
already exists error, we need to retry.
Signed-off-by: Scott Seago <sseago@redhat.com>
2023-10-09 17:38:37 -04:00
e5e99c75a0
Fix dep package describe and ci words spell. ( #6924 )
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-10-09 12:12:14 +05:30
d8d66381e7
issue 6734: spread backup pod evenly
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-10-08 20:01:12 +08:00
0d4e61eb24
Merge pull request #6649 from sseago/orphaned-partially-failed
2023-10-06 10:35:57 -07:00
5ab66728e2
Merge pull request #6843 from yanggangtony/clean-and-addlicenses
...
Add missing file licences and do some clean works.
2023-10-02 12:11:28 -07:00
fd67ecb688
Code clean for backup cmd client. ( #6750 )
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-09-29 12:23:12 -04:00
11745809c4
Add missing file licences and do some clean works.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-09-29 04:25:01 +01:00
8e01d1b9be
Add support for block volumes ( #6680 )
...
Signed-off-by: David Zaninovic <dzaninovic@catalogicsoftware.com>
2023-09-28 09:44:46 -04:00
c6191797b4
Merge pull request #6884 from ywk253100/230928_repo_init
...
Create the backup repository only when it doesn't exist
2023-09-28 17:36:44 +08:00
61a6c1ba2a
Create the backup repository only when it doesn't exist
...
When preparing a backup repository, Velero tries to connect to it, if fails then create it. The repository status always records the error reported by creation but the real reason maybe caused by the connect operation. This is confuseing and hard to debug
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-28 14:53:59 +08:00
af43d96ac9
Merge pull request #6885 from Lyndon-Li/issue-fix-6880
...
Issue 6880: set ParallelUploadAboveSize as MaxInt64
2023-09-28 14:24:08 +08:00
3e3ffec7cd
issue 6880: set ParallelUploadAboveSize as MaxInt64
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-28 12:34:30 +08:00
73ea00b477
issue 6861: fill repoIdentifier only for restic repo ( #6872 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-27 16:49:35 -04:00
563f1ccee1
Merge pull request #6475 from nilesh-akhade/main
...
Add `--or-selector` for backup and restore command
2023-09-27 20:09:07 +08:00
2e71cffe0e
issue: move plugin depdending podvolume functions to util pkg
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-26 16:39:33 +08:00
c3ec7b71c5
Merge pull request #6715 from nilesh-akhade/metric
...
Remove schedule-related metrics on schedule delete
2023-09-25 10:24:04 -07:00
d8b9328310
support JSON Merge Patch and Strategic Merge Patch in Resource Modifiers
...
Signed-off-by: lou <alex1988@outlook.com>
2023-09-25 18:00:18 +08:00
cda722cf9d
Fix the metrics backup_last_status not report right value when the schedule down unexpectation.
...
Signed-off-by: yanggang <gang.yang@daocloud.io>
2023-09-19 15:25:21 +08:00
b598150cd1
Support setting CA cert for BSL
...
Support setting CA cert for BSL
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-19 11:28:05 +08:00
3a291e368a
Make Kopia support Azure AD
...
This commit introduces our own Azure storage provider by wrapping Kopia's implementation rather than contributing to upstream based on the following considerations:
1. Velero needs the capability to interact with the repository concurrently while Kopia doesn't, this will increase the complexity of Kopia if we contribute to upstream
2. The configuration items provided by Velero and Kopia are conflict, e.g. Velero supports customizing storage account URI which is a full path while Kopia supports customizing storage account domain which is part of the URI. We need to consider the backward compatibility and upgrade case if we contribute to upstream which needs extra efforts
3. Contribute to upstream is a longer cycle when we need to introduce new changes. With this commit, we no longer depends on upstream for the Azure storage provider part and is easy for us to maintain
Signed-off-by: Wenkai Yin(尹文开) <yinw@vmware.com>
2023-09-19 11:28:04 +08:00
5af664d361
bump kopia to v0.14 ( #6833 )
...
Signed-off-by: Lyndon-Li <lyonghui@vmware.com>
2023-09-18 21:05:21 +08:00
Wenkai Yin(尹文开)
Jose Arevalo
zhongjun.li
Lyndon-Li
Daniel Jiang
qiuming
lyndon-li
Lyndon-Li
Xun Jiang
Qi Xu
Xun Jiang/Bruce Jiang
allenxu404
Shubham Pampattiwar
Tiger Kaovilai
Shashank Singh
lou
yanggang
Jeffrey Koehler
Anshul Ahuja
Anshul Ahuja
Sebastian Glab
Ripolin
Shubham Pampattiwar
Scott Seago
David Zaninovic