vmware-tanzu
/
velero
mirror of https://github.com/vmware-tanzu/velero.git
1
0
Fork 0
Code Issues Projects Releases Wiki Activity
2,089 Commits
33 Branches
161 Tags
122 MiB
Commit Graph

192 Commits (7abd2c6db92ee1c2fde2b21a5080641361ddff2f)

Author SHA1 Message Date
Carlisia 23b1098950
Fix copyright 
Signed-off-by: Carlisia <carlisiac@vmware.com>
 2019-04-01 12:06:14 -07:00
Steve Kriss 7298a4eda0 allow restic restore helper image to be specified via ConfigMap (#1311) 
* allow restic restore helper image to be specified via ConfigMap

Signed-off-by: Steve Kriss <krisss@vmware.com>
 2019-03-29 17:11:34 -04:00
Steve Kriss 9b635c0e14 add additionalItems to restore item actions (#1304) 
* add additionalItems to restore item actions

Signed-off-by: Steve Kriss <krisss@vmware.com>
Co-authored-by: Andy Goldstein <goldsteina@vmware.com>
 2019-03-28 12:21:56 -07:00
Steve Kriss bb9c3f6a1a rename BlockStore to VolumeSnapshotter 
Signed-off-by: Steve Kriss <krisss@vmware.com>
 2019-03-27 14:55:28 -06:00
Steve Kriss a111eed2af update license headers to Velero contributors (#1302) 
Signed-off-by: Steve Kriss <krisss@vmware.com>
 2019-03-20 12:32:48 -07:00
Carlisia a71e43b2b7
Split velero plugin client into its own package 
Signed-off-by: Carlisia <carlisiac@vmware.com>
 2019-03-19 16:05:37 -07:00
Steve Kriss 1eac10ca9f
Merge pull request #1288 from carlisia/c-plugins-II 
Split plugin framework into its own package
 2019-03-19 16:44:58 -06:00
Carlisia 7dfe58d37f
Split plugin framework into its own package 
Signed-off-by: Carlisia <carlisiac@vmware.com>
 2019-03-19 15:36:31 -07:00
Steve Kriss 7d66fc31bd pkg/restic: check for & skip hostPath PVC/PVs 
Signed-off-by: Steve Kriss <krisss@vmware.com>
 2019-03-19 08:57:47 -06:00
KubeKween 73514a003b Move plugin interfaces to same package (#1264) 
* Move plugin interfaces to same package

Signed-off-by: Carlisia <carlisiac@vmware.com>
 2019-03-14 16:35:06 -04:00
Steve Kriss 7674332313 pass --log-level to plugins (#1278) 
Plumb the log level through to plugin processes


Signed-off-by: Steve Kriss <krisss@vmware.com>
 2019-03-14 10:53:36 -07:00
Steve Kriss 4583aa7078
Merge pull request #826 from nrb/fix-691 
Wait for namespace to terminate before restoring
 2019-02-07 11:07:25 -07:00
Nolan Brubaker 890202f2e4 Wait for PV/namespace to delete before restore 
If a PV already exists, wait for it, it's associated PVC, and associated
namespace to be deleted before attempting to restore it.

If a namespace already exists, wait for it to be deleted before
attempting to restore it.

Signed-off-by: Nolan Brubaker <brubakern@vmware.com>
 2019-02-06 15:43:50 -05:00
Steve Kriss 328bc361be velero server: log version and git SHA at startup 
Signed-off-by: Steve Kriss <krisss@vmware.com>
 2019-02-05 10:12:06 -07:00
Nolan Brubaker 43714caaec Rename Ark to Velero!!! 
Signed-off-by: Nolan Brubaker <brubakern@vmware.com>
 2019-02-04 17:35:22 -05:00
Steve Kriss 8a58b217be show server version in ark version output using ServerStatusRequest CRD 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2019-01-23 12:51:13 -07:00
Carlisia 1906c33eb2
Improve directions when location CRDs not deployed 
Signed-off-by: Carlisia <carlisia@grokkingtech.io>
 2018-12-07 10:41:40 -08:00
Andy Goldstein aa9d96f3b7
Add pprof support to ark server 
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
 2018-12-05 10:13:39 -05:00
Andy Goldstein 62d8c642d2
Remove default token from all service accounts 
Instead of only removing the default token from a service account when
it already exists in the cluster, always remove it. If the service
account already exists, continue to do the merging logic.

Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
 2018-12-04 11:41:18 -05:00
Andy Goldstein d85872dfb2
Merge pull request #1069 from gliptak/patch-1 
Update to go 1.11
 2018-11-21 08:39:06 -05:00
Gábor Lipták daf1a75515 Bring Go current in Travis 
Signed-off-by: Gábor Lipták <gliptak@gmail.com>
 2018-11-21 08:31:14 -05:00
Christian Beneke 90c5ed0850 Initialize empty schedule metrics on server init 
When backups are run manually (outside of a schedule) the metrics
will be counted for ark_*{schedule=""}. To prevent partial NaN
metrics they will be initialised on server init.

Signed-off-by: Christian Beneke <c.beneke@syseleven.de>
 2018-11-14 15:31:26 +01:00
Steve Kriss 2781e4e8de
Merge pull request #956 from ffd2subroutine/qps-burst-configurable 
Added qps and burst to server's client
 2018-11-09 12:41:41 -07:00
Darko Radisic e5556fe608 Added qps and burst to server's client 
Signed-off-by: Darko Radisic <ffd2subroutine@users.noreply.github.com>
 2018-11-09 20:16:24 +01:00
Steve Kriss b818cc2769 don't require a default provider VSL if there's only 1 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-26 12:45:40 -06:00
Andy Goldstein bca585162f Run 'make update' to update formatting 
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
 2018-10-23 13:08:42 -04:00
Nolan Brubaker 6591b5a09c
Merge pull request #975 from skriss/rm-pvproviderexists 
remove pvProviderExists param from NewRestoreController
 2018-10-23 12:58:17 -04:00
Steve Kriss f3a57b5b8a
Merge pull request #971 from shubheksha/fix/594-restore-storageclasses-before-pv-pvc 
Restore storageclasses before pvs and pvcs
 2018-10-23 08:14:42 -06:00
Shubheksha Jalan 596eea1b8c restore storageclasses before pvs and pvcs 
Signed-off-by: Shubheksha Jalan <jshubheksha@gmail.com>
 2018-10-22 21:15:08 +02:00
Steve Kriss 8acc66d02f remove pvProviderExists param from NewRestoreController 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-22 11:47:51 -06:00
Domenic Rosati 9952dfb0ad Address #424: Add CRDs to list of prioritized resources 
Signed-off-by: Domenic Rosati <domenicrosati@gmail.com>
 2018-10-18 22:42:37 -03:00
Steve Kriss c36131a024 remove Config-related code 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-17 14:00:38 -06:00
Wayne Witzel III 406b50a71b update restore process using snapshot locations 
Signed-off-by: Wayne Witzel III <wayne@riotousliving.com>
 2018-10-17 13:40:42 -06:00
Steve Kriss 4a03370f1d update backup deletion controller for snapshot locations 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-17 13:40:42 -06:00
Steve Kriss df07b7dc9f update backup code to work with volume snapshot locations 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-17 13:36:50 -06:00
Wayne Witzel III 4af89fa863 add unit test for getDefaultVolumeSnapshotLocations 
Signed-off-by: Wayne Witzel III <wayne@riotousliving.com>
 2018-10-17 13:35:52 -06:00
Wayne Witzel III 02f50b9c84 add default-volume-snapshot-locations to server cmd 
Signed-off-by: Wayne Witzel III <wayne@riotousliving.com>
 2018-10-17 13:35:50 -06:00
Carlisia 1aa712d236 Default and validate VolumeSnapshotLocations 
Signed-off-by: Carlisia <carlisia@grokkingtech.io>
 2018-10-17 13:33:22 -06:00
Steve Kriss 4173515435 don't require a default backup storage location to exist 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-11 14:43:27 -06:00
Steve Kriss 3af43b492f add azure-specific code to support multi-location restic 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-05 09:20:56 -06:00
Steve Kriss d009163b67 update restic to support multiple backup storage locations 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-05 09:10:35 -06:00
Steve Kriss eb709b8f70 only sync a backup location if it's changed since last sync 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-10-03 08:05:06 -06:00
Michal Wieczorek 0f1c5c283f Enable restoring resources with ownerReference set 
Signed-off-by: Michal Wieczorek <wieczorek-michal@wp.pl>
 2018-10-02 12:04:51 +02:00
Steve Kriss e46e89cb61 have restic share main Ark bucket 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-09-25 13:12:22 -06:00
Steve Kriss 8bc7e4f6aa store backups & restores in backups/, restores/ subdirs in obj storage 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-09-25 09:56:41 -06:00
Steve Kriss d34994cb5f set azure restic env vars based on default backup location's config 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-09-05 14:31:42 -06:00
Steve Kriss b31e25bf6e server: remove unused code, replace deprecated func 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:21 -07:00
Steve Kriss 729d733986 controllers: take a newPluginManager func in constructors 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:21 -07:00
Steve Kriss 133dc185ca backup sync: process the default location first 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:21 -07:00
Steve Kriss 6f7bfe545d remove Config CRD's BackupStorageProvider & other obsolete code 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:21 -07:00
Steve Kriss bd4d97b9e4 move server's defaultBackupLocation into config struct 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:21 -07:00
Steve Kriss 0e94fa37f9 update sync controller for backup locations 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:21 -07:00
Carlisia 2750aa71b9 Use backup storage location during restore 
Closes #740

Signed-off-by: Carlisia <carlisia@grokkingtech.io>
 2018-08-28 13:19:21 -07:00
Steve Kriss 20f89fbcef use the default backup storage location for restic 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:21 -07:00
Steve Kriss cf7c8587f0 download request: fix setting of log level for plugin manager 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:21 -07:00
Steve Kriss 3234124afe backup deletion: fix setting of log level in plugin manager 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:20 -07:00
Steve Kriss 8f5346150c download request controller: use backup location for object store 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:20 -07:00
Steve Kriss bab08ed1a6 backup deletion controller: use backup location for object store 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:19:20 -07:00
Nolan Brubaker c6f488f75f Use backup location in the backup controller 
Fixes #739

Signed-off-by: Nolan Brubaker <nolan@heptio.com>
 2018-08-28 13:19:20 -07:00
Steve Kriss adbcd3703b add --default-backup-storage-location flag to server cmd 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-08-28 13:14:51 -07:00
Carlisia 9508e4a20e
Switch Config CRD elements to server flags 
Signed-off-by: Carlisia <carlisia@grokkingtech.io>
 2018-08-16 08:51:46 -07:00
Nolan Brubaker eb6f742b5d Document CRD not found errors 
Signed-off-by: Nolan Brubaker <nolan@heptio.com>
 2018-08-02 16:41:28 -04:00
Steve Kriss 1c26fbde32 remove SnapshotService, replace with direct BlockStore usage 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-07-31 08:58:11 -07:00
Andy Goldstein 130512187a Refactor plugin management 
Refactor plugin management:
- support multiple plugins per executable
- support restarting a plugin process in the event it terminates
- simplify plugin lifecycle management by using separate managers for
  each scope (server vs backup vs restore)

Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
 2018-07-31 08:34:57 -07:00
Steve Kriss 131afb571e
Merge pull request #607 from nrb/restore-metrics 
Restore metrics
 2018-07-27 12:25:56 -07:00
Nolan Brubaker 82f1cd87dc
Merge pull request #680 from carlisia/c-delete-from-etcd 
Delete backups from etcd if they're not in storage
 2018-07-25 18:25:52 -04:00
Carlisia d2e629f5a8
Delete backups from etcd if they're not in storage 
This fixes #309.

Signed-off-by: Carlisia <carlisia@grokkingtech.io>

Co-authored-by: Steve Kriss <steve@heptio.com>
 2018-07-25 14:53:50 -07:00
Nolan Brubaker 7cebfe2df0 Add restore attempt and success/failure counters 
Signed-off-by: Nolan Brubaker <nolan@heptio.com>
 2018-07-25 11:22:43 -04:00
Nolan Brubaker b0af81e780
Merge pull request #689 from lemaral/init-schedule-metrics 
Init schedule Prometheus metrics
 2018-07-23 16:16:26 -04:00
Steve Kriss e063b7983a
Merge pull request #682 from nrb/support-rbac-1.7 
Support for rbac v1beta1 on kubernetes v1.7.5+
 2018-07-23 12:00:50 -07:00
Nolan Brubaker dd1e150511 Add RBAC support for 1.7 clusters 
Signed-off-by: Nolan Brubaker <nolan@heptio.com>
 2018-07-23 14:19:03 -04:00
Carlisia c47a364ab3
Merge pull request #687 from skriss/fix-delete-issues 
fix delete issues
 2018-07-23 10:40:14 -07:00
Alex Lemaresquier 450fa72fbb Initialize schedule Prometheus metrics to have them created beforehand (see https://prometheus.io/docs/practices/instrumentation/#avoid-missing-metrics) 
Signed-off-by: Alex Lemaresquier <alex+github@lemaresquier.org>
 2018-07-20 23:30:24 +02:00
Steve Kriss 78cbdf95f3 delete old deletion requests for backup when processing a new one 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-07-20 11:42:42 -07:00
Steve Kriss 1df9a8a38d exit server if not all Ark CRDs exist at startup 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-07-18 14:30:42 -07:00
Nolan Brubaker e11634bfbc
Merge pull request #676 from skriss/dont-create-namespace 
require namespace for backups/etc. to exist at server startup
 2018-07-17 14:26:04 -04:00
Mike Arpaia 3efe677007
Update Ark library code to work with Kubernetes 1.11 
Signed-off-by: Mike Arpaia <mike@arpaia.co>
 2018-07-16 20:46:20 -06:00
Steve Kriss d195512062 require namespace for backups/etc. to exist at server startup 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-07-13 13:50:12 -07:00
Steve Kriss 22e8f23e2c replace ark restic repo init cmd with automatic initialization of repos 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-06-27 13:50:37 -07:00
Steve Kriss f2072e5868 use repo identifier from ResticRepo CR when backing up/restoring 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-06-20 10:42:53 -07:00
Steve Kriss 65ed8da4b7 add ResticRepository CRD and move repo-level actions to a controller 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-06-20 09:21:43 -07:00
Andy Goldstein cc9140b3cc Log to stdout instead of stderr 
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
 2018-06-14 14:02:12 -04:00
Ashish Amarnath 83658e891e Add a metrics package to add and expose metrics 
* add a metrics package to handle metric registration and publishing
* add a metricsAddress field to the server struct
* make metrics a part of the server
* start a metrics endpoint as part of starting the controllers
* instrument backup_controller to report metrics
* update cli-reference docs
* update example deployments with prometheus annotations
* update 'pkg/install' tooling with prometheus annotations

Signed-off-by: Ashish Amarnath <ashish.amarnath@gmail.com>
 2018-06-13 13:17:08 -07:00
Steve Kriss 50d4084fac add restic integration for doing pod volume backups/restores 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-06-06 09:48:10 -07:00
Andy Goldstein 18e2401e79
Merge pull request #455 from skriss/remove-aws-region 
AWS: remove region requirement from config for backupStorageProvider
 2018-05-23 11:02:57 -04:00
Steve Kriss b029860b46 AWS: remove region requirement from config for backupStorageProvider 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-05-22 11:59:53 -07:00
Steve Kriss 20f56e9868 cleanup plugin subprocesses on server exit 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-05-11 09:48:46 -07:00
Steve Kriss 09c20b51e6 shutdown gracefully on SIGINT/SIGTERM 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-05-10 16:22:14 -07:00
Andy Goldstein ea83ed32f5
Merge pull request #470 from skriss/backup-cluster-roles-and-bindings 
backups: include clusterroles/bindings that reference serviceaccounts
 2018-05-09 13:21:13 -04:00
Steve Kriss 041cfc2173 backups: include clusterroles/bindings that reference serviceaccounts 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-05-09 10:03:55 -07:00
Steve Kriss 6754955bcd when syncing backups, set their namespace to current cluster's Ark ns 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-05-07 09:12:51 -07:00
Andy Goldstein 258f3e011e
Merge pull request #409 from skriss/fix-398 
get backup name from restore spec when handling restore DownloadRequests
 2018-04-10 13:29:07 -04:00
Steve Kriss 0d2b49acce get backup name from restore spec when handling restore DownloadRequests 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-04-09 10:50:10 -07:00
Andy Goldstein 3f2e222ae4 Don't allow deletion of in-progress backups 
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
 2018-04-06 13:08:39 -04:00
Andy Goldstein 74f60b1ee1 Switch backup finalizer to DeleteBackupRequest 
We ran into a lot of problems using a finalizer on the backup to allow
the Ark server to clean up all associated backup data when deleting a
backup.

Users also found it less than desirable that deleting the heptio-ark
namespace resulted in all the backup data being deleted.

This removes the finalizer and replaces it with an explicit
DeleteBackupRequest that is created as a means of requesting the
deletion of a backup and all its associated data. This is what `ark
backup delete` does.

If you use kubectl to delete a backup or to delete the heptio-ark
namespace, this no longer deletes associated backups. Additionally, as
long as the heptio-ark namespace still exists, the Ark server's
BackupSyncController will continually sync backups into the heptio-ark
namespace from object storage.

Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
 2018-04-05 11:16:15 -04:00
Steve Kriss c60e47dedd use cobra's arg-count validation & call Complete() before Validate() 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-04-03 09:45:29 -07:00
Shubham 73499c2cff Add limitranges to defaultResourcePriorities 
This commit adds limitranges to defaultResourcePriorities as
suggested in #385.

This is done so that pods are not restored before the LimitRange
objects, because that would lead to pods not honoring the requests
and limits set in LimitRange objects.

Fixes #385

Signed-off-by: Shubham <shubham@linux.com>
 2018-03-17 21:13:44 +05:30
Steve Kriss cab904570f GCP: copy tags from volume to snapshot, and snapshot to volume 
Signed-off-by: Steve Kriss <steve@heptio.com>
 2018-03-13 11:52:09 -07:00
Andy Goldstein e618e0e456 server: allow configurable plugin dir 
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
 2018-02-27 14:50:38 -05:00
Blake 465c60b408
Add global kubecontext CLI flag 
Signed-off-by: Blake <blake.barnett@postmates.com>
 2018-02-26 10:47:39 -08:00