Commit Graph

93 Commits (907ae6c5b05ca50d607447a19355aa9a87f38bdd)

Author SHA1 Message Date
Steve Kriss 907ae6c5b0 move groupresource resolution into discovery helper
Signed-off-by: Steve Kriss <steve@heptio.com>
2017-09-11 14:41:50 -07:00
Steve Kriss f438c226e3 Merge pull request #40 from ncdc/backup-logs
Save logs per backup
2017-09-11 13:31:17 -07:00
Andy Goldstein ab99fcc2e2 Update backup and log file name formats
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:49 -04:00
Andy Goldstein 3bb02ac949 Use ioutil.Discard in unit test
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:49 -04:00
Andy Goldstein 71fadf381e Clarify Backup() param names
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:49 -04:00
Andy Goldstein a583f22ea9 Add ActionContext so backup actions can log
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:48 -04:00
Andy Goldstein 50a95d052e Delete all objects in backup dir
Delete all objects in backup "dir" when deleting a backup, instead of
hard-coding individual file names/types. This way, we'll be able to
delete log files and anything else we add without having to update our
deletion code.

Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:48 -04:00
Andy Goldstein 193000e487 Add ListObjects (for backup dir deletions)
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:48 -04:00
Andy Goldstein 5c9ffae88f Renerate files
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:48 -04:00
Andy Goldstein ee38a9471a Regen docs last
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:48 -04:00
Andy Goldstein 03dde45c09 Add 'ark backup logs' command for retrieval
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:48 -04:00
Andy Goldstein 9848a7a55b Save backup log file to object storage
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:48 -04:00
Andy Goldstein b50a78cf7b Work around glog flag.Parse issue
Due to a change in glog, if you don't call flag.Parse, every log line
prints out 'ERROR: logging before flag.Parse'. This works around that
change. Ultimately we need to switch to a different logging library.

Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:47 -04:00
Andy Goldstein 860eb7e845 Match Azure sdk changes
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-11 15:40:47 -04:00
Andy Goldstein 742f45849f Switch to dep & update dependencies
Switch to dep.

Update the following:
- azure-sdk-for-go to 10.2.1-beta
- go-autorest to 8.1.1
- client-go to 4.0.0

Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-06 13:41:25 -04:00
Andy Goldstein 3c945e3416 Remove hack/godep-save.sh
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-06 13:41:23 -04:00
Andy Goldstein ac8dc5ecc9 Doc dep mgmt
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-06 13:41:23 -04:00
Andy Goldstein 31102923cb Add script for dep
Signed-off-by: Andy Goldstein <andy.goldstein@gmail.com>
2017-09-06 13:41:23 -04:00
Andy Goldstein b7265a59f2 Merge pull request #63 from skriss/gc_restores
GC restores along with backups; de-dupe GC controller code
2017-09-06 13:37:18 -04:00
Steve Kriss 7648155c9a delete restores when GC'ing backups & don't orphan cloud resources
Signed-off-by: Steve Kriss <steve@heptio.com>
2017-09-06 10:34:08 -07:00
Andy Goldstein 305e7fcea0 Merge pull request #59 from jrnt30/explicit-includes-excludes-restore
Allows explicit include/exclude of namespaces on restores
2017-09-06 11:21:24 -04:00
Andy Goldstein 56c680f991 Merge pull request #62 from jrnt30/default-home-resolution
Allow default kubeconfig resolution
2017-09-06 11:16:10 -04:00
Justin Nauman 2d084c4348 Removing instead of deprecating Namespace attr
- Per discussion, there is no reason to deal
with the complexity of backwards compatibility
with the Namespace attribute on the Restore
domain.

- Also noticed there was an error on the
validation of the BackupController where
the message would actually just be the index
of the error and not the contents of the message
itself.

Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-09-05 17:38:32 -05:00
Justin Nauman 2457d8f116 Removing instead of deprecating Namespace attr
- Per discussion, there is no reason to deal
with the complexity of backwards compatibility
with the Namespace attribute on the Restore
domain.

- Also noticed there was an error on the
validation of the BackupController where
the message would actually just be the index
of the error and not the contents of the message
itself.

Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-09-05 17:18:10 -05:00
Justin Nauman b50a046370 Additional Validation on Include/Exclude
- Adding in additional test to ensure *Namespaces attributes
don't directly conflict logically with one another
- Additional PR changes around naming/typos

Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-09-05 17:17:46 -05:00
Justin Nauman af2a792a9a Allows explicit include/exclude of namespaces on restores
- Introduces similar Include/Exclude declaration on the Restore
resource and cli flags
- Kept support for legacy Namespaces attribute until it could be
deprecating.  Defining both IncludeNamespaces and Namespaces results
in a validation error and the Restore will not be processed (shouldn't
be able to occur)

Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-09-05 17:17:41 -05:00
Andy Goldstein 4e596852b5 Merge pull request #66 from skriss/getallbackups-fix
in GetAllBackups don't error if single backup is unreadable
2017-09-05 13:02:56 -04:00
Steve Kriss ba299f880f in GetAllBackups don't error if single backup is unreadable
Signed-off-by: Steve Kriss <steve@heptio.com>
2017-09-05 09:56:37 -07:00
Andy Goldstein 43c74e33c2 Merge pull request #57 from skriss/restore_missing_backup_fix
during restore, try to get backup directly from obj storage if not in cache/API
2017-09-05 12:47:13 -04:00
Andy Goldstein 7ec0407756 Merge pull request #61 from jrnt30/aws-paging
AWS Paging Support
2017-09-05 12:46:05 -04:00
Steve Kriss f07a70c604 during restore, try to get backup directly from obj storage if not in cache/API
Signed-off-by: Steve Kriss <steve@heptio.com>
2017-09-05 09:25:39 -07:00
Justin Nauman c0e94a4c1a Allow default kubeconfig resolution
- Changed the default kubeconfig loading to utilize
the client-go's loader strategy.  This allows users
to use the Ark client without having to explicitly
define a KUBECONFIG env var or argument.

This more closely resemebles how Kubectl works and users
are probably more used to while preserving the
current rules.

Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-08-28 07:56:57 -05:00
Justin Nauman f017a23d41 AWS Paging Support
- Adding in paging support for the S3 and Snapshot
AWS integration.

As a testing note, you can add in a a MaxKeys to the S3
request as an easy way to ensure that paging is working
properly without having to creation over 1k backups.

Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-08-28 05:49:39 -05:00
Andy Goldstein b20feee7f9 Merge pull request #43 from skriss/pvprovider_optional
make PVProvider optional in server config; disallow snap/restore PVs …
2017-08-23 12:59:59 -04:00
Steve Kriss 768aed4ddd make --snapshot-volumes, --restore-volumes optional with sensible default behavior based on PVProvider existence
Signed-off-by: Steve Kriss <steve@heptio.com>
2017-08-23 09:47:52 -07:00
Steve Kriss 8d5c8ffcbb get rid of StorageAdapter structs and move validation into block/object
Signed-off-by: Steve Kriss <steve@heptio.com>
2017-08-23 09:46:15 -07:00
Steve Kriss ebc06fd632 make PVProvider optional in server config; disallow snap/restore PVs when not provided
Signed-off-by: Steve Kriss <steve@heptio.com>
2017-08-23 09:46:15 -07:00
Andy Goldstein 3ca085eb58 Merge pull request #45 from jrnt30/snapshot-restore-defaults
Snapshot and restore volumes by default
2017-08-22 09:08:03 -04:00
Justin Nauman 618de63d23 Doc updates where volume flags are concered
Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-08-21 09:48:07 -05:00
Justin Nauman d39d6f96fa Adjusting docs and example
- Removed explicit setting of snapshot flags
- Removed node selector on replicaset to reduce manual steps for users

Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-08-21 09:47:42 -05:00
Justin Nauman fc8f27c997 Adjusting PV example to only one replica
- The two replicas contend for single PVC with the defined toplogy.  Could adjust to SS but kept it simple for now

Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-08-21 09:47:11 -05:00
Justin Nauman 3ea9899140 Adding in defaults for backup creation and restore
Signed-off-by: Justin Nauman <justin.r.nauman@gmail.com>
2017-08-21 09:47:11 -05:00
Jessica Yao e993dd0cbd Merge pull request #47 from abiogenesis-now/jyao/add-release-doc-warning
[docs] Add warnings about doc changes between releases
2017-08-18 14:46:50 -07:00
Jessica Yao e793aa1626 Merge pull request #51 from skriss/azure-docs-typo
fix mismatch between created and referenced SP name
2017-08-17 16:20:40 -07:00
Steve Kriss 80032639f1 fix mismatch between created and referenced SP name
Signed-off-by: Steve Kriss <steve@heptio.com>
2017-08-17 15:37:38 -07:00
Jessica Yao ef9eafacb4 address comments
Signed-off-by: Jessica Yao <jessica@heptio.com>
2017-08-16 14:03:05 -07:00
Jessica Yao e19d964042 simplify local build instructions
Signed-off-by: Jessica Yao <jessica@heptio.com>
2017-08-16 10:36:31 -07:00
Jessica Yao a57bd1698b add comment about local images and container tags
Signed-off-by: Jessica Yao <jessica@heptio.com>
2017-08-16 09:35:24 -07:00
Jessica Yao 462e5443a8 use same versioning warning across the board
Signed-off-by: Jessica Yao <jessica@heptio.com>
2017-08-15 13:03:30 -07:00
Jessica Yao 91ba076cce add warnings about doc changes between releases
Signed-off-by: Jessica Yao <jessica@heptio.com>
2017-08-15 10:18:31 -07:00