Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add progress reporting for restic backups & restores #1749

Closed
skriss opened this issue Aug 9, 2019 · 2 comments
Closed

add progress reporting for restic backups & restores #1749

skriss opened this issue Aug 9, 2019 · 2 comments
Assignees
Labels
Enhancement/User End-User Enhancement to Velero Restic - GA needed for restic integration to be considered GA Restic Relates to the restic integration
Milestone

Comments

@skriss
Copy link
Contributor

skriss commented Aug 9, 2019

xref #20 #21

Describe the problem/challenge you have

During long-running restic backups/restores, there is no visibility into what (if anything) is happening, making it hard to know if the backup/restore is making progress or hung, how long the operation might take, etc.

Describe the solution you'd like

We should capture progress during restic operations and make it user-visible somewhere (could be in a status field on the PVB/PVR, or in an Event, or somewhere else - TBD).

restic backup provides progress reporting to stdout. @jmontleon did a POC of capturing this periodically and writing it to the PVB's status (see this comment).

restic restore does not yet have such progress reporting; however, the restic ls SNAPSHOT_ID command will give a listing of all files in a backup, and we could potentially use that along with periodic listing of files in the directory being restored to provide something useful to the user.

This definitely needs some experimentation and design work, but IMHO we need to do this before declaring restic GA, as it's just too hard to know what's going on right now.

@prydonius if you're looking for something to do next week, some R&D here would definitely be useful!

@skriss skriss added Enhancement/User End-User Enhancement to Velero Restic Relates to the restic integration labels Aug 9, 2019
@skriss skriss changed the title [restic] add progress reporting for restic backups & restores add progress reporting for restic backups & restores Aug 9, 2019
@skriss skriss added P2 - Long-term important Restic - GA needed for restic integration to be considered GA labels Aug 12, 2019
@prydonius
Copy link
Contributor

prydonius commented Aug 13, 2019

restic backup provides progress reporting to stdout. @jmontleon did a POC of capturing this periodically and writing it to the PVB's status (see this comment).

FYI took me a while to figure out that the JSON output for restic backup requires 0.9.5, our current images ship 0.9.4, so we'll need to update that.

@skriss
Copy link
Contributor Author

skriss commented Sep 10, 2019

Closed by #1821 and #1854

@skriss skriss closed this as completed Sep 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement/User End-User Enhancement to Velero Restic - GA needed for restic integration to be considered GA Restic Relates to the restic integration
Projects
None yet
Development

No branches or pull requests

2 participants