Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement hooks for failure scenarios: crash_hook, cancel_hook, fail_hook #4315

Merged
merged 34 commits into from
Aug 11, 2023
Merged
Show file tree
Hide file tree
Changes from 12 commits
Commits
Show all changes
34 commits
Select commit Hold shift + click to select a range
ccc6ef7
Add cancel and fail hooks
Jul 25, 2023
3eee395
Run hooks in main with arguments
XavierCS-dev Jul 25, 2023
a80ac7f
Init eb_go with parse_options()
XavierCS-dev Jul 25, 2023
2ef4cf6
Merge with main
Aug 7, 2023
014fd42
Add crash hook
XavierCS-dev Aug 8, 2023
1a589dc
Remove trailing whitespace
XavierCS-dev Aug 8, 2023
565c113
Revert file permissions
XavierCS-dev Aug 8, 2023
852e4c9
Updated unit tests expected output with new hooks
XavierCS-dev Aug 8, 2023
3d61e4a
Insert missing commas
XavierCS-dev Aug 8, 2023
b880856
Replace spaces with tabs to match expected options output
XavierCS-dev Aug 8, 2023
716701d
Merge branch 'develop' into 4302_failure_hooks
XavierCS-dev Aug 8, 2023
b5ec611
Shorten long line of imports
XavierCS-dev Aug 8, 2023
f296dc5
formatting of imports
branfosj Aug 9, 2023
0e751c9
Reorder failure hooks to be in alphabetical order
XavierCS-dev Aug 10, 2023
6cb5eda
Merge branch '4302_failure_hooks' of https://github.com/XavierCS-dev/…
XavierCS-dev Aug 10, 2023
8a474bb
Fix output tests for hook order
XavierCS-dev Aug 10, 2023
ec87c86
Alter refactor to define variables
XavierCS-dev Aug 10, 2023
2e8b80f
Comment out line overriding variables defined elsewhere
XavierCS-dev Aug 10, 2023
81e5344
Fix style issues
XavierCS-dev Aug 10, 2023
0ac9daf
Update main docstring and add prepare_main docstring
XavierCS-dev Aug 10, 2023
22b4429
Remove uncessary comment
XavierCS-dev Aug 10, 2023
1751fe3
Only set eb_go and cfg_settings if not already
XavierCS-dev Aug 10, 2023
c4be4ca
Move setup config to occure before os.environ is checked
XavierCS-dev Aug 10, 2023
58623de
Change pprepare_main description
XavierCS-dev Aug 10, 2023
8148fb5
Add return to prepare_main docstring
XavierCS-dev Aug 10, 2023
f2f6b45
Move eb_go and cfg_settings to end of parameters to prevent breaking …
XavierCS-dev Aug 10, 2023
56def6b
Add init_session_state and hooks to prepare_main returns
XavierCS-dev Aug 10, 2023
d8a34e4
Update docstrings to match new parameters and return values
XavierCS-dev Aug 10, 2023
fcc6fee
Add or condition to ensure test passes
XavierCS-dev Aug 10, 2023
4146b46
Separate check on hooks to be None
XavierCS-dev Aug 11, 2023
d9b15f0
Improve clarity when checking for None values in main
XavierCS-dev Aug 11, 2023
7d31bb8
clean up passing of data produced by prepare_main into main
boegel Aug 11, 2023
20c99cd
Remove unnecessary parameter descriptions
XavierCS-dev Aug 11, 2023
746b992
Merge pull request #1 from boegel/4302_failure_hooks
XavierCS-dev Aug 11, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 10 additions & 2 deletions easybuild/main.py
Original file line number Diff line number Diff line change
Expand Up @@ -69,9 +69,10 @@
from easybuild.tools.github import add_pr_labels, install_github_token, list_prs, merge_pr, new_branch_github, new_pr
from easybuild.tools.github import new_pr_from_branch
from easybuild.tools.github import sync_branch_with_develop, sync_pr_with_develop, update_branch, update_pr
from easybuild.tools.hooks import BUILD_AND_INSTALL_LOOP, PRE_PREF, POST_PREF, START, END, load_hooks, run_hook
from easybuild.tools.hooks import BUILD_AND_INSTALL_LOOP, PRE_PREF, POST_PREF, CRASH, START, \
END, CANCEL, FAIL, load_hooks, run_hook
branfosj marked this conversation as resolved.
Show resolved Hide resolved
from easybuild.tools.modules import modules_tool
from easybuild.tools.options import opts_dict_to_eb_opts, set_up_configuration, use_color
from easybuild.tools.options import opts_dict_to_eb_opts, parse_options, set_up_configuration, use_color
from easybuild.tools.output import COLOR_GREEN, COLOR_RED, STATUS_BAR, colorize, print_checks, rich_live_cm
from easybuild.tools.output import start_progress_bar, stop_progress_bar, update_progress_bar
from easybuild.tools.robot import check_conflicts, dry_run, missing_deps, resolve_dependencies, search_easyconfigs
Expand Down Expand Up @@ -732,9 +733,16 @@ def main(args=None, logfile=None, do_build=None, testing=False, modtool=None):


if __name__ == "__main__":
eb_go = parse_options()
XavierCS-dev marked this conversation as resolved.
Show resolved Hide resolved
hooks = load_hooks(eb_go.options.hooks)
try:
main()
except EasyBuildError as err:
run_hook(FAIL, hooks, args=[err])
print_error(err.msg)
except KeyboardInterrupt as err:
run_hook(CANCEL, hooks, args=[err])
print_error("Cancelled by user: %s" % err)
except Exception as err:
run_hook(CRASH, hooks, args=[err])
print_error("Encountered an unrecoverable error: %s" % err)
7 changes: 7 additions & 0 deletions easybuild/tools/hooks.py
Original file line number Diff line number Diff line change
Expand Up @@ -66,6 +66,10 @@
MODULE_WRITE = 'module_write'
END = 'end'

FAIL = 'fail'
CANCEL = 'cancel'
CRASH = 'crash'
XavierCS-dev marked this conversation as resolved.
Show resolved Hide resolved

PRE_PREF = 'pre_'
POST_PREF = 'post_'
HOOK_SUFF = '_hook'
Expand Down Expand Up @@ -101,6 +105,9 @@
for p in [PRE_PREF, POST_PREF]] + [
POST_PREF + BUILD_AND_INSTALL_LOOP,
END,
FAIL,
CANCEL,
CRASH,
XavierCS-dev marked this conversation as resolved.
Show resolved Hide resolved
]
KNOWN_HOOKS = [h + HOOK_SUFF for h in HOOK_NAMES]

Expand Down
3 changes: 3 additions & 0 deletions test/framework/options.py
Original file line number Diff line number Diff line change
Expand Up @@ -719,6 +719,9 @@ def test_avail_hooks(self):
" post_testcases_hook",
" post_build_and_install_loop_hook",
" end_hook",
" fail_hook",
" cancel_hook",
" crash_hook",
'',
])
self.assertEqual(stdout, expected)
Expand Down