You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Dec 7, 2023. It is now read-only.
Lifting this into its own issue, because it's really important.
Any admin (regardless of whether they are a member of the pangeo-forge-4967 GCP project) can query logs for Dataflow jobs using the secrets/dataflow-job-submission.json service account key contained in this repo.
This is an essential tool for supporting recipe contributors, e.g. on staged-recipes, when jobs fail.
Knowing the job_id is key here, so fixing #145 will make this easier. Once #145 is fixed, the process described in #145 (comment) should be added to docs/README.md
In addition to gcloud logging CLI, @yuvipanda's logs.py linked in #145 (comment) and explained further in #145 (comment) should also be described in this doc.
Note that I'm not certain that the secrets/dataflow-job-submission.json service account creds will work for all operations supported in this logs.py, but this service account's roles could be adjusted if necessary, to ensure that Pangeo Forge Orchestrator admins can use these creds for calling Yuvi's logs.py, even if they are not members of the pangeo-forge-4967 GCP project.
Lifting this into its own issue, because it's really important.
Any admin (regardless of whether they are a member of the
pangeo-forge-4967
GCP project) can query logs for Dataflow jobs using thesecrets/dataflow-job-submission.json
service account key contained in this repo.This is an essential tool for supporting recipe contributors, e.g. on
staged-recipes
, when jobs fail.#145 (comment) describes how to do this.
Knowing the
job_id
is key here, so fixing #145 will make this easier. Once #145 is fixed, the process described in #145 (comment) should be added todocs/README.md
cc @andersy005
The text was updated successfully, but these errors were encountered: