Merge branch 'master' of github.com:HariSekhon/DevOps-Bash-tools

pull/2/head
Hari Sekhon 3 years ago
commit b33d4e6daf

@ -584,14 +584,18 @@ etc.
- `github_*.sh` - [GitHub](https://github.com/) API scripts:
- `github_api.sh` - queryies the GitHub [API](https://docs.github.com/en/rest/reference). Can infer GitHub user, repo and authentication token from local checkout or environment (`$GITHUB_USER`, `$GITHUB_TOKEN`)
- `github_foreach_repo.sh` - executes a templated command for each non-fork GitHub repo, replacing the `{user}` and `{repo}` in each iteration
- `github_actions_foreach_workflow.sh` - executes a templated command for each workflow in a given GitHub repo, replacing `{name}`, `{id}` and `{state}` in each iteration
- `github_actions_runner.sh` - generates a [GitHub Actions](https://github.com/features/actions) self-hosted runner token for a given Repo or Organization via the GitHub API and then runs a dockerized GitHub Actions runner with the appropriate configuration
- `github_actions_runner_local.sh` - downloads, configures and runs a local GitHub Actions Runner for Linux or Mac
- `github_actions_runner_token.sh` - generates a GitHub Actions runner token to register a new self-hosted runner
- `github_actions_runners.sh` - lists GitHub Actions self-hosted runners for a given Repo or Organization
- `github_actions_delete_offline_runners.sh` - deletes offline GitHub Actions self-hosted runners. Useful to clean up short-lived runners eg. Docker, Kubernetes
- `github_workflows.sh` - lists GitHub Actions workflows for a given repo (or auto-infers local repository)
- `github_workflow_runs.sh` - lists GitHub Actions workflow runs for a given workflow id or name
- `github_workflows_status.sh` - lists all GitHub Actions workflows and their statuses for a given repo
- `github_actions_workflows.sh` - lists GitHub Actions workflows for a given repo (or auto-infers local repository)
- `github_actions_workflow_runs.sh` - lists GitHub Actions workflow runs for a given workflow id or name
- `github_actions_workflows_status.sh` - lists all GitHub Actions workflows and their statuses for a given repo
- `github_actions_workflows_state.sh` - lists GitHub Actions workflows enabled/disabled states (GitHub now disables workflows after 6 months without a commit)
- `github_actions_workflow_enable.sh` - enables a given GitHub Actions workflow
- `github_actions_workflows_enable_all.sh` - enables all GitHub Actions workflows in a given repo. Useful to undo GitHub disabling all workflows in a repo after 6 months without a commit
- `github_get_user_ssh_public_keys.sh` - fetches a given GitHub user's public SSH keys via the API for piping to `~/.ssh/authorized_keys` or adjacent tools
- `github_get_ssh_public_keys.sh` - fetches the currently authenticated GitHub user's public SSH keys via the API, similar to above but authenticated to get identifying key comments
- `github_add_ssh_public_keys.sh` - uploads SSH keys from local files or standard input to the currently authenticated GitHub account. Specify pubkey files (default: `~/.ssh/id_rsa.pub`) or read from standard input for piping from adjacent tools

@ -0,0 +1,76 @@
#!/usr/bin/env bash
# vim:ts=4:sts=4:sw=4:et
# args: devops-bash-tools echo user={user} repo={repo} name={name} workflow_name={workflow} id={id}
#
# Author: Hari Sekhon
# Date: 2021-11-27 11:21:14 +0000 (Sat, 27 Nov 2021)
#
# https://github.com/harisekhon/bash-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help improve or steer this or other code I publish
#
# https://www.linkedin.com/in/harisekhon
#
set -euo pipefail
[ -n "${DEBUG:-}" ] && set -x
srcdir="$(cd "$(dirname "$0")" && pwd)"
# shellcheck disable=SC1090
. "$srcdir/lib/github.sh"
# shellcheck disable=SC2034,SC2154
usage_description="
Run a command for each GitHub Actions workflow in the given repo
All arguments after the repo become the command template
\$GITHUB_ORGANIZATION / \$GITHUB_USER - the user or organization to iterate the repos on - if not specified then determines the currently authenticated github user from your \$GITHUB_TOKEN
The command template replaces the following for convenience in each iteration:
{organization}, {org} => the organization account being iterated
{username}, {user} => the user account being iterated
{repo} => the repo name with the user prefix
{workflow}, {name} => the workflow name
{id}, {workflow_id} => the workflow id
eg.
${0##*/} devops-bash-tools echo user={user} repo={repo} name={name} workflow_name={workflow} id={id}
${0##*/} devops-bash-tools echo org={org} repo={repo} name={name} workflow_name={workflow} id={id}
"
# used by usage() in lib/utils.sh
# shellcheck disable=SC2034
usage_args="<repo> <command> <args>"
help_usage "$@"
min_args 2 "$@"
repo="$1"
shift || :
cmd_template="$*"
"$srcdir/github_actions_workflows.sh" "$repo" |
jq -r '.workflows[] | [.id, .name] | @tsv' |
while read -r id workflow; do
echo "# ============================================================================ #" >&2
echo "# $workflow" >&2
echo "# ============================================================================ #" >&2
cmd="$cmd_template"
cmd="${cmd//\{username\}/${user:-}}"
cmd="${cmd//\{user\}/${user:-}}"
cmd="${cmd//\{organization\}/${GITHUB_ORGANIZATION:-}}"
cmd="${cmd//\{org\}/${GITHUB_ORGANIZATION:-}}"
cmd="${cmd//\{repo\}/$repo}"
cmd="${cmd//\{name\}/$workflow}"
cmd="${cmd//\{workflow\}/$workflow}"
cmd="${cmd//\{workflow_id\}/$id}"
cmd="${cmd//\{id\}/$id}"
eval "$cmd"
echo >&2
done

@ -0,0 +1,49 @@
#!/usr/bin/env bash
# vim:ts=4:sts=4:sw=4:et
#
# Author: Hari Sekhon
# Date: 2021-11-28 11:11:51 +0000 (Sun, 28 Nov 2021)
#
# https://github.com/HariSekhon/bash-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/HariSekhon
#
set -euo pipefail
[ -n "${DEBUG:-}" ] && set -x
srcdir="$(dirname "${BASH_SOURCE[0]}")"
# shellcheck disable=SC1090
. "$srcdir/lib/utils.sh"
# shellcheck disable=SC2034,SC2154
usage_description="
Enables a GitHub Actions workflow via the API
Use this to enable a workflow programmatically.
"
# used by usage() in lib/utils.sh
# shellcheck disable=SC2034
usage_args="<repo> <workflow_id>"
help_usage "$@"
min_args 2 "$@"
repo="$1"
workflow_id="$2"
USER="${GITHUB_ORGANIZATION:-${GITHUB_USER:-$(get_github_user)}}"
if ! [[ $repo =~ / ]]; then
repo="$USER/$repo"
fi
timestamp "Enabling github actions workflow with id '$workflow_id'"
"$srcdir/github_api.sh" "/repos/$repo/actions/workflows/$workflow_id/enable" -X PUT
timestamp "workflow id '$workflow_id' enabled'"

@ -26,9 +26,9 @@ srcdir="$(dirname "$0")"
# shellcheck disable=SC2034
usage_description="
Script to get GitHub Workflow runs for a given Workflow ID (or name.yaml) via the API
Returns GitHub Actions Workflow runs for a given Workflow ID (or name.yaml) in json format via the API
Workflow ID can be either a number (see output of adjacent github_workflows.sh), or the name of the workflow yaml file, with or without the .yaml extension
Workflow ID can be either a number (see output of adjacent github_actions_workflows.sh), or the name of the workflow yaml file, with or without the .yaml extension
If no repo arg is given and is inside a git repo then takes determines the repo from the first git remote listed

@ -25,7 +25,7 @@ srcdir="$(dirname "$0")"
# shellcheck disable=SC2034,SC2154
usage_description="
Script to get GitHub Workflows via the API
Returns GitHub Actions Workflows json via the API
If no repo arg is given and is inside a git repo then takes determines the repo from the first git remote listed
@ -62,11 +62,12 @@ for arg; do
esac
done
USER="${GITHUB_USER:-${USERNAME:-${USER}}}"
USER="${GITHUB_ORGANIZATION:-${GITHUB_USER:-$(get_github_user)}}"
PASSWORD="${GITHUB_PASSWORD:-${GITHUB_TOKEN:-${PASSWORD:-}}}"
if ! [[ $repo =~ / ]]; then
repo="$USER/$repo"
fi
"$srcdir/github_api.sh" "/repos/$repo/actions/workflows$workflow_id" # | jq -r '.workflows[].path' | sed 's|.github/workflows/||;s|\.yaml$||'
# XXX: would need to iterate pages if you have more than 100 workflows
"$srcdir/github_api.sh" "/repos/$repo/actions/workflows$workflow_id?per_page=100" # | jq -r '.workflows[].path' | sed 's|.github/workflows/||;s|\.yaml$||'

@ -0,0 +1,47 @@
#!/usr/bin/env bash
# vim:ts=4:sts=4:sw=4:et
#
# Author: Hari Sekhon
# Date: 2021-11-28 11:11:51 +0000 (Sun, 28 Nov 2021)
#
# https://github.com/HariSekhon/bash-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/HariSekhon
#
set -euo pipefail
[ -n "${DEBUG:-}" ] && set -x
srcdir="$(dirname "${BASH_SOURCE[0]}")"
# shellcheck disable=SC1090
. "$srcdir/lib/utils.sh"
# shellcheck disable=SC2034,SC2154
usage_description="
Enables all GitHub Actions workflows via the API
Use to re-enable all your workflows as GitHub has started disabling workflows in repos after 6 months without a commit
"
# used by usage() in lib/utils.sh
# shellcheck disable=SC2034
usage_args="<repo>"
help_usage "$@"
min_args 1 "$@"
repo="$1"
USER="${GITHUB_ORGANIZATION:-${GITHUB_USER:-$(get_github_user)}}"
if ! [[ $repo =~ / ]]; then
repo="$USER/$repo"
fi
timestamp "Enabling all github actions workflows in repo '$repo'"
"$srcdir/github_actions_foreach_workflow.sh" "$repo" "$srcdir/github_actions_workflow_enable.sh" "$repo" "{id}"

@ -0,0 +1,39 @@
#!/usr/bin/env bash
# vim:ts=4:sts=4:sw=4:et
#
# Author: Hari Sekhon
# Date: 2021-11-28 11:11:51 +0000 (Sun, 28 Nov 2021)
#
# https://github.com/HariSekhon/bash-tools
#
# License: see accompanying Hari Sekhon LICENSE file
#
# If you're using my code you're welcome to connect with me on LinkedIn and optionally send me feedback to help steer this or other code I publish
#
# https://www.linkedin.com/in/HariSekhon
#
set -euo pipefail
[ -n "${DEBUG:-}" ] && set -x
srcdir="$(dirname "${BASH_SOURCE[0]}")"
# shellcheck disable=SC1090
. "$srcdir/lib/utils.sh"
# shellcheck disable=SC2034,SC2154
usage_description="
Lists GitHub Actions Workflows enabled/disable state via the API
Output format:
<workflow_id> <enabled/disable> <workflow_name>
"
# used by usage() in lib/utils.sh
# shellcheck disable=SC2034
usage_args="<repo> [<workflow_id>]"
help_usage "$@"
"$srcdir/github_actions_workflows.sh" "$@" |
jq -r '.workflows[] | [.id, .state, .name ] | @tsv'

@ -22,7 +22,7 @@ srcdir="$(dirname "$0")"
# shellcheck disable=SC2034,SC2154
usage_description="
Script to get GitHub Workflow runs status via the API
Lists GitHub Actions Workflows run status via the API
If no repo arg is given and is inside a git repo then takes determines the repo from the first git remote listed
@ -33,8 +33,10 @@ If no repo arg is given and is inside a git repo then takes determines the repo
# shellcheck disable=SC2034
usage_args="<repo> [<workflow_id>]"
help_usage "$@"
workflows="$(
"$srcdir/github_workflows.sh" "$@" |
"$srcdir/github_actions_workflows.sh" "$@" |
jq -r '.workflows[].path' |
sed 's|.github/workflows/||;s|\.yaml$||'
)"
@ -44,7 +46,7 @@ for workflow_name in $workflows; do
{
output="$(
printf '%s\t' "$workflow_name"
"$srcdir/github_workflow_runs.sh" "$workflow_name" |
"$srcdir/github_actions_workflow_runs.sh" "$workflow_name" |
jq -r 'limit(1; .workflow_runs[] | .conclusion?)'
)"
echo "$output"

@ -45,8 +45,9 @@ chart="$2"
shift || :
shift || :
# doesn't really matter what this repo name is as long as it's consistent and can infer what it should be from the chart call
repo="${chart%%/*}"
release_name="${chart##*/}"
release_name="${chart##*/}" # for simplicity the release name can be the same as the chart, which is fine for most cases
if ! helm repo list | grep -q "^${repo}[[:space:]]"; then
helm repo add "$repo" "$repo_url"

@ -20,9 +20,8 @@ srcdir="$(dirname "${BASH_SOURCE[0]}")"
# shellcheck disable=SC1090,SC1091
. "$srcdir/lib/utils.sh"
# shellcheck disable=SC1090
# not using anything from here directly
#. "$srcdir/lib/kubernetes.sh"
# shellcheck disable=SC1090,SC1091
. "$srcdir/lib/kubernetes.sh"
# shellcheck disable=SC2034,SC2154
usage_description="
@ -36,6 +35,9 @@ Uses adjacent scripts:
kubectl_create_namespaces.sh
If a kubectl context is given as an arg, uses adjacent kubectl.sh to prevent race conditions, see kubectl.sh for more details
Requires Kustomize 4.x for --enable-helm support
"
# used by usage() in lib/utils.sh

Loading…
Cancel
Save