Week 13 routine

[kiwixbot]

Infra

• Check nodes free space

df -h / && df -h /data

• Nodes and worker system upgrades

apt update && apt upgrade

• Ensure all borg repositories are being updated
• Check Pod errors

k get pods -A -o wide|grep Error

• Check Pod restarts

k get pods -A -o wide | pyp -i 'print("\n".join([line for line in l if re.split(r"\s+", line)[4] != "0"]))'

• Check if k8s should/could be upgraded

curl -s -H "X-Auth-Token: $SCW_SECRET_KEY" https://api.scaleway.com/k8s/v1/regions/fr-par/clusters/$KIWIX_PROD_CLUSTER|jq ".version,.upgrade_available"
curl -s -H "X-Auth-Token: $SCW_SECRET_KEY" https://api.scaleway.com/k8s/v1/regions/fr-par/versions|jq ".versions[].name"

• Upgrade k8s if applicable

Stats

• Ensure download.kiwix.org stats are being recorded
• Check whether matomo should be upgraded

Projects

• UptimeRobot has no alert
• youzim.it backlog is reasonable
• No systematic failure in tasks.
• PRs awaiting your review

Security

• Analyze/merge dependabot PRs

Note: this is an automatic reminder intended for the assignee(s).

[rgaudin]

• Couple errors: SSL related on downloading from github on Saturday (gen dev library) (self resolved)
• Library-related (file gone) on gen library on Friday (self resolved)
• Upgraded k8s to 1.23.16
• Upgraded matomo to 4.14.1
• youzim.it pipeline blocked by 2 similar tasks that didn't respect the limit. One of the reason we recently (after those two tasks) updated zimit to 0.9 crawler Parameter sizeLimit is not ending the crawl correctly webrecorder/browsertrix-crawler#256