postmortem.io
Menu

839 entries newest

Browse

Incident

2026-10-27: CI workloads impacted by GCP maintenance event

Read the original on the source site (external)
Contents · 5 sections

CI workloads impacted by GCP maintenance event (Severity 2)

Problem

CI workloads are being delayed by a GCP maintenance event.

Impact

CI jobs were delayed, with runner queue times increasing and pending jobs rising into the thousands. This also affected deployments and feature flag changes.

Causes

GCP maintenance in an affected zone reduced runner capacity.

Response strategy

We merged a change to avoid the maintenance-affected zone and rolled the affected pods. Queue delays and pending jobs have started to recover.

Post-incident review

Incident review, owned by @kkyrala. FCL exception request; decision pending.

Original source · other

2026-10-27: CI workloads impacted by GCP maintenance event

https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/23343

This page is an extract. Cite the original; link here for the indexed copy.

GitLab. "2026-10-27: CI workloads impacted by GCP maintenance event." other, 27 Oct 2026. https://gitlab.com/gitlab-com/gl-infra/production/-/work_items/23343 (retrieved 2026-10-27 via postmortem.io)