598 engineering incidents, newest first

• Grafana security update: post-incident review for GitHub workflow vulnerability and what's next Apr 26, 2025 Incident Grafana Labs security-incidentgithub-actionssupply-chain +2
• Railway Incident Report: April 23rd, 2025 Apr 23, 2025 Incident Railway outagegcpcloud-sql +3
• Incident Report: Spotify Outage on April 16, 2025 Apr 16, 2025 Incident Spotify outageenvoykubernetes +4
• GitHub Availability Report: April 2025 Apr 11, 2025 Incident GitHub outagecodespacesconfiguration +3
• Intermittent failures Apr 9, 2025 Incident incident.io outagedatabasepostgres +2
• Post Incident Report: April 4, 2025 - Delays in starting workflows Apr 4, 2025 Incident CircleCI outagedatabaseworkflows +2
• Post Incident Report: April 4, 2025 - CircleCI UI Loading & build triggering issues Apr 4, 2025 Incident CircleCI outageconfig-errorwaf +3
• GitHub Availability Report: March 2025 Mar 29, 2025 Incident GitHub outagecredentialsexpiry +2
• Cloudflare incident on March 21, 2025 Mar 21, 2025 Incident Cloudflare outager2object-storage +2
• Postmortem on Next.js Middleware bypass Feb 27, 2025 Incident Vercel securityvulnerabilitycve +2
• GitHub Availability Report: February 2025 Feb 25, 2025 Incident GitHub outagenotificationsemail +4
• Incident Report for Box: [Critical] Customers may have issues with Uploads, Downloads, and accessing the All Files page Feb 19, 2025 Incident Box outageauthenticationapi +2
• Taming A Voracious Rust Proxy Feb 18, 2025 Incident Fly.io outagerustproxy +4
• How we responded to a 2+ hour partial outage in Grafana Cloud Feb 18, 2025 Incident Grafana Labs outagekubernetesload-balancer +3
• February 16 Outage postmortem Feb 16, 2025 Incident Fly.io outagenetworkingupstream-provider +3
• .COM/.NET SRS Production Environment Planned Outage Feb 9, 2025 Incident Enom outagemaintenancedomains +2
• Cloudflare incident on February 6, 2025 Feb 6, 2025 Incident Cloudflare outager2object-storage +2
• Post Incident Report: January 23, 2025 - Some commit status updates were not published Jan 23, 2025 Incident CircleCI outagedeploymentgithub +3
• Post Incident Report: January 22, 2025 - Delays starting and canceling workflows and jobs, and viewing them in the UI Jan 22, 2025 Incident CircleCI outagedatabasearchival +2
• GitHub Availability Report: January 2025 Jan 9, 2025 Incident GitHub outagedatabaseconfiguration +3
• Azure network outage in South Central US Dec 26, 2024 Incident Elastic Cloud outageelastic-cloudazure +2
• GitHub Availability Report: December 2024 Dec 17, 2024 Incident GitHub outagewebsocketlive-updates +2
• Incident Report: December 16th, 2024 Dec 16, 2024 Incident Railway outagegcpfirewall +3
• November 25 Outage Postmortem Nov 25, 2024 Incident Fly.io outagecorrosionapi +3
• GitHub Availability Report: November 2024 Nov 19, 2024 Incident GitHub outagedatabasenotifications +1
• Cloudflare Incident on November 14, 2024, Resulting in Lost Logs Nov 14, 2024 Incident Cloudflare outagelogginglogpush +2
• Canva incident report: API Gateway outage Nov 12, 2024 Incident Canva outageapi-gatewaycdn +6
• Known issue with APM Data Ingestion v8.15.0 Oct 31, 2024 Incident Elastic Cloud apmelasticsearchelastic-cloud +3
• Public IR - Major - Jobs Not Starting or In-Progress Fail 10-22-2024 & 10-28-2024 Oct 22, 2024 Incident CircleCI outageoutput-serviceapi-gateway +2
• October 22 Orchestration Outage Postmortem Oct 22, 2024 Incident Fly.io outagecertificate-expirationconsul +3
• GitHub Availability Report: October 2024 Oct 11, 2024 Incident GitHub outageavailability-reportdns +4
• Routing failures on Common Runtime, EU region Oct 8, 2024 Incident Heroku outageddosrouting +1
• GitHub Availability Report: September 2024 Sep 16, 2024 Incident GitHub outagegithub-actionsgithub-pages +3
• Outbound SMTP Outage on September 15-16, 2024 Sep 15, 2024 Incident Postmark outagesmtpssl +3
• Public IR - Major - Increased Wait Times for Machine Jobs 09-11-2024 Sep 11, 2024 Incident CircleCI outageredisstep-service +3
• September 1 Routing Layer Outage Postmortem Sep 1, 2024 Incident Fly.io outageproxyrust +3
• Incident Report: August 27th, 2024 Aug 27, 2024 Incident Railway outageterraformiac +3
• GitHub Availability Report: August 2024 Aug 14, 2024 Incident GitHub outagedatabaseconfiguration +2
• Incident Review: Pageserver outage in us-east-1 Aug 14, 2024 Incident Neon outagedatabasestorage +4
• GitHub Availability Report: July 2024 Jul 31, 2024 Incident GitHub outageavailability-reportwebhooks +3