A carefully organized library of public engineering incident reports, postmortems, and shutdown writeups — every entry linked back to its original source.https://postmortem.io/https://postmortem.io/incidents/aws--2026-07-17--billing-console-inaccurate-estimated-data/https://postmortem.io/incidents/aws--2026-07-17--billing-console-inaccurate-estimated-data/Inaccurate Estimated Billing Data (AWS Billing Console) AWS Health Dashboard timeline. Jul 17, 2026 08:33 UTC — We are investigating issues with Cost Explorer reflecting…Fri, 17 Jul 2026 00:00:00 GMTIncidentbillingcost-managementdata-accuracyconfigurationhttps://postmortem.io/incidents/aws--2026-07-16--cloudfront-vpc-origins-5xx-errors/https://postmortem.io/incidents/aws--2026-07-16--cloudfront-vpc-origins-5xx-errors/Increased 5xx Errors for CloudFront VPC Origins AWS Health Dashboard timeline. Jul 16, 2026 08:44 UTC — We are investigating increased 5xx errors for Cloudfront customers…Thu, 16 Jul 2026 00:00:00 GMTIncidentoutagecdnvpcapihttps://postmortem.io/incidents/aws--2026-07-15--eu-central-1-az2-connectivity/https://postmortem.io/incidents/aws--2026-07-15--eu-central-1-az2-connectivity/Elevated connectivity issues in a single Availability Zone (EU CENTRAL 1) AWS Health Dashboard timeline. Jul 15, 2026 23:11 UTC — We are investigating elevated connectivity issues…Wed, 15 Jul 2026 00:00:00 GMTIncidentoutageec2availability-zonenetworkinghttps://postmortem.io/incidents/github--2026-07-14--incident-with-webhooks/https://postmortem.io/incidents/github--2026-07-14--incident-with-webhooks/Incident with Webhooks Resolved This incident has been resolved. Thank you for your patience and understanding as we addressed this issue. A detailed root cause analysis will be…Tue, 14 Jul 2026 00:00:00 GMTIncidentoutagegithub-webhooksdeploymentdata-losshttps://postmortem.io/incidents/rust-lang--2026-07-11--crates-io-dos-attack/https://postmortem.io/incidents/rust-lang--2026-07-11--crates-io-dos-attack/DoS Attack Resolved This incident has been resolved. Big thanks to Fastly for providing their CDN services and their fast response time! Posted Jul 11, 2026 15:42 UTC Monitoring…Sat, 11 Jul 2026 00:00:00 GMTIncidentoutageddossecurityapicdncrates.iohttps://postmortem.io/incidents/github--2026-07-09--delays-starting-actions-runs/https://postmortem.io/incidents/github--2026-07-09--delays-starting-actions-runs/Delays starting Actions runs Resolved On July 9, 2026, between 03:29 UTC and 13:39 UTC, GitHub Actions experienced delayed and failed job starts on GitHub hosted runners. The…Thu, 09 Jul 2026 00:00:00 GMTIncidentoutagegithub-actionsgithub-pagesci-cdprovisioningcapacityhttps://postmortem.io/incidents/telstra--2026-07-08--nationwide-outage-time-keeping-server-defect/https://postmortem.io/incidents/telstra--2026-07-08--nationwide-outage-time-keeping-server-defect/Telstra outage exposes national vulnerability: one system failure, 6 million affected and critical 000 calls blocked The Silicon Review, 08 July 2026, Author: Sashindra Suresh A…Wed, 08 Jul 2026 00:00:00 GMTIncidentoutagetelecomntptime-syncemergency-servicesaustraliainfrastructurethird-party-impacthttps://postmortem.io/incidents/aws--2026-07-06--us-east-1-launch-template-api-errors/https://postmortem.io/incidents/aws--2026-07-06--us-east-1-launch-template-api-errors/Increased EC2 Launch Template API Error Rates (US EAST 1) AWS Health Dashboard timeline. Jul 6, 2026 12:45 UTC — We are investigating increased error rates when calling EC2 Launch…Mon, 06 Jul 2026 00:00:00 GMTIncidentoutageec2apius-east-1https://postmortem.io/incidents/railway--2026-07-02--us-east-services-outage/https://postmortem.io/incidents/railway--2026-07-02--us-east-services-outage/Incident Report: July 2, 2026 — US East Services Outage Author: Ray Chen Date: Jul 3, 2026 Impact Between approximately 07:44 UTC and 12:01 UTC on July 2, 2026, Railway users…Thu, 02 Jul 2026 00:00:00 GMTIncidentoutagenetworkingstorageprivate-networkingispus-easthttps://postmortem.io/incidents/github--2026-07-02--incident-with-pages/https://postmortem.io/incidents/github--2026-07-02--incident-with-pages/Incident with Pages Resolved On July 2nd, 2026, between approximately 15:00 and 18:30 UTC, the GitHub Pages service experienced degraded deployment performance due to a surge in…Thu, 02 Jul 2026 00:00:00 GMTIncidentoutagegithub-pagesdeploymentcapacityautoscalinghttps://postmortem.io/incidents/supabase--2026-06-30--project-status-change-failures/https://postmortem.io/incidents/supabase--2026-06-30--project-status-change-failures/Project status change failures in multiple regions Resolved Capacity availability and project creation, resize, and restart operations have returned to normal and have remained…Tue, 30 Jun 2026 00:00:00 GMTIncidentoutagecapacitypostgresqlmulti-regioninfrastructuredatabasehttps://postmortem.io/incidents/aws--2026-06-30--eu-north-1-ec2-api-errors/https://postmortem.io/incidents/aws--2026-06-30--eu-north-1-ec2-api-errors/Increased EC2 API Error Rates and Latencies (EU NORTH 1) AWS Health Dashboard timeline. Jun 30, 2026 21:02 UTC — We are investigating increased launch errors and API errors in the…Tue, 30 Jun 2026 00:00:00 GMTIncidentoutageec2apihttps://postmortem.io/incidents/mongodb--2026-06-25--atlas-ui-loading-issues/https://postmortem.io/incidents/mongodb--2026-06-25--atlas-ui-loading-issues/MongoDB Atlas: Atlas UI loading issues MongoDB Cloud Status incident, opened 2026 06 25, status: resolved Update (2026 06 25, resolved): From 2026 06 25 06:55 UTC to 2026 06 25…Thu, 25 Jun 2026 00:00:00 GMTIncidentoutagedatabaseatlasuilatencyrate-limitinghttps://postmortem.io/incidents/circleci--2026-06-23--delays-starting-docker-jobs/https://postmortem.io/incidents/circleci--2026-06-23--delays-starting-docker-jobs/Summary On Tuesday, June 23, 2026, our engineering team identified that a single Docker job cluster was operating below expected performance levels. Our infrastructure is…Tue, 23 Jun 2026 00:00:00 GMTIncidentoutagedockernomadroutingdecommissioningmonitoringhttps://postmortem.io/incidents/fly-io--2026-06-15--tkdb-migration-machines-api-outage/https://postmortem.io/incidents/fly-io--2026-06-15--tkdb-migration-machines-api-outage/June 15: Machines API Outage (15:07UTC) Our token service tkdb became unavailable, which broke our macaroon token verification path. This caused a broad control plane outage for…Mon, 15 Jun 2026 00:00:00 GMTIncidentoutagetkdbmacaroontokensmachines-apiproxycordoninghttps://postmortem.io/incidents/aws--2026-06-06--sa-east-1-internet-connectivity/https://postmortem.io/incidents/aws--2026-06-06--sa-east-1-internet-connectivity/Internet Connectivity Issues (SA EAST 1) AWS Health Dashboard timeline. Jun 6, 2026 04:24 UTC — Between 5:50 PM and 7:15 PM PDT, we experienced connectivity issues that may have…Sat, 06 Jun 2026 00:00:00 GMTIncidentoutagenetworkinghttps://postmortem.io/incidents/github--2026-06-04--availability-report-june-2026/https://postmortem.io/incidents/github--2026-06-04--availability-report-june-2026/GitHub described June's infrastructure progress before its incident write ups: monolith traffic in Azure peaked at 45% in Central US, lower than hoped because GitHub paused the…Thu, 04 Jun 2026 00:00:00 GMTIncidentoutagecopilotddoscachingauthenticationthird-party-dependencygithub-actionshttps://postmortem.io/incidents/supabase--2026-06-02--us-east-2-ohio-pause-restore-backup-errors/https://postmortem.io/incidents/supabase--2026-06-02--us-east-2-ohio-pause-restore-backup-errors/Errors impacting pause, restore, and backup operations in us east 2 (Ohio) Supabase Status incident, opened 2026 06 02, status: resolved Update (13:36 UTC, investigating): We are…Tue, 02 Jun 2026 00:00:00 GMTIncidentoutagedatabasedeploymentus-east-2https://postmortem.io/incidents/elastic--2026-05-29--upstream-azure-outage-service-degradation/https://postmortem.io/incidents/elastic--2026-05-29--upstream-azure-outage-service-degradation/Upstream Azure Outage Causing Service Degradation Elastic Cloud (Public) Status incident, opened 2026 05 29, status: resolved Update (06:32 UTC, investigating): We are continuing…Fri, 29 May 2026 00:00:00 GMTIncidentoutageelasticsearchelastic-cloudazureavailability-zonehttps://postmortem.io/incidents/aws--2026-05-22--route53-api-error-rates/https://postmortem.io/incidents/aws--2026-05-22--route53-api-error-rates/Increased Route 53 API Error Rates AWS Health Dashboard timeline. May 22, 2026 23:38 UTC — We are investigating increased error rates for Route53 API calls. May 23, 2026 00:13 UTC…Fri, 22 May 2026 00:00:00 GMTIncidentoutagednsapiroute53https://postmortem.io/incidents/railway--2026-05-19--gcp-account-suspension/https://postmortem.io/incidents/railway--2026-05-19--gcp-account-suspension/Incident Report: May 19, 2026 GCP Account Suspension Authors: Chandrika Khanduri & Cody De Arkland Date: May 20, 2026 Impact Between 22:20 UTC on May 19 and 06:14 UTC on May 20…Tue, 19 May 2026 00:00:00 GMTIncidentoutagegcpcontrol-planedatabaseplatform-widecloud-dependencyhttps://postmortem.io/incidents/supabase--2026-05-08--us-east-1-az4-network-connectivity/https://postmortem.io/incidents/supabase--2026-05-08--us-east-1-az4-network-connectivity/Network connectivity in us east 1 az4 Supabase Status incident, opened 2026 05 08, status: resolved Update (00:50 UTC, investigating): Increased connection times for Supavisor…Fri, 08 May 2026 00:00:00 GMTIncidentoutagedatabaseawsavailability-zonesupavisorhttps://postmortem.io/incidents/mongodb--2026-05-07--aws-cluster-dns-degraded-performance/https://postmortem.io/incidents/mongodb--2026-05-07--aws-cluster-dns-degraded-performance/AWS Cluster DNS Changes Degraded Performance MongoDB Cloud Status incident, opened 2026 05 07, status: resolved Update (2026 05 07 15:17 UTC, identified): DNS changes for AWS…Thu, 07 May 2026 00:00:00 GMTIncidentoutagedatabaseatlasawsdnsacmecluster-managementhttps://postmortem.io/incidents/aws--2026-05-07--us-east-1-az4-thermal-event/https://postmortem.io/incidents/aws--2026-05-07--us-east-1-az4-thermal-event/Increased Error Rate and Latency in US EAST 1 (use1 az4 thermal event) AWS Health Dashboard timeline for the thermal event that impaired a single Availability Zone (use1 az4) in…Thu, 07 May 2026 00:00:00 GMTIncidentoutagedatacenterpower-outageavailability-zoneec2ebshardwarehttps://postmortem.io/incidents/cloudflare--2026-05-05--de-tld-dnssec-outage/https://postmortem.io/incidents/cloudflare--2026-05-05--de-tld-dnssec-outage/When DNSSEC goes wrong: how we responded to the .de TLD outage Authors: Sebastiaan Neuteboom, Christian Elmerot, Max Worsley Overview On May 5, 2026, at approximately 19:30 UTC,…Tue, 05 May 2026 00:00:00 GMTIncidentoutagednsdnssec1.1.1.1resolverthird-partyhttps://postmortem.io/incidents/github--2026-05-04--availability-report-may-2026/https://postmortem.io/incidents/github--2026-05-04--availability-report-may-2026/GitHub reported on its ongoing infrastructure investments before covering May's incidents: the company is now serving 40% of monolith traffic from Azure (up from 8% in February),…Mon, 04 May 2026 00:00:00 GMTIncidentoutagedatabasegithub-actionscopilotnetworkingcapacitythird-party-dependencyhttps://postmortem.io/incidents/honeycomb--2026-05-04--kafka-maintenance-may-2026/https://postmortem.io/incidents/honeycomb--2026-05-04--kafka-maintenance-may-2026/Honeycomb Incident Report: Kafka Maintenance on May 4 and 7, 2026 On May 4th in the EU instance, and May 7th in the US instance, Honeycomb ran its only scheduled maintenance…Mon, 04 May 2026 00:00:00 GMTIncidentmaintenancekafkacommunicationincident-responseplanned-downtimeingesthttps://postmortem.io/incidents/aws--2026-04-27--eu-west-3-az2-connectivity/https://postmortem.io/incidents/aws--2026-04-27--eu-west-3-az2-connectivity/Increased EC2 Connectivity Issues in a single Availability Zone (EU WEST 3) AWS Health Dashboard timeline. Apr 27, 2026 11:27 UTC — We are investigating instance connectivity…Mon, 27 Apr 2026 00:00:00 GMTIncidentoutageec2availability-zonehttps://postmortem.io/incidents/github--2026-04-23--update-on-github-availability/https://postmortem.io/incidents/github--2026-04-23--update-on-github-availability/This post, published April 28, 2026 by GitHub CTO Vlad Fedorov, addresses two recent incidents outside the normal monthly availability report cadence: "Both of those incidents are…Thu, 23 Apr 2026 00:00:00 GMTIncidentoutagemerge-queuegitsearchelasticsearchddoscapacityscalinghttps://postmortem.io/incidents/github--2026-04-01--availability-report-april-2026/https://postmortem.io/incidents/github--2026-04-01--availability-report-april-2026/In April, GitHub experienced 10 incidents that resulted in degraded performance across GitHub services. To increase transparency, at the end of April GitHub released a separate…Wed, 01 Apr 2026 00:00:00 GMTIncidentoutagesearchdnsdatabaserate-limitingcopilotgithub-actionsgithub-pagesddosscrapinghttps://postmortem.io/incidents/railway--2026-03-30--authenticated-user-data-cached/https://postmortem.io/incidents/railway--2026-03-30--authenticated-user-data-cached/Incident Report: March 30th, 2026 — Authenticated User Data Cached Author: Jacob Cooper Date: Mar 30, 2026 Impact Between 10:42 and 11:34 UTC on March 30, 2026, a configuration…Mon, 30 Mar 2026 00:00:00 GMTIncidentsecurity-incidentdata-exposurecdncachingmisconfigurationhttps://postmortem.io/incidents/supabase--2026-03-26--navigating-regional-network-blocks/https://postmortem.io/incidents/supabase--2026-03-26--navigating-regional-network-blocks/If you provide infrastructure that hosts applications for developers, you will eventually run into network blocks. ISPs, national firewalls, and automated abuse systems can block…Thu, 26 Mar 2026 00:00:00 GMTIncidentoutagenetworkdnscensorshipmulti-tenantthird-partyregulatoryhttps://postmortem.io/incidents/discord--2026-03-25--voice-outage-holster-pool-bottleneck/https://postmortem.io/incidents/discord--2026-03-25--voice-outage-holster-pool-bottleneck/This article is a collaborative piece by Bo Ingram, Senior Staff Engineer on Realtime Infrastructure, and Stephen Birarda, Senior Staff Engineer on Audio/Video infrastructure. The…Wed, 25 Mar 2026 00:00:00 GMTIncidentoutagevoicekuberneteselixirerlangconnection-poolingrate-limitingcapacitycascading-failurehttps://postmortem.io/incidents/mongodb--2026-03-25--atlas-admin-api-503-errors/https://postmortem.io/incidents/mongodb--2026-03-25--atlas-admin-api-503-errors/Intermittent 503 Errors on Atlas Admin API and Automation Tooling MongoDB Cloud Status incident, opened 2026 03 25, status: resolved Update (2026 03 25 21:31 UTC, investigating):…Wed, 25 Mar 2026 00:00:00 GMTIncidentoutagedatabaseatlasapiterraformcontrol-planehttps://postmortem.io/incidents/linear--2026-03-24--private-team-data-exposure/https://postmortem.io/incidents/linear--2026-03-24--private-team-data-exposure/Post mortem on Linear security incident on March 24th, 2026 Jamie Finnigan · April 06, 2026 On Tuesday March 24, a code change we deployed caused data from private teams to be…Tue, 24 Mar 2026 00:00:00 GMTIncidentsecuritydata-exposureaccess-controlpermissionsbughttps://postmortem.io/incidents/github--2026-03-11--addressing-githubs-recent-availability-issues/https://postmortem.io/incidents/github--2026-03-11--addressing-githubs-recent-availability-issues/Addressing GitHub's recent availability issues by Vlad Fedorov (@v fedorov gh) — March 11, 2026 Over the past several weeks, GitHub has experienced significant availability and…Wed, 11 Mar 2026 00:00:00 GMTIncidentoutagedatabasecachinggithub-actionsredisfailoverazure-migrationhttps://postmortem.io/incidents/aws--2026-03-07--eu-central-2-s3-error-rates/https://postmortem.io/incidents/aws--2026-03-07--eu-central-2-s3-error-rates/Increased S3 Error Rates (EU CENTRAL 2) AWS Health Dashboard timeline. Mar 7, 2026 19:53 UTC — We are investigating increased error rates in the EU CENTRAL 2 Region. Mar 7, 2026…Sat, 07 Mar 2026 00:00:00 GMTIncidentoutages3storagehttps://postmortem.io/incidents/bitbucket--2026-03-06--disrupted-bitbucket-availability/https://postmortem.io/incidents/bitbucket--2026-03-06--disrupted-bitbucket-availability/Disrupted Bitbucket availability Incident Report for Atlassian Bitbucket Postmortem Summary On March 6, 2026, between 02:19 UTC and 04:00 UTC, Bitbucket Cloud experienced an…Fri, 06 Mar 2026 00:00:00 GMTIncidentoutagehosting-providerrate-limitingdeploymentscalingcapacityhttps://postmortem.io/incidents/github--2026-03-03--availability-report-march-2026/https://postmortem.io/incidents/github--2026-03-03--availability-report-march-2026/In March, GitHub experienced four incidents that resulted in degraded performance across GitHub services. Incident 1: March 03, 18:59 UTC (1 hour 10 minutes) Between 18:46 and…Tue, 03 Mar 2026 00:00:00 GMTIncidentoutagecachingdatabasegithub-actionscopilotcredentialsthird-party-dependencyhttps://postmortem.io/incidents/elastic--2026-03-02--aws-bahrain-connectivity-disruption/https://postmortem.io/incidents/elastic--2026-03-02--aws-bahrain-connectivity-disruption/Connectivity disruption for AWS Bahrain (me south 1) Elastic Cloud (Public) Status incident, opened 2026 03 02, status: identified (ongoing as of this writing) Update (2026 03 02,…Mon, 02 Mar 2026 00:00:00 GMTIncidentoutageelasticsearchelastic-cloudawsregional-outagehttps://postmortem.io/incidents/cockroachdb--2026-03-01--aws-me-central-1-power-outage-fire/https://postmortem.io/incidents/cockroachdb--2026-03-01--aws-me-central-1-power-outage-fire/Cluster unavailability and degraded cluster operations in AWS me central 1 CockroachDB Cloud Status incident, opened 2026 03 01, status: resolved. Affected service: CockroachDB…Sun, 01 Mar 2026 00:00:00 GMTIncidentoutagedatabaseawspower-outageavailability-zonecluster-unavailabilitydisaster-recoveryhttps://postmortem.io/incidents/mongodb--2026-03-01--atlas-admin-api-legacy-version-failures/https://postmortem.io/incidents/mongodb--2026-03-01--atlas-admin-api-legacy-version-failures/MongoDB Atlas Admin API: Temporary failures for tools using older API versions MongoDB Cloud Status incident, opened 2026 03 01, status: resolved Update (2026 03 02 12:00 UTC,…Sun, 01 Mar 2026 00:00:00 GMTIncidentoutagedatabaseatlasapiterraformclideprecationhttps://postmortem.io/incidents/mongodb--2026-03-01--impaired-cluster-operations-me-central-1-me-south-1/https://postmortem.io/incidents/mongodb--2026-03-01--impaired-cluster-operations-me-central-1-me-south-1/Impaired Cluster Operations – AWS me central 1 (United Arab Emirates) and AWS me south 1 (Bahrain) MongoDB Cloud Status incident, opened 2026 03 01, status: monitoring Update…Sun, 01 Mar 2026 00:00:00 GMTIncidentoutagedatabaseatlasawsregional-outageavailability-zonehttps://postmortem.io/incidents/aws--2026-03-01--me-central-1-me-south-1-region-disruption/https://postmortem.io/incidents/aws--2026-03-01--me-central-1-me-south-1-region-disruption/Service disruption in the ME CENTRAL 1 (UAE) and ME SOUTH 1 (Bahrain) Regions AWS Health Dashboard timeline for the multi day disruption that began in the ME CENTRAL 1 (UAE)…Sun, 01 Mar 2026 00:00:00 GMTIncidentoutagedatacenterpower-outageavailability-zones3dynamodbdisaster-recoveryhttps://postmortem.io/incidents/aws--2026-02-25--us-east-1-ec2-metrics-status-check-delays/https://postmortem.io/incidents/aws--2026-02-25--us-east-1-ec2-metrics-status-check-delays/Intermittent Missing or Delayed EC2 Instance and Status Check Metrics (US EAST 1) AWS Health Dashboard timeline. Feb 25, 2026 18:14 UTC — We are experiencing intermittent missing…Wed, 25 Feb 2026 00:00:00 GMTIncidentoutageec2monitoringus-east-1https://postmortem.io/incidents/aws--2026-02-21--us-east-1-direct-connect-connectivity/https://postmortem.io/incidents/aws--2026-02-21--us-east-1-direct-connect-connectivity/AWS Direct Connect Connectivity Issues (US EAST 1) AWS Health Dashboard timeline. Feb 21, 2026 00:38 UTC — We are investigating connectivity issues impacting AWS Direct Connect…Sat, 21 Feb 2026 00:00:00 GMTIncidentoutagenetworkingdirect-connectus-east-1https://postmortem.io/shutdowns/cydoc--2026-02-21--why-i-shut-down-my-bootstrapped-health-ai-startup/https://postmortem.io/shutdowns/cydoc--2026-02-21--why-i-shut-down-my-bootstrapped-health-ai-startup/I was the Founder and CEO of Cydoc, a health AI startup, for seven years (April 2018 to August 2025). We achieved what many consider to be validation milestones: paying customers,…Sat, 21 Feb 2026 00:00:00 GMTShutdownsolo-founderbootstrappedhealthtechaisaasb2bshutdownno-cofounderhttps://postmortem.io/incidents/cloudflare--2026-02-20--byoip-bgp-withdrawal-outage/https://postmortem.io/incidents/cloudflare--2026-02-20--byoip-bgp-withdrawal-outage/Cloudflare outage on February 20, 2026 Authors: David Tuber, Dzevad Trumic Overview On February 20, 2026, at 17:48 UTC, Cloudflare experienced a significant service disruption…Fri, 20 Feb 2026 00:00:00 GMTIncidentoutagebgpbyoipconfig-errormagic-transitspectrumhttps://postmortem.io/incidents/railway--2026-02-18--ddos-cloudflare-bgp-outage/https://postmortem.io/incidents/railway--2026-02-18--ddos-cloudflare-bgp-outage/Incident Report: Feb 18 21 DDoS + Cloudflare Outage Overview Railway experienced a multi day incident combining DDoS attacks with upstream infrastructure failures. The incident…Wed, 18 Feb 2026 00:00:00 GMTIncidentoutageddoscloudflarebgpwafnetworkingmulti-dayhttps://postmortem.io/incidents/mongodb--2026-02-13--dns-resolution-failures-public-ip/https://postmortem.io/incidents/mongodb--2026-02-13--dns-resolution-failures-public-ip/DNS Resolution failures for public IP addresses within 31.89.0.0/24 MongoDB Cloud Status incident, opened 2026 02 13, status: resolved Update (2026 02 13, investigating): We are…Fri, 13 Feb 2026 00:00:00 GMTIncidentoutagedatabaseatlasawsdnsnetworking