All Systems are Online

Return to Statuspage

Event History

March 2026

Renew TLS certificates

» View Event Details | Created Tue, 17 Mar 2026 13:00:00 +0000

Scheduled What is happening? CHG0076670 CITZ MCS SILVER - Renew TLS certificates CHG0076671 CITZ MCS EMERALD - Renew TLS certificates CHG0076672 CITZ MCS GOLD - Renew TLS certificates CHG0076673 CITZ MCS GOLDDR - Renew TLS certificates Replace the TLS certs for the Kubernetes API and default router wildcard on each PROD cluster. When? - Silver / Emerald - Tue Mar 17th - Gold - Wed Mar 18th - Gold DR - Thur Mar 19th Starting at 6:00 AM and finishing before 9:00 AM Will there be an impact on the Platform apps? No, no downtime is expected at the time, for questions post in #devops-operations Do I need to do anything? No Check the #devops-alert channel for the announcement of when the change is complete and check the health of your app.
Posted: Tue, 17 Mar 2026 13:00:00 +0000

CHG0076634 CITZ - MCS GOLD - Drain and power down mcs-gold-app-07.dmz for decommissioning

» View Event Details | Created Wed, 11 Mar 2026 16:00:00 +0000

Resolved This has been completed
Posted: Fri, 13 Mar 2026 18:21:00 +0000

CHG0076031 STMS NET - INT - EXT03 MCS Load Balancer Bypass

» View Event Details | Created Sun, 22 Mar 2026 11:00:00 +0000

Scheduled What is happening? The network switch upstream from Silver and Gold is being removed from the path. When? Starting at Sunday March 22nd 4:00 AM and finishing before 9:00 AM. Will there be an impact on the Platform apps? Yes, all network traffic into or out of both Silver and Gold clusters will be down for 30 minutes. Do I need to do anything? Once connectivity is restored and the failover tests complete, verify your application is healthy and can connect to all the things it needs to. Check the #devops-alert channel for the announcement of when the change is complete and check the health of your app.
Posted: Sun, 22 Mar 2026 11:00:00 +0000

CHG0076480 CITZ MCS EMERALD - Power off GPU node to support VMware patching

» View Event Details | Created Tue, 17 Mar 2026 17:00:00 +0000

Scheduled One node in Emerald will be drained and powered off When? Starting at Tuesday, March 17th at 9:00 AM and finishing before 5:00 PM Will there be an impact on the Platform apps? Pods will be drained and rescheduled to other nodes. Pods that require a GPU will be down and unable to schedule as there is only a single GPU node. Do I need to do anything? No Check the #devops-alert channel for the announcement of when the change is complete and check the health of your app.
Posted: Tue, 17 Mar 2026 17:00:00 +0000

CHG0076421 - CITZ MCS SILVER - Move master-04 to a new rack

» View Event Details | Created Sun, 15 Mar 2026 14:00:00 +0000

Scheduled When? Sunday, March 15th at 6:00 AM and finishing before 9:00 AM Will there be an impact on the Platform apps? Master node drain is not likely to be disruptive but may cause some slowness with the API. Do I need to do anything? No action required. Check the #devops-alert channel for the announcement of when the change is complete and check the health of your app.
Posted: Sun, 15 Mar 2026 14:00:00 +0000

CHG0076413 - CITZ MCS SILVER - Move 3 nodes to a new rack

» View Event Details | Created Tue, 10 Mar 2026 17:00:00 +0000

Resolved This has been completed
Posted: Fri, 13 Mar 2026 18:20:00 +0000

CHG0076144 - CITZ MCS SILVER/EMERALD - Replace end of life NetApp

» View Event Details | Created Sat, 07 Mar 2026 16:00:00 +0000

Resolved Given all the excitement this week, we're canceling any more Silver node drains as part of last weekends NetApp upgrade for this week. We'll aim to resume on Monday Mar 23 and try some new tricks to slow the drain process to hopefully improve the experience. But slow volume mounts may continue to happen.
Posted: Fri, 13 Mar 2026 18:19:00 +0000

Subscribe to Updates