Monday March 11, 2024

Issue summary:
On March 11, 2024 from 2:43 PM PDT until 3:43 PM PDT some users in workspaces using International Data Residency (IDR) experienced issues with several Slack features, including messages loading or sending, channels appearing blank, canvases loading, huddles connecting, and trouble with some workflows were also noted.

We identified a spike in error rates that was tied to a recent change to a backend service configuration logic. This change resulted in a cache discrepancy between services causing the errors. We rolled back the recent changes which immediately reduced error rates, resolving the issue for affected users. We are working on modifying the service handler in an effort to reduce the likelihood of this occurring in the future.

1:18 PM PST

The cause of the issue has been identified. We rolled back a recent change that resolved the issue for affected users. We appreciate your patience while we sorted this out and apologize for any interruption to your day.

3:51 PM PST

We're still working to identify the root cause of the issue, however, this is isolated to workspaces with International Data Residency (IDR) enabled. Affected users on desktop and mobile may be experiencing additional issues with loading channels, huddles, canvases, and some workflows.

3:30 PM PST

We're investigating issues users are having with sending and loading messages, including threads. We'll be back with an update as soon as we know more.

3:04 PM PST