Wednesday March 27, 2024

Incident

Issues loading Slack for less than 1% of customers

Issue summary:
On March 27, 2024 from 8:13 AM PDT until 3:38 PM PDT, some users experienced errors when attempting to login, send messages, open channels, or threads.

We traced this issue back to a subset of errors that occurred within a set of cross-functional databases that are responsible for basic user features in Slack. As an immediate step to mitigate the issue, we automatically performed a restore of the backups of these affected databases.

Once the process of restoring these backups was completed, the databases began successfully processing user requests, fully restoring the functionality of the affected features. We are working to put safeguards in place to reduce the likelihood of this issue occurring again in the future.

1:45 PM PST

We have restored the affected databases and are now fully functional again.
We apologize for any inconvenience to your day and appreciate your patience while we worked to restore functionality.

3:53 PM PST

We're continuing to work on restoring affected databases to return impacted workspaces and users to full functionality. Unfortunately this will continue to take some time, however we are confident the issue will be resolved in full.

We'll be back with another update as soon as the process is complete and the issue is resolved. Thank you for continuing to bear with us.

1:57 PM PST

We're working on restoring backups of the affected databases to get things back to normal as quickly as possible.

We'll continue to share more information as it becomes available. Thanks for sticking with us as we continue to work towards a fix.

9:58 AM PST

We have identified an issue with a specific database and are currently looking into solutions.

The error identified impacts loading Slack on the app, web browsers and sending messages, for less than 1% of Slack customers.

The team continues to investigate this issue, and we'll report back as more information becomes available.

9:02 AM PST

We're investigating an issue where some customers may be unable to load or send messages within Slack. We'll be back with an update as soon as we know more.

8:32 AM PST

Services affected

Connectivity

Messaging

Status

Incident