Monday March 11, 2024

Issue summary: On March 11, 2024 from 2:43 PM PDT until 3:43 PM PDT some users in workspaces using International Data Residency (IDR) experienced issues with several Slack features, including messages loading or sending, channels appearing blank, canvases loading, huddles connecting, and trouble with some workflows were also noted. We identified a spike in error rates that was tied to a recent change to a backend service configuration logic. This change resulted in a cache discrepancy between services causing the errors. We rolled back the recent changes which immediately reduced error rates, resolving the issue for affected users. We are working on modifying the service handler in an effort to reduce the likelihood of this occurring in the future.

1:18 PM PST

The cause of the issue has been identified. We rolled back a recent change that resolved the issue for affected users. We appreciate your patience while we sorted this out and apologize for any interruption to your day.

3:51 PM PST

We're still working to identify the root cause of the issue, however, this is isolated to workspaces with International Data Residency (IDR) enabled. Affected users on desktop and mobile may be experiencing additional issues with loading channels, huddles, canvases, and some workflows.

3:30 PM PST

We're investigating issues users are having with sending and loading messages, including threads. We'll be back with an update as soon as we know more.

3:04 PM PST

Issue Summary: On March 11, 2024 at 3:00 PDT to March 12, 2024 at 12:00 AM PDT, some users had trouble completing workflows that contained either text or drop-down fields due to a bug that caused the cursor to revert to the previous field in the workflow. Upon investigation, we discovered a recent code change that introduced this bug. We rolled back the change and pushed a fix to all users resolving the issue. Thank you again for bearing with us in the meantime.

12:21 PM PST

We have deployed a fix to resolve the workflow issue, and this update is currently rolling out to everyone. To fetch the fix immediately, please refresh Slack with Cmd/Ctrl + Shift + R. Slack will reload, but won't sign you out. Thank you for bearing with us, we appreciate it.

8:08 PM PST

We believe we've identified the root cause of the issue, and are rolling back a recent change that will hopefully resolve the issue for those affected. Some customers may have success in the meantime with filling out workflow forms in a web browser. Our team are still working to fully resolve the issue though, and we'll be back in touch when we have more news to share.

5:56 PM PST

We are currently investigating an issue that is causing focus within workflow forms to erroneously jump back to the first field when entering text in any other field. We'll let you know as soon as we have another update, and we apologize for the hassle in the meantime.

5:03 PM PST