Sansform - Storage users in US-West-2 experiencing increased latency on storage requests – Incident details

Experiencing partially degraded performance

Storage users in US-West-2 experiencing increased latency on storage requests

Resolved
Degraded performance
Started 14 days agoLasted about 9 hours

Affected

Supabase

Operational from 4:00 PM to 4:00 PM, Degraded performance from 4:00 PM to 8:26 PM, Operational from 8:26 PM to 12:40 AM

Supabase → Storage

Operational from 4:00 PM to 4:00 PM, Degraded performance from 4:00 PM to 8:26 PM, Operational from 8:26 PM to 12:40 AM

Updates
  • Resolved
    Resolved

    All residual jobs have drained. Storage performance and job activity is normal.

  • Update
    Update

    Job queues continue to drain. We will actively monitor until they are complete.

  • Monitoring
    Monitoring

    Backlog is being effectively processed and operations have returned to normal. We continue to monitor the performance in us-west-2.

  • Update
    Update

    We are seeing improvement in the performance of us-west-2 after implementation of our mitigation strategies. Storage operation is returning to normal. We will continue to monitor performance in this region.

  • Update
    Update

    We have implemented further mitigations and are tracking their progress. We continue to actively work this issue.

  • Update
    Update

    The team is still working on a solution, and mitigation work is underway.

  • Update
    Update

    We are implementing load mitigation strategies to improve the performance of storage requests in US-West-2.

  • Identified
    Identified

    Users in US-West-2 are seeing increased latency on storage requests. The team has identified the issue and is working on a solution.