Timeline:
Start Time: 09/06/23 01:40 PM PT
End Time: 09/06/23 02:26 PM PT
Customer Impact:
Hearsay Engineering was performing a planned system upgrade when the system began to experience service issues due to a problem with the upgrade configuration. Some users experienced issues logging in, page errors, and failed API calls during this time.
Resolution:
Hearsay Engineering quickly responded to the incident and fixed the application by reverting to the last known healthy version of production.
Future Improvements:
Hearsay Engineering will add additional quality checks in our development test environments to better highlight this issue during future system upgrades.