OASIS Increase in Error Rate

Incident
January 14, 10:16pm

OASIS Increase in Error Rate

Status: Closed
Start: January 14, 10:08pm
End: January 14, 10:16pm
Duration: 8 minutes
Affected Components:
OASIS Application OASIS Analytics OASIS Third Party Components SQL Managed Instance (UK West) Cloudflare Workspaces Report Builder SQL Managed Instance (UK South) Web Application Servers Text Magic Email Report Books Dashboarding Utility Servers Blob File Storage
Update

January 14, 10:08pm

January 14, 10:08pm

We are aware users are experiencing increased error messages with OASIS from our internal monitoring system.

The team identified routine internal maintenance process not operating as expected.

OASIS Product Team

Resolved

January 14, 10:16pm

January 14, 10:16pm

All systems now operational.

The root cause was a scaling operation which triggered an SQL instance restart, an operation which often happens during Microsoft's maintenance window without service interruption.

An ongoing process triggered a protection mechanism called rapid fail protection disabled the applications as a result of excessive error reporting.

We apologise for any inconvenience.

OASIS Product Team