Utility Servers
We are aware users are experiencing performance issues with OASIS from our internal monitoring system and reports we have received from clients directly.
This will be observable when interacting with OASIS by saving and navigating around or an increased number of application errors presenting to users.
The team are currently working to identify the the cause of the performance issue and will provide an update to the incident soon.
OASIS Product Team
We identified the issue causing the performance issues with OASIS today. It relates to the weekly full back up processes in place for the databases. This is creating high data read load which is impacting the speed in which the OASIS application is able to communicate with the database. This has been exacerbated by additional patching required this morning which involved servers coming offline for updates and it takes time for the application to spool up.
Overall the performance is improving as the backup processes have moved onto smaller databases. We expect normal operations from around about 14:00. However, we will provide another update later this afternoon.
Thank you for you patience, we apologies for any interruption this may have caused.
OASIS Product Team
This issue has been marked as resolved as service performance returned to normal after further monitoring.
Thank you again for you patience, we apologies for any interruption this may have caused.
OASIS Product Team
We are aware users are experiencing performance issues with OASIS from our internal monitoring system and reports we have received from clients directly.
This will be observable when interacting with OASIS by saving and navigating around or an increased number of application errors presenting to users.
We have identified the issue is a result of backup overrun which is increasing load on the systems. The backups in question are the database backups which are managed by Azure Managed SQL Instance and have no control over the scheduling of these backups. We will raise a ticket with Rackspace and Microsoft understand any ongoing issues which are impacting on the performance of the backups running.
We can se that the backups are progress and expect the system to return to normal operation shortly. We will provide an update at 13:00.
OASIS Product Team
Following our investigations yesterday into the intermittent performance issues we made a number of optimisations in the evening which we will monitor to assess if they improve the overall performance during periods of heavy load on the the systems.
We will monitor this issue for the remainder of the week.
OASIS Product Support Team
We have continue to monitor the service performance over the last 5 days and can confirm it is working within performance thresholds under load.
We will mark this incident as resolved.
OASIS Product Team
We are aware users are experiencing performance issues with OASIS from our internal monitoring system and reports we have received from clients directly.
This will be observable when interacting with OASIS by saving and navigating around or an increased number of application errors presenting to users.
We have identified the issue is a result of backup overrun which is increasing load on the systems. The backups in question are the database backups which are managed by Azure Managed SQL Instance and have no control over the scheduling of these backups.
We can se that the backups are progress and expect the system to return to normal operation shortly. We will provide an update at 13:00.
OASIS Product Team
We have reviewed the backups and confirmed that OASIS has restored to normal operations. We will review internally whether we can adjust any scheduling or implement measure that can minimise the impact in the event of an over run in future.
Thanks you for your patience.
OASIS Product Support Team