Viking

Incident Status
Resolved
Affected Services
Incident Updates
Viking
Wed Nov 30 2022 - 20:48:40

The scratch (lustre) filesystem is now back up and available again.

The system is still generating a lot of errors despite the measures that were taken, so further periods of slowness may be expected. Our service provider will continue to closely monitor the filesystem for any issues, and is in communication with the hardware vendor regarding further steps.

Viking filesystem issues
Thu Dec 1 2022 - 10:47:18

As you are aware, the scratch filesystem is still offline. Our service provider has made some changes that should hopefully make the system a little more resilient to hardware errors, and is currently running consistency checks on the data. These checks take some time to run, but we're hoping that scratch should be available again this evening,

Viking filesystem issues
Fri Dec 2 2022 - 10:00:20

The scratch (lustre) filesystem is now back up and available again this morning.
Unfortunately, the system is still generating a lot of errors despite the measures that were taken yesterday, so further periods of slowness are to be expected. Our service provider will continue to closely monitor the filesystem for any issues, and is in communication with the hardware vendor regarding further steps.

Issues Resolved
Fri Dec 9 2022 - 09:53:03

We do not anticipate any further issues with this service.

The issues are now resolved.

Viking scratch filesystem
Mon Dec 19 2022 - 08:45:27

The Viking scratch filesystem is having further issues

We are aware of the problem and will work with our service provider to get to the bottom of it.

We'll let you know when we have an update. Sorry for the ongoing frustration with this.

Viking scratch filestore
Mon Dec 19 2022 - 10:00:43

We've been informed by our service provider that the scratch filesystem should now be up and running as normal, so please go ahead and submit jobs as usual.

Let us know if you notice any further instability - we will also be monitoring it!

Viking disk issues
Thu Jan 12 2023 - 12:13:07

We do not anticipate any further issues with this service.

The issues are now resolved.