RSS Feed

Sydney - New Hypervisor

Scheduled on 27/04/2018 17:30:00 Status Scheduled Estimated finish 27/04/2018 18:00:00

Dear Dediserve Sydney users,

On 27th April 2018 we will be performing routine maintenance on our new blade in Sydney (HV4) to add it to the main host group to allow internal networking. This work will be short and performed out of hours in-region. You do not need to do anything, we will perform the work and power the host back on once complete.

As always, any questions, do let us know.

Related servers / services

RCA - Singapore HV1 issues

Scheduled on 18/04/2018 22:00:00 Status Resolved Fault / Issue Estimated finish 19/04/2018 06:00:00

Dear Dediserve Singapore users,

Some of you may have experienced trouble connecting to your VMs in our Singapore datacentre last night between 22:00GMT and 06:00GMT. Apologies for the interruption, below details the issue faced at that time.

What was the issue?:
At 22:00GMT on the 18th April the BL460c compute blade that handled the role of "Hypervisor 1" began reporting critical issues with its motherboard. As a result, we had to act immediately and shut down the Hypervisor to begin replacement and ensure integrity of service.

What was the root cause?:
A host (Hypervisor 1) motherboard critical state indicating imminent failure of hardware.

Why was there downtime?:
To ensure integrity of data we had to power down the host immediately whilst the data stored therein was still in a good and viable state, attempting to migrate whilst motherboard issues were flagging could have been disastrous if power failed during migration.

What has been done to address this?:
The previous blade has been replaced with an upgraded and new host, now with dual 12 core CPUs rather than dual 8 cores.

Why did this take the time it did?:
We had to first ensure the integrity of all stored data before ordering the host be replaced, our engineers then had to arrive on-site to perform the work. Once complete, we again verified the data before bringing the VMs back online.

What was the impact?:
The impact was purely VM unavailability, due to the diligence of Dediserve staff during this period the integrity of all data associated with this host was ensured.

Will this happen again?:
All Dediserve hardware is rigorously tested prior to deployment, and whilst every effort is made to avoid hardware failures - they do still occur. It is very rare to see a motherboard degrade instantly from OK to critical and we do not expect to see this issue again with this host.

Again, apologies for the issues experienced.

Related servers / services

RFO - Jakarta connectivity issues

Scheduled on 12/04/2018 19:30:00 Status Finished Estimated finish 12/04/2018 20:30:00

Dear Dediserve Jakarta users,

Some of you may have experienced connectivity issues at our Indonesia location yesterday,. Firstly, apologies for the interruption, our Datacenter provider experienced issue with their core routing following a large DDoS that was mitigated earlier in the day. Upstream issues are always a frustration as we have no direct control over networks outside of our own, however we worked with our provider minute by minute to update you on the progress of the works.

We will continue to monitor the situation and update you with any new findings in due course.

If you have any questions, as always, please get in touch.

Related servers / services