Some systems are experiencing issues

Stickied Incidents

2024-06-25

cPanel Wordpress update failures

An automatic Wordpress update has caused a couple of of sites hosted on cPanel to break. While this issue is not related to Hornet, we post this here as notification.

For more information, see https://core.trac.wordpress.org/ticket/61489. If your site is affected, you can fix it yourself by replacing wp-includes/default-filters.php with the correct one from the Github mirror (note the version!): https://github.com/WordPress/wordpress-develop/blob/6.5.5/src/wp-includes/default-filters.php. You can use the wordpress CLI tool to verify the file checksums in your installation.

  • It appears that an automated security patch applied by Patchman caused this issue, which is related to the use of an older Wordpress version. While they are working on a fix, we recommend all Wordpress users to upgrade their site to the latest available version.

    • 2024-06-07

    Backup Backup outage

    Multiple consecutive disk failure in the backup resulted in major outage in the backup service

    We're investigating a proper solution.

    Past Incidents

    2024-10-30

    Cloud Cloud platform outage

    An issue with the cloud platform is causing outages on vColo machines and internal services.

  • An issue with the cloud platform is causing outages on vColo machines and internal services.

    • 2024-06-25

    cPanel Wordpress update failures

    An automatic Wordpress update has caused a couple of of sites hosted on cPanel to break. While this issue is not related to Hornet, we post this here as notification.

    For more information, see https://core.trac.wordpress.org/ticket/61489. If your site is affected, you can fix it yourself by replacing wp-includes/default-filters.php with the correct one from the Github mirror (note the version!): https://github.com/WordPress/wordpress-develop/blob/6.5.5/src/wp-includes/default-filters.php. You can use the wordpress CLI tool to verify the file checksums in your installation.

  • It appears that an automated security patch applied by Patchman caused this issue, which is related to the use of an older Wordpress version. While they are working on a fix, we recommend all Wordpress users to upgrade their site to the latest available version.

    • 2024-06-07

    Backup Backup outage

    Multiple consecutive disk failure in the backup resulted in major outage in the backup service

    We're investigating a proper solution.

    2024-06-01

    Homeserver Matrix outage and performance issues

    Performance issues encountered during the regular cleanup are causing the homeserver to have severe performance issues.

  • Mitigations have had effect. Performance should be back to normal.

  • We have identified the issue and are working on deploying workarounds on our infrastructure.

  • We have reconfigured the homeserver to prioritise client requests. Clients should be somewhat functional, but messages between utwente.io and other homeservers experience significant delays (up to several hours).

    • 2024-05-08

    cPanel cPanel outage

    cPanel and websites hosted on Hornet were offline for some time due to an unexpected VM migration.

    2023-12-29

    cPanel cPanel performance issues

    Due to an external massive automated vulnerability scan cPanel experienced some performance issues. This started at about 01:45 and has been manually mitigated at around 09:20.