melon.org system status

In addition to status.melon.org, rolling.melon.org and kiwano.melon.org have been fully restored. deadly.melon.org has also been partially restored; because the Gallery 2 site spotted.melon.org which was integrated with deadly.melon.org has not yet been restored, the integration functionality has not been restored either.

Further updates will follow as the remaining functionality is restored.

In mid-late May, an OS upgrade on the various melon.org containers tried to switch to systemd, while the kernel on the host server did not support this version of systemd. This permanently wedged a few containers, which had to be rebuilt, and have their files copied over. This also led to about a day of intermittent outage on the host server, as verious attempts to unwedge the server were made. Since then, the special config line to tell the OS to continue to use sysvinit instead of systemd has been deployed on all the servers, host and container alike, and the upgrade to jessie has been made. Most services were restored within a couple of days, but some of the CMS-based webservices (like wordpress) refused to restore cleanly from their backups.

Owing to other things to do, restoring wordpress sites got a low priority, and the first restoration has only just happened (this site: status.melon.org). Updates will be provided as the other CMS-based webservices get restored.

Additionally, there are problems with SSH. healthy.melon.org is inaccessible by SFTP, and logging from horned.melon.org to itself via SSH generates spurious error messages in the terminal. These issues will be addressed after the CMS-based webservices are restored.