status.prohosting24.de Open in urlscan Pro
168.119.121.164  Public Scan

Form analysis
0 forms found in the DOM

Text Content

Some systems are experiencing issues
 * Web
   
   prohosting24.de
   Operational
   web.prohosting24.de
   Operational
   app.prohosting24.de
   Operational

 * DNS
   
   ns1.prohosting24.de / ns1.prohosting24.eu
   Operational
   ns2.prohosting24.de / ns2.prohosting24.eu
   Operational

 * Infrastructure
   
   Network
   Operational
   fra01
   Operational

 * Storage
   
   CEPH cluster
   Operational
   Backup server
   Partial Outage

 * Docker
   
   Host 1
   Operational
   Host 2
   Operational

 * Hypervisor
   
   ph24-7
   Operational
   ph24-8
   Operational
   ph24-9
   Operational
   ph24-10
   Operational
   ph24-12
   Operational
   ph24-13
   Operational
   ph24-14
   Operational
   pve1
   Operational
   pve2
   Operational
   pve3
   Operational


STICKIED INCIDENTS

2ND DECEMBER 2023

Backup server Backup RAID Rebuild
10 hours ago

Our backup server's RAID is currently undergoing enhancements to increase
performance and accommodate increased storage demands. We have expanded the
array by adding two 18TB datacenter SAS Drives.

All existing backups can still be restored anytime.

During this process, VM backups are temporarily paused. We appreciate your
understanding as we work to complete the upgrades swiftly.


PAST INCIDENTS

2ND DECEMBER 2023

Backup server Backup RAID Rebuild
10 hours ago

Our backup server's RAID is currently undergoing enhancements to increase
performance and accommodate increased storage demands. We have expanded the
array by adding two 18TB datacenter SAS Drives.

All existing backups can still be restored anytime.

During this process, VM backups are temporarily paused. We appreciate your
understanding as we work to complete the upgrades swiftly.

29TH NOVEMBER 2023

pve2 Node Failures
4 days ago

One of our hypervisor containing VMs and Storage Cluster services has failed. We
are evacuating the host.

We have fixed the system succesfully.

4 days ago

23RD NOVEMBER 2023

Network Internal Gateway down
9 days ago

Unfortunately, the internal gateway was not accessible due to an incorrect VRRP
configuration, which had an impact on internal services and our homepage.

12TH OCTOBER 2023

CEPH cluster Degraded NVMe CEPH performance
2 months ago

We are investigating ongoing performance issues. Some measures have already been
implemented to decrease the performance impact.

We have identified the cause again and taken further measures to remedy the
performance degradation. The performance degradation has been resolved.

2 months ago

We are investigating new performance issues and already implemented further
measure to increase the client performance.

2 months ago

We have successfully resolved the cluster performance degradation and are
actively implementing enhanced monitoring for proactive issue detection for
ongoing operation improvement.

2 months ago

8TH MAY 2023

ph24-12 ph24-12 down
7 months ago

The hypervisor seems to be offline

A bug in the running kernel version caused the system to kernel panic, we have
patched the kernel and rebooted the system.

7 months ago

17TH DECEMBER 2022

Crashed Hypervisor ph24-11
a year ago

The hypervisor ph24-11 is not responding due to IO related issues with the hosts
software raid.

There have been fan control related issues which lead to a crashing system. We
have adjusted the fan control configuration to suite our needs.

a year ago

The system has been evacuated and we are conducting further investigations to
ensure that this problem does not occur again.

a year ago

16TH NOVEMBER 2022

Crashing VMs
a year ago

We are currently investigating an issue where several VMs have crashed.

The issue has been resolved

a year ago

22ND OCTOBER 2022

ph24-9 Malfunction of hypervisor ph24-9
a year ago

We are working on restoring the functionality of the affected guests and of the
hypervisor.

The Problem has been resolved

a year ago

15TH AUGUST 2022

prohosting24.de Backend errors
a year ago

We are currently implementing a fix which should make the web app operational
again.

All problems have been resolved now.

a year ago

We stumbled across some issues with restored tables, those tables are going to
be restored again manually.

a year ago

The Problem has been resolved

a year ago

5TH APRIL 2022

ns2.prohosting24.de / ns2.prohosting24.eu Nameserver 2 shutdown
2 years ago

We performed a controlled shutdown of the secondary name server ns2 due to a
detected inconsistency in replicated DNS zones. We are currently investigating
why axfr zone transfer is not working as expected.

All dns zones are still resolveable through the primary nameserver ns1.

We have redeployed the secondary name server. All DNS zones are now available
and consistent on both nameservers.

2 years ago

4TH APRIL 2022

Network 5.181.151.0/24 offline
2 years ago

The provider of the subnet 5.181.151.0/24 has interrupted the routes.

I have assigned a new IP address to the affected servers. If the server is not
accessible via this address after a reboot, the address may have to be adjusted
manually using the noVNC console.

All customers have been migrated to other IP-Address spaces.

a year ago

3RD APRIL 2022

Backup server Proxmox backup server peformance issues
2 years ago

Current migration of data between raid arrays on the backup server provided by
our housing provider is causing performance issues that result in the inability
to create or restore backups at this time. After the data migration is complete,
the backup creation and restoration tasks are performed much faster than before.

The backup server is fully operational.

2 years ago

The Backupserver is now beeing migrated back to a raid 10 array.

2 years ago

The migration has finished successfully.

2 years ago

2ND APRIL 2022

CEPH cluster Performance issues due to maintenance
2 years ago

Performance issues detected

Migration of data has finished successfully. Everything is up and running again.

2 years ago

We have temporarily added a new object store daemon to ph24-8 and managed to get
the crashed ph24-8/9 object store daemon working again. The ph24-5 hypervisor
was successfully taken out of service.

Migration of data that is still in progress may affect the performance of the
Ceph cluster.

2 years ago

The ph24-8/9 object store daemon crashed while we were performing a data
migration to other object stores. This failure resulted in unavailability of 25
pg's. The data was not lost, but was unavailable for a few minutes.

2 years ago

27TH MARCH 2022

Network Network unavailable for subnet 5.181.151.0/24
2 years ago

All services from the network 5.181.151.0/24 are unreachable

The owner of the IPv4 resources 5.181.151.0/24 removed the route object for the
subnet because of an abuse report regarding fraudulent content being hosted at
web.prohosting24.de.

The fraudulent content has been removed and the connectivity was restored by
recreating the old route object.

2 years ago


Powered by Cachet. Times are shown in CET.

 * Dashboard
 * Subscribe