Update - No changes have been observed in the last 24 hours. Due to the scale and impact of this incident however, we will continue to maintain heightened monitoring throughout the next 48 hours.
Sep 20, 09:12 CEST
Update - We can confirm that all systems still look good and are performing as expected.
Sep 19, 13:10 CEST
Monitoring - A fix has been implemented and we are monitoring the results.
Sep 19, 07:32 CEST
Update - All systems are back online, and are performing as expected. We are still working on adding some more resiliency, but none of this is going to be noticeable to customers.

The backlog of server scan/detection data processing remains and is currently estimated to take at least 6 more hours to process.
Sep 19, 06:29 CEST
Update - The Data Processing Backend is being brought back online in phases too.

Please note that there will currently be a significant backlog in processing of data sent from servers, causing data in the Portal to be out-of-date. This will automatically be resolved in the next several hours.
Sep 19, 06:18 CEST
Update - We are currently gradually bringing services back online. The Portal and Customer API are currently operating again, and we are closely monitoring their resumption of service. Work on the other components is continuing in the meantime.
Sep 19, 06:10 CEST
Update - We hope to resume service within the next two hours.
Sep 19, 05:01 CEST
Update - The work is still ongoing. We will be switching to updates every two hours.
Sep 19, 03:01 CEST
Update - We are currently performing a series of additional backups and expanding our redundant infrastructure. In light of ensuring the most risk-free form of operation, we want to complete all of this before we resume service.

Rest assured that we can confirm there is no data loss involved in this incident, nor do we expect to be at risk of any at the moment. The current downtime is purely by choice to give ourselves room for necessary precautions for future incidents.

Another update will be provided in an hour.
Sep 19, 02:04 CEST
Update - Due to the current pace of verification work, we will be switching to hourly updates on this incident.
Sep 19, 01:04 CEST
Update - As before, our stability verification is still ongoing. Unfortunately we are unable to provide an ETA at this time.

Although we naturally understand the problems this is causing for our customers, we want to emphasize that we feel this is currently the most prudent course of action to prevent further issues and further strengthen the platform going forward. We sincerely apologize for the inconvenience.

We will provide another update on this incident within 30 minutes.
Sep 19, 00:34 CEST
Update - Our stability verification is still ongoing. Unfortunately we are unable to provide an ETA at this time.

We will provide another update on this incident within 30 minutes.
Sep 19, 00:07 CEST
Update - Damaged components of the stack have been replaced. Before we resume service, we are running additional safety and hardening checks to verify the continued stability of the cluster.

We will provide another update on this incident within 30 minutes.
Sep 18, 23:41 CEST
Identified - We have identified our database cluster as experiencing a major outage. Work is currently in progress to resolve this. Unfortunately we are unable to provide an ETA at this time.

We will provide another update on this incident within 30 minutes.
Sep 18, 23:32 CEST
Update - The Data Processing Backend cluster is also affected. We are still investigating.
Sep 18, 23:17 CEST
Investigating - The Portal and Customer API are experiencing issues with availability. We are investigating the issue.
Sep 18, 23:10 CEST
Portal ? Operational
Customer API ? Operational
Agent API ? Operational
Definitions API ? Operational
Licensing API ? Operational
Data Processing Infrastructure ? Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Sep 21, 2019

No incidents reported today.

Sep 19, 2019
Completed - Due to our recent issues on the platform, we are cancelling this maintenance. We will reschedule in the near future.
Sep 19, 09:39 CEST
Scheduled - We will be performing hardware upgrades on our Portal cluster in the morning of 20 September starting from 10:00 (CEST). During this upgrade the Portal will be unavailable for a maximum timespan of 10 minutes.
Sep 13, 17:21 CEST
Sep 18, 2019
Resolved - The issue has been fully resolved.
Sep 18, 13:02 CEST
Monitoring - The problem is resolved and all systems are operational again. We are keeping a close eye on our monitoring to watch for any potential regression.
Sep 18, 11:01 CEST
Update - The Portal and Customer API are back online. We are still working on the data processing backend cluster.
Sep 18, 10:51 CEST
Identified - We have identified a problem causing the Portal to be unavailable. We are currently working on resolving the problem.
Sep 18, 10:38 CEST
Sep 17, 2019

No incidents reported.

Sep 16, 2019
Resolved - All systems are fully operational again and working as intended.
Sep 16, 09:56 CEST
Identified - Currently we are seeing a high volume of detection and task data that is in the backlog for processing. As a result of this the feedback between the agents and Portal is slow, making it potentially seem unresponsive.

We are working to improve this responsiveness and the accuracy of the data displayed in the Portal regarding both detections and their resolution state.
Sep 11, 16:08 CEST
Sep 15, 2019

No incidents reported.

Sep 14, 2019

No incidents reported.

Sep 13, 2019

No incidents reported.

Sep 12, 2019

No incidents reported.

Sep 10, 2019

No incidents reported.

Sep 9, 2019

No incidents reported.

Sep 8, 2019

No incidents reported.

Sep 7, 2019

No incidents reported.