Back

Incident history

September

No incidents reported

August
FoxESS Inverters incorrectly curtailed batteries
Resolved

FoxESS inverters that were being curtailed during the time of a release on the 26th Aug. around 11:36 weren't able to correctly lift those limits causing suboptimal control.

August 28 at 10:03 AM CEST

Resolved after 0m

Degraded EV Charging Optimisation
Resolved

What happened: Between 16:42 and 07:38 CEST, charging control decisions for cloud connected EVs were temporarily not executed. Affected vehicles remained in their last known state for the duration of the incident.

Impact: Approximately 5% more charging sessions missed their target compared to baseline. The majority of charging sessions completed successfully. No data was lost, and all systems resumed normal operation automatically after the issue was resolved.

Resolution: A fix was deployed and normal operation was restored by 07:38 CEST on August 12.

August 12 at 11:21 AM CEST

Resolved after 0m

Xenon Dashboard maintenance
Scheduled for August 3 at 08:30 AM CEST - August 3 at 09:30 AM CEST
Scheduled

A scheduled maintenance window will take place on August, 3rd, from 08:30 to 09:30 CET. During this time, you may experience brief service disruptions.

August 3 at 08:30 AM CEST
Database Maintenance - Webhook Subscription Management
Scheduled for August 12 at 05:00 PM CEST - August 12 at 07:00 PM CEST
Completed

The maintenance work has been completed successfully.

There won't be any interruptions or rejections for the Webhook Subscription API anymore.

August 12 at 05:00 PM CEST
July
Errors while linking EVCS on C2C integration
Resolved

The bug was identified and fixed.

July 30 at 11:45 AM CEST

Resolved after 46m

Disruptions to Login Flow on Customer-Facing Frontends
Resolved

On 2026-07-22, a coordinated release across the customer-facing frontends caused widespread 401 authentication errors for users. The issue stemmed from a change in the authentication flow and an audience configuration change. The backend’s newly tightened validation logic rejected these tokens, causing users to be unable to log in or maintain their sessions.

Impact

Between 09:30 and 10:15 CEST, users attempting to authenticate were partially met with 401 errors. This disrupted normal frontend operations. While the primary issue was mitigated within 45 minutes, residual errors persisted for several hours due to browser-side caching of the previous frontend version.

Root Cause

The incident was caused by two intersecting factors:
* Backend validation: The backend was updated to implement stricter validation on JWT audience claims.
* Frontend refresh logic: The frontends' token refresh flow - when requesting a new access token - was returning multiple audiences in a way that did not match the strict expectations set by the backend.

The configuration change moved the frontends to a new audience, which triggered this mismatch, whereas the previous configuration had relied on legacy behavior that the backend was no longer implicitly supporting.

Detection

The incident was detected by automated alerts which fired shortly after the v5.13.0 rollout.

Resolution

The following steps were taken to mitigate and resolve the incident:
* Rollback: The frontend changes were rolled back to the previous stable versions for both frontends.
* Backend Configuration: The backend validation logic was amended to temporarily allow the legacy audience value, ensuring that existing sessions remained valid while the frontend could be safely updated.

July 22 at 10:04 AM CEST

Resolved after 1d