East Coast DC storage issue

Incident Report for Kaltura

Resolved

Service has been restored in the East Coast data center and we’re currently monitoring.
Posted May 05, 2019 - 15:56 UTC

Update

Kaltura's technical teams are still working to resolve the current issue in the East Coast data center.
Traffic is still being served from the West Coast data center and there's no impact on Kaltura's services.
As part of the Data Center recovery process, crucial maintenance work  is scheduled for Sunday, May 5th.
A separate maintenance notification will be sent out.
Posted May 02, 2019 - 14:37 UTC

Update

Intermittent playback issue on West Coast DC is resolved.
Traffic is being served from the West Coast data center and there's no impact on Kaltura's services at the moment.
Posted May 01, 2019 - 14:47 UTC

Monitoring

A fix has been implemented and we are monitoring the results.
Posted May 01, 2019 - 14:23 UTC

Update

We are continuing to work on a fix for this issue.
Posted May 01, 2019 - 14:23 UTC

Identified

We have problems with intermittent playback on our West Coast DC.
More updates will follow on this page.
Posted May 01, 2019 - 14:16 UTC

Update

Kaltura's technical teams are still working with the storage vendor to resolve the issue in the East Coast data center.
Traffic is still being served from the West Coast data center and there's no impact on Kaltura's services at the moment.
Posted Apr 29, 2019 - 14:52 UTC

Update

The issue with upload and transcoding has been resolved completely.

Also, please note that backup Live stream service links are still not available.
Posted Apr 26, 2019 - 21:00 UTC

Update

This is to update you about current platform status.

Traffic is handled by one DC at the moment so there could be some performance degradation for such services as:
- Upload
- Transcoding

Also please note that backup Live stream service links are not available at the moment as well.
Posted Apr 25, 2019 - 08:12 UTC

Update

We are continuing to monitor for any further issues.
Posted Apr 25, 2019 - 07:40 UTC

Update

Currently, East Coast DC is unstable. There is no impact on the service, however, ingest and transcoding can take longer for all customers.
We are continuing to monitor further.
Posted Apr 24, 2019 - 19:45 UTC

Update

After the traffic was shifted to the East Coast, the issue with storage subsystem reoccurred.
Thus, the traffic was switched back to the West Coast DC.
We are continuing to monitor further.
Posted Apr 24, 2019 - 14:50 UTC

Monitoring

A fix has been implemented and we are monitoring the results.
Posted Apr 24, 2019 - 07:46 UTC

Identified

Kaltura identified an issue with the East Coast data center. All traffic was shifted to the second one.
Users could face DropFolder(FTP) service issues during 06:00-06:30 UTC.
Posted Apr 24, 2019 - 06:52 UTC

Update

We are continuing to investigate this issue.
Posted Apr 24, 2019 - 06:32 UTC

Update

We are currently checking an issue related to upload. More details to follow
Posted Apr 24, 2019 - 06:26 UTC

Investigating

Kaltura is currently investigating an issue with the production environment.
More updates will follow on this page.
Posted Apr 24, 2019 - 05:55 UTC
This incident affected: Transcoding, Live, and Playback.