❌

Normal view

Networking in BLR1 Region

16 September 2025 at 12:39

Sep 16, 17:39 UTC
Resolved - Our Engineering team has confirmed that our upstream providers have been able to mitigate the network connectivity issues in the BLR1 and SGP1 regions.

At this time users should not experience intermittent degraded performance and timeout errors with Droplet-based services to and from these regions.

If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.

Sep 15, 16:59 UTC
Update - Our Engineering team has observed significant improvements with the network latency and packet loss during peak hours today. This is a result of our upstream providers making some routing adjustments. We are carefully monitoring the network performance for the next 24 hours.

We will communicate any further relevant information as we have it. We apologize for the inconvenience in the meantime.

Sep 8, 22:29 UTC
Update - Significant submarine cable outages continue to impact multiple network carriers on the Indian subcontinent, with increased latency and packet loss to our BLR1 region occurring sporadically throughout the day.

On a positive note, our upstream providers have worked diligently over the past couple of days to minimize the impact of the loss of submarine capacity. As a result, we are now mainly seeing service degradation during the busier evening peak hours only.

For the moment, we have no updates to provide regarding when the situation might improve. Repair times for submarine cables are typically on the order of weeks or months. However, further short-term improvements may still be possible as upstream carriers work to re-balance traffic where feasible.

Separately, we continue to look into potential avenues for additional mitigations and will keep our customers aprised as we make progress in this area.

We apologize for the ongoing inconvenience created by this extraordinary situation and thank our customers for their patience.

Sep 6, 23:02 UTC
Monitoring - Our Engineering team confirms that multiple subsea cable cuts are impacting connectivity in the APAC region, which also affects traffic to Europe and the U.S. East Coast.

Traffic is being rerouted through alternate paths to maintain service continuity. As a result, users may experience higher latency and intermittent connectivity issues.

Our engineering team continues to monitor the situation closely and is working with upstream providers as repair efforts progress. We will share further updates as they become available.

We apologize for the disruption and appreciate your patience.

Sep 6, 18:49 UTC
Update - We are continuing to work on a fix for this issue.

Sep 6, 18:44 UTC
Update - Our Engineering team has implemented changes to optimize traffic routing in the BLR and SGP regions, addressing networking issues stemming from our upstream providers, which are affected by major submarine cable outages in the APAC region. Despite these adjustments, users may still encounter intermittent packet loss or connectivity issues when accessing resources in the affected areas. We are working with our upstream vendors to gain further insights and achieve a definitive resolution.

We apologize for any inconvenience caused.

Sep 6, 16:48 UTC
Identified - Our Engineering team has identified the cause of the issue impacting networking connectivity in BLR1 region to be with our upstream provider.

Our team is actively working on remediation steps. We will post an update as soon as we have more information.

Sep 6, 16:13 UTC
Investigating - Our Engineering team is currently investigating an issue impacting networking in BLR1 region. Users may experience network connectivity loss to Droplets and Droplet-based services, like Managed Kubernetes and Database Clusters.

We apologize for the inconvenience and will share an update once we have more information.

Droplet Creation

5 September 2025 at 14:42

Sep 5, 19:42 UTC
Resolved - From 18:53 to 19:15 UTC, our Engineering team identified an issue with the public Droplet API, resulting in difficulties in creating, accessing and listing Droplets via the Cloud Control Panel or API. Autoscaler and LBaaS APIs were also affected. Our team has fully resolved the issues, and as of 19:15 UTC, all services are operating normally.
We apologize for the inconvenience. If you are still experiencing any problems or have additional questions, then please open a support ticket within your account

EV jobs are starting to slip away

4 September 2025 at 05:00
The electric vehicle industry is cutting staff faster than smoke. More than 30,000 workers have lost their positions at electric-vehicle makers and related industries worldwide over the past year, according...

© Qilai Shen/Panos Pictures/Redux

Employees work on a Trumpchi brand vehicle production line at the Guangzhou Automobile Group Co. Ltd. (GAC) plant. Trumpchi, the Chinese auto brand established in 2010 and now preparing for U.S. sales, has become a topic of debate as owner GAC considers whether American consumers would love or hate the marque with a name similar to that of the controversial former U.S. president.

Creation Date:

Managed Database API Maintenance

3 September 2025 at 06:30

Sep 3, 11:30 UTC
Completed - The scheduled maintenance has been completed.

Sep 3, 07:30 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Sep 2, 22:10 UTC
Scheduled - Start: 2025-09-03 07:30 UTC
End: 2025-09-03 11:30 UTC

During the above window, our Engineering team will be performing maintenance on the Managed Databases API to enhance security, improve access control and enable better auditing and compliance. Please note that existing Databases and workloads will continue to run normally and will not be impacted.

Expected Impact:

We don’t anticipate any service disruptions during this window. Your existing databases and workloads will continue to run normally and will not be impacted.

In the event of an unexpected issue occurs, only control plane actions like provisioning new clusters, modifying configurations, and fetching database details will be impacted. The data-plane for connecting and running queries on your databases will be unaffected.

If an unexpected issue arises, we will endeavor to keep any impact to a minimum and may revert if required.

If you have any questions related to this event, please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

My mom and Dr. DeepSeek

2 September 2025 at 05:00
Every few months, my mother, a 57-year-old kidney transplant patient who lives in a small city in eastern China, embarks on a two-day journey to see her doctor. She fills...

© Illustrations by Ard Su for Rest of World

Block Storage Volumes and Kubernetes Clusters in NYC1 Region

Aug 29, 15:45 UTC
Resolved - From 14:24 to 14:41 UTC, our Engineering team identified issues affecting Block Storage Volumes in the NYC1 region. During this time, users may have experienced difficulties processing requests on Volumes. It was observed that this might have impacted Kubernetes clusters in the NYC1 region as well. Our team has fully resolved the issues, and as of 14:42 UTC, all services are operating normally.

We apologize for the inconvenience. If you are still experiencing any problems or have additional questions, then please open a support ticket within your account

AI robot dolls charm their way into nursing the elderly

27 August 2025 at 05:00
In her tiny sunlit Seoul apartment, Kim Jeong-ran sat on her bed, talking affectionately to a cloth doll perched on her lap.  “Hyodol, you’re my lovely granddaughter,” the 81-year-old said,...

© Jun Michael Park for Rest of World

Kim Jeong-ran, 81, speaks with her Hyodol, an AI-equipped companion robot, at her home in Gungdong, Guro-gu, Seoul, South Korea, Jul 23, 2025.

Droplet Creation

Aug 26, 20:01 UTC
Resolved - Our Engineering team has confirmed full resolution of the issue impacting Droplet creation in all regions. Users can now create Droplets without any issues.

We appreciate your patience while we worked to fix this issue. If you continue to experience any problems, please open a ticket from your account for further investigation.

Aug 26, 19:33 UTC
Monitoring - Our Engineering team has identified the reason behind the failed Droplet creates and implemented a fix to resolve the issue. Users should now be able to create Droplets.

We are actively monitoring the situation and will post an update as soon as the issue is fully resolved.

Aug 26, 18:30 UTC
Investigating - Our Engineering team is currently investigating an issue with Droplet creation in multiple regions. This is only affecting new accounts at this time. Existing users are not impacted.

Users with new accounts may experience an elevated failure rate when attempting to create Droplets during this time.

We apologize for the inconvenience and will share an update once we have more information.

SFO2 Power Maintenance

Aug 22, 04:54 UTC
Completed - Our Engineering team has confirmed that the issue caused by the unexpected power event has been fully resolved. Droplet connectivity in SFO2 should now be completely restored, and events like powering on/off should work as expected.

We apologize for any inconvenience caused. If you continue to experience any issues, please open a support ticket from within your account.

Aug 22, 01:25 UTC
Update - Our Engineering team has mitigated the issue with the unexpected power event and will continue to monitor this closely. Droplet connectivity in SFO2 should be restored, and events, such as powering on/off, should complete successfully now.

We apologize for the inconvenience this has caused. We will post updates if any further unexpected issues arise, and once this maintenance is fully completed. Thank you for your patience.

Aug 22, 00:35 UTC
Update - Our Engineering team is still working on the issue with some nodes in SFO2 going offline. Some users may still experience connectivity and event processing issues in SFO2.

We apologize for the inconvenience. We will post an update once we've confirmed that this issue is resolved.

Aug 21, 23:29 UTC
Update - During this maintenance, an unexpected power issue has occurred, which has caused multiple nodes to go down. Some customers with Droplets in SFO2 may notice that their Droplets are experiencing connectivity and event processing issues.

Our Engineering team is working to resolve this immediately, we will post an update here once we have more information.

Aug 21, 21:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Aug 21, 20:50 UTC
Scheduled - We are initiating an emergency power maintenance in one of our data center cages. This maintenance is critical and must be performed immediately to ensure infrastructure stability.

Expected Impact:

All devices run on redundant power. We do not expect any customer impact during this maintenance. If the redundant power feed experienced an issue during the course of the maintenance (which is unlikely), customers could see impact to existing resources housed in the affected cages, including Droplets, rDNS, and Object Storage. We will post updates if any unexpected outage occurs.

To help ensure a safe operation, we've temporarily reduced Droplet capacity in our SFO2 region. Customers who deploy Droplets in SFO2 may see some sizes unavailable or run into capacity errors for large deployments. This is temporary, so if you do encounter an error, we encourage you to try to deploy once more once the maintenance is complete.

Our engineering and operations teams are onsite and will be monitoring affected systems closely throughout the maintenance. Emergency notifications will be sent promptly if any critical impacts arise.

We appreciate your understanding as we work to resolve this situation as quickly and safely as possible.

If you have any questions related to this maintenance please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

❌