© Joanne Lee/Qilai Shen/Panos Pictures/Redux/Rest of World
Nov 18, 19:33 UTC
Resolved - Our Engineering team has confirmed complete resolution of the issue that was impacting Spaces Object Storage, DigitalOcean Container Registry, and App Platform, across all regions.
From 16:52 UTC - 18:41 UTC, users may have experienced increased error rates when accessing Spaces objects, interacting with the DigitalOcean Container Registry and while creating/deploying Apps with App Platform. Functionality is completely restored and all operations are succeeding normally.
If you continue to experience any issues with these services please submit a ticket to our customer support team for assistance. Thank you for your patience.
Nov 18, 19:07 UTC
Monitoring - Our Engineering team has completed the mitigation efforts and a fix is now deployed in all regions.
As of 18:41 UTC, error rates have returned to normal and users should no longer experience issues accessing, creating, or performing updates on their existing services with the impacted products.
We are monitoring the situation and will provide an update shortly.
Nov 18, 18:32 UTC
Investigating - Our Engineering team is investigating an issue impacting Spaces Object Storage, DigitalOcean Container Registry, and App Platform, across all regions.
Beginning at 16:52 UTC, users may have started experiencing 500 errors when trying to access and perform operations with their Spaces bucket, as well as increased failure rates when pushing to Container Registries and creating/deploying Apps.
Our team has started to apply mitigations to correct the issue, which are rolling out across all regions.
We'll provide another update once that process has completed.
Nov 18, 21:42 UTC
Resolved - Our Engineering team has confirmed that the issues with Authoritative DNS resolution across multiple regions has been fully resolved. DNS queries should now be resolving normally.
If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.
Nov 16, 22:52 UTC
Update - We are continuing to monitor our Authoritative DNS Service and have seen improvements since implementing the fix. The engineering team is waiting for full confirmation that the issue is corrected before we resolve this incident completely.
If you are facing any issues with our Authoritative DNS Service, please reach out to our support team.
Nov 15, 22:05 UTC
Monitoring - Our Engineering team has implemented a fix to resolve the issues with Authoritative DNS Resolution across multiple regions and is currently monitoring the situation.
We will continue to monitor this at our end and will share an update once the problem is resolved completely.
Nov 15, 11:12 UTC
Identified - Our Engineering team has identified the cause of the issue impacting Authoritative DNS Resolution across multiple regions and is actively working on a fix. We will post an update as soon as we have more information.
Nov 15, 08:33 UTC
Update - We are actively investigating the ongoing issues with Authoritative DNS Resolution across multiple regions.
We have engaged multiple teams to investigate the issue, and we apologize for the continued inconvenience. We will provide additional updates as soon as more information becomes available.
Nov 15, 04:03 UTC
Investigating - Our Engineering team is investigating an issue with intermittent failures and increased latency in DNS resolution across multiple regions.
During this time, users may experience issues with DNS resolution, or see errors returned when querying DNS records which are hosted on the DigitalOcean authoritative DNS infrastructure.
We apologize for the inconvenience and will share an update once we have more information.
© Photography by George Etheredge for Rest of World
© Ruwangi Amarasinghe for Rest of World
Nov 13, 20:44 UTC
Resolved - From 19:06 - 19:14 UTC, our Engineering team observed an issue impacting Authoritative DNS Resolution globally. During this time, users might have experienced latency or resolution issues while querying DNS records hosted on our authoritative DNS infrastructure.
The Engineering team swiftly identified and resolved the issue, and as of 19:14 UTC, all DNS queries should now be resolving normally.
We apologize for the inconvenience and if you are still experiencing issues or have any additional questions, please open a support ticket from within your account.
Nov 13, 13:43 UTC
Completed - The AMS3 Power Maintenance which was previously scheduled at 2024-11-14 20:00 UTC has been cancelled. We will notify you via email and a new maintenance post on status.digitalocean.com with the updated date and timings for this maintenance.
We apologize for any inconvenience and thank you for your understanding.
If you have questions or concerns about this maintenance, please reach out to us by opening up a ticket on your account.
Nov 12, 13:48 UTC
Scheduled - Start: 2024-11-14 20:00 UTC
End: 2024-11-15 06:00 UTC
Hello,
During the above window, our Engineering team will be performing maintenance on redundant upstream electrical systems in order to improve reliability in our AMS3 region.
Expected Impact:
Power systems are redundant and we don’t expect to see any downtime, however, in the very unlikely situation that we lose power to both supplies, users may experience disruption with the following services or for a brief period:
Networking
Backups
Snapshots
Droplet create & restore operations
We will endeavor to keep any downtime to a minimum for the duration of the change.
If you have any questions related to this issue please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket
Thank you,
Team DigitalOcean
© Photography by Muhammad Fadli for Rest of World
Nov 12, 22:06 UTC
Resolved - From 20:03 - 20:08 UTC, our Engineering team observed an issue with internal DigitalOcean network connectivity in the NYC3 region. During this time, users might have experienced errors for control plane operations for services in NYC3, such as creating and deleting services, or issuing updates to existing services for products like App Platform Apps, DOKS & Managed Databases.
The incident did not impact public or private network connectivity for customer services.
We apologize for the inconvenience and if you are still experiencing issues or have any additional questions, please open a support ticket from within your account.
© Ernest Ankomah/Getty Images
© Sanjit Das/Bloomberg/Getty Images
Nov 13, 11:10 UTC
Completed - The SFO3 Network Maintenance which was previously scheduled at 2024-11-13 10:00 UTC has been cancelled. We will notify you via email and a new maintenance post on status.digitalocean.com with the updated date and timings for this maintenance.
We apologize for any inconvenience and thank you for your understanding.
If you have questions or concerns about this maintenance, please reach out to us by opening up a ticket on your account.
Nov 13, 10:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Nov 11, 10:20 UTC
Scheduled - Start: 2024-11-13 10:00 UTC
End: 2024-11-13 14:00 UTC
During the above window, our Networking team will be performing maintenance on core switches in our SFO3 datacenter as part of network upgrades.
Expected Impact:
These upgrades are designed and tested to be seamless, and we do not expect any impact to customer traffic due to this maintenance. Should an unexpected issue arise, a possible outcome would be temporary loss of connectivity or increased latency for a brief period of time. We will endeavor to keep any such impact to a minimum.
If you have any questions related to this issue please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket
© Ruwangi Amarasinghe for Rest of World
© Samsul Said/Bloomberg/Getty Images
Login
