Nov 22, 17:44 UTC
Resolved - From 09:05 to 09:50 UTC (November 21), our Engineering team observed an issue with Droplet creation.

During this time, users may have experienced intermittent errors while creating the Droplets via the Cloud Panel and API. Users should no longer be experiencing these issues.

We apologize for the inconvenience. If you have any questions or continue to experience issues, please reach out via a Support ticket on your account.

Nov 25, 19:20 UTC
Resolved - Given the absence of outages for the Support Portal, we will now resolve this incident. Our Engineering team will continue to work with our vendor to ensure continued stability of this service. If we observe further outages, we will communicate those to our users via new updates on our status page.

We sincerely apologize and thank you for your patience as we worked through this issue. In case of any questions or concerns, please open a ticket with our Support team.

Nov 25, 15:56 UTC
Update - Our Engineering team continues to work with our vendor to find a solution, but we have not observed any further outages of our Support Portal over the last 48 hours. We will provide additional updates as information becomes available. If an outage does occur, users may still contact us via the form here: https://www.digitalocean.com/company/contact/support

Thank you for your patience. We will post an update as soon as more information becomes available.

Nov 22, 03:49 UTC
Update - Our Engineering team continues to work with our vendor in order to resolve the issue with users accessing the Support Portal. The issue has been escalated and we are awaiting feedback.

As a reminder, if users need to reach out, they can utilize the form here as a workaround:

https://www.digitalocean.com/company/contact/support

Thank you for your patience. We will post an update as soon as further information becomes available.

Nov 21, 15:40 UTC
Investigating - Our Engineering team has observed issues with our Support Portal. During brief, recurring outages, users are unable to access the Support Portal at https://cloudsupport.digitalocean.com/. We are aware of these events and our engineers are working with our vendor to resolve this.

As this issue is intermittent, we expect users will be able to log support tickets normally. However, during any periods of unavailability, as a temporary workaround, users may still contact us via the form here: https://www.digitalocean.com/company/contact/support

Thank you for your patience. We will post an update as soon as further information becomes available.

Nov 20, 01:54 UTC
Resolved - Our Engineering team has confirmed that the issue with displaying users for PostgreSQL Managed Databases across all regions has been fully resolved.

If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.

Nov 20, 01:34 UTC
Monitoring - Our Engineering team has rolled out a fix to resolve the issue with displaying users for PostgreSQL Managed Databases across all regions.

Users should no longer see errors while creating new users for PostgreSQL Managed Databases using Cloud Control Panel.

We will continue to monitor this at our end and will share an update once the problem is resolved completely.

Nov 20, 00:50 UTC
Investigating - Our Engineering team is investigating an issue with displaying users for PostgreSQL Managed Databases across all regions.

During this time, users are unable to see existing users in the Cloud Control Panel. Additionally, when creating users in the Cloud Control Panel, an error will be displayed, despite the user being created successfully.

Creating and listing users for PostgreSQL clusters via the API remains functional.

We apologize for the inconvenience and will share an update once we have more information.

Nov 18, 19:33 UTC
Resolved - Our Engineering team has confirmed complete resolution of the issue that was impacting Spaces Object Storage, DigitalOcean Container Registry, and App Platform, across all regions.

From 16:52 UTC - 18:41 UTC, users may have experienced increased error rates when accessing Spaces objects, interacting with the DigitalOcean Container Registry and while creating/deploying Apps with App Platform. Functionality is completely restored and all operations are succeeding normally.

If you continue to experience any issues with these services please submit a ticket to our customer support team for assistance. Thank you for your patience.

Nov 18, 19:07 UTC
Monitoring - Our Engineering team has completed the mitigation efforts and a fix is now deployed in all regions.

As of 18:41 UTC, error rates have returned to normal and users should no longer experience issues accessing, creating, or performing updates on their existing services with the impacted products.

We are monitoring the situation and will provide an update shortly.

Nov 18, 18:32 UTC
Investigating - Our Engineering team is investigating an issue impacting Spaces Object Storage, DigitalOcean Container Registry, and App Platform, across all regions.

Beginning at 16:52 UTC, users may have started experiencing 500 errors when trying to access and perform operations with their Spaces bucket, as well as increased failure rates when pushing to Container Registries and creating/deploying Apps.

Our team has started to apply mitigations to correct the issue, which are rolling out across all regions.

We'll provide another update once that process has completed.

Nov 18, 21:42 UTC
Resolved - Our Engineering team has confirmed that the issues with Authoritative DNS resolution across multiple regions has been fully resolved. DNS queries should now be resolving normally.

If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.

Nov 16, 22:52 UTC
Update - We are continuing to monitor our Authoritative DNS Service and have seen improvements since implementing the fix. The engineering team is waiting for full confirmation that the issue is corrected before we resolve this incident completely.

If you are facing any issues with our Authoritative DNS Service, please reach out to our support team.

Nov 15, 22:05 UTC
Monitoring - Our Engineering team has implemented a fix to resolve the issues with Authoritative DNS Resolution across multiple regions and is currently monitoring the situation.

We will continue to monitor this at our end and will share an update once the problem is resolved completely.

Nov 15, 11:12 UTC
Identified - Our Engineering team has identified the cause of the issue impacting Authoritative DNS Resolution across multiple regions and is actively working on a fix. We will post an update as soon as we have more information.

Nov 15, 08:33 UTC
Update - We are actively investigating the ongoing issues with Authoritative DNS Resolution across multiple regions.

We have engaged multiple teams to investigate the issue, and we apologize for the continued inconvenience. We will provide additional updates as soon as more information becomes available.

Nov 15, 04:03 UTC
Investigating - Our Engineering team is investigating an issue with intermittent failures and increased latency in DNS resolution across multiple regions.

During this time, users may experience issues with DNS resolution, or see errors returned when querying DNS records which are hosted on the DigitalOcean authoritative DNS infrastructure.

We apologize for the inconvenience and will share an update once we have more information.

Nov 13, 20:44 UTC
Resolved - From 19:06 - 19:14 UTC, our Engineering team observed an issue impacting Authoritative DNS Resolution globally. During this time, users might have experienced latency or resolution issues while querying DNS records hosted on our authoritative DNS infrastructure.

The Engineering team swiftly identified and resolved the issue, and as of 19:14 UTC, all DNS queries should now be resolving normally.

We apologize for the inconvenience and if you are still experiencing issues or have any additional questions, please open a support ticket from within your account.

Nov 13, 13:43 UTC
Completed - The AMS3 Power Maintenance which was previously scheduled at 2024-11-14 20:00 UTC has been cancelled. We will notify you via email and a new maintenance post on status.digitalocean.com with the updated date and timings for this maintenance.

We apologize for any inconvenience and thank you for your understanding.

If you have questions or concerns about this maintenance, please reach out to us by opening up a ticket on your account.

Nov 12, 13:48 UTC
Scheduled - Start: 2024-11-14 20:00 UTC
End: 2024-11-15 06:00 UTC

Hello,

During the above window, our Engineering team will be performing maintenance on redundant upstream electrical systems in order to improve reliability in our AMS3 region.

Expected Impact:

Power systems are redundant and we don’t expect to see any downtime, however, in the very unlikely situation that we lose power to both supplies, users may experience disruption with the following services or for a brief period:

Networking
Backups
Snapshots
Droplet create & restore operations

We will endeavor to keep any downtime to a minimum for the duration of the change.

If you have any questions related to this issue please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

Thank you,
Team DigitalOcean

Nov 12, 22:06 UTC
Resolved - From 20:03 - 20:08 UTC, our Engineering team observed an issue with internal DigitalOcean network connectivity in the NYC3 region. During this time, users might have experienced errors for control plane operations for services in NYC3, such as creating and deleting services, or issuing updates to existing services for products like App Platform Apps, DOKS & Managed Databases.

The incident did not impact public or private network connectivity for customer services.

We apologize for the inconvenience and if you are still experiencing issues or have any additional questions, please open a support ticket from within your account.

Nov 13, 11:10 UTC
Completed - The SFO3 Network Maintenance which was previously scheduled at 2024-11-13 10:00 UTC has been cancelled. We will notify you via email and a new maintenance post on status.digitalocean.com with the updated date and timings for this maintenance.

We apologize for any inconvenience and thank you for your understanding.

If you have questions or concerns about this maintenance, please reach out to us by opening up a ticket on your account.

Nov 13, 10:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Nov 11, 10:20 UTC
Scheduled - Start: 2024-11-13 10:00 UTC
End: 2024-11-13 14:00 UTC

During the above window, our Networking team will be performing maintenance on core switches in our SFO3 datacenter as part of network upgrades.

Expected Impact:

These upgrades are designed and tested to be seamless, and we do not expect any impact to customer traffic due to this maintenance. Should an unexpected issue arise, a possible outcome would be temporary loss of connectivity or increased latency for a brief period of time. We will endeavor to keep any such impact to a minimum.

If you have any questions related to this issue please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

Nov 6, 19:49 UTC
Completed - Hello,

The AMS3 Power Maintenance which was previously scheduled at 2024-11-07 20:00 UTC has been cancelled. We will notify you via email and a new maintenance post on status.digitalocean.com with the updated date and timings for this maintenance.

We apologize for any inconvenience and thank you for your understanding. You may find the initial maintenance notice along with a description of any expected impact related to this work included at the bottom of this message.

If you have questions or concerns about this maintenance, please reach out to us by opening up a ticket on your account.

Thank you,

---BEGIN INITIAL MAINTENANCE NOTICE---

Start: 2024-11-07 20:00 UTC
End: 2024-11-08 06:00 UTC


Hello,

During the above window, our Engineering team will be performing maintenance on redundant upstream electrical systems in order to improve reliability in our AMS3 region.

Expected Impact:

We don’t expect to see any downtime as the power to hypervisors is redundant. In a highly unlikely situation, where we lose power to both the supplies, the Droplet(s) listed below may experience downtime for a brief period. We will endeavor to keep this to a minimum for the duration of the change.


If you have any questions related to this issue please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket


Thank you,
Team DigitalOcean

Nov 5, 12:53 UTC
Scheduled - Start: 2024-11-07 20:00 UTC
End: 2024-11-08 06:00 UTC

Hello,

During the above window, our Engineering team will be performing maintenance on redundant upstream electrical systems in order to improve reliability in our AMS3 region.

Expected Impact:

We don’t expect to see any downtime as the power to hypervisors is redundant. In a highly unlikely situation, where we lose power to both the supplies, the Droplet(s) listed below may experience downtime for a brief period. We will endeavor to keep this to a minimum for the duration of the change.

If you have any questions related to this issue please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

Thank you,
Team DigitalOcean

Nov 6, 18:10 UTC
Completed - The scheduled maintenance has been completed.

Nov 6, 09:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Nov 4, 22:20 UTC
Scheduled - Start: 2024-11-06 09:00 UTC
End: 2024-11-07 22:00 UTC


During the above window, our Engineering team will be performing maintenance on principal infrastructure in order to improve reliability of DigitalOcean services.

Expected Impact:

During the maintenance window, users may experience increased latency for platform management operations, including:

Cloud Control Panel and API operations
Event processing
Droplet creates, resizes, rebuilds, and power events
Managed Kubernetes reconciliation and scaling
Load Balancer operations
Container Registry operations
App Platform operations
Managed Database creation and scaling

We do not expect any impact to customer traffic due to this maintenance. In the event that an unexpected issue should arise, users may experience errors with creating new resources such as Droplets, Load Balancers, Managed Kubernetes clusters, and Managed Databases. We will endeavor to keep any such impact to a minimum.

If you have any questions related to this issue please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

Nov 1, 17:37 UTC
Resolved - Our Engineering team has confirmed resolution of the issue impacting Droplet creation events and event processing and all services should now be operating normally. If you continue to experience any problems, please open a ticket with our Support team. Thank you for your patience and we apologize for any inconvenience.

Nov 1, 13:39 UTC
Update - We are continuing to monitor for any further issues.

Nov 1, 13:36 UTC
Monitoring - Our Engineers are currently monitoring an issue related to event processing and Droplet creates in our NYC2 region. Between 12:34 UTC and 13:09, users may have experienced failures with events such as creating, destroying, or rebuilding Droplets and Droplet-backed products. Our team has mitigated the impact and is monitoring the situation closely. We will post another update as soon as we can confirm the issue to be fully resolved.

Oct 31, 18:56 UTC
Resolved - From 10:30 UTC to 18:04 UTC, users may have experienced delays when adding new nodes to the Cluster or reconciling the Kubernetes Clusters.

Our Engineering team has confirmed the full resolution of the issue. Users should now be able to add new nodes or reconcile Kubernetes Clusters without any delays.

If you continue to experience problems, please open a ticket with our support team from within your Cloud Control Panel.

Oct 31, 18:04 UTC
Monitoring - Our Engineering team has confirmed that some backend changes caused this issue and as of now, there are no delays observed when reconciling or adding new nodes to the Clusters. At this time, users should be able to add new nodes or reconcile their Clusters without any delay.

We are monitoring the situation closely and will post an update as soon as we confirm the issue is fully resolved.

Oct 31, 17:17 UTC
Identified - Our Engineering team has identified the cause of the issue and is working on implementing a fix to make sure no delays are observed when reconciling the Kubernetes Clusters.

We apologize for the inconvenience and will post an update as soon as additional information is available.

Oct 31, 16:59 UTC
Investigating - Our Engineering team is currently investigating issues with Managed Kubernetes clusters. During this time, some users may experience delays when reconciling or adding nodes to their Kubernetes clusters.

We apologize for the inconvenience and will provide an update as soon as we have more information.

Nov 8, 14:00 UTC
Completed - The scheduled maintenance has been completed.

Nov 8, 13:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Nov 8, 18:07 UTC
Scheduled - Start Time: Friday, Nov 8, 2024 at 13:00 UTC
End Time: Friday, Nov 8, 2024 at 14:00 UTC

During the above window, our Engineering team will perform maintenance on the authoritative DNS infrastructure in order to improve reliability of the service. During this operation, the IPv4 and IPv6 addresses of “ns3.digitalocean.com” will change. Customers do NOT need to take any action in preparation for this update.

Expected Impact:

This update is designed to be seamless and we do not expect any impact to DNS queries made to customer domains hosted by DigitalOcean as a result of this maintenance.

If an unexpected issue arises, resolution of some records in zones hosted with DigitalOcean may experience increased latency or a brief disruption. We will endeavor to keep any such impact to a minimum.

If you have any questions or concerns regarding this maintenance, please reach out to us by opening up a ticket on your account via https://cloudsupport.digitalocean.com/s/.

Nov 1, 14:00 UTC
Completed - The scheduled maintenance has been completed.

Nov 1, 13:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Oct 29, 18:03 UTC
Scheduled - Start Time: Tuesday, Nov 1, 2024 at 13:00 UTC
End Time: Tuesday, Nov 1, 2024 at 14:00 UTC

During the above window, our Engineering team will perform maintenance on the authoritative DNS infrastructure in order to improve reliability of the service. During this operation, the IPv4 and IPv6 addresses of “ns2.digitalocean.com” will change. Customers do NOT need to take any action in preparation for this update.

Expected Impact:

This update is designed to be seamless and we do not expect any impact to DNS queries made to customer domains hosted by DigitalOcean as a result of this maintenance.

If an unexpected issue arises, resolution of some records in zones hosted with DigitalOcean may experience increased latency or a brief disruption. We will endeavor to keep any such impact to a minimum.

If you have any questions or concerns regarding this maintenance, please reach out to us by opening up a ticket on your account via https://cloudsupport.digitalocean.com/s/.

Oct 30, 05:27 UTC
Resolved - From 04:36 to 04:51 UTC, users may have experienced errors when attempting to create Managed Database clusters.

Our Engineering team has confirmed the full resolution of the issue. Users should now be able to create Managed Database clusters normally.

If you continue to experience problems, please open a ticket with our support team from within your Cloud Control Panel.

Oct 30, 05:07 UTC
Monitoring - Our Engineering team has implemented a fix to resolve the issues impacting the creation of Managed Database Clusters. Users should now be able to create Managed Database clusters without any issues.

We are actively monitoring the situation and will post an update as soon as the issue is fully resolved.

Oct 30, 04:53 UTC
Investigating - As of 04:53 UTC ur Engineering team is investigating an issue with Managed Databases. At this time, users may experience errors while attempting to create new Managed Database instances in all regions.

We apologize for the inconvenience and will provide another update as soon as possible.

Nov 1, 07:00 UTC
Completed - The scheduled maintenance has been completed.

Oct 31, 20:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Oct 29, 12:04 UTC
Scheduled - Start: 2024-10-31 20:00 UTC
End: 2024-11-01 06:00 UTC

During the above window, our Engineering team will be performing maintenance on redundant upstream electrical systems in order to improve reliability in our AMS3 region.

Expected Impact:

We don’t expect to see any downtime as the power to hypervisors is redundant. In a highly unlikely situation, where we lose power to both the supplies, the impacted Droplet(s) may experience downtime for a brief period. We will endeavor to keep this to a minimum for the duration of the change.


If you have any questions related to this issue please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

Oct 29, 07:27 UTC
Resolved - From 01:56 to 06:36 UTC, our Engineering team observed an issue with Container Registry and App Platform builds in the BLR1 region.

During this time, users may have experienced delays while building their Apps and could have potentially experienced timeout errors in builds as a result. Additionally, a subset of customers may have experienced latency while interacting with the Container Registries.

Our Engineering team was able to take action to mitigate the impact and resolve the issue. All services are now functioning as expected. Thank you for your patience, and we apologize for any inconvenience.

If you have any questions or continue to experience issues, please reach out via a Support ticket on your account.

Oct 25, 22:03 UTC
Resolved - Our Engineering team identified an issue with new Droplet creates and rebuilds using Ubuntu 24.10 based Snapshot and Backup Images. From Oct 10 13:33 to Oct 25 19:58 UTC, users may have experienced issues while creating new Droplets using Ubuntu 24.10 based Snapshots and Backup Images in all of our regions.

We have disabled new Droplet creates and rebuilds using Ubuntu 24.10 based Image until new image has been published. Users who are still running Ubuntu 24.10 based Droplets should create offline Snapshots.

We apologize for the inconvenience. If you continue to experience any issues, please open a support ticket from within your account.

Oct 29, 14:00 UTC
Completed - The scheduled maintenance has been completed.

Oct 29, 13:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Oct 23, 19:21 UTC
Scheduled - Start Time: Tuesday, Oct 29, 2024 at 13:00 UTC
End Time: Tuesday, Oct 29, 2024 at 14:00 UTC

During the above window, our Engineering team will perform maintenance on the authoritative DNS infrastructure in order to improve reliability of the service. During this operation, the IPv4 and IPv6 addresses of “ns1.digitalocean.com” will change. Customers do NOT need to take any action in preparation for this update.

Expected Impact:

This update is designed to be seamless and we do not expect any impact to DNS queries made to customer domains hosted by DigitalOcean as a result of this maintenance.

If an unexpected issue arises, resolution of some records in zones hosted with DigitalOcean may experience increased latency or a brief disruption. We will endeavor to keep any such impact to a minimum.

If you have any questions or concerns regarding this maintenance, please reach out to us by opening up a ticket on your account via https://cloudsupport.digitalocean.com/s/.