Aug 13, 09:30 UTC
Resolved - As of 18:45 UTC, our Engineering team has resolved the issues with OpenAI rate limits that were affecting certain DigitalOcean services. The problem, which began at approximately 09:30 UTC, caused errors (429s) for Agents using OpenAI models for serverless inference.

Systems Affected:

Serverless inference
Evaluations

Technical Details: The issue was caused by exceeding OpenAI rate limits, which resulted in 429 errors for OpenAI models.

Duration: The incident lasted for approximately 9 hours, from 09:30 UTC to 18:45 UTC. We apologize for any inconvenience this may have caused and appreciate your patience as we worked to resolve the issue. If you continue to experience problems, please open a ticket with our Support team.

Aug 7, 23:45 UTC
Resolved - Our Engineering team identified and resolved an issue with the doctl v1.136.0 that was affecting automations and integrations, including App Platform and GitHub Action.

Users with the affected version of doctl may see 404 errors blocking their pipeline. The issue was caused by missing binaries in the release. The broken release has been deleted. Automations depending on doctl should now function as expected.

We apologize for the inconvenience. The new release shall be published soon.

Jul 30, 02:04 UTC
Resolved - Our Engineering team has implemented a fix for the issue that was preventing users from submitting or viewing tickets through our Support Ticket Portal. At this time, all users should be able to access the portal and manage tickets normally via https://cloudsupport.digitalocean.com/s/.

Additionally, any previously submitted tickets that were affected by this issue have now been successfully routed to our Support Team, who will be addressing them as quickly as possible.

We sincerely apologize for the inconvenience and appreciate your patience while we worked to resolve this issue.

Jul 30, 01:42 UTC
Identified - Our Engineering team has identified the root cause of the issue affecting the ability to submit or view tickets through our Support Ticket Portal. They are actively working on implementing a fix.

We will share another update as soon as more information becomes available. Thank you for your continued patience and understanding as we work to resolve this issue.

Jul 30, 01:26 UTC
Investigating - Our Engineering team is investigating an issue with our DigitalOcean Support Ticket Portal. At this time, users may not be able to submit new tickets or view currently opened tickets at https://cloudsupport.digitalocean.com/s/.

We apologize for the inconvenience and will share an update once we have more information.

Jul 23, 12:38 UTC
Resolved - As of 23:43 UTC, July 22, we have confirmed that the issue has been fully resolved. All affected functionality is operating normally, and users should be able to add and update payment methods without any errors.

Thank you for your patience while we worked to address this issue. If you continue to experience issues, then please open a ticket with our Support team for further review.

Jul 23, 01:47 UTC
Monitoring - Our Engineering team has implemented a fix for the issue that was preventing users from adding payment cards via the DigitalOcean Cloud Panel. Functionality has been restored, and users should no longer encounter errors when attempting to add or update payment methods.

We are actively monitoring the situation to ensure stability and will provide a final update once we confirm the issue is fully resolved.

Jul 23, 00:09 UTC
Investigating - Our Engineering team is currently investigating an issue where users are unable to add payment cards via the DigitalOcean Cloud Panel. We apologize for the inconvenience and will share an update as soon as we have more information.

Jul 22, 18:55 UTC
Resolved - Our Engineering team, in collaboration with Let's Encrypt, has successfully resolved the issue affecting SSL certificate provisioning for Spaces and Load Balancers. Certificate creation is now fully restored and functioning as expected.

Existing certificates and HTTPS traffic were not impacted during this time. If you continue to experience any issues with certificate provisioning, please open a support ticket for assistance.

We sincerely apologize for any inconvenience this may have caused and appreciate your patience.

Jul 22, 14:55 UTC
Monitoring - Our Engineering team, in collaboration with Let's Encrypt, has implemented a fix to address the issue affecting SSL certificate provisioning for Spaces and Load Balancers. Initial reports indicate that certificate creation is now functioning as expected.

However, we are continuing to monitor the situation closely to ensure full stability. Existing certificates and HTTPS traffic remain unaffected.

We will provide an update once the issue is fully resolved.

Jul 22, 09:32 UTC
Update - Our Engineering team continues to investigate an issue affecting the creation of Let's Encrypt SSL certificates through the DigitalOcean Cloud Panel for Spaces and Load Balancers. During this time, users may experience failures or delays when provisioning new certificates.

Our team is actively working to resolve the issue and we will provide further updates as soon as we have more information. Thank you for your continued patience.

Jul 21, 20:02 UTC
Investigating - Our Engineering team has identified an issue affecting the creation of Let's Encrypt SSL certificates through the DigitalOcean Cloud Panel for Spaces and Load Balancers. During this time, users may experience failures or delays when provisioning new certificates.

Our team is actively working with Let's Encrypt to resolve the issue as quickly as possible. Existing certificates and traffic over HTTPS are not impacted.

We will continue to provide updates as we learn more.

Jul 23, 20:45 UTC
Completed - The scheduled maintenance has been completed.

Jul 23, 13:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Jul 20, 14:15 UTC
Scheduled - Start: 2025-07-23 13:00 UTC
End: 2025-07-23 21:00 UTC

During the above window, our Engineering team will be performing maintenance on core control plane infrastructure. Please note that the existing infrastructure will continue running without issue. This maintenance may impact create, read, update, and delete (CRUD) operations in all regions.

Expected Impact:

During the maintenance window, users may experience brief periods of increased latency with the following platform operations:

Cloud Control Panel and API operations
Event processing
Droplet creates, resizes, rebuilds, and power events
Managed Kubernetes reconciliation and scaling
Load Balancer operations
Container Registry operations
App Platform operations
Managed Database creation and scaling

We do not expect any impact to customer traffic due to this maintenance. If an unexpected issue for the control plane arises, we will endeavor to keep any impact to a minimum and may revert if required.

If you have any questions related to this maintenance please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

Jul 18, 13:20 UTC
Resolved - Our Engineering team has successfully resolved the issue that was affecting Reserved IPs and Load Balancers. Between 10:45 UTC and 12:10 UTC today, users may have encountered errors while assigning, reserving, or releasing Reserved IPs, or provisioning Load Balancers. All services have now been fully restored and are functioning normally. If you continue to experience any issues, please open a ticket with our support team. We apologize for any inconvenience this may have caused.

Jul 18, 12:36 UTC
Monitoring - Our Engineering team has implemented a fix to address the issue affecting Reserved IPs and Load Balancers and is actively monitoring the situation. We will provide an update once the issue is fully resolved.

Jul 18, 12:17 UTC
Investigating - Our Engineering team is currently investigating an issue affecting Reserved IPs and Load Balancers. During this time, users may be unable to assign, reserve, or release Reserved IPs, or provision Load Balancers. This impact is limited to IPv4; IPv6 remains unaffected. We apologize for the inconvenience and will share an update as soon as we have more information

Jul 17, 18:10 UTC
Resolved - From 13:12 UTC to 17:18 UTC, users may have experienced errors with App deployment via App Platform. The deployments particularly failed for the Apps with Databases linked to them.

Our Engineering team has now confirmed the resolution of the issue, and App deployment should be working as expected.

If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.

Jul 17, 15:17 UTC
Resolved - Our Engineering team has implemented a fix for the issue that was preventing tickets submitted via the Support Contact Form from reaching our Support team. The form is now working as expected, and all new submissions are being properly routed to our Support team.

Additionally, previously submitted tickets that were impacted by this issue have been successfully routed to our Support Team. The team will address them as soon as possible.

We apologize for any inconvenience caused and appreciate your patience while we worked to resolve this issue.

Jul 17, 11:35 UTC
Identified - Our Engineering team has identified the root cause of the issue with submissions from our Support Contact Form and backlogged submissions are now flowing into our Support queues to be addressed.

Our Support team is now working to address the backlog of submissions as quickly as possible.

Jul 17, 09:46 UTC
Investigating - As of 9:23 UTC, our Engineering team is currently investigating an issue with our Support Contact Form, which users use when they are unable to log into their accounts to submit support tickets, located here: https://www.digitalocean.com/company/contact/support

At this time, users are still able to submit the form, but the submissions are not being received by our Support Team.

We have confirmed the submissions were received by our systems and we're working to get these submissions over to our Support Team, as well as remediate the issue.

If you are able to log into your account, please submit any Support tickets via https://cloudsupport.digitalocean.com/s/ rather than the contact form.

We will post another update as soon as we have further information. In the meantime, we appreciate your patience as we work through this.

Jul 10, 23:13 UTC
Resolved - Our Engineering team has fully resolved the issue with new Kubernetes cluster GPU creations. Users with new clusters should be able to create GPU nodes without issue.

If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.

Jul 10, 21:19 UTC
Identified - Our Engineering team has identified an issue impacting creations of GPU nodes on new Kubernetes clusters. New clusters on the latest version will not be able to launch a new GPU node. Existing workloads are not impacted.

Our team is working on deploying a fix for this issue, We will post an update once we have more information.

Jul 8, 17:01 UTC
Resolved - Our Engineering team has resolved the issue affecting all control plane operations (Create, Read, Update, Delete) for non-MongoDB Managed Database clusters. All services and App Platform deployments with Managed Databases should now be operating normally.

If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.

Jul 8, 16:01 UTC
Monitoring - Our Engineering team has deployed a fix to address the issue affecting all control plane operations (Create, Read, Update, Delete) for non-MongoDB Managed Database clusters. Users should now be able to perform standard database operations successfully. App Platform deployments with Managed Databases should also be succeeding now.

We are now monitoring the situation in order to ensure stability and will post an update once the issue is resolved completely.

Jul 8, 14:57 UTC
Investigating - Our Engineering team is investigating an issue that is impacting all control plane operations (Create, Read, Update, Delete) for all non-Mongo Managed Database clusters. During this time, users may encounter long running queries when attempting those operations, including provisioning new clusters, listing clusters, etc.

In addition, App Platform deploys with Managed Databases are also affected, which may result in delayed or failed deployments for some applications.

We will provide updates as more information becomes available.

Jul 10, 00:00 UTC
Completed - The scheduled maintenance has been completed.

Jul 9, 22:00 UTC
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Jul 6, 23:35 UTC
Update - We will be undergoing scheduled maintenance during this time.

Jul 6, 23:32 UTC
Scheduled - We are reaching out again to inform you that the Network maintenance in NYC1 region which was previously scheduled to be complete on 2025-06-18 22:00 UTC has been rescheduled to the following window:

Start: 2025-07-09 22:00 UTC
End: 2025-07-10 00:00 UTC

We apologize for any inconvenience this short notice causes and thank you for your understanding. You may find the initial maintenance notice along with a description of any expected impact related to this work included at the bottom of this message.

If you have questions or concerns about this maintenance, please reach out to us by opening up a ticket on your account.

---BEGIN INITIAL MAINTENANCE NOTICE—

Start: 2025-06-18 22:00 UTC
End: 2025-06-19 00:00 UTC

Hello,

During the above window, our Networking team will be making changes to the core networking infrastructure to improve performance and scalability in the NYC1 region.

Expected impact:

During the maintenance window, users may experience delays or failures with event processing for a brief duration on Droplets and Droplet-based services, including Droplets, Managed Kubernetes, Load Balancers, Container Registry, and App Platform. Additionally, regular requests via the Public API, as well as viewing and submitting requests through the Cloud Control Panel, may time out or fail for up to 5 minutes. We will endeavor to keep this to a minimum for the duration of the change.

If you have any questions related to this issue, please send us a ticket from your cloud support page. https://cloudsupport.digitalocean.com/s/createticket

Jul 2, 18:40 UTC
Resolved - Our Engineering team has resolved the issue affecting all control plane operations (Create, Read, Update, Delete) for non-MongoDB Managed Database clusters. All services and App Platform deployments with Managed Databases should now be operating normally. If you continue to experience problems, please open a ticket with our support team. We apologize for any inconvenience.

Jul 2, 17:43 UTC
Monitoring - Our Engineering team has deployed a fix to address the issue affecting all control plane operations (Create, Read, Update, Delete) for non-MongoDB Managed Database clusters. Users should now be able to perform standard database operations successfully. App Platform deployments with Managed Databases should also be succeeding now.

We are now monitoring the situation in order to ensure stability and will post an update once the issue is resolved completely.

Jul 2, 16:59 UTC
Investigating - Our Engineering team is investigating an issue that is impacting all control plane operations (Create, Read, Update, Delete) for all non-Mongo Managed Database clusters. During this time, users may encounter 401/403 errors when attempting those operations, including provisioning new clusters, listing clusters, etc.

In addition, App Platform deploys with Managed Databases are also affected, which may result in delayed or failed deployments for some applications.

We will provide updates as more information becomes available.

Jul 2, 20:15 UTC
Resolved - This incident has been resolved.

Jul 2, 19:50 UTC
Monitoring - All previously reported issues have now been resolved.

Resolved Issues:

- Indexing jobs are now operational and starting as expected.
- Indexing job statuses are updating normally.
- Evaluation runs on new teams are fully operational.
- Knowledge base creation is functioning correctly.
- Linking functions to agents is now operational.

We appreciate your patience while our team worked to resolve these issues. We will continue to monitor the fixes to ensure everything remains stable.

Jul 2, 19:19 UTC
Update - Our Engineering team continues to work on a fix for this issue. We will share further updates as soon as they become available. Thank you for your continued patience.

Jul 2, 17:39 UTC
Identified - Our Engineering team has identified several issues impacting indexing jobs and knowledge base creation.

At this time, users may experience the following:

- Indexing jobs are currently failing to start. As a result, most teams will be unable to initiate new jobs.
- For teams where jobs do start, they may remain stuck in a "queued" status.
- Knowledge base creation is still failing and may result in an error.

We apologize for the disruption and will provide further updates as we learn more.

Jul 2, 16:29 UTC
Monitoring - A fix has been implemented and we are monitoring the results.

Jul 2, 15:08 UTC
Identified - The issue has been identified and a fix is being implemented.

Jul 2, 14:24 UTC
Investigating - Our Engineering team is investigating an issue with creating agents using an attached knowledge base.

At this time, users may experience errors when attempting to create a new agent and specify a knowledge base during the creation process.

We apologize for the inconvenience and will share an update once we have more information.

Jul 3, 19:55 UTC
Resolved - Our Engineering team has confirmed that the issue affecting access to Object Storage Buckets in the FRA1 and SFO3 regions has been fully resolved. Users should no longer experience SSL/TLS handshake failures when accessing their Buckets in these regions.

We appreciate your patience and understanding while we worked to resolve this matter. If you continue to experience any issues, please don't hesitate to open a support ticket from your account for further assistance.

Jul 3, 19:15 UTC
Monitoring - Our Engineering team has identified the root cause of the issue as a block imposed by a third-party provider on users utilizing residential cable services and their advanced security offerings.

During this time, a subset of users accessing their Spaces buckets in the FRA1 and SFO3 regions via residential cable services may have experienced SSL/TLS handshake failures.

This block was removed as of 17:48 UTC, and users should no longer encounter errors when accessing the contents of their buckets.

We are actively working with the third-party provider to ensure that such blocks are not imposed again in the future.

We will continue to monitor the situation and post an update once this issue is fully resolved. Thank you for your patience.

Jul 2, 13:43 UTC
Update - Our Engineering team continues to investigate reports of SSL/TLS handshake failures affecting Object Storage access in the FRA1 and SFO3 regions. The team is reviewing logs and traffic flows to isolate the root cause and determine whether a misconfiguration or external dependency is contributing to the failures.

Our team is actively working to resolve the issue and we will provide further updates as soon as we have more information. Thank you for your continued patience.

Jul 1, 19:01 UTC
Investigating - Our Engineering team is currently investigating reports of SSL/TLS handshake failures for Object Storage access in FRA1 and SFO3 regions. Affected users may see connection errors or timeouts when attempting to access buckets over HTTPS.

We are actively working to identify the root cause and implement a solution and will share further updates as more information becomes available.

Jul 1, 03:01 UTC
Resolved - Our Engineering team has confirmed full resolution of the issue with creation events for MongoDB clusters in all of our regions.

We apologize for any inconvenience throughout this process. If you continue to experience problems, please open a ticket with our support team.

Jul 1, 02:32 UTC
Monitoring - Our Engineering team has implemented a fix to resolve the issue that was preventing users from creating MongoDB clusters in all of our regions and is currently monitoring the situation.

During this time, users should no longer experience issues with creating MongoDB clusters and all the stalled creation events should provision completely.

We will post an update as soon as the issue is fully resolved.

Jul 1, 01:59 UTC
Investigating - Our Engineering team is investigating an issue with creation events for MongoDB clusters in all of our regions.

During this time, users may face issues while creating MongoDB clusters.

We apologize for the inconvenience and will share an update once we have more information.

Jun 30, 21:30 UTC
Resolved - Our Engineering team confirms the full resolution of creation issue with Managed Databases through Cloud Panel and API.

At this time, all users should be able to create Managed Database clusters normally.

We apologize for the inconvenience. If you continue to experience any issues, please open a support ticket from within your account.

Jun 30, 19:10 UTC
Monitoring - Our Engineering team has implemented a fix for the issue affecting the creation of Managed Databases via both the Cloud Panel and API and functionality has been restored.

We are currently monitoring the systems to ensure stability and will provide a final update once we confirm full resolution.

Jun 30, 18:23 UTC
Identified - Our Engineering team has identified an issue that is impacting the creation of Managed Databases through the DigitalOcean Cloud Panel and API. During this time a subset of users may experience errors or delays when attempting to provision new database clusters.

We are actively working on a solution in order to restore the service. Existing database clusters remain operational and are not affected by this issue.

We will provide updates as more information becomes available.

Jun 23, 13:00 UTC
Resolved - Our Engineering team has confirmed that the issue with Functions has now been fully resolved. If you continue to see errors please open a ticket with our Support team and they will be happy to assist you.

Jun 23, 12:23 UTC
Monitoring - Our Engineering team has mitigated the issue with Functions and is monitoring the situation. We will post an update once we can fully confirm resolution.

Jun 23, 12:06 UTC
Investigating - As of 10:50 UTC, our Engineering team is investigating an issue with Functions in all regions.

During this time, users may experience an issue when trying to create or delete Functions. Additionally, users trying to deploy apps using the Function component may see the deployment failing.

We apologize for the inconvenience, and we'll share an update once we have more information.

Jun 23, 10:09 UTC
Resolved - Between 08:07 UTC and 08:32 UTC, our Engineering team observed issues impacting networking in the TOR1 region. During this time, users may have experienced intermittent connectivity issues while interacting with Droplets and Droplet-based services.

Additionally, users may have experienced intermittent timeouts when using the API or Cloud Control panel. All services are now functioning as expected. Thank you for your patience, and we apologize for any inconvenience.

If you have any questions or continue to experience issues, please reach out via a Support ticket on your account.

Jun 22, 05:40 UTC
Resolved - From 2:57 AM to 4:38 AM UTC, our Engineering team identified and resolved an issue that affected multiple GenAI Platform models. During this period, all GenAI inference services were unavailable.

The Engineering team has confirmed that the issue has been fully resolved.

If you continue to experience any problems, please contact our support team by submitting a ticket through your Cloud Control Panel.