tag:status.deco.cx,2005:/history deco Status - Incident history 2026-07-24T10:55:00.000+00:00 deco tag:status.deco.cx,2005:Incident/cmryxsmfo08sf0rrudekz84yb 2026-07-24T10:55:00.000+00:00 2026-07-24T10:55:00.000+00:00 Intermittent slowness and failures loading sites Type: Incident

Duration: 3 hours and 15 minutes

Affected Components: hosting-kubernetes

Jul 24, 10:55:00 GMT+0
Investigating - We are investigating reports of intermittent slowness and failures loading sites hosted on the platform, beginning around 10:55 UTC Our team is actively working to identify the source and restore normal operation. We will post further updates as we make progress..

Jul 24, 11:10:00 GMT+0
Resolved - Between approximately 10:55 and 11:10 UTC — about 15 minutes — a DNS resolution issue at our cloud infrastructure provider temporarily affected the loading of most sites. A portion of requests experienced slowness or failed to load during this window. Service recovered around 11:10 UTC and all sites are operating normally. The cause was external and limited in duration, and no action is required from customers. We continue to monitor with the provider to ensure stability and mitigate any recurrence..

Jul 24, 11:00:00 GMT+0
Identified - We have identified that the disruption was caused by a brief DNS resolution issue at our cloud infrastructure provider, which temporarily affected the loading of most hosted sites. The cause is external to the deco infrastructure. We are already seeing signs of recovery and the service is returning to normal. We continue to monitor closely until full confirmation..

]]> tag:status.deco.cx,2005:Incident/cmr25n0vr00x90rni6y623k59 2026-07-01T13:24:00.000+00:00 2026-07-01T13:24:00.000+00:00 All environments unavailable Type: Incident

Duration: 36 minutes

Affected Components: admin

Jul 1, 13:24:00 GMT+0
Investigating - We are currently investigating this incident..

Jul 1, 13:40:00 GMT+0
Identified - A platform rollout change an internal dns and turn environments unavailable, rollback is in progress.

Jul 1, 14:00:00 GMT+0
Resolved - This incident has been resolved..

Jul 1, 13:57:00 GMT+0
Monitoring - All environments are back and fully operational.

]]> tag:status.deco.cx,2005:Incident/cmqgpuw5h00l52oqxhjgrjlrj 2026-06-16T13:35:00.000+00:00 2026-06-16T13:35:00.000+00:00 Environments are unstable Type: Incident

Duration: 40 minutes

Affected Components: admin

Jun 16, 13:35:00 GMT+0
Investigating - We are currently investigating this incident..

Jun 16, 14:15:01 GMT+0
Identified - We found a problematic load balancer that were holding traffic behind it.

Jun 16, 14:15:11 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmpcnx9js00d9qkivjwt942r2 2026-05-19T11:00:00.000+00:00 2026-05-19T11:00:00.000+00:00 Degraded performance at logs system Type: Incident

Duration: 2 hours and 25 minutes

Affected Components: admin

May 19, 11:00:00 GMT+0
Identified - Our log's provider partner has degraded performance issues.

May 19, 13:25:16 GMT+0
Resolved - This incident has been resolved. Our log's provider is fully operational .

]]> tag:status.deco.cx,2005:Incident/cmoubhysi004fsingrq7065ej 2026-05-06T04:00:00.000+00:00 2026-05-06T04:00:00.000+00:00 New environments base in production instead of local changes Type: Incident

Duration: 13 hours and 28 minutes

Affected Components: admin

May 6, 04:00:00 GMT+0
Identified - We are continuing to work on a fix for this incident..

May 6, 17:28:08 GMT+0
Resolved - This incident has been resolved. New environment checkout the correct options but the ones created during the incident need rebase to apply the fix.

]]> tag:status.deco.cx,2005:Maintenance/cmotb71fd02ahshdre69jili0 2026-05-06T01:00:00.000+00:00 2026-05-06T01:00:00.000+00:00 Infrastructure maintenance Type: Maintenance

Duration: 3 hours and 9 minutes

Affected Components: admin

May 6, 01:00:00 GMT+0
Identified - Admin operations may be degraded during maintenance window..

May 6, 03:02:01 GMT+0
Identified - Partial maintenance window done. We are working on the configuration of environments now..

May 6, 03:37:57 GMT+0
Identified - Environments configuration in progress..

May 6, 04:04:00 GMT+0
Identified - The environments are already configured, but are experiencing some instability. This will be resolved in a few minutes..

May 6, 04:08:46 GMT+0
Completed - Maintenance has completed successfully..

]]> tag:status.deco.cx,2005:Maintenance/cmos028sv0093n6q16c8ar99w 2026-05-04T14:00:00.000+00:00 2026-05-04T14:00:00.000+00:00 Infrastructure maintenance Type: Maintenance

Affected Components: admin

May 4, 14:00:00 GMT+0
Completed - We are planning for a scheduled maintenance during that time and the deploys will be paused.

]]> tag:status.deco.cx,2005:Incident/cmnycjci0002gc1oveuaycxrl 2026-04-14T08:15:13.655+00:00 2026-04-14T08:15:13.655+00:00 Major outage Type: Incident

Duration: 2 hours and 18 minutes

Affected Components: hosting-kubernetes

Apr 14, 08:15:13 GMT+0
Identified - We are continuing to work on a fix for this incident..

Apr 14, 08:36:34 GMT+0
Identified - Some website are back to normal and we are fixing the rest now.

Apr 14, 08:58:05 GMT+0
Identified - We are continuing to work on a fix for this incident. Most of the sites are back to normal operations.

Apr 14, 10:33:21 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmmklhfv702grmg9on5h6s49k 2026-03-10T12:37:10.368+00:00 2026-03-10T12:37:10.368+00:00 403 error on Add To Cart in VTEX Type: Incident

Duration: 15 minutes

Affected Components: VTEX

Mar 10, 12:37:10 GMT+0
Investigating - We are currently investigating this incident..

Mar 10, 12:51:59 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Maintenance/cmmeune1i067it29rhbw68e4p 2026-03-06T12:10:00.000+00:00 2026-03-06T12:10:00.000+00:00 Database maintenance Type: Maintenance

Duration: 15 minutes

Affected Components: admin

Mar 6, 12:10:00 GMT+0
Identified - We are planning for a scheduled maintenance on studio admin during that time..

Mar 6, 12:10:01 GMT+0
Identified - Maintenance is now in progress.

Mar 6, 12:25:00 GMT+0
Completed - Maintenance has completed successfully.

]]> tag:status.deco.cx,2005:Incident/cmlv8xtl30ueuqmpzemu87179 2026-02-20T18:35:00.000+00:00 2026-02-20T18:35:00.000+00:00 VTEX Search API has elevated error rate Type: Incident

Duration: 57 minutes

Affected Components: VTEX

Feb 20, 18:35:00 GMT+0
Investigating - We have immediately alerted the VTEX team..

Feb 20, 19:31:33 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmli4u0su01amhh847lsyxu66 2026-02-11T14:35:49.253+00:00 2026-02-11T14:35:49.253+00:00 VTEX platform instability Type: Incident

Duration: 34 minutes

Affected Components: VTEX

Feb 11, 14:35:49 GMT+0
Identified - We are continuing to work on a fix for this incident..

Feb 11, 15:09:48 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmlgpnrk208gm132rz57zibkj 2026-02-10T14:43:16.940+00:00 2026-02-10T14:43:16.940+00:00 We are upscaling our database - downtime of 5-10 minutes expected. Type: Incident

Duration: 5 minutes

Affected Components: admin

Feb 10, 14:43:16 GMT+0
Monitoring - .

Feb 10, 14:47:47 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmlgjjxa81483voi5tglgr8ut 2026-02-10T11:30:00.000+00:00 2026-02-10T11:30:00.000+00:00 Login is not working in admin.deco.cx Type: Incident

Duration: 42 minutes

Affected Components: Third Party: Supabase → Storage, Third Party: Supabase → Auth, admin

Feb 10, 11:30:00 GMT+0
Investigating - We are currently investigating this incident..

Feb 10, 12:00:57 GMT+0
Identified - We have discovered the root cause in our downstream database provider. We are working to solve the issue. .

Feb 10, 12:11:57 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cml72n25x03jbzdgryd9bbhvn 2026-02-03T20:40:00.000+00:00 2026-02-03T20:40:00.000+00:00 Admin interface is not working Type: Incident

Duration: 1 hour and 2 minutes

Affected Components: admin

Feb 3, 20:40:00 GMT+0
Investigating - We are currently investigating this incident..

Feb 3, 21:15:50 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result. Environment reset and creation is currently not working. We are working to reestablish full service as soon as possible..

Feb 3, 21:42:21 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmicyvtu300c6rvq1gc7nl9uq 2025-11-24T09:51:17.893+00:00 2025-11-24T09:51:17.893+00:00 We are investigating reports of issues with our Auth System Type: Incident

Affected Components: admin

Nov 24, 09:51:17 GMT+0
Investigating - We are currently investigating this incident..

Nov 24, 09:55:00 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmhuqxo4p0169pvvoijwl4wsf 2025-11-11T15:48:55.495+00:00 2025-11-11T15:48:55.495+00:00 Admin access impacted Type: Incident

Duration: 23 minutes

Affected Components: admin

Nov 11, 15:48:55 GMT+0
Identified - The use of the admin interface may be affected in some environments..

Nov 11, 16:11:28 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmhp6kjr600agir6sed3k79xp 2025-11-07T17:00:49.876+00:00 2025-11-07T22:00:00.000+00:00 Internal network errors in our hosting platform is causing increased 503 error rates Type: Incident

Duration: 4 hours and 59 minutes

Affected Components: hosting-kubernetes

Nov 7, 22:00:00 GMT+0
Resolved - This incident has been resolved. We continue our 24/7 monitoring for any instabilities. .

Nov 7, 17:00:49 GMT+0
Identified - We are continuing to work on a fix for this incident..

]]> tag:status.deco.cx,2005:Incident/cmhnmticx00geejeg4shricew 2025-11-06T15:32:00.000+00:00 2025-11-06T15:32:00.000+00:00 Site deploys are not successful Type: Incident

Duration: 1 hour and 3 minutes

Affected Components: admin

Nov 6, 15:32:00 GMT+0
Investigating - Our deploy sub-system responsible for sites is facing an internal GCP Error. We are currently investigating this incident..

Nov 6, 16:34:50 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmh0hmev3001nq788qwpz5fua 2025-10-21T11:17:00.000+00:00 2025-10-21T11:17:00.000+00:00 Sites returning 404 not found Type: Incident

Duration: 2 hours and 38 minutes

Affected Components: hosting-kubernetes

Oct 21, 11:17:00 GMT+0
Investigating - We are currently investigating this incident..

Oct 21, 11:43:31 GMT+0
Identified - One of our major CDN provider is experiencing issues We're working on migrating the sites to a backup CDN.

Oct 21, 12:08:56 GMT+0
Monitoring - We are in contact with our CDN provider and expect a full resolution soon While that, the migration to our CDN backup is in progress and working .

Oct 21, 13:32:13 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Oct 21, 13:54:40 GMT+0
Resolved - This incident has been resolved. The root cause was a misconfiguration performed by one of our infrastructure providers at 8:08 GMT-3\. At 8:35 GMT-3 we had already migrated away 80% of the traffic, and then worked to reestablish service for the remaining 20%, which concluded at 10:38 GMT-3\. .

]]> tag:status.deco.cx,2005:Incident/cmgyvwugw00r21wzrg8zwbxy6 2025-10-20T08:02:00.000+00:00 2025-10-20T08:02:00.000+00:00 Some sites on k8s infrastructure are currently down Type: Incident

Duration: 28 minutes

Affected Components: hosting-kubernetes

Oct 20, 08:02:00 GMT+0
Investigating - We are currently investigating this incident..

Oct 20, 08:17:00 GMT+0
Identified - We detect that a package we rely on is down: <https://registry.npmjs.org/@aws-crypto/crc32c>.

Oct 20, 08:25:00 GMT+0
Monitoring - The package is back to normal, and we already can see site back to normal as well.

Oct 20, 08:30:00 GMT+0
Resolved - This incident has been resolved. No more site is down and the package is ok.

]]> tag:status.deco.cx,2005:Incident/cmfb6dwhm007mu91x1blykf0u 2025-09-08T13:15:00.000+00:00 2025-09-08T13:15:00.000+00:00 Deployment issue Type: Incident

Duration: 1 hour and 24 minutes

Sep 8, 13:15:00 GMT+0
Investigating - We are currently investigating an incident that blocks new deployments.

Sep 8, 14:38:49 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Maintenance/cmf1uvje4006cy8l96jm8wqq0 2025-09-02T01:15:00.000+00:00 2025-09-02T01:59:56.435+00:00 Database Type: Maintenance

Duration: 45 minutes

Affected Components: admin

Sep 2, 01:59:56 GMT+0
Completed - Maintenance has completed successfully..

Sep 2, 01:15:00 GMT+0
Identified - We are planning for a database scheduled maintenance during that time..

Sep 2, 01:15:01 GMT+0
Identified - Maintenance is now in progress.

]]> tag:status.deco.cx,2005:Incident/cmcnrnb4c000314m25lqn1sex 2025-07-03T18:31:00.000+00:00 2025-07-03T18:31:00.000+00:00 3rd party dependency service with limited capabilities Type: Incident

Duration: 1 hour and 27 minutes

Affected Components: admin

Jul 3, 18:31:00 GMT+0
Identified - [esm.sh](http://esm.sh) is a code dependency service (similar to NPM) that multiple deco sites use to fetch dependencies. It's experiencing a partial downtime, limiting the capacity for new deploys. We are continuing to work on a bypass solution for this incident. This doesn't affect current running sites..

Jul 3, 19:57:30 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Jul 3, 19:57:30 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Maintenance/cmc3ccoor0005dppvp2ieqysf 2025-06-21T04:00:00.000+00:00 2025-06-21T04:00:01.000+00:00 Admin maintenance Type: Maintenance

Duration: 34 minutes

Affected Components: admin

Jun 21, 04:00:01 GMT+0
Identified - Maintenance is now in progress.

Jun 21, 04:34:19 GMT+0
Completed - Maintenance has completed successfully..

Jun 21, 04:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during that time. The admin of all sites may be suspended for some time..

]]> tag:status.deco.cx,2005:Incident/cmbttrivh004kqaob2zqa2fwl 2025-06-12T18:40:00.000+00:00 2025-06-12T21:30:00.000+00:00 Elevated errors on sites Type: Incident

Duration: 2 hours and 50 minutes

Affected Components: hosting-denodeploy, hosting-kubernetes

Jun 12, 21:30:00 GMT+0
Resolved - This incident has been resolved..

Jun 12, 20:08:00 GMT+0
Monitoring - Registries and services are up on our cloud partners. We are monitoring the issue..

Jun 12, 18:40:00 GMT+0
Identified - Current issues on our cloud partners and npm registry made pod automatic scale unavailable. We used registry mirrors to avoid complete disruptions for all sites..

]]> tag:status.deco.cx,2005:Incident/cmbtp9gos000ny687yet3xdy0 2025-06-12T18:16:04.838+00:00 2025-06-12T20:13:58.781+00:00 Admin access impacted Type: Incident

Duration: 3 hours and 12 minutes

Affected Components: admin

Jun 12, 20:13:58 GMT+0
Monitoring - We are seeing improvement in error rates, but still monitoring current status..

Jun 12, 18:16:04 GMT+0
Investigating - We are currently investigating this incident..

Jun 12, 18:18:08 GMT+0
Identified - We've identified a downstream outage in one of our partner's cloud.

Jun 12, 21:28:02 GMT+0
Resolved - This incident has been resolved..

]]> tag:status.deco.cx,2005:Incident/cmax4ehsl002gmqmp8ed0c9yv 2025-05-20T23:03:31.613+00:00 2025-05-21T00:05:50.191+00:00 Admin is offline due to database issues Type: Incident

Duration: 1 hour and 2 minutes

Affected Components: admin

May 21, 00:05:50 GMT+0
Resolved - This incident has been resolved..

May 20, 23:03:31 GMT+0
Identified - **We are actively working on resolving this incident.** Please note that new deployments and access to the admin interface are currently affected..

]]> tag:status.deco.cx,2005:Incident/cm9kc9kh00083mguu6lrfo51g 2025-04-16T18:13:00.000+00:00 2025-04-16T19:48:49.457+00:00 Admin.cx fails to complete some tasks Type: Incident

Duration: 4 hours and 7 minutes

Affected Components: admin

Apr 16, 19:48:49 GMT+0
Identified - Our nginx that responds requests for environments is overloaded. We are escalating the service to improve our SLA. Due to this failure, operations related to admin operations on envs are failing. This doesn't impact production sites..

Apr 16, 21:26:00 GMT+0
Identified - We are continuing to work on a fix for this incident. Our nginx is still suffering due to excess of routes/endpoints..

Apr 16, 22:20:24 GMT+0
Resolved - This incident has been resolved. We apologize for the inconvenience and are working to prevent this type of problem in the future. .

Apr 16, 18:13:00 GMT+0
Investigating - We are currently investigating this incident..

]]> tag:status.deco.cx,2005:Incident/cm8rbxwhy000e1267popwalsy 2025-03-27T12:12:00.000+00:00 2025-03-27T12:12:00.000+00:00 Users Unable to Access deco.cx Admin Due to Permission Changes Type: Incident

Duration: 19 minutes

Affected Components: admin

Mar 27, 12:12:00 GMT+0
Investigating - We are currently investigating this incident..

Mar 27, 12:29:08 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Mar 27, 12:31:11 GMT+0
Resolved - This incident has been resolved..

]]>