tag:status.chef.io,2005:/historyChef Status - Incident History2025-01-20T04:38:53-08:00Cheftag:status.chef.io,2005:Incident/228382992024-11-12T05:20:21-08:002024-11-12T05:20:24-08:00Artifacatory update<p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>05:20</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>04:35</var> PST</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>02:20</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>12</var>, <var data-var='time'>02:17</var> PST</small><br><strong>Scheduled</strong> - We are performing maintenance activities against some of our download services. In the 10:20 - 13:00 UTC timeframe, you may experience intermittent disruptions while trying to consume artifacts/downloads from our download product page.</p>tag:status.chef.io,2005:Incident/187797162023-10-17T03:00:31-07:002023-10-17T03:00:33-07:00Hosted Chef Set to Get a Database and Infrastructure Upgrade<p><small>Oct <var data-var='date'>17</var>, <var data-var='time'>03:00</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Oct <var data-var='date'>17</var>, <var data-var='time'>02:55</var> PDT</small><br><strong>Verifying</strong> - We have completed the Upgrade and verifying the changes.</p><p><small>Oct <var data-var='date'>17</var>, <var data-var='time'>02:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Oct <var data-var='date'>13</var>, <var data-var='time'>06:59</var> PDT</small><br><strong>Scheduled</strong> - We have scheduled a Maintenance window on 17-October-2023 (Tuesday) starting 02:00 AM PST till 03:00 AM PST. During the scheduled Downtime period, both Hosted Chef API and Hosted Chef Web Console will be unavailable.<br />We appreciate your patience and understanding. For more details, please read our blog post <br />http://bit.ly/46Ok66g</p>tag:status.chef.io,2005:Incident/168396562023-04-11T23:00:00-07:002023-04-12T11:24:28-07:00Interim issue with hosted chef<p><small>Apr <var data-var='date'>11</var>, <var data-var='time'>23:00</var> PDT</small><br><strong>Resolved</strong> - There was an incident with Hosted Chef today morning at 6:00AM UTC, the Hosted Chef application (manage.chef.io) was down for 15 mins. We identified the root cause and fixed the issue immediately. The systems are now healthy and up and running.</p>tag:status.chef.io,2005:Incident/98225122022-04-26T03:00:33-07:002022-04-26T03:12:59-07:00Hosted Chef Set to Get a Database and Infrastructure Upgrade<p><small>Apr <var data-var='date'>26</var>, <var data-var='time'>03:00</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed. <br />We couldn't proceed with the mentioned changes, as we found an issue on our canary instance. we will have new maintenance window planned and we will keep you informed about it.</p><p><small>Apr <var data-var='date'>26</var>, <var data-var='time'>02:49</var> PDT</small><br><strong>Verifying</strong> - Verification is currently underway for the maintenance items.</p><p><small>Apr <var data-var='date'>26</var>, <var data-var='time'>02:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Apr <var data-var='date'>20</var>, <var data-var='time'>12:30</var> PDT</small><br><strong>Scheduled</strong> - We have scheduled a Maintenance window on 26-April-2022 (Tuesday) starting 02:00 AM PST till 03:00 AM PST. During the scheduled Downtime period both Hosted Chef API and Hosted Chef Web Console will be unavailable.<br />We appreciate your patience and understanding. For more details, please read our blog post <br />https://bit.ly/3K64rDj</p>tag:status.chef.io,2005:Incident/96509052022-03-31T02:05:23-07:002022-03-31T02:05:24-07:00Learn Chef Maintenance<p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>02:05</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>31</var>, <var data-var='time'>02:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>28</var>, <var data-var='time'>11:17</var> PDT</small><br><strong>Scheduled</strong> - Learn Chef platform (including both the public and sandbox LMS, Studio, and Figures) will be unavailable for 5 mins on Thu, Mar 31 at 5 am EST.</p>tag:status.chef.io,2005:Incident/95946912022-03-21T11:15:19-07:002022-03-21T11:15:20-07:00Authentication broken for Supermarket<p><small>Mar <var data-var='date'>21</var>, <var data-var='time'>11:15</var> PDT</small><br><strong>Resolved</strong> - We have identified and fixed the issue, sign in is working as expected now. We will continue to monitor the system.</p><p><small>Mar <var data-var='date'>21</var>, <var data-var='time'>07:33</var> PDT</small><br><strong>Investigating</strong> - We have identified that sign in for supermarket is not working. We are currently investigating the issue and we will keep you posted</p>tag:status.chef.io,2005:Incident/91366762022-01-24T18:00:30-08:002022-01-24T18:00:30-08:00Learn Chef Maintenance<p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>18:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>24</var>, <var data-var='time'>17:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>21</var>, <var data-var='time'>07:36</var> PST</small><br><strong>Scheduled</strong> - Our service partner will be deploying updates for Virtual Labs. We anticipate this taking just a few minutes during the hour, but will impact anyone actively using a virtual lab during that time. If you have questions, join us in #learnchef on the Chef Community Slack. https://community.chef.io/slack</p>tag:status.chef.io,2005:Incident/88977032022-01-10T06:50:29-08:002022-01-10T06:50:30-08:00Supermarket (supermarket.chef.io) maintenance and upgrade<p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>06:50</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>06:30</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>10</var>, <var data-var='time'>05:15</var> PST</small><br><strong>Update</strong> - Maintenance/upgrade starting in just over an hour.</p><p><small>Dec <var data-var='date'>20</var>, <var data-var='time'>11:34</var> PST</small><br><strong>Scheduled</strong> - Supermarket (https://supermarket.chef.io) will be down for maintenance and upgrade, during which the site and API will be unavailable.<br />Scheduled downtime - January 10th, 2022 (6:30 AM PST to 6:50 AM PST)</p>tag:status.chef.io,2005:Incident/90168942022-01-06T11:19:28-08:002022-01-06T11:19:30-08:00Hosted Chef Extended Maintenance<p><small>Jan <var data-var='date'> 6</var>, <var data-var='time'>11:19</var> PST</small><br><strong>Resolved</strong> - We have completed the Database upgrade and all systems are operational now. Thanks you for your patience.</p><p><small>Jan <var data-var='date'> 6</var>, <var data-var='time'>08:45</var> PST</small><br><strong>Monitoring</strong> - We have completed the DB optimization successfully and have opened Hosted Chef for traffic.<br />We are monitoring the system performance now.<br />Consider the system as Operational .</p><p><small>Jan <var data-var='date'> 6</var>, <var data-var='time'>08:15</var> PST</small><br><strong>Update</strong> - We are continuing to work on the DB optimization and have seen significant progress in the last hour.<br />We will keep you updated with our progress.</p><p><small>Jan <var data-var='date'> 6</var>, <var data-var='time'>07:22</var> PST</small><br><strong>Update</strong> - We are continuing to work on the DB optimization, it is taking longer than we anticipated.<br />We will keep you posted as and when we have an update to share, Thanks for your patience.</p><p><small>Jan <var data-var='date'> 6</var>, <var data-var='time'>05:04</var> PST</small><br><strong>Identified</strong> - We are seeing some issues with the upgraded DB performance after the upgrade today and working to optimize it , We will keep you posted about our progress with the upgrade completion.</p>tag:status.chef.io,2005:Incident/88637152022-01-06T05:00:30-08:002022-01-06T05:00:31-08:00Hosted Chef Planned Maintenance<p><small>Jan <var data-var='date'> 6</var>, <var data-var='time'>05:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'> 6</var>, <var data-var='time'>02:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Dec <var data-var='date'>16</var>, <var data-var='time'>02:43</var> PST</small><br><strong>Scheduled</strong> - We have scheduled a Downtime on 06-Jan-2022 (Thursday) starting 02:00 AM PST till 05:00 AM PST. During the scheduled Downtime period both Hosted Chef API and Hosted Chef Web Console will be unavailable.<br />We appreciate your patience and understanding. For more details, please read our blog post https://bit.ly/329NSX6</p>tag:status.chef.io,2005:Incident/89124992021-12-22T15:18:05-08:002021-12-22T15:18:06-08:00Hosted Chef Increased error rate<p><small>Dec <var data-var='date'>22</var>, <var data-var='time'>15:18</var> PST</small><br><strong>Resolved</strong> - This Incident is resolved and services are back to normal.<br />Thanks for your patience.</p><p><small>Dec <var data-var='date'>22</var>, <var data-var='time'>15:06</var> PST</small><br><strong>Monitoring</strong> - The issue is fixed and both Hosted Chef Web console and Hosted Chef API are performing normally now.<br />We will continue to monitor for a while.</p><p><small>Dec <var data-var='date'>22</var>, <var data-var='time'>07:27</var> PST</small><br><strong>Identified</strong> - We have identified our internal Search Service to be the problem and this is because of on-going AWS us-east-1 incident.<br />Our Engineers are working to restore the service with normal performance.</p><p><small>Dec <var data-var='date'>22</var>, <var data-var='time'>05:39</var> PST</small><br><strong>Investigating</strong> - We are seeing increased Error rates in Hosted Chef , this seems to be because of an on going AWS network issue in us-east-1 region.<br />Our Engineers are working on this and we will keep you posted.</p>tag:status.chef.io,2005:Incident/87247662021-12-08T02:00:37-08:002021-12-08T02:00:37-08:00Learn Chef Maintenance<p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>02:00</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Dec <var data-var='date'> 8</var>, <var data-var='time'>01:01</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>30</var>, <var data-var='time'>07:18</var> PST</small><br><strong>Scheduled</strong> - We anticipate learn.chef.io to be unavailable for around an hour for database maintenance. We will provide updates if it will be down for longer.</p>tag:status.chef.io,2005:Incident/83399652021-11-16T05:58:08-08:002021-11-16T05:58:09-08:00Hosted Chef Planned Maintenance<p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>05:58</var> PST</small><br><strong>Completed</strong> - We are deferring this maintenance window to a later date, which will be announced soon.<br />Apologies for any inconvenience this might have caused you.</p><p><small>Oct <var data-var='date'>28</var>, <var data-var='time'>07:05</var> PDT</small><br><strong>Scheduled</strong> - We have a scheduled maintenance on 17-Nov-2021 (Wednesday) starting 05:00 AM EST till 02:00 PM EST. During this maintenance window both Hosted Chef API and Hosted Chef Web Console will be unavailable.<br />We appreciate your patience and understanding.</p>tag:status.chef.io,2005:Incident/78850402021-08-31T16:36:01-07:002021-08-31T16:36:02-07:00Timeouts and failed requests for package distribution infrastructure<p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>16:36</var> PDT</small><br><strong>Resolved</strong> - Vendor has resolved their incident.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>14:46</var> PDT</small><br><strong>Update</strong> - Error rates have improved for package distribution infrastructure. We will continue to monitor the upstream outage.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>14:36</var> PDT</small><br><strong>Monitoring</strong> - We have implemented a workaround which should alleviate timeouts and error rates. We are continuing to monitor the upstream vendor outage.</p><p><small>Aug <var data-var='date'>31</var>, <var data-var='time'>12:00</var> PDT</small><br><strong>Identified</strong> - We are experiencing network performance degradation due to a vendor.</p>tag:status.chef.io,2005:Incident/75499682021-07-20T06:49:32-07:002021-07-20T06:49:33-07:00Upgrading package-router backend infrastructure<p><small>Jul <var data-var='date'>20</var>, <var data-var='time'>06:49</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jul <var data-var='date'>20</var>, <var data-var='time'>06:49</var> PDT</small><br><strong>Update</strong> - Scheduled maintenance is still in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>20</var>, <var data-var='time'>06:30</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jul <var data-var='date'>19</var>, <var data-var='time'>13:57</var> PDT</small><br><strong>Scheduled</strong> - packages.chef.io will undergo maintenance at this time</p>tag:status.chef.io,2005:Incident/73157392021-06-23T13:26:33-07:002021-06-23T13:26:33-07:00Chef Package Distribution Outage<p><small>Jun <var data-var='date'>23</var>, <var data-var='time'>13:26</var> PDT</small><br><strong>Resolved</strong> - This incident has been resolved.</p><p><small>Jun <var data-var='date'>23</var>, <var data-var='time'>12:58</var> PDT</small><br><strong>Investigating</strong> - We are facing issues with our Package Distribution Infrastructure.<br />We are Working on identifying the issue and a resolution.</p>tag:status.chef.io,2005:Incident/70931902021-06-02T10:00:29-07:002021-06-02T10:00:31-07:00Learn Chef Upgrade<p><small>Jun <var data-var='date'> 2</var>, <var data-var='time'>10:00</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'> 2</var>, <var data-var='time'>00:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'>26</var>, <var data-var='time'>11:46</var> PDT</small><br><strong>Scheduled</strong> - Our vendor is performing a major version upgrade to learn.chef.io beginning at 7am UTC (3am Eastern US, 12am Pacific) on June 2nd, 2021, and the site will be offline.<br /><br />The upgrade is anticipated to take between 8 and 10 hours, and will result in a full outage for learn.chef.io.<br /><br />An un-branded, generic landing page will be displayed for all visitors while the maintenance is ongoing, which may cause user confusion.</p>tag:status.chef.io,2005:Incident/68076272021-04-21T15:20:02-07:002021-04-21T15:20:03-07:00Increased Error rate 5xx on Hosted Chef (api.chef.io/manage.chef.io)<p><small>Apr <var data-var='date'>21</var>, <var data-var='time'>15:20</var> PDT</small><br><strong>Resolved</strong> - We have fixed the issue and Error rate is close to 0. We will continue to monitor for a while.<br />Thank you for your patience.</p><p><small>Apr <var data-var='date'>21</var>, <var data-var='time'>13:14</var> PDT</small><br><strong>Update</strong> - We have not been able to fix the issue yet and are continuing our work to resolve the issue.<br />Thanks for being patient.</p><p><small>Apr <var data-var='date'>21</var>, <var data-var='time'>10:57</var> PDT</small><br><strong>Identified</strong> - We are facing increased 5xx Error rate on Hosted Chef.<br />We have identified the problem and are working to resolve the issue.<br />We will keep you updated.</p>tag:status.chef.io,2005:Incident/65122952021-03-25T09:00:30-07:002021-03-25T09:00:31-07:00Hosted Chef Maintenance<p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>09:00</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'>25</var>, <var data-var='time'>07:30</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'>11</var>, <var data-var='time'>23:30</var> PST</small><br><strong>Scheduled</strong> - We will be undergoing a scheduled maintenance on 25th March 2021 at 7:30 AM PST.<br />You might experience 5xx errors on chef client runs during the maintenance window.</p>tag:status.chef.io,2005:Incident/65036132021-03-10T23:32:44-08:002021-03-10T23:32:44-08:00Increased Error rate 5xx on Hosted Chef (api.chef.io)<p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>23:32</var> PST</small><br><strong>Resolved</strong> - The issue has been resolved.<br />We were facing error with our indexing cluster and that lead to increased 5xx for the API calls.</p><p><small>Mar <var data-var='date'>10</var>, <var data-var='time'>22:09</var> PST</small><br><strong>Investigating</strong> - We are currently investigating increased error rate in Hosted Chef.<br />We will keep you posted.</p>tag:status.chef.io,2005:Incident/64570812021-03-08T03:15:29-08:002021-03-08T03:15:30-08:00Supermarket Maintenance<p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>03:15</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Mar <var data-var='date'> 8</var>, <var data-var='time'>02:16</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Mar <var data-var='date'> 4</var>, <var data-var='time'>15:43</var> PST</small><br><strong>Scheduled</strong> - Supermarket will be undergoing maintenance. There may be a brief outage during the maintenance window.</p>tag:status.chef.io,2005:Incident/60878782021-01-27T08:08:01-08:002021-01-27T08:08:01-08:00Hosted Chef Maintenance<p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>08:08</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>08:03</var> PST</small><br><strong>Update</strong> - Scheduled maintenance is still in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>27</var>, <var data-var='time'>07:30</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Jan <var data-var='date'>22</var>, <var data-var='time'>09:00</var> PST</small><br><strong>Scheduled</strong> - Hosted Chef will be undergoing maintenance to its Database servers. There will be an outage for 2 - 4 hours during the maintenance window.</p>tag:status.chef.io,2005:Incident/55444472020-11-16T09:40:20-08:002020-11-16T09:40:21-08:00packages.chef.io Maintenance<p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>09:40</var> PST</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Nov <var data-var='date'>16</var>, <var data-var='time'>09:00</var> PST</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>Nov <var data-var='date'>11</var>, <var data-var='time'>15:12</var> PST</small><br><strong>Scheduled</strong> - Will will be migrating packages.chef.io to a new backend infrastructure.</p>tag:status.chef.io,2005:Incident/45143932020-07-02T08:46:14-07:002020-07-02T08:46:15-07:00Hosted Chef - Manage UI is not saving/loading attributes<p><small>Jul <var data-var='date'> 2</var>, <var data-var='time'>08:46</var> PDT</small><br><strong>Resolved</strong> - We have deployed a previous release of Manage to Hosted Chef to fix the UI bug until we can fix it in the latest version of manage.</p><p><small>Jul <var data-var='date'> 2</var>, <var data-var='time'>05:22</var> PDT</small><br><strong>Investigating</strong> - We are investigating an issue with Hosted Chef - Manage UI functionality. <br /><br />Please note this does not affect the Hosted Chef API and Knife functionality is still available.</p>tag:status.chef.io,2005:Incident/41206302020-06-01T10:45:47-07:002020-06-01T10:45:48-07:00Hosted Chef Database Maintenance<p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>10:45</var> PDT</small><br><strong>Completed</strong> - The scheduled maintenance has been completed.</p><p><small>Jun <var data-var='date'> 1</var>, <var data-var='time'>09:00</var> PDT</small><br><strong>In progress</strong> - Scheduled maintenance is currently in progress. We will provide updates as necessary.</p><p><small>May <var data-var='date'>15</var>, <var data-var='time'>13:02</var> PDT</small><br><strong>Scheduled</strong> - We are migrating our database to a new backend engine. While the window is scheduled for 2 hours, based on previous testing and completed work we anticipate the service will only be unavailable for approximately 20 minutes during this window.</p>