Incidents reported on status page for Breww https://status.breww.com/ https://d1lppblt9t2x15.cloudfront.net/logos/bcbce6aaceff8f8e21cda27c6763cbfa.png https://status.breww.com/ en https://status.breww.com/incident/601405 Sat, 28 Jun 2025 22:00:00 +0000 https://status.breww.com/incident/601405#02c33c4417a5a86e31317125bf0329433672baa519e26ecc58d918f5b21d91ee Maintenance completed https://status.breww.com/incident/601405 Sat, 28 Jun 2025 22:00:00 +0000 https://status.breww.com/incident/601405#02c33c4417a5a86e31317125bf0329433672baa519e26ecc58d918f5b21d91ee Maintenance completed https://status.breww.com/incident/601405 Sat, 28 Jun 2025 22:00:00 +0000 https://status.breww.com/incident/601405#02c33c4417a5a86e31317125bf0329433672baa519e26ecc58d918f5b21d91ee Maintenance completed https://status.breww.com/incident/601405 Sat, 28 Jun 2025 22:00:00 +0000 https://status.breww.com/incident/601405#02c33c4417a5a86e31317125bf0329433672baa519e26ecc58d918f5b21d91ee Maintenance completed https://status.breww.com/incident/601405 Sat, 28 Jun 2025 21:00:00 -0000 https://status.breww.com/incident/601405#b8ad35fbe4c2932ead5dc5b3884245aa4ea34f20be106c9bfb55f49dcb69e540 For more information and if you have any questions, please see our [Breww Community announcement thread](https://community.breww.com/t/scheduled-maintenance-with-short-downtime-weekend-of-28-29th-june-2025/6039). We're pleased to confirm that the maintenance is complete now. https://status.breww.com/incident/601405 Sat, 28 Jun 2025 21:00:00 -0000 https://status.breww.com/incident/601405#b8ad35fbe4c2932ead5dc5b3884245aa4ea34f20be106c9bfb55f49dcb69e540 For more information and if you have any questions, please see our [Breww Community announcement thread](https://community.breww.com/t/scheduled-maintenance-with-short-downtime-weekend-of-28-29th-june-2025/6039). We're pleased to confirm that the maintenance is complete now. https://status.breww.com/incident/601405 Sat, 28 Jun 2025 21:00:00 -0000 https://status.breww.com/incident/601405#b8ad35fbe4c2932ead5dc5b3884245aa4ea34f20be106c9bfb55f49dcb69e540 For more information and if you have any questions, please see our [Breww Community announcement thread](https://community.breww.com/t/scheduled-maintenance-with-short-downtime-weekend-of-28-29th-june-2025/6039). We're pleased to confirm that the maintenance is complete now. https://status.breww.com/incident/601405 Sat, 28 Jun 2025 21:00:00 -0000 https://status.breww.com/incident/601405#b8ad35fbe4c2932ead5dc5b3884245aa4ea34f20be106c9bfb55f49dcb69e540 For more information and if you have any questions, please see our [Breww Community announcement thread](https://community.breww.com/t/scheduled-maintenance-with-short-downtime-weekend-of-28-29th-june-2025/6039). We're pleased to confirm that the maintenance is complete now. https://status.breww.com/incident/601873 Thu, 12 Jun 2025 19:43:00 -0000 https://status.breww.com/incident/601873#e0a5df161a79fc3dc4b758fd597cc912e698f1e24874d6f8c438f3a5ab1d6669 Google appears to have resolved their issue, so everything should be back to normal again. We're really sorry for any inconvenience that this issue may have caused you. https://status.breww.com/incident/601873 Thu, 12 Jun 2025 19:00:00 -0000 https://status.breww.com/incident/601873#1e82e0a8eb3c71c0ac8d1bd298d9550d4b2e59c0cc7f879d876bf9fbddc6eb85 Google have now [officially acknowledged the issue](https://status.cloud.google.com/incidents/ow5i3PPK96RduMcb1SsW), which confirms this as the cause and that we do, at least, know that they are working on a solution. We'll update you here when we know more. We're really sorry for any impact this is having on you. https://status.breww.com/incident/601873 Thu, 12 Jun 2025 18:24:00 -0000 https://status.breww.com/incident/601873#534d33cfbb9b7f98f6ac57419323349c4a337004d1e9184a87047e7ff1beea77 We're aware of an issue with Google Cloud, which is impacting some functionality within Breww. Fortunately, we don't rely on Google Cloud for many things, but their outage is causing some issues, such as label/invoice printing. Google [haven't publicly acknowledged the issue at this time](https://status.cloud.google.com/index.html), but [X.com is full of others reporting the same issue](https://x.com/search?q=google%20cloud&src=typed_query), so we're confident that this is an issue with them, rather than something directly in our control. We're exploring issues to work around their outage and restore full service to Breww. https://status.breww.com/ Wed, 11 Jun 2025 11:48:13 +0000 https://status.breww.com/#c957a5c9b03c7a0fe2c0f04facfc98c8ab0a8de33e45375724dd362391d857e3 Urgent background task processing recovered https://status.breww.com/ Wed, 11 Jun 2025 11:40:47 +0000 https://status.breww.com/#c957a5c9b03c7a0fe2c0f04facfc98c8ab0a8de33e45375724dd362391d857e3 Urgent background task processing went down https://status.breww.com/ Thu, 17 Apr 2025 08:01:58 +0000 https://status.breww.com/#cf4aa3bbd053dd26e2dca911924d1819b9a4fa66a5b7be8998dcbf6658f17053 Breww public API recovered https://status.breww.com/ Thu, 17 Apr 2025 07:56:43 +0000 https://status.breww.com/#7820693f49953a9e7c53063964c9528b77ac84d6161f94c312a7a6eee4d21428 Breww core platform (inc. mobile app) recovered https://status.breww.com/ Thu, 17 Apr 2025 07:52:54 +0000 https://status.breww.com/#cf4aa3bbd053dd26e2dca911924d1819b9a4fa66a5b7be8998dcbf6658f17053 Breww public API went down https://status.breww.com/ Thu, 17 Apr 2025 07:51:39 +0000 https://status.breww.com/#7820693f49953a9e7c53063964c9528b77ac84d6161f94c312a7a6eee4d21428 Breww core platform (inc. mobile app) went down https://status.breww.com/ Wed, 16 Apr 2025 05:24:04 +0000 https://status.breww.com/#5a61c9b63b1e54e8348a5d563f7950afd815acee1206c7301c9947fa7c7568df Breww public API recovered https://status.breww.com/ Wed, 16 Apr 2025 05:15:45 +0000 https://status.breww.com/#adb75508166c859f539a64a908a0714c2a3c86bc1b373e3d80e9834565fe7369 Breww core platform (inc. mobile app) recovered https://status.breww.com/ Wed, 16 Apr 2025 05:10:03 +0000 https://status.breww.com/#5a61c9b63b1e54e8348a5d563f7950afd815acee1206c7301c9947fa7c7568df Breww public API went down https://status.breww.com/ Wed, 16 Apr 2025 05:07:15 +0000 https://status.breww.com/#adb75508166c859f539a64a908a0714c2a3c86bc1b373e3d80e9834565fe7369 Breww core platform (inc. mobile app) went down https://status.breww.com/incident/546060 Wed, 16 Apr 2025 05:00:00 -0000 https://status.breww.com/incident/546060#4159708bc7123f8fc99a06f55267340b4d3645d1cbebd988bef1fdb7dde10648 We experience a short period of service interruption this morning that started around the same time as the issue yesterday. We’re working with our cloud provider to ensure this doesn’t happen in future. Please accept our apologies for any inconvenience caused. https://status.breww.com/incident/546060 Wed, 16 Apr 2025 05:00:00 -0000 https://status.breww.com/incident/546060#4159708bc7123f8fc99a06f55267340b4d3645d1cbebd988bef1fdb7dde10648 We experience a short period of service interruption this morning that started around the same time as the issue yesterday. We’re working with our cloud provider to ensure this doesn’t happen in future. Please accept our apologies for any inconvenience caused. https://status.breww.com/incident/546060 Wed, 16 Apr 2025 05:00:00 -0000 https://status.breww.com/incident/546060#4159708bc7123f8fc99a06f55267340b4d3645d1cbebd988bef1fdb7dde10648 We experience a short period of service interruption this morning that started around the same time as the issue yesterday. We’re working with our cloud provider to ensure this doesn’t happen in future. Please accept our apologies for any inconvenience caused. https://status.breww.com/incident/546060 Wed, 16 Apr 2025 05:00:00 -0000 https://status.breww.com/incident/546060#4159708bc7123f8fc99a06f55267340b4d3645d1cbebd988bef1fdb7dde10648 We experience a short period of service interruption this morning that started around the same time as the issue yesterday. We’re working with our cloud provider to ensure this doesn’t happen in future. Please accept our apologies for any inconvenience caused. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 07:33:00 -0000 https://status.breww.com/incident/545433#5a4149c4515b8be62d5db8b6ed038460e76963e201458ba21029ba89bddbf2b1 We're pleased to confirm that this incident is now resolved. We hope this hasn't caused you too much inconvenience and sincerely apologise for the inconvenience that has been caused. We'll speak to our cloud provider for a full post-mortem and to find out what is being done to ensure this doesn't happen again in the future. Thank you, everyone, for your understanding. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 07:33:00 -0000 https://status.breww.com/incident/545433#5a4149c4515b8be62d5db8b6ed038460e76963e201458ba21029ba89bddbf2b1 We're pleased to confirm that this incident is now resolved. We hope this hasn't caused you too much inconvenience and sincerely apologise for the inconvenience that has been caused. We'll speak to our cloud provider for a full post-mortem and to find out what is being done to ensure this doesn't happen again in the future. Thank you, everyone, for your understanding. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 07:33:00 -0000 https://status.breww.com/incident/545433#5a4149c4515b8be62d5db8b6ed038460e76963e201458ba21029ba89bddbf2b1 We're pleased to confirm that this incident is now resolved. We hope this hasn't caused you too much inconvenience and sincerely apologise for the inconvenience that has been caused. We'll speak to our cloud provider for a full post-mortem and to find out what is being done to ensure this doesn't happen again in the future. Thank you, everyone, for your understanding. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 07:33:00 -0000 https://status.breww.com/incident/545433#5a4149c4515b8be62d5db8b6ed038460e76963e201458ba21029ba89bddbf2b1 We're pleased to confirm that this incident is now resolved. We hope this hasn't caused you too much inconvenience and sincerely apologise for the inconvenience that has been caused. We'll speak to our cloud provider for a full post-mortem and to find out what is being done to ensure this doesn't happen again in the future. Thank you, everyone, for your understanding. https://status.breww.com/ Tue, 15 Apr 2025 07:00:29 +0000 https://status.breww.com/#9d4523d0915e82a725685c6d00a758da7b081df9b815582680b86fa1c7910779 Urgent background task processing recovered https://status.breww.com/ Tue, 15 Apr 2025 07:00:26 +0000 https://status.breww.com/#32c56120ae1e39f6ae24572e67bbe6e548eb13799a1e015695892723fac64516 Non-urgent background task processing recovered https://status.breww.com/ Tue, 15 Apr 2025 06:52:32 +0000 https://status.breww.com/#ecc01d632b4b32ef67dd10f9d5ee5268433620d9c891ebcde1c25c0312708830 Breww public API recovered https://status.breww.com/ Tue, 15 Apr 2025 06:41:29 +0000 https://status.breww.com/#86a8c5162a40f3354918886eba964216ae0f86ee41052bc82845b3d3e7cd9186 Breww core platform (inc. mobile app) recovered https://status.breww.com/ Tue, 15 Apr 2025 06:38:32 +0000 https://status.breww.com/#ecc01d632b4b32ef67dd10f9d5ee5268433620d9c891ebcde1c25c0312708830 Breww public API went down https://status.breww.com/ Tue, 15 Apr 2025 06:33:47 +0000 https://status.breww.com/#86a8c5162a40f3354918886eba964216ae0f86ee41052bc82845b3d3e7cd9186 Breww core platform (inc. mobile app) went down https://status.breww.com/ Tue, 15 Apr 2025 06:32:31 +0000 https://status.breww.com/#4981918aff7b38a6dbb4f59e4eec955ea4126ef3839fd83fdf42939eaa0c086a Breww public API recovered https://status.breww.com/ Tue, 15 Apr 2025 06:31:58 +0000 https://status.breww.com/#ed78889cad585b0c56c4e1efee5d00ddc44f66ee19dda354ab86704dbee37320 Breww core platform (inc. mobile app) recovered https://status.breww.com/ Tue, 15 Apr 2025 06:23:34 +0000 https://status.breww.com/#4981918aff7b38a6dbb4f59e4eec955ea4126ef3839fd83fdf42939eaa0c086a Breww public API went down https://status.breww.com/ Tue, 15 Apr 2025 06:17:31 +0000 https://status.breww.com/#f8aed14360ec8e1b931e24f2e85c0cf14da1543c0d5151d32d3a8705d682cba2 Breww public API recovered https://status.breww.com/ Tue, 15 Apr 2025 06:04:46 +0000 https://status.breww.com/#ed78889cad585b0c56c4e1efee5d00ddc44f66ee19dda354ab86704dbee37320 Breww core platform (inc. mobile app) went down https://status.breww.com/ Tue, 15 Apr 2025 06:02:48 +0000 https://status.breww.com/#dd62572625d521441027d6ff6437bfd41c754a7daabbadce8362eb69061fd028 Breww core platform (inc. mobile app) recovered https://status.breww.com/ Tue, 15 Apr 2025 05:49:51 +0000 https://status.breww.com/#dd62572625d521441027d6ff6437bfd41c754a7daabbadce8362eb69061fd028 Breww core platform (inc. mobile app) went down https://status.breww.com/ Tue, 15 Apr 2025 05:44:50 +0000 https://status.breww.com/#43ab8c832a785c3678b1aaab9a890413c56817038ade41a9ad51be0691ec01af Breww core platform (inc. mobile app) recovered https://status.breww.com/incident/545433 Tue, 15 Apr 2025 05:32:00 -0000 https://status.breww.com/incident/545433#236b653f74f2d5e7c15256717770e9879cb58e77f21d6e1d51fe893ebb8434c8 The issue appears to be a networking issue in our primary data centre (provided by DigitalOcean). Unfortunately, as this isn't a problem with any of our own systems, we're in their hands to wait for the fix. We've contacted them urgently to ensure they're working on it, but we're sure this will have been picked up by their internal monitoring, and they will no doubt be working on a resolution already. It appears that some page loads are working without an issue, so please keep trying. We'll do what we can to minimise the impact of this issue. Please accept our apologies for the inconvenience this is causing. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 05:32:00 -0000 https://status.breww.com/incident/545433#236b653f74f2d5e7c15256717770e9879cb58e77f21d6e1d51fe893ebb8434c8 The issue appears to be a networking issue in our primary data centre (provided by DigitalOcean). Unfortunately, as this isn't a problem with any of our own systems, we're in their hands to wait for the fix. We've contacted them urgently to ensure they're working on it, but we're sure this will have been picked up by their internal monitoring, and they will no doubt be working on a resolution already. It appears that some page loads are working without an issue, so please keep trying. We'll do what we can to minimise the impact of this issue. Please accept our apologies for the inconvenience this is causing. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 05:32:00 -0000 https://status.breww.com/incident/545433#236b653f74f2d5e7c15256717770e9879cb58e77f21d6e1d51fe893ebb8434c8 The issue appears to be a networking issue in our primary data centre (provided by DigitalOcean). Unfortunately, as this isn't a problem with any of our own systems, we're in their hands to wait for the fix. We've contacted them urgently to ensure they're working on it, but we're sure this will have been picked up by their internal monitoring, and they will no doubt be working on a resolution already. It appears that some page loads are working without an issue, so please keep trying. We'll do what we can to minimise the impact of this issue. Please accept our apologies for the inconvenience this is causing. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 05:32:00 -0000 https://status.breww.com/incident/545433#236b653f74f2d5e7c15256717770e9879cb58e77f21d6e1d51fe893ebb8434c8 The issue appears to be a networking issue in our primary data centre (provided by DigitalOcean). Unfortunately, as this isn't a problem with any of our own systems, we're in their hands to wait for the fix. We've contacted them urgently to ensure they're working on it, but we're sure this will have been picked up by their internal monitoring, and they will no doubt be working on a resolution already. It appears that some page loads are working without an issue, so please keep trying. We'll do what we can to minimise the impact of this issue. Please accept our apologies for the inconvenience this is causing. https://status.breww.com/ Tue, 15 Apr 2025 05:30:39 +0000 https://status.breww.com/#32c56120ae1e39f6ae24572e67bbe6e548eb13799a1e015695892723fac64516 Non-urgent background task processing went down https://status.breww.com/ Tue, 15 Apr 2025 05:28:36 +0000 https://status.breww.com/#f8aed14360ec8e1b931e24f2e85c0cf14da1543c0d5151d32d3a8705d682cba2 Breww public API went down https://status.breww.com/ Tue, 15 Apr 2025 05:24:48 +0000 https://status.breww.com/#43ab8c832a785c3678b1aaab9a890413c56817038ade41a9ad51be0691ec01af Breww core platform (inc. mobile app) went down https://status.breww.com/ Tue, 15 Apr 2025 05:10:39 +0000 https://status.breww.com/#9d4523d0915e82a725685c6d00a758da7b081df9b815582680b86fa1c7910779 Urgent background task processing went down https://status.breww.com/incident/545433 Tue, 15 Apr 2025 05:00:00 -0000 https://status.breww.com/incident/545433#6e160ee0e534f19a271878c188e769861ab0a5938c916b2fd5c1ddf2ed65f271 We are currently experiencing a service outage affecting all users. Our engineering team is actively investigating the issue and working to restore access as soon as possible. We will provide updates here as we learn more. Thank you for your patience and understanding. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 05:00:00 -0000 https://status.breww.com/incident/545433#6e160ee0e534f19a271878c188e769861ab0a5938c916b2fd5c1ddf2ed65f271 We are currently experiencing a service outage affecting all users. Our engineering team is actively investigating the issue and working to restore access as soon as possible. We will provide updates here as we learn more. Thank you for your patience and understanding. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 05:00:00 -0000 https://status.breww.com/incident/545433#6e160ee0e534f19a271878c188e769861ab0a5938c916b2fd5c1ddf2ed65f271 We are currently experiencing a service outage affecting all users. Our engineering team is actively investigating the issue and working to restore access as soon as possible. We will provide updates here as we learn more. Thank you for your patience and understanding. https://status.breww.com/incident/545433 Tue, 15 Apr 2025 05:00:00 -0000 https://status.breww.com/incident/545433#6e160ee0e534f19a271878c188e769861ab0a5938c916b2fd5c1ddf2ed65f271 We are currently experiencing a service outage affecting all users. Our engineering team is actively investigating the issue and working to restore access as soon as possible. We will provide updates here as we learn more. Thank you for your patience and understanding. https://status.breww.com/ Fri, 04 Apr 2025 06:57:28 +0000 https://status.breww.com/#3c4313ec11b5ac6ec903d6ac7d6cbf07f887a3863927b4955f68d6c273fde786 Non-urgent background task processing recovered https://status.breww.com/ Fri, 04 Apr 2025 06:40:30 +0000 https://status.breww.com/#3c4313ec11b5ac6ec903d6ac7d6cbf07f887a3863927b4955f68d6c273fde786 Non-urgent background task processing went down https://status.breww.com/incident/457295 Thu, 07 Nov 2024 01:58:00 -0000 https://status.breww.com/incident/457295#a7bd873e680275f718f9385a0b78232bb251e9e908acb8a268fe3ee78cb4e7c2 The upstream issue appears to be resolved now. We will continue to monitor for future issues and again please accept our apologies for any inconvenience that this may have caused you. https://status.breww.com/incident/457295 Thu, 07 Nov 2024 01:58:00 -0000 https://status.breww.com/incident/457295#a7bd873e680275f718f9385a0b78232bb251e9e908acb8a268fe3ee78cb4e7c2 The upstream issue appears to be resolved now. We will continue to monitor for future issues and again please accept our apologies for any inconvenience that this may have caused you. https://status.breww.com/incident/457295 Thu, 07 Nov 2024 01:30:00 -0000 https://status.breww.com/incident/457295#801089c88cc1ebf499e6e420a495855160707473363738e207ef7e7f39f7fff4 We're aware of some connection timeout issues and are actively investigating. It would appear to be a connectivity issue with our primary cloud hosting provider (Digitalocean). We're in contact with them to ensure that they are aware of their issue and working on a fix. We're really sorry for any inconvenience that this might be causing you and hope to have this resolved promptly, but the issue appears to be out of our control at this time. https://status.breww.com/incident/457295 Thu, 07 Nov 2024 01:30:00 -0000 https://status.breww.com/incident/457295#801089c88cc1ebf499e6e420a495855160707473363738e207ef7e7f39f7fff4 We're aware of some connection timeout issues and are actively investigating. It would appear to be a connectivity issue with our primary cloud hosting provider (Digitalocean). We're in contact with them to ensure that they are aware of their issue and working on a fix. We're really sorry for any inconvenience that this might be causing you and hope to have this resolved promptly, but the issue appears to be out of our control at this time. https://status.breww.com/incident/431017 Sat, 05 Oct 2024 21:30:00 +0000 https://status.breww.com/incident/431017#64630433e0b48263fdca9859d689fa670b7333ec4fcb5b1ecd2230ee3bcaa582 Maintenance completed https://status.breww.com/incident/431017 Sat, 05 Oct 2024 21:30:00 +0000 https://status.breww.com/incident/431017#64630433e0b48263fdca9859d689fa670b7333ec4fcb5b1ecd2230ee3bcaa582 Maintenance completed https://status.breww.com/incident/431017 Sat, 05 Oct 2024 21:30:00 +0000 https://status.breww.com/incident/431017#64630433e0b48263fdca9859d689fa670b7333ec4fcb5b1ecd2230ee3bcaa582 Maintenance completed https://status.breww.com/incident/431017 Sat, 05 Oct 2024 21:30:00 +0000 https://status.breww.com/incident/431017#64630433e0b48263fdca9859d689fa670b7333ec4fcb5b1ecd2230ee3bcaa582 Maintenance completed https://status.breww.com/incident/431017 Sat, 05 Oct 2024 21:00:00 -0000 https://status.breww.com/incident/431017#c21a326aefa24a7dcb2351335a9203ac15688d4110d43fb9bfa69a2784533157 We will be performing scheduled maintenance over the weekend of 5th/6th October 2024, which will require a short period of downtime. More details can be found at https://community.breww.com/t/scheduled-maintenance-with-short-downtime-weekend-of-5th-6th-october-2024/4915 https://status.breww.com/incident/431017 Sat, 05 Oct 2024 21:00:00 -0000 https://status.breww.com/incident/431017#c21a326aefa24a7dcb2351335a9203ac15688d4110d43fb9bfa69a2784533157 We will be performing scheduled maintenance over the weekend of 5th/6th October 2024, which will require a short period of downtime. More details can be found at https://community.breww.com/t/scheduled-maintenance-with-short-downtime-weekend-of-5th-6th-october-2024/4915 https://status.breww.com/incident/431017 Sat, 05 Oct 2024 21:00:00 -0000 https://status.breww.com/incident/431017#c21a326aefa24a7dcb2351335a9203ac15688d4110d43fb9bfa69a2784533157 We will be performing scheduled maintenance over the weekend of 5th/6th October 2024, which will require a short period of downtime. More details can be found at https://community.breww.com/t/scheduled-maintenance-with-short-downtime-weekend-of-5th-6th-october-2024/4915 https://status.breww.com/incident/431017 Sat, 05 Oct 2024 21:00:00 -0000 https://status.breww.com/incident/431017#c21a326aefa24a7dcb2351335a9203ac15688d4110d43fb9bfa69a2784533157 We will be performing scheduled maintenance over the weekend of 5th/6th October 2024, which will require a short period of downtime. More details can be found at https://community.breww.com/t/scheduled-maintenance-with-short-downtime-weekend-of-5th-6th-october-2024/4915 https://status.breww.com/incident/365583 Mon, 06 May 2024 18:00:00 +0000 https://status.breww.com/incident/365583#96be16266e9684e0caf50293977150f9e82230fb411f399478a429b6a1b18695 Maintenance completed https://status.breww.com/incident/365583 Mon, 06 May 2024 18:00:00 +0000 https://status.breww.com/incident/365583#96be16266e9684e0caf50293977150f9e82230fb411f399478a429b6a1b18695 Maintenance completed https://status.breww.com/incident/365583 Mon, 06 May 2024 16:00:00 -0000 https://status.breww.com/incident/365583#dcf5c05be6d37b26f8be9930aa1f3916966bfcfab279f0edf1b607307ea19edb We're performing some vital planned platform upgrades, which we anticipate will result in short periods of intermittent connectivity or error messages. We'll be starting the upgrades at 5pm UK time and expect them to take no more than 2 hours. Please don't worry if you see error pages during this time; please just wait a few minutes and try again. We're sorry for any inconvenience that this might cause you but we're confident that you'll find the improvements beneficial. **7:05pm - Maintenance is completed. Thank you for your patience and understanding if you received any error messages during this time** https://status.breww.com/incident/365583 Mon, 06 May 2024 16:00:00 -0000 https://status.breww.com/incident/365583#dcf5c05be6d37b26f8be9930aa1f3916966bfcfab279f0edf1b607307ea19edb We're performing some vital planned platform upgrades, which we anticipate will result in short periods of intermittent connectivity or error messages. We'll be starting the upgrades at 5pm UK time and expect them to take no more than 2 hours. Please don't worry if you see error pages during this time; please just wait a few minutes and try again. We're sorry for any inconvenience that this might cause you but we're confident that you'll find the improvements beneficial. **7:05pm - Maintenance is completed. Thank you for your patience and understanding if you received any error messages during this time** https://status.breww.com/incident/354039 Thu, 11 Apr 2024 11:15:00 -0000 https://status.breww.com/incident/354039#5940f970e6f56d4d98e14237ffc49821dab6599278f5c7d8dc04a41b2e773b19 We're really sorry, but we had a problem with allowing you to make changes to your data. Breww was fully usable in a "view-only" capacity, but most data "writes" were failing. The issue started around midnight and lasted until just before 7:30am (UK time). The issue was caused by one of our security mechanisms (known as CSRF) erroneously rejecting user's requests to apply changes to their data. When you send data update requests to Breww, we verify that they come from a trusted source. This check thought the requests were not to be trusted, even though they were, in fact, from trusted sources. We have extensive monitoring of our systems in place to ensure that we know about any issues with our platform. This monitoring will wake our team up in the middle of the night if needed. Unfortunately, our monitoring didn't detect this issue, so it didn't wake us up to fix it. This is why the problem took so long to be fixed. Once our team was aware of the problem, it was resolved within 10 minutes. ### Why did it occur in the first place? Ironically, we had deployed a change intended to improve reliability, which we deliberately made during the period of the day when Breww is at its quietest - which is late evening for our UK-based team. The change was well tested in our non-production environments, but due to some differing characteristics of our production environment, related to how the web application firewall (WAF) and reverse proxies work together, an HTTP header was being dropped that wasn't dropped in the other environments. This caused the CSRF checks to reject the requests to change data. Due to the nature of the update, we also had it planned for Breww's quietest period to reduce the impact of any expected problems. This was unfortunate in this case as the change appeared to have worked perfectly, so our team went to bed unaware of these problems. We hadn't in any way anticipated that it would cause the problems that it did in the way it did, so after the change seemed to go live successfully, and because we didn't encounter any problems during the testing in our non-production environment, we were happy that all was well. As we have customers all around the world, but we're based in the UK, our out-of-hours, isn't out-of-hours for everyone. ### Going forward This became such a significant problem as we were not alerted to the problem by our monitoring. This is arguably the biggest failing here. We'll be introducing new monitoring metrics to detect issues like this in the future and ensure the team is notified (and woken up if required). We're going to start monitoring application response codes for elevated levels/spikes, and ensure this triggers the same processes as so many other already-monitored metrics do. ### We're sorry We hold our hands up. We let you down today. We know that Breww is vital to your business and that issues like this are not acceptable. We've already learnt from it and will have processes/monitoring improved very soon. We appreciate all the kind messages and thank you for being so understanding that problems do happen despite our best efforts. This will only make Breww stronger and more resilient going forward. https://status.breww.com/incident/325391 Sun, 11 Feb 2024 23:30:00 +0000 https://status.breww.com/incident/325391#1b6be9c012c2a2b4498ba677ab8f6117b1afbce110c3251ea6a6194564d3c71f Maintenance completed https://status.breww.com/incident/325391 Sun, 11 Feb 2024 23:30:00 +0000 https://status.breww.com/incident/325391#1b6be9c012c2a2b4498ba677ab8f6117b1afbce110c3251ea6a6194564d3c71f Maintenance completed https://status.breww.com/incident/325391 Sun, 11 Feb 2024 22:20:00 -0000 https://status.breww.com/incident/325391#5c242d694146691c4306f57e33f3dbabc5cbce7ffe73f028392e66c0114b1173 We're installing updates to our server infrastructure to ensure it remains secure and reliable. We don't anticipate any issues using Breww, but short moments of connectivity issues are possible. https://status.breww.com/incident/325391 Sun, 11 Feb 2024 22:20:00 -0000 https://status.breww.com/incident/325391#5c242d694146691c4306f57e33f3dbabc5cbce7ffe73f028392e66c0114b1173 We're installing updates to our server infrastructure to ensure it remains secure and reliable. We don't anticipate any issues using Breww, but short moments of connectivity issues are possible. https://status.breww.com/incident/305609 Wed, 27 Dec 2023 23:07:00 +0000 https://status.breww.com/incident/305609#7c8cf90a8cd04289d9a7812d985053fe89cc06e34ac43e372af779487c63bac6 Maintenance completed https://status.breww.com/incident/305609 Wed, 27 Dec 2023 23:07:00 +0000 https://status.breww.com/incident/305609#7c8cf90a8cd04289d9a7812d985053fe89cc06e34ac43e372af779487c63bac6 Maintenance completed https://status.breww.com/incident/305609 Wed, 27 Dec 2023 22:00:00 -0000 https://status.breww.com/incident/305609#a45df8129889fc702a11e8a956e2a64a5204e9c87dcd2e245ebb1fb3f2857604 You may see some error messages while we upgrade some of our server infrastructure. We don't expect this to last longer than about 15 minutes. https://status.breww.com/incident/305609 Wed, 27 Dec 2023 22:00:00 -0000 https://status.breww.com/incident/305609#a45df8129889fc702a11e8a956e2a64a5204e9c87dcd2e245ebb1fb3f2857604 You may see some error messages while we upgrade some of our server infrastructure. We don't expect this to last longer than about 15 minutes. https://status.breww.com/incident/275376 Fri, 20 Oct 2023 11:57:00 -0000 https://status.breww.com/incident/275376#fa976fe0eab853cf3bbeed113c268215bcce539f93058c018dc1d3787a574e50 We had a short period (approx 15 minutes) or unreliable access to Breww, which appears to be resolved fully now. During this time some pages worked fine and some would fail. We believe the root cause of this problem to be with Cloudflare and can confirm that there were no issues with Breww's own infrastructure during this time. We're continuing to monitor the situation and ensure full connectivity is and remains restored. We're really sorry for any inconvenience caused by this. https://status.breww.com/incident/275376 Fri, 20 Oct 2023 11:57:00 -0000 https://status.breww.com/incident/275376#fa976fe0eab853cf3bbeed113c268215bcce539f93058c018dc1d3787a574e50 We had a short period (approx 15 minutes) or unreliable access to Breww, which appears to be resolved fully now. During this time some pages worked fine and some would fail. We believe the root cause of this problem to be with Cloudflare and can confirm that there were no issues with Breww's own infrastructure during this time. We're continuing to monitor the situation and ensure full connectivity is and remains restored. We're really sorry for any inconvenience caused by this. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 13:29:00 -0000 https://status.breww.com/incident/243410#4c55f60d40995d1f75738ddd22e2c3ea28b4e7f181b8dc1d0b7ada0c02884d10 We've been advised by our provider that a fix is now in place. We're really sorry for the inconvenience that their outage has caused everyone, and thank you for your patience during this time. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 13:29:00 -0000 https://status.breww.com/incident/243410#4c55f60d40995d1f75738ddd22e2c3ea28b4e7f181b8dc1d0b7ada0c02884d10 We've been advised by our provider that a fix is now in place. We're really sorry for the inconvenience that their outage has caused everyone, and thank you for your patience during this time. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 13:29:00 -0000 https://status.breww.com/incident/243410#4c55f60d40995d1f75738ddd22e2c3ea28b4e7f181b8dc1d0b7ada0c02884d10 We've been advised by our provider that a fix is now in place. We're really sorry for the inconvenience that their outage has caused everyone, and thank you for your patience during this time. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 11:14:00 -0000 https://status.breww.com/incident/243410#0973997d0ec3a7c15b87323ca35ed287b6a5ce45a7bea6a14e3f1a01ac02cb2a And we're back again! We're marking this as degraded until we have official word on a permanent fix from our provider. Apologies again for the inconvenience caused. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 11:14:00 -0000 https://status.breww.com/incident/243410#0973997d0ec3a7c15b87323ca35ed287b6a5ce45a7bea6a14e3f1a01ac02cb2a And we're back again! We're marking this as degraded until we have official word on a permanent fix from our provider. Apologies again for the inconvenience caused. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 11:14:00 -0000 https://status.breww.com/incident/243410#0973997d0ec3a7c15b87323ca35ed287b6a5ce45a7bea6a14e3f1a01ac02cb2a And we're back again! We're marking this as degraded until we have official word on a permanent fix from our provider. Apologies again for the inconvenience caused. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 11:06:00 -0000 https://status.breww.com/incident/243410#30d3441e60bb7711eb4fa738edca9bff07e6eef86129653ed4b0887fbe019735 We're really sorry, but this issue appears to have occurred again. We're still speaking to our cloud provider to ensure this is resolved again promptly. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 11:06:00 -0000 https://status.breww.com/incident/243410#30d3441e60bb7711eb4fa738edca9bff07e6eef86129653ed4b0887fbe019735 We're really sorry, but this issue appears to have occurred again. We're still speaking to our cloud provider to ensure this is resolved again promptly. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 11:06:00 -0000 https://status.breww.com/incident/243410#30d3441e60bb7711eb4fa738edca9bff07e6eef86129653ed4b0887fbe019735 We're really sorry, but this issue appears to have occurred again. We're still speaking to our cloud provider to ensure this is resolved again promptly. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 10:13:00 -0000 https://status.breww.com/incident/243410#7e82e0f06394b9d2e06ce92de0de80b2fcc0a8f81da9f5a16ad29e19e1f90410 Our primary cloud provider has resolved their data connectiveity issue and all Breww services are online again now. We're still speaking to them to understand what went wrong, why, and how this can be prevented in the future. For the related issue with DigitalOcean, please see [their status page updates here](https://status.digitalocean.com/incidents/q4b09b022nmh). Please accept our apologies for this service interuption. The cause was a data connectivity issue with our cloud provider and so both the cause and the fix were out of our hands. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 10:13:00 -0000 https://status.breww.com/incident/243410#7e82e0f06394b9d2e06ce92de0de80b2fcc0a8f81da9f5a16ad29e19e1f90410 Our primary cloud provider has resolved their data connectiveity issue and all Breww services are online again now. We're still speaking to them to understand what went wrong, why, and how this can be prevented in the future. For the related issue with DigitalOcean, please see [their status page updates here](https://status.digitalocean.com/incidents/q4b09b022nmh). Please accept our apologies for this service interuption. The cause was a data connectivity issue with our cloud provider and so both the cause and the fix were out of our hands. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 10:13:00 -0000 https://status.breww.com/incident/243410#7e82e0f06394b9d2e06ce92de0de80b2fcc0a8f81da9f5a16ad29e19e1f90410 Our primary cloud provider has resolved their data connectiveity issue and all Breww services are online again now. We're still speaking to them to understand what went wrong, why, and how this can be prevented in the future. For the related issue with DigitalOcean, please see [their status page updates here](https://status.digitalocean.com/incidents/q4b09b022nmh). Please accept our apologies for this service interuption. The cause was a data connectivity issue with our cloud provider and so both the cause and the fix were out of our hands. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 10:05:00 -0000 https://status.breww.com/incident/243410#0e48e35315eb17e7cea729879adaae01c75c0bfc36e19bf3fa667c19b26583c2 We're in contact with our primary cloud provider (DigitalOcean) to ensure they get this resolved promptly. We are really sorry for the impact this has on you and we know how important it is that this is resolved urgently. The issue isn't within our own infrastructure, which means, unfortunately, that the fix is also something that we're reliant on others to do. Please keep an eye on status.breww.com for updates on this issue. We're working with our cloud provider to ensure this get's resolved promptly. Please accept our apologies for the inconvenience this is causing you. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 10:05:00 -0000 https://status.breww.com/incident/243410#0e48e35315eb17e7cea729879adaae01c75c0bfc36e19bf3fa667c19b26583c2 We're in contact with our primary cloud provider (DigitalOcean) to ensure they get this resolved promptly. We are really sorry for the impact this has on you and we know how important it is that this is resolved urgently. The issue isn't within our own infrastructure, which means, unfortunately, that the fix is also something that we're reliant on others to do. Please keep an eye on status.breww.com for updates on this issue. We're working with our cloud provider to ensure this get's resolved promptly. Please accept our apologies for the inconvenience this is causing you. https://status.breww.com/incident/243410 Wed, 09 Aug 2023 10:05:00 -0000 https://status.breww.com/incident/243410#0e48e35315eb17e7cea729879adaae01c75c0bfc36e19bf3fa667c19b26583c2 We're in contact with our primary cloud provider (DigitalOcean) to ensure they get this resolved promptly. We are really sorry for the impact this has on you and we know how important it is that this is resolved urgently. The issue isn't within our own infrastructure, which means, unfortunately, that the fix is also something that we're reliant on others to do. Please keep an eye on status.breww.com for updates on this issue. We're working with our cloud provider to ensure this get's resolved promptly. Please accept our apologies for the inconvenience this is causing you.