R360 Hosting - WatchGuard AuthPoint Multi-Factor Authentication Outage
Update - Due to WatchGuard's outage, we have temporarily disabled WatchGuard AuthPoint on our website and also on our Remote Desktop Servers. You can now bypass login on our website, and instead just launch your Remote Desktop Connection and it should log you in directly. Once WatchGuard has resolved their issue, we will work with them before re-enabling MFA.
Oct 22, 2024 - 05:41 PDT
Investigating - Dear R360 Cloud Hosting Customers,

WatchGuard AuthPoint, our Multi-Factor Authentication provider, is having another outage again today. We are working on removing AuthPoint from our login page and also our Remote Desktop Servers.

When you click login at https://r360.com, you will just need to use your Remote Desktop User Name and Password and login to the Domain OOTBHOST.int, make sure to click the check box for "I have read and accept the terms and conditions".

You will get a "You have been successfully authenticated" notification. Once you have that you can launch Remote Desktop and connect in. When you get the WatchGuard AuthPoint login screen, select to use OTP (one time passcode), and then on your mobile device open the WatchGuard AuthPoint app and enter in the 6 digit code from the App into the OTP screen.

https://learn.recur360.com/using-one-time-password-for-multi-factor-authentication/

Thank you for your patience while we work with our security provider while they investigate and resolve their outage which is affecting all of our users.

https://status.watchguard.com
Oct 22, 2024 - 05:11 PDT

About This Site

Welcome to system status page for R360 CLOUD Hosting for QuickBooks Remote Desktops. We will provide information here on system Maintenance, Upgrades and Performance as well as send email/txt notifications to subscribers when such incidents take place. Your an always come to our https://r360.com/chat for chat support between 7 AM EST - 8 PM PST.

Uptime over the past 90 days. View historical uptime.
R360 CLOUD HOSTING - QuickBooks Remote Desktops ? Degraded Performance
90 days ago
99.89 % uptime
Today
RECUR360 Platform ? Operational
90 days ago
100.0 % uptime
Today
RECUR360 - QuickBooks Online ? Operational
90 days ago
100.0 % uptime
Today
RECUR360 - QuickBooks Desktop / Web Connector ? Operational
90 days ago
100.0 % uptime
Today
RECUR360PAY/Merchant Track ? Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Past Incidents
Oct 22, 2024

Unresolved incident: R360 Hosting - WatchGuard AuthPoint Multi-Factor Authentication Outage.

Oct 21, 2024
WatchGuard AuthPoint MultiFactor Authentication Outage
Resolved - At 1:41 CST today WatchGuard resolved the issue with their Push notifications not working or being delayed. We apologize for any inconvenience this may have caused on authenticating on our servers. We'll continue to monitor and provide any updates should this occur again.

https://status.watchguard.com

Monitoring - We have resolved the intermittent issues with delayed push notifications, and everything is now operating normally. If you are still experiencing problems with RADIUS authentications, please contact WatchGuard support. Thank you for your patience.
Oct 21 2024, 19:41 UTC
Oct 21, 13:26 PDT
Monitoring - Per the https://support.watchguard.com website, WatchGuard has implemented a fix and AuthPoint MFA Push notifications are operating again. We will continue to monitor the issue with WatchGuard. Thank you for your patience!

2024-10-20 - Global - MFA Push Notifications and Timeout Issues
monitoring - WatchGuard teams have continued to monitor this issue and services are operating normally. If you are still experiencing issues with RADIUS authentications, please contact WatchGuard support. Again we apologize for any impact this may have had on you or your customers.

Oct 21 2024, 16:14 UTC
Oct 21, 10:14 PDT
Investigating - R360 Hosting is currently investigating a continuing outage with WatchGuard AuthPoint MFA. R360 uses WG AP MFA on our Router which is our first step of authentication, and then on our servers. Yesterday WG had a global outage but resolved it later in the day. It appears to currently be happening again.

We have implemented a temporary workaround on our Login page. Now when you go to https://r360.com and click Login, the Router login page will show that you are logging into OOTBHOST.int in the drop down box rather than AuthPoint. This allows you to authenticate using your user name and password combination. You will not get a push notification upon successful login, you will just be redirected to our website. Then when you connect to Remote Desktop, when prompted for Push notification, choose the option for OTP (one time passcode), then open the WatchGuard AuthPoint app on your mobile device and enter in the 6 digit code that you see.

If you use the Mobile VPN to login/authenticate, this is currently unavailable.

We are actively monitoring this with WG to see when they resolve it. Security is of the upmost importance to us and it is highly frustrating when our technology/security partners have issues with the components that we rely on.

We'll provide updates as they are available to us.

R360 Cloud Hosting Support
Oct 21, 09:17 PDT
Oct 20, 2024
R360 Hosting - WatchGuard AuthPoint Timeout Issue
Resolved - Operational - Watchguard has implemented a fix in the US, and operations are now functioning as normal. We appreciate your patience during that time. Thank you!
Oct 20, 15:34 PDT
Update - investigating - We are still working hard to resolve the MFA push notification and timeout issues. Our team is investigating potential causes and solutions. Thank you for your continued patience, and we'll post our next update in 1 hour, if not sooner.
Oct 20, 14:24 PDT
Update - investigating - We are still working hard to identify the issue with MFA push notifications and timeouts. Our team is making progress, and we appreciate your continued patience. We'll post our next update in 1 hour, if not sooner. Thank you!
Oct 20, 13:22 PDT
Update - investigating - We continue to work on the MFA push notifications and timeout issues, which are currently affecting users in the EU and US only. We’ll post our next update soon to let users know where we are in the process.
Oct 20, 12:51 PDT
Investigating - Dear R360 Customers,

WatchGuard AuthPoint Services are currently experiencing an issue with push notifications. It seems they are timing out and not approving the log in.

Below is the message from WatchGuard Support. They are investigating while we work alongside to get our AuthPoint systems working again. We will send out an update as soon as the issue is identified.
 
2024-10-20 - Oct 20, 2024 - 19:16 UTC - Global - MFA Push Notifications and Timeout Issues
investigating - We're currently investigating the issue where users are not receiving MFA push notifications or are experiencing timeouts even after approval. Once we determine the impact and scale of these potential issues, we'll post our next update in 30 minutes, if not sooner.

Any questions, please let us know.

We apologize for the inconvenience.

R360 Support Staff
Oct 20, 12:32 PDT
R360 Cloud Hosting - October Monthly Microsoft Updates
Completed - The scheduled maintenance has been completed.
Oct 20, 02:00 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 19, 21:00 PDT
Update - We will be undergoing scheduled maintenance during this time.
Oct 17, 10:47 PDT
Scheduled - Dear R360 Cloud Hosting Customers,

This is a reminder that on this coming Saturday October 19th, 2024, we will need to update and reboot all servers starting at 9:00 PM PST / 12:00 AM EST in order to install Microsoft Windows Critical Updates that recently were released. The update window should take a total of 3-5 hours. Please make sure to exit QuickBooks and other applications by 9:00 PM PST / 12:00 AM EST and click Start>0-LogOff out of your server sessions. We will send a notification after the updates are complete for you to log back in.

If you have any issues post update, please come to our LiveChat https://r360.com/chat.

Best regards,

R360 Cloud Hosting Support
Oct 19, 21:00 PDT
Oct 19, 2024
Oct 18, 2024

No incidents reported.

Oct 17, 2024

No incidents reported.

Oct 16, 2024

No incidents reported.

Oct 15, 2024

No incidents reported.

Oct 14, 2024

No incidents reported.

Oct 13, 2024

No incidents reported.

Oct 12, 2024

No incidents reported.

Oct 11, 2024

No incidents reported.

Oct 10, 2024

No incidents reported.

Oct 9, 2024
R360 Hosting - Microsoft Remote Desktop Gateway Issues
Resolved - This incident has been resolved.
Oct 9, 11:30 PDT
Update - Dear R360 Hosting Customers,

Some good news came in from Microsoft this morning.

Microsoft has released a patch update for October to fix the disconnect issues that some of you have been experiencing the last few weeks. We plan to run this update this evening at 9:30 pm PST/ 12:30 EST. This update will last for roughly 1-2 hours. During that time, no one will be able to log into the servers until the update is complete.

October 8, 2024—Patch KB5044281 - [Remote Desktop TSGateway Crash (known issue)] Fixed

After the update is complete, the systems should return to normal, and users can log back in. Hopefully, this update will take care of the problems of disconnecting sessions.

We appreciate your patience as we work through the issues. If you have any questions, please let us know.

Thank you!

R360 Hosting Staff
Oct 8, 11:25 PDT
Monitoring - R360 Hosting Customers,

After September updates ran, disconnect have been occurring sporadically across our hosting environment. Over the last couple weeks we been working with our hardware and software vendors to narrow the root cause. After working with Microsoft, we were notified that after July updates. These updates would caused Remote Desktop services to crash. However, we were not affected until after September updates. Currently, Microsoft does not have a fix but we are working with them to solve this issue. If you experience a disconnect, give it 10 minutes before logging back in. This allows the service to reset itself. If you log in too quickly it will disconnect again.

We apprentice the patience and appreciate all our customers. We have been working diligently to narrow and solve the problem. We will update our customers once a fix has been implemented in the following.

Thank you!

R360 Support Staff
Oct 7, 17:17 PDT
R360 Hosting Customers - Disconnect Issues Continued
Resolved - We were able to find the issue with the network and resolve. Network is stable and customers should be able to log in without disconnect.

Thanks.

R360 Hosting Staff
Oct 9, 11:30 PDT
Identified - R360 Hosting,

We are aware of disconnects still happening. These disconnects are unrelated to the fix we applied yesterday. These are internet related at our datacenter. We are working on solving this issue quickly, so you customers are no longer being disconnected.

We will update this status once completed in the next 15 minutes.

Thanks.

R360 Support Staff
Oct 9, 09:58 PDT
Oct 8, 2024
R360 Hosting - Microsoft October Update Patch for Microsoft Remote Desktop Disconnect Fix
Completed - The scheduled maintenance has been completed.
Oct 8, 23:30 PDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 8, 21:30 PDT
Scheduled - Dear R360 Hosting Customers,

Some good news came in from Microsoft this morning.

Microsoft has released a patch update for October to fix the disconnect issues that some of you have been experiencing the last few weeks. We plan to run this update this evening at 9:30 pm PST/ 12:30 EST. This update will last for roughly 1-2 hours. During that time, no one will be able to log into the servers until the update is complete.

October 8, 2024—Patch KB5044281 - [Remote Desktop TSGateway Crash (known issue)] Fixed

After the update is complete, the systems should return to normal, and users can log back in. Hopefully, this update will take care of the problems of disconnecting sessions.

We appreciate your patience as we work through the issues. If you have any questions, please let us know.

Thank you!

R360 Hosting Staff
Oct 8, 11:23 PDT
← Incident History Powered by Atlassian Statuspage