San Diego – R10-C09 Pro-Active Switch Replacement (revised)

START TIME: 1/6/2018 12:00 PST (Saturday)
ESTIMATED END TIME: 1/6/2018 13:00 PST (Saturday)
DURATION: 5 minutes
EQUIPMENT: Network Switch
TYPE OF WORK: Pro-active Replacement
IMPACT OF WORK: Up to 5 minutes of network timeouts for customers with San Diego colocation service in cabinet R10-C09

During the maintenance window above, Fast Serv technical staff will be pro-actively performing a switch hardware swap of a potentially faulty network switch.  Since the switch is not causing any network related issues (it is management, only) we are allowing extra time for clients to prepare for this work.  We are not expecting downtime longer than 5 minutes during this window however due to the complex nature of the upgrade unexpected issues could occur.   If any issues occur, we will immediately roll back the upgrade and reschedule.

Please note that no action on your behalf is required.   This window only affects you if you have one of the following types of service located in R10-C09 (Colo2):  San Diego Colocation.

MS17-010 / WannaCry ransomware

All managed Windows servers are confirmed NOT vulnerable to this latest ‘WannaCry’ ransomware breakout.   Although our latest networks scans do not seem to indicate any vulnerabilities, we HIGHLY recommend any unmanaged Windows server clients ensure that the latest Windows Updates have been applied.   If you have any questions or concerns, please contact the 24/7 helpdesk.

Ashburn – ASH04 Emergency Switch Replacement

START TIME: 12/1/2016 19:00 EST (Thursday)
ESTIMATED END TIME: 12/1/2016 23:59 EST (Thursday)
DURATION: 5 hours
EQUIPMENT: Network Switch
TYPE OF WORK: Emergency Replacement
IMPACT OF WORK: Up to 30 minutes of latency/timeouts for customers with dedicated servers, colocation, or BGP bandwidth in ASH04

During the maintenance window above, Fast Serv technical staff will be performing an emergency switch hardware swap due to a failing network switch.  We are not expecting downtime longer than 30 minutes during this window however due to the complex nature of the upgrade unexpected issues could occur.   If any issues occur, we will immediately roll back the upgrade and reschedule.

Please note that no action on your behalf is required.   This window only affects you if you have one of the following types of service located in ASH04:  Dedicated, Colocation, BGP Switchport.  It does not affect Virtual, Cloud hosting, Cpanel hosting, streaming in any location or any service NOT located in ASH04 .   You can determine the location of your service via the customer Portal under the services tab.   Hover over ‘info’ next to your service and it will indicate the location (ASH01 thru ASH06).   If you have any questions or require support during or after the maintenence, please do not hesitate to contact us.

VHOST Web Hosting Server Upgrades (Cpanel/WHM)

START TIME: 09/24/2016 00:00 EDT (Saturday)
ESTIMATED END TIME: 09/25/2016 23:59 EDT (Sunday)
DURATION: 2 days
EQUIPMENT: Cpanel Website Hosting Service (vhost.fastserv.com)
TYPE OF WORK: Hardware and Software Upgrade
IMPACT OF WORK: Up to 1-hr of website timeouts

Please note that no action on your behalf is required.   This window only affects you if you have your website hosted on our VHOST shared hosting service.  It does not affect Dedicated, Virtual or Cloud hosting customers.   If you have any questions or require support during or after the upgrade, please do not hesitate to contact us.

During the maintenance window above, Fast Serv technical staff will be performing an upgrade to both the server hardware and server software which serves your website.   This upgrade will provide a notable improvement in website speed with an upgrade from Apache to LiteSpeed web server, from CentOS 5 to  CentOS 7 (latest) operating system, while doubling the CPU and memory of the underlying hardware which hosts your sites.  This upgrade is also necessary to ensure 100% the stability and security of your websites in the future as CentOS 5 reaches end-of-life   We are not expecting downtime longer than 60 minutes during this window however due to the complex nature of the upgrade unexpected issues could occur.   If any issues occur, we will immediately roll back the upgrade and reschedule.

 

Ashburn – Network Maintenance (rescheduled)

START TIME: 07/30/2016 15:00 EDT (Saturday)
ESTIMATED END TIME: 07/30/2016 16:00 EDT (Saturday)
DURATION: 1 hour
EQUIPMENT: Network
TYPE OF WORK: Preventive Maintenance
IMPACT OF WORK: Brief moments of latency or timeouts

During the maintenance window listed above, data center operations along with approved vendors will be performing preventative maintenance on one of our core switches. This work is being done to ensure reliability of our network.  Due to the redundant nature of our network the impact should be minimal including one or two moments of increased latency and/or timeouts lasting 5 minutes each, affecting our website and a limited section of our customer base.   If you have any questions please do not hesitate to contact us.

Note:  Event rescheduled to take place during non-business hours.

Ashburn – Generator Annual PM and 4 Hrs. Load Bank per Generator

START TIME: 05/16/2016 06:00 EDT (Monday)
ESTIMATED END TIME: 05/27/2016 18:00 EDT (Friday)
DURATION: 11 days
EQUIPMENT: Generator
TYPE OF WORK: Preventive Maintenance
IMPACT OF WORK: None anticipated

During the maintenance window listed above, data center operations along with approved vendors will be performing the Annual maintenance on all backup generators supporting the Ashburn data center. This work is being done to ensure reliability of the generator system. We do not anticipate any impact to your services as a result of this work.

Ashburn Network Issues – Resolved

1:30PM (EST) – We are currently investigating network issues in Ashburn VA causing packet loss and connectivity issues for some customers.

Update: 1:50PM (EST) – We have localized the issue and stabilized the network.

Update: 5:30PM (EST) – We have seamlessly rolled out configuration changes to our network to help prevent this issue from re-occurring.

Upstream Network Maintenance

START TIME: 12/19/2015 12:00 EST (Saturday)
ESTIMATED END TIME: 12/19/2015 15:00 EST (Saturday)
DURATION: 3 Hour(s)
EQUIPMENT: Carrier Maintenance
TYPE OF WORK: Preventive Maintenance
IMPACT OF WORK: Brief Latency

During the maintenance window listed above, one of our upstream networks will be performing maintenance.    Due to the redundant nature of the network, there should be minimal impact to your services, although two brief periods of higher latency as BGP routes re-converge should be expected.

Microsoft Security Bulletin MS15-034 – Critical

A new 0-day exploit has been discovered in all versions of Windows running the IIS webserver.   We will be patching all managed Windows servers running IIS between now and Friday.   Due to the severity of this exploit, we are unable to wait until the weekend / off-hours and must roll this patch out as quickly as possible.

Read more:

https://technet.microsoft.com/library/security/MS15-034

Critical Windows Update – Schannel

Microsoft recently announced a major vulnerability in Schannel (Microsoft’s own version of SSL/TLS) affecting all versions of Windows and Windows Server operating systems.   This vulnerability is worse than the recent shellshock and heartbleed bugs affecting Linux, because it not only allows remote code execution but affects every Windows version out there.  There are no known exploits ‘in the wild’ yet, but Microsoft and security experts agree it’s a matter of days before mass hacking begins.  You can read about it here:

https://support.microsoft.com/kb/2992611

Please apply all pending updates to your Windows computers (servers here at Fast Serv as well as your own PC’s and Windows Servers with other providers) as soon as possible.   We will be going through all our managed Windows servers this weekend (11/22 – 11/23) and manually applying this update on any servers which have not yet been patched.   Keep in mind, that for the patch to be effective, one or more reboots is required.