While LSA Technology Services always attempt to avoid or minimize outages, the Research Computing and Infrastructure (RCI) team has three mid-semester maintenance weekends every year (typically near spring break, Art Fair, and the fall study break). RCI also reserves an 11:00 PM–1:00 AM nightly maintenance window for ad hoc maintenance with advanced warning to the affected audience.
Central DNS servers - hardware replacement ns-dc-asb-1; Issue Symptoms: None; Swapping in new hardware for ns-asb-dc-1 The servers are redundant, so there should be no impact on services. Domain Name System (DNS) is the service that converts internet names (like www.umich.edu) into network addresses (like 141.211.243.251). Anticipated End Time: 04/01/2023 23:59
Start Time: Thu, 30 Mar 2023 15:29:00 EDT
Microwave Tower Guyed Wires Damaged; Issue Symptoms: Degradation; 3/2/23 9:30am: The tower has been deemed safe but full repairs won't be made until seasonal weigh restrictions are lifted on Washtenaw county due to the need for a 270ft crane on-site. U-M Forestry will be on-site removing downed trees and dead wood. Fence repairs will also be scheduled. 3/1/23 2:30pm: Update from Ryan Tamblyn: The down guy has been replaced as of 2:30 pm. A full inspection will be required before anyone can climb the tower. Great Lakes Tower needs to bring out a larger crane to complete the inspection but can not do so until the frost restrictions are lifted in Washtenaw county, and we have another tree removed from the down guy on the north west enclosure. I am not aware of any groups on campus that climb the tower regularly but we may want to post a "Do Not Climb" sign at the base until it passes inspection. We will need to replace the fencing at the south east down guy enclosure and more than likely look at having some tree trimming done to avoid any future problems. I was assured that the tower is safe and will not collapse due to any natural occurrence's. I plan on following up with GLT next week to try and get an inspection scheduled. During a routine inspection of the Microwave Tower at 1655 Dean Road it was discovered that a fallen tree had broken one of the guyed wires which support the tower. At this time the tower is operational and there does not appear to any immediate risk. As a precaution, DPSS, Fire, and EHS have been notified. Great Lakes Tower is on-site to effect repairs, and a crane is being dispatched to assist. There is no current ETA on this repair, and all services supported by the tower remain operational. Anticipated End Time: 04/30/2023 11:23
Start Time: Wed, 1 Mar 2023 11:29:00 EST
Reported Problems Reaching UM Websites; Issue Symptoms: Intermittent issues; Users began reporting sporadic problems reaching UM websites from off-campus locations. Our upstream ISP Merit was contacted for assistance and they acknowledged similar complaints from other Merit customers. Further analysis from Merit discovered flapping in their commodity Internet connection with AT&T in Grand Rapids which momentarily failed over to their Southfield datacenter. The peering subsequently failed back to Grand Rapids a few minutes later which restored our Internet connectivity. We will update this status page once we have root cause from Merit on the AT&T outage. Anticipated End Time: 03/23/2023 13:40
Start Time: Thu, 23 Mar 2023 13:58:00 EDT
Distribution Layer (DL) switch replacement in Ruthven and the Central Campus Classroom (CCCB) buildings. Issue Symptoms: Outage ITS Engineering and UMnet will be replacing the Distribution Layer DL switches located in the Ruthven and the Central Campus Classroom CCCB buildings A new Cisco DL switch will be installed in each building prior to the cutover date and connected to the new 100G core backbone On the day of the cutover FSU will transfer all the endpoint connections from the old DL switches to the new DL switches which have been populated with configuration information via automation The actual work is expected to take up to 8 hours with a portion of the maintenance window reserved for testing... Status: Scheduled Start Time: 04/01/2023 08:00 Anticipated End Time: 04/01/2023 16:00
Start Time: Thu, 23 Mar 2023 11:45:00 EDT
Upgrade shared postgresql RDS instance used by ITS Container Service Issue Symptoms: Intermittent issues 3/20/2023: Modifying the expected end date to Sunday, April 2nd at 2am based on testing in non-production environment. =========== Amazon RDS postgresSQL Instance listed below will have a New Operating System update and version upgrade on Saturday, April 1st staring at 11pm. It will be upgraded from 10.21 to 14.7 version. Applications relying upon this database instance will be unable to connect to the database during this maintenance window. Symptoms will vary depending on how the web application author chose to deal with a database connection failure. containerprod-pg.aws.vdc.it.umich.edu Status: Scheduled Start Time: 04/01/2023 23:00 Anticipated End Time: 04/02/2023 02:00
Start Time: Mon, 6 Mar 2023 14:30:00 EST
Upgrade to Active Directory Certificate Services Issue Symptoms: None On 1 April 2023, the Identity and Access Management team will perform an upgrade to Active Directory Certificate Services. During this activity, we will install servers into the UMROOT domain running Windows Server 2022 , then install the new version of Certificate Services. We will make no changes to the current Certificate Services infrastructure. The current and new Certificate Services infrastructure will operate in parallel. Please note: All certificates generated by the current Certificate Services infrastructure will remain valid. Status: Scheduled Start Time: 04/01/2023 23:00 Anticipated End Time: 04/02/2023 07:00
Start Time: Thu, 2 Mar 2023 09:44:00 EST
Update to Canvas connector from MCommunity Issue Symptoms: Outage The IAM tean will be making a change to the connector software that sends user data to Canvas from MCommunity We are adding the ability to populate a Canvas attribute known as Sortable Name This change will use name parts from MCommunity to create a more properly sorted list of users in a class especially for surnames which have spaces in them The current sorting option in Canvas is less clear about what the proper name parts are leading to incorrect or unexpected sorting results Once the connector has been updated the IAM team will at a later date send... Status: Scheduled Start Time: 04/01/2023 23:00 Anticipated End Time: 04/01/2023 23:30
Start Time: Fri, 31 Mar 2023 15:01:00 EDT
Update to MCommunity internal processing Issue Symptoms: Outage The IAM team will be making a change to internal mechanisms for dealing with identity data discrepancies. Currently, emails are sent out when a data issue is discovered by this internal process. After the change is made, the information will be written to a log file that is indexed and alerted on by Splunk, making for a more efficient workflow within the IAM team. There is no public facing effect of this change at all. Status: Scheduled Start Time: 04/01/2023 23:30 Anticipated End Time: 04/01/2023 23:50
Start Time: Fri, 31 Mar 2023 15:19:00 EDT
ITS Tech Shop Maintenance Issue Symptoms: None The ITS Tech Shop site will be undergoing routine maintenance. Users will be unable to access the site for some portion or all of the maintenance window timeframe. Status: Cancelled Start Time: 04/03/2023 06:00
Start Time: Tue, 7 Feb 2023 16:16:00 EST
Network Border Infrastructure System (NBIS) Update Issue Symptoms: Outage ITS Network Security Operations will be updating the software on the NBIS Corelight servers. The actual work is expected to take approximately 2 hours to complete, however additional time is reserved for testing. Status: Scheduled Start Time: 04/03/2023 09:00 Anticipated End Time: Unknown
Start Time: Thu, 30 Mar 2023 14:09:00 EDT
Connect VAST switches to top of the rack switches Issue Symptoms: None Vast mellanox switches will be connected to top of the rack switches at the MACC data center on Tuesday, April 4, 2023 between 5am to 7am. We do not anticipate any impact on services. Status: Scheduled Start Time: 04/04/2023 05:00 Anticipated End Time: 04/04/2023 07:00
Start Time: Fri, 31 Mar 2023 13:04:00 EDT
NORTH CAMPUS SERVICE BLDG #1, NORTH CAMPUS MICROWAVE TOWER Electrical Maintenance - 04/05/2023 06:00 AM - 04/05/2023 07:00 AM Issue Symptoms: Outage This is notification that on Wednesday 04/05 from 6:00 am to 7:00 am NORTH CAMPUS SERVICE BLDG #1 and NORTH CAMPUS MICROWAVE TOWER will be undergoing electrical maintenance. During this time WiFi, wired network connections, network phones, printers, etc. may be unavailable. Once power is restored and we can ensure that all ITS equipment and services are back up and functioning normally, we will close this status. Status: Scheduled Start Time: 04/05/2023 06:00 Anticipated End Time: 04/05/2023 07:00
Start Time: Wed, 22 Mar 2023 08:27:00 EDT
Distribution Layer (DL) Switch Replacement at the Lay Automotive Engineering Lab Issue Symptoms: Outage ITS Engineering and UMnet will be replacing the Distribution Layer DL switch located in the Lay Automotive Engineering Lab room 2070F-2A A new Cisco DL switch will be installed prior to the cutover date and connected to the new 100G core backbone On the day of the cutover FSU will transfer all the endpoint connections from the old DL switch to the new DL switch which has been populated with configuration information via automation The actual work is expected to take up to 3 hours with a portion of the maintenance window reserved for testing... Status: Scheduled Start Time: 04/06/2023 05:08 Anticipated End Time: 04/06/2023 08:00
Start Time: Mon, 27 Mar 2023 14:43:00 EDT
G155 Angell Hall, 435 South State St, Ann Arbor, MI 48109-1003