Problem: campus backup service temporarily unavailable Cause: scheduled maintenance reboot Affects: users of campus backup service Started: 05/06/2010 05:00 PM Resolved: 05/06/2010 06:30 PM
restarting the backup servers netwrkr-1, netwrkr-2, and netwrkr-3
there are no backups currently running
only those users wanting to restore files in the next hour, or so, will be affected
this restart is to clear temporary files and occurs once every three weeks, schedule(s) permitting
Created: 05/06/2010 17:11:47 by dxi16
Updates:
Problem: Firmware Upgrade of ADIC Physical Tape Library Cause: current firmware is very outdated Affects: no restores from backups older than 9 days Started: 04/21/2010 10:00 AM Resolved: 04/21/2010 01:00 PM
During the upgrade access to physical tapes will not be possible. Restores from backups older than 9 days will not be available. Backups to physical tapes will also not be available, but none are scheduled during this time. Cloning to physical tapes will also not be possible but cloning was put on hold last night and non cloning jobs are currently running.
Created: 04/21/2010 09:34:43 by dxi16
Updates:
Problem: blackboard.case.edu downtime Cause: installing bug fixes Affects: all Blackboard users Started: 03/22/2010 03:00 AM Resolved: 03/22/2010 06:00 AM
We are installing a service pack to fix various bugs. This maintenance is rescheduled from the same time, a week prior, to avoid conflicting with the PeopleSoft Financials upgrade.
Created: 03/10/2010 15:17:28 by prj
Updates: 03/17/2010 14:44:07 by prj
Problem: blackboard.case.edu downtime Cause: system maintenance Affects: all Blackboard users Started: 03/07/2010 09:00 PM Resolved: 03/08/2010 07:00 AM
We are upgrading Blackboard's Oracle database, flushing and reloading one database table to correct a problem with statistics tracking, and installing a Blackboard service pack.
Created: 03/05/2010 14:41:43 by prj
Updates:
Problem: A. W. Smith Hall, a 96-Port Voice and Wireless Module needs to be refreshed by being reseated. Cause: unknown Affects: all of the End-Users, in the A. W. Smith Hall, for their voice and wireless network connections Started: 02/03/2010 05:00 AM Resolved: 02/03/2010 06:00 AM
This Wednesday Morning, between the hours of five o'clock and six o'clock, during the Standard Maintenance Window, this module will be refreshed by being reseated.
And we apologize for any inconveniences this brief network outage may cause very early this Wednesday morning.
Created: 02/06/2010 10:14:23 by euw
Updates:
Problem: Wood Hall, Room WB-14, SER 1 Cause: A 16-Port Gigabit Ethernet Module has failed repeatedly lately. Affects: up-to-eight fiber-optical data-ports, in the Wood Hall, on the Ground Floor Started: 02/05/2010 05:00 AM Resolved: 02/05/2010 06:00 AM
This Friday Morning, between the hours of five o'clock and six o'clock, during the Standard Maintenance Window, this module will be replaced with one of the spares.
And we apologize for any inconveniences this brief network outage may cause very early tomorrow morning.
Created: 02/04/2010 18:44:16 by euw
Updates:
Problem: Production Database Server will be down (DB7) Cause: Bad DIMM Affects: See list below Started: 01/18/2010 07:00 AM Resolved: 01/18/2010 09:00 AM
The error reporting for the bad DIMM has been causing /var to fill, which then has a ripple effect causing LDAP client config file to disappear and syslogd to start to chew up processor time.
Affected applications include (but are not limited to):
Ad Astra
BlackBoard (Course mgmt. system)
Dental School Clinic
Identity Management (user account/password changes)
IP address/host name management
E-mail lists
MyCase portal
Pinnacle (phone billing)
University Library web sites (not including EuclidPLUS/on-line catalog system)
DARS
ProSam (Financial Aid)
Encyclopedia of Cleveland History
Internal IT applications: Appworx, ChangeMan, Mashups, VirtualCenter
The ERP systems (PeopleSoft Financials, HCM, and Student systems) should NOT be affected by this outage.
Created: 01/13/2010 14:40:21 by rfw
Updates:
Problem: Non-ERP Oracle server (DB7) downtime Cause: applying a patch to fix the cause of the last 2 database server crashes Affects: see list below Started: 12/03/2009 03:00 AM Resolved: 12/03/2009 06:00 AM
The cause of the last 2 Oracle server crashes has been identified; in order to correct it, we need to reboot the system to apply an operating system patch. This will be done during the 3-6am window on Thursday morning, 12/3/09.
Affected applications include (but are not limited to):
Ad Astra
BlackBoard (Course mgmt. system)
Dental School Clinic
Identity Management (user account/password changes)
IP address/host name management
E-mail lists
MyCase portal
Pinnacle (phone billing)
University Library web sites (not including EuclidPLUS/on-line catalog system)
DARS
ProSam (Financial Aid)
Encyclopedia of Cleveland History
Internal IT applications: Appworx, ChangeMan, Mashups, VirtualCenter
The ERP systems (PeopleSoft Financials, HCM, and Student systems) should NOT be affected by this outage.
Created: 11/30/2009 15:08:55 by jan3
Updates:
Problem: blackboard.case.edu downtime Cause: system maintenance Affects: all Blackboard users Started: 11/25/2009 03:00 AM Resolved: 11/25/2009 04:30 AM
We will be clearing out some old files to free up disk space.
Created: 11/20/2009 12:34:55 by prj
Updates:
Problem: Cisco Catalyst C-3750 Router, Diner-M1-E1, to be power-cycled. Cause: in order to hopefully restore its full operation Affects: all of the end-users in the diner Started: 11/13/2009 11:00 AM Resolved: 11/13/2009 12:00 PM
Several of the Router Interfaces have failed operation,
lately; so therefore, by power-cycling the entire router,
the hope is to be able to restore their full operation;
otherwise, the Cisco Catalyst C-3750 Router, Diner-M1-E1,
may then need to be replaced by something else, which is
comparable or better than before now; and the actual brief
network outage may be only for a few minutes now; where-by
wired and wireless, data and voice, they will be affected now.
Created: 11/12/2009 18:18:30 by euw
Updates:
Problem: Mail list archives going offline Cause: Disk Expansion Affects: Mailing list archives Started: 11/13/2009 05:00 AM Resolved: 11/13/2009 06:00 AM
The file system that holds the mailing list archives is almost full. We will be expanding it on Friday morning. During the maintenance we will need to turn off archiving and access to the archives.
Mailing list processing should not be affected.
If all goes well and the expansion manages to preserve the original files then we should be back online within the 1 hour maintenance. If, however, the expansion does wipe out the files then we will need to restore the files before we resume archiving. That could take up to 8 hours.
Archive requests will be queued up during the down time and will be applied once the system is back online.
Created: 11/09/2009 14:32:44 by emr
Updates:
Problem: Veale-M1-E1; Module 3, WS-X6548-GE-TX; Bus Asic #0 transient Pb error. Recovered. (0x0002, 0x0000): Module needs troubleshooting or TAC Cause: unknown Affects: up-to-forty-eight direct data local-area-network connections Started: 11/11/2009 08:00 AM Resolved: 11/11/2009 09:00 AM
1. First to install a WS-X6148V-GE-TX module in to an empty or vacant Slot 3.
2. Second to move all patches to Module 3 from Module 2.
3. The Forty-Eight directly-connected End-Users, they may experience a brief interruption in the service for possibly only a few minutes, while the patches are being moved, this morning.
4. We apologize for any inconvenience this may cause during this brief network outage.
5. Out-of-the-forty-eight direct network connections,
forty-three are of the general use, while five are of the use of the five vending machines.
Created: 11/06/2009 14:44:05 by euw
Updates: 11/09/2009 10:18:14 by euw, 11/09/2009 13:45:13 by euw
Problem: NS2 OS Update Cause: Software Patching Affects: Name Server Lookups Started: 10/21/2009 05:00 AM Resolved: 10/21/2009 06:00 AM
Slight delays in Name Server lookups during the Maintenance period.
Created: 10/16/2009 15:24:28 by dnd
Updates:
Problem: NS3a OS Update Cause: Software Patching Affects: Name Server Lookups Started: 10/19/2009 05:00 AM Resolved: 10/19/2009 06:00 AM
Slight delays in Name Server lookups during this period.
Created: 10/16/2009 15:20:28 by dnd
Updates:
Problem: Master Authentication Database (Kerberos KDC) Unavailable Cause: OS Patching/Upgrade Affects: Services that write to the Authentication DB (see notes) Started: 10/21/2009 05:00 AM Resolved: 10/21/2009 06:00 AM
The master authentication database which controls changes to passwords will be unavailable while the server is down for OS patches/upgrades. During the time the server is down the following specific services will be unavailable:
Password change/reset
Account activation
ITS Internal account lookup tool
Basic authentication (login) services will NOT be affected by this maintenance.
We do not expect the maintenance to take more than about 20 minutes.
Created: 10/16/2009 09:02:49 by dak
Updates:
Problem: Single Sign On (SSO) Service upgrade/patching Cause: OS Patching/Upgrade Affects: All SSO users (see notes) Started: 10/21/2009 04:30 AM Resolved: 10/21/2009 06:00 AM
[10/21/09 6:00AM] - The patching is completed. We noticed some sluggish response on the server after the patching with regards to the startup and shutdown of the SSO processes, although actual performance of the service seems reasonable. We have placed the server back into production but will be monitoring performance on the system to verify that the performance continues to be acceptable.
The SSO service will be down briefly to prepare one of the servers for OS patches/upgrades. The system will be completely unavailable briefly (5-10 minutes) during the 4:30AM to 5:00AM time frame while we take the server to be patched out of service. Once that is done, service will be restored at a potential slightly reduced capacity until 6:00AM or earlier depending on when the system patching is complete.
Created: 10/16/2009 08:50:38 by dak
Updates: 10/21/2009 05:59:39 by dak
Problem: Single Sign On (SSO) Service upgrade/patching Cause: OS Patching/Upgrade Affects: All SSO users (see notes) Started: 10/20/2009 04:30 AM Resolved: 10/20/2009 06:00 AM
[10/20/09 6:30AM] - Patching completed without issues and the service is fully operational. We had additional time in the maintenance window this morning to prepare for tomorrow's patching and upgrade so tomorrow's maintenance should be relatively quick.
The SSO service will be down briefly to prepare one of the servers for OS patches/upgrades. The system will be completely unavailable briefly (5-10 minutes) during the 4:30AM to 5:00AM time frame while we take the server to be patched out of service. Once that is done, service will be restored at a potential slightly reduced capacity until 6:00AM or earlier depending on when the system patching is complete.
Created: 10/16/2009 08:47:00 by dak
Updates: 10/20/2009 06:43:10 by dak
Problem: DocShare Service Maintenance Cause: OS Patching/Upgrade Affects: Users of the DocShare Service Started: 10/19/2009 05:00 AM Resolved: 10/19/2009 06:00 AM
The DocShare service will be unavailable while the system is down for operating system upgrades/patches. It is possible that the service will be down for the entire time period scheduled.
Created: 10/16/2009 07:52:35 by dak
Updates:
Problem: Deploying new version of Google Apps mail migration tool Cause: Ease transition of faculty and staff to Google Apps mail Affects: Everyone migrating mail to Google Apps mail Started: 10/12/2009 05:00 AM Resolved: 10/12/2009 05:15 AM
The new version has several enhancements:
- It will not time out if communications with Google is slow.
- The process will "loop" until as much mail is moved as can be.
- The end user can refer to a periodically updated status page specific to their migration - no need to keep a browser window open, and can be checked from any browser.
Created: 10/12/2009 07:40:04 by dak
Updates:
Problem: Teamtrack is being upgraded to Business Mashups Cause: Upgrade application Affects: Teamtrack users Started: 09/29/2009 07:00 AM Resolved: 09/29/2009 11:15 AM
Teamtrack is undergoing maintenance on Tuesday , Sept 29 and is unavailable from 7:00 am to 1:00 pm . During that time, it will be migrated to a newer version of the software called Business Mashups.
UPDATE: The Tramtrack to Business Mashups upgrade has completed successfully at 11:15 am. The new URL to access Business Mashups is at
https://mashups.case.edu/tmtrack/tmtrack.dll?
Created: 09/29/2009 07:45:04 by rxg263
Updates: 09/29/2009 11:20:39 by rxg263