Production Team Report 2010-07-19

RAL Tier1 Production Team Report for 19th July 2010.

AoD This Week

Mon: Tiju Tues: Tiju Wed: John Thu: Tiju Fri: Tiju

Last week

• Gareth: AoD (1) day A/L 2days.
• John: AoD (3 days), Gareth stand-in, looking at Nagios checks for Castor 2.1.9.
• Tiju: Catching up after A/L, AoD (1 day), Sure/Modem script

Changes to Operating procedures

• None.

Declared Outages in GOC DB

• July 19-22 LHC Technical Stop Dates.
• CANCELLED Transformer checks. (Site At Risk). TX1 & TX4. At Risk on whole Tier1 from 08:30 on Monday 19th to 17:00 on Thursday 22nd July.
• July 19 At risk for intervention on tape robot controller node.
• July 20 At risk for firmware upgrades to tape robot.
• July 20 At risk for multipath configuration.
• July 21 At risk for multipath configuration.
• July 22 At risk for multipath configuration.

Advanced Warning

• 2nd August: Stop SL4 batch service. (Turn off SL3 UIs)
• Early August: turn off lcgce02. Currently there is a downtime from 2/8/2010 to 10/08/2010
• Not yet scheduled: Restrict access to FTS & LFC databases via Oracle 'ACLs'

Other Changes

• Fabric:
  • Double the network link to the tape robot stack (stack 12), postponed from the last TS. (Requires Castor stop).
  • Swap out the older of the pair of SAN switches in the Tier1 Oracle databases for its new replacement. (Requires FTS, LFC, 3D stop).
  • New kernels and glibc updates on non-castor Oracle RAC nodes. (Done for LUGH).
• Database:
  • None
• Grid Services:
  • Add Quatorised BDII to Top-BDII set. (Below threshold for technical stop).
• Castor:
  • Possible SRM update
• Networks:
  • Commissioning OPN link