Break reports

Schedule:

2010-07-06 23:30 - 2010-07-06 00:30

Duration:

1 h

Affected services:

DNS

Reason:

Operating systems of name and label will be upgraded to next version. Breaks per server should be approximately 20 minutes. Break in service per server should be even shorter.

Update at 23:45: name.it.hiit.fi upgraded and up and running.

Update at 00:03: label.it.hiit.fi upgraded and up and running.

Update at 00:56: Due to changed default behaviour recursive queries were denied from all until 00:30. At that time the configuration was corrected and the break was over.

Schedule:

2010-06-22 04:30 - 2010-06-28 11:45

Duration:

6d 7:15 h

Affected services:

VCS repositories and TRACs authenticating using CS.

Reason:

After last tuesday's break vcs.hiit.fi didn't include department of CS's root certificate to its list of trusted root certificates. This caused all authentications that used department of CS's LDAP server to repositories and TRACs to fail thus preventing users from accessing them.

The list of trusted root certificates was regenerated and user's were able to log in at 2010-06-28 11:45.

Schedule:

2010-06-22 04:30 - 2010-06-22 07:35

Duration:

3:05 h

Affected services:

All IT services, including network connnection and test networks.

Reason:

An electrical maintenance work causes a two (2) hour power disruption in server room in between 2010-06-22 05 - 07.

All IT services will be shut down in between 04:30 and 05:20 and booted up again as soon as power is restored. Thus the break is expected to be shorter than announced.

For more information, please see univerisity of Helsinki's break report about the matter (only in Finnish).

Update at 2010-06-21 14:26: Servers will be rebooted before actual break to make sure that there aren't any complications in the morning. More information can be found from the break report about reboots.

Update at 2010-06-22 07:40: Power was restored at 07:05. All services were up and running at 07:35.

Schedule:

2010-06-21 15:00 - 21:00

Duration:

6:00 h

Affected services:

DNS, LDAP, Radius (incl. eduroam), VCS, VPN, WWW.

Reason:

The following servers will be rebooted to make sure they boot nicely after tomorrow morning's break.
- find.it.hiit.fi
- lose iti.hiit.fi
- name.it.hiit.fi
- label.it.hiit.fi
- finglas.it.hiit.fi
- fangorn.it.hiit.fi
- peregrin.it.hiit.fi
- pippin.it.hiit.fi
- frodo.it.hiit.fi
- openvpn01.fe.hiit.fi
- bilbo.it.hiit.fi
- terae.hiit.fi
- universe.hiit.fi
- stone.hiit.fi
- eowyn.it.hiit.fi

 Pending updates including kernel upgrades will be installed as well.

Breaks to individual service should not be longer than five minutes. Most services aren't affected at all due to their design.

Update at 16:20: The following servers are still to be booted:
- peregrin.it.hiit.fi
- pippin.it.hiit.fi
- frodo.it.hiit.fi
- openvpn01.fe.hiit.fi
- bilbo.it.hiit.fi
- universe.hiit.fi
- stone.hiit.fi

Schedule:

2010-06-11 12:50 - 13:10

Duration:

0:20 h

Affected services:

DHCP.

Reason:

Server relocation.