36 hr web site outage
Installation of Microsoft patch/updates on 16/01/2008 caused irrecoverable corruption of web services on the server
Symptoms:
HTTP services were blocked and unreachable to configure or view.
All services in Services applet appear to run normally, however open/configuring services hangs each applet including the network configuration control panel, firewall control panel, IIS and IPSEC services.
No meaningful message in events file.
Cannot back-out the updates, patch removal fails as uninstall service stalls/hangs on inspecting current configuration step.
Resolution:
The nuclear option (reinstallation of OS).
Upon applying the sequence of updates I note that KB941644 and KB943485 have been superceded by SP3. It appears the mandarins in Redmond addressed the problem we encountered in the service pack.
- b. The same or similar problem has been widely reported on administrator forum sites, some admins were able to back out the updates, our situation appears to be a
worst caseexample.
Cost:
- hours outage. 2 days effort.
