Today I had planned to go into the office mid morning to look at some issues that we have with a web fronted application, well you know what they say about the best laid plans of Muppets and Men. I got up to the sound of torrential rain, decided to have some breakfast before heading off to the office, before I had finished breakfast I’d been called. A problem on servers in Europe, ones that I thought were only on Monday to Friday cover from 08:00 to 20:00, still I was on call so I had a look. A number of hours later I was still looking, not actually achieving anything just looking.
When the call came in for the fifth time in six hours I decided that I hated on call, the log files were devoid of information the problem was affecting two servers simultaneously. When I did some investigation I found that the problem always seems to hit both servers together. The servers are physically separate although the application is the same on each, as is the total lack of information. After almost a full day of this I felt like I was chasing my tail, even at the end of the day when the damn application seemed like it was going to stay up I didn’t feel very good about the achievement.
Still I’ve set some parameters on one of the systems that should capture more information for the next poor unfortunate that has to deal with the problem, not that that makes me feel much better. What did make me feel better was a post on my Daughters blog, she at least has had a couple of good days. But as Systems Admins all know, there’s always the unexpected – tomorrow I’ll have to finish off what I started to do on Friday and expected to complete today.