Clean Server Room
I spent the better part of today going through the server room and cleaning out years of accumulated junk that had been thrown in there.
Highlights include:
- 100+ DLT backup tapes, all headed to the degausser on campus
- 30 heavy gauge power cables from various servers
- Norton Internet Security 2004, never opened
- Office 2000
- Tons and tons and tons of empty boxes.
The goal? To make it so that when I need to retreat away from the noise of my office and actually get some work done, I have a place to go that not only has a door, but a door protected by a mag reader. And, if I position myself close enough to the Liebert (which is where the table is in the room) I don't get blown on. The ambient temperature of the room is about 74 F which isn't bad, and the noise from the servers is at least better than listening to people talking loudly.
Oh, and Jae is a jerk.
Productive at Work
Over the last few days I've setup Dell Openmanage and finished tweaking our install of IPMonitor. Now, when a service goes down or there's a hardware failure I'll get an email notifying me. You'd think that this would have been setup before, but my predecessor apparently just scheduled weekly walkthroughs of the two datacenters to look for amber lights on the servers.
Tomorrow's project will be configuring tighter rules for alerting that will go right to my phone via a text message (I only want the really critical errors to come there) as well as automatically open up a helpdesk ticket. I also began sketching out a new server inventory which I will need to put into Sharepoint along with some other documentation.
It's a fairly slow time right now, and since I've gone to work in academia I've really enjoyed the ability to set things up the right way, rather than rush from fire to fire like I had to do in startup-land. That's not to say that I don't miss some of the fun of being in a startup - I worked with some absolutely brilliant people at Grid, and I really miss spending time with them and having debates and conversations about tech.
I also found a piece of software which, so far, has helped me a lot. My desk is right outside of the office that the desktop support folks work out of, and there's a lot of traffic in and out of there. It's very distracting to be troubleshooting some server or network problem and hear people BS'ing with the desktop folks. Since my desk is actually in a really nice space (although it's a bit small) and there's political reasons why I can't move into an office, it's become imperative that I find some way of isolating myself. Well, besides the big frosted Japanese privacy screen that I set up in front of my cube, I found an OSX White Noise Generator, Noisy. I have it set to generate pink noise at about 10% of my iMac's volume. It's a small app that I just keep open on my second monitor and jack up the volume if someone starts talking loudly or I really need to focus.
I still miss working with Jae, even if he was noisy.
Productive Day
Today I finally managed to get RHEL5 boxes authenticating against Active Directory using secure LDAP. I had no problem getting RHEL4 boxes to do it, or RHEL5 boxes without TLS, but I figured out what the problem was with RHEL5. In my /etc/ldap.conf I had a line:
ssl yes
Which enabled Secure LDAP in RHEL4. In RHEL5 the line needs to be:
ssl start_tls
Incidentally, that line works fine in RHEL4, which means that I can continue using the same config files (and eventually package them up as an RPM or something for when we provision new nodes) across RHEL4 and RHEL5 systems.
Beyond that Chris managed to get two Itanium HPUX servers racked and their console cards configured. He had a nice introduction to Wireshark to get their MAC address, and then arp ping to configure the IP's. Tomorrow I will work with him to get the VLANs set correctly on the switch uplinks, and then I will have to do something to jog my memory to disable Serviceguard on those two nodes.
New Record
I made a new personal record today. 24 new VMWare virtual machines made in one day.
21 agents, 3 managers. There's 7 new Windows nodes to build as well. I also have to set up all of the clustering goodness on the nodes.
This puts us closer to filling QA's request of 54 new servers (Linux, Windows, UNIX.)
It's days like these that I think that if I knew Perl better, I could write a wrapper using the VMWare API and make this whole process easier. It also makes me wonder why nobody has done anything like that yet.