Power Failure / Raid Failure/ HUD Failure / Now What --

Hi, can't really help you with your immediate problem, but no, it appears the problem is not related with the RAID itself but rather with the SMART monitoring: if you google for "Device: /dev/sda, not capable of SMART self-check" you will come across several peolpe who report a lot of SMART messages like yours. Their cure has been to disable smartd altogether.

Besides IRCD and HUDLite, is there anything else going wrong? Can you access all of your disks? Perhaps posting a dmesg would be appropriate.

Regarding your other question, look up www.networkupstools.org or, since you are using APC, www.apcupsd.org.

Well,

I would think it should be but I am going to research the two links referenced above and hopefully have something working soon. The Raid and smartd errors are more trouble some right now.

Other than my nervousness about the raid because power at this facility/ office is so unstable the system has actually been real stable.

------------------------

Dave,

Which version of TB / CentOS are you running ? Did you build the apcupsd from scratch or use a prebuild ?

Looks like this will be my best solution to solve the power detection issue, now to fight the raid problem.

---------------------------

To install apcupsd from source:
-------------------------------------------------------------------------------
yum install gcc-c++
cd /usr/src
wget http://downloads.sourceforge.net/apcupsd/apcupsd-3.14.3.tar.gz
tar xvzf apcupsd-3.14.3.tar.gz
cd apcupsd-3.14.3
CFLAGS="-g -O2" LDFLAGS="-g" ./configure --enable-usb --with-upstype=usb --with-upscable=usb --prefix=/usr --sbindir=/sbin --with-cgi-bin=/var/www/cgi-bin --enable-cgi --with-css-dir=/var/www/docs/css --with-log-dir=/etc/apcupsd --enable-pthreads --enable-powerflute
make
make install
-----------------------------------------------------------------------------
to check location of apcupsd:
whereis apcupsd

If compiled correctly one of the locations will be /sbin/apcupsd

Then edit UPS device type and connection type:
nano /etc/apcupsd/apcupsd.conf

I use some older model APC Smart UPS 620 with serial interface, so I use
UPSTYPE = apcsmart
UPSCABLE = smart

To start apcupsd monitoring, type:

/etc/init.d/apcupsd start

To check status (including battery runtime etc):
/etc/init.d/apcupsd status

Dell SC-440 can run on cheap SmartUPS 620 (you can get it for $70) for ~50-60 mins.

Thank you,
Vadim

My APC ups at home is connected to one primary server.
When a power failure is detected, the server runs a script that sends shutdown commands to every computer in the house. Including trixbox.
Then, after all the workstations have shutdown, the domain controllers themselves shutdown.
Finally, UPS powers off.

I do not run any software on the trixbox or client computers for this. Just send it ssh command "poweroff".

Not only that, but when power is restored, the primary domain controller powers on all alone.
Once is comes up, stabilizes, and DNS is up, internet is up, then it sends wake-on-lan commands to all the other servers (like trixbox) to start booting up.

The shutdown is easy.
The UPS runs this script to shutdown the client machines.

@START "" "shutdown.exe" /m \\Worf      /s /f /d p:6:12 /c "Power Failure"
@START "" "shutdown.exe" /m \\Wangchung /s /f /d p:6:12 /c "Power Failure"
@START "" "shutdown.exe" /m \\itchy     /s /f /d p:6:12 /c "Power Failure"
@START "" "shutdown.exe" /m \\calculon  /s /f /d p:6:12 /c "Power Failure"
@START "" "shutdown.exe" /m \\hope      /s /f /d p:6:12 /c "Power Failure"
@START "" "shutdown.exe" /m \\lorax     /s /f /d p:6:12 /c "Power Failure"
@START "" "plink.exe" -ssh -pw ***** root@scratchy /sbin/shutdown -hP now Power Failure

All the windows servers use "shutdown.exe", but the trixbox uses "plink.exe". Then the UPS shuts itself off...

For startup, the main server is set to auto-power-on when the UPS starts back up. (After the batteries charge at least 20%).
Once the server is up (windows server 2003), it has a scheduled job that runs like this:

"C:\Program Files\Aquila Technology\WakeOnLan\WakeOnLanC.exe" -w -m Itchy
"C:\Program Files\Aquila Technology\WakeOnLan\WakeOnLanC.exe" -w -m Scratchy
"C:\Program Files\Aquila Technology\WakeOnLan\WakeOnLanC.exe" -w -m Wangchung
"C:\Program Files\Aquila Technology\WakeOnLan\WakeOnLanC.exe" -w -m Lorax

The wakeonlan program I wrote myself. It is freely available for anyone to use. You can download it here.
http://www.aquilatech.com/wakeonlan

You can use any program, but I think mine is the best. It does much more than simple wake ups.

This stuff is not optional. If you aren't doing this, its just a matter of time before you lose everything.

Slightly off topic, but WangChung is a backup server.
Its job is to run incremental backups of the entire domain every day, and full backups once a month.
The backups are grandfathered, so there are always 3 full backups on the SAN at any given time.

Basildane,

what UPS software you are running on Windows Domain Controller and what event or software feature is used to execute shutdown script?

Apcupsd also supports the PowerChute Network Shutdown protocol. It can be used to shutdown network servers running apcupsd (including windows computers).

why? is this considered as not good practice?
I wanted to find out how the previous poster running shutdown scripts

Yes your setup is cost effective but I don't want to load APC software on mission critical server and enter root account password into the script

If you didn't want to use the root password you could preshare a certificate.

You can also remote exec without invoking a shell.