Topic: Very odd occurance, advice please?

[Steve L]

Hey all,

I had an odd situation. At 8:35pm CST, Thursday I began to receive email "cron" messages. A total of nine, all below in the order they came. My server is the latest rev. with all the updates applied. I also have some customizations installed, Jabber server, AWSTATS, System Monitor, MP3 Jukebox. Around this time ,before I checked my mail, I had noticed my hard drive activity light was on constantly. Well, I didn't think much about it. Once I got the email warnings I attempted to access the Server Manager without success. The logon refused me. SSH refused me also. My web page was not accessible, but the gateway to the Internet was fine. I attempted to access my mail again and was refused.

Next I hooked my keyboard and montior to the SME and attempted to login as root, without success. I rebooted the SME which let me access the server via web manager, SSH and the console as root. Once rebooted and into the server manager, I checked the System Monitor by Juan J. Prieto & Jaime Nebrera which showed a steady ramping in CPU, RAM, HARD DISK, and SWAP, from 12noon-10:30pm CST, until maxed at 100%. The ETH 0, ETH 1 showed no increse in traffic.

What logs are a good starting point to figure out what was going on here. And has anyone had a similar experience.

Thanks in advance for any and all advice,

Steve L.

--------------------------------------------------------
Out of memory!
Command was: /etc/e-smith/web/panels/manager/cgi-bin/-.awstats/awstats.pl -h www.absolutenettech.com < /var/log/httpd/awstats/www.absolutenettech.com > /dev/null

Out of memory!
Command was: /etc/e-smith/web/panels/manager/cgi-bin/.awstats/awstats.pl -h www.absolutenettech.com < /var/log/httpd/awstats/www.absolutenettech.com > /dev/null


Out of memory!
Callback called exit at /sbin/e-smith/awstats-pp line 26.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 35.
Callback called exit at /sbin/e-smith/awstats-pp line 35.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 33.
Callback called exit at /sbin/e-smith/awstats-pp line 33.
BEGIN failed--compilation aborted at /sbin/e-smith/awstats-pp line 26.

Out of memory!
Callback called exit at /sbin/e-smith/awstats-pp line 26.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 48.
Callback called exit at /sbin/e-smith/awstats-pp line 48.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 112.
Callback called exit at /sbin/e-smith/awstats-pp line 112.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 35.
Callback called exit at /sbin/e-smith/awstats-pp line 35.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 33.
Callback called exit at /sbin/e-smith/awstats-pp line 33.
BEGIN failed--compilation aborted at /sbin/e-smith/awstats-pp line 26.

Out of memory!
Callback called exit at /sbin/e-smith/awstats-pp line 26.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 32.
Callback called exit at /sbin/e-smith/awstats-pp line 32.
BEGIN failed--compilation aborted at /sbin/e-smith/awstats-pp line 26.

Out of memory!
Callback called exit at /sbin/e-smith/awstats-pp line 26.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 29.
Callback called exit at /sbin/e-smith/awstats-pp line 29.
BEGIN failed--compilation aborted at /sbin/e-smith/awstats-pp line 26.

Out of memory!
Callback called exit at /sbin/e-smith/awstats-pp line 25.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 150.
Callback called exit at /sbin/e-smith/awstats-pp line 150.
BEGIN failed--compilation aborted at /sbin/e-smith/awstats-pp line 25.

Out of memory!
Callback called exit at /sbin/e-smith/awstats-pp line 25.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 150.
Callback called exit at /sbin/e-smith/awstats-pp line 150.
BEGIN failed--compilation aborted at /sbin/e-smith/awstats-pp line 25.

Out of memory!
Callback called exit at /sbin/e-smith/awstats-pp line 25.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 12.
Callback called exit at /sbin/e-smith/awstats-pp line 12.
END failed--call queue aborted at /sbin/e-smith/awstats-pp line 26.
Callback called exit at /sbin/e-smith/awstats-pp line 26.
BEGIN failed--compilation aborted at /sbin/e-smith/awstats-pp line 25.