Server Hangs Every Thursday Night at 11:26pm

Discussion in 'Server Operation' started by bschultz, Apr 22, 2011.

  1. bschultz

    bschultz Member

    I have a Debian server that for the last three Thursday nights, has hung at 11:26pm.

    There is nothing in the syslog

    Apr 21 22:26:01 server1 /USR/SBIN/CRON[31391]: (root) CMD (/cron/liveice_cron.txt >> /dev/null 2>&1)
    Apr 22 05:47:05 server1 kernel: imklog 3.18.6, log source = /proc/kmsg started.


    The liveice cron job runs every five minutes...so that isn't the issue.

    Is there anywhere else I can look for a log that may show what is happening?
     
  2. falko

    falko Super Moderator Howtoforge Staff

    Did you check the cron logs in /etc/cron.weekly/?
     
  3. bschultz

    bschultz Member

    No logs there...just a man-db file.

     
  4. net-help.dk

    net-help.dk New Member

    hung as in system not responding for at short periode of time or do you have to do something to help the server "recover" ?

    Do you have any graph off your system load CPU, MEM, DISK ?
    Are you aware off any changes on the server 3 weeks ago ?
     
  5. bschultz

    bschultz Member

    I have to manually press the reset button...the server does not respond to any ssh or keyboard commands.

    I don't have monit or munin running on this server. I'll try to get it installed before tonight to see what's up.
     
  6. net-help.dk

    net-help.dk New Member

    Are you able to see whats on the server's screen when it hangs, before you hit the reset buttom ?

    Are there any sign on kernel panic ?

    Are you able to ping the server from an external machine or does it stop completely responding ?
     
  7. bschultz

    bschultz Member

    The screen is black...and it doesn't respond to anything.

    I didn't get time to install monit today...which means I'll have a week to get it done before it hangs again...which should happen tonight.
     
  8. net-help.dk

    net-help.dk New Member

    i'm starting to think "hardware issue"
    but lets see what your graphs are showing ?

    when was the server last updatet ?
     
  9. bschultz

    bschultz Member

    And oddly enough, the server didn't hang last night!!!!
     

Share This Page