Hi friends I got a very serious problem today one of my servers stopped working and I tried to understand why and what happened for it. I realized one issue from hard disk space and also saw MySQL stopped also. Then for the sake of space matter, I deleted all things inside the log and backups directory. These are all I have done and don't know what to do. Please please need urgent help. here are some reports from forum guidance : Code: ##### SERVER ##### IP-address (as per hostname): ***.***.***.*** IP-address(es) (as per ifconfig): ***.***.***.*** [INFO] OS version is Debian GNU/Linux 8.11 (jessie) [INFO] ISPConfig is installed. ##### ISPCONFIG ##### ISPConfig version is 3.0.5.4p8 ##### VERSION CHECK ##### [INFO] php (cli) version is 5.6.38-0+deb8u1 [INFO] php-cgi (used for cgi php in default vhost!) is version 5.6.38-0+deb8u1 ##### PORT CHECK ##### [WARN] Port 8080 (ISPConfig) seems NOT to be listening [WARN] Port 8081 (ISPConfig Apps) seems NOT to be listening [WARN] Port 80 (Webserver) seems NOT to be listening [WARN] Port 443 (Webserver SSL) seems NOT to be listening ##### MAIL SERVER CHECK ##### ##### RUNNING SERVER PROCESSES ##### [WARN] I could not determine which web server is running. [INFO] I found the following mail server(s): Postfix (PID 1218) [INFO] I found the following pop3 server(s): Dovecot (PID 546) [INFO] I found the following imap server(s): Unknown process (init) (PID 1) [INFO] I found the following ftp server(s): PureFTP (PID 1115) ##### LISTENING PORTS ##### (only () Local (Address) [anywhere]:993 (1/init) [anywhere]:995 (546/dovecot) [localhost]:10024 (1043/amavisd-new) [localhost]:10025 (1218/master) [anywhere]:587 (1218/master) [localhost]:11211 (525/memcached) [anywhere]:110 (546/dovecot) [anywhere]:143 (1/init) [anywhere]:111 (419/rpcbind) [anywhere]:465 (1218/master) [anywhere]:21 (1115/pure-ftpd) ***.***.***.***:53 (518/named) [localhost]:53 (518/named) [anywhere]:22 (636/sshd) [localhost]:631 (616/cupsd) [anywhere]:25 (1218/master) [localhost]:953 (518/named) [anywhere]:40991 (442/rpc.statd) *:*:*:*::*:993 (1/init) *:*:*:*::*:995 (546/dovecot) *:*:*:*::*:10024 (1043/amavisd-new) *:*:*:*::*:3306 (2353/mysqld) *:*:*:*::*:587 (1218/master) [localhost]10 (546/dovecot) [localhost]43 (1/init) [localhost]11 (419/rpcbind) *:*:*:*::*:465 (1218/master) *:*:*:*::*:21 (1115/pure-ftpd) *:*:*:*::*:53 (518/named) *:*:*:*::*:22 (636/sshd) *:*:*:*::*:631 (616/cupsd) *:*:*:*::*:25 (1218/master) *:*:*:*::*:953 (518/named) *:*:*:*::*:51232 (442/rpc.statd) ##### IPTABLES ##### Chain INPUT (policy DROP) target prot opt source destination fail2ban-postfix-sasl tcp -- [anywhere]/0 [anywhere]/0 multiport dports 25 fail2ban-dovecot-pop3imap tcp -- [anywhere]/0 [anywhere]/0 multiport dports 110,995,143,993 fail2ban-pureftpd tcp -- [anywhere]/0 [anywhere]/0 mult iport dports 21 fail2ban-ssh tcp -- [anywhere]/0 [anywhere]/0 multiport dports 22 DROP tcp -- [anywhere]/0 ***.***.***.***/8 ACCEPT all -- [anywhere]/0 [anywhere]/0 state RELATE D,ESTABLISHED ACCEPT all -- [anywhere]/0 [anywhere]/0 DROP all -- ***.***.***.***/4 [anywhere]/0 PUB_IN all -- [anywhere]/0 [anywhere]/0 PUB_IN all -- [anywhere]/0 [anywhere]/0 PUB_IN all -- [anywhere]/0 [anywhere]/0 PUB_IN all -- [anywhere]/0 [anywhere]/0 PUB_IN all -- [anywhere]/0 [anywhere]/0 DROP all -- [anywhere]/0 [anywhere]/0 Chain FORWARD (policy DROP) target prot opt source destination ACCEPT all -- [anywhere]/0 [anywhere]/0 state RELATE D,ESTABLISHED DROP all -- [anywhere]/0 [anywhere]/0 Chain OUTPUT (policy ACCEPT) target prot opt source destination PUB_OUT all -- [anywhere]/0 [anywhere]/0 PUB_OUT all -- [anywhere]/0 [anywhere]/0 PUB_OUT all -- [anywhere]/0 [anywhere]/0 PUB_OUT all -- [anywhere]/0 [anywhere]/0 PUB_OUT all -- [anywhere]/0 [anywhere]/0 Chain INT_IN (0 references) target prot opt source destination ACCEPT icmp -- [anywhere]/0 [anywhere]/0 DROP all -- [anywhere]/0 [anywhere]/0 Chain INT_OUT (0 references) target prot opt source destination ACCEPT icmp -- [anywhere]/0 [anywhere]/0 ACCEPT all -- [anywhere]/0 [anywhere]/0 Chain PAROLE (16 references) target prot opt source destination ACCEPT all -- [anywhere]/0 [anywhere]/0 Chain PUB_IN (5 references) target prot opt source destination ACCEPT icmp -- [anywhere]/0 [anywhere]/0 icmptype 3 ACCEPT icmp -- [anywhere]/0 [anywhere]/0 icmptype 0 ACCEPT icmp -- [anywhere]/0 [anywhere]/0 icmptype 11 ACCEPT icmp -- [anywhere]/0 [anywhere]/0 icmptype 8 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:20 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:21 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:22 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:25 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:53 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:80 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:110 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:143 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:443 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:587 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:993 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:995 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:3306 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:8080 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:8081 PAROLE tcp -- [anywhere]/0 [anywhere]/0 tcp dpt:1000 0 ACCEPT udp -- [anywhere]/0 [anywhere]/0 udp dpt:53 ACCEPT udp -- [anywhere]/0 [anywhere]/0 udp dpt:3306 DROP icmp -- [anywhere]/0 [anywhere]/0 DROP all -- [anywhere]/0 [anywhere]/0 Chain PUB_OUT (5 references) target prot opt source destination ACCEPT all -- [anywhere]/0 [anywhere]/0 Chain fail2ban-dovecot-pop3imap (1 references) target prot opt source destination RETURN all -- [anywhere]/0 [anywhere]/0 Chain fail2ban-postfix-sasl (1 references) target prot opt source destination REJECT all -- ***.***.***.*** [anywhere]/0 reject-with icmp-port-unreachable RETURN all -- [anywhere]/0 [anywhere]/0 Chain fail2ban-pureftpd (1 references) target prot opt source destination RETURN all -- [anywhere]/0 [anywhere]/0 Chain fail2ban-ssh (1 references) target prot opt source destination REJECT all -- ***.***.***.*** [anywhere]/0 reject-with ic mp-port-unreachable REJECT all -- ***.***.***.*** [anywhere]/0 reject-with ic mp-port-unreachable RETURN all -- [anywhere]/0 [anywhere]/0 Also MySQL status shows me these results: Code: mysql.service - LSB: Start and stop the mysql database server daemon Loaded: loaded (/etc/init.d/mysql) Active: active (running) since Sun 2020-02-09 13:50:46 EST; 3h 44min ago Process: 2162 ExecStop=/etc/init.d/mysql stop (code=exited, status=0/SUCCESS) Process: 2194 ExecStart=/etc/init.d/mysql start (code=exited, status=0/SUCCESS) CGroup: /system.slice/mysql.service ├─2218 /bin/bash /usr/bin/mysqld_safe ├─2353 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib/mysql/plugin --user=mysq... └─2354 logger -t mysqld -p daemon.error Feb 09 17:15:08 ns1 mysqld[2354]: 200209 17:15:08 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:15:18 ns1 mysqld[2354]: 200209 17:15:18 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:15:34 ns1 mysqld[2354]: 200209 17:15:34 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:15:39 ns1 mysqld[2354]: 200209 17:15:39 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:30:02 ns1 mysqld[2354]: 200209 17:30:02 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:30:07 ns1 mysqld[2354]: 200209 17:30:07 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:30:07 ns1 mysqld[2354]: 200209 17:30:07 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:30:18 ns1 mysqld[2354]: 200209 17:30:18 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:30:34 ns1 mysqld[2354]: 200209 17:30:34 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Feb 09 17:30:39 ns1 mysqld[2354]: 200209 17:30:39 [ERROR] Couldn't repair table: c0sli.def_wscredit_logs Note: the size of this DB is over 150 GB please let me know what to do
Found the problem and I want to share the issue: I deleted log files which belonged to Apache and found the point by these commands: Code: cd /etc/apache2 apache2ctl configtest then it has shown me the exact point where my error was. Code: (2)No such file or directory: AH02291: Cannot access directory '/var/log/apache2/' for main error log (2)No such file or directory: AH02291: Cannot access directory '/var/log/apache2/' for error log of vhost defined at /etc/apache2/sites-enabled/000-default.conf:1 AH00014: Configuration check failed Action 'configtest' failed. Finally, I created the directory and gave necessary permissions to restart Apache service: