Error 500 on ISPConfig panel

When I try to login to my ISPConfig control panel, I get an Internal Server error...

You guys obviously can't help me with just this information, so my first question would be: Where to find the logs that could point me in any direction?

I did find a log file in /var/logs/ispconfig/ispconfig.log, but that's empty...

All my websites are running perfectly fine BTW...

 

It points me to the suexec.log, which shows this error:

[2019-09-26 15:31:51]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fci-scripts/ispconfig)
How do I need t oset up this folder?

 

[Thu Sep 26 15:31:30.965978 2019] [mpm_prefork:notice] [pid 6319] AH00169: caught SIGTERM, shutting down
[Thu Sep 26 15:31:31.248311 2019] [ssl:warn] [pid 12937] AH01906: 2001:3366:6633:0:20c:29ff:fedb:9f25:8080:0 server certificate is a CA certificate (BasicConstraints: CA == TRUE !?)
[Thu Sep 26 15:31:31.248384 2019] [ssl:warn] [pid 12937] AH01909: 2001:3366:6633:0:20c:29ff:fedb:9f25:8080:0 server certificate does NOT include an ID which matches the server name
[Thu Sep 26 15:31:31.248536 2019] [ssl:error] [pid 12937] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: [email protected],CN=schattorie.s$
[Thu Sep 26 15:31:31.248549 2019] [ssl:error] [pid 12937] AH02604: Unable to configure certificate 2001:3366:6633:0:20c:29ff:fedb:9f25:8080:0 for stapling
[Thu Sep 26 15:31:31.248583 2019] [suexec:notice] [pid 12937] AH01232: suEXEC mechanism enabled (wrapper: /usr/lib/apache2/suexec)
SIGTERM handler "exitall" not defined.
[Thu Sep 26 15:31:31.586506 2019] [:error] [pid 12944] python_init: Python version mismatch, expected '2.7.6', found '2.7.15+'.
[Thu Sep 26 15:31:31.586620 2019] [:error] [pid 12944] python_init: Python executable found '/usr/bin/python'.
[Thu Sep 26 15:31:31.586638 2019] [:error] [pid 12944] python_init: Python path being used '/usr/lib/python2.7:/usr/lib/python2.7/plat-x86_64-linux-gnu:/usr/lib/python2.7/lib-tk:/usr/l$
[Thu Sep 26 15:31:31.586664 2019] [:notice] [pid 12944] mod_python: Creating 8 session mutexes based on 150 max processes and 0 max threads.
[Thu Sep 26 15:31:31.586673 2019] [:notice] [pid 12944] mod_python: using mutex_directory /tmp
[Thu Sep 26 15:31:31.609951 2019] [ssl:warn] [pid 12944] AH01906: 2001:3366:6633:0:20c:29ff:fedb:9f25:8080:0 server certificate is a CA certificate (BasicConstraints: CA == TRUE !?)
[Thu Sep 26 15:31:31.609978 2019] [ssl:warn] [pid 12944] AH01909: 2001:3366:6633:0:20c:29ff:fedb:9f25:8080:0 server certificate does NOT include an ID which matches the server name
[Thu Sep 26 15:31:31.610106 2019] [ssl:error] [pid 12944] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: [email protected],CN=schattorie.s$
[Thu Sep 26 15:31:31.610118 2019] [ssl:error] [pid 12944] AH02604: Unable to configure certificate 2001:3366:6633:0:20c:29ff:fedb:9f25:8080:0 for stapling
[Thu Sep 26 15:31:31.621877 2019] [mpm_prefork:notice] [pid 12944] AH00163: Apache/2.4.29 (Ubuntu) mod_fcgid/2.3.9 mod_python/3.3.1 Python/2.7.15+ OpenSSL/1.1.1 configured -- resuming $
[Thu Sep 26 15:31:31.621910 2019] [core:notice] [pid 12944] AH00094: Command line: '/usr/sbin/apache2'
suexec policy violation: see suexec log for more details
[Thu Sep 26 15:31:47.867849 2019] [fcgid:warn] [pid 12982] (104)Connection reset by peer: [client 172.10.0.2:60118] mod_fcgid: error reading data from FastCGI server
[Thu Sep 26 15:31:47.867887 2019] [core:error] [pid 12982] [client 172.10.0.2:60118] End of script output before headers: index.php
suexec policy violation: see suexec log for more details
[Thu Sep 26 15:31:49.889526 2019] [fcgid:warn] [pid 12978] (104)Connection reset by peer: [client 172.10.0.2:60119] mod_fcgid: error reading data from FastCGI server
[Thu Sep 26 15:31:49.889555 2019] [core:error] [pid 12978] [client 172.10.0.2:60119] End of script output before headers: index.php
suexec policy violation: see suexec log for more details
[Thu Sep 26 15:31:50.803096 2019] [fcgid:warn] [pid 12976] (104)Connection reset by peer: [client 172.10.0.2:60120] mod_fcgid: error reading data from FastCGI server
[Thu Sep 26 15:31:50.803125 2019] [core:error] [pid 12976] [client 172.10.0.2:60120] End of script output before headers: index.php
suexec policy violation: see suexec log for more details
[Thu Sep 26 15:31:50.963915 2019] [fcgid:warn] [pid 12975] (104)Connection reset by peer: [client 172.10.0.2:60121] mod_fcgid: error reading data from FastCGI server
[Thu Sep 26 15:31:50.967287 2019] [core:error] [pid 12975] [client 172.10.0.2:60121] End of script output before headers: index.php
suexec policy violation: see suexec log for more details
[Thu Sep 26 15:31:51.119477 2019] [fcgid:warn] [pid 12979] (104)Connection reset by peer: [client 172.10.0.2:60122] mod_fcgid: error reading data from FastCGI server
[Thu Sep 26 15:31:51.119507 2019] [core:error] [pid 12979] [client 172.10.0.2:60122] End of script output before headers: index.php
suexec policy violation: see suexec log for more details
[Thu Sep 26 15:36:01.169713 2019] [fcgid:warn] [pid 12982] (104)Connection reset by peer: [client 172.10.0.2:60176] mod_fcgid: error reading data from FastCGI server
[Thu Sep 26 15:36:01.169734 2019] [core:error] [pid 12982] [client 172.10.0.2:60176] End of script output before headers: index.php
suexec policy violation: see suexec log for more details
Argument ""-"" isn't numeric in numeric gt (>) at /usr/local/ispconfig/server/scripts/vlogger line 514, <STDIN> line 461.
suexec policy violation: see suexec log for more details
[Thu Sep 26 15:51:02.677336 2019] [fcgid:warn] [pid 12978] (104)Connection reset by peer: [client 172.10.0.2:60445] mod_fcgid: error reading data from FastCGI server
[Thu Sep 26 15:51:02.677357 2019] [core:error] [pid 12978] [client 172.10.0.2:60445] End of script output before headers: index.php
suexec policy violation: see suexec log for more details
[Thu Sep 26 15:51:04.640471 2019] [fcgid:warn] [pid 12977] (104)Connection reset by peer: [client 172.10.0.2:60446] mod_fcgid: error reading data from FastCGI server
[Thu Sep 26 15:51:04.640500 2019] [core:error] [pid 12977] [client 172.10.0.2:60446] End of script output before headers: index.php

 

Or should I look into the fcgid error, I've already tried several solutions to eit the fcgid config files and the vhost file of ispconfig...

 

I've tried updating ISPConfig, but that results in an error: "Cannot retrieve version file."

 

ISPConfig not wanting to update had something to do with the DNS servers on my side, I managed to update via "ispconfig_update.sh"...

But unfortunately, it dit not fix my issue :S

 

I haven't logged in to my ISPConfig for months, and the last time I did it just worked fine... The only thing I can think of is that I did an apt-upgrade, but shouldn't I be able to figure out if a package is missing by tracing the error messages?

If I look into my errors, I find this forum post: https://www.howtoforge.com/community/threads/error-500-ispconfig-admin-panel.63983/
The last post states that the file permissions of the /var/www/php-fcgi-scripts//ispconfig are incorrect (which should make sense since that's the error suexec.log shows), so I tried changing them... However, when I look into that folder, it is empty?

Edit: Oh wait, that file is hidden XD

Edit 2: But changing the path as described in the thread above doesn't work either...

 

I've walked through this page of the guide which I used to set up this server.. But every package seems to be in right order...

https://www.howtoforge.com/tutorial...he-php-phpmyadmin-fcgi-suexec-pear-and-mcrypt

Also, if I try to run a simple phpinfo() from the ispconfig dir it also throws an error 500, only simple HTML files are shown in my browser...

Edit: I'm really going crazy at this point... I updated everything, walked through the perfect server guide to make sure I have everything installed... I also found a php-cgi7.2 in my /usr.bin folder, I tried using that in the ispconfig starte script... Nothing works, I cannot get the ispconfig control panel to work anymore...

Does anybody have any suggestion of what I could try?

 

Please read before posting!

 

Thank you guys for your replies!

First the output of @ahrasis's suggestion:

Code:

##### SERVER #####
IP-address (as per hostname): ***.***.***.***
[WARN] could not determine server's ip address by ifconfig
[INFO] OS version is Ubuntu 18.04.3 LTS

[INFO] ISPConfig is installed.

##### ISPCONFIG #####
ISPConfig version is 3.1.15


##### VERSION CHECK #####

[INFO] php (cli) version is 7.2.19-0ubuntu***.***.***.***

##### PORT CHECK #####


##### MAIL SERVER CHECK #####


##### RUNNING SERVER PROCESSES #####

[INFO] I found the following web server(s):
   Apache 2 (PID 18555)
[INFO] I found the following mail server(s):
   Postfix (PID 5365)
[INFO] I found the following pop3 server(s):
   Dovecot (PID 6395)
[INFO] I found the following imap server(s):
   Dovecot (PID 6395)
[INFO] I found the following ftp server(s):
   PureFTP (PID 6515)

##### LISTENING PORTS #####
(only        ()
Local        (Address)
***.***.***.***:53        (8407/named)
[localhost]:53        (8407/named)
[anywhere]:21        (6515/pure-ftpd)
***.***.***.***:53        (768/systemd-resolve)
[anywhere]:22        (1077/sshd)
[localhost]:953        (8407/named)
[anywhere]:25        (5365/master)
[anywhere]:993        (6395/dovecot)
[localhost]:9025        (835/php-fpm:)
[anywhere]:995        (6395/dovecot)
[localhost]:10023        (1566/postgrey)
[localhost]:8999        (835/php-fpm:)
[localhost]:10024        (5295/amavisd-new)
[localhost]:10025        (5365/master)
[localhost]:10026        (5295/amavisd-new)
[localhost]:10027        (5365/master)
[anywhere]:587        (5365/master)
[localhost]:11211        (837/memcached)
[anywhere]:110        (6395/dovecot)
[anywhere]:143        (6395/dovecot)
[anywhere]:465        (5365/master)
*:*:*:*::*:53        (8407/named)
*:*:*:*::*:21        (6515/pure-ftpd)
*:*:*:*::*:22        (1077/sshd)
*:*:*:*::*:953        (8407/named)
*:*:*:*::*:25        (5365/master)
*:*:*:*::*:443        (18555/apache2)
*:*:*:*::*:993        (6395/dovecot)
*:*:*:*::*:995        (6395/dovecot)
*:*:*:*::*:10023        (1566/postgrey)
*:*:*:*::*:10024        (5295/amavisd-new)
*:*:*:*::*:10026        (5295/amavisd-new)
*:*:*:*::*:3306        (6110/mysqld)
*:*:*:*::*:587        (5365/master)
[localhost]10        (6395/dovecot)
[localhost]43        (6395/dovecot)
*:*:*:*::*:8080        (18555/apache2)
*:*:*:*::*:80        (18555/apache2)
*:*:*:*::*:8081        (18555/apache2)
*:*:*:*::*:465        (5365/master)




##### IPTABLES #####
Chain INPUT (policy ACCEPT)
target     prot opt source               destination         

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination         

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination         

The ls -la...

Code:

/ispconfig
total 12
drwxr-xr-x 2 ispconfig ispconfig 4096 Sep 27 00:34 .
drwxrwxrwx 6 root      root      4096 Jun 24  2018 ..
-rw-r--r-- 1 ispconfig ispconfig  300 Sep 27 00:32 .php-fcgi-starter

Fresh Apache error log:

Code:

[Fri Sep 27 06:25:22.895765 2019] [:error] [pid 19931] python_init: Python version mismatch, expected '2.7.6', found '2.7.15+'.
[Fri Sep 27 06:25:22.925271 2019] [:error] [pid 19931] python_init: Python executable found '/usr/bin/python'.
[Fri Sep 27 06:25:22.925297 2019] [:error] [pid 19931] python_init: Python path being used '/usr/lib/python2.7:/usr/lib/python2.7/plat-x86_64-linux-gnu:/usr/lib/python2.7/lib-tk:/usr/lib/python2.7/lib-old:/usr/lib/python2.7/lib-dynload'.
[Fri Sep 27 06:25:22.925317 2019] [:notice] [pid 19931] mod_python: Creating 8 session mutexes based on 150 max processes and 0 max threads.
[Fri Sep 27 06:25:22.925329 2019] [:notice] [pid 19931] mod_python: using mutex_directory /tmp
[Fri Sep 27 06:25:23.705121 2019] [ssl:warn] [pid 19931] AH01906: 10.1.0.25:8080:0 server certificate is a CA certificate (BasicConstraints: CA == TRUE !?)
[Fri Sep 27 06:25:23.705165 2019] [ssl:warn] [pid 19931] AH01909: 10.1.0.25:8080:0 server certificate does NOT include an ID which matches the server name
[Fri Sep 27 06:25:23.740210 2019] [ssl:error] [pid 19931] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: [email protected],CN=schattorie.solutions,OU=IT,O=Schattorie Solutions,L=Heerlen,ST=Limburg,C=NL / issuer: [email protected],CN=schattorie.solutions,OU=IT,O=Schattorie Solutions,L=Heerlen,ST=Limburg,C=NL / serial: BC43ED58186D1CAD / notbefore: Jun 23 10:40:36 2018 GMT / notafter: Jun 20 10:40:36 2028 GMT]
[Fri Sep 27 06:25:23.740242 2019] [ssl:error] [pid 19931] AH02604: Unable to configure certificate 10.1.0.25:8080:0 for stapling
[Fri Sep 27 06:25:23.740456 2019] [mpm_prefork:notice] [pid 19931] AH00163: Apache/2.4.29 (Ubuntu) mod_fcgid/2.3.9 mod_python/3.3.1 Python/2.7.15+ OpenSSL/1.1.1 configured -- resuming normal operations
[Fri Sep 27 06:25:23.740471 2019] [core:notice] [pid 19931] AH00094: Command line: '/usr/sbin/apache2'
[Fri Sep 27 06:25:24.756188 2019] [mpm_prefork:warn] [pid 19931] AH00167: long lost child came home! (pid 19956)
suexec policy violation: see suexec log for more details
suexec policy violation: see suexec log for more details
suexec policy violation: see suexec log for more details
suexec policy violation: see suexec log for more details
suexec policy violation: see suexec log for more details
suexec policy violation: see suexec log for more details
suexec policy violation: see suexec log for more details
suexec policy violation: see suexec log for more details
[Fri Sep 27 08:43:49.733964 2019] [fcgid:warn] [pid 25618] (104)Connection reset by peer: [client 172.10.0.2:53910] mod_fcgid: error reading data from FastCGI server
[Fri Sep 27 08:43:49.733997 2019] [core:error] [pid 25618] [client 172.10.0.2:53910] End of script output before headers: test.php
suexec policy violation: see suexec log for more details
suexec policy violation: see suexec log for more details
[Fri Sep 27 08:51:17.160344 2019] [fcgid:warn] [pid 25617] (104)Connection reset by peer: [client 172.10.0.2:53947] mod_fcgid: error reading data from FastCGI server
[Fri Sep 27 08:51:17.160375 2019] [core:error] [pid 25617] [client 172.10.0.2:53947] End of script output before headers: index.php
suexec policy violation: see suexec log for more details
[Fri Sep 27 08:51:18.308856 2019] [fcgid:warn] [pid 27361] (104)Connection reset by peer: [client 172.10.0.2:53949] mod_fcgid: error reading data from FastCGI server
[Fri Sep 27 08:51:18.308886 2019] [core:error] [pid 27361] [client 172.10.0.2:53949] End of script output before headers: index.php

Fresh suexec log

Code:

[2019-09-27 06:58:40]: uid: (5014/web41) gid: (5005/client1) cmd: .php-fcgi-starter
[2019-09-27 06:58:40]: directory is writable by others: (/var/www/php-fcgi-scripts/web41)
[2019-09-27 07:26:10]: uid: (5014/web41) gid: (5005/client1) cmd: .php-fcgi-starter
[2019-09-27 07:26:10]: directory is writable by others: (/var/www/php-fcgi-scripts/web41)
[2019-09-27 07:56:20]: uid: (5014/web41) gid: (5005/client1) cmd: .php-fcgi-starter
[2019-09-27 07:56:20]: directory is writable by others: (/var/www/php-fcgi-scripts/web41)
[2019-09-27 07:56:21]: uid: (5014/web41) gid: (5005/client1) cmd: .php-fcgi-starter
[2019-09-27 07:56:21]: directory is writable by others: (/var/www/php-fcgi-scripts/web41)
[2019-09-27 07:56:21]: uid: (5014/web41) gid: (5005/client1) cmd: .php-fcgi-starter
[2019-09-27 07:56:21]: directory is writable by others: (/var/www/php-fcgi-scripts/web41)
[2019-09-27 07:56:23]: uid: (5014/web41) gid: (5005/client1) cmd: .php-fcgi-starter
[2019-09-27 07:56:23]: directory is writable by others: (/var/www/php-fcgi-scripts/web41)
[2019-09-27 08:08:19]: uid: (5014/web41) gid: (5005/client1) cmd: .php-fcgi-starter
[2019-09-27 08:08:19]: directory is writable by others: (/var/www/php-fcgi-scripts/web41)
[2019-09-27 08:43:49]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
[2019-09-27 08:43:49]: file has no execute permission: (/var/www/php-fcgi-scripts/ispconfig/.php-fcgi-starter)
[2019-09-27 08:46:34]: uid: (5014/web41) gid: (5005/client1) cmd: .php-fcgi-starter
[2019-09-27 08:46:34]: directory is writable by others: (/var/www/php-fcgi-scripts/web41)
[2019-09-27 08:51:17]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
[2019-09-27 08:51:17]: file has no execute permission: (/var/www/php-fcgi-scripts/ispconfig/.php-fcgi-starter)
[2019-09-27 08:51:18]: uid: (5003/ispconfig) gid: (5004/ispconfig) cmd: .php-fcgi-starter
[2019-09-27 08:51:18]: file has no execute permission: (/var/www/php-fcgi-scripts/ispconfig/.php-fcgi-starter)

 

Hmmm, I should've read the log today, that message wasn't present yesterday

Well, thanks for your help, that fixed it!