I have not checked my server or performed updates or other in a while and am now getting ERROR 500 - Internal Server Error! when I try to load a webpage. It also appears that I am not able to perform basic apt updates either. Debian 9.11 running NGINX [error] 11996#11996: *10070223 directory index of "/var/www/apps/" is forbidden Thanks for any and all help
The error you posted is about the ispconfig apps vhost on port 8081 and not related to a website. Take a look at the error.log file of the website to find out why you get a 500 error when you access it. Which exact error message do you get when updating with apt?
Thanks for the reply. Not sure if this is what you wanted: root@mr1:/var/www/MyDomain.com/log# cat error.log root@mr1:/var/www/MyDomain.com/log# It comes back empty............... ================================================== apt errors: ----- apt update Ign:1 http://deb.debian.org/debian stretch InRelease Err:2 http://deb.debian.org/debian stretch Release Could not open file /var/lib/apt/lists/partial/deb.debian.org_debian_dists_stretch_Release - open (30: Read-only file system) [IP: 151.101.184.204 80] Ign:3 http://repo.mongodb.org/apt/debian stretch/mongodb-org/4.0 InRelease Ign:4 http://security.debian.org/debian-security stretch/updates InRelease Hit:5 http://repo.mongodb.org/apt/debian stretch/mongodb-org/4.0 Release Err:6 http://repo.mongodb.org/apt/debian stretch/mongodb-org/4.0 Release.gpg Couldn't create temporary file /tmp/apt.conf.yEcVMo for passing config to apt-key Hit:7 http://packages.prosody.im/debian stretch InRelease Err:7 http://packages.prosody.im/debian stretch InRelease Couldn't create temporary file /tmp/apt.conf.1uZBqs for passing config to apt-key Err:8 http://security.debian.org/debian-security stretch/updates Release Could not open file /var/lib/apt/lists/partial/security.debian.org_debian-security_dists_stretch_updates_Release - open (30: Read-only file system) [IP: 151.101.184.204 80] Reading package lists... Done W: chown to _apt:root of directory /var/lib/apt/lists/partial failed - SetupAPTPartialDirectory (30: Read-only file system) W: chmod 0700 of directory /var/lib/apt/lists/partial failed - SetupAPTPartialDirectory (30: Read-only file system) W: Not using locking for read only lock file /var/lib/apt/lists/lock W: Problem unlinking the file /var/lib/apt/lists/partial/.apt-acquire-privs-test.pkB42a - IsAccessibleBySandboxUser (30: Read-only file system) W: Problem unlinking the file /var/lib/apt/lists/partial/.apt-acquire-privs-test.y36TeL - IsAccessibleBySandboxUser (30: Read-only file system) W: Problem unlinking the file /var/lib/apt/lists/partial/.apt-acquire-privs-test.Um0Jql - IsAccessibleBySandboxUser (30: Read-only file system) W: Problem unlinking the file /var/lib/apt/lists/partial/.apt-acquire-privs-test.XT2zCV - IsAccessibleBySandboxUser (30: Read-only file system) W: Problem unlinking the file /var/lib/apt/lists/partial/deb.debian.org_debian_dists_stretch_InRelease - PrepareFiles (30: Read-only file system) W: Problem unlinking the file /var/lib/apt/lists/partial/deb.debian.org_debian_dists_stretch_Release - PrepareFiles (30: Read-only file system) E: The repository 'http://deb.debian.org/debian stretch Release' does no longer have a Release file. N: Updating from such a repository can't be done securely, and is therefore disabled by default. N: See apt-secure(8) manpage for repository creation and user configuration details. W: Problem unlinking the file /var/lib/apt/lists/partial/repo.mongodb.org_apt_debian_dists_stretch_mongodb-org_4.0_InRelease - PrepareFiles (30: Read-only file system) W: Problem unlinking the file /var/lib/apt/lists/partial/security.debian.org_debian-security_dists_stretch_updates_InRelease - PrepareFiles (30: Read-only file system) W: Problem unlinking the file /var/lib/apt/lists/partial/repo.mongodb.org_apt_debian_dists_stretch_mongodb-org_4.0_Release - PrepareFiles (30: Read-only file system) W: Problem unlinking the file /var/lib/apt/lists/partial/repo.mongodb.org_apt_debian_dists_stretch_mongodb-org_4.0_Release.gpg - pkgAcqMetaSig (30: Read-only file system) W: chown to _apt:root of file /var/lib/apt/lists/repo.mongodb.org_apt_debian_dists_stretch_mongodb-org_4.0_Release failed - Item::QueueURI (30: Read-only file system) W: chmod 0600 of file /var/lib/apt/lists/repo.mongodb.org_apt_debian_dists_stretch_mongodb-org_4.0_Release failed - Item::QueueURI (30: Read-only file system) W: chown to root:root of file /var/lib/apt/lists/repo.mongodb.org_apt_debian_dists_stretch_mongodb-org_4.0_Release failed - 400::URIFailure (30: Read-only file system) W: chmod 0644 of file /var/lib/apt/lists/repo.mongodb.org_apt_debian_dists_stretch_mongodb-org_4.0_Release failed - 400::URIFailure (30: Read-only file system) W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://repo.mongodb.org/apt/debian stretch/mongodb-org/4.0 Release: Couldn't create temporary file /tmp/apt.conf.yEcVMo for passing config to apt-key W: Problem unlinking the file /var/lib/apt/lists/partial/packages.prosody.im_debian_dists_stretch_InRelease - PrepareFiles (30: Read-only file system) W: chown to _apt:root of file /var/lib/apt/lists/packages.prosody.im_debian_dists_stretch_InRelease failed - Item::QueueURI (30: Read-only file system) W: chmod 0600 of file /var/lib/apt/lists/packages.prosody.im_debian_dists_stretch_InRelease failed - Item::QueueURI (30: Read-only file system) W: chown to root:root of file /var/lib/apt/lists/packages.prosody.im_debian_dists_stretch_InRelease failed - 400::URIFailure (30: Read-only file system) W: chmod 0644 of file /var/lib/apt/lists/packages.prosody.im_debian_dists_stretch_InRelease failed - 400::URIFailure (30: Read-only file system) W: An error occurred during the signature verification. The repository is not updated and the previous index files will be used. GPG error: http://packages.prosody.im/debian stretch InRelease: Couldn't create temporary file /tmp/apt.conf.1uZBqs for passing config to apt-key W: Problem unlinking the file /var/lib/apt/lists/partial/security.debian.org_debian-security_dists_stretch_updates_Release - PrepareFiles (30: Read-only file system) E: The repository 'http://security.debian.org/debian-security stretch/updates Release' does no longer have a Release file. N: Updating from such a repository can't be done securely, and is therefore disabled by default. N: See apt-secure(8) manpage for repository creation and user configuration details. W: Problem unlinking the file /var/cache/apt/pkgcache.bin - RemoveCaches (30: Read-only file system) W: Problem unlinking the file /var/cache/apt/srcpkgcache.bin - RemoveCaches (30: Read-only file system)
Might be that your server has mounted the filesystem in read-only mode due to errors. Did you reboot the server recently and was this the point the issues started?
No I have not rebooted and was not doing anything on the server for some time. I do not have any type of cause and effect other than not keeping up with updates or other.
According to the error messages, the hard disk is mounted read-only. This explains why services like php or system updates fail. Such a read-only remount happens e.g. when the harddisk failed and the filesystem got corrupted. Try to run these commands to see if the disk is writable: touch /var/cache/apt/test.txt ls -la /var/cache/apt/test.txt and post the result,
root@mr1:/# touch /var/cache/apt/test.txt touch: cannot touch '/var/cache/apt/test.txt': Read-only file system
The filesystem is mounted read-only indeed. Check the syslog file if you can find the reason why it got mounted in read-only mode. You might also want to check the filesystem for defects. To mount it in read-write mode later, you can use this command: mount -o remount, rw /
Thanks for the reply. I contacted the host: "The server was still dropping into an emergency console at startup due to file system inconsistencies, however it was able to repair these issues after running fsck." everything now appears to be working. Thanks!