ISPConfig 3 is not downloading update package list. I've recovered a backup from my vps, after that the ispconfig3 is not updating he package list How can i debug it to know what is causing it?
What package list? APS or maybe debian repository ( selected check for updates enabled )? At first I'd check for any log traces in /var/log/ispconfig/ispconfig.log cron.log or /var/log/cron.log - maybe syslog, too. You could also comment out your ispconfig crons and run them manually ( don't forget to reenable them ) just use the command /usr/local/ispconfig/server/cron_daily.sh if you meant the repository. If you have issues updating the APS catalog it should leave log entries somewhere. You could check if you can reach apscatalog.com from your command line. Please let me know what kind of package list you were refering to and I'll try to dig into that
I am using ISPConfig latest version....Ubuntu 16 + CSF Firewall and can't update APSCatalog list by the menu option to update it. I've already added apscatalog ip to csf.allow and increased CT-LIMIT from CSF csf.conf to "0" what means no limit and even at that way i can't upgrade the list ...in the previous versions i've been able to do it with no problems... Actually nowadays is always the same problem, ending with no upgrade and reporting the following error message PHP-xml packages are installed once i've verified it. -----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------* apt list php7* | grep "installed" WARNING: apt does not have a stable CLI interface. Use with caution in scripts. php7.0/xenial-updates,xenial-updates,xenial-security,xenial-security,now 7.0.33-0ubuntu0.16.04.4 all [installed] php7.0-bcmath/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-cgi/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-cli/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-common/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-curl/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-fpm/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-gd/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-imap/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-intl/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-json/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic] php7.0-ldap/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic] php7.0-mbstring/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-mcrypt/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-mysql/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-opcache/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-pspell/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-readline/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic] php7.0-recode/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-soap/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic] php7.0-sqlite3/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-tidy/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-xml/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic] php7.0-xmlrpc/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] php7.0-xsl/xenial-updates,xenial-updates,xenial-security,xenial-security,now 7.0.33-0ubuntu0.16.04.4 all [installed] php7.0-zip/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed] # apt list php-* | grep "installed" WARNING: apt does not have a stable CLI interface. Use with caution in scripts. php-apcu/xenial,now 5.1.3+4.0.10-1build1 amd64 [installed] php-auth/xenial,xenial,now 1.6.4-1build1 all [installed] php-auth-sasl/xenial,xenial,now 1.0.6-2build1 all [installed,automatic] php-common/xenial-updates,xenial-updates,now 1:35ubuntu6.1 all [installed,automatic] php-crypt-chap/xenial,xenial,now 1.5.0-1build1 all [installed,automatic] php-db/xenial,xenial,now 1.7.14-3build1 all [installed,automatic] php-gettext/xenial,xenial,now 1.0.11-2build1 all [installed] php-imagick/xenial,now 3.4.0~rc6-1ubuntu3 amd64 [installed] php-ldap/xenial-updates,xenial-updates,now 1:7.0+35ubuntu6.1 all [installed,automatic] php-log/xenial,xenial,now 1.12.9-1build1 all [installed,automatic] php-mail/xenial,xenial,now 1.3.0-1 all [installed,automatic] php-mail-mime/xenial,xenial,now 1.10.0-2 all [installed,automatic] php-mail-mimedecode/xenial,xenial,now 1.5.5-3build1 all [installed,automatic] php-mdb2/xenial,xenial,now 2.5.0b5-1build1 all [installed,automatic] php-memcache/xenial,now 3.0.9~20151130.fdbd46b-2 amd64 [installed] php-net-ldap2/xenial,xenial,now 2.2.0-1ubuntu1 all [installed,automatic] php-net-ldap3/xenial,xenial,now 1.0.3-1build1 all [installed,automatic] php-net-sieve/xenial,xenial,now 1.3.4-2build1 all [installed] php-net-smtp/xenial,xenial,now 1.7.1-1build1 all [installed,automatic] php-net-socket/xenial,xenial,now 1.0.14-1build1 all [installed,automatic] php-pear/xenial-updates,xenial-updates,xenial-security,xenial-security,now 1:1.10.1+submodules+notgz-6ubuntu0.1 all [installed] php-phpseclib/xenial,xenial,now 2.0.1-1build1 all [installed,automatic] php-soap/xenial-updates,xenial-updates,now 1:7.0+35ubuntu6.1 all [installed,automatic] php-tcpdf/xenial,xenial,now 6.0.093+dfsg-1ubuntu1 all [installed,automatic] php-xml/xenial-updates,xenial-updates,now 1:7.0+35ubuntu6.1 all [installed] -----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------* The ISPConfig Log reports just an indication to have a good connection to the PHP from apscatalog website to get the upgrades> "replaced my ip and url for my server " my.ip.XXX.YYY - - [23/May/2019:12:00:53 -0300] "GET /sites/aps_update_packagelist.php HTTP/1.1" 200 1178 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36" my.ip.XXX.YYY - - [23/May/2019:12:00:55 -0300] "GET /sites/aps_cron_apscrawler_if.php HTTP/1.1" 200 925 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36" my.ip.XXX.YYY - - [23/May/2019:12:02:48 -0300] "GET /sites/aps_installedpackages_list.php HTTP/1.1" 200 2007 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36" my.ip.XXX.YYY - - [23/May/2019:12:02:54 -0300] "GET /sites/aps_availablepackages_list.php HTTP/1.1" 200 2181 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36" my.ip.XXX.YYY - - [23/May/2019:12:02:59 -0300] "POST /sites/aps_availablepackages_list.php HTTP/1.1" 200 2670 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36" my.ip.XXX.YYY - - [23/May/2019:12:03:05 -0300] "POST /sites/aps_availablepackages_list.php HTTP/1.1" 200 2182 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36" my.ip.XXX.YYY - - [23/May/2019:12:17:31 -0300] "GET /keepalive.php HTTP/1.1" 200 782 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36" -----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------* Even already deactivate the firewall completly to avoid any kind of interfering from firewall but never updates. Any one have any idea about what could causing it? Just in case an manuall upgrade could be done downloading the files from apscatalog website, please share it here. Thanks in advance
Thanks you ZTK.me for you previous reply! ping apscatalog.com PING apscatalog.com (209.41.159.69) 56(84) bytes of data. 64 bytes from 209.41.159.69: icmp_seq=1 ttl=49 time=148 ms 64 bytes from 209.41.159.69: icmp_seq=2 ttl=49 time=148 ms 64 bytes from 209.41.159.69: icmp_seq=3 ttl=49 time=148 ms 64 bytes from 209.41.159.69: icmp_seq=4 ttl=49 time=148 ms
already tried the following (obviously no effect for quite obvious reason, it should already fixed once the version in use is 3.1.11 ispconfig_patch -------------------------------------------------------------------------------- _____ ___________ _____ __ _ |_ _/ ___| ___ \ / __ \ / _(_) | | \ `--.| |_/ / | / \/ ___ _ __ | |_ _ __ _ | | `--. \ __/ | | / _ \| '_ \| _| |/ _` | _| |_/\__/ / | | \__/\ (_) | | | | | | | (_| | \___/\____/\_| \____/\___/|_| |_|_| |_|\__, | __/ | |___/ -------------------------------------------------------------------------------- >> Patch tool Please enter the patch id that you want to be applied to your ISPConfig installation. Please be aware that we take NO responsibility that this will work for you. Only use patches if you know what you are doing. Enter patch id: 3054_aps Patch description: -------------------------------------------------------------------------------- This patch fixes: APS crawler: String could not be parsed as XML -------------------------------------------------------------------------------- Do you really want to apply this patch now? (y,n) [y]: y (Stripping trailing CRs from patch; use --binary to disable.) patching file interface/lib/classes/aps_crawler.inc.php Reversed (or previously applied) patch detected! Assume -R? [n] Apply anyway? [n] Skipping patch. 2 out of 2 hunks ignored -- saving rejects to file interface/lib/classes/aps_crawler.inc.php.rej (Stripping trailing CRs from patch; use --binary to disable.) patching file server/lib/classes/aps_installer.inc.php Reversed (or previously applied) patch detected! Assume -R? [n] Apply anyway? [n] Skipping patch. 1 out of 1 hunk ignored -- saving rejects to file server/lib/classes/aps_installer.inc.php.rej (Stripping trailing CRs from patch; use --binary to disable.) patching file server/lib/classes/aps_installer.inc.php Reversed (or previously applied) patch detected! Assume -R? [n] Apply anyway? [n] Skipping patch. 1 out of 1 hunk ignored -- saving rejects to file server/lib/classes/aps_installer.inc.php.rej
It might be that the xml which is delivered from apscatalog is broken at the moment as that's what the error message means.
Most funny thing is that checking the directory in /usr/local/ispconfig/interface/web/sites/aps_meta_packages the packages has the new files regarding the most recently version for wordpress for example....seems that the downloading files from apscatalog is working, but the process that transport it to DB is facing a bug
but if a go to available packages to install and try to search for wordpress, only shows the Chinese version, so seems that the dabatase with the packlist has not been updated.
and if i try to change the parameters at both files at interface and server sub-directories (aps_base.inc.php) to use APS VERSION 2.0 rather than 1.2, doesn't work too.
I don't think that there is a fix that can de done on our side. It happens sometimes that apscatalog delivers invalid xml and they fix it after some time.
I've found a way to fix.... I went to directory and deleted all the packages.zip directories regarding the apps that i do not need, remaining just wordpress, and finally worked...soo now we are sure that in the directory /usr/local/ispconfig/interface/web/sites/aps_meta_packages there is one or more files damaged... so i will furthermore recover one-by-one zip package, run de upgrade and identify which one is damaged...But i am quite sure that the first time the CSF blocked the upgrade process due to the CSF->cf.conf>CT_LIMIT parameter (that was "300" seconds) and now is "0" (No limit) has damaged one of the files what is causing the XML error message. What is the best way to recover the ZIP directories originally distributed with ISP Install files?
LOL....fabulous....the upgrade process has automatically recovered the full list after what i've done...ISPCONFIG is really the Best Plataform to Hosting web stuff!!! In other words....deleting 99% of packages from "/usr/local/ispconfig/interface/web/sites/aps_meta_packages" fix the problems Many thanks Till!
