ISPConfig 3 is not downloading update package list

Discussion in 'Plugins/Modules/Addons' started by Fabio IT Consultant, Feb 10, 2016.

  1. ISPConfig 3 is not downloading update package list.
    I've recovered a backup from my vps, after that the ispconfig3 is not updating he package list

    How can i debug it to know what is causing it?
     
  2. ztk.me

    ztk.me Well-Known Member HowtoForge Supporter

    What package list? APS or maybe debian repository ( selected check for updates enabled )?
    At first I'd check for any log traces in /var/log/ispconfig/ispconfig.log cron.log or /var/log/cron.log - maybe syslog, too.

    You could also comment out your ispconfig crons and run them manually ( don't forget to reenable them )
    just use the command /usr/local/ispconfig/server/cron_daily.sh if you meant the repository.

    If you have issues updating the APS catalog it should leave log entries somewhere. You could check if you can reach apscatalog.com
    from your command line.

    Please let me know what kind of package list you were refering to and I'll try to dig into that :)
     
    Fabio IT Consultant likes this.
  3. I am using ISPConfig latest version....Ubuntu 16 + CSF Firewall and can't update APSCatalog list by the menu option to update it.
    I've already added apscatalog ip to csf.allow and increased CT-LIMIT from CSF csf.conf to "0" what means no limit and even at that way i can't upgrade the list ...in the previous versions i've been able to do it with no problems...
    Actually nowadays is always the same problem, ending with no upgrade and reporting the following error message
    upload_2019-5-23_12-29-14.png
    PHP-xml packages are installed once i've verified it.
    -----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*
    apt list php7* | grep "installed"

    WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

    php7.0/xenial-updates,xenial-updates,xenial-security,xenial-security,now 7.0.33-0ubuntu0.16.04.4 all [installed]
    php7.0-bcmath/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-cgi/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-cli/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-common/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-curl/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-fpm/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-gd/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-imap/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-intl/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-json/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic]
    php7.0-ldap/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic]
    php7.0-mbstring/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-mcrypt/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-mysql/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-opcache/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-pspell/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-readline/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic]
    php7.0-recode/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-soap/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic]
    php7.0-sqlite3/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-tidy/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-xml/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed,automatic]
    php7.0-xmlrpc/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]
    php7.0-xsl/xenial-updates,xenial-updates,xenial-security,xenial-security,now 7.0.33-0ubuntu0.16.04.4 all [installed]
    php7.0-zip/xenial-updates,xenial-security,now 7.0.33-0ubuntu0.16.04.4 amd64 [installed]

    # apt list php-* | grep "installed"

    WARNING: apt does not have a stable CLI interface. Use with caution in scripts.

    php-apcu/xenial,now 5.1.3+4.0.10-1build1 amd64 [installed]
    php-auth/xenial,xenial,now 1.6.4-1build1 all [installed]
    php-auth-sasl/xenial,xenial,now 1.0.6-2build1 all [installed,automatic]
    php-common/xenial-updates,xenial-updates,now 1:35ubuntu6.1 all [installed,automatic]
    php-crypt-chap/xenial,xenial,now 1.5.0-1build1 all [installed,automatic]
    php-db/xenial,xenial,now 1.7.14-3build1 all [installed,automatic]
    php-gettext/xenial,xenial,now 1.0.11-2build1 all [installed]
    php-imagick/xenial,now 3.4.0~rc6-1ubuntu3 amd64 [installed]
    php-ldap/xenial-updates,xenial-updates,now 1:7.0+35ubuntu6.1 all [installed,automatic]
    php-log/xenial,xenial,now 1.12.9-1build1 all [installed,automatic]
    php-mail/xenial,xenial,now 1.3.0-1 all [installed,automatic]
    php-mail-mime/xenial,xenial,now 1.10.0-2 all [installed,automatic]
    php-mail-mimedecode/xenial,xenial,now 1.5.5-3build1 all [installed,automatic]
    php-mdb2/xenial,xenial,now 2.5.0b5-1build1 all [installed,automatic]
    php-memcache/xenial,now 3.0.9~20151130.fdbd46b-2 amd64 [installed]
    php-net-ldap2/xenial,xenial,now 2.2.0-1ubuntu1 all [installed,automatic]
    php-net-ldap3/xenial,xenial,now 1.0.3-1build1 all [installed,automatic]
    php-net-sieve/xenial,xenial,now 1.3.4-2build1 all [installed]
    php-net-smtp/xenial,xenial,now 1.7.1-1build1 all [installed,automatic]
    php-net-socket/xenial,xenial,now 1.0.14-1build1 all [installed,automatic]
    php-pear/xenial-updates,xenial-updates,xenial-security,xenial-security,now 1:1.10.1+submodules+notgz-6ubuntu0.1 all [installed]
    php-phpseclib/xenial,xenial,now 2.0.1-1build1 all [installed,automatic]
    php-soap/xenial-updates,xenial-updates,now 1:7.0+35ubuntu6.1 all [installed,automatic]
    php-tcpdf/xenial,xenial,now 6.0.093+dfsg-1ubuntu1 all [installed,automatic]
    php-xml/xenial-updates,xenial-updates,now 1:7.0+35ubuntu6.1 all [installed]
    -----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*
    The ISPConfig Log reports just an indication to have a good connection to the PHP from apscatalog website to get the upgrades>
    "replaced my ip and url for my server "
    my.ip.XXX.YYY - - [23/May/2019:12:00:53 -0300] "GET /sites/aps_update_packagelist.php HTTP/1.1" 200 1178 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
    my.ip.XXX.YYY - - [23/May/2019:12:00:55 -0300] "GET /sites/aps_cron_apscrawler_if.php HTTP/1.1" 200 925 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
    my.ip.XXX.YYY - - [23/May/2019:12:02:48 -0300] "GET /sites/aps_installedpackages_list.php HTTP/1.1" 200 2007 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
    my.ip.XXX.YYY - - [23/May/2019:12:02:54 -0300] "GET /sites/aps_availablepackages_list.php HTTP/1.1" 200 2181 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
    my.ip.XXX.YYY - - [23/May/2019:12:02:59 -0300] "POST /sites/aps_availablepackages_list.php HTTP/1.1" 200 2670 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
    my.ip.XXX.YYY - - [23/May/2019:12:03:05 -0300] "POST /sites/aps_availablepackages_list.php HTTP/1.1" 200 2182 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
    my.ip.XXX.YYY - - [23/May/2019:12:17:31 -0300] "GET /keepalive.php HTTP/1.1" 200 782 "https://myserver.com:8172/" "Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.169 Safari/537.36"
    -----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*-----------*
    Even already deactivate the firewall completly to avoid any kind of interfering from firewall but never updates.

    Any one have any idea about what could causing it?

    Just in case an manuall upgrade could be done downloading the files from apscatalog website, please share it here.

    Thanks in advance
     
  4. Thanks you ZTK.me for you previous reply!
    ping apscatalog.com
    PING apscatalog.com (209.41.159.69) 56(84) bytes of data.
    64 bytes from 209.41.159.69: icmp_seq=1 ttl=49 time=148 ms
    64 bytes from 209.41.159.69: icmp_seq=2 ttl=49 time=148 ms
    64 bytes from 209.41.159.69: icmp_seq=3 ttl=49 time=148 ms
    64 bytes from 209.41.159.69: icmp_seq=4 ttl=49 time=148 ms
     
  5. already tried the following (obviously no effect for quite obvious reason, it should already fixed once the version in use is 3.1.11

    ispconfig_patch


    --------------------------------------------------------------------------------
    _____ ___________ _____ __ _
    |_ _/ ___| ___ \ / __ \ / _(_)
    | | \ `--.| |_/ / | / \/ ___ _ __ | |_ _ __ _
    | | `--. \ __/ | | / _ \| '_ \| _| |/ _` |
    _| |_/\__/ / | | \__/\ (_) | | | | | | | (_| |
    \___/\____/\_| \____/\___/|_| |_|_| |_|\__, |
    __/ |
    |___/
    --------------------------------------------------------------------------------


    >> Patch tool

    Please enter the patch id that you want to be applied to your ISPConfig installation.
    Please be aware that we take NO responsibility that this will work for you.
    Only use patches if you know what you are doing.

    Enter patch id: 3054_aps

    Patch description:
    --------------------------------------------------------------------------------
    This patch fixes: APS crawler: String could not be parsed as XML
    --------------------------------------------------------------------------------
    Do you really want to apply this patch now? (y,n) [y]: y

    (Stripping trailing CRs from patch; use --binary to disable.)
    patching file interface/lib/classes/aps_crawler.inc.php
    Reversed (or previously applied) patch detected! Assume -R? [n]
    Apply anyway? [n]
    Skipping patch.
    2 out of 2 hunks ignored -- saving rejects to file interface/lib/classes/aps_crawler.inc.php.rej
    (Stripping trailing CRs from patch; use --binary to disable.)
    patching file server/lib/classes/aps_installer.inc.php
    Reversed (or previously applied) patch detected! Assume -R? [n]
    Apply anyway? [n]
    Skipping patch.
    1 out of 1 hunk ignored -- saving rejects to file server/lib/classes/aps_installer.inc.php.rej
    (Stripping trailing CRs from patch; use --binary to disable.)
    patching file server/lib/classes/aps_installer.inc.php
    Reversed (or previously applied) patch detected! Assume -R? [n]
    Apply anyway? [n]
    Skipping patch.
    1 out of 1 hunk ignored -- saving rejects to file server/lib/classes/aps_installer.inc.php.rej
     
  6. till

    till Super Moderator Staff Member ISPConfig Developer

    It might be that the xml which is delivered from apscatalog is broken at the moment as that's what the error message means.
     
    Fabio IT Consultant likes this.
  7. Most funny thing is that checking the directory in /usr/local/ispconfig/interface/web/sites/aps_meta_packages
    the packages has the new files regarding the most recently version for wordpress for example....seems that the downloading files from apscatalog is working, but the process that transport it to DB is facing a bug
    upload_2019-5-23_13-28-43.png
     
    Last edited: May 23, 2019
  8. but if a go to available packages to install and try to search for wordpress, only shows the Chinese version, so seems that the dabatase with the packlist has not been updated.
    upload_2019-5-23_13-29-47.png
     
  9. and if i try to change the parameters at both files at interface and server sub-directories (aps_base.inc.php) to use APS VERSION 2.0 rather than 1.2, doesn't work too.
    upload_2019-5-23_13-33-10.png
    upload_2019-5-23_13-33-27.png
    upload_2019-5-23_13-34-28.png
     

    Attached Files:

  10. many Thanks for the reply Till...
    what do you suggest to fix it manually?
     
  11. till

    till Super Moderator Staff Member ISPConfig Developer

    I don't think that there is a fix that can de done on our side. It happens sometimes that apscatalog delivers invalid xml and they fix it after some time.
     
    Fabio IT Consultant likes this.
  12. I've found a way to fix....

    I went to directory upload_2019-5-23_13-50-19.png
    and deleted all the packages.zip directories regarding the apps that i do not need, remaining just wordpress, and finally worked...soo now we are sure that in the directory /usr/local/ispconfig/interface/web/sites/aps_meta_packages there is one or more files damaged...
    so i will furthermore recover one-by-one zip package, run de upgrade and identify which one is damaged...But i am quite sure that the first time the CSF blocked the upgrade process due to the CSF->cf.conf>CT_LIMIT parameter (that was "300" seconds) and now is "0" (No limit) has damaged one of the files what is causing the XML error message.
    What is the best way to recover the ZIP directories originally distributed with ISP Install files?

    upload_2019-5-23_13-49-54.png
     
    Last edited: May 23, 2019
  13. LOL....fabulous....the upgrade process has automatically recovered the full list after what i've done...ISPCONFIG is really the Best Plataform to Hosting web stuff!!!
    In other words....deleting 99% of packages from "/usr/local/ispconfig/interface/web/sites/aps_meta_packages" fix the problems
    Many thanks Till!
     
    ahrasis and till like this.

Share This Page