New Slave Server - Job Queue stuck

Discussion in 'ISPConfig 3 Priority Support' started by nowhere, Oct 26, 2024.

  1. nowhere

    nowhere New Member HowtoForge Supporter

    Hello,
    running multiserver systeme Debian 12 latest
    added a new (additional) slave server, fresh install, with the autoinstall script
    Installation worked without a problem
    New Server is not a mirror of anything (the server should became a additional not mirrored DNS)
    After checking everything (host files, db access, firewalls, php version) I still get the error at the new slave

    Code:
    # /usr/local/ispconfig/server/server.sh
    PHP Deprecated:  Automatic conversion of false to array is deprecated in /usr/local/ispconfig/server/lib/classes/modules.inc.php on line 128
    PHP Warning:  Undefined array key "new" in /usr/local/ispconfig/server/lib/classes/modules.inc.php on line 148
    PHP Fatal error:  Uncaught TypeError: count(): Argument #1 ($value) must be of type Countable|array, null given in /usr/local/ispconfig/server/lib/classes/modules.inc.php:148
    Stack trace:
    #0 /usr/local/ispconfig/server/server.php(187): modules->processDatalog()
    #1 {main}
      thrown in /usr/local/ispconfig/server/lib/classes/modules.inc.php on line 148
    
    Any idea how to fix it?

    Thanks
     
  2. till

    till Super Moderator Staff Member ISPConfig Developer

    There must be some invalid data in the datalog on the master server. Which ISPConfig version is used on the new slave server, and is the ISPConfig version identical on all nodes of the multiserver setup?
     
  3. nowhere

    nowhere New Member HowtoForge Supporter

    Initially the system was installed with debian 11 (some years ago)
    Meantime the system was upgraded to debian 12 and also ISPConfig was always updated.
    Add the moment I added the additional "node147" to the system the master (node140) was at the latest 3.2.12.p1 where the other slaves was at 3.2.12 - but all server at Debian 12
    After problems started I patched the other slaves to 3.2.12.p1
    I´m sure your are right that there is a problem with the datalog.
    One entry my collegue found was that a json string which was in the log a '/n' was wrong (I had to ask him was it was in detail).

    Any idea how to fix?
    If it is the fastest solution I could reinstall the server.
     
  4. till

    till Super Moderator Staff Member ISPConfig Developer

    Reinstalling will not help: what you can try is that you set the value of the field 'updated' in table 'server' to a number that is 1 higher than the datalog_id of the datalog records that fails. I'm not 100% sure if its enough to do this on the master, you might have to do this in server table of the slave too.

    I will have to look at the code to add a condition to skip such faulty records in future.
     
  5. till

    till Super Moderator Staff Member ISPConfig Developer

    I guess the faulty record was just skipped in the past, as older PHP versions were less strict in checking variables.
     
  6. nowhere

    nowhere New Member HowtoForge Supporter

    Hello Till,
    once again thank you for your support!
    1st) everything looks good
    What I did:
    At master server:
    dbispconfig/server
    looked for value of "server_id" and value of "updated"
    For me server_id is "7" and updated was "2683"

    At the table "sys_datalog" I looked for the highest value of "datalog_id" for the affectedd "server_id"
    Back at table dbispconfig/server I entered the 'datalog_id+1' at 'updated' for the slave server server

    At the slave server I also entered the same value to the table at the database of the slave server.
    Now it looks good.
    After that I did a resync of all services for the affected server.

    Now it looks good
    Thanks again for the quick support
     
    till likes this.
  7. nowhere

    nowhere New Member HowtoForge Supporter

    For debbuging I will provide you with additional Information:
    The first error was:
    Code:
    # /usr/local/ispconfig/server/server.sh
    25.10.2024-09:45 - ERROR - Replication of datalog_id: 305 failed. Error: (client) in MySQL server: (localhost) Data truncated for column 'locked' at row 1 # SQL: REPLACE INTO ?? (??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??,??) VALUES (?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)
    25.10.2024-09:45 - ERROR - Error in Replication, changes were not processed.
    finished server.php.
    
    The solution was
    Table "sys_datalog" datarecord with ID 305 "locked" was filled with "n" .

    Code:
    a:2:{s:3:"new";a:129:{s:9:"client_id";s:1:"5";s:10:"sys_userid";s:1:"1";s:11:"sys_groupid";s:1:"1";s:13:"sys_perm_user";s:4:"riud";s:14:"sys_perm_group";s:4:"riud";s:14:"sys_perm_other";s:0:"";s:12:"company_name";s:0:"";s:10:"company_id";s:0:"";s:6:"gender";s:0:"";s:17:"contact_firstname";s:0:"";s:12:"contact_name";s:12:"alois winter";s:11:"customer_no";s:1:"6";s:6:"vat_id";s:0:"";s:6:"street";s:16:"Street 41";s:3:"zip";s:4:"000";s:4:"city";s:4:"Town";s:5:"state";s:13:"Upper Austria";s:7:"country";s:2:"AT";s:9:"telephone";s:15:"+430000000";s:6:"mobile";s:0:"";s:3:"fax";s:0:"";s:5:"email";s:12:"[email protected]";s:8:"internet";s:0:"";s:3:"icq";s:0:"";s:5:"notes";s:0:"";s:18:"bank_account_owner";s:0:"";s:19:"bank_account_number";s:0:"";s:9:"bank_code";s:0:"";s:9:"bank_name";s:0:"";s:17:"bank_account_iban";s:0:"";s:18:"bank_account_swift";s:0:"";s:12:"paypal_email";s:0:"";s:18:"default_mailserver";s:1:"0";s:12:"mail_servers";s:0:"";s:16:"limit_maildomain";s:1:"0";s:13:"limit_mailbox";s:1:"0";s:15:"limit_mailalias";s:1:"0";s:21:"limit_mailaliasdomain";s:1:"0";s:17:"limit_mailforward";s:1:"0";s:18:"limit_mailcatchall";s:1:"0";s:17:"limit_mailrouting";s:1:"0";s:17:"limit_mail_wblist";s:1:"0";s:16:"limit_mailfilter";s:1:"0";s:15:"limit_fetchmail";s:1:"0";s:15:"limit_mailquota";s:1:"0";s:23:"limit_spamfilter_wblist";s:1:"0";s:21:"limit_spamfilter_user";s:1:"0";s:23:"limit_spamfilter_policy";s:1:"0";s:17:"limit_mail_backup";s:1:"y";s:15:"limit_relayhost";s:1:"n";s:18:"default_xmppserver";s:1:"1";s:12:"xmpp_servers";s:0:"";s:17:"limit_xmpp_domain";s:1:"0";s:15:"limit_xmpp_user";s:1:"0";s:14:"limit_xmpp_muc";s:1:"n";s:15:"limit_xmpp_anon";s:1:"n";s:23:"limit_xmpp_auth_options";s:16:"plain,hashed,isp";s:15:"limit_xmpp_vjud";s:1:"n";s:16:"limit_xmpp_proxy";s:1:"n";s:17:"limit_xmpp_status";s:1:"n";s:19:"limit_xmpp_pastebin";s:1:"n";s:22:"limit_xmpp_httparchive";s:1:"n";s:17:"default_webserver";s:1:"2";s:11:"web_servers";s:1:"2";s:12:"limit_web_ip";N;s:16:"limit_web_domain";s:2:"10";s:15:"limit_web_quota";s:4:"2048";s:15:"web_php_options";s:11:"no,fast-cgi";s:9:"limit_cgi";s:1:"n";s:9:"limit_ssi";s:1:"n";s:10:"limit_perl";s:1:"n";s:10:"limit_ruby";s:1:"n";s:12:"limit_python";s:1:"n";s:12:"force_suexec";s:1:"y";s:13:"limit_hterror";s:1:"n";s:14:"limit_wildcard";s:1:"n";s:9:"limit_ssl";s:1:"y";s:21:"limit_ssl_letsencrypt";s:1:"y";s:19:"limit_web_subdomain";s:2:"10";s:21:"limit_web_aliasdomain";s:2:"10";s:14:"limit_ftp_user";s:2:"10";s:16:"limit_shell_user";s:1:"0";s:10:"ssh_chroot";s:2:"no";s:17:"limit_webdav_user";s:1:"0";s:12:"limit_backup";s:1:"y";s:24:"limit_directive_snippets";s:1:"n";s:9:"limit_aps";s:1:"0";s:17:"default_dnsserver";s:1:"0";s:10:"db_servers";s:1:"2";s:14:"limit_dns_zone";s:1:"0";s:23:"default_slave_dnsserver";s:1:"0";s:20:"limit_dns_slave_zone";s:1:"0";s:16:"limit_dns_record";s:1:"0";s:16:"default_dbserver";s:1:"2";s:11:"dns_servers";s:0:"";s:14:"limit_database";s:1:"1";s:19:"limit_database_user";s:2:"10";s:20:"limit_database_quota";s:4:"1024";s:10:"limit_cron";s:1:"0";s:15:"limit_cron_type";s:3:"url";s:20:"limit_cron_frequency";s:1:"5";s:19:"limit_traffic_quota";s:2:"-1";s:12:"limit_client";s:1:"0";s:18:"limit_domainmodule";s:1:"0";s:21:"limit_mailmailinglist";s:1:"0";s:15:"limit_openvz_vm";s:1:"0";s:27:"limit_openvz_vm_template_id";s:1:"0";s:16:"parent_client_id";s:1:"0";s:8:"username";s:8:"rspsucwi";s:8:"password";s:118:"$6$rounds=5000$95e925324cf66a....kfCbECFR1b5U.mYM5Z8GyYT7U6UqqAIEr1QINzaSDfa.A8GoTLJnKpvip2En5MQMhtAzU7m4iRvVO6Zv/";s:8:"language";s:2:"en";s:9:"usertheme";s:7:"default";s:15:"template_master";s:1:"1";s:19:"template_additional";s:0:"";s:10:"created_at";s:10:"1675157349";s:6:"locked";s:0:"";s:8:"canceled";s:1:"n";s:11:"can_use_api";s:1:"n";s:8:"tmp_data";N;s:6:"id_rsa";s:2622:"-----BEGIN OPENSSH PRIVATE KEY-----
    b3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn
    NhAAAAAwEAAQAAAYEAu7HVSpKiEkhnJTjum/20LSMo/p4q+fn8xIxq2PppGVr4MFg3dzBw
    aq1TkBP/kJIhhzTSSii532Vrjn/8yz4+xuercgsi6ELPj3wxJLoqG3SNkr6btB9B/Tc4SD
    .....
    kwHD/vkCesvNemsPRRYIKIHqS0czVLnCv2mPXkpRgNHCPU1GXrTXR1eKa3dFHLKFzDN033
    S1h6CUgIwidGFzjoqkuj3U3H1B3YQwAAAAMBAAEAAAGBALc9BNr5zmoE71XCgAggJf+O/N
    2espw69w83erR7u5E6Y2RnKzccPhOXRSY6r9yHHV5vLgGiQtwammeTAcu15/mtgI4k2x5e
    ....
    dA6IJ0W91XrsRlAAAAG3JzcHN1Y3dpLXJzYS1rZXktMTY3NTE1NzM0OQECAwQFBgc=
    -----END OPENSSH PRIVATE KEY-----
    ";s:7:"ssh_rsa";s:581:"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7sdVKkqISSGclOO6b/bQtIyj+nir5+fzEjGrY+mkZWvgwWDd3MHBqrVOQE/+QkiGHNNJKKLnfZWuOf/........
    mNV9LogBlJMBw/75AnrLzXprD0UWCCiB6ktHM1S5wr9pj15KUYDRwj1NRl6010dXimt3RRyyhcwzdN90tYeglICMInRhc46KpLo91Nx9Qd2EM= rspsucwi-rsa-key-1675157349
    ";s:20:"customer_no_template";s:25:"R[CLIENTID]C[CUSTOMER_NO]";s:17:"customer_no_start";s:1:"1";s:19:"customer_no_counter";s:1:"0";s:10:"added_date";s:10:"2023-01-31";s:8:"added_by";s:0:"";s:17:"validation_status";s:6:"accept";s:10:"risk_score";s:1:"0";s:15:"activation_code";s:0:"";}s:3:"old";a:129:{s:9:"client_id";N;s:10:"sys_userid";N;s:11:"sys_groupid";N;s:13:"sys_perm_user";N;s:14:"sys_perm_group";N;s:14:"sys_perm_other";s:0:"";s:12:"company_name";s:0:"";s:10:"company_id";s:0:"";s:6:"gender";s:0:"";s:17:"contact_firstname";s:0:"";s:12:"contact_name";N;s:11:"customer_no";N;s:6:"vat_id";s:0:"";s:6:"street";N;s:3:"zip";N;s:4:"city";N;s:5:"state";N;s:7:"country";N;s:9:"telephone";N;s:6:"mobile";s:0:"";s:3:"fax";s:0:"";s:5:"email";N;s:8:"internet";s:0:"";s:3:"icq";s:0:"";s:5:"notes";s:0:"";s:18:"bank_account_owner";s:0:"";s:19:"bank_account_number";s:0:"";s:9:"bank_code";s:0:"";s:9:"bank_name";s:0:"";s:17:"bank_account_iban";s:0:"";s:18:"bank_account_swift";s:0:"";s:12:"paypal_email";s:0:"";s:18:"default_mailserver";N;s:12:"mail_servers";s:0:"";s:16:"limit_maildomain";N;s:13:"limit_mailbox";N;s:15:"limit_mailalias";N;s:21:"limit_mailaliasdomain";N;s:17:"limit_mailforward";N;s:18:"limit_mailcatchall";N;s:17:"limit_mailrouting";N;s:17:"limit_mail_wblist";N;s:16:"limit_mailfilter";N;s:15:"limit_fetchmail";N;s:15:"limit_mailquota";N;s:23:"limit_spamfilter_wblist";N;s:21:"limit_spamfilter_user";N;s:23:"limit_spamfilter_policy";N;s:17:"limit_mail_backup";N;s:15:"limit_relayhost";N;s:18:"default_xmppserver";N;s:12:"xmpp_servers";s:0:"";s:17:"limit_xmpp_domain";N;s:15:"limit_xmpp_user";N;s:14:"limit_xmpp_muc";N;s:15:"limit_xmpp_anon";N;s:23:"limit_xmpp_auth_options";N;s:15:"limit_xmpp_vjud";N;s:16:"limit_xmpp_proxy";N;s:17:"limit_xmpp_status";N;s:19:"limit_xmpp_pastebin";N;s:22:"limit_xmpp_httparchive";N;s:17:"default_webserver";N;s:11:"web_servers";N;s:12:"limit_web_ip";N;s:16:"limit_web_domain";N;s:15:"limit_web_quota";N;s:15:"web_php_options";N;s:9:"limit_cgi";N;s:9:"limit_ssi";N;s:10:"limit_perl";N;s:10:"limit_ruby";N;s:12:"limit_python";N;s:12:"force_suexec";N;s:13:"limit_hterror";N;s:14:"limit_wildcard";N;s:9:"limit_ssl";N;s:21:"limit_ssl_letsencrypt";N;s:19:"limit_web_subdomain";N;s:21:"limit_web_aliasdomain";N;s:14:"limit_ftp_user";N;s:16:"limit_shell_user";N;s:10:"ssh_chroot";N;s:17:"limit_webdav_user";N;s:12:"limit_backup";N;s:24:"limit_directive_snippets";N;s:9:"limit_aps";N;s:17:"default_dnsserver";N;s:10:"db_servers";N;s:14:"limit_dns_zone";N;s:23:"default_slave_dnsserver";N;s:20:"limit_dns_slave_zone";N;s:16:"limit_dns_record";N;s:16:"default_dbserver";N;s:11:"dns_servers";s:0:"";s:14:"limit_database";N;s:19:"limit_database_user";N;s:20:"limit_database_quota";N;s:10:"limit_cron";N;s:15:"limit_cron_type";N;s:20:"limit_cron_frequency";N;s:19:"limit_traffic_quota";N;s:12:"limit_client";N;s:18:"limit_domainmodule";N;s:21:"limit_mailmailinglist";N;s:15:"limit_openvz_vm";N;s:27:"limit_openvz_vm_template_id";N;s:16:"parent_client_id";N;s:8:"username";N;s:8:"password";N;s:8:"language";N;s:9:"usertheme";N;s:15:"template_master";N;s:19:"template_additional";s:0:"";s:10:"created_at";N;s:6:"locked";s:0:"";s:8:"canceled";N;s:11:"can_use_api";N;s:8:"tmp_data";N;s:6:"id_rsa";N;s:7:"ssh_rsa";N;s:20:"customer_no_template";N;s:17:"customer_no_start";N;s:19:"customer_no_counter";N;s:10:"added_date";N;s:8:"added_by";s:0:"";s:17:"validation_status";N;s:10:"risk_score";N;s:15:"activation_code";s:0:"";}}
    
    
    
    Hopefully this will help to fix the code
     

Share This Page