Mail stuck in queue - Amavis misconfig

Discussion in 'General' started by Sharone, Jun 23, 2020.

  1. Sharone

    Sharone Member

    Hi there,
    I'm running Ubuntu 18.04, I just upgraded to ISPConfig 3.1.15p3 (multiserver setup) and I have a ton of mail stuck in the mail queue that I cannot seem to resolve. Errors point to Amavis setup (could be additional misconfigurations elsewhere) that is fine one moment and after a couple of minutes it is as below;

    Error message in mail queue
    Code:
    0E4B0DFADF9    27676 Tue Jun 23 15:37:52  [email protected]
    (delivery temporarily suspended: connect to 127.0.0.1[127.0.0.1]:10026: Connection refused)
                                             [email protected]
    74B38E0698D    31165 Tue Jun 23 11:37:59  [email protected]
    (delivery temporarily suspended: connect to 127.0.0.1[127.0.0.1]:10024: Connection refused)
                                             [email protected]
    
    

    Code:
    root@mail:~# systemctl status amavis
    ● amavis.service - LSB: Starts amavisd-new mailfilter
       Loaded: loaded (/etc/init.d/amavis; generated)
       Active: active (running) since Tue 2020-06-23 20:20:25 EAT; 44min ago
         Docs: man:systemd-sysv-generator(8)
      Process: 10440 ExecStop=/etc/init.d/amavis stop (code=exited, status=0/SUCCESS)
      Process: 10450 ExecStart=/etc/init.d/amavis start (code=exited, status=0/SUCCESS)
        Tasks: 3 (limit: 4915)
       CGroup: /system.slice/amavis.service
               ├─10511 /usr/sbin/amavisd-new (master)
               ├─18652 /usr/sbin/amavisd-new (ch1-18652-01-3)
               └─18655 /usr/sbin/amavisd-new (ch1-18655-01-3)
    
    Jun 23 21:04:23 mail.srv.domain.tld amavis[18655]: (18655-01-2) Blocked MTA-BLOCKED {TempFailedInbound}, [127.0.0.1]:56586 <[email protected]> -> <techs
    Jun 23 21:04:23 mail.srv.domain.tld amavis[18655]: (18655-01-3) (!)connect to /var/run/clamav/clamd.ctl failed, attempt #1: Can't connect to a UNIX socket /var/run/cl
    Jun 23 21:04:24 mail.srv.domain.tld amavis[18652]: (18652-01-3) (!)connect to /var/run/clamav/clamd.ctl failed, attempt #1: Can't connect to a UNIX socket /var/run/cl
    Jun 23 21:04:24 mail.srv.domain.tld amavis[18652]: (18652-01-3) (!)ClamAV-clamd av-scanner FAILED: run_av error: Too many retries to talk to /var/run/clamav/clamd.ctl
    Jun 23 21:04:24 mail.srv.domain.tld amavis[18652]: (18652-01-3) (!)WARN: all primary virus scanners failed, considering backups
    Jun 23 21:04:24 mail.srv.domain.tld amavis[18652]: (18652-01-3) (!)run_av (ClamAV-clamscan) FAILED - unexpected exit 2, output="LibClamAV Error: cli_loaddbdir(): No s
    Jun 23 21:04:24 mail.srv.domain.tld amavis[18652]: (18652-01-3) (!)ClamAV-clamscan av-scanner FAILED: /usr/local/bin/clamscan unexpected exit 2, output="LibClamAV Err
    Jun 23 21:04:24 mail.srv.domain.tld amavis[18652]: (18652-01-3) (!!)AV: ALL VIRUS SCANNERS FAILED
    Jun 23 21:04:24 mail.srv.domain.tld amavis[18655]: (18655-01-3) (!)connect to /var/run/clamav/clamd.ctl failed, attempt #1: Can't connect to a UNIX socket /var/run/cl
    Jun 23 21:04:24 mail.srv.domain.tld amavis[18655]: (18655-01-3) (!)ClamAV-clamd: All attempts (1) failed connecting to /var/run/clamav/clamd.ctl, retrying (2)
    Code:
    root@mail:~# systemctl status clamav-freshclam.service
    ● clamav-freshclam.service - LSB: ClamAV virus database updater
       Loaded: loaded (/etc/init.d/clamav-freshclam; generated)
       Active: active (exited) since Tue 2020-06-23 20:20:39 EAT; 1h 16min ago
         Docs: man:systemd-sysv-generator(8)
      Process: 10920 ExecStop=/etc/init.d/clamav-freshclam stop (code=exited, status=0/SUCCESS)
      Process: 10921 ExecStart=/etc/init.d/clamav-freshclam start (code=exited, status=0/SUCCESS)
    
    Jun 23 20:20:39 mail.srv.domain.tld systemd[1]: Starting LSB: ClamAV virus database updater...
    Jun 23 20:20:39 mail.srv.domain.tld systemd[1]: Started LSB: ClamAV virus database updater.
    
    
    root@mail:~# systemctl status clamav-daemon.service
    ● clamav-daemon.service - LSB: ClamAV daemon
       Loaded: loaded (/etc/init.d/clamav-daemon; generated)
       Active: active (exited) since Tue 2020-06-23 20:20:34 EAT; 1h 16min ago
         Docs: man:systemd-sysv-generator(8)
      Process: 10749 ExecStop=/etc/init.d/clamav-daemon stop (code=exited, status=0/SUCCESS)
      Process: 10750 ExecStart=/etc/init.d/clamav-daemon start (code=exited, status=0/SUCCESS)
    
    Jun 23 20:20:34 mail.srv.domain.tld systemd[1]: Starting LSB: ClamAV daemon...
    Jun 23 20:20:34 mail.srv.domain.tld systemd[1]: Started LSB: ClamAV daemon.
    
    Code:
    root@mail:~#  ll /var/run/clamav/
    ls: cannot access '/var/run/clamav/': No such file or directory
    
    less /etc/clamav/clamd.conf
    Code:
    #Automatically Generated by clamav-daemon postinst
    #To reconfigure clamd run #dpkg-reconfigure clamav-daemon
    #Please read /usr/share/doc/clamav-daemon/README.Debian.gz for details
    #LocalSocket /var/run/clamav/clamd.ctl
    LocalSocket /var/lib/clamav/clamd.sock
    FixStaleSocket true
    LocalSocketGroup clamav
    LocalSocketMode 666
    # TemporaryDirectory is not set to its default /tmp here to make overriding
    # the default with environment variables TMPDIR/TMP/TEMP possible
    User clamav
    ScanMail true
    ScanArchive true
    ArchiveBlockEncrypted false
    MaxDirectoryRecursion 15
    FollowDirectorySymlinks false
    FollowFileSymlinks false
    ReadTimeout 180
    MaxThreads 12
    MaxConnectionQueueLength 15
    LogSyslog false
    LogRotate true
    LogFacility LOG_LOCAL6
    LogClean false
    LogVerbose false
    PreludeEnable no
    PreludeAnalyzerName ClamAV
    DatabaseDirectory /var/lib/clamav
    OfficialDatabaseOnly false
    SelfCheck 3600
    Foreground false
    Debug false
    ScanPE true
    MaxEmbeddedPE 10M
    ScanOLE2 true
    ScanPDF true
    ScanHTML true
    MaxHTMLNormalize 10M
    MaxHTMLNoTags 2M
    MaxScriptNormalize 5M
    MaxZipTypeRcg 1M
    ScanSWF true
    ExitOnOOM false
    LeaveTemporaryFiles false
    AlgorithmicDetection true
    ScanELF true
    IdleTimeout 30
    CrossFilesystems true
    PhishingSignatures true
    PhishingScanURLs true
    PhishingAlwaysBlockSSLMismatch false
    PhishingAlwaysBlockCloak false
    PartitionIntersection false
    DetectPUA false
    ScanPartialMessages false
    HeuristicScanPrecedence false
    StructuredDataDetection false
    CommandReadTimeout 30
    SendBufTimeout 200
    MaxQueue 100
    ExtendedDetectionInfo true
    OLE2BlockMacros false
    AllowAllMatchScan true
    ForceToDisk false
    DisableCertCheck false
    DisableCache false
    MaxScanTime 120000
    MaxScanSize 100M
    MaxFileSize 25M
    MaxRecursion 16
    MaxFiles 10000
    MaxPartitions 50
    MaxIconsPE 100
    PCREMatchLimit 10000
    PCRERecMatchLimit 5000
    PCREMaxFileSize 25M
    ScanXMLDOCS true
    ScanHWP3 true
    MaxRecHWP3 16
    StreamMaxLength 25M
    LogFile /var/log/clamav/clamav.log
    LogTime true
    LogFileUnlock false
    LogFileMaxSize 0
    Bytecode true
    BytecodeSecurity TrustSigned
    BytecodeTimeout 60000
    OnAccessMaxFileSize 5M
    
    Code:
    root@mail:~# ll /var/lib/clamav
    total 12
    drwxrwxrwx  3 clamav clamav 4096 Jun 23 17:33 ./
    drwxr-xr-x 76 root   root   4096 Jun 23 18:25 ../
    -rw-r--r--  1 clamav clamav    0 Jun 23 16:07 clamd.sock
    drwxr-xr-x  2 clamav clamav 4096 Jun 23 17:36 tmp.12b09/
     
  2. Sharone

    Sharone Member

    /etc/amavis/conf.d/05-node_id
    Code:
    use strict;
    
    # $myhostname is used by amavisd-new for node identification, and it is
    # important to get it right (e.g. for ESMTP EHLO, loop detection, and so on).
    
    # chomp($myhostname = `hostname --fqdn`);
    
    # To manually set $myhostname, edit the following line with the correct Fully
    # Qualified Domain Name (FQDN) and remove the # at the beginning of the line.
    #
    $myhostname = "mail.srv.domain.tld";
    
    1;  # ensure a defined return

    postconf -n
    Code:
    postconf -n
    root@mail-20:~# postconf -n
    alias_database = hash:/etc/aliases, hash:/var/lib/mailman/data/aliases
    alias_maps = hash:/etc/aliases, hash:/var/lib/mailman/data/aliases
    append_dot_mydomain = no
    biff = no
    body_checks = regexp:/etc/postfix/body_checks
    broken_sasl_auth_clients = yes
    content_filter = amavis:[127.0.0.1]:10024
    dovecot_destination_recipient_limit = 1
    greylisting = check_policy_service inet:127.0.0.1:10023
    header_checks = regexp:/etc/postfix/header_checks
    html_directory = /usr/share/doc/postfix/html
    inet_interfaces = all
    inet_protocols = all
    mailbox_size_limit = 0
    maildrop_destination_concurrency_limit = 1
    maildrop_destination_recipient_limit = 1
    mailman_destination_recipient_limit = 1
    message_size_limit = 0
    mime_header_checks = regexp:/etc/postfix/mime_header_checks
    mydestination = mail-20.srv.domain.tld, localhost, localhost.localdomain
    myhostname = mail-20.srv.domain.tld
    mynetworks = 127.0.0.0/8 x.x.x.x/32 x.x.x.x/32 10.0.0.0/32 [::1]/128
    myorigin = /etc/mailname
    nested_header_checks = regexp:/etc/postfix/nested_header_checks
    owner_request_special = no
    policyd-spf_time_limit = 3600
    proxy_read_maps = $local_recipient_maps $mydestination $virtual_alias_maps $virtual_alias_domains $sender_bcc_maps $virtual_mailbox_maps $virtual_mailbox_domains $relay_recipient_maps $relay_domains $canonical_maps $sender_canonical_maps $recipient_canonical_maps $relocated_maps $transport_maps $mynetworks $smtpd_sender_login_maps
    readme_directory = /usr/share/doc/postfix
    receive_override_options = no_address_mappings
    recipient_delimiter = +
    relay_domains = mysql:/etc/postfix/mysql-virtual_relaydomains.cf
    relay_recipient_maps = mysql:/etc/postfix/mysql-virtual_relayrecipientmaps.cf
    relayhost =
    sender_bcc_maps = proxy:mysql:/etc/postfix/mysql-virtual_outgoing_bcc.cf
    smtp_sasl_auth_enable = no
    smtp_sasl_password_maps = hash:/etc/postfix/sasl_passwd
    smtp_sasl_security_options =
    smtp_tls_exclude_ciphers = RC4, aNULL
    smtp_tls_protocols = !SSLv2,!SSLv3
    smtp_tls_security_level = may
    smtp_tls_session_cache_database = btree:${data_directory}/smtp_scache
    smtpd_banner = $myhostname ESMTP $mail_name (Ubuntu)
    smtpd_client_message_rate_limit = 100
    smtpd_client_restrictions = check_client_access mysql:/etc/postfix/mysql-virtual_client.cf
    smtpd_helo_required = yes
    smtpd_helo_restrictions = permit_sasl_authenticated, permit_mynetworks, check_helo_access regexp:/etc/postfix/helo_access, reject_invalid_hostname, reject_non_fqdn_hostname, reject_invalid_helo_hostname, reject_unknown_helo_hostname, check_helo_access regexp:/etc/postfix/blacklist_helo
    smtpd_recipient_restrictions = permit_mynetworks, permit_sasl_authenticated, reject_unauth_destination, check_recipient_access mysql:/etc/postfix/mysql-virtual_recipient.cf, check_recipient_access mysql:/etc/postfix/mysql-virtual_policy_greylist.cf
    smtpd_restriction_classes = greylisting
    smtpd_sasl_auth_enable = yes
    smtpd_sasl_authenticated_header = yes
    smtpd_sasl_path = private/auth
    smtpd_sasl_type = dovecot
    smtpd_sender_login_maps = proxy:mysql:/etc/postfix/mysql-virtual_sender_login_maps.cf
    smtpd_sender_restrictions = check_sender_access regexp:/etc/postfix/tag_as_originating.re , permit_mynetworks, permit_sasl_authenticated, check_sender_access mysql:/etc/postfix/mysql-virtual_sender.cf, check_sender_access regexp:/etc/postfix/tag_as_foreign.re
    smtpd_tls_cert_file = /etc/postfix/smtpd.cert
    smtpd_tls_exclude_ciphers = RC4, aNULL
    smtpd_tls_key_file = /etc/postfix/smtpd.key
    smtpd_tls_mandatory_protocols = !SSLv2, !SSLv3
    smtpd_tls_protocols = !SSLv2,!SSLv3
    smtpd_tls_security_level = may
    smtpd_tls_session_cache_database = btree:${data_directory}/smtpd_scache
    smtpd_use_tls = yes
    transport_maps = hash:/var/lib/mailman/data/transport-mailman, proxy:mysql:/etc/postfix/mysql-virtual_transports.cf
    virtual_alias_domains =
    virtual_alias_maps = hash:/var/lib/mailman/data/virtual-mailman, proxy:mysql:/etc/postfix/mysql-virtual_forwardings.cf, proxy:mysql:/etc/postfix/mysql-virtual_email2email.cf
    virtual_gid_maps = mysql:/etc/postfix/mysql-virtual_gids.cf
    virtual_mailbox_base = /var/vmail
    virtual_mailbox_domains = proxy:mysql:/etc/postfix/mysql-virtual_domains.cf
    virtual_mailbox_maps = proxy:mysql:/etc/postfix/mysql-virtual_mailboxes.cf
    virtual_maps = hash:/var/lib/mailman/data/virtual-mailman
    virtual_transport = dovecot
    virtual_uid_maps = mysql:/etc/postfix/mysql-virtual_uids.cf
    
    postconf -M (/etc/postfix/master.cf)
    Code:
    smtp       inet  n       -       y       -       -       smtpd
    pickup     fifo  n       -       y       60      1       pickup
    cleanup    unix  n       -       y       -       0       cleanup
    qmgr       fifo  n       -       n       300     1       qmgr
    tlsmgr     unix  -       -       y       1000?   1       tlsmgr
    rewrite    unix  -       -       y       -       -       trivial-rewrite
    bounce     unix  -       -       y       -       0       bounce
    defer      unix  -       -       y       -       0       bounce
    trace      unix  -       -       y       -       0       bounce
    verify     unix  -       -       y       -       1       verify
    flush      unix  n       -       y       1000?   0       flush
    proxymap   unix  -       -       n       -       -       proxymap
    proxywrite unix  -       -       n       -       1       proxymap
    smtp       unix  -       -       y       -       -       smtp
    relay      unix  -       -       y       -       -       smtp
    showq      unix  n       -       y       -       -       showq
    error      unix  -       -       y       -       -       error
    retry      unix  -       -       y       -       -       error
    discard    unix  -       -       y       -       -       discard
    local      unix  -       n       n       -       -       local
    virtual    unix  -       n       n       -       -       virtual
    lmtp       unix  -       -       y       -       -       lmtp
    anvil      unix  -       -       y       -       1       anvil
    scache     unix  -       -       y       -       1       scache
    maildrop   unix  -       n       n       -       -       pipe flags=DRhu user=vmail argv=/usr/bin/maildrop -d vmail ${extension} ${recipient} ${user} ${nexthop} ${sender}
    uucp       unix  -       n       n       -       -       pipe flags=Fqhu user=uucp argv=uux -r -n -z -a$sender - $nexthop!rmail ($recipient)
    ifmail     unix  -       n       n       -       -       pipe flags=F user=ftn argv=/usr/lib/ifmail/ifmail -r $nexthop ($recipient)
    bsmtp      unix  -       n       n       -       -       pipe flags=Fq. user=bsmtp argv=/usr/lib/bsmtp/bsmtp -t$nexthop -f$sender $recipient
    scalemail-backend unix - n       n       -       2       pipe flags=R user=scalemail argv=/usr/lib/scalemail/bin/scalemail-store ${nexthop} ${user} ${extension}
    mailman    unix  -       n       n       -       -       pipe flags=FR user=list argv=/usr/lib/mailman/bin/postfix-to-mailman.py ${nexthop} ${user}
    dovecot    unix  -       n       n       -       -       pipe flags=DROhu user=vmail:vmail argv=/usr/lib/dovecot/deliver -f ${sender} -d ${user}@${nexthop}
    amavis     unix  -       -       y       -       2       smtp -o smtp_data_done_timeout=1200 -o smtp_send_xforward_command=yes
    127.0.0.1:10025 inet n   -       y       -       -       smtpd -o content_filter= -o local_recipient_maps= -o relay_recipient_maps= -o smtpd_restriction_classes= -o smtpd_client_restrictions= -o smtpd_helo_restrictions= -o smtpd_sender_restrictions= -o smtpd_recipient_restrictions=permit_mynetworks,reject -o mynetworks=127.0.0.0/8 -o strict_rfc821_envelopes=yes -o receive_override_options=no_unknown_recipient_checks,no_header_body_checks
    127.0.0.1:10027 inet n   -       n       -       -       smtpd -o content_filter= -o local_recipient_maps= -o relay_recipient_maps= -o smtpd_restriction_classes= -o smtpd_client_restrictions= -o smtpd_helo_restrictions= -o smtpd_sender_restrictions= -o smtpd_recipient_restrictions=permit_mynetworks,reject -o mynetworks=127.0.0.0/8 -o strict_rfc821_envelopes=yes -o receive_override_options=no_unknown_recipient_checks,no_header_body_checks -o smtp_send_xforward_command=yes -o milter_default_action=accept -o milter_macro_daemon_name=ORIGINATING -o disable_dns_lookups=yes
    policyd-spf unix -       n       n       -       0       spawn user=policyd-spf argv=/usr/bin/policyd-spf
     
    Last edited: Jun 23, 2020
  3. till

    till Super Moderator Staff Member ISPConfig Developer

    from which version did you upgrade to 3.1.15p3 and did you choose to reconfigure services during update? Any custom config file templates in use?
     
  4. Sharone

    Sharone Member

    - I upgraded from 3.0.5.4p9 (Ubuntu 14.04)
    - I chose to reconfigure the services during the update
    - No custom file templates in use that I can think of. I only edited existing files
     
  5. till

    till Super Moderator Staff Member ISPConfig Developer

    If I understand you correctly, you upgraded Ubuntu from 14.04 to 18.04 in the same process? Did you go through the Ubuntu 18.04 perfect server tutorial step by step to install missing packages (especially the mail part, in your case)? The port 10026 is from amavis, so there must be an issue with the amavis config if it does not open that port.
     
  6. Sharone

    Sharone Member

    Yes I installed the missing packages but I have been having trouble with getting amavis & clamav to work.
    I keep getting this error when I run freshclam and yet libcurl4 was installed with clamav.

    Code:
    freshclam: /usr/lib/x86_64-linux-gnu/libcurl.so.4: version `CURL_OPENSSL_3' not found (required by /usr/local/lib/libfreshclam.so.2)
    
     
  7. Sharone

    Sharone Member

    I ran this command again and installed spamassassin

    I also ran
    However I am now getting this from amavis
    Code:
    root@mail:~# systemctl status amavis
    ● amavis.service - LSB: Starts amavisd-new mailfilter
       Loaded: loaded (/etc/init.d/amavis; generated)
       Active: active (exited) since Wed 2020-06-24 17:36:12 EAT; 39min ago
         Docs: man:systemd-sysv-generator(8)
      Process: 24624 ExecStop=/etc/init.d/amavis stop (code=exited, status=0/SUCCESS)
      Process: 24630 ExecStart=/etc/init.d/amavis start (code=exited, status=0/SUCCESS)
    
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: No decoder for       .jar
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: No decoder for       .lha
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: No decoder for       .lrz
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: No decoder for       .lz4
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: No decoder for       .rar
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: No decoder for       .swf
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: Using primary internal av scanner code for ClamAV-clamd
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: Found secondary av scanner ClamAV-clamscan at /usr/local/bin/clamscan
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: (!!)TROUBLE in pre_loop_hook: config: no rules were found!  Do you need to run 'sa-update'?
    Jun 24 17:36:12 mail.srv.domain.tld amavis[24676]: (!)_DIE: Suicide () TROUBLE in pre_loop_hook: config: no rules were found!  Do you need to run 'sa-update'
    sa-update gives me
    Code:
    root@mail:~# sa-update -vvv
    gpg: WARNING: unsafe ownership on homedir '/etc/spamassassin/sa-update-keys'
    DNS TXT query: 2.4.3.updates.spamassassin.org -> 1879105
    Update available for channel updates.spamassassin.org: -1 -> 1879105
    DNS TXT query: mirrors.updates.spamassassin.org -> http://spamassassin.apache.org/updates/MIRRORED.BY
    fetching http://spamassassin.apache.org/updates/MIRRORED.BY
    http: (wget) GET http://spamassassin.apache.org/updates/MIRRORED.BY, FAILED, status: exit 4
    error: unable to refresh mirrors file for channel updates.spamassassin.org, using old file
    error: no mirror data available for channel updates.spamassassin.org
    channel: MIRRORED.BY file contents were missing, channel failed
    Update failed, exiting with code 4
    
    Permissions
    Code:
    root@mail:~# ll /var/lib/spamassassin/
    total 24
    drwxr-xr-x  6 debian-spamd debian-spamd 4096 Jun 24 02:00 ./
    drwxr-xr-x 75 root         root         4096 Jun 24 12:01 ../
    drwxr-xr-x  3 debian-spamd debian-spamd 4096 Jun 24 02:00 3.004002/
    drwxr-xr-x  3 debian-spamd debian-spamd 4096 Jun 23 11:41 compiled/
    drwxr-xr-x  3 debian-spamd debian-spamd 4096 Jun 24 17:56 sa-update-keys/
    drwxr-xr-x  3 debian-spamd debian-spamd 4096 Jun 23 11:41 .spamassassin/
    
    Code:
    root@mail:~# ll /etc/spamassassin/
    total 72
    drwxr-xr-x   4 debian-spamd debian-spamd  4096 Jun 24 02:00 ./
    drwxr-xr-x 131 root         root         12288 Jun 24 16:43 ../
    -rw-r--r--   1 debian-spamd debian-spamd  1292 Feb 10 18:17 65_debian.cf
    -rw-r--r--   1 debian-spamd debian-spamd  1289 Jan 28  2015 init.pre
    -rw-r--r--   1 debian-spamd debian-spamd  2208 May 24  2017 local.cf
    -rw-r--r--   1 debian-spamd debian-spamd  2379 Nov  6  2018 local.cf.dpkg-dist
    -rw-r--r--   1 debian-spamd debian-spamd   118 Jan 28  2015 sa-compile.pre
    drwxr-xr-x   2 debian-spamd debian-spamd  4096 Jun 23 11:08 sa-update-hooks.d/
    drwx------   3 debian-spamd debian-spamd  4096 Jun 24 18:17 sa-update-keys/
    -rw-r--r--   1 debian-spamd debian-spamd  2524 Jan 28  2015 v310.pre
    -rw-r--r--   1 debian-spamd debian-spamd  1194 Jan 28  2015 v312.pre
    -rw-r--r--   1 debian-spamd debian-spamd  2416 Jan 28  2015 v320.pre
    -rw-r--r--   1 debian-spamd debian-spamd  1237 Jan 28  2015 v330.pre
    -rw-r--r--   1 debian-spamd debian-spamd  1020 Jan 28  2015 v340.pre
    -rw-r--r--   1 debian-spamd debian-spamd  1309 Nov  6  2018 v341.pre
    -rw-r--r--   1 debian-spamd debian-spamd  1505 Nov  6  2018 v342.pre
    
    I keep hitting dead ends
     
  8. till

    till Super Moderator Staff Member ISPConfig Developer

    Maybe it's wort a try to force a reinstall of spamassassin and clamav:

    apt-get -y install --reinstall spamassassin clamav clamav-daemon
     
  9. Sharone

    Sharone Member

    Thanks, I just tried that and still got the same error as before when I ran sa-update.
    I decided to disable amavis and clamav for now as we have a stand-alone spam filter.
    After disabling I got these errors in the mail queue
    Code:
    Jun 25 13:35:52 mail-20 postfix/cleanup[18073]: warning: proxy:mysql:/etc/postfix/mysql-virtual_outgoing_bcc.cf lookup error for "[email protected]"
    Jun 25 13:35:52 mail-20 postfix/cleanup[18073]: warning: 59466D932BD: sender_bcc_maps map lookup problem -- message not accepted, try again later
    Jun 25 13:35:52 mail-20 postfix/smtpd[18438]: too many errors after END-OF-MESSAGE from mailscan-10.domain.tld[x.x.x.x]
    Jun 25 13:35:52 mail-20 postfix/smtpd[18416]: 599D0D932BD: client=mailscan-10.domain.tld[x.x.x.x
    Jun 25 13:35:52 mail-20 postfix/cleanup[18245]: warning: proxy:mysql:/etc/postfix/mysql-virtual_outgoing_bcc.cf lookup error for "[email protected]"
    Jun 25 13:35:52 mail-20 postfix/cleanup[18245]: warning: 599D0D932BD: sender_bcc_maps map lookup problem -- message not accepted, try again later
    Jun 25 13:35:52 mail-20 postfix/qmgr[12450]: 6109AD9BD70: from=<>, size=33492, nrcpt=1 (queue active)
    Jun 25 13:35:52 mail-20 postfix/smtpd[18416]: too many errors after END-OF-MESSAGE from mailscan-10.domain.tld[x.x.x.x]
    Jun 25 13:35:52 mail postfix/cleanup[18221]: 6D3B0D932BD: message-id=<[email protected]>
    
     
  10. Sharone

    Sharone Member

    I have mail stuck in the queue which I think points to a problem with dovecot and MySQL.
    Code:
    Warning: mysql: Query failed, retrying: Unknown column 'maildir_format' in 'field list'
    Error: sql([email protected],185.143.72.16): Password query failed: Unknown column 'maildir_format
    Password query failed: Unknown column 'maildir_format' in 'field list'
    dovecot-sql.conf
    Code:
    # password-query with prefetch
    password_query = SELECT email as user, password, maildir as userdb_home, CONCAT( maildir_format, ':', maildir, '/', IF(maildir_format='maildir','Maildir',maildir_format)) as userdb_mail, uid as userdb_uid, gid as userdb_gid, CONCAT('*:storage=', quota, 'B') AS userdb_quota_rule, CONCAT(maildir, '/.sieve') as userdb_sieve FROM mail_user WHERE (login = '%u' OR email = '%u') AND `disable%Ls` = 'n' AND server_id = '2'
    user_query = SELECT email as user, maildir as home, CONCAT( maildir_format, ':', maildir, '/', IF(maildir_format='maildir','Maildir',maildir_format)) as mail, uid, gid, CONCAT('*:storage=', quota, 'B') AS quota_rule, CONCAT(maildir, '/.sieve') as sieve FROM mail_user WHERE (login = '%u' OR email = '%u') AND `disable%Ls` = 'n' AND server_id = '2'
    
    I checked the database and maildir_format exists in the table mail_user. I cannot figure out where else it could be missing
     
    Last edited: Jun 25, 2020
  11. till

    till Super Moderator Staff Member ISPConfig Developer

    Yes, that field is in mail_user table. Maybe it was missing at the timepoint of that error. Try to requeue that single message to see if it gets delivered then.
     
  12. Sharone

    Sharone Member

    I ran postsuper -r ALL and the mail was requeued. No change. I am still getting the same error
     
  13. SamTzu

    SamTzu Active Member

    Just spent hours and hours with this my self... again (using Debian.)
    Usually it's hostname or IPv6 but this time amavis really did not like to play fair.
    This time only thing that worked was to delete /var/lib/amavis/db folder.
    Code:
    systemctl stop amavis
    rm -Rf /var/lib/amavis/db
    mkdir /var/lib/amavis/db
    chown amavis:amavis /var/lib/amavis/db -Rf
    systemctl start amavis
    systemctl status amavis
    postqueue -f
    netstat -tapn
    mailq
    
    You might like to update ISPconfig just to be sure.
     
    Last edited: Mar 6, 2021
  14. Sharone

    Sharone Member

    I had a couple of tables missing from the database after I updated the application. This cleared up the issue.
     

Share This Page