All Mail stuck in spool after upgrade of Ispconfig

Discussion in 'ISPConfig 3 Priority Support' started by Hans-Linux, Apr 16, 2024.

  1. Hans-Linux

    Hans-Linux New Member

    Tested with Thunderbird, Webmail, Gmail, and Telnet from local Wan and external Wan. Also with Telnet from the server itself. Tested with and without UFW firewall active. All required router ports are open. No ports are blocked by the ISP.

    Contents of /var/spool/postfix/defer/9/9C17AE00C0:
    <[email protected]>: connect to 127.0.0.1[127.0.0.1]:10026: Connection refused
    [email protected]
    offset=743
    dsn_orig_rcpt=rfc822;[email protected]
    status=4.4.1
    action=delayed
    reason=connect to 127.0.0.1[127.0.0.1]:10026: Connection refused

    Contents of /var/spool/postfix/deferred/9/9C17AE00C0:
    C_ 640 778 1 0 640 0T^Q1713252201 474113A^Vcreate_time=1713252204A^Tlog_ident=9C17AE00C0A^Vrewrite_context=remoteA^Qsasl_method=PLAINA^\[email protected]^[email protected]^AOAencoding=8bitA^_log_client_name=xxx.xxxx.comA^_log_client_address=xxx.xxx.xxx.xxxA^[email protected][xxx.xxx.xxx.xxx]A^[log_helo_name=[192.168.0.]A^Wlog_protocol_name=ESMTPA^[[email protected]#reverse_client_name=xxx.xxxx.comA^[client_address=xxx.xxx.xxx.xxxA^Qclient_port=57338A^Zserver_address=192.168.0.xxxA^Oserver_port=465A^Whelo_name[192.168.0.254]A^Sprotocol_name=ESMTPA^Uclient_address_type=2A#dsn_orig_rcpt=rfc822;[email protected]^[email protected]^[email protected]^O 0M^@N=Re
    ceived: from [192.168.0.254] (xxx.xxxx.com [xxx.xxx.xxx.xxx])N' (Authenticated sender: [email protected])N; by server.xxxx.com (Postfix) with ESMTPSA id 9C17AE00C0N= for
    <[email protected]>; Tue, 16 Apr 2024 17:23:21 +1000 (AEST)N<Message-ID: <[email protected]>N%Date: Tue, 16 Apr 2024 17:23:00 +1000N^QMIME-Version: 1.0N^_User-Agent: Mozilla ThunderbirdN^WContent-Language: en-AUN^YTo: Xxxx <[email protected]>N^[From: Test <[email protected]>N^]Subject: Test message to selfN6Content-Type: text/plain; charset=UTF-8; format=flowedN^_Content-Transfer-Encoding: 7bitp^O 0N^@N^TTest message to selfp^O 0X^@L^Vlmtp:[127.0.0.1]:10026Aencoding=8bitp^O 0E^@

    07/04/2024 Debian 12 upgrade: /var/log/dpkg.log:
    2024-04-07 20:44:58 startup archives unpack
    2024-04-07 20:45:02 upgrade bsdutils:amd64 1:2.38.1-5+b1 1:2.38.1-5+deb12u1
    2024-04-07 20:45:02 status half-configured bsdutils:amd64 1:2.38.1-5+b1
    2024-04-07 20:45:02 status unpacked bsdutils:amd64 1:2.38.1-5+b1
    2024-04-07 20:45:02 status half-installed bsdutils:amd64 1:2.38.1-5+b1
    2024-04-07 20:45:03 status triggers-pending man-db:amd64 2.11.2-2
    2024-04-07 20:45:06 status unpacked bsdutils:amd64 1:2.38.1-5+deb12u1
    2024-04-07 20:45:08 startup packages configure
    2024-04-07 20:45:08 configure bsdutils:amd64 1:2.38.1-5+deb12u1 <none>
    2024-04-07 20:45:08 status unpacked bsdutils:amd64 1:2.38.1-5+deb12u1
    2024-04-07 20:45:08 status half-configured bsdutils:amd64 1:2.38.1-5+deb12u1
    2024-04-07 20:45:09 status installed bsdutils:amd64 1:2.38.1-5+deb12u1
    2024-04-07 20:45:10 startup archives unpack
    2024-04-07 20:45:11 upgrade libsmartcols1:amd64 2.38.1-5+b1 2.38.1-5+deb12u1
    2024-04-07 20:45:11 status triggers-pending libc-bin:amd64 2.36-9+deb12u4
    2024-04-07 20:45:11 status half-configured libsmartcols1:amd64 2.38.1-5+b1
    2024-04-07 20:45:12 status unpacked libsmartcols1:amd64 2.38.1-5+b1
    2024-04-07 20:45:12 status half-installed libsmartcols1:amd64 2.38.1-5+b1
    2024-04-07 20:45:15 status unpacked libsmartcols1:amd64 2.38.1-5+deb12u1
    2024-04-07 20:45:16 startup packages configure
    2024-04-07 20:45:16 configure libsmartcols1:amd64 2.38.1-5+deb12u1 <none>
    2024-04-07 20:45:16 status unpacked libsmartcols1:amd64 2.38.1-5+deb12u1
    2024-04-07 20:45:16 status half-configured libsmartcols1:amd64 2.38.1-5+deb12u1
    2024-04-07 20:45:17 status installed libsmartcols1:amd64 2.38.1-5+deb12u1
    2024-04-07 20:45:18 startup archives unpack
    2024-04-07 20:45:19 upgrade util-linux-extra:amd64 2.38.1-5+b1 2.38.1-5+deb12u1
    2024-04-07 20:45:19 status half-configured util-linux-extra:amd64 2.38.1-5+b1
    2024-04-07 20:45:20 status unpacked util-linux-extra:amd64 2.38.1-5+b1
    2024-04-07 20:45:20 status half-installed util-linux-extra:amd64 2.38.1-5+b1
    2024-04-07 20:45:22 status unpacked util-linux-extra:amd64 2.38.1-5+deb12u1
    2024-04-07 20:45:23 startup packages configure
    2024-04-07 20:45:23 configure util-linux-extra:amd64 2.38.1-5+deb12u1 <none>
    2024-04-07 20:45:23 status unpacked util-linux-extra:amd64 2.38.1-5+deb12u1
    2024-04-07 20:45:24 status half-configured util-linux-extra:amd64 2.38.1-5+deb12u1
    2024-04-07 20:45:27 status installed util-linux-extra:amd64 2.38.1-5+deb12u1
    2024-04-07 20:45:28 startup archives unpack
    2024-04-07 20:45:30 upgrade util-linux:amd64 2.38.1-5+b1 2.38.1-5+deb12u1
    2024-04-07 20:45:30 status half-configured util-linux:amd64 2.38.1-5+b1
    2024-04-07 20:45:30 status unpacked util-linux:amd64 2.38.1-5+b1
    2024-04-07 20:45:30 status half-installed util-linux:amd64 2.38.1-5+b1
    2024-04-07 20:45:31 status triggers-pending mailcap:all 3.70+nmu1
    2024-04-07 20:45:45 status unpacked util-linux:amd64 2.38.1-5+deb12u1

    The server runs in Virtual on a Gentoo host.
    I am not familiar with Debian or systemd, Please let me know how to fix it.
    Logfiles are available on request.
    Thanks in advance
     
  2. till

    till Super Moderator Staff Member ISPConfig Developer

    Seems as if amavisd is not started, try to start it with:

    service amavis start

    if it does not start, check the mail.log file to see why it is unable to start.

    And you mentioned an upgrade of ISPConfig. Did you maybe upgrade Debian from an older version to Debian 12? As ISPConfig has no upgrades, it just offers updates.
     
  3. Taleman

    Taleman Well-Known Member HowtoForge Supporter

  4. Hans-Linux

    Hans-Linux New Member

    Code:
    mailq
    Results in 100's of messages like these:
     
  5. Taleman

    Taleman Well-Known Member HowtoForge Supporter

  6. Hans-Linux

    Hans-Linux New Member

    Looks like amavis is not installed.
    Code:
    root@server-1:/# service amavis start
    Failed to start amavis.service: Unit amavis.service not found.
    Will install amavis tomorrow on my testing server.
    Debian 12.0 and ISPConfig-3.2.11p1 was working fine since last year.
     
  7. till

    till Super Moderator Staff Member ISPConfig Developer

    Please run the test script and post the output. Do not install amavisd before we ensure that your system is not using rspamd. Please run the test script from the read before posting post and post the result.
     
  8. Hans-Linux

    Hans-Linux New Member

    rspamd masked and dead.
    Code:
    root@server-1:~# service rspamd status
    ○ rspamd.service
         Loaded: masked (Reason: Unit rspamd.service is masked.)
         Active: inactive (dead)
    
    root@server-1:~# apt list rspamd
    Listing... Done
    rspamd/unknown 3.8.4-1~93fa4f6dc~bookworm amd64 [residual-config]
    N: There are 2 additional versions. Please use the '-a' switch to see them.
    
    root@server-1:~# apt -a list rspamd
    Listing... Done
    rspamd/unknown 3.8.4-1~93fa4f6dc~bookworm amd64 [residual-config]
    rspamd/now 3.7.5-2~8c86c1676~bullseye amd64 [residual-config]
    rspamd/stable 3.4-1 amd64 [residual-config][\CODE]
    
    Attached the requested htf_report.txt.
     

    Attached Files:

  9. Taleman

    Taleman Well-Known Member HowtoForge Supporter

    Maybe rspamd fails because network is not working properly? At least the networking and ifup services failed.
    Can that host reach internet and can host be reached from internet?
    If host has lost network connection, e-mails can not come or go.
     
  10. Hans-Linux

    Hans-Linux New Member

    rspamd is masked and dead
    Code:
    root@server-1:/# service rspamd status
    ○ rspamd.service
         Loaded: masked (Reason: Unit rspamd.service is masked.)
         Active: inactive (dead)
    root@server-1: #
    How can I get rspamd to work?

    The network is working properly, mail get through to /var/spool/postfix/defer/* and /var/spool/postfix/defered/*
    Code:
    [INFO] systemd failed services status:
      UNIT               LOAD   ACTIVE SUB    DESCRIPTION
    ● [email protected]  loaded failed failed ifup for eth2
    ● networking.service loaded failed failed Raise network interfaces
    
    This is in error as it either shows eth1 or eth2 when sun multiple times. Ping confirm that both are up and working OK.

    I can access the websites (japan.c5ace.com) and all other on this server from mobile phone via 5G and the local library's computer. DNS works. server received emails. They get stuck in
    Contents of /var/spool/postfix/defer/7/7ACC8E00CB:
    Code:
    7ACC8E00CB     9913 Thu Apr 18 04:23:33  [email protected]
                       (connect to 127.0.0.1[127.0.0.1]:10024: Connection refused)
    
    Contents of /var/spool/postfix/defered7/7ACC8E00CB:
    Code:
                                             [email protected]
    C_           9913             763               1               0            9913               0T^P1713378213 32389A^Vcreate_time=1713378213A^Tlog_ident=7ACC8E00CBA^Vrewrite_contex
    t=remoteS^[email protected]%log_client_name=cloud2.howtoforge.comA!log_client_address=168.119.187.99A^Ulog_client_port=57544A8log_message_origin=cloud2.howtoforge.com[168.119.18
    7.99]A#log_helo_name=cloud2.howtoforge.comA^Wlog_protocol_name=ESMTPA!client_name=cloud2.howtoforge.comA)reverse_client_name=cloud2.howtoforge.comA^]client_address=168.119.187.99A^Q
    client_port=57544A^Zserver_address=192.168.0.XXXA^Nserver_port=25A^_helo_name=cloud2.howtoforge.comA^Sprotocol_name=ESMTPA^Uclient_address_type=2A$dsn_orig_rcpt=rfc822;[email protected]
    O^[email protected]^[email protected]^O              0M^@NMReceived: from cloud2.howtoforge.com (cloud2.howtoforge.com [168.119.187.99])N9  by server-1.xxxxxx.com (Postfix) with ESMT
    P id 7ACC8E00CBN>      for <[email protected]>; Thu, 18 Apr 2024 04:23:33 +1000 (AEST)N>Received: by cloud2.howtoforge.com (Postfix, from userid 1002)N6 id D0AE95F413; Wed, 17 Apr 202
    4 20:23:28 +0200 (CEST)N To: Hans-Linux <[email protected]>NYSubject: All Mail stuck in spool after upgrade of Ispconfig - New reply to watched threadN+X-PHP-Originating-Script: 1002:
    Sendmail.phpNCFrom: Howtoforge - Linux Howtos and Tutorials <[email protected]>N'X-To-Validate: [email protected]: <b197ea5780980b189d056c942628b673b58f1f70@for
    um.howtoforge.com>N%Date: Wed, 17 Apr 2024 18:23:28 +0000N$Content-Type: multipart/alternative;N. boundary="=_3cea0ad8b80f132628a32b0ba2f22d83"N^QMIME-Version: 1.0p^O              0
    N^@N$--=_3cea0ad8b80f132628a32b0ba2f22d83N'Content-Type: text/plain; charset=utf-8N+Content-Transfer-Encoding: quoted-printableN^@NIHans-Linux,=0A=0ATaleman replied to a thread you
    are watching at Howtofo=NIrge - Linux Howtos and Tutorials..............
    
     
    Last edited: Apr 18, 2024
  11. Taleman

    Taleman Well-Known Member HowtoForge Supporter

    Have rspamd configuration files been modified? The masked state may be originated from a improper service definitions.
    The deferred mail seems to have arrived at your host OK. I assume it was not delivered to mailbox because rspamd was not running.
    If you have masked rspamd yourself, unmask it. Have you tried starting rspamd with?
    Code:
    systemctl start rspamd.service
    If it does not start, unmask it first:
    Code:
    systemctl unmask rspamd.service
    and then try start again.
    When rsamd is running, the e-mails should start coming and going.
    By the way, I did not know systemctl has a masked state. I read manual page and used search engines to see what it is and how to change it. You could have done same.
     
  12. Hans-Linux

    Hans-Linux New Member

    Tried:
    Code:
    root@server-1:~# systemctl start rspamd.service
    Failed to start rspamd.service: Unit rspamd.service not found.
    
    root@server-1:~# systemctl unmask rspamd.service
    Unit rspamd.service does not exist, proceeding anyway.
    root@server-1:~#[\CODE]
    I installed rspamd:
    root@server-1:~# systemctl status rspamd.service:
    [CODE]
    ● rspamd.service - rapid spam filtering system
         Loaded: loaded (/lib/systemd/system/rspamd.service; enabled; preset: enabled)
         Active: active (running) since Thu 2024-04-18 17:43:03 AEST; 3min 19s ago
           Docs: https://rspamd.com/doc/
       Main PID: 5874 (rspamd)
          Tasks: 8 (limit: 19145)
         Memory: 155.7M
            CPU: 630ms
         CGroup: /system.slice/rspamd.service
                 ├─5874 "rspamd: main process"
                 ├─5876 "rspamd: rspamd_proxy process (localhost:11332)"
                 ├─5877 "rspamd: controller process (localhost:11334)"
                 ├─5878 "rspamd: normal process (localhost:11333)"
                 ├─5879 "rspamd: normal process (localhost:11333)"
                 ├─5880 "rspamd: normal process (localhost:11333)"
                 ├─5881 "rspamd: normal process (localhost:11333)"
                 └─5882 "rspamd: hs_helper process"
    
    Apr 18 17:43:03 server-1 systemd[1]: Started rspamd.service - rapid spam filtering system.
    Apr 18 17:43:03 server-1 rspamd[5874]: 2024-04-18 17:43:03 #5874(main) <a741ae>; main; main: rspamd 3.4 is loading configuration, build id: release
    lines 1-20/20 (END)
    
    Mail remains stuck.
    How can I install rspamd without screwing up ISPConfig and the rest of the system? Building and configuring a complete new server from scratch?
     
  13. till

    till Super Moderator Staff Member ISPConfig Developer

    In ISPConfig under System > server config > email. is the spam filtering system there set to Rspamd or Amavis? Set it To Rspamd if it is not set to rspamd yet. Then run:

    apt install --reinstall rspamd

    Then run:

    ispconfig_update.sh --force

    and let the ISPConfig updater reconfigure services during update.
     
    Th0m likes this.
  14. Hans-Linux

    Hans-Linux New Member

    Thanks you this fixed the problem.
     

Share This Page