Mailman problems after migration??

Discussion in 'ISPConfig 3 Priority Support' started by craig baker, Dec 29, 2020.

  1. craig baker

    craig baker Member HowtoForge Supporter

    I recently migrated servers from centos7/ispconfig3.1x to centos8/3.2
    largely successful (read prior issues) - and mailman is operational as far as accessing the lists and doing the functions.
    BUT - I cannot send out any posts to [email protected] (the address that used to work just fine!)
    I get
    now we have various suspects:
    in /etc/mailman
    Code:
    -rw-r--r--    1 root root        0 Dec 27 10:11 aliases
    -rw-r--r--    1 root mailman 12288 Dec 27 10:11 aliases.db
    -rw-r--r--.   1 root mailman  4498 Dec 27 09:31 mm_cfg.py
    -rw-r--r--    1 root root     4498 Dec 27 09:31 mm_cfg.py~
    -rw-r--r--.   1 root mailman 14103 Nov  3 15:29 sitelist.cfg
    drwxr-sr-x.  42 root mailman  4096 Nov  3 15:29 templates
    -rw-r--r--    1 root root        0 Sep 29 19:23 virtual-mailman
    -rw-r--r--    1 root root    12288 Oct 18 14:16 virtual-mailman.db
    -rwxr-xr-x    1 root mailman   152 Oct 18 14:16 virtual_to_transport.sh
    -rw-r--r--    1 root root      152 Oct 18 14:16 virtual_to_transport.sh~
    aliases and virtual-mailman are both zero length.
    in /var/lib/mailman/data:
    Code:
    drwxrwsr-x. 2 root    mailman  4096 Dec 27 09:35 .
    drwxrwsr-x. 6 root    mailman    79 Nov  3 15:29 ..
    lrwxrwxrwx  1 root    mailman    20 Sep  1 12:13 aliases -> /etc/mailman/aliases
    -rw-r-----  1 root    mailman 12288 Dec 27 09:36 aliases.db
    -rw-rw-r--  1 mailman mailman 27561 Aug 31 13:17 heldmsg-theeldestgeek-73.pck
    -rw-rw-r--  1 mailman mailman  4158 Sep 15 15:40 heldmsg-theeldestgeek-74.pck
    -rw-rw-r--  1 mailman mailman  4222 Sep 16 13:33 heldmsg-theeldestgeek-75.pck
    -rw-rw-r--  1 mailman mailman  4418 Oct 22 00:51 heldmsg-theeldestgeek-76.pck
    -rw-rw-r--  1 mailman mailman  6211 Oct 27 17:39 heldmsg-theeldestgeek-77.pck
    -rw-------  1 mailman mailman 79857 Oct 27  2017 owner-bounces.mbox
    lrwxrwxrwx  1 root    mailman    25 Nov  3 15:29 sitelist.cfg -> /etc/mailman/sitelist.cfg
    -rw-r--r--  1 root    mailman  2156 May 28  2018 transport-mailman
    -rw-r--r--  1 root    mailman 12288 Dec 27 09:31 transport-mailman.db
    -rw-r--r--  1 root    mailman     0 Jun 13  2013 virtual-mailman
    -rw-r--r--  1 root    mailman 12288 Dec 27 09:31 virtual-mailman.db
    the virtual-mailman is still 0, the transport-mailman contains:

    Code:
    # This file is generated by Mailman, and is kept in sync with the binary hash
    # file virtual-mailman.db.  YOU SHOULD NOT MANUALLY EDIT THIS FILE unless you
    # know what you're doing, and can keep the two files properly in sync.  If you
    # screw it up, you're on your own.
    #
    # Note that you should already have this virtual domain set up properly in
    # your Postfix installation.  See README.POSTFIX for details.
    
    # LOOP ADDRESSES START
    [email protected]  local
    [email protected]      local
    # LOOP ADDRESSES END
    
    # STANZA START: theeldestgeek
    # CREATED: Mon May 28 17:33:21 2018
    [email protected]              local
    [email protected]        local
    [email protected]      local
    [email protected]      local
    [email protected]         local
    [email protected]        local
    [email protected]        local
    [email protected]      local
    [email protected]    local
    [email protected]  local
    # STANZA END: theeldestgeek
    
    # STANZA START: mailman
    # CREATED: Mon May 28 17:33:21 2018
    [email protected]              local
    [email protected]        local
    [email protected]      local
    [email protected]      local
    [email protected]         local
    [email protected]        local
    [email protected]        local
    [email protected]      local
    [email protected]    local
    [email protected]  local
    # STANZA END: mailman
    
    # STANZA START: toptech
    # CREATED: Mon May 28 17:33:21 2018
    [email protected]              local
    [email protected]        local
    [email protected]      local
    [email protected]      local
    [email protected]         local
    [email protected]        local
    [email protected]        local
    [email protected]      local
    [email protected]    local
    [email protected]  local
    # STANZA END: toptech
    in my /etc/mailman/mm_cfg.py:
    Code:
    # Default domain for email addresses of newly created MLs
    DEFAULT_EMAIL_HOST = 'ns10.cdbsystems.com'
    #-------------------------------------------------------------
    # Default host for web interface of newly created MLs
    DEFAULT_URL_HOST   = 'ns10.cdbsystems.com'
    #-------------------------------------------------------------
    # Required when setting any of its arguments.
    add_virtualhost(DEFAULT_URL_HOST, DEFAULT_EMAIL_HOST)
    
    #-------------------------------------------------------------
    # The default language for this server.
    DEFAULT_SERVER_LANGUAGE = 'en'
    
    #-------------------------------------------------------------
    # Iirc this was used in pre 2.1, leave it for now
    USE_ENVELOPE_SENDER    = 0              # Still used?
    
    #-------------------------------------------------------------
    # Unset send_reminders on newly created lists
    DEFAULT_SEND_REMINDERS = 0
    
    #-------------------------------------------------------------
    # Uncomment this if you configured your MTA such that it
    # automatically recognizes newly created lists.
    # (see /usr/share/doc/mailman/README.Exim4.Debian or
    # /usr/share/mailman/postfix-to-mailman.py)
    # MTA=None   # Misnomer, suppresses alias output on newlist
    
    #-------------------------------------------------------------
    # Uncomment if you use Postfix virtual domains (but not
    # postfix-to-mailman.py), but be sure to see
    # /usr/share/doc/mailman/README.Debian first.
    MTA='Postfix'
    POSTFIX_STYLE_VIRTUAL_DOMAINS = ['theeldestgeek.com', 'toptechva.com']
    I believe this was migrated off the old server.
    all looks more or less correct apart from the virtual-mailman and aliases??
    in /etc/postfix/main.cf
    I have lines:
    alias_maps = hash:/etc/aliases
    and alias_database = hash:/etc/aliases
    further down:
    virtual_alias_domains = proxy:mysql:/etc/postfix/mysql-virtual_alias_domains.cf
    virtual_alias_maps = hash:/etc/mailman/virtual-mailman, proxy:mysql:/etc/postfix/mysql-virtual_forwardings.cf, proxy:mysql:/etc/postfix/mysql-virtual_alias_maps.cf, proxy:mysql:/etc/postfix/mysql-virtual_email2email.cf
    virtual_mailbox_domains = proxy:mysql:/etc/postfix/mysql-virtual_domains.cf
    virtual_mailbox_maps = proxy:mysql:/etc/postfix/mysql-virtual_mailboxes.cf
    transport_maps = hash:/var/lib/mailman/data/transport-mailman, proxy:mysql:/etc/postfix/mysql-virtual_transports.cf

    so - any ideas?

    Also I note that when I created a new mailman list TEG in ispconfig - NO entry was made in ANY file! no trace of TEG.
    but it gave no error.
    When ispconfig creates a new mailman list what files are altered in what folders?

    inquiring minds and all that!
    happy holidays to all :)
     
  2. Jesse Norell

    Jesse Norell Well-Known Member Staff Member Howtoforge Staff

    I don't use mailman nor centos, but what version of postfix do you have (and/or what do you have for 'enable_original_recipient' setting)? If it's 'yes', try changing to 'no' temporarily and test if mailman works (note it might cause other issues with delivery, but test if mailman is affected).
     
  3. craig baker

    craig baker Member HowtoForge Supporter

    post is version 3.31. enable_original_recipient is set to yes, but I remember some problems getting it to work before under ispconfig 3.11, and I'm sure THATS not the problem. something to do with the virtual_domain setup and [email protected] triggering the list, but I dont remember THAT exactly!
     
  4. craig baker

    craig baker Member HowtoForge Supporter

    I've been looking back over the centos 8 perfect server which I used
    https://www.howtoforge.com/tutorial...stfix-dovecot-and-ispconfig/#-install-mailman

    and surely the mailman installation instructions are missing a LOT???
    it mentions putting the mailman stanza into /etc/aliases (not /etc/mailman/aliases).
    --snip--
    ## mailman mailing list
    mailman: "|/usr/lib/mailman/mail/mailman post mailman"
    mailman-admin: "|/usr/lib/mailman/mail/mailman admin mailman"
    mailman-bounces: "|/usr/lib/mailman/mail/mailman bounces mailman"
    mailman-confirm: "|/usr/lib/mailman/mail/mailman confirm mailman"
    mailman-join: "|/usr/lib/mailman/mail/mailman join mailman"
    mailman-leave: "|/usr/lib/mailman/mail/mailman leave mailman"
    mailman-owner: "|/usr/lib/mailman/mail/mailman owner mailman"
    mailman-request: "|/usr/lib/mailman/mail/mailman request mailman"
    mailman-subscribe: "|/usr/lib/mailman/mail/mailman subscribe mailman"
    mailman-unsubscribe: "|/usr/lib/mailman/mail/mailman unsubscribe mailman"
    --snip--
    but NO reference in postfix main.cf or master.cf to aliases (and certainly not /etc/aliases???)
    no virtual domains no nothing. arent we missing a LOT of the install instructions???
     
  5. craig baker

    craig baker Member HowtoForge Supporter

    ENLIGHTENMENT - at least a work around:

    Playing around a good bit and recreating some of the additional steps in centos 7 server that were missing from centos 8. I've reached an interesting situation.

    Ispconfig3 cannot create any mailing list. when I make a new one, no file appears altered anywhere!
    but the /usr/lib/mailman/bin/newlist infact makes new lists.
    they seem to alter 3 sets of files:
    in /var/lib/mailman/data entries are made in
    aliases (which I symlinked to /etc/mailman/aliases)
    and transport-mailman (not symlinked).
    there is a file virtual-mailman in /var/lib/mailman/data which is NOT altered!
    back in /etc/mailman we see that the file virtual-mailman is altered (and does not affected in the var/lib/mailman/data folder).

    newlist does create the aliases.db via a call to newaliases, but does NOT create virtual-mailman.db or transport-mailman.db! so those have to be created manually
    with postmap /etc/mailman/transport-! (or the lists dont work of course).
    /etc/postfix/main.cf contains:

    alias_database = hash:/etc/aliases and
    virtual_alias_maps = hash:/etc/mailman/virtual-mailman, proxy:mysql:/etc/postfix/mysql-virtual_forwardings.cf,
    proxy:mysql:/etc/postfix/mysql-virtual_alias_maps.cf, proxy:mysql:/etc/postfix/mysql-virtual_email2email.cf

    as well as

    transport_maps = hash:/var/lib/mailman/data/transport-mailman, proxy:mysql:/etc/postfix/mysql-virtual_transports.cf

    in /etc/mailman/mm_cfg.py:
    # Default domain for email addresses of newly created MLs
    #was DEFAULT_EMAIL_HOST = 'ns10.cdbsystems.com'
    DEFAULT_EMAIL_HOST = 'theeldestgeek.com'
    #-------------------------------------------------------------
    # Default host for web interface of newly created MLs
    #DEFAULT_URL_HOST = 'ns10.cdbsystems.com'
    DEFAULT_URL_HOST = 'lists.theeldestgeek.com'
    #-------------------------------------------------------------
    # Required when setting any of its arguments.
    add_virtualhost(DEFAULT_URL_HOST, DEFAULT_EMAIL_HOST)
    --
    as well as later:
    MTA='Postfix'
    POSTFIX_STYLE_VIRTUAL_DOMAINS = ['lists.theeldestgeek.com','theeldestgeek.com', 'toptechva.com']
    VIRTUAL_MAILMAN_LOCAL_DOMAIN = 'localhost'

    Finally now I could post to a newly created list with the newlist command (of course does not show up in ispconfigs lists!)
    so now I manually added the stanzas I made duplicating a newlist created block with ones for theeldestgeek (the list I had before, and which the data was all knows to mailman, but was inaccessible!)
    made the entries in aliases, and virtual-mailman - ran newaliases and postmap /etc/mailman/virtual-mailman, and voila! I can post to my old mailman list as I did before the mirgration!

    This may not be clean, but it does work. now maybe I can work out why ispconfig3 is not generating lists itself!

    hopefully this will help someone!
    cdb.
     

Share This Page