resync tool doesnt regenerate/update sieve file

Discussion in 'Installation/Configuration' started by sor_tay, Oct 29, 2021.

  1. sor_tay

    sor_tay New Member

    Code:
    ##### SERVER #####
    IP-address (as per hostname): ***.***.***.***
    [WARN] could not determine server's ip address by ifconfig
    [INFO] OS version is Ubuntu 18.04.3 LTS
     
    [INFO] uptime:  17:28:54 up 16:26,  1 user,  load average: 0.89, 0.43, 0.43
     
    [INFO] memory:
                  total        used        free      shared  buff/cache   available
    Mem:           7.8G        6.8G        130M         25M        840M        687M
    Swap:          4.0G        2.4G        1.6G
     
    [INFO] ISPConfig is installed.
    
    ##### ISPCONFIG #####
    ISPConfig version is 3.2.7p1
    
    
    ##### VERSION CHECK #####
    
    [INFO] php (cli) version is 7.2.31-1+ubuntu18.04.1+deb.sury.org+1
    [INFO] php-cgi (used for cgi php in default vhost!) is version 7.2.31
    
    ##### PORT CHECK #####
    
    
    ##### MAIL SERVER CHECK #####
    
    
    ##### RUNNING SERVER PROCESSES #####
    
    [INFO] I found the following web server(s):
        Apache 2 (PID 1704)
    [INFO] I found the following mail server(s):
        Postfix (PID 1499)
    [INFO] I found the following pop3 server(s):
        Dovecot (PID 957)
    [INFO] I found the following imap server(s):
        Dovecot (PID 957)
    [INFO] I found the following ftp server(s):
        PureFTP (PID 1692)
    
    ##### LISTENING PORTS #####
    (only        ()
    Local        (Address)
    [localhost]:953        (26451/named)
    [anywhere]:25        (1499/master)
    [anywhere]:993        (957/dovecot)
    [anywhere]:995        (957/dovecot)
    [localhost]:11332        (991/rspamd:)
    [localhost]:11333        (991/rspamd:)
    [localhost]:11334        (991/rspamd:)
    [localhost]:10023        (1696/postgrey)
    [localhost]:10024        (1716/amavisd-new)
    [localhost]:10025        (1499/master)
    [localhost]:10026        (1716/amavisd-new)
    [localhost]:10027        (1499/master)
    [anywhere]:587        (1499/master)
    [localhost]:6379        (1051/redis-server)
    [localhost]:11211        (978/memcached)
    [anywhere]:110        (957/dovecot)
    [anywhere]:143        (957/dovecot)
    [anywhere]:465        (1499/master)
    ***.***.***.***:53        (26451/named)
    ***.***.***.***:53        (26451/named)
    [localhost]:53        (26451/named)
    [anywhere]:21        (1692/pure-ftpd)
    ***.***.***.***:53        (755/systemd-resolve)
    [anywhere]:22        (1021/sshd)
    *:*:*:*::*:953        (26451/named)
    *:*:*:*::*:25        (1499/master)
    *:*:*:*::*:443        (1704/apache2)
    *:*:*:*::*:993        (957/dovecot)
    *:*:*:*::*:995        (957/dovecot)
    *:*:*:*::*:10024        (1716/amavisd-new)
    *:*:*:*::*:10026        (1716/amavisd-new)
    *:*:*:*::*:3306        (1253/mysqld)
    *:*:*:*::*:587        (1499/master)
    *:*:*:*::*:6379        (1051/redis-server)
    [localhost]10        (957/dovecot)
    [localhost]43        (957/dovecot)
    *:*:*:*::*:8080        (1704/apache2)
    *:*:*:*::*:80        (1704/apache2)
    *:*:*:*::*:8081        (1704/apache2)
    *:*:*:*::*:465        (1499/master)
    *:*:*:*::*:53        (26451/named)
    *:*:*:*::*:21        (1692/pure-ftpd)
    *:*:*:*::*:22        (1021/sshd)
    
    
    
    
    ##### IPTABLES #####
    Chain INPUT (policy ACCEPT)
    target     prot opt source               destination         
    f2b-pureftpd  tcp  --  [anywhere]/0            [anywhere]/0            multiport dports 21
    f2b-postfix  tcp  --  [anywhere]/0            [anywhere]/0            multiport dports 25,465,587
    f2b-pcps   tcp  --  [anywhere]/0            [anywhere]/0            multiport dports 25,465,587
    f2b-postfix-sasl  tcp  --  [anywhere]/0            [anywhere]/0            multiport dports 25
    f2b-sshd   tcp  --  [anywhere]/0            [anywhere]/0            multiport dports 22
    
    Chain FORWARD (policy ACCEPT)
    target     prot opt source               destination         
    
    Chain OUTPUT (policy ACCEPT)
    target     prot opt source               destination         
    
    Chain f2b-pcps (1 references)
    target     prot opt source               destination         
    REJECT     all  --  ***.***.***.***        [anywhere]/0            reject-with icmp-port-unreachable
    RETURN     all  --  [anywhere]/0            [anywhere]/0           
    re
    Chain f2b-postfix (1 references)
    target     prot opt source               destination         
    RETURN     all  --  [anywhere]/0            [anywhere]/0           
    
    Chain f2b-postfix-sasl (1 references)
    target     prot opt source               destination         
    REJECT     all  --  ***.***.***.***        [anywhere]/0            reject-with icmp-port-unreachable
    REJECT     all  --  ***.***.***.***         [anywhere]/0            reject-with icmp-port-unreachable
    REJECT     all  --  ***.***.***.***      [anywhere]/0            reject-with icmp-port-unreachable
    RETURN     all  --  [anywhere]/0            [anywhere]/0           
    
    Chain f2b-pureftpd (1 references)
    target     prot opt source               destination         
    RETURN     all  --  [anywhere]/0            [anywhere]/0           
    
    Chain f2b-sshd (1 references)
    target     prot opt source               destination         
    REJECT     all  --  ***.***.***.***        [anywhere]/0            reject-with icmp-port-unreachable
    RETURN     all  --  [anywhere]/0            [anywhere]/0           
    
    
    
    
    ##### LET'S ENCRYPT #####
    Certbot is installed in /usr/bin/letsencrypt
    
    
    
    Hi guys, need help with regenerating the sieve file for all email users.
    I had bulk-edited mail_user.move_junk = y for all my email users using mysql command. Then I used 'resync tool' (on Ispconfig3 GUI) to resync the Mailboxes & Mailfilter. However, that didnt update the sieve file nor create a new .ispconfig-before.sieve nor .ispconfig.sieve.
    Any help or insight?
    My server's details:
    Ubuntu 18.04.3 LTS
    Apache 2.4.29
    Postfix 3.3.0
    Dovecot 2.2.33.2
    mysql 15.1 Distrib 10.1.48-MariaDB
    php 7.2.31-1
    ISPConfig version 3.2.7p1
     
  2. Th0m

    Th0m ISPConfig Developer Staff Member ISPConfig Developer

  3. sor_tay

    sor_tay New Member

    Yes, I'm sure the resync was done because I ran the command "/usr/local/ispconfig/server/server.sh" on the terminal via SSH and it was showing the executed commands.
    Anyway here's the output of the command in zip file.
    Sorry, i cant replied to your post, since the system doesnt allow me to include link in my post yet.
     

    Attached Files:

  4. Th0m

    Th0m ISPConfig Developer Staff Member ISPConfig Developer

    Please include the output in code tags in your comment, so we don't have to download a possible malicious file.
     
  5. sor_tay

    sor_tay New Member

    i had shorten the output (to hide the actual username & domain name), hope it's enough.
    Code:
    30.10.2021-10:29 - DEBUG - Calling function 'check_phpini_changes' from plugin 'webserver_plugin' raised by action 'server_plugins_loaded'.
    30.10.2021-10:29 - DEBUG - Found 809 changes, starting update process.
    30.10.2021-10:29 - DEBUG - Calling function 'user_update' from plugin 'mail_plugin' raised by event 'mail_user_update'.
    30.10.2021-10:29 - DEBUG - Mailuser uid: 5000, gid: 5000
    30.10.2021-10:29 - DEBUG - Created Directory: /var/vmail/jb11.rx.com.my
    30.10.2021-10:29 - DEBUG - Created Maildir /var/vmail/jb11.rx.com.my/tay/Maildir with subfolder: Sent
    30.10.2021-10:29 - DEBUG - Created Maildir /var/vmail/jb11.rx.com.my/tay/Maildir with subfolder: Drafts
    30.10.2021-10:29 - DEBUG - Created Maildir /var/vmail/jb11.rx.com.my/tay/Maildir with subfolder: Trash
    30.10.2021-10:29 - DEBUG - Created Maildir /var/vmail/jb11.rx.com.my/tay/Maildir with subfolder: Junk
    30.10.2021-10:29 - DEBUG - safe_exec cmd: chown -R 'vmail':'vmail' '/var/vmail/jb11.rx.com.my/tay' - return code: 0
    30.10.2021-10:29 - DEBUG - Set ownership on /var/vmail/jb11.rx.com.my/tay
    30.10.2021-10:29 - DEBUG - Calling function 'update' from plugin 'maildeliver_plugin' raised by event 'mail_user_update'.
    30.10.2021-10:29 - DEBUG - Calling function 'user_settings_update' from plugin 'rspamd_plugin' raised by event 'mail_user_update'.
    30.10.2021-10:29 - DEBUG - rspamd: user_settings_update() for mail_user [email protected]
    30.10.2021-10:29 - DEBUG - Processed datalog_id 15946
    ...
    30.10.2021-10:31 - DEBUG - Processed datalog_id 16753
    30.10.2021-10:31 - DEBUG - Calling function 'user_settings_update' from plugin 'rspamd_plugin' raised by event 'spamfilter_users_update'.
    30.10.2021-10:31 - DEBUG - rspamd: user_settings_update() for spamfilter_user [email protected]
    30.10.2021-10:31 - DEBUG - Processed datalog_id 16754
    30.10.2021-10:31 - DEBUG - Calling function 'restartRspamd' from module 'mail_module'.
    30.10.2021-10:31 - DEBUG - Trying to use Systemd to restart service
    30.10.2021-10:31 - DEBUG - safe_exec cmd: systemctl is-enabled 'rspamd' 2>&1 - return code: 0
    30.10.2021-10:31 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
    finished server.php.
     
  6. sor_tay

    sor_tay New Member

    Btw, this is the output on the GUI:
    Code:
    Resynced Alias
    Nothing found
    
    Resynced Mail access
    
    Resynced Content Filter
    
    Resynced Mail User Filter
    Nothing found
    
    Resynced Spamfilter
    
    Resynced Spamfilter
    Nothing found
     
  7. till

    till Super Moderator Staff Member ISPConfig Developer

    It might be that a resync is not able to recreate the sieve files. If I remember correctly, the sieve files get written only when there are changes between old and new config, and due to doing the update via SQL, there is no change between the fields in sys_datalog. Might be that we have to implement a workaround to enforce this in resync or we have to write the sieve file each time a mail user is altered, but this is not ideal too.
     
  8. sor_tay

    sor_tay New Member

    Thanks for the explanation, I was under the impression that resync would help to update the sieve in my scenario (mass update via sql).
    Just found out there's a similar request when I was about to make this a request under 'feature requests', https://git.ispconfig.org/ispconfig/ispconfig3/-/issues/6080 by Dominik about 7 months ago. However, it seemed there's no update after that. Would there be a good chance that this feature would make it in the next update of ISPConfig (or in the near future)?
     
    Last edited: Oct 30, 2021
  9. sor_tay

    sor_tay New Member

    Thanks to your information on 'sys_datalog', i had managed to force the re-generation of sieve file for all mail users.
    I'll list out the steps here, in hope that it can offer help to anyone who is looking for similar workaround:
    1. Stop the cron job for '/usr/local/ispconfig/server/server.sh'
    2. Take note of the last datalog_id on table 'sys_datalog'
    3. run the resync for mailboxes, it'll inject new data to table sys_datalog
    4. update the 'move_junk = y' in the 'new' section of the created data, this'll create (force) the changes for all mailboxes. Only apply this on all data after the last datalog_id from step #2
    5. run '/usr/local/ispconfig/server/server.sh'
    6. enable the cron job for '/usr/local/ispconfig/server/server.sh'
     

Share This Page