ISPConfig v3, PowerDNS and cluster

Discussion in 'Installation/Configuration' started by adminnc, Sep 10, 2010.

  1. adminnc

    adminnc New Member

    Hello,
    I'm trying to do a 2 Ubuntu 10.04 servers cluster with ispc3 and powerdns :
    - server 1 with web, mysql, dns, mail etc
    - server 2 with dns replicated from server 1

    I've follow 'The Perfect Server – Ubuntu 10.04 [ISPConfig 3]' and the 'Installing A Multiserver Setup With Dedicated Web, Email, DNS And MySQL Database Servers On Debian 5.0 With ISPConfig 3' for the clustering howto

    All seems ok but I've notice that if I'm turning off pdns & pdns-recursor on server 1, server 2 can't resolv anymore !
    I don't have any resolver in /etc/resolv.conf and there isn't server 1 in any pdns config files.

    Then I've put '2' for $conf["log_priority"] in /usr/local/ispconfig/server/lib/config.inc.php and launch the server.sh script as root user (no su or sudo, but logged as root), I can see no errors, just some warnings about 'PHP Deprecated: Comments starting with '#' are deprecated'

    So I've check the databases 'dbispconfig' and 'powerdns' : none of the dns_* tables are replicated, and none of the 'powerdns' tables too.

    So is it normal and how can I do to have the server 2 completely autonomous with its own records ?
     
  2. adminnc

    adminnc New Member

    Hi again,

    I've found the /etc/resolv.conf error why the dns server 2 was depending about server 1, but I can't find why there is no replication about dns records between the 2 servers.

    here is the output from server.sh on server 2 :

    PHP Deprecated: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/imagick.ini on line 1 in Unknown on line 0
    PHP Deprecated: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/imap.ini on line 1 in Unknown on line 0
    PHP Deprecated: Comments starting with '#' are deprecated in /etc/php5/cli/conf.d/mcrypt.ini on line 1 in Unknown on line 0
    10.09.2010-11:55 - DEBUG - Set Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
    10.09.2010-11:55 - DEBUG - Found 20 changes, starting update process.
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 1
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`company_name`,`contact_name`,`street`,`zip`,`city`,`state`,`country`,`telephone`,`mobile`,`fax`,`email`,`internet`,`icq`,`notes`,`default_mailserver`,`limit_maildomain`,`limit_mailbox`,`limit_mailalias`,`limit_mailaliasdomain`,`limit_mailforward`,`limit_mailcatchall`,`limit_mailrouting`,`limit_mailfilter`,`limit_fetchmail`,`limit_mailquota`,`limit_spamfilter_wblist`,`limit_spamfilter_user`,`limit_spamfilter_policy`,`default_webserver`,`limit_web_ip`,`limit_web_domain`,`limit_web_quota`,`web_php_options`,`limit_web_subdomain`,`limit_web_aliasdomain`,`limit_ftp_user`,`limit_shell_user`,`ssh_chroot`,`default_dnsserver`,`limit_dns_zone`,`limit_dns_record`,`default_dbserver`,`limit_database`,`limit_cron`,`limit_cron_type`,`limit_cron_frequency`,`limit_traffic_quota`,`limit_client`,`parent_client_id`,`username`,`password`,`language`,`usertheme`,`template_master`,`template_additional`,`created_at`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 2
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 3
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`company_name`,`contact_name`,`street`,`zip`,`city`,`state`,`country`,`telephone`,`mobile`,`fax`,`email`,`internet`,`icq`,`notes`,`default_mailserver`,`limit_maildomain`,`limit_mailbox`,`limit_mailalias`,`limit_mailaliasdomain`,`limit_mailforward`,`limit_mailcatchall`,`limit_mailrouting`,`limit_mailfilter`,`limit_fetchmail`,`limit_mailquota`,`limit_spamfilter_wblist`,`limit_spamfilter_user`,`limit_spamfilter_policy`,`default_webserver`,`limit_web_ip`,`limit_web_domain`,`limit_web_quota`,`web_php_options`,`limit_web_subdomain`,`limit_web_aliasdomain`,`limit_ftp_user`,`limit_shell_user`,`ssh_chroot`,`default_dnsserver`,`limit_dns_zone`,`limit_dns_record`,`default_dbserver`,`limit_database`,`limit_cron`,`limit_cron_type`,`limit_cron_frequency`,`limit_traffic_quota`,`limit_client`,`parent_client_id`,`username`,`password`,`language`,`usertheme`,`template_master`,`template_additional`,`created_at`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 4
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`company_name`,`contact_name`,`street`,`zip`,`city`,`state`,`country`,`telephone`,`mobile`,`fax`,`email`,`internet`,`icq`,`notes`,`default_mailserver`,`limit_maildomain`,`limit_mailbox`,`limit_mailalias`,`limit_mailaliasdomain`,`limit_mailforward`,`limit_mailcatchall`,`limit_mailrouting`,`limit_mailfilter`,`limit_fetchmail`,`limit_mailquota`,`limit_spamfilter_wblist`,`limit_spamfilter_user`,`limit_spamfilter_policy`,`default_webserver`,`limit_web_ip`,`limit_web_domain`,`limit_web_quota`,`web_php_options`,`limit_web_subdomain`,`limit_web_aliasdomain`,`limit_ftp_user`,`limit_shell_user`,`ssh_chroot`,`default_dnsserver`,`limit_dns_zone`,`limit_dns_record`,`default_dbserver`,`limit_database`,`limit_cron`,`limit_cron_type`,`limit_cron_frequency`,`limit_traffic_quota`,`limit_client`,`parent_client_id`,`username`,`password`,`language`,`usertheme`,`template_master`,`template_additional`,`created_at`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 5
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 6
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`company_name`,`contact_name`,`street`,`zip`,`city`,`state`,`country`,`telephone`,`mobile`,`fax`,`email`,`internet`,`icq`,`notes`,`default_mailserver`,`limit_maildomain`,`limit_mailbox`,`limit_mailalias`,`limit_mailaliasdomain`,`limit_mailforward`,`limit_mailcatchall`,`limit_mailrouting`,`limit_mailfilter`,`limit_fetchmail`,`limit_mailquota`,`limit_spamfilter_wblist`,`limit_spamfilter_user`,`limit_spamfilter_policy`,`default_webserver`,`limit_web_ip`,`limit_web_domain`,`limit_web_quota`,`web_php_options`,`limit_web_subdomain`,`limit_web_aliasdomain`,`limit_ftp_user`,`limit_shell_user`,`ssh_chroot`,`default_dnsserver`,`limit_dns_zone`,`limit_dns_record`,`default_dbserver`,`limit_database`,`limit_cron`,`limit_cron_type`,`limit_cron_frequency`,`limit_traffic_quota`,`limit_client`,`parent_client_id`,`username`,`password`,`language`,`usertheme`,`template_master`,`template_additional`,`created_at`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 7
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 8
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`company_name`,`contact_name`,`street`,`zip`,`city`,`state`,`country`,`telephone`,`mobile`,`fax`,`email`,`internet`,`icq`,`notes`,`default_mailserver`,`limit_maildomain`,`limit_mailbox`,`limit_mailalias`,`limit_mailaliasdomain`,`limit_mailforward`,`limit_mailcatchall`,`limit_mailrouting`,`limit_mailfilter`,`limit_fetchmail`,`limit_mailquota`,`limit_spamfilter_wblist`,`limit_spamfilter_user`,`limit_spamfilter_policy`,`default_webserver`,`limit_web_ip`,`limit_web_domain`,`limit_web_quota`,`web_php_options`,`limit_web_subdomain`,`limit_web_aliasdomain`,`limit_ftp_user`,`limit_shell_user`,`ssh_chroot`,`default_dnsserver`,`limit_dns_zone`,`limit_dns_record`,`default_dbserver`,`limit_database`,`limit_cron`,`limit_cron_type`,`limit_cron_frequency`,`limit_traffic_quota`,`limit_client`,`parent_client_id`,`username`,`password`,`language`,`usertheme`,`template_master`,`template_additional`,`created_at`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 9
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO remote_user (`remote_userid`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`remote_username`,`remote_password`,`remote_functions`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 23
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO remote_user (`remote_userid`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`remote_username`,`remote_password`,`remote_functions`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 24
    10.09.2010-11:55 - DEBUG - Replicated from master: DELETE FROM client WHERE client_id = 3
    10.09.2010-11:55 - DEBUG - Processed datalog_id 83
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO remote_user (`remote_userid`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`remote_username`,`remote_password`,`remote_functions`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 86
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 106
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`company_name`,`contact_name`,`street`,`zip`,`city`,`state`,`country`,`telephone`,`mobile`,`fax`,`email`,`internet`,`icq`,`notes`,`default_mailserver`,`limit_maildomain`,`limit_mailbox`,`limit_mailalias`,`limit_mailaliasdomain`,`limit_mailforward`,`limit_mailcatchall`,`limit_mailrouting`,`limit_mailfilter`,`limit_fetchmail`,`limit_mailquota`,`limit_spamfilter_wblist`,`limit_spamfilter_user`,`limit_spamfilter_policy`,`default_webserver`,`limit_web_ip`,`limit_web_domain`,`limit_web_quota`,`web_php_options`,`limit_web_subdomain`,`limit_web_aliasdomain`,`limit_ftp_user`,`limit_shell_user`,`ssh_chroot`,`default_dnsserver`,`limit_dns_zone`,`limit_dns_record`,`default_dbserver`,`limit_database`,`limit_cron`,`limit_cron_type`,`limit_cron_frequency`,`limit_traffic_quota`,`limit_client`,`parent_client_id`,`username`,`password`,`language`,`usertheme`,`template_master`,`template_additional`,`created_at`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 107
    10.09.2010-11:55 - DEBUG - Replicated from master: DELETE FROM server WHERE server_id = 5
    10.09.2010-11:55 - DEBUG - Processed datalog_id 401
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 424
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`company_name`,`contact_name`,`street`,`zip`,`city`,`state`,`country`,`telephone`,`mobile`,`fax`,`email`,`internet`,`icq`,`notes`,`default_mailserver`,`limit_maildomain`,`limit_mailbox`,`limit_mailalias`,`limit_mailaliasdomain`,`limit_mailforward`,`limit_mailcatchall`,`limit_mailrouting`,`limit_mailfilter`,`limit_fetchmail`,`limit_mailquota`,`limit_spamfilter_wblist`,`limit_spamfilter_user`,`limit_spamfilter_policy`,`default_webserver`,`limit_web_ip`,`limit_web_domain`,`limit_web_quota`,`web_php_options`,`limit_web_subdomain`,`limit_web_aliasdomain`,`limit_ftp_user`,`limit_shell_user`,`ssh_chroot`,`default_dnsserver`,`limit_dns_zone`,`limit_dns_record`,`default_dbserver`,`limit_database`,`limit_cron`,`limit_cron_type`,`limit_cron_frequency`,`limit_traffic_quota`,`limit_client`,`parent_client_id`,`username`,`password`,`language`,`usertheme`,`template_master`,`template_additional`,`created_at`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 425
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO sys_group (`groupid`,`name`,`description`,`client_id`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 426
    10.09.2010-11:55 - DEBUG - Replicated from master: REPLACE INTO client (`client_id`,`sys_userid`,`sys_groupid`,`sys_perm_user`,`sys_perm_group`,`sys_perm_other`,`company_name`,`contact_name`,`street`,`zip`,`city`,`state`,`country`,`telephone`,`mobile`,`fax`,`email`,`internet`,`icq`,`notes`,`default_mailserver`,`limit_maildomain`,`limit_mailbox`,`limit_mailalias`,`limit_mailaliasdomain`,`limit_mailforward`,`limit_mailcatchall`,`limit_mailrouting`,`limit_mailfilter`,`limit_fetchmail`,`limit_mailquota`,`limit_spamfilter_wblist`,`limit_spamfilter_user`,`limit_spamfilter_policy`,`default_webserver`,`limit_web_ip`,`limit_web_domain`,`limit_web_quota`,`web_php_options`,`limit_web_subdomain`,`limit_web_aliasdomain`,`limit_ftp_user`,`limit_shell_user`,`ssh_chroot`,`default_dnsserver`,`limit_dns_zone`,`limit_dns_record`,`default_dbserver`,`limit_database`,`limit_cron`,`limit_cron_type`,`limit_cron_frequency`,`limit_traffic_quota`,`limit_client`,`parent_client_id`,`username`,`password`,`language`,`usertheme`,`template_master`,`template_additional`,`created_at`) VALUES ...
    10.09.2010-11:55 - DEBUG - Processed datalog_id 427
    10.09.2010-11:55 - DEBUG - Remove Lock: /usr/local/ispconfig/server/temp/.ispconfig_lock
    finished.
     
  3. till

    till Super Moderator Staff Member ISPConfig Developer

    Login to ispconfig on the master server, go to the server settings of the slave server and select that this server is a slave server of the master. The settings is named "is mirror of". This new setting will only affect new created domains or updated domains.
     
  4. adminnc

    adminnc New Member

    Hello,

    I've already done it and try to create zone, or records but no succes on replication.
    So I've done a mysql replication and it is working but I will definitively prefer the ispconfig replication.
    Where I can see more logs or how to force a replication ?
    I've try to find docs about how to setup a module for replication, but no success, so I've inspected the code and say to me if I'm wrong but it seems it is in the sys_datalog that there is the hook.
    I'm just trying to find a way to debug it more.

    Thanks for your help
     
  5. till

    till Super Moderator Staff Member ISPConfig Developer

    You can not use mysql replication and ispconfig replication togeteher as tehy are incompatible. So as long as you use mysql replication, the ispconfig replication will fail.

    So the steps to fix this are:

    1) disable mysql replication.
    2) ensure that you installed ispconfig on the slave server in exopert mode and that you have choosen to join the master server.
    3) that you selcted that the slave is a mirror of the master server in ispconfig. It is essential that this is done before any data is added on the master server as only new or updated data gets replicated.
     
  6. adminnc

    adminnc New Member

    Hi Till,

    Thank you for your reply
    So I've stoped mysql replication and uninstall all and reinstall the server in the cluster.
    I've check connection for dns server to master's mysql server and it is ok, but still nothing in powerdns database.
    So I've reinstall all, master and slave, on master there is nothing in powerdns database too now... but still dbispconfig.dns_* are full of the dns settings I need.
    So I think I've done something wrong with the cluster setup, my idea is to reinstall all the cluster, but I need to keep the dbispconfig database because I've already lot of customers inside.
    So my question is : is it possible to ask the master to synchronize from scratch the powerdns database with the data in dbispconfig database ?

    Thx
     

Share This Page