ISPConfig 3 - Automated MultiServer Setup - Problems with System Server Services Mods

Hi All,

Been using ISPConfig for awhile, mostly with single server setups, but a few test runs of multiserver setups. Really great software! We appreciate all the hard work that goes into it's development and support!

Based off some existing scripts (referenced elsewhere in these forums), we've successfully been able to create an automated script with a combination of bash and expect that can setup up everything unattended (after the basic OS install). We are having trouble with one last step.

This step involves modifying the services provided by each server. In the Web Interface this is under System > Server Services > <server_name>. We can successfully modify the sql to change the services, but it seems to miss some setting, and the monitoring thinks the FTPServer should be running on all the systems.

Here's the sql (run from bash):

Code:

mysql -u${LCL_MYSQL_ROOT_USERNAME} -p${LCL_MYSQL_ROOT_PASSWORD} -D${LCL_ISPCONFIG_MYSQL_DB} << SQL2
UPDATE server SET mail_server=0, web_server=1, dns_server=0, file_server=1, db_server=0, vserver_server=0, proxy_server=0, firewall_server=1, updated=1 WHERE server_name='${LCL_SERVER_FQDN_WEB}';
UPDATE server SET mail_server=1, web_server=0, dns_server=0, file_server=0, db_server=0, vserver_server=0, proxy_server=0, firewall_server=1, updated=2 WHERE server_name='${LCL_SERVER_FQDN_MAIL}';
UPDATE server SET mail_server=0, web_server=0, dns_server=0, file_server=0, db_server=1, vserver_server=0, proxy_server=0, firewall_server=1, updated=3 WHERE server_name='${LCL_SERVER_FQDN_DB}';
UPDATE server SET mail_server=0, web_server=0, dns_server=1, file_server=0, db_server=0, vserver_server=0, proxy_server=0, firewall_server=1, updated=4 WHERE server_name='${LCL_SERVER_FQDN_DNS1}';
UPDATE server SET mail_server=0, web_server=0, dns_server=1, file_server=0, db_server=0, vserver_server=0, proxy_server=0, firewall_server=1, updated=5 WHERE server_name='${LCL_SERVER_FQDN_DNS2}';
SQL2

(Obviously the variables get replaced with the necessary information.) What else do we need to do? I notice that when the changes are made from the Web Interface, the only difference (that I could find anyway) is that the changes are logged into the sys_datalog table as well. Do we need to emulate that from our script? If so, what would we insert? The information in there seems somewhat cryptic.

Any help, or leads to finding what we need are appreciated! Thanks in advance!

Of course, we can always resort to using the Web Interface to make the changes, however, we would like to fully automate the install end to end!

Thanks and regards,
SuperJC

 

Hi Till,

Thanks for your reply and the timely information. So now I will have to try to figure out the API. My first scan of the remote APIs doesn't seem to turn up one that could be used for this purpose. I do see a function in db_mysql.inc.php that I could possibly leverage. Not quite sure how to do so. However, I do see some info here that might help me: http://www.howtoforge.com/how-to-create-remote-api-scripts-for-ispconfig-3

If anyone has some helpful hints on using these APIs and functions it would be greatly appreciated!

Thanks,
SuperJC

 

Thanks again. That was the function I had my eye on! Now I just have to figure out how to use it. I think I have some ideas, so we'll see how it goes!

Thanks for your help!

Take care,
SuperJC

 

Piecing together information I found in various posts on this forum, I think I was able to figure it out. Here's the script I worked up. It probably could be refined, and I'm open to suggestions & improvements!

Code:

#!/bin/bash
[ $# -eq 1 ] || { echo -e "\nError:\tConfiguration file needed ...\nUsage:\t${0##*/} <configuration_file.conf>\n"; exit 1; }
LCL_CONF_FILE="${1}"
# source in the variables set in the config file
source ${LCL_CONF_FILE}

php <<PHP1
<?php
include_once('/usr/local/ispconfig/interface/lib/config.inc.php');
\$conf['start_session'] = false;
include_once('/usr/local/ispconfig/interface/lib/app.inc.php');
include_once('/usr/local/ispconfig/interface/lib/classes/db_mysql.inc.php');

	global \$app;
	\$tablename = "server";
	\$index_field = "server_name";

	// WEB
	\$index_value = "${LCL_SERVER_FQDN_WEB}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"1",
				"dns_server"		=>	"0",
				"file_server"		=>	"1",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",
				"proxy_server"		=>	"0",
				"firewall_server"	=>	"1",
				"updated"		=>	"1",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// MAIL
	\$index_value = "${LCL_SERVER_FQDN_MAIL}";
	\$update_data = array(	"mail_server"		=>	"1",
				"web_server"		=>	"0",
				"dns_server"		=>	"0",
				"file_server"		=>	"0",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",
				"proxy_server"		=>	"0",
				"firewall_server"	=>	"1",
				"updated"		=>	"2",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// DB
	\$index_value = "${LCL_SERVER_FQDN_DB}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"0",
				"dns_server"		=>	"0",
				"file_server"		=>	"0",
				"db_server"		=>	"1",
				"vserver_server"	=>	"0",
				"proxy_server"		=>	"0",
				"firewall_server"	=>	"1",
				"updated"		=>	"3",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// DNS1
	\$index_value = "${LCL_SERVER_FQDN_DNS1}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"0",
				"dns_server"		=>	"1",
				"file_server"		=>	"0",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",
				"proxy_server"		=>	"0",
				"firewall_server"	=>	"1",
				"updated"		=>	"4",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// DNS2
	\$index_value = "${LCL_SERVER_FQDN_DNS2}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"0",
				"dns_server"		=>	"1",
				"file_server"		=>	"0",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",
				"proxy_server"		=>	"0",
				"firewall_server"	=>	"1",
				"updated"		=>	"5",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);
?>
PHP1

These posts were helpful in constructing this:

• http://www.howtoforge.com/forums/showthread.php?t=26905

• http://www.howtoforge.com/forums/showthread.php?t=40690

• http://www.howtoforge.com/forums/showthread.php?t=44347

Thanks,
SuperJC

 

So, here's some refinements we made to mimic more closely what the WebUI form returns:

Code:

LCL_SERVER_ID_CP="$(mysql -N -u${LCL_MYSQL_ROOT_USERNAME} -p${LCL_MYSQL_ROOT_PASSWORD} -D${LCL_ISPCONFIG_MASTER_SERVER_MYSQL_DB} -e "SELECT server_id FROM server WHERE server_name='${LCL_SERVER_FQDN_CP}';")"
LCL_SERVER_ID_WEB="$(mysql -N -u${LCL_MYSQL_ROOT_USERNAME} -p${LCL_MYSQL_ROOT_PASSWORD} -D${LCL_ISPCONFIG_MASTER_SERVER_MYSQL_DB} -e "SELECT server_id FROM server WHERE server_name='${LCL_SERVER_FQDN_WEB}';")"
LCL_SERVER_ID_MAIL="$(mysql -N -u${LCL_MYSQL_ROOT_USERNAME} -p${LCL_MYSQL_ROOT_PASSWORD} -D${LCL_ISPCONFIG_MASTER_SERVER_MYSQL_DB} -e "SELECT server_id FROM server WHERE server_name='${LCL_SERVER_FQDN_MAIL}';")"
LCL_SERVER_ID_DB="$(mysql -N -u${LCL_MYSQL_ROOT_USERNAME} -p${LCL_MYSQL_ROOT_PASSWORD} -D${LCL_ISPCONFIG_MASTER_SERVER_MYSQL_DB} -e "SELECT server_id FROM server WHERE server_name='${LCL_SERVER_FQDN_DB}';")"
LCL_SERVER_ID_DNS1="$(mysql -N -u${LCL_MYSQL_ROOT_USERNAME} -p${LCL_MYSQL_ROOT_PASSWORD} -D${LCL_ISPCONFIG_MASTER_SERVER_MYSQL_DB} -e "SELECT server_id FROM server WHERE server_name='${LCL_SERVER_FQDN_DNS1}';")"
LCL_SERVER_ID_DNS2="$(mysql -N -u${LCL_MYSQL_ROOT_USERNAME} -p${LCL_MYSQL_ROOT_PASSWORD} -D${LCL_ISPCONFIG_MASTER_SERVER_MYSQL_DB} -e "SELECT server_id FROM server WHERE server_name='${LCL_SERVER_FQDN_DNS2}';")"

php <<PHP1
<?php
include_once('/usr/local/ispconfig/interface/lib/config.inc.php');
\$conf['start_session'] = false;
include_once('/usr/local/ispconfig/interface/lib/app.inc.php');
include_once('/usr/local/ispconfig/interface/lib/classes/db_mysql.inc.php');

	global \$app;
	\$tablename = "server";
	\$index_field = "server_id";

	// CP
	\$index_value = "${LCL_SERVER_ID_CP}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"0",
				"dns_server"		=>	"0",
				"file_server"		=>	"0",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// WEB
	\$index_value = "${LCL_SERVER_ID_WEB}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"1",
				"dns_server"		=>	"0",
				"file_server"		=>	"1",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// MAIL
	\$index_value = "${LCL_SERVER_ID_MAIL}";
	\$update_data = array(	"mail_server"		=>	"1",
				"web_server"		=>	"0",
				"dns_server"		=>	"0",
				"file_server"		=>	"0",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// DB
	\$index_value = "${LCL_SERVER_ID_DB}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"0",
				"dns_server"		=>	"0",
				"file_server"		=>	"0",
				"db_server"		=>	"1",
				"vserver_server"	=>	"0",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// DNS1
	\$index_value = "${LCL_SERVER_ID_DNS1}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"0",
				"dns_server"		=>	"1",
				"file_server"		=>	"0",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);

	// DNS2
	\$index_value = "${LCL_SERVER_ID_DNS2}";
	\$update_data = array(	"mail_server"		=>	"0",
				"web_server"		=>	"0",
				"dns_server"		=>	"1",
				"file_server"		=>	"0",
				"db_server"		=>	"0",
				"vserver_server"	=>	"0",
				"mirror_server_id"	=>	"${LCL_SERVER_ID_DNS1}",);
	\$app->db->datalogUpdate(\$tablename, \$update_data, \$index_field, \$index_value, \$force_update = false);
?>
PHP1

Likely those Server_ID variables could be done in SQL too, but with my limited knowledge of it, I decided to use bash variables.

Comments, suggestions, improvement always welcome!

Thanks,

SuperJC