Dear all I manage to setup the heartbeat to work on my FreeBSD 7.2. When I shutdown either of the servers, the other server is able to detect this event. The only problem is, it seems like the heartbeat is not adding the Virtual IP to the active server. Neither is there any errors in the logs. And I am able to manually add the virtual ip using ifconfig when I am login as root. Any idea? I am out of wits. *******ha.cf************* debugfile /var/log/ha-debug logfile /var/log/ha-log logfacility local0 keepalive 2 deadtime 30 warntime 10 initdead 120 udpport 694 ucast bce0 192.168.0.100 auto_failback on node www1.domain.com node www2.domain.com ****haresources******** www1.domain.com 192.168.0.1/27 ****authkeys**** auth 2 2 sha1 RANDOM ***ha-debug***** heartbeat[1206]: 2010/04/14_21:15:44 WARN: Logging daemon is disabled --enabling logging daemon is recommended heartbeat[1206]: 2010/04/14_21:15:44 info: ************************** heartbeat[1206]: 2010/04/14_21:15:44 info: Configuration validated. Starting heartbeat 2.1.4 heartbeat[1207]: 2010/04/14_21:15:44 info: heartbeat: version 2.1.4 heartbeat[1207]: 2010/04/14_21:15:44 info: Heartbeat generation: 1271235854 heartbeat[1207]: 2010/04/14_21:15:44 info: glib: ucast: write socket priority set to IPTOS_LOWDELAY on bce0 heartbeat[1207]: 2010/04/14_21:15:44 info: glib: ucast: set SO_REUSEPORT(w) heartbeat[1207]: 2010/04/14_21:15:44 info: glib: ucast: set SO_REUSEPORT(w) heartbeat[1207]: 2010/04/14_21:15:44 info: glib: ucast: started on port 694 interface bce0 to 192.168.0.101 heartbeat[1207]: 2010/04/14_21:15:44 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[1207]: 2010/04/14_21:15:44 info: G_main_add_TriggerHandler: Added signal manual handler heartbeat[1207]: 2010/04/14_21:15:44 info: G_main_add_SignalHandler: Added signal handler for signal 20 heartbeat[1207]: 2010/04/14_21:15:44 info: Local status now set to: 'up' heartbeat[1207]: 2010/04/14_21:15:50 WARN: Gmain_timeout_dispatch: Dispatch function for hb_pop_deadtime was delayed 1093 ms (> 500 ms) before being called (GSource: 0x287430d0) heartbeat[1207]: 2010/04/14_21:15:50 info: Gmain_timeout_dispatch: started at 116410 should have started at 116270 heartbeat[1207]: 2010/04/14_21:15:52 WARN: Gmain_timeout_dispatch: Dispatch function for send local status was delayed 1765 m s (> 1010 ms) before being called (GSource: 0x287437b0) heartbeat[1207]: 2010/04/14_21:15:52 info: Gmain_timeout_dispatch: started at 116715 should have started at 116489 heartbeat[1207]: 2010/04/14_21:15:52 WARN: Gmain_timeout_dispatch: Dispatch function for check for signals was delayed 1765 m s (> 1010 ms) before being called (GSource: 0x28743a30) heartbeat[1207]: 2010/04/14_21:15:52 info: Gmain_timeout_dispatch: started at 116715 should have started at 116489 heartbeat[1207]: 2010/04/14_21:17:44 WARN: node www2.domain.com: is dead heartbeat[1207]: 2010/04/14_21:17:44 info: Comm_now_up(): updating status to active heartbeat[1207]: 2010/04/14_21:17:44 info: Local status now set to: 'active' heartbeat[1207]: 2010/04/14_21:17:44 info: Starting child client "/usr/local/lib/heartbeat/ccm" (275,275) heartbeat[1207]: 2010/04/14_21:17:44 info: Starting child client "/usr/local/lib/heartbeat/cib" (275,275) heartbeat[1218]: 2010/04/14_21:17:44 info: Starting "/usr/local/lib/heartbeat/ccm" as uid 275 gid 275 (pid 1218) heartbeat[1219]: 2010/04/14_21:17:44 info: Starting "/usr/local/lib/heartbeat/cib" as uid 275 gid 275 (pid 1219) heartbeat[1207]: 2010/04/14_21:17:44 info: Starting child client "/usr/local/lib/heartbeat/lrmd -r" (0,0) heartbeat[1220]: 2010/04/14_21:17:44 info: Starting "/usr/local/lib/heartbeat/lrmd -r" as uid 0 gid 0 (pid 1220) heartbeat[1207]: 2010/04/14_21:17:44 info: Starting child client "/usr/local/lib/heartbeat/stonithd" (0,0) cib[1219]: 2010/04/14_21:17:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[1219]: 2010/04/14_21:17:44 info: G_main_add_TriggerHandler: Added signal manual handler cib[1219]: 2010/04/14_21:17:44 info: G_main_add_SignalHandler: Added signal handler for signal 20 cib[1219]: 2010/04/14_21:17:44 info: main: Retrieval of a per-action CIB: disabled cib[1219]: 2010/04/14_21:17:44 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <cib generated="false" admin_epoch="0" epoch ="24" num_updates="2" have_quorum="false" ignore_dtd="false" num_peers="1" cib_feature_revision="2.0" crm_feature_set="2.0" c ib-last-written="Wed Apr 14 21:05:41 2010" ccm_transition="1"> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <configuration> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <crm_config> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <cluster_property_set id="cib-bootstrap-options"> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <attributes> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="2.1.4-node: aa909246edb386137b986c5773344b98c6969999"/> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] </attributes> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] </cluster_property_set> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] </crm_config> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <nodes> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <node id="7e040e96-040f-455b-93ea-62698feed422" uname="www1.domain.com" type="normal"/> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <node id="9b122093-48c6-4b37-8c27-4e0862ccc9a1" uname="www2.domain.com" type="normal"/> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <node id="bdf56ec9-739e-46af-a536-3f08c7993c8f" uname="www2.domain.com" type="normal"/> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] </nodes> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <resources/> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <constraints/> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] </configuration> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] <status/> cib[1219]: 2010/04/14_21:17:44 info: log_data_element: readCibXmlFile: [on-disk] </cib> cib[1219]: 2010/04/14_21:17:44 info: startCib: CIB Initialization completed successfully cib[1219]: 2010/04/14_21:17:44 info: cib_register_ha: Signing in with Heartbeat heartbeat[1221]: 2010/04/14_21:17:44 info: Starting "/usr/local/lib/heartbeat/stonithd" as uid 0 gid 0 (pid 1221) heartbeat[1207]: 2010/04/14_21:17:44 info: Starting child client "/usr/local/lib/heartbeat/attrd" (275,275) lrmd[1220]: 2010/04/14_21:17:44 info: G_main_add_SignalHandler: Added signal handler for signal 15 lrmd[1220]: 2010/04/14_21:17:44 info: G_main_add_SignalHandler: Added signal handler for signal 20 lrmd[1220]: 2010/04/14_21:17:44 info: G_main_add_SignalHandler: Added signal handler for signal 30 lrmd[1220]: 2010/04/14_21:17:44 info: G_main_add_SignalHandler: Added signal handler for signal 31 lrmd[1220]: 2010/04/14_21:17:44 info: Started. stonithd[1221]: 2010/04/14_21:17:45 info: G_main_add_SignalHandler: Added signal handler for signal 30 heartbeat[1222]: 2010/04/14_21:17:45 info: Starting "/usr/local/lib/heartbeat/attrd" as uid 275 gid 275 (pid 1222) stonithd[1221]: 2010/04/14_21:17:45 info: G_main_add_SignalHandler: Added signal handler for signal 31 heartbeat[1207]: 2010/04/14_21:17:45 info: Starting child client "/usr/local/lib/heartbeat/crmd" (275,275) heartbeat[1223]: 2010/04/14_21:17:45 info: Starting "/usr/local/lib/heartbeat/crmd" as uid 275 gid 275 (pid 1223) attrd[1222]: 2010/04/14_21:17:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 cib[1219]: 2010/04/14_21:17:45 info: cib_register_ha: FSA Hostname: www1.domain.com stonithd[1221]: 2010/04/14_21:17:45 info: Signing in with heartbeat. attrd[1222]: 2010/04/14_21:17:45 info: register_with_ha: Hostname: www1.domain.com ccm[1218]: 2010/04/14_21:17:45 info: Hostname: www1.domain.com attrd[1222]: 2010/04/14_21:17:45 info: register_with_ha: UUID: 7e040e96-040f-455b-93ea-62698feed422 ccm[1218]: 2010/04/14_21:17:45 info: Break tie for 2 nodes cluster ccm[1218]: 2010/04/14_21:17:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[1223]: 2010/04/14_21:17:45 info: main: CRM Hg Version: node: aa909246edb386137b986c5773344b98c6969999 crmd[1223]: 2010/04/14_21:17:45 info: crmd_init: Starting crmd crmd[1223]: 2010/04/14_21:17:45 info: G_main_add_SignalHandler: Added signal handler for signal 15 crmd[1223]: 2010/04/14_21:17:45 info: G_main_add_TriggerHandler: Added signal manual handler crmd[1223]: 2010/04/14_21:17:45 info: G_main_add_SignalHandler: Added signal handler for signal 20 stonithd[1221]: 2010/04/14_21:17:45 notice: /usr/local/lib/heartbeat/stonithd start up successfully. stonithd[1221]: 2010/04/14_21:17:45 info: G_main_add_SignalHandler: Added signal handler for signal 20 cib[1219]: 2010/04/14_21:17:45 info: ccm_connect: Registering with CCM... cib[1219]: 2010/04/14_21:17:47 info: cib_init: Starting cib mainloop cib[1219]: 2010/04/14_21:17:47 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm cib[1219]: 2010/04/14_21:17:47 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 cib[1219]: 2010/04/14_21:17:47 info: cib_ccm_msg_callback: PEER: www1.domain.com cib[1224]: 2010/04/14_21:17:47 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1224]: 2010/04/14_21:17:47 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1224]: 2010/04/14_21:17:47 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last) cib[1224]: 2010/04/14_21:17:47 info: write_cib_contents: Wrote version 0.24.2 of the CIB to disk (digest: c6786a6f7bf54ee1d2a5f20aeaedb1d5) cib[1224]: 2010/04/14_21:17:47 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1224]: 2010/04/14_21:17:47 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last) cib[1219]: 2010/04/14_21:17:49 info: cib_client_status_callback: Status update: Client www1.domain.com/cib now has status [join] cib[1219]: 2010/04/14_21:17:49 info: cib_client_status_callback: Status update: Client www1.domain.com/cib now has status [online] crmd[1223]: 2010/04/14_21:17:49 info: do_cib_control: CIB connection established cib[1219]: 2010/04/14_21:17:49 info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on crmd[1223]: 2010/04/14_21:17:49 info: register_with_ha: Hostname: www1.domain.com crmd[1223]: 2010/04/14_21:17:51 info: register_with_ha: UUID: 7e040e96-040f-455b-93ea-62698feed422 crmd[1223]: 2010/04/14_21:17:54 info: populate_cib_nodes: Requesting the list of configured nodes crmd[1223]: 2010/04/14_21:17:56 WARN: get_uuid: Could not calculate UUID for www2.domain.com crmd[1223]: 2010/04/14_21:17:56 WARN: populate_cib_nodes: Node www2.domain.com: no uuid found crmd[1223]: 2010/04/14_21:17:59 notice: populate_cib_nodes: Node: www1.domain.com (uuid: 7e040e96-040f-455b-93ea-62698feed422) crmd[1223]: 2010/04/14_21:17:59 info: do_ha_control: Connected to Heartbeat crmd[1223]: 2010/04/14_21:17:59 WARN: do_fsa_action: Action A_HA_CONNECT took 9328ms to complete crmd[1223]: 2010/04/14_21:17:59 info: do_ccm_control: CCM connection established... waiting for first callback crmd[1223]: 2010/04/14_21:17:59 info: do_started: Delaying start, CCM (0000000000100000) not connected crmd[1223]: 2010/04/14_21:17:59 info: crmd_init: Starting crmd's mainloop crmd[1223]: 2010/04/14_21:17:59 notice: crmd_client_status_callback: Status update: Client www1.domain.com/crmd now has status [online] crmd[1223]: 2010/04/14_21:18:01 notice: crmd_client_status_callback: Status update: Client www1.domain.com/crmd now has status [online] crmd[1223]: 2010/04/14_21:18:03 info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm crmd[1223]: 2010/04/14_21:18:03 info: mem_handle_event: instance=1, nodes=1, new=1, lost=0, n_idx=0, new_idx=0, old_idx=3 crmd[1223]: 2010/04/14_21:18:03 info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=1) crmd[1223]: 2010/04/14_21:18:03 info: ccm_event_detail: NEW MEMBERSHIP: trans=1, nodes=1, new=1, lost=0 n_idx=0, new_idx=0, old_idx=3 crmd[1223]: 2010/04/14_21:18:03 info: ccm_event_detail: CURRENT: www1.domain.com [nodeid=0, born=1] crmd[1223]: 2010/04/14_21:18:03 info: ccm_event_detail: NEW: www1.domain.com [nodeid=0, born=1] crmd[1223]: 2010/04/14_21:18:03 info: do_started: Delaying start, Config not read (0000000000000040) crmd[1223]: 2010/04/14_21:18:03 info: do_started: The local CRM is operational crmd[1223]: 2010/04/14_21:18:03 info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_FSA_INTERNAL origin=do_started ] attrd[1222]: 2010/04/14_21:18:32 info: main: Starting mainloop... crmd[1223]: 2010/04/14_21:20:10 info: crm_timer_popped: Election Trigger (I_DC_TIMEOUT) just popped! crmd[1223]: 2010/04/14_21:20:10 WARN: do_log: [[FSA]] Input I_DC_TIMEOUT from crm_timer_popped() received in state (S_PENDING) crmd[1223]: 2010/04/14_21:20:10 info: do_state_transition: State transition S_PENDING -> S_ELECTION [ input=I_DC_TIMEOUT cause=C_TIMER_POPPED origin=crm_timer_popped ] crmd[1223]: 2010/04/14_21:20:10 info: do_election_count_vote: Updated voted hash for www1.domain.com to vote crmd[1223]: 2010/04/14_21:20:10 info: do_election_count_vote: Election ignore: our vote (www1.domain.com) crmd[1223]: 2010/04/14_21:20:10 info: do_state_transition: State transition S_ELECTION -> S_INTEGRATION [ input=I_ELECTION_DC cause=C_FSA_INTERNAL origin=do_election_check ] crmd[1223]: 2010/04/14_21:20:10 info: start_subsystem: Starting sub-system "tengine" crmd[1223]: 2010/04/14_21:20:10 info: start_subsystem: Starting sub-system "pengine" crmd[1223]: 2010/04/14_21:20:10 info: do_dc_takeover: Taking over DC status for this partition cib[1219]: 2010/04/14_21:20:10 info: cib_process_readwrite: We are now in R/W mode cib[1219]: 2010/04/14_21:20:10 info: log_data_element: cib:diff: - <cib generated="false" epoch="24" num_updates="2"/> cib[1219]: 2010/04/14_21:20:10 info: log_data_element: cib:diff: + <cib generated="true" epoch="25" num_updates="1"/> crmd[1223]: 2010/04/14_21:20:10 info: erase_node_from_join: Removed dead node www1.domain.com from join calculations: welcomed=0 itegrated=0 finalized=0 confirmed=0 crmd[1223]: 2010/04/14_21:20:10 info: join_make_offer: Making join offers based on membership 1 crmd[1223]: 2010/04/14_21:20:10 info: do_dc_join_offer_all: join-1: Waiting on 1 outstanding join acks cib[1232]: 2010/04/14_21:20:10 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) tengine[1230]: 2010/04/14_21:20:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[1230]: 2010/04/14_21:20:10 info: G_main_add_TriggerHandler: Added signal manual handler pengine[1231]: 2010/04/14_21:20:10 info: G_main_add_SignalHandler: Added signal handler for signal 15 tengine[1230]: 2010/04/14_21:20:10 info: G_main_add_TriggerHandler: Added signal manual handler pengine[1231]: 2010/04/14_21:20:10 info: pe_init: Starting pengine tengine[1230]: 2010/04/14_21:20:10 info: te_init: Registering TE UUID: a6707afb-7609-4f2e-983c-9438763e9550 tengine[1230]: 2010/04/14_21:20:10 info: set_graph_functions: Setting custom graph functions cib[1219]: 2010/04/14_21:20:10 info: cib_null_callback: Setting cib_diff_notify callbacks for tengine: on tengine[1230]: 2010/04/14_21:20:10 info: unpack_graph: Unpacked transition -1: 0 actions in 0 synapses tengine[1230]: 2010/04/14_21:20:10 info: te_init: Starting tengine tengine[1230]: 2010/04/14_21:20:10 info: te_connect_stonith: Attempting connection to fencing daemon... cib[1232]: 2010/04/14_21:20:10 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1232]: 2010/04/14_21:20:10 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last) cib[1232]: 2010/04/14_21:20:10 info: write_cib_contents: Wrote version 0.25.1 of the CIB to disk (digest: 931114109f91a3889fa67799010c15d8) cib[1232]: 2010/04/14_21:20:10 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1232]: 2010/04/14_21:20:10 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last) crmd[1223]: 2010/04/14_21:20:12 info: update_dc: Set DC to www1.domain.com (2.0) crmd[1223]: 2010/04/14_21:20:15 info: do_state_transition: State transition S_INTEGRATION -> S_FINALIZE_JOIN [ input=I_INTEGRATED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[1223]: 2010/04/14_21:20:15 info: do_state_transition: All 1 cluster nodes responded to the join offer. crmd[1223]: 2010/04/14_21:20:15 info: update_attrd: Connecting to attrd... cib[1219]: 2010/04/14_21:20:15 info: sync_our_cib: Syncing CIB to all peers attrd[1222]: 2010/04/14_21:20:15 info: attrd_local_callback: Sending full refresh cib[1219]: 2010/04/14_21:20:15 info: log_data_element: cib:diff: - <cib epoch="25" num_updates="2"/> cib[1219]: 2010/04/14_21:20:15 info: log_data_element: cib:diff: + <cib epoch="26" num_updates="1" dc_uuid="7e040e96-040f-455b-93ea-62698feed422"/> tengine[1230]: 2010/04/14_21:20:15 info: te_connect_stonith: Connected tengine[1230]: 2010/04/14_21:20:15 info: update_abort_priority: Abort priority upgraded to 1000000 tengine[1230]: 2010/04/14_21:20:15 info: update_abort_priority: 'DC Takeover' abort superceeded cib[1233]: 2010/04/14_21:20:15 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1233]: 2010/04/14_21:20:15 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1233]: 2010/04/14_21:20:15 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last) cib[1233]: 2010/04/14_21:20:15 info: write_cib_contents: Wrote version 0.26.2 of the CIB to disk (digest: d67037a3e8e0a07c580a83ad01143f7d) cib[1233]: 2010/04/14_21:20:15 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig) cib[1233]: 2010/04/14_21:20:15 info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last) crmd[1223]: 2010/04/14_21:20:17 info: update_dc: Set DC to www1.domain.com (2.0) crmd[1223]: 2010/04/14_21:20:17 info: do_dc_join_ack: join-1: Updating node state to member for www1.domain.com crmd[1223]: 2010/04/14_21:20:17 info: do_state_transition: State transition S_FINALIZE_JOIN -> S_POLICY_ENGINE [ input=I_FINALIZED cause=C_FSA_INTERNAL origin=check_join_state ] crmd[1223]: 2010/04/14_21:20:17 info: do_state_transition: All 1 cluster nodes are eligible to run resources. pengine[1231]: 2010/04/14_21:20:17 WARN: unpack_nodes: Detected multiple node entries with uname=www2.domain.com - this is rarely intended pengine[1231]: 2010/04/14_21:20:17 info: determine_online_status: Node www1.domain.com is online crmd[1223]: 2010/04/14_21:20:17 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[1230]: 2010/04/14_21:20:17 info: process_te_message: Processing graph derived from /var/lib/heartbeat/pengine/pe-input-35.bz2 tengine[1230]: 2010/04/14_21:20:17 info: unpack_graph: Unpacked transition 0: 1 actions in 1 synapses tengine[1230]: 2010/04/14_21:20:17 info: send_rsc_command: Initiating action 2: probe_complete probe_complete on www1.domain.com tengine[1230]: 2010/04/14_21:20:17 info: run_graph: Transition 0: (Complete=1, Pending=0, Fired=0, Skipped=0, Incomplete=0) tengine[1230]: 2010/04/14_21:20:17 info: notify_crmd: Transition 0 status: te_complete - <null> crmd[1223]: 2010/04/14_21:20:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[1230]: 2010/04/14_21:20:17 info: extract_event: Aborting on transient_attributes changes for 7e040e96-040f-455b-93ea-62698feed422 tengine[1230]: 2010/04/14_21:20:17 info: update_abort_priority: Abort priority upgraded to 1000000 pengine[1231]: 2010/04/14_21:20:17 info: process_pe_message: Transition 0: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-35.bz2 pengine[1231]: 2010/04/14_21:20:17 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues. crmd[1223]: 2010/04/14_21:20:17 info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_PE_CALC cause=C_IPC_MESSAGE origin=route_message ] crmd[1223]: 2010/04/14_21:20:17 info: do_state_transition: All 1 cluster nodes are eligible to run resources. pengine[1231]: 2010/04/14_21:20:17 WARN: unpack_nodes: Detected multiple node entries with uname=www2.domain.com - this is rarely intended pengine[1231]: 2010/04/14_21:20:17 info: determine_online_status: Node www1.domain.com is online crmd[1223]: 2010/04/14_21:20:17 info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] tengine[1230]: 2010/04/14_21:20:17 info: process_te_message: Processing graph derived from /var/lib/heartbeat/pengine/pe-inpu t-36.bz2 tengine[1230]: 2010/04/14_21:20:17 info: unpack_graph: Unpacked transition 1: 0 actions in 0 synapses tengine[1230]: 2010/04/14_21:20:17 info: run_graph: Transition 1: (Complete=0, Pending=0, Fired=0, Skipped=0, Incomplete=0) tengine[1230]: 2010/04/14_21:20:17 info: notify_crmd: Transition 1 status: te_complete - <null> crmd[1223]: 2010/04/14_21:20:17 info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_IDLE [ input=I_TE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ] pengine[1231]: 2010/04/14_21:20:17 info: process_pe_message: Transition 1: PEngine Input stored in: /var/lib/heartbeat/pengine/pe-input-36.bz2 pengine[1231]: 2010/04/14_21:20:17 info: process_pe_message: Configuration WARNINGs found during PE processing. Please run "crm_verify -L" to identify issues.