Hi, have Problem with the Lenny Howto: on primary /usr/lib/heartbeat/hb_standby local srv3 primary syslog HTML: Jun 22 08:44:23 srv3 heartbeat: [5246]: info: srv3 wants to go standby [local] Jun 22 08:44:23 srv3 heartbeat: [5246]: info: standby: srv4 can take our local resources Jun 22 08:44:23 srv3 heartbeat: [7023]: info: give up local HA resources (standby). Jun 22 08:44:23 srv3 ResourceManager[7036]: [7047]: info: Releasing resource group: srv3 drbddisk::r0 LVM::drbdvg0 Filesystem::/dev/drbdvg0/web::/VSERVERS/web::ext3 Vserver-web SendArp::192.168.1.26/27/eth0 Jun 22 08:44:23 srv3 ResourceManager[7036]: [7062]: info: Running /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop Jun 22 08:44:23 srv3 ResourceManager[7036]: [7063]: debug: Starting /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop Jun 22 08:44:23 srv3 SendArp[7081]: [7087]: INFO: SendArp for 192.168.1.26/27/eth0 released Jun 22 08:44:23 srv3 SendArp[7064]: [7088]: INFO: Success Jun 22 08:44:23 srv3 ResourceManager[7036]: [7089]: debug: /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop done. RC=0 Jun 22 08:44:23 srv3 ResourceManager[7036]: [7098]: info: Running /etc/ha.d/resource.d/Vserver-web stop Jun 22 08:44:23 srv3 ResourceManager[7036]: [7099]: debug: Starting /etc/ha.d/resource.d/Vserver-web stop Jun 22 08:44:25 srv3 ResourceManager[7036]: [7210]: debug: /etc/ha.d/resource.d/Vserver-web stop done. RC=0 Jun 22 08:44:25 srv3 ResourceManager[7036]: [7224]: info: Running /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop Jun 22 08:44:25 srv3 ResourceManager[7036]: [7225]: debug: Starting /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop Jun 22 08:44:25 srv3 Filesystem[7237]: [7267]: INFO: Running stop for /dev/drbdvg0/web on /VSERVERS/web Jun 22 08:44:25 srv3 Filesystem[7237]: [7277]: INFO: Trying to unmount /VSERVERS/web Jun 22 08:44:25 srv3 Filesystem[7237]: [7279]: INFO: unmounted /VSERVERS/web successfully Jun 22 08:44:25 srv3 Filesystem[7226]: [7285]: INFO: Success Jun 22 08:44:25 srv3 ResourceManager[7036]: [7286]: debug: /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop done. RC=0 Jun 22 08:44:25 srv3 ResourceManager[7036]: [7300]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:44:25 srv3 ResourceManager[7036]: [7301]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:44:25 srv3 LVM[7313]: [7324]: INFO: Deactivating volume group drbdvg0 Jun 22 08:44:25 srv3 LVM[7313]: [7330]: INFO: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open 0 logical volume(s) in volume group "drbdvg0" now active Jun 22 08:44:25 srv3 LVM[7302]: [7333]: INFO: Success Jun 22 08:44:25 srv3 ResourceManager[7036]: [7334]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=0 Jun 22 08:44:25 srv3 ResourceManager[7036]: [7348]: info: Running /etc/ha.d/resource.d/drbddisk r0 stop Jun 22 08:44:25 srv3 ResourceManager[7036]: [7349]: debug: Starting /etc/ha.d/resource.d/drbddisk r0 stop Jun 22 08:44:25 srv3 kernel: [41059.687933] drbd0: role( Primary -> Secondary ) Jun 22 08:44:25 srv3 ResourceManager[7036]: [7356]: debug: /etc/ha.d/resource.d/drbddisk r0 stop done. RC=0 Jun 22 08:44:25 srv3 heartbeat: [7023]: info: local HA resource release completed (standby). Jun 22 08:44:25 srv3 heartbeat: [5246]: info: Local standby process completed [local]. Jun 22 08:44:25 srv3 kernel: [41059.834183] drbd0: peer( Secondary -> Primary ) Jun 22 08:44:26 srv3 kernel: [41060.813752] drbd0: peer( Primary -> Secondary ) Jun 22 08:44:26 srv3 heartbeat: [5246]: WARN: 1 lost packet(s) for [srv4] [27398:27400] Jun 22 08:44:26 srv3 heartbeat: [5246]: info: remote resource transition completed. Jun 22 08:44:26 srv3 heartbeat: [5246]: info: No pkts missing from srv4! Jun 22 08:44:26 srv3 heartbeat: [5246]: info: Other node completed standby takeover of local resources. Jun 22 08:44:57 srv3 heartbeat: [5246]: info: srv4 wants to go standby [foreign] Jun 22 08:45:09 srv3 heartbeat: [5246]: info: standby: acquire [foreign] resources from srv4 Jun 22 08:45:09 srv3 heartbeat: [7357]: info: acquire local HA resources (standby). Jun 22 08:45:09 srv3 ResourceManager[7370]: [7381]: info: Acquiring resource group: srv3 drbddisk::r0 LVM::drbdvg0 Filesystem::/dev/drbdvg0/web::/VSERVERS/web::ext3 Vserver-web SendArp::192.168.1.26/27/eth0 Jun 22 08:45:09 srv3 ResourceManager[7370]: [7409]: info: Running /etc/ha.d/resource.d/drbddisk r0 start Jun 22 08:45:09 srv3 ResourceManager[7370]: [7410]: debug: Starting /etc/ha.d/resource.d/drbddisk r0 start Jun 22 08:45:09 srv3 kernel: [41125.557868] drbd0: role( Secondary -> Primary ) Jun 22 08:45:09 srv3 ResourceManager[7370]: [7414]: debug: /etc/ha.d/resource.d/drbddisk r0 start done. RC=0 Jun 22 08:45:09 srv3 LVM[7437]: [7450]: INFO: LVM Volume drbdvg0 is offline Jun 22 08:45:09 srv3 LVM[7426]: [7451]: INFO: Resource is stopped Jun 22 08:45:09 srv3 ResourceManager[7370]: [7465]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 start Jun 22 08:45:09 srv3 ResourceManager[7370]: [7466]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 start Jun 22 08:45:09 srv3 LVM[7478]: [7489]: INFO: Activating volume group drbdvg0 Jun 22 08:45:09 srv3 LVM[7478]: [7493]: INFO: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Reading all physical volumes. This may take a while... Found volume group "drbdvg0" using metadata type lvm2 Jun 22 08:45:09 srv3 LVM[7478]: [7501]: INFO: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open 1 logical volume(s) in volume group "drbdvg0" now active Jun 22 08:45:09 srv3 LVM[7467]: [7504]: INFO: Success Jun 22 08:45:09 srv3 ResourceManager[7370]: [7505]: debug: /etc/ha.d/resource.d/LVM drbdvg0 start done. RC=0 Jun 22 08:45:09 srv3 Filesystem[7517]: [7561]: INFO: Resource is stopped Jun 22 08:45:09 srv3 ResourceManager[7370]: [7575]: info: Running /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 start Jun 22 08:45:09 srv3 ResourceManager[7370]: [7576]: debug: Starting /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 start Jun 22 08:45:09 srv3 Filesystem[7588]: [7618]: INFO: Running start for /dev/drbdvg0/web on /VSERVERS/web Jun 22 08:45:09 srv3 kernel: [41126.033549] kjournald starting. Commit interval 5 seconds Jun 22 08:45:09 srv3 kernel: [41126.033549] EXT3 FS on dm-0, internal journal Jun 22 08:45:09 srv3 kernel: [41126.033549] EXT3-fs: mounted filesystem with ordered data mode. Jun 22 08:45:09 srv3 Filesystem[7577]: [7632]: INFO: Success Jun 22 08:45:09 srv3 ResourceManager[7370]: [7633]: debug: /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 start done. RC=0 Jun 22 08:45:09 srv3 ResourceManager[7370]: [7652]: info: Running /etc/ha.d/resource.d/Vserver-web start Jun 22 08:45:09 srv3 ResourceManager[7370]: [7653]: debug: Starting /etc/ha.d/resource.d/Vserver-web start Jun 22 08:45:09 srv3 kernel: [41126.167044] Not cloning cgroup for unused subsystem ns Jun 22 08:45:10 srv3 kernel: [41126.381150] Not cloning cgroup for unused subsystem ns Jun 22 08:45:10 srv3 SendArp[7796]: [7802]: DEBUG: /usr/lib/heartbeat/send_arp -i 200 -r 5 -p /var/run/heartbeat/rsctmp/send_arp/send_arp-192.168.1.26 27/eth0 192.168.1.26 auto 192.168.1.26 ffffffffffff Jun 22 08:45:10 srv3 SendArp[7779]: [7805]: INFO: Success Jun 22 08:45:10 srv3 send_arp: [7804]: ERROR: libnet_init failure on 27/eth0: libnet_select_device(): can't find interface for IP 27/eth0 Jun 22 08:45:10 srv3 SendArp[7796]: [7807]: ERROR: Could not send gratuitous arps Jun 22 08:45:10 srv3 ResourceManager[7370]: [7808]: debug: /etc/ha.d/resource.d/Vserver-web start done. RC=0 Jun 22 08:45:10 srv3 SendArp[7820]: [7843]: INFO: Running OK Jun 22 08:45:10 srv3 heartbeat: [7357]: info: local HA resource acquisition completed (standby). Jun 22 08:45:10 srv3 heartbeat: [5246]: info: Standby resource acquisition done [foreign]. Jun 22 08:45:10 srv3 heartbeat: [5246]: info: remote resource transition completed. srv4 secondary syslog HTML: Jun 22 08:44:23 srv4 heartbeat: [14513]: info: srv3 wants to go standby [local] Jun 22 08:44:26 srv4 kernel: [44951.060246] drbd0: peer( Primary -> Secondary ) Jun 22 08:44:26 srv4 heartbeat: [14513]: info: standby: acquire [local] resources from srv3 Jun 22 08:44:26 srv4 heartbeat: [17849]: info: acquire foreign HA resources (standby). Jun 22 08:44:26 srv4 ResourceManager[17862]: [17873]: info: Acquiring resource group: srv3 drbddisk::r0 LVM::drbdvg0 Filesystem::/dev/drbdvg0/web::/VSERVERS/web::ext3 Vserver-web SendArp::192.168.1.26/27/eth0 Jun 22 08:44:26 srv4 ResourceManager[17862]: [17901]: info: Running /etc/ha.d/resource.d/drbddisk r0 start Jun 22 08:44:26 srv4 ResourceManager[17862]: [17902]: debug: Starting /etc/ha.d/resource.d/drbddisk r0 start Jun 22 08:44:26 srv4 kernel: [44951.680569] drbd0: role( Secondary -> Primary ) Jun 22 08:44:26 srv4 ResourceManager[17862]: [17906]: debug: /etc/ha.d/resource.d/drbddisk r0 start done. RC=0 Jun 22 08:44:26 srv4 LVM[17929]: [17942]: INFO: LVM Volume drbdvg0 is offline Jun 22 08:44:26 srv4 LVM[17918]: [17943]: INFO: Resource is stopped Jun 22 08:44:26 srv4 ResourceManager[17862]: [17957]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 start Jun 22 08:44:26 srv4 ResourceManager[17862]: [17958]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 start Jun 22 08:44:26 srv4 LVM[17970]: [17981]: INFO: Activating volume group drbdvg0 Jun 22 08:44:26 srv4 LVM[17970]: [17985]: INFO: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Reading all physical volumes. This may take a while... Found volume group "drbdvg0" using metadata type lvm2 Jun 22 08:44:26 srv4 LVM[17970]: [17994]: INFO: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open 1 logical volume(s) in volume group "drbdvg0" now active Jun 22 08:44:26 srv4 LVM[17959]: [18000]: INFO: Success Jun 22 08:44:26 srv4 ResourceManager[17862]: [18001]: debug: /etc/ha.d/resource.d/LVM drbdvg0 start done. RC=0 Jun 22 08:44:26 srv4 Filesystem[18013]: [18057]: INFO: Resource is stopped Jun 22 08:44:26 srv4 ResourceManager[17862]: [18071]: info: Running /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 start Jun 22 08:44:26 srv4 ResourceManager[17862]: [18072]: debug: Starting /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 start Jun 22 08:44:26 srv4 Filesystem[18084]: [18114]: INFO: Running start for /dev/drbdvg0/web on /VSERVERS/web Jun 22 08:44:26 srv4 Filesystem[18084]: [18121]: ERROR: Couldn't find directory [/VSERVERS/web] to use as a mount point Jun 22 08:44:26 srv4 Filesystem[18073]: [18122]: ERROR: Illegal argument Jun 22 08:44:26 srv4 ResourceManager[17862]: [18123]: debug: /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 start done. RC=2 Jun 22 08:44:26 srv4 ResourceManager[17862]: [18124]: ERROR: Return code 2 from /etc/ha.d/resource.d/Filesystem Jun 22 08:44:26 srv4 ResourceManager[17862]: [18125]: CRIT: Giving up resources due to failure of Filesystem::/dev/drbdvg0/web::/VSERVERS/web::ext3 Jun 22 08:44:26 srv4 ResourceManager[17862]: [18126]: info: Releasing resource group: srv3 drbddisk::r0 LVM::drbdvg0 Filesystem::/dev/drbdvg0/web::/VSERVERS/web::ext3 Vserver-web SendArp::192.168.1.26/27/eth0 Jun 22 08:44:26 srv4 ResourceManager[17862]: [18141]: info: Running /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop Jun 22 08:44:26 srv4 ResourceManager[17862]: [18142]: debug: Starting /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop Jun 22 08:44:26 srv4 SendArp[18160]: [18166]: INFO: SendArp for 192.168.1.26/27/eth0 released Jun 22 08:44:26 srv4 SendArp[18143]: [18167]: INFO: Success Jun 22 08:44:26 srv4 ResourceManager[17862]: [18168]: debug: /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop done. RC=0 Jun 22 08:44:26 srv4 ResourceManager[17862]: [18177]: info: Running /etc/ha.d/resource.d/Vserver-web stop Jun 22 08:44:26 srv4 ResourceManager[17862]: [18178]: debug: Starting /etc/ha.d/resource.d/Vserver-web stop Jun 22 08:44:26 srv4 ResourceManager[17862]: [18182]: debug: /etc/ha.d/resource.d/Vserver-web stop done. RC=0 Jun 22 08:44:26 srv4 ResourceManager[17862]: [18196]: info: Running /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop Jun 22 08:44:26 srv4 ResourceManager[17862]: [18197]: debug: Starting /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop Jun 22 08:44:26 srv4 Filesystem[18209]: [18239]: INFO: Running stop for /dev/drbdvg0/web on /VSERVERS/web Jun 22 08:44:27 srv4 Filesystem[18198]: [18248]: INFO: Success Jun 22 08:44:27 srv4 ResourceManager[17862]: [18249]: debug: /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop done. RC=0 Jun 22 08:44:27 srv4 ResourceManager[17862]: [18263]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:44:27 srv4 ResourceManager[17862]: [18264]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:44:27 srv4 LVM[18276]: [18287]: INFO: Deactivating volume group drbdvg0 Jun 22 08:44:27 srv4 LVM[18276]: [18293]: INFO: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open 0 logical volume(s) in volume group "drbdvg0" now active Jun 22 08:44:27 srv4 LVM[18265]: [18296]: INFO: Success Jun 22 08:44:27 srv4 ResourceManager[17862]: [18297]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=0 Jun 22 08:44:27 srv4 ResourceManager[17862]: [18311]: info: Running /etc/ha.d/resource.d/drbddisk r0 stop Jun 22 08:44:27 srv4 ResourceManager[17862]: [18312]: debug: Starting /etc/ha.d/resource.d/drbddisk r0 stop Jun 22 08:44:27 srv4 kernel: [44952.696035] drbd0: role( Primary -> Secondary ) Jun 22 08:44:27 srv4 ResourceManager[17862]: [18319]: debug: /etc/ha.d/resource.d/drbddisk r0 stop done. RC=0 Jun 22 08:44:27 srv4 heartbeat: [17849]: info: foreign HA resource acquisition completed (standby). Jun 22 08:44:27 srv4 heartbeat: [14513]: info: Standby resource acquisition done [local]. Jun 22 08:44:27 srv4 heartbeat: [14513]: info: remote resource transition completed. Jun 22 08:44:57 srv4 hb_standby[18356]: [18362]: Going standby [foreign]. Jun 22 08:44:57 srv4 heartbeat: [14513]: info: srv4 wants to go standby [foreign] Jun 22 08:44:57 srv4 heartbeat: [14513]: info: standby: srv3 can take our foreign resources Jun 22 08:44:57 srv4 heartbeat: [18366]: info: give up foreign HA resources (standby). Jun 22 08:44:57 srv4 ResourceManager[18379]: [18390]: info: Releasing resource group: srv3 drbddisk::r0 LVM::drbdvg0 Filesystem::/dev/drbdvg0/web::/VSERVERS/web::ext3 Vserver-web SendArp::192.168.1.26/27/eth0 Jun 22 08:44:57 srv4 ResourceManager[18379]: [18405]: info: Running /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop Jun 22 08:44:57 srv4 ResourceManager[18379]: [18406]: debug: Starting /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop Jun 22 08:44:57 srv4 SendArp[18424]: [18430]: INFO: SendArp for 192.168.1.26/27/eth0 released Jun 22 08:44:57 srv4 SendArp[18407]: [18431]: INFO: Success Jun 22 08:44:57 srv4 ResourceManager[18379]: [18432]: debug: /etc/ha.d/resource.d/SendArp 192.168.1.26/27/eth0 stop done. RC=0 Jun 22 08:44:57 srv4 ResourceManager[18379]: [18441]: info: Running /etc/ha.d/resource.d/Vserver-web stop Jun 22 08:44:57 srv4 ResourceManager[18379]: [18442]: debug: Starting /etc/ha.d/resource.d/Vserver-web stop Jun 22 08:44:57 srv4 ResourceManager[18379]: [18446]: debug: /etc/ha.d/resource.d/Vserver-web stop done. RC=0 Jun 22 08:44:57 srv4 ResourceManager[18379]: [18460]: info: Running /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop Jun 22 08:44:57 srv4 ResourceManager[18379]: [18461]: debug: Starting /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop Jun 22 08:44:57 srv4 Filesystem[18473]: [18480]: WARNING: Couldn't find device [/dev/drbdvg0/web]. Expected /dev/??? to exist Jun 22 08:44:58 srv4 Filesystem[18473]: [18504]: INFO: Running stop for /dev/drbdvg0/web on /VSERVERS/web Jun 22 08:44:58 srv4 Filesystem[18462]: [18513]: INFO: Success Jun 22 08:44:58 srv4 ResourceManager[18379]: [18514]: debug: /etc/ha.d/resource.d/Filesystem /dev/drbdvg0/web /VSERVERS/web ext3 stop done. RC=0 Jun 22 08:44:58 srv4 ResourceManager[18379]: [18528]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:44:58 srv4 ResourceManager[18379]: [18529]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:44:58 srv4 LVM[18541]: [18552]: INFO: Deactivating volume group drbdvg0 Jun 22 08:44:58 srv4 LVM[18541]: [18556]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open /dev/drbd0: open failed: Wrong medium type Volume group "drbdvg0" not found Jun 22 08:44:58 srv4 LVM[18530]: [18557]: ERROR: Generic error Jun 22 08:44:58 srv4 ResourceManager[18379]: [18558]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:44:58 srv4 ResourceManager[18379]: [18559]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:44:59 srv4 ResourceManager[18379]: [18562]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:44:59 srv4 ResourceManager[18379]: [18576]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:44:59 srv4 ResourceManager[18379]: [18577]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:44:59 srv4 LVM[18589]: [18600]: INFO: Deactivating volume group drbdvg0 Jun 22 08:44:59 srv4 LVM[18589]: [18604]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:44:59 srv4 LVM[18578]: [18605]: ERROR: Generic error Jun 22 08:44:59 srv4 ResourceManager[18379]: [18606]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:44:59 srv4 ResourceManager[18379]: [18607]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:00 srv4 ResourceManager[18379]: [18610]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:00 srv4 ResourceManager[18379]: [18624]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:00 srv4 ResourceManager[18379]: [18625]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:00 srv4 LVM[18637]: [18648]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:00 srv4 LVM[18637]: [18652]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:00 srv4 LVM[18626]: [18653]: ERROR: Generic error Jun 22 08:45:00 srv4 ResourceManager[18379]: [18654]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:00 srv4 ResourceManager[18379]: [18655]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:01 srv4 ResourceManager[18379]: [18658]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:01 srv4 ResourceManager[18379]: [18672]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:01 srv4 ResourceManager[18379]: [18673]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:01 srv4 LVM[18685]: [18696]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:01 srv4 LVM[18685]: [18700]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:01 srv4 LVM[18674]: [18701]: ERROR: Generic error Jun 22 08:45:01 srv4 ResourceManager[18379]: [18702]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:01 srv4 ResourceManager[18379]: [18703]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:02 srv4 ResourceManager[18379]: [18706]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:02 srv4 ResourceManager[18379]: [18720]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:02 srv4 ResourceManager[18379]: [18721]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:02 srv4 LVM[18733]: [18744]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:02 srv4 LVM[18733]: [18748]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:02 srv4 LVM[18722]: [18749]: ERROR: Generic error Jun 22 08:45:02 srv4 ResourceManager[18379]: [18750]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:02 srv4 ResourceManager[18379]: [18751]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:03 srv4 ResourceManager[18379]: [18754]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:03 srv4 ResourceManager[18379]: [18768]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:03 srv4 ResourceManager[18379]: [18769]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:03 srv4 LVM[18781]: [18792]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:03 srv4 LVM[18781]: [18796]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:03 srv4 LVM[18770]: [18797]: ERROR: Generic error Jun 22 08:45:03 srv4 ResourceManager[18379]: [18798]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:03 srv4 ResourceManager[18379]: [18799]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:04 srv4 ResourceManager[18379]: [18802]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:04 srv4 ResourceManager[18379]: [18816]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:04 srv4 ResourceManager[18379]: [18817]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:04 srv4 LVM[18829]: [18840]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:04 srv4 LVM[18829]: [18844]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:04 srv4 LVM[18818]: [18845]: ERROR: Generic error Jun 22 08:45:04 srv4 ResourceManager[18379]: [18846]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:04 srv4 ResourceManager[18379]: [18847]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:05 srv4 ResourceManager[18379]: [18850]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:05 srv4 ResourceManager[18379]: [18864]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:05 srv4 ResourceManager[18379]: [18865]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:05 srv4 LVM[18877]: [18888]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:05 srv4 LVM[18877]: [18892]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:05 srv4 LVM[18866]: [18893]: ERROR: Generic error Jun 22 08:45:05 srv4 ResourceManager[18379]: [18894]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:05 srv4 ResourceManager[18379]: [18895]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:06 srv4 ResourceManager[18379]: [18898]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:06 srv4 ResourceManager[18379]: [18912]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:06 srv4 ResourceManager[18379]: [18913]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:07 srv4 LVM[18925]: [18936]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:07 srv4 LVM[18925]: [18940]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:07 srv4 LVM[18914]: [18941]: ERROR: Generic error Jun 22 08:45:07 srv4 ResourceManager[18379]: [18942]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:07 srv4 ResourceManager[18379]: [18943]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:08 srv4 ResourceManager[18379]: [18946]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:08 srv4 ResourceManager[18379]: [18960]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:08 srv4 ResourceManager[18379]: [18961]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:08 srv4 LVM[18973]: [18984]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:08 srv4 LVM[18973]: [18988]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:08 srv4 LVM[18962]: [18989]: ERROR: Generic error Jun 22 08:45:08 srv4 ResourceManager[18379]: [18990]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:08 srv4 ResourceManager[18379]: [18991]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:09 srv4 ResourceManager[18379]: [18994]: info: Retrying failed stop operation [LVM::drbdvg0] Jun 22 08:45:09 srv4 ResourceManager[18379]: [19008]: info: Running /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:09 srv4 ResourceManager[18379]: [19009]: debug: Starting /etc/ha.d/resource.d/LVM drbdvg0 stop Jun 22 08:45:09 srv4 LVM[19021]: [19032]: INFO: Deactivating volume group drbdvg0 Jun 22 08:45:09 srv4 LVM[19021]: [19036]: ERROR: File descriptor 3 left open File descriptor 4 left open File descriptor 5 left open File descriptor 6 left open File descriptor 7 left open File descriptor 8 left open File descriptor 9 left open File descriptor 10 left open File descriptor 11 left open File descriptor 12 left open File descriptor 14 left open Volume group "drbdvg0" not found Jun 22 08:45:09 srv4 LVM[19010]: [19037]: ERROR: Generic error Jun 22 08:45:09 srv4 ResourceManager[18379]: [19038]: debug: /etc/ha.d/resource.d/LVM drbdvg0 stop done. RC=1 Jun 22 08:45:09 srv4 ResourceManager[18379]: [19039]: ERROR: Return code 1 from /etc/ha.d/resource.d/LVM Jun 22 08:45:09 srv4 LVM[19062]: [19075]: INFO: LVM Volume drbdvg0 is offline Jun 22 08:45:09 srv4 LVM[19051]: [19076]: INFO: Resource is stopped Jun 22 08:45:09 srv4 ResourceManager[18379]: [19077]: ERROR: Resource script for LVM::drbdvg0 probably not LSB-compliant. Jun 22 08:45:09 srv4 ResourceManager[18379]: [19078]: WARN: it (LVM::drbdvg0) MUST succeed on a stop when already stopped Jun 22 08:45:09 srv4 ResourceManager[18379]: [19079]: WARN: Machine reboot narrowly avoided! Jun 22 08:45:09 srv4 ResourceManager[18379]: [19093]: info: Running /etc/ha.d/resource.d/drbddisk r0 stop Jun 22 08:45:09 srv4 ResourceManager[18379]: [19094]: debug: Starting /etc/ha.d/resource.d/drbddisk r0 stop Jun 22 08:45:09 srv4 ResourceManager[18379]: [19101]: debug: /etc/ha.d/resource.d/drbddisk r0 stop done. RC=0 Jun 22 08:45:09 srv4 heartbeat: [18366]: info: foreign HA resource release completed (standby). Jun 22 08:45:09 srv4 heartbeat: [14513]: info: Local standby process completed [foreign]. Jun 22 08:45:09 srv4 kernel: [45008.138381] drbd0: peer( Secondary -> Primary ) Jun 22 08:45:11 srv4 heartbeat: [14513]: WARN: 1 lost packet(s) for [srv3] [27407:27409] Jun 22 08:45:11 srv4 heartbeat: [14513]: info: remote resource transition completed. Jun 22 08:45:11 srv4 heartbeat: [14513]: info: No pkts missing from srv3! Jun 22 08:45:11 srv4 heartbeat: [14513]: info: Other node completed standby takeover of foreign resources. before migration its Primary/secondary an srv3 and after this also. the vserver is running again on srv3 after failed migration.