I've tested a few of these hostnames, and none has an A record. I think that is the problem - Postfix tries to look them up and doesn't find them.
Thanks Falko Just so I'm clear, it is the destinationdomains that don't have a records yes not my own domain mail boxes. ?
Thanks Fail to ban was also working over time, banning and unbanning ip s for ssh and other services all the time so I'm not sure what was going on, maybe the server was being attacked? I also use monit and munin to monitor the server and services where failing and restarting several times a day. Anyway, I have disabled ssh port forwarding to the server and since then had no problems what so ever. Mail warning log is all clear, fail to ban has calmed down and monit has reported no problems. Thanks for your help.