ISPConfig 3 - back-res a Backup and Restore script

Thanks for pointing this out. The computer variable can be set like this:

Code:

COMPUTER="www.site.com"

The implicit setting for me is:

Code:

COMPUTER=`cat /etc/HOSTNAME | awk 'NR==1{print $1}'`

just because I use mainly Slackware for many servers and the hostname file is /etc/HOSTNAME.
The first version of the script was from a Ubuntu server so it uses /etc/hostname.

Hope this helps!

 

Hello All,

Although the script is working fine, I have some problem backing up few home folders. Some of users' home folders' have '_' in their names. It has been clearly mentioned in the headers of the script that, '...Weird things can happen if your backup dirs includes the "-" or "_" chars.' I cannot change names of these folders now. If possible, please guide me to solve the problem.

Dipesh

 

You have to replace those characters, which are "hardcoded" in the script. Begin reading the code with the line: "#Replace / with _ in dir name => filename" I hope you will understand what's going on. Choose another character to replace "/" and if it's a smarter choice write here so we can update the script to help other people too.

If you need more help write here. I'll read this forum more often these days to help you if you need.

 

No Mail on completion

When the backup runs via cron the code suggests an email is generated and sent to the 'responsible person'. Is it just me or does this not work? The backup runs - there are log file entries and tar files in the right place but no "Success" email. When I ran the code with a trace it looks like that line is never executed?

Using the latest script on 5 Debian ISPConfig3 servers.

 

You have to check your mail command. There are 2 lines in the script which are used to send mail. Just search for "mail -s"
You can test if the mail command works using some test command:

mail -s "Subject" "[email protected]" < "datatext"

 

Not the problem ..

Mail on all servers runs just fine... it has to... they are production servers.

If I run the (modified - variables are substituted) line from a shell, it runs and the mail is sent. It's the back-res script that does not seem to fire the line...

The safe tail of the trace (set -x)


+ echo '2010-05-30 19:12:48 - back-res - Daily backup for /var done.'
+ rm -rf /backup/tmpbck/full-backup_var.lck
+ rm -rf /backup/tmpbck/excluded
+ log 'All backup jobs done. Exiting script!'
++ date '+%Y-%m-%d %H:%M:%S'
+ acum='2010-05-30 19:12:48'
+ '[' -e /backup/server.domain.tld/log/backup.log ']'
++ basename ./back-res
+ echo '2010-05-30 19:12:48 - back-res - All backup jobs done. Exiting script!'
++ basename ./back-res
+ echo '2010-05-30 19:12:48 - back-res - All backup jobs done. Exiting script!'
+ exit 1


As you can see the line is never reached or executed...

 

You are right, the line which sends mail is in the restore part of the script... So mail is send only at restore. My mistake. The backup part does not send mail. I'll correct this as soon as possible. Thanks for pointing this up.

 

Fix ....

change back-res line 356

#Clean temp dir
rm -rf $tmpdir/excluded
# End of script
log "All backup jobs done. Exiting script!"
}

#Clean temp dir
rm -rf $tmpdir/excluded
# End of script
log "All backup jobs done. Exiting script!"
mail -s "Daily backup of $COMPUTER `date +'%F'`" "$email" < $tmpdir/maildata
}

 

hello

can someone tell me how I setup cron job

I want to do this in ISPConfig, and then at night

with kind regards michael

 

cron

You don't say for what OS: Most Linux / Unix boxes will accept the following:

from the shell as root:

Code:

 crontab -e

then copy and paste:

Code:

30 1 * * *  /etc/back-res 1>/dev/null 2>/dev/null

which is

Code:

*     *     *   *    *        command to be executed
-     -     -   -    -
|     |     |   |    |
|     |     |   |    +----- day of week (0 - 6) (Sunday=0)
|     |     |   +------- month (1 - 12)
|     |     +--------- day of        month (1 - 31)
|     +----------- hour (0 - 23)
+------------- min (0 - 59)

So at 30 minutes past 1 every day of the month run back-res sending output and error output to the bit bucket

To run a cronjob for hosted websites there is an option on the control panel -- sites .. cronjobs

 

Interesting Error

Hey g00gl3,

I'm receiving this error with the new version of this script and just wanted to see if it's actually something I should worry about..

Code:

/bin/tar: /adm: Cannot stat: No such file or directory
/bin/tar: Exiting with failure status due to previous errors

It appears as if the backup script is still taking a full backup of the ispconfig information but this error is just making a bit nervous. Is this something that I should be worried about?

 

Hello!

This error appears because you don't have a dir called "/adm" please check the 131 line of the script, variable "DIRECTORIES" and set what you want to back-up.
In your case there is nothing to worry if the other dir's are backed up. tar just can't backup a non-existent file

 

Thank you for help! I'll modify the script for public with this and other small improvements pretty soon.

 

Attention at automated delete of files

I've found that if you move around back-up dir the m-time can change and the script does not work as expected deleting old files, because is using the m-time to find what files to delete when there is no more space.

There is NO problem is you don't touch those files and dirs created by back-res. But if you do be sure the m-time is corectly set.

If you do not have set

Code:

del_en="yes"

you can ignore this message, as the script does NOT free up space for you, if you don't have any.

 

more detail

Ah well there was an interesing exercise. A week after loading and running the script - a small production server collapsed. 64 bit, Debian, ISPConfig3.0.2.1 (web and mail server), it's one of the secondary servers in a multi server set up - which also complicates things no end and alas it does NOT restore... in fact restoring rips the heart right out of the box... leaving me with a very dead box that won't even run a shell... gotta love computers....

Now I have an old compaq rack mount G3 that I was playing with to see what the mirror options of ISPCOnfig3 did (and thats not a great deal it seems ) but - what would it take to get this box loaded whatever I can salvage from the back-res backup?

 

Hello,

you can restore the server if you have all full* files from a month (the most current, the better). Then you need all incremental files, and database dumps. You have a corrupt filesystem? If you do, make a clone of the drive onto another drive then run fsck. That way if the source drive is having bad sectors, you can recover more data.

After recover you must create special dirs (/proc, /sys, /dev, etc) then run grub or lilo to restore the MBR of the drive, after this, if all is ok you sholud have a server like it was on the last incremental day

If you have any problems, post here, I'll try to help you.

 

Thanks!! It works perfect!

 

Hey g00gl3,

Hypothetical scenario that I'd like to get your advice on if you don't mind

Could I take a full backup from one server and using the same script on a different server with ispconfig installed, completely restore everything from the first server? essentially creating an exact copy of the initial?

so Server 1 > run back res

scp files over to Server 2

Server 2 (exact setup as server 1) > run back res restore mode, and essentially have an exact copy?

 

The answer is yes it's possible. Just take care and be sure you have all valuable data backed up before you begin. Try to have all required binaries (tar especially) already installed on the second server.

I've cloned this way servers and it works, the only thing is you must pay attention to any error wich may occur and correct it.

For first try I suggest you use a different partition for the / (root) and instruct your bootloader to dual-boot between de new and old system, this is the safest approach.

Please write here so we can help others too.

 

Currently working on it

Hey g00gl3,


I am in the process currently of testing out this theory, however for now on my prod boxes I'm just using the mysql replication / rsync route. I have two test boxes that I am playing around with the back-res script so I will touch base soon on if I was successful or not

Cheers