rsync incremental snapshot backups

gabrix · Dec 9, 2006

I followed your incremental snapshot backups.Nearly everything ok apart from some errors i wanted you to look at .
1 error message:

/backup/backup.sh: line 2: -localhost: No such file or directory
/usr/bin/mysqldump: Got error: 1049: Unknown database 'Database' when selecting the database
Click to expand...

The dir i want to backup is /var/www/torgab documentroot of my site and its relative database.The script i'm using is copied and pasted from the one here.
2 error message

rsync error: some files could not be transferred (code 23) at main.c(789)
no support for smartcards.
/bin/touch: cannot touch `12682BACKUPDIR/current': No such file or directory
Click to expand...

And you script has this double $$ , $$BACKUPDIR/current" is this incorrect ???
I corrected something including some others dirs in the esclude list i will wait for next messages and see how things are going.

sjau · Dec 9, 2006

Can you post me the script you have?
Or rather your modifications?

gabrix · Dec 9, 2006

sjau said:

Can you post me the script you have?
Or rather your modifications?
Click to expand...

The script is on this site , modifications are relative to my lan ips and paths mysql user e password.The script is basically the same you see on this site here http://www.howtoforge.org/rsync_incremental_snapshot_backups i have changed the last command

$SSH -i $KEY $BACKUP_USER "$CP -al $BACKUPDIR/current/* $MKDIR"
Click to expand...

where you see $BACKUPDIR/current/ there was a double $$ and that's it.

sjau · Dec 9, 2006

Well, the double $$ is an error, I need to fix that... however I need what you have a script to see where the error lies that you are describing.

gabrix · Dec 9, 2006

This is the last official error message after corrections:

/backup/backup.sh: line 2: -localhost: No such file or directory
/usr/bin/mysqldump: Got error: 1049: Unknown database 'Database' when selecting the database
building file list ... done
deleting var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_d67744f1bde873eb54ce60994b17c325
./
backup/
backup/backup.sh
backup/backup.sh~
backup/backup_exclude
backup/backup_exclude~
mysql_backup/
mysql_backup/Database.sql
mysql_backup/mysql.sql
mysql_backup/test.sql
mysql_backup/tor-final.sql
mysql_backup/tor-onion.sql
var/

sent 468194 bytes received 8462 bytes 56077.18 bytes/sec
total size is 16835570 speedup is 35.32
no support for smartcards.
Click to expand...

This is the script i'm using as you see it doesn't differ much from the one here:

#!/bin/bash
unset PATH
# USER VARIABLES
BACKUPDIR=/backup # Folder on the backup server
KEY=/root/.ssh/id_dsa
MYSQLUSER=xxxxx
MYSQLPWD=yyyyyy
MYSQLHOST=localhost
MYSQLBACKUPDIR=/mysql_backup
BACKUP_USER=xxxxxx@www
EXCLUDES=/backup/backup_exclude # File containing exludes
# PATH VARIABLES
CP=/bin/cp;
MK=/bin/mkdir;
SSH=/usr/bin/ssh;
DATE=/bin/date;
RM=/bin/rm;
GREP=/bin/grep;
MYSQL=/usr/bin/mysql;
MYSQLDUMP=/usr/bin/mysqldump;
RSYNC=/usr/bin/rsync;
TOUCH=/bin/touch;
## ##
## -- DO NOT EDIT BELOW THIS HERE -- ##
## ##
# CREATING CURRENT DATE / TIME
NOW=`$DATE '+%Y-%m'-%d_%H:%M`
MKDIR=$BACKUPDIR/$NOW/
# CREATE MYSQL BACKUP
# Remove existing backup dir
$RM -Rf $MYSQLBACKUPDIR
# Create new backup dir
$MK $MYSQLBACKUPDIR
#Dump new files
for i in $(echo 'SHOW DATABASES;' | $MYSQL -u$MYSQLUSER -p$MYSQLPWD
-$MYSQLHOST|$GREP -v '^Database$'); do
$MYSQLDUMP \
-u$MYSQLUSER -p$MYSQLPWD -h$MYSQLHOST \
-Q -c -C --add-drop-table --add-locks --quick --lock-tables \
$i > $MYSQLBACKUPDIR/$i.sql;
done;
# CREATE NEW BACKUPDIR
$SSH -i $KEY $BACKUP_USER "$MK $MKDIR"
# RUN RSYNC INTO CURRENT
$RSYNC \
-apvz --delete --delete-excluded \
--exclude-from="$EXCLUDES" \
-e "$SSH -i $KEY" \
/ $BACKUP_USER:/$BACKUPDIR/current ;
# UPDATE THE MTIME TO REFELCT THE SNAPSHOT TIME
$SSH -I $KEY $BACKUP_USER "$TOUCH $BACKUPDIR/current"
# MAKE HARDLINK COPY
$SSH -i $KEY $BACKUP_USER "$CP -al $BACKUPDIR/current/* $MKDIR"
Click to expand...

sjau · Dec 9, 2006

what's in your backup_exclude file?

gabrix · Dec 10, 2006

esclude dir list:

/bin/
/boot/
/dev/
/etc/
/home/
/lib/
/lost+found/
/media/
/mnt/
/opt/
/proc/
/root/
/sbin/
/srv/
/sys/
/tmp/
/usr/
/var/backups/
/var/cache/
/var/lib/
/var/local/
/var/lock/
/var/lost+found/
/var/mail/
/var/opt/
/var/run/
/var/log/
/var/spool/
/var/tmp/
/var/lib/php4/
/var/lib/mysql/
/var/ossec
/NFS
Click to expand...

Last error messages:

/backup/backup.sh: line 2: -localhost: No such file or directory
/usr/bin/mysqldump: Got error: 1049: Unknown database 'Database' when selecting the database
building file list ... done
Click to expand...

This is fine i think it is just relative to a default database ... i think!But the message continues:

./
mysql_backup/
mysql_backup/Database.sql
mysql_backup/mysql.sql
mysql_backup/test.sql
mysql_backup/tor-final.sql
mysql_backup/tor-onion.sql
var/www/torgab/cache/
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_1564112e05a3c5d9d96ec38529658052
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_199acb87f60fafc694a19f7267e685af
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_2417bf3846650656d160848c3de73c07
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_2457334b7810696f519c949ac4052c26
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_261d1cbd472067bfd6a5aed9641607c4
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_3f63dae5fa6ab5a80e6eedffe6b60608
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_470fd8071ccb77c1ba909801d4a2c48d
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_514561b6f0fee94f6a616b8d26ef1bbe
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_5253285a1b5e1944d80f51e64967e54c
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_5dcd4f10f511b30d0a62b4890c737256
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_5e53b818ef6600446c864c42376db053
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_5f569ab862c711112a65f1f56c6289b6
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_68777f4bf27c7c9ff2c3e93cb6e6b041
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_6b35a744fd73826088873344ac8080a7
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_6f4c295ee7f6e1f3c2cb900903495536
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_7c273fb83057c7b53866c10b8b7b9538
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_81b8f668c4f6515dd62eeb4495029fe0
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_8292c094b7dbe16b29659eb2fd07397a
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_856a929277ee107537ab95f0d36bf850
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_8f699a8ced6609779f3bb51ed1c516a3
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_95931b4cf84fff28696fe6e2f9cea5de
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_9b9542c4d82832e5ea852eb542b12135
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_a3fc996e726e90bdd69cb46520e146b7
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_a6602f9172a36a6980d74d4ed8d354a0
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_b3cfa6c0c6b4fc4c776e6c438beb0d55
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_b665b0365de0a34f49f792fd996cf5df
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_b9ee24c4000ceed09b9b83fb0cbfd527
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_bb4e28bc5adb92caabb5f23c6371cf4c
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_c871fa09019c8321bb033abc624b1b4b
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_d826f17eac082825c3a07fe85c9b45d4
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_db37c32731dba66cb99c24a455e95f20
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_dba4df1e302e075943c9884a4bba9839
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_de78affdc225806d708701f9ad8d824e
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_e2a0feb7818d84f63c7af528cdadb388
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_e39d80a489910ebed4b74aa0837a3e23
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_e54469a5510146e973b3c0f3614cba03
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_e615554d583dc5577a3e86ab6975f821
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_e6f2f5780cae75e92f21ebaae69f8b9e
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_e7a82d4bb1ed63aaed35b9358148d8cf
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_f25af5d0a6e6813601aaedd03a9c6306
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_fc1188680173cfd74a56ed14f2fa69f0

sent 106536 bytes received 4272 bytes 44323.20 bytes/sec
total size is 16873488 speedup is 152.28
no support for smartcards.
Click to expand...

And i don't see anything to worry about .... great tutorial anyway !!!

sjau · Dec 10, 2006

MYSQL is installed as you have backups of other sql-dbs...
This is an interesting entry... can you check whether you have a folder "Database" in your mysql folder?

And I think you should add
/backup/
also to the exlude file

gabrix · Dec 11, 2006

The backup script stopped working i get this erro now ...

/backup/backup.sh: line 2: -localhost: No such file or directory
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
building file list ... done
./
backup/
backup/backup.sh
backup/backup.sh~
mysql_backup/
mysql_backup/Database.sql
mysql_backup/mysql.sql
mysql_backup/test.sql
mysql_backup/tor-final.sql
mysql_backup/tor-onion.sql
var/www/torgab/cache/
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_09dd40aebdf73234a793ef10f446207c
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_5606c17b001b8023d35f97acbbe1d0a6
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_5685f11bfc865574bb4ce76818f01643
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_72bd4188da41ac60d92296eed2ef2c62
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_7c273fb83057c7b53866c10b8b7b9538
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_7d49c3bd946c80583933661be3ebdd23
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_8cf353e8bcae4bc2114654198ad6652b
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_8d1c19102f5e7397e001e4a836220fd2
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_94cbfbc785bae17898ab89c086fc323e
var/www/torgab/cache/cache_94afbfb2f291e0bf253fcf222e9d238e_e6405e44bf638694b515d4da833cdaeb

sent 95612 bytes received 3646 bytes 39703.20 bytes/sec
total size is 16483462 speedup is 166.07
no support for smartcards.
Click to expand...

I haven't changed passwords in mysql or anything,i don't have Database,actually i have nothing backed up !!!

sjau · Dec 11, 2006

Well, the mysql-root account should have a password...
If you don't use MySQL at all then eliminate the following lines:

# Create new backup dir
$MK $MYSQLBACKUPDIR
#Dump new files
for i in $(echo 'SHOW DATABASES;' | $MYSQL -u$MYSQLUSER -p$MYSQLPWD
-$MYSQLHOST|$GREP -v '^Database$'); do
$MYSQLDUMP \
-u$MYSQLUSER -p$MYSQLPWD -h$MYSQLHOST \
-Q -c -C --add-drop-table --add-locks --quick --lock-tables \
$i > $MYSQLBACKUPDIR/$i.sql;
done;
Click to expand...

Otherwise you must set the root-mysql password...

gabrix · Dec 11, 2006

sjau said:

Well, the mysql-root account should have a password...
If you don't use MySQL at all then eliminate the following lines:

Otherwise you must set the root-mysql password...
Click to expand...

I need to backup mysql databases , and the right password is set in the script,mysqldump stopped working for a password i haven't changed in the backup script and mysql neither.
error:

/backup/backup.sh: line 2: -localhost: No such file or directory
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
Enter password: /usr/bin/mysqldump: Got error: 1045: Access denied for user: 'root@localhost' (Using password: NO) when trying to connect
building file list ... done
./
mysql_backup/
mysql_backup/Database.sql
mysql_backup/mysql.sql
mysql_backup/test.sql
mysql_backup/tor-final.sql
mysql_backup/tor-onion.sql
var/www/webalizer/ctry_usage_200612.png
var/www/webalizer/daily_usage_200612.png
var/www/webalizer/hourly_usage_200612.png
var/www/webalizer/index.html
var/www/webalizer/usage.png
var/www/webalizer/usage_200612.html
var/www/webalizer/webalizer.current
var/www/webalizer/webalizer.hist

sent 100792 bytes received 738 bytes 67686.67 bytes/sec
total size is 16501528 speedup is 162.53
no support for smartcards.
Click to expand...

This what has been backedup:

root@www:~# ls /backup/
2006-12-08_18:00 2006-12-09_12:00 2006-12-10_06:00 2006-12-11_00:00 current
2006-12-09_00:00 2006-12-09_18:00 2006-12-10_12:00 2006-12-11_06:00
2006-12-09_06:00 2006-12-10_00:00 2006-12-10_18:00 2006-12-11_12:00
root@www:~# ls /backup/current/
backup cdrom cifs initrd initrd.img mysql_backup SMBfs var vmlinuz
root@www:~# ls /backup/current/mysql_backup/
Database.sql mysql.sql test.sql tor-final.sql tor-onion.sql
Click to expand...

It looks like the mysqldump got done anyway,what do you think ?
On the server where mysql is i login with the password is in the backup_script

root@mail:~# mysql -u root -p
Enter password:
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 762 to server version: 4.0.24_Debian-10sarge2-log

Type 'help;' or '\h' for help. Type '\c' to clear the buffer.

mysql>
Click to expand...

gabrix · Dec 11, 2006

I think i got over this password problem i need your help here ...

-u$MYSQLUSER -p$MYSQLPWD -h$MYSQLHOST
Click to expand...

..i gave a space between the $ and the variable value above ... it has to be with no space , right ????
Now i willl wait for next messages and see if i'm ight ...

gabrix · Dec 11, 2006

/backup/backup.sh: line 2: -localhost: No such file or directory
/usr/bin/mysqldump: Got error: 1049: Unknown database 'Database' when selecting the database
building file list ... done
Click to expand...

It still says of a error on line2 of database 'Database' i don't have:

mysql> show databases;
+-----------+
| Database |
+-----------+
| mysql |
| test |
| tor-final |
| tor-onion |
+-----------+
4 rows in set (0.03 sec)
Click to expand...

It's not affecting the overall procedure

root@mail:~# ls /mysql_backup/
Database.sql mysql.sql test.sql tor-final.sql tor-onion.sql
Click to expand...

... old on !!!It sees the top writing Database and is backing up that too !!!It's a guess!

sjau · Dec 11, 2006

The line needs to be like this (you have a line break in there):
Code:
for i in $(echo 'SHOW DATABASES;' | $MYSQL -u$MYSQLUSER -p$MYSQLPWD -h$MYSQLHOST|$GREP -v '^Database$'); do

Log in or Sign up

rsync incremental snapshot backups

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

gabrix New Member

gabrix New Member

sjau Local Meanie Moderator

Share This Page

Log in or Sign up

rsync incremental snapshot backups

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

sjau Local Meanie Moderator

gabrix New Member

gabrix New Member

gabrix New Member

sjau Local Meanie Moderator

Share This Page

Useful Searches