backup failure....

Discussion in 'Installation/Configuration' started by gilas, Mar 16, 2007.

  1. gilas

    gilas Member

    Hi

    there are two sites active, I tried to backup one of them.

    The problem:

    method: download - the file size of the set is 209 bytes against 33MB.

    On the other hand, using FTP method all seems work correctly.

    What can I do?!?

    Thankx
     
  2. till

    till Super Moderator Staff Member ISPConfig Developer

    Do the backup manually or enable the auto backup function in config.inc.php. The backup function in the controlpanel is not able to backup large sites.
     
  3. gilas

    gilas Member

    backup...

    This sounds strange, because this is the content of my tmp directory:

    drwx------ 2 admispconfig admispconfig 4096 2007-03-16 15:14 0ac2d74b5442415ca5060063c8570f1b
    drwx------ 2 admispconfig admispconfig 4096 2007-03-16 15:11 1ec88d3f4af5d03cd103fa1602c73fae
    -rw-r--r-- 1 admispconfig admispconfig 33212645 2007-03-16 15:11 3fe5293afd681b2efb1854b6cad3f020.zip
    -rw-r--r-- 1 admispconfig admispconfig 33233052 2007-03-16 15:14 8d1a29f420ef471638e96fad23e05f5d.zip
    drwx------ 2 admispconfig admispconfig 4096 2007-03-20 10:21 8db48fad575c93a7317032b0ddcfbdb7
    -rw-r--r-- 1 admispconfig admispconfig 33215468 2007-03-20 10:21 ac43babfbb492c647f8c532c51eaae8c.zip


    as you can see the backup was made correctly, the problem is that I can download the set (i.e. 33215468 (33MB), last line above...).

    I have a quota problem, could be that this is the cause... I'm investigating...
     
  4. gilas

    gilas Member

    Now I modified quota entries but the problem still persists...
     
  5. falko

    falko Super Moderator ISPConfig Developer

    What exactly is the problem?
    What's the output of
    Code:
    df -h
    and
    Code:
    repquota -avug
    ?
     
  6. gilas

    gilas Member

    output

    Hi Falko,
    i suspect you are investigatin in the wrong direction (below the quota outputs).

    The problem infact is that when I try to download a set explorer say me that it is large 209 bytes instead to 33MB. This works successfully in the previous version of ISPConfig...

    In the contrary, when I select FTP backup all is ok and the set is correctly transferred to the remote server.

    thanx anywhere


    df -h:


    /dev/md0 191G 1,1G 181G 1% /
    tmpfs 2,0G 0 2,0G 0% /dev/shm
    /dev/sda1 3,7G 39M 3,5G 2% /boot




    Block limits File limits
    User used soft hard grace used soft hard grace
    ----------------------------------------------------------------------
    root -- 879476 0 0 45623 0 0
    daemon -- 32 0 0 11 0 0
    bin -- 4 0 0 1 0 0
    man -- 668 0 0 22 0 0
    mail -- 4 0 0 1 0 0
    news -- 4 0 0 1 0 0
    www-data -- 48744 0 0 4023 0 0
    nobody -- 4 0 0 1 0 0
    Debian-exim -- 32 0 0 9 0 0
    alex -- 800 0 0 117 0 0
    identd -- 8 0 0 2 0 0
    fetchmail -- 4 0 0 1 0 0
    bind -- 72 0 0 18 0 0
    mysql -- 37916 0 0 1010 0 0
    postfix -- 160 0 0 63 0 0
    ftp -- 4 0 0 1 0 0
    admispconfig -- 122508 0 0 2111 0 0
    web2_franco -- 372 512000 513024 37 0 0
    web1_prova2 -- 43452 102400 103424 3899 0 0
    #500 -- 6068 0 0 556 0 0
    #501 -- 636 0 0 41 0 0
    *** Report for group quotas on device /dev/md0
    Block grace time: 7days; Inode grace time: 7days
    Block limits File limits
    Group used soft hard grace used soft hard grace
    ----------------------------------------------------------------------
    root -- 876848 0 0 40173 0 0
    daemon -- 32 0 0 9 0 0
    bin -- 16 0 0 2 0 0
    adm -- 5036 0 0 66 0 0
    tty -- 24 0 0 703 0 0
    disk -- 0 0 0 4078 0 0
    lp -- 0 0 0 22 0 0
    mail -- 148 0 0 10 0 0
    news -- 4 0 0 4 0 0
    kmem -- 0 0 0 3 0 0
    dialout -- 0 0 0 62 0 0
    cdrom -- 0 0 0 37 0 0
    floppy -- 0 0 0 64 0 0
    tape -- 0 0 0 16 0 0
    audio -- 0 0 0 36 0 0
    dip -- 24 0 0 7 0 0
    www-data -- 33284 0 0 2661 0 0
    src -- 4 0 0 1 0 0
    shadow -- 84 0 0 6 0 0
    utmp -- 200 0 0 6 0 0
    video -- 0 0 0 205 0 0
    sasl -- 16 0 0 2 0 0
    staff -- 1496 0 0 172 0 0
    users -- 648 0 0 98 0 0
    nogroup -- 16 0 0 4 0 0
    crontab -- 40 0 0 3 0 0
    Debian-exim -- 44 0 0 8 0 0
    alex -- 152 0 0 19 0 0
    ssh -- 76 0 0 1 0 0
    bind -- 80 0 0 20 0 0
    mysql -- 34064 0 0 997 0 0
    postfix -- 104 0 0 44 0 0
    postdrop -- 32 0 0 9 0 0
    admispconfig -- 122504 0 0 2109 0 0
    web1 -- 42184 512000 513024 3897 0 0
    web2 -- 17080 512000 513024 1396 0 0
    web5 -- 0 10240 11264 0 0 0
    web6 -- 0 10240 11264 0 0 0
    web8 -- 0 0 0 0 0 0
    web9 -- 0 0 0 0 0 0
    #500 -- 6068 0 0 556 0 0
    #501 -- 636 0 0 41 0 0
     
  7. till

    till Super Moderator Staff Member ISPConfig Developer

    But the ISPConfig code is exact the same then in the previous version, so it might be browser related. Please try another browser liek firefox.
     
  8. gilas

    gilas Member

    another browser

    Just tried, the same.... maybe user/group protection for the access... (?!)
     
  9. falko

    falko Super Moderator ISPConfig Developer

    Did you modify the ISPConfig sources somehow, or do you use the original sources? Any errors in the error log in /root/ispconfig/httpd/log?
     
  10. rlhesson

    rlhesson Guest

    I have the exact same problem with unmodified source. When you goto backup just one site, it dowloads an archive to your computer it claims this archive is the real size (for example mine was 62.1 MB), but when you go to unpack it, it says its corrupted and cannot be opened. When you view the properties on the file, its only like 200kb.

    Error Log

    [Sun Mar 25 11:04:33 2007] [error] [client 82.165.243.51] File does not exist: /home/admispconfig/ispconfig/web/~antigoth/printenv.php
    df: `/var/named/chroot/proc': Permission denied
    df: `/var/named/chroot/proc': Permission denied
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    df: `/var/named/chroot/proc': Permission denied
    df: `/var/named/chroot/proc': Permission denied
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    df: `/var/named/chroot/proc': Permission denied
    df: `/var/named/chroot/proc': Permission denied
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    df: `/var/named/chroot/proc': Permission denied
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: web2_rlhesson/.forward
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: web2_rlhesson/.forward
     
    Last edited by a moderator: Mar 25, 2007
  11. gilas

    gilas Member

    seems to be a zip failure....

    This is the error_log from /root/ispconfig (....)


    zip warning: Permission denied
    zip warning: could not open for reading: error/.no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: error/.no_delete
    zip warning: Permission denied
    zip warning: could not open for reading: .no_delete

    safe mode is off...

    fiiles remaining in the temp dir and now I must to deleted them manually, the risk is to fill the HD with save sets!

    thanx
     
  12. PoleCat

    PoleCat New Member

    Heya,

    Searching the forum to see if anyone had the same problems as me, I stumbled apon this thread. It seems like I have the EXACT same problem.

    The backups wont take, it backs up about 17M of Data, but when my browser downloads it, I get 4K only.

    #ls -alh /tmp/ | grep ispconfig
    Code:
    -rw-r--r--   1 root          root          17M Feb 22 15:15 home_admispconfig_02_22_2007__15_49_12.tar.gz
    -rw-r--r--   1 root          root          17M Feb 22 15:15 root_ispconfig_02_22_2007__15_49_12.tar.gz
    
    #cat /root/ispconfig/httpd/logs/error_log
    Code:
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
            zip warning: name not matched: *
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
            zip warning: name not matched: *
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/aaf.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/Kevin-army-18yrs.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/Vincent-Crest.JPG
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/dad in airforce.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/grandparents wedding day.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/gran as young woman.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/Mother.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/Grandad.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/My Ouma.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/jeanette cover.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/Gwethalyn.jpg
    zip warning: Permission denied
            zip warning: could not open for reading: tree/media/Willyn Munsey.jpg
            zip warning: name not matched: *
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
            zip warning: name not matched: *
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
            zip warning: name not matched: *
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
            zip warning: name not matched: *
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    zip warning: Permission denied
            zip warning: could not open for reading: error/.no_delete
            zip warning: name not matched: *
    zip warning: Permission denied
            zip warning: could not open for reading: .no_delete
    spirit:~/ispconfig/httpd/logs# 
    
    OS: Debian GNU/Linux 3.1
    ISPConfig: 2.2.10

    Any Ideas? The only changes that I have made is doing a upgrade from .9 to .10 seems like since then it stopped working.
     
  13. falko

    falko Super Moderator ISPConfig Developer

    Did you do a chmod on some of these files where it says Permission denied?
     
  14. PoleCat

    PoleCat New Member

    Nope, not on those files. But here is the persmission of one of the files in question:
    Code:
    -rw-------   1 www-data www-data   51962 Mar  8 17:20 Mother.jpg
    
    As what user does ISPconfig backup run? Should it not run as root to overcome permission errors?

    Those files were uploaded through the phpgedcom genealogy framework. So the website has set those permissions itself.

    A auto-backup feature for ISPconfig to backup all the sites as a admin function to a remote ftp server would be pretty cool. Say you can schedule it once a week or something to do a backup.
    I learned the hard way about backups. You only take it seriously once you lost critical customer information and you lose business because you forgot to do backups. :p
     
  15. gilas

    gilas Member

    backup and common area

    I made some tries; if I select 'mySQL database' all works fine, but when I select too 'web data' backup stops and returns the download window with 209 byte of save set.

    Then I suppose Falkso says the true about the backup. Infact I suspect the problem is connected to a common area where I put the source to share TYPO3. The source is owned/grouped by root:root and it is linked by some symlinks from the single sites.

    Could be that the backup utility follow the links, just arrived in the common area where root is the owner stops it.

    I remember that in the old times there was a similar problems connected to the backup and follow symlinks.
     
  16. till

    till Super Moderator Staff Member ISPConfig Developer

    The backup script runs as user admispconfig and not as root user, thats why it can not backup your files. All files within a website must be owned by the user and group that owns the website, the user admispconfig is member of the group that owns the website too. The backup utility can not run as root for security reasons.
     
  17. PoleCat

    PoleCat New Member

    Heya,

    Thanks, I'm just usign the FTP backup facility now to backup to one of my other servers. It seems to do the job. I'll wait untill the backup functionality has been improved a bit before I use the download data part which is not working for me.

    Thanks for the help. :)
     
  18. Davide

    Davide Member

    It seems that this problem is related to the "memory_limit" entry on /root/ispconfig/php/php.ini

    It will transfer only slightly smaller files than the value of this entry. With "memory_limit = 64 M" (default on 2.2.17), I could correctly download .zip backups up to ~ 63.5M. Any bigger backup would download only ~200 bytes

    Increasing this value, you can download bigger backups. I have tried up to 256M, successfully downloading a 251 MB .zip

    P.S. After changing the value, you *MUST* restart ispconfig_server
     
  19. smartcall

    smartcall ISPConfig Developer ISPConfig Developer

    I have exactly the same problem. Increasing the php memory limit solves it. But there are sites with more than 400 megs of data in my server.
    I don't think that increasing the memory limit that much is a good idea.

    Another solution would be great, but I can't think of one.
     
  20. till

    till Super Moderator Staff Member ISPConfig Developer

    For large sites, you will have to use our own bakup script e.g. based on the tar command as this can not be handles by the ISPConfig script.
     

Share This Page