Problems with stats

Discussion in 'ISPConfig 3 Priority Support' started by DantePasquale, Jun 5, 2018.

  1. DantePasquale

    DantePasquale Member HowtoForge Supporter

    Hi, I have finally got my internet back working properly and am revisiting setups for a few sites I own.
    I noticed there are no updated stats at all! And I set things up for webalizer but when I view the stats page it shows awstats. Not sure if that is an issue however.
    Where do I begin debugging this issue?
    Thanks!
     
  2. till

    till Super Moderator Staff Member ISPConfig Developer

    First, check if webalizer is installed, e.g. with 'which webalizer'

    Then, check if the crontab lines are there, you need at least these two:

    Code:
    * * * * * /usr/local/ispconfig/server/server.sh 2>&1 | while read line; do echo `/bin/date` "$line" >> /var/log/ispconfig/cron.log; done
    * * * * * /usr/local/ispconfig/server/cron.sh 2>&1 | while read line; do echo `/bin/date` "$line" >> /var/log/ispconfig/cron.log; done
    You can display the content of the root crontab with the command 'crontab -l'.
     
  3. DantePasquale

    DantePasquale Member HowtoForge Supporter

    which webalizer returns /usr/bin/webalizer
    and crontab -l has
    Code:
     
    * * * * * /usr/local/ispconfig/server/server.sh 2>&1 | while read line; do echo `/bin/date` "$line" >> /var/log/ispconfig/cron.log; done
    * * * * * /usr/local/ispconfig/server/cron.sh 2>&1 | while read line; do echo `/bin/date` "$line" >> /var/log/ispconfig/cron.log; done
    
    [CODE]
     
  4. till

    till Super Moderator Staff Member ISPConfig Developer

    Does the access.log file in /var/www/yourdomain.tld/log/access.log contain recent log entries?
     
  5. DantePasquale

    DantePasquale Member HowtoForge Supporter

    just a couple of bots in the last 24 hours
     
  6. till

    till Super Moderator Staff Member ISPConfig Developer

    Ok, it's just important that there is any traffic, not that the bind mount failed so that webalizer can't find any current logs.

    Try to run the cron plugin for website stats manually:

    cd /usr/local/ispconfig/server
    php cron_debug.php --cronjob=150-webalizer.inc.php
     
  7. DantePasquale

    DantePasquale Member HowtoForge Supporter

    should there be a bind mount? The only one I have is for amavis/sa-learn stats
    The output from the above is:
    "Finished"
     
  8. till

    till Super Moderator Staff Member ISPConfig Developer

    Yes, there should be a bind mount. But as you said that you can see the current log lines, the bind mount must be there, otherwise, you won't have any log in the website log folder.
     
  9. DantePasquale

    DantePasquale Member HowtoForge Supporter

    here's what I see in df:
    Code:
    df -h
    Filesystem                  Size  Used Avail Use% Mounted on
    udev                         24G     0   24G   0% /dev
    tmpfs                       4.8G  2.3M  4.8G   1% /run
    /dev/mapper/vg00-lvroot      28G  2.9G   24G  11% /
    /dev/mapper/vg00-lvusr       19G  8.4G  9.0G  49% /usr
    tmpfs                        24G   71M   24G   1% /dev/shm
    tmpfs                       5.0M  8.0K  5.0M   1% /run/lock
    tmpfs                        24G     0   24G   0% /sys/fs/cgroup
    /dev/sdi1                   1.8T  1.6T  173G  91% /media/backup
    /dev/mapper/vg00-lvvar       19G  9.2G  8.2G  53% /var
    /dev/mapper/vg00-lvhome     353G  232G  105G  69% /home
    /dev/sda1                   960M  270M  640M  30% /boot
    /dev/mapper/vg01-lvwww      493G  220G  248G  47% /var/www
    /dev/mapper/vg01-lvvideos   493G   58G  410G  13% /var/Videos
    /dev/mapper/vg01-lvmusic    197G   52G  136G  28% /var/Music
    /dev/mapper/vg01-lvmysql    197G   69G  118G  37% /var/mysql
    /dev/mapper/vg01-lvvmail    739G   22G  682G   4% /var/vmail
    /dev/mapper/vg01-lvbackups  168G  136G   25G  85% /var/backup
    /dev/mapper/vg01-lvphotos   2.0T  765G  1.2T  40% /var/Photos
    cgmfs                       100K     0  100K   0% /run/cgmanager/fs
    tmpfs                       4.8G     0  4.8G   0% /run/user/7
    tmpfs                       4.8G   88K  4.8G   1% /run/user/1002
    tmpfs                       4.8G     0  4.8G   0% /run/user/1001
    bindfs                      739G   22G  682G   4% /var/tmp/amavis
    
    
     
  10. till

    till Super Moderator Staff Member ISPConfig Developer

    Hmm, there should be bind mounts. Please take a look into the /etc/fstab file, are the bind mounts defined there, one for each website? if yes, try running 'mount -a' to activate them again.
     
  11. DantePasquale

    DantePasquale Member HowtoForge Supporter

    Well, there are bind mounts in /etc/fstab -- but something looks off so I didn't run mount -a:

    Code:
    # /dev/mapper/cryptswap1 none swap sw 0 0
    # /var/log/ispconfig/httpd/cocoanet.us /var/www/clients/client1/web1/log    none    bind,nobootwait    0 0
    # /var/log/ispconfig/httpd/dantesinfernophotography.com /var/www/clients/client1/web2/log    none    bind,nobootwait    0 0
    /dev/mapper/vg01-lvbackups    /var/backup     ext4 defaults    0    2
    LABEL=WDMyPassport2tb        /media/backup     ext4 defaults    0    2
    /var/log/ispconfig/httpd/dantesinfernophotography.com /var/www/clients/client2/web2/log none bind,nofail 0 0
    /var/log/ispconfig/httpd/dantesinfernophotography.com /var/www/clients/client2/web4/log    none    bind,nobootwait    0
    
    I see some old ones that are commented out but the new ones don't look correct. Shouldn't there be one entry per website?
     
  12. till

    till Super Moderator Staff Member ISPConfig Developer

    Yes, there should be just one per website. Just remove the duplicate ones with 'nobootwait'. Seems as if there is an issue in the ispconfig apache plugin that did not clean them up correctly.
     
  13. DantePasquale

    DantePasquale Member HowtoForge Supporter

    mount -a doesn't show any errors but there are no bind mounts added.
    here's the fstab now:
    Code:
     
    # /etc/fstab: static file system information.
    #
    # Use 'blkid' to print the universally unique identifier for a
    # device; this may be used with UUID= as a more robust way to name devices
    # that works even if disks are added and removed. See fstab(5).
    #
    # <file system> <mount point>   <type>  <options>       <dump>  <pass>
    proc            /proc           proc    nodev,noexec,nosuid 0       0
    /dev/mapper/vg00-lvroot /               ext4    errors=remount-ro,usrjquota=quota.user,grpjquota=quota.group,jqfmt=vfsv0 0       1
    # /boot was on /dev/sda1 during installation
    UUID=ed8e0db5-14b6-4901-937b-9a42bca940be /boot           ext2    defaults        0       2
    /dev/mapper/vg00-lvhome /home           ext4    defaults        0       2
    /dev/mapper/vg00-lvusr /usr            ext4    defaults        0       2
    /dev/mapper/vg00-lvvar /var            ext4    defaults        0       2
    # /dev/mapper/vg01-lvmusic /var/Music      ext4    defaults        0       2
    UUID=ccdc5913-ab02-42e6-bf5f-9b3d2071f261 /var/Music    ext4    defaults    0 2
    /dev/mapper/vg01-lvphotos /var/Photos     ext4    defaults        0       2
    /dev/mapper/vg01-lvvideos /var/Videos     ext4    defaults        0       2
    /dev/mapper/vg01-lvvmail /var/vmail      ext4    defaults        0       2
    /dev/mapper/vg01-lvwww /var/www        ext4    defaults        0       2
    /dev/mapper/vg01-lvmysql /var/mysql        ext4    defaults        0       2
    /dev/mapper/vg00-lvswap none            swap    sw              0       0
    # /dev/mapper/cryptswap1 none swap sw 0 0
    /dev/mapper/vg01-lvbackups    /var/backup     ext4 defaults    0    2
    LABEL=WDMyPassport2tb        /media/backup     ext4 defaults    0    2
    /var/log/ispconfig/httpd/dantesinfernophotography.com /var/www/clients/client2/web2/log none bind,nofail 0 0
    /var/log/ispconfig/httpd/cocoaet.us /var/www/clients/client1/web1/log none bind,nofail 0 0 
    But trying to mount manually gives me:

    Code:
    bindfs /var/log/ispconfig/httpd/dantesinfernophotography.com /var/www/clients/client2/web2/log
    fuse: mountpoint is not empty
    fuse: if you are sure this is safe, use the 'nonempty' mount option
    Do I need to delete (after backing up) the files under /var/log/ispconfig/httpd/'hosntme'/* ???
     
  14. Taleman

    Taleman Well-Known Member HowtoForge Supporter

    If you have files in the mountpoint, they can not be accessed while mount is on. And just take up disk space uselessly. Move then somewhere else or if they are already copied to where they are supposed to be then delete those files.
     
  15. DantePasquale

    DantePasquale Member HowtoForge Supporter

    finally got around to this and it is now mounting the bindfs properly (haven't rebooted tho)
    But that brings up another question!
    How do I mount the amavis dirs via the /etc/fstab??? Here's the command I use:
    bindfs -r --map=vmail/amavis /var/vmail /var/tmp/amavis
     
  16. DantePasquale

    DantePasquale Member HowtoForge Supporter

    ok, somehow I see stats from 2010, but nothing newer -- tried running the awstats cron jobs manually and found that there was no link for yesterday-access, so I created them and the jobs ran without error, but still not showing new stats. Any ideas???
     
  17. till

    till Super Moderator Staff Member ISPConfig Developer

    amavis dirs are normally not mounted with a bind mount on an ISPConfig server.

    Does the symlink points to the correct log and does that log contain the correct log lines in /var/www/clients/client2/web2/log?
     

Share This Page