Website Harddisk Quote Not Showing Usage Correctly

Discussion in 'ISPConfig 3 Priority Support' started by jhewit, Dec 3, 2013.

  1. jhewit

    jhewit New Member

    I previously submitted this issue, and have verified it is running.

    On the Dashboard it shows website usage at: 526.41MB

    However, a check of the Windows Folder Properties (where files were uploaded from) shows the actual total size of all files uploaded at: 567MB


    *** Report for user quotas on device /dev/sda2
    Block grace time: 7days; Inode grace time: 7days
    Block limits File limits
    User used soft hard grace used soft hard grace
    ----------------------------------------------------------------------
    root -- 1708784 0 0 82781 0 0
    daemon -- 8 0 0 3 0 0
    abrt -- 1036 0 0 44 0 0
    haldaemon -- 8 0 0 2 0 0
    ntp -- 8 0 0 2 0 0
    postfix -- 104 0 0 53 0 0
    apache -- 2268 0 0 168 0 0
    mysql -- 24948 0 0 348 0 0
    dovecot -- 4 0 0 3 0 0
    clam -- 99352 0 0 11 0 0
    amavis -- 1360 0 0 34 0 0
    named -- 7680 0 0 250 0 0
    webalizer -- 16 0 0 4 0 0
    mailman -- 96 0 0 27 0 0
    vmail -- 2368 0 0 386 0 0
    getmail -- 8 0 0 3 0 0
    ispapps -- 24 0 0 7 0 0
    ispconfig -- 54652 0 0 7557 0 0
    web1 -- 538912 0 0 113 0 0
    #1000 -- 2524 0 0 164 0 0

    Statistics:
    Total blocks: 9
    Data blocks: 1
    Entries: 20
    Used average: 20.000000

    *** Report for group quotas on device /dev/sda2
    Block grace time: 7days; Inode grace time: 7days
    Block limits File limits
    Group used soft hard grace used soft hard grace
    ----------------------------------------------------------------------
    root -- 1660952 0 0 80028 0 0
    daemon -- 8 0 0 3 0 0
    tty -- 28 0 0 2 0 0
    mail -- 252 0 0 9 0 0
    man -- 128 0 0 32 0 0
    lock -- 4 0 0 1 0 0
    nobody -- 112 0 0 1 0 0
    dbus -- 52 0 0 1 0 0
    utmp -- 648 0 0 5 0 0
    utempter -- 4 0 0 1 0 0
    abrt -- 24 0 0 4 0 0
    haldaemon -- 8 0 0 2 0 0
    ntp -- 12 0 0 3 0 0
    postdrop -- 400 0 0 4 0 0
    postfix -- 88 0 0 49 0 0
    stapusr -- 160 0 0 1 0 0
    slocate -- 2020 0 0 3 0 0
    apache -- 2344 0 0 177 0 0
    mysql -- 24948 0 0 348 0 0
    dovecot -- 8 0 0 2 0 0
    dovenull -- 4 0 0 1 0 0
    clam -- 99352 0 0 11 0 0
    amavis -- 1360 0 0 34 0 0
    named -- 7728 0 0 262 0 0
    mailman -- 43596 0 0 2727 0 0
    vmail -- 2368 0 0 385 0 0
    ispapps -- 24 0 0 6 0 0
    ispconfig -- 54668 0 0 7560 0 0
    client0 -- 538912 0 0 112 0 0
    #1000 -- 3948 0 0 186 0 0

    Statistics:
    Total blocks: 10
    Data blocks: 2
    Entries: 30
    Used average: 15.000000
     
  2. jhewit

    jhewit New Member

    Also a curiosity question, I know that as of now MYSQL databases are not counted in quota but that feature is requested. But are e-mail accounts and its allocated storage counted against the quota?
     
  3. Croydon

    Croydon ISPConfig Developer ISPConfig Developer

    email quota is handled directly by the mailserver (through ISPConfig and the virtual mail users).
    email quota and web quota are completely separate, though.
     
  4. jhewit

    jhewit New Member

    Ok well that presents three questions:

    1. Why is the web quota showing incorrectly?
    2. Is there no such thing as an overall quota? As I'm sure most hosts do not want to sell a customer a 500MB package then have to add in 1-5GB contingency for database and emails...
    3. Is traffic from FTP included in the traffic quota?

    Thanks for any answers you can provide.
     
  5. Croydon

    Croydon ISPConfig Developer ISPConfig Developer

    1. I can't say. maybe someone else can. on my system it displays absolutely correct.

    2. nope. there is no overall quota and I doubt that it will be in the near (or even far) future. you have to keep in mind that ISPConfig is designed for multi-server setups too, so the quota might not even be on a single server.

    3. nope. Its only web traffic.
     
  6. jhewit

    jhewit New Member

    1. Alright, as it is far off not marginally like 1MB its like as if it is omitting certain files for some reason.

    2. Regardless of multiple server setup or not it should not be that difficult to implement, as all your doing is ensuring the total of all services combined does not exceed the account limit. ie. TOTAL USED = WEB QUOTA + EMAIL QUOTA + SQL QUOTA ... TOTAL LEFT = LIMIT - TOTAL USED. This will likely be the reason I do not use ISPCONFIG then as that is not functional for a hosting control panel if you cannot get a total combined usage. You cannot sell a 500MB package and be unable to calculate email and sql usage our of that and still make profit.

    3. Also a big problem for web hosts, as you do not want users creating a publicly distributed FTP account and users downloading files without it counting against there transfer quota.
     
  7. till

    till Super Moderator Staff Member ISPConfig Developer

    Linux filesystem quta is based on the ownership of files and not by the place were they are stored. so if the quota differs between folder size and filesystem quota, then some of the files in this folder must be owned by another or wrong user.

    Neither the imap servers dovecot / courier nor mysql is able to have a realtime joint quota with Linux filesystem quota. So yes, ispconfig could sum up the sizes of mysql, email and web and offer some kind of action then. But as it is no real quota, what shall ISPConfig do then? Delete a database, delete a few emails or web files, block the ftp login or email login? Btw. ISPConfig as it is is in use by many hosting companys workldwide with a few hundred thousand installed servers and currently about 40 thousand new installations each month, so I would call that usable for ISP's if its the most widely used open source hosting control panel.

    Other hosts dont have a problem with that. If its a problem for you, then feel free to make a feature request for it in the bugtracker. If it gets enough votes, then we will add it on the roadmap.
     
    Last edited: Dec 3, 2013
  8. jhewit

    jhewit New Member

    It's possible that ownership could be the issue, will check into that.

    I did not say ISPConfig was not useful, or didn't have it's uses. After all I've been taking time to investigate it as an option. But for website hosting for the sole purpose of resale it is a must to have an overall disk space cap. How is it possible? Not entirely sure, but WHM/Cpanel does it. As does one of your open-source competitors VestaCP.

    Yes it can be a major issue regardless if your running an un-metered line or not, as look at it from this perspective. I'm a customer and I want to share a zip file of wedding pictures which all are high-res. The zip file is 125MB-250MB, so for ease of downloading I create a FTP account to distribute to friends, family, and the groom and bride so that everyone can download them.

    Now on a rough estimate lets says 50 people decide to download this zip file, roughly computed that will be 6.10GB-12.20GB of data transfer that is now given free. So yes it could be a major issue. If they breach that data transfer limit all services should be stopped not just web.

    Just my thoughts and inputs as a user and first-time tester of this control panel.
     
  9. till

    till Super Moderator Staff Member ISPConfig Developer

    You can do this by either patching the mysql / dovecot etc. binaries to implement functions for an overall quota that re not available in their ipensource releases or you use a less scalable approach for mail users by creating a Linux system user for each mail account so it has its own linux quota instead of using virtual mail users as used in all larger installs and ISPConfig.

    But this would only work for single root servers anyway and not on installations for larger ISP's that run multiple dedicated mail / web and database servers as such a quota would not span over several servers. So even if we would not care about scalability of the mailsystem and implement it with linux system users for each mail account, it would only work for small installs that have just one server like cpanel or vestacp. So when you compare controlpanels, you should check if their apprach is scalable too, at least if you paln to run more then one server in your company in future.
     
  10. jhewit

    jhewit New Member

    Actually having tested VestaCP as well I can tell you that your assessment of there control panel is far from the truth. There system is fully scalable. And works much more smoother on multi-server setups. Not to mention installation, and configuration then with ISPConfig. The reason I was looking at ISPConfig is to fully evaluate all options.

    ISPConfig is not a bad hosting control panel, but still lacks some of the core requirements of a true web hosting control panel. I will continue to follow this project and be a supporter, just was hoping maybe reviewing how VestaCP does it as it is open-source as well would give some insight into how they accomplish certain tasks that in my opinion now give them the upper hand.

    I will look into the owner of the files issue, and submit a bug report for these two requested features. And look forward to hopefully one day seeing true Diskspace and Traffic Quota's.
     
  11. Croydon

    Croydon ISPConfig Developer ISPConfig Developer

    To be honest... and that is my personal opinion... I would not use a control panel that sets up it's own apt repository and installs / upgrades packages.
    As far as I can tell, at least a patched version of vsftpd is used.

    What I like about ISPConfig (and that's one reason I contribute) is that it does not install or remove or .... any system packages and is pure php.
    If you want to provide hosting services, I think you should at least know how to configure and set up a server correctly. And if you do so, I don't like the idea of getting a foreign apt repo.

    Having a straight forward installation is one thing (btw. ISPConfig will have a quiet installation via ini template soon, afaik), binary packages are another.

    As I said, this is only my personal opinion, based on many years and experience with different hosting panels.

    Last but not least one more important thing (correct me if I am wrong).
    As of vesta's code structure using shell skripts directly called by the web interface, it has the need to act as PRIVILEGED user.
    So if anytime the vesta interface is hacked (I don't say vesta has security flaws, but nearly every software has them at some time), you are f***ed up as the attacker acts with root (or sudo) rights. Once again. VestaCP might be nice fore some, but it's nothing I would like to see on one of my servers.
     

Share This Page