consuming a lot of memory

Discussion in 'Installation/Configuration' started by 3cwired_com, Jun 1, 2009.

  1. 3cwired_com

    3cwired_com New Member

    I am using debian lenny with the perfect setup and this is a sample list from top:


    Code:
    mysql	152304 kB	/usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file ...
    2462	clamav	98948 kB	/usr/sbin/clamd
    7210	www-data	91252 kB	/usr/sbin/apache2 -k start
    7329	www-data	86208 kB	/usr/sbin/apache2 -k start
    7293	www-data	85724 kB	/usr/sbin/apache2 -k start
    7213	www-data	83936 kB	/usr/sbin/apache2 -k start
    7215	www-data	83932 kB	/usr/sbin/apache2 -k start
    7307	www-data	83404 kB	/usr/sbin/apache2 -k start
    7214	www-data	83148 kB	/usr/sbin/apache2 -k start
    7257	www-data	83148 kB	/usr/sbin/apache2 -k start
    7305	www-data	82444 kB	/usr/sbin/apache2 -k start
    7212	www-data	82344 kB	/usr/sbin/apache2 -k start
    7306	www-data	82184 kB	/usr/sbin/apache2 -k start
    7331	www-data	79060 kB	/usr/sbin/apache2 -k start
    7256	www-data	78760 kB	/usr/sbin/apache2 -k start
    7261	www-data	78760 kB	/usr/sbin/apache2 -k start
    7330	www-data	78760 kB	/usr/sbin/apache2 -k start
    7373	www-data	78740 kB	/usr/sbin/apache2 -k start
    7278	www-data	78628 kB	/usr/sbin/apache2 -k start
    7372	www-data	78328 kB	/usr/sbin/apache2 -k start
    3312	root	78196 kB	/usr/sbin/apache2 -k start
    7208	www-data	67260 kB	/usr/sbin/apache2 -k start
    28172	amavis	57696 kB	amavisd (ch18-avail)
    28715	amavis	57288 kB	amavisd (ch15-avail)
    1394	amavis	54420 kB	amavisd (master)
    1923	root	47520 kB	/usr/sbin/lwresd
    1798	root	29040 kB	/usr/sbin/spamd --create-prefs --max-children 5 --helper-home-dir -d --pidfile=/ ...
    1806	root	29040 kB	spamd child
    1807	root	29040 kB	spamd child
    1835	root	28428 kB	/usr/sbin/rsyslogd -c3
    29115	root	23980 kB	/usr/bin/python /usr/bin/fail2ban-server -b -s /var/run/fail2ban/fail2ban.sock
    7190	root	14036 kB	/usr/share/webmin/proc/index_size.cgi
    3007	root	12508 kB	/usr/sbin/smbd -D
    3073	root	12508 kB	/usr/sbin/smbd -D
    3372	root	12440 kB	/usr/bin/perl /usr/share/webmin/miniserv.pl /etc/webmin/miniserv.conf
    7275	postfix	11744 kB	smtpd -n smtp -t inet -u -c -o stress
    7353	postfix	11744 kB	smtpd -n smtp -t inet -u -c -o stress
    3116	root	9116 kB	/usr/sbin/winbindd
    3129	root	9116 kB	/usr/sbin/winbindd
    3074	root	8360 kB	/usr/sbin/saslauthd -a pam -c -m /var/spool/postfix/var/run/saslauthd -r -n 5
    3079	root	8360 kB	/usr/sbin/saslauthd -a pam -c -m /var/spool/postfix/var/run/saslauthd -r -n 5
    3080	root	8360 kB	/usr/sbin/saslauthd -a pam -c -m /var/spool/postfix/var/run/saslauthd -r -n 5
    3081	root	8360 kB	/usr/sbin/saslauthd -a pam -c -m /var/spool/postfix/var/run/saslauthd -r -n 5
    3082	root	8360 kB	/usr/sbin/saslauthd -a pam -c -m /var/spool/postfix/var/run/saslauthd -r -n 5
    20610	root	8160 kB	sshd: root@pts/0
    7403	postfix	8116 kB	trivial-rewrite -n rewrite -t unix -u -c
    7404	postfix	8104 kB	proxymap -t unix -u
    18826	postfix	8020 kB	qmgr -l -t fifo -u
    7140	web2	7796 kB
    
    I am not sure why all of these processes takes up so much ram if not needed. Is there anyway to tweak and tune these processes so that they dont take up much more memory. Thanks.
     
  2. till

    till Super Moderator Staff Member ISPConfig Developer

    There are a lot of infos in the internet on how to tune apache if you search for them with e.g. goole :)
     
  3. 3cwired_com

    3cwired_com New Member

    thanks will do!
     
  4. SamTzu

    SamTzu Active Member

    Memory ISPConfig3

    Did You find anything useful?
    I have noticed that my ISPConfig3 setup on ProxMox/OpenVZ server seems to use a lot more memory than ISPConfig2 on VMWare. I'm wondering what could cause that.
     
  5. till

    till Super Moderator Staff Member ISPConfig Developer

    ISPConfig 3 uses a completely different setup with other daemons and especially a much better spamfilter etc. Other daemons might need system resources and also newer versions of the same software like apache, spamassassin and clamav etc. might need more ram. ISPConfig itself does not need any permanent system resources as it is just a script that is run by cron.
     
  6. SamTzu

    SamTzu Active Member

    Thx, Till.

    I'm actually wondering if the OpenVZ is to be blamed here.
    I have read from some sources that it's use of memory is somehow 'unorthodox'.

    I'm just trying to figure out how to get more out of our servers.
    I keep getting the infamous PHP 'Out of memory' error too often.
    Allocated Trillion Billion bytes when only 300000 was requested.

    I need to learn more about Bean counters.
    Only I have never been too good at counting :)
     
  7. falko

    falko Super Moderator Howtoforge Staff

  8. nikoladd

    nikoladd New Member

    I will suggest that the "much better spamfilter" be disabled by default because:
    1) it's 3 daemons with their subprocesses use 200+MB of committed memory right out of the box.
    2) The amavisd requires fixing just to start it.
    3) The content filter is plain stupid! We are a software development company and we had a whole day lost on a project until finding out that it blocks our own email and clients didn't receive their updates that contained zipped exe files (remember software company). Some "much better" programmer has been coding unchecked there.
    4) Having an antivirus service on a web server IS BAD DECISION! You can be flooded your performance WILL be hampered when a large attachment is present. Generally content filters are supposed to go on separate servers.

    The content filter should be disabled by default and whoever want's it could enable it. It doesn't run out of the box anyway.
     
  9. till

    till Super Moderator Staff Member ISPConfig Developer

    The content filter runs out of the box perfectly if the system is installed as described in the perfect setup guide. I'am doing these installations daily and there are > 10 000 installations with ISPConfig out there were it works. So instead of claiming that it does not work gernerally while it just not worked for you, why did you not just asked if you had a problem?

    to 3) I work also in a software company and it never blocked any zip file in the last year since we use it, so the question is which settings you use. Amavisd is a widely used spamfilter.

    to 4) That was your decision. ISPConfig is a multi server system to separate mail and webserver. If you decide to install web and mailserver on one machine, dont blame the software for it.
     
  10. nikoladd

    nikoladd New Member

    Well we used the OFFICIAL guide from this url http://www.ispconfig.org/docs/INSTALL_DEBIAN_4.0.txt
    The perfectly hidden one was not found at the time. And it did NOT work out of the box. We found our way, but still out of the box it didn't work.

    errr that's the ISPC3 forum. Remember? Wishful thinking maybe?

    I've fixed the problem. I was speaking of out of the box which is pretty different thing.

    That's like claiming every crash is survivable because you survived one. Most normal people don't spend their lives tweaking settings. And most admins don't really understand business requirements so this is a problem.

    errr that's the ISPC3 forum. Again. Would you be so kind to point me out how to configure a ispc3 cluster? That would be very helpful. But as far as I've read your own comments on people's questions about it the answer was: "It's not implemented." In my understanding "multi server system" means support for multiple servers to be used in one system and not some silly mapping to other single servers.
     
  11. till

    till Super Moderator Staff Member ISPConfig Developer

    Sure very hidden ispconfig documentation page ;) I installed a lot of servers with this guide and it works fine for me and many others without any tweaks needed.

    No, just ispconfig 3 statistics. And yes, I know the difference between ispconfig 2 and 3 ;)

    There are about 300 - 400 ISPConfig 3 downloads per day without the downloads for updates and without downloads for beta and RC releases. So when you claim in your post that ISPConfig setup is not working out of the box in general and it's just silly.

    The posts talked about mirroring for load balancing and not of running services on different servers like separate mail, web and dns servers what you claimed is not possible. Just select expert mode when you install ispconfig on the second server and you will be asked if the server shall join a master server. I know several ISP's running ispconfig clusters with separated services in production enviroments.
     

Share This Page