ISPconfig 2 FTP transfer slow on LAN

Discussion in 'Installation/Configuration' started by orasis, Sep 24, 2010.

  1. orasis

    orasis Member

    Hi, I installed ISPconfig 2 back again and uploading sites on a LAN connection using Filezilla.
    I had ISPconfig 3 since today, and the FTP transfer was extremely fast, I was uploading 8000 files in less than a minute.
    in ISPconfig 2 it takes more than 15 minutes to do this


    Edit: I have similar problem with Web-FTP too. It takes long to enter and show the contents.

    what do I need to check please ?

    thanks a lot
     
    Last edited: Sep 24, 2010
  2. falko

    falko Super Moderator Howtoforge Staff

    Did you try both active and passive transfers in your FTP client?
     
  3. edge

    edge Active Member Moderator

  4. orasis

    orasis Member

    Hi there guys,

    thanks to both of you for your reply and help me into this really,

    yes in Filezilla I have tried both Default // Active // Passive modes, even restarting the client on every change. I even tried this from a linux os running on same computer connecting to the same server.

    I read it, thanks for pointing me there, I also found lots of other ones before I posted my problem. Well Actually, my problem is not the speed I get in order to connect to the server actually, which is an issue you can say compared to how it was before, but the speed I get in transfering files.

    Example:
    - If I try to transfer a large file, as a tested a 1GB WAV file, it transfers it with the limits of my lan connection. about 11,7MB/s
    - But If I try to upload say, a Joomla unpacked archive, which is about 6000 files or so, I see the files uploading slow.

    So it is not the actual speed of 1 file itself, but how long it takes for 1 file to the next. As I said, in ISPconfig 3, it was uploading 8000 files in like WOW les than a minute like a lightning. Now it takes 2 cigarettes (or more).

    This is my ping results from a Windows OS, (default firewall disabled completely from the windows services even, no firewall on OS/Computer itself):

    Code:
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time=1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time=1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time=1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time=1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    Reply from 192.168.0.150: bytes=32 time<1ms TTL=64
    I also haven't added any jobs to this ubuntu machine, I did install some more software to it, but the test I am talking about, and slow file transfer is since I first installed it and it was 100% clean of other installations. I have rebooted the machine lots of times too. It should also not be a ram issue, I don't have slow logins either (I remind you on same laptop computer I was running ISPconfig 3 the previous day). I also don't have more IPs added.


    netstat -tap

    Code:
    Proto Recv-Q Send-Q Local Address            Foreign Address         State       PID/Program name
    tcp        0      0 *:https                  *:*                     LISTEN      3431/apache2    
    tcp        0      0 example1.mydomain.:10024 *:*                     LISTEN      1488/amavisd (maste
    tcp        0      0 *:mysql                  *:*                     LISTEN      1667/mysqld     
    tcp        0      0 *:www                    *:*                     LISTEN      3431/apache2    
    tcp        0      0 *:81                     *:*                     LISTEN      3263/ispconfig_http
    tcp        0      0 *:ftp                    *:*                     LISTEN      4836/proftpd: (acce
    tcp        0      0 example1.mydomain:domain *:*                     LISTEN      3598/named      
    tcp        0      0 example1.mydomain:domain *:*                     LISTEN      3598/named      
    tcp        0      0 *:ssh                    *:*                     LISTEN      1374/sshd       
    tcp        0      0 example1.mydomain.ne:ipp *:*                     LISTEN      2795/cupsd      
    tcp        0      0 example1.mydomain.ne:953 *:*                     LISTEN      3598/named      
    tcp        0      0 *:smtp                   *:*                     LISTEN      3555/master     
    tcp        0      0 example1.mydomain.ne:ftp example2.myotherdomain.ne:2281 ESTABLISHED 4840/proftpd: example2
    tcp6       0      0 [::]:imaps               [::]:*                  LISTEN      2166/couriertcpd
    tcp6       0      0 [::]:pop3s               [::]:*                  LISTEN      2210/couriertcpd
    tcp6       0      0 [::]:pop3                [::]:*                  LISTEN      2185/couriertcpd
    tcp6       0      0 [::]:imap2               [::]:*                  LISTEN      2141/couriertcpd
    tcp6       0      0 [::]:ssh                 [::]:*                  LISTEN      1374/sshd       
    tcp6       0      0 localhost:ipp            [::]:*                  LISTEN      2795/cupsd      
    tcp6       0      0 localhost:953            [::]:*                  LISTEN      3598/named      
    tcp6       0      0 [::]:smtp                [::]:*                  LISTEN      3555/master

    iptables -L

    Code:
    Chain INPUT (policy DROP)
    target     prot opt source               destination         
    DROP       tcp  --  anywhere             127.0.0.0/8         
    ACCEPT     all  --  anywhere             anywhere            state RELATED,ESTABLISHED 
    ACCEPT     all  --  anywhere             anywhere            
    DROP       all  --  BASE-ADDRESS.MCAST.NET/4  anywhere            
    PUB_IN     all  --  anywhere             anywhere            
    PUB_IN     all  --  anywhere             anywhere            
    PUB_IN     all  --  anywhere             anywhere            
    PUB_IN     all  --  anywhere             anywhere            
    DROP       all  --  anywhere             anywhere            
    
    Chain FORWARD (policy DROP)
    target     prot opt source               destination         
    ACCEPT     all  --  anywhere             anywhere            state RELATED,ESTABLISHED 
    DROP       all  --  anywhere             anywhere            
    
    Chain OUTPUT (policy ACCEPT)
    target     prot opt source               destination         
    PUB_OUT    all  --  anywhere             anywhere            
    PUB_OUT    all  --  anywhere             anywhere            
    PUB_OUT    all  --  anywhere             anywhere            
    PUB_OUT    all  --  anywhere             anywhere            
    
    Chain INT_IN (0 references)
    target     prot opt source               destination         
    ACCEPT     icmp --  anywhere             anywhere            
    DROP       all  --  anywhere             anywhere            
    
    Chain INT_OUT (0 references)
    target     prot opt source               destination         
    ACCEPT     icmp --  anywhere             anywhere            
    ACCEPT     all  --  anywhere             anywhere            
    
    Chain PAROLE (10 references)
    target     prot opt source               destination         
    ACCEPT     all  --  anywhere             anywhere            
    
    Chain PUB_IN (4 references)
    target     prot opt source               destination         
    ACCEPT     icmp --  anywhere             anywhere            icmp destination-unreachable 
    ACCEPT     icmp --  anywhere             anywhere            icmp echo-reply 
    ACCEPT     icmp --  anywhere             anywhere            icmp time-exceeded 
    ACCEPT     icmp --  anywhere             anywhere            icmp echo-request 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:ftp 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:ssh 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:smtp 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:domain 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:www 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:81 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:pop3 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:imap2 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:https 
    PAROLE     tcp  --  anywhere             anywhere            tcp dpt:webmin 
    ACCEPT     udp  --  anywhere             anywhere            udp dpt:domain 
    DROP       icmp --  anywhere             anywhere            
    DROP       all  --  anywhere             anywhere            
    
    Chain PUB_OUT (4 references)
    target     prot opt source               destination         
    ACCEPT     all  --  anywhere             anywhere     
    

    Now I first noticed the problem when the server was fresh installed and the ISPconfig Firewall was not ON. So turning it ON/OFF has same results.

    This is what my proftpd.conf looks like:

    Code:
    #
    # /etc/proftpd/proftpd.conf -- This is a basic ProFTPD configuration file.
    # To really apply changes reload proftpd after modifications.
    # 
    
    # Includes DSO modules
    Include /etc/proftpd/modules.conf
    
    # Set off to disable IPv6 support which is annoying on IPv4 only boxes.
    UseIPv6                on
    # If set on you can experience a longer connection delay in many cases.
    IdentLookups            off
    
    ServerName            "Debian"
    ServerType            standalone
    DeferWelcome            off
    
    MultilineRFC2228        on
    DefaultServer            on
    ShowSymlinks            on
    
    TimeoutNoTransfer        600
    TimeoutStalled            600
    TimeoutIdle            1200
    
    DisplayLogin                    welcome.msg
    DisplayChdir                   .message true
    ListOptions                    "-l"
    
    DenyFilter            \*.*/
    
    # Use this to jail all users in their homes 
    DefaultRoot            ~
    
    # Users require a valid shell listed in /etc/shells to login.
    # Use this directive to release that constrain.
    # RequireValidShell        off
    
    # Port 21 is the standard FTP port.
    Port                21
    
    # In some cases you have to specify passive ports range to by-pass
    # firewall limitations. Ephemeral ports can be used for that, but
    # feel free to use a more narrow range.
    # PassivePorts                  49152 65534
    
    # If your host was NATted, this option is useful in order to
    # allow passive tranfers to work. You have to use your public
    # address and opening the passive ports used on your firewall as well.
    # MasqueradeAddress        1.2.3.4
    
    # This is useful for masquerading address with dynamic IPs:
    # refresh any configured MasqueradeAddress directives every 8 hours
    <IfModule mod_dynmasq.c>
    # DynMasqRefresh 28800
    </IfModule>
    
    # To prevent DoS attacks, set the maximum number of child processes
    # to 30.  If you need to allow more than 30 concurrent connections
    # at once, simply increase this value.  Note that this ONLY works
    # in standalone mode, in inetd mode you should use an inetd server
    # that allows you to limit maximum number of processes per service
    # (such as xinetd)
    MaxInstances            30
    
    # Set the user and group that the server normally runs at.
    User                proftpd
    Group                nogroup
    
    # Umask 022 is a good standard umask to prevent new files and dirs
    # (second parm) from being group and world writable.
    Umask                022  022
    # Normally, we want files to be overwriteable.
    AllowOverwrite            on
    
    # Uncomment this if you are using NIS or LDAP via NSS to retrieve passwords:
    # PersistentPasswd        off
    
    # This is required to use both PAM-based authentication and local passwords
    # AuthOrder            mod_auth_pam.c* mod_auth_unix.c
    
    # Be warned: use of this directive impacts CPU average load!
    # Uncomment this if you like to see progress and transfer rate with ftpwho
    # in downloads. That is not needed for uploads rates.
    #
    # UseSendFile            off
    
    TransferLog /var/log/proftpd/xferlog
    SystemLog   /var/log/proftpd/proftpd.log
    
    <IfModule mod_quotatab.c>
    QuotaEngine off
    </IfModule>
    
    <IfModule mod_ratio.c>
    Ratios off
    </IfModule>
    
    
    # Delay engine reduces impact of the so-called Timing Attack described in
    # http://security.lss.hr/index.php?page=details&ID=LSS-2004-10-02
    # It is on by default. 
    <IfModule mod_delay.c>
    DelayEngine off
    </IfModule>
    
    <IfModule mod_ctrls.c>
    ControlsEngine        off
    ControlsMaxClients    2
    ControlsLog           /var/log/proftpd/controls.log
    ControlsInterval      5
    ControlsSocket        /var/run/proftpd/proftpd.sock
    </IfModule>
    
    <IfModule mod_ctrls_admin.c>
    AdminControlsEngine off
    </IfModule>
    
    #
    # Alternative authentication frameworks
    #
    #Include /etc/proftpd/ldap.conf
    #Include /etc/proftpd/sql.conf
    
    #
    # This is used for FTPS connections
    #
    #Include /etc/proftpd/tls.conf
    
    # A basic anonymous configuration, no upload directories.
    
    # <Anonymous ~ftp>
    #   User                ftp
    #   Group                nogroup
    #   # We want clients to be able to login with "anonymous" as well as "ftp"
    #   UserAlias            anonymous ftp
    #   # Cosmetic changes, all files belongs to ftp user
    #   DirFakeUser    on ftp
    #   DirFakeGroup on ftp
    # 
    #   RequireValidShell        off
    # 
    #   # Limit the maximum number of anonymous logins
    #   MaxClients            10
    # 
    #   # We want 'welcome.msg' displayed at login, and '.message' displayed
    #   # in each newly chdired directory.
    #   DisplayLogin            welcome.msg
    #   DisplayChdir        .message
    # 
    #   # Limit WRITE everywhere in the anonymous chroot
    #   <Directory *>
    #     <Limit WRITE>
    #       DenyAll
    #     </Limit>
    #   </Directory>
    # 
    #   # Uncomment this if you're brave.
    #   # <Directory incoming>
    #   #   # Umask 022 is a good standard umask to prevent new files and dirs
    #   #   # (second parm) from being group and world writable.
    #   #   Umask                022  022
    #   #            <Limit READ WRITE>
    #   #            DenyAll
    #   #            </Limit>
    #   #            <Limit STOR>
    #   #            AllowAll
    #   #            </Limit>
    #   # </Directory>
    # 
    # </Anonymous>
    
    
    ServerIdent on "FTP Server ready."
    
    DefaultRoot ~
    
    Include /etc/proftpd_ispconfig.conf
    
    UseReverseDNS off
    

    If I turn the "UseIPv6 on" to "off" as by someone's advice, then the FTP server goes completely down.

    Most important for me is, that even if I connect from the same computer that the server is installed on, I get absolutely same speed results. So it must be some special setting that I need to alter.

    ISP Server Status

    Status:
    Code:
    Server Online since:  	
    0d, 0:13h
    Users Online: 	
    2 users
    System Load 1 Minute: 	
    0.00
    System Load 5 Minutes: 	
    0.06
    System Load 15 Minutes: 	
    0.09 
    
    Filesystem	Size	Used	Avail	Use%	Mounted
    /dev/sda3	20G	6.4G	13G	35%	/
    udev	1006M	280K	1006M	1%	/dev
    none	1006M	1.4M	1005M	1%	/dev/shm
    none	1006M	136K	1006M	1%	/var/run
    none	1006M	0	1006M	0%	/var/lock
    none	1006M	0	1006M	0%	/lib/init/rw
    
    Main Memory:
    Code:
    Cached:  	 346956 kB
    SwapCached: 	0 kB
    Active: 	447084 kB
    Inactive: 	285204 kB
    Active(anon): 	348952 kB
    Inactive(anon): 	48 kB
    Active(file): 	98132 kB
    Inactive(file): 	285156 kB
    Unevictable: 	0 kB
    Mlocked: 	0 kB
    HighTotal: 	1186248 kB
    HighFree: 	478640 kB
    LowTotal: 	873956 kB
    LowFree: 	785076 kB
    SwapTotal: 	4200956 kB
    SwapFree: 	4200956 kB
    Dirty: 	112 kB
    Writeback: 	0 kB
    AnonPages: 	340244 kB
    Mapped: 	85932 kB
    Slab: 	24948 kB
    SReclaimable: 	14988 kB
    SUnreclaim: 	9960 kB
    PageTables: 	6268 kB
    NFS_Unstable: 	0 kB
    Bounce: 	0 kB
    WritebackTmp: 	0 kB
    CommitLimit: 	5231056 kB
    Committed_AS: 	1089652 kB
    VmallocTotal: 	122880 kB
    VmallocUsed: 	53336 kB
    VmallocChunk: 	61940 kB
    HugePages_Total: 	0
    HugePages_Free: 	0
    HugePages_Rsvd: 	0
    HugePages_Surp: 	0
    Hugepagesize: 	4096 kB
    DirectMap4k: 	53240 kB
    DirectMap4M: 	856064 kB
    
    CPU:
    Code:
    processor :  	 0
    vendor_id : 	GenuineIntel
    cpu family : 	6
    model : 	15
    model name : 	Intel(R) Core(TM)2 CPU T7200 @ 2.00GHz
    stepping : 	6
    cpu MHz : 	1000.000
    cache size : 	4096 KB
    physical id : 	0
    siblings : 	2
    core id : 	0
    cpu cores : 	2
    apicid : 	0
    initial apicid : 	0
    fdiv_bug : 	no
    hlt_bug : 	no
    f00f_bug : 	no
    coma_bug : 	no
    fpu : 	yes
    fpu_exception : 	yes
    cpuid level : 	10
    wp : 	yes
    flags : 	fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc arch_perfmon pebs bts pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow
    bogomips : 	3991.73
    clflush size : 	64
    power management: 	
    processor : 	1
    vendor_id : 	GenuineIntel
    cpu family : 	6
    model : 	15
    model name : 	Intel(R) Core(TM)2 CPU T7200 @ 2.00GHz
    stepping : 	6
    cpu MHz : 	1000.000
    cache size : 	4096 KB
    physical id : 	0
    siblings : 	2
    core id : 	1
    cpu cores : 	2
    apicid : 	1
    initial apicid : 	1
    fdiv_bug : 	no
    hlt_bug : 	no
    f00f_bug : 	no
    coma_bug : 	no
    fpu : 	yes
    fpu_exception : 	yes
    cpuid level : 	10
    wp : 	yes
    flags : 	fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe nx lm constant_tsc arch_perfmon pebs bts pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm lahf_lm tpr_shadow
    bogomips : 	3929.44
    clflush size : 	64
    power management: 
    
    Services:
    Code:
    Web-Server:      
    Online
    FTP-Server:     
    Online
    SMTP-Server:     
    Online
    POP3-Server:     
    Online
    BIND-Server:     
    Online
    mySQL-Server:     
    Online
    Code:
    ISPConfig
    Version: 2.2.37
    (c) ISPConfig 2010
     
  5. orasis

    orasis Member

    I just restarted into linux (the computer I just posted the above reply),
    installed gFTP to try the same thing. Result, even slower, I actually don't like gFTP at all.

    Also testing right now with Filezilla on linux, same thing.

    By the way, same kinda slow speed I have even when deleting files from server. ( 6000 files = 2 cigarettes long :D )
     

Share This Page