Different results Nginx Microcache ISP Config vs ApacheBooster for Cpanel

Discussion in 'Server Operation' started by DanielP, Dec 9, 2013.

  1. DanielP

    DanielP New Member

    I do some last testing to decide what tech solution to use but got some strange results...

    I use ab for test and siege, Nginx with microcache set in ISPConfig and Cpanel with ApacheBooster plugin which is Nginx + Varnish + Apache

    i use a 2 wordpress blogs home pages but they are not so different and in to diffrent benchmarks i got one or other thechnology to be 50 percent faster than the other



    I. ApacheBench

    Apache Booster
    Code:
     /usr/local/apache/bin/ab -c 100 -n 100000 http:/xxxxxxxxxxxxx/This is ApacheBench, Version 2.3 <$Revision: 1528965 $>
    Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    Licensed to The Apache Software Foundation, http://www.apache.org/
    
    Benchmarking xxxxxx (be patient)
    Completed 10000 requests
    Completed 20000 requests
    Completed 30000 requests
    Completed 40000 requests
    Completed 50000 requests
    Completed 60000 requests
    Completed 70000 requests
    Completed 80000 requests
    Completed 90000 requests
    Completed 100000 requests
    Finished 100000 requests
    
    
    Server Software:        ApacheBooster/1.9
    Server Hostname:        xxxxxx
    Server Port:            80
    
    Document Path:          /
    Document Length:        0 bytes
    
    Concurrency Level:      100
    Time taken for tests:   26.112 seconds
    Complete requests:      100000
    Failed requests:        0
    Non-2xx responses:      100000
    Total transferred:      31962150 bytes
    HTML transferred:       0 bytes
    Requests per second:    3829.71 [#/sec] (mean)
    Time per request:       26.112 [ms] (mean)
    Time per request:       0.261 [ms] (mean, across all concurrent requests)
    Transfer rate:          1195.37 [Kbytes/sec] received
    
    Connection Times (ms)
                  min  mean[+/-sd] median   max
    Connect:        0    5   4.1      5      29
    Processing:     1   21  20.3     18     602
    Waiting:        0   19  19.9     16     598
    Total:          1   26  20.6     24     605
    
    Percentage of the requests served within a certain time (ms)
      50%     24
      66%     27
      75%     30
      80%     32
      90%     38
      95%     44
      98%     52
      99%     59
     100%    605 (longest request)
    
    Requests per second: 3829.71 [#/sec]

    Nginx Microcache

    Code:
     ab -c 10 -n 100000 http://xxxxxxxxxxxxxxxxxxx/
    This is ApacheBench, Version 2.3 <$Revision: 655654 $>
    Copyright 1996 Adam Twiss, Zeus Technology Ltd, http://www.zeustech.net/
    Licensed to The Apache Software Foundation, http://www.apache.org/
    
    Benchmarking xxxxxxxxxxxxxxxxxxxxxxx (be patient)
    Completed 10000 requests
    Completed 20000 requests
    Completed 30000 requests
    Completed 40000 requests
    Completed 50000 requests
    Completed 60000 requests
    Completed 70000 requests
    Completed 80000 requests
    Completed 90000 requests
    Completed 100000 requests
    Finished 100000 requests
    
    
    Server Software:        nginx/1.5.7
    Server Hostname:        xxxxxxxxxxxxxxxxxxxxxxxxx
    Server Port:            80
    
    Document Path:          /
    Document Length:        10232 bytes
    
    Concurrency Level:      10
    Time taken for tests:   15.850 seconds
    Complete requests:      100000
    Failed requests:        98866
       (Connect: 0, Receive: 0, Length: 98866, Exceptions: 0)
    Write errors:           0
    Total transferred:      1060701134 bytes
    HTML transferred:       1023101134 bytes
    Requests per second:    6308.96 [#/sec] (mean)
    Time per request:       1.585 [ms] (mean)
    Time per request:       0.159 [ms] (mean, across all concurrent requests)
    Transfer rate:          65350.78 [Kbytes/sec] received
    
    Connection Times (ms)
                  min  mean[+/-sd] median   max
    Connect:        0    0   0.5      0      13
    Processing:     0    1  11.8      1    1323
    Waiting:        0    1  11.8      1    1323
    Total:          0    2  11.8      1    1325
    
    Percentage of the requests served within a certain time (ms)
      50%      1
      66%      1
      75%      2
      80%      2
      90%      2
      95%      3
      98%      5
      99%      6
     100%   1325 (longest request)
    

    Requests per second: 6308.96 [#/sec]

    so far so good it mean that my Nginx Microcache Setup is almost 50 percent faster than the Apache Booster setup ...

    but strange results came from sige test in benchmark mode


    II. SIEGE 2.72

    siege -b -t60s httpxxxxxxxxxx


    Apache Booster
    Code:
    ** Preparing 15 concurrent users for battle.
    The server is now under siege...
    Lifting the server siege...      done.
    
    Transactions:		        9958 hits
    Availability:		      100.00 %
    Elapsed time:		       59.44 secs
    Data transferred:	       29.12 MB
    Response time:		        0.09 secs
    Transaction rate:	      167.53 trans/sec
    Throughput:		        0.49 MB/sec
    Concurrency:		       14.42
    Successful transactions:        9967
    Failed transactions:	           0
    Longest transaction:	        5.05
    Shortest transaction:	        0.03
    
    
    Transaction rate: 167.53 trans/sec


    Nginx Microcache

    Code:
    ** SIEGE 2.72
    ** Preparing 15 concurrent users for battle.
    The server is now under siege...
    Lifting the server siege...      done.
    
    Transactions:		        6093 hits
    Availability:		      100.00 %
    Elapsed time:		       59.52 secs
    Data transferred:	       60.06 MB
    Response time:		        0.14 secs
    Transaction rate:	      102.37 trans/sec
    Throughput:		        1.01 MB/sec
    Concurrency:		       14.78
    Successful transactions:        6093
    Failed transactions:	           0
    Longest transaction:	        5.45
    Shortest transaction:	        0.00
    
    Transaction rate: 102.37 trans/sec


    In siege test Apache Booster is 50 percent faster than Nginx Microchace which is completely the opposite of the Apache Bench (test)

    So does somebody got the idea why result are like that ?
     
    Last edited: Dec 9, 2013
  2. till

    till Super Moderator Staff Member ISPConfig Developer

    There must be something wrong with the second test:

    apache:

    Data transferred: 29.12 MB

    nginx:

    Data transferred: 60.06 MB

    so the data amount of the nginx test is 2 times the amount of the apache test.
     
  3. DanielP

    DanielP New Member

    My mistake my BP (business partner) start developing process on wp blog the time of the test and use theme with a big header image

    i just finish redoing the siege test on an fresh installed Wordpress, I still got some differences in badnwith... think it's about level of compression, but result are the same 162 for apache booster and 102 for Niginx Microcache

    Code:
    ** SIEGE 2.72
    ** Preparing 15 concurrent users for battle.
    The server is now under siege...
    Lifting the server siege...      done.
    
    Transactions:		        9879 hits
    Availability:		      100.00 %
    Elapsed time:		       59.76 secs
    Data transferred:	       23.57 MB
    Response time:		        0.09 secs
    Transaction rate:	      165.31 trans/sec
    Throughput:		        0.39 MB/sec
    Concurrency:		       14.55
    Successful transactions:        9879
    Failed transactions:	           0
    Longest transaction:	        5.07
    Shortest transaction:	        0.03
     
    Code:
    ** SIEGE 2.72
    ** Preparing 15 concurrent users for battle.
    The server is now under siege...
    Lifting the server siege...      done.
    
    Transactions:		        6075 hits
    Availability:		      100.00 %
    Elapsed time:		       59.35 secs
    Data transferred:	       14.45 MB
    Response time:		        0.15 secs
    Transaction rate:	      102.36 trans/sec
    Throughput:		        0.24 MB/sec
    Concurrency:		       14.92
    Successful transactions:        6075
    Failed transactions:	           0
    Longest transaction:	        5.15
    Shortest transaction:	        0.00
    
    
     

Share This Page