Scripts
==============================

Scripts available:
- summarizer.py: summarizes the results of a benchmark session run by reading the specificed csv file
- wms_request.py: builds a csv file with random width,height and bounding boxes. The file is then used
                  to drive a benchmarking session
- benchmark: a script that first invokes jmeter and then the summarizer to run a benchmarking session
             and summarize its results

Running a benchmarking session
==============================

First off, if you don't have a script directory
named after your server, create one (like geoserver
and mapserver have).

Then copy and customize the benchmarking scripts to
match your server URL and eventual extra parameters needed
in the calls. Make sure to also copy the .csv files
driving the workload.

Once the JMeter scripts are in place, run:

./benchmark <server>/<script>.jmx

The command will run JMeter against the provided script
in headless mode and create a <server>/<script>.jmx.log
file with the detailed results of each request, and then
pass it to summarizer.py that will aggregate the results
and present a summary per thread group.

The output should look like:

> ./benchmark geoserver/tiff8.xml 
Created the tree successfully using geoserver/tiff8.xml
Starting the test @ Thu Sep 24 06:16:15 EDT 2009 (1253787375105)
Waiting for possible shutdown message on port 4445
Generate Summary Results +    20 in   3.9s =    5.1/s Avg:   193 Min:    91 Max:   442 Err:     0 (0.00%)
Generate Summary Results +    52 in   9.9s =    5.3/s Avg:   187 Min:    72 Max:   505 Err:     0 (0.00%)
... # long list of results skipped for brevity
Generate Summary Results +    24 in   7.2s =    3.3/s Avg:  1757 Min:    71 Max:  6056 Err:     0 (0.00%)
Generate Summary Results =  1500 in 165.7s =    9.0/s Avg:  2694 Min:    71 Max: 15309 Err:     0 (0.00%)
Tidying up ...    @ Thu Sep 24 06:19:01 EDT 2009 (1253787541969)
... end of run
Label	Count	Avg	Min	Max	Throughput
1	100	192	72	505	5.1
10	200	927	86	3662	9.8
20	400	1859	151	9109	9.5
40	800	3867	71	15309	9.7