JMeter template files to copy from to set up for each server If you are working locally checkout this directory like: svn co http://svn.osgeo.org/osgeo/foss4g/benchmarking/wms/2011/jmeter jmeter If you are on the remote jmeter benchmark machine do: cd /opt/scripts/2011/jmeter Note: on the above machine permissions are messy, you may need to do this to enable to GUI to save files: sudo chown -R jmeterusr jmeter/ To create jmx files for your server do: cd jmeter SERVER= mkdir $SERVER svn add $SERVER svn cp templates/*.jmx $SERVER/ svn ci -m "copying template jmx files for $SERVER" Then rename them, for example: svn mv mapnik/servername-vector-3857-pg.jmx mapnik/mapnik-vector-3857-pg.jmx svn mv mapnik/servername-vector-3857-seed-pg.jmx mapnik/mapnik-vector-3857-seed-pg.jmx svn ci mapnik/ -m "fixing naming of jmx files" Finally, edit the files either in an XML editor or JMeter GUI: 1) Change all instances of SERVERNAME to your actual server name like: sed -i '' -e's/SERVERNAME/mapnik/' mapnik/*jmx 2) If running on the Windows machine change 12.189.158.78 to 12.189.158.75 in the line: 12.189.158.78 3) Change the port 8000 to your desired port in line: 8000 4) Edit any of the other 'HTTP Request Defaults' needed for your server url A note on logging in JMeter: Logging of requests is set to only errors in the "View Results Tree". Logging here is helpful to ensure your successful requests are actually returning correctly looking tiles. But if left on during repeated runs JMeter in the past has become bogged down such that your results change! So, this is off by default. Turn on at your own risk for debugging. Logging of all requests (both errors and successes) are ON in the "Summary Report" so that the right report is generated (but you should see no errors otherwise something is wrong with your server and will require a new test run).