MapServer Oct 14 ======================================= Tests run by Frank. Overall Notes: - The 5.6 improvement to read all three ECW bands in one pass (also helpful for MrSID, JPEG2000 and a few other formats) was directly motivated by last years performance benchmarking. - The 5.6 improvement to support holding open raster files (with CLOSE_CONNECTION=DEFER) in FastCGI mode was directly motivated by last years performance benchmarking. - All FastCGI tests run with 8 fastcgi processes regardless of the number of clients. BigTIFF ------- BigTiff v5.4 FastCGI ------------------ Label Count Avg Min Max Errors Throughput 1 100 207 90 1339 0 4.8 10 200 662 107 1842 0 13.3 20 400 1150 86 7377 0 15.0 40 800 2197 83 32232 0 15.2 BigTiff v5.6 CGI ------------------ Label Count Avg Min Max Errors Throughput 1 100 207 90 1339 0 4.8 10 200 662 107 1842 0 13.3 20 400 1150 86 7377 0 15.0 40 800 2197 83 32232 0 15.2 BigTiff v5.6 FastCGI ---------------------- Label Count Avg Min Max Errors Throughput 1 100 92 22 234 0 10.6 10 200 328 19 1627 0 26.5 20 400 625 18 2996 0 27.4 40 800 1378 26 4095 0 27.1 NOTES: - We keep the file open in 5.6, but not in 5.4 FastCGI. Tiled TIFF ---------- NOTES: Normally in layers with many tiles for which low resolution requests may be made we would build a composite reduced resolution layer to use for low resolution requests. This was not done for the benchmark. This means low resolution requests will have required access to quite a few TIFF tiles which presumably has some additional overhead. The relatively poor performance of the Tiled TIFF case vs. the BigTIFF case is not necessarily representative of what would happen in a better organized configuration. 512 tiles mosaic, v5.4, FastCGI ------------------------------- Label Count Avg Min Max Errors Throughput 1 100 149 25 708 0 6.6 10 200 513 16 3819 0 16.1 20 400 1008 39 5397 0 16.7 40 800 2188 31 8149 0 17.0 512 tiles mosaic, v5.6, FastCGI ------------------------------- Label Count Avg Min Max Errors Throughput 1 100 152 25 765 0 6.5 10 200 555 24 3380 0 14.9 20 400 1005 32 6167 0 16.4 40 800 2212 41 8103 0 16.9 NOTES: - For tiled layers we do *not* hold the files open in FastCGI mode, so there is relatively little advantage in fastcgi mode over cgi mode. 512 tiles mosaic, v5.6, CGI --------------------------- Label Count Avg Min Max Errors Throughput 1 100 362 97 3166 0 2.7 10 200 839 142 5208 0 11.0 20 400 1502 100 10515 0 11.4 40 800 2962 124 39417 0 11.3 ECW --- ECW v5.4 FastCGI ---------------------- Label Count Avg Min Max Errors Throughput 1 100 304 74 1259 0 3.3 10 200 946 72 3072 0 9.6 20 400 2008 144 5237 0 9.4 40 800 4337 277 7646 0 8.9 ECW v5.6 CGI ---------------------- Label Count Avg Min Max Errors Throughput 1 100 249 117 667 0 4.0 10 200 731 124 1627 0 12.6 20 400 1379 125 12343 0 12.8 40 800 2882 153 24613 0 12.6 ECW v5.6 FastCGI ---------------------- Label Count Avg Min Max Errors Throughput 1 100 132 28 513 0 7.4 10 200 434 56 2843 0 20.0 20 400 918 51 5390 0 19.8 40 800 1975 61 5972 0 19.1 NOTES: - For 5.6 we actually hold the ECW file open in FastCGI mode, but not in 5.4. - For 5.6 we read all three bands at once, not 3-pass like in 5.4. GeoServer Oct 11 ========================= (aaime) 8 tiles TIFF ---------------------- Label Count Avg Min Max Errors Throughput 1 100 163 32 545 0 6.0 10 200 702 50 2077 0 13.1 20 400 1542 47 4643 0 11.8 40 800 3359 29 8673 0 11.1 512 tiles TIFF ---------------------- Label Count Avg Min Max Errors Throughput 1 100 208 36 702 0 4.7 10 200 974 52 5154 0 9.4 20 400 1910 74 9763 0 9.3 40 800 4163 77 12360 0 8.9 ECW ---------------------- Label Count Avg Min Max Errors Throughput 1 100 198 48 713 0 5.0 10 200 812 70 2543 0 11.3 20 400 1732 71 4743 0 10.6 40 800 3632 50 10046 0 10.1 GeoServer Oct 16 ========================== (aaime) ************************ bluemarble_512 ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 221 34 1977 0 4.5 10 200 938 52 4300 0 9.6 20 400 1897 102 7252 0 9.6 40 800 3851 92 7505 0 10.0 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 206 33 667 0 4.8 10 200 915 55 4733 0 9.5 20 400 1912 63 9936 0 9.6 40 800 3821 77 8645 0 10.1 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 208 33 662 0 4.8 10 200 946 53 4397 0 9.7 20 400 1912 120 6810 0 9.6 40 800 3879 111 7165 0 9.9 ************************ bluemarble_8 ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 157 31 519 0 6.3 10 200 753 48 2942 0 12.3 20 400 1375 91 2578 0 13.8 40 800 2927 75 5019 0 13.1 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 155 30 519 0 6.3 10 200 654 49 2006 0 13.8 20 400 1371 106 2349 0 13.8 40 800 2878 73 5177 0 13.3 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 153 30 523 0 6.4 10 200 662 53 1628 0 13.7 20 400 1417 90 3405 0 13.3 40 800 2818 96 4066 0 13.6 ************************ ecw ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 264 49 778 0 3.7 10 200 1029 107 4633 0 9.1 20 400 1836 94 3444 0 10.3 40 800 3799 238 5858 0 10.2 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 200 48 709 0 4.9 10 200 826 133 2195 0 11.2 20 400 1675 91 3623 0 11.3 40 800 3686 106 5909 0 10.5 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 198 48 711 0 5.0 10 200 826 70 1959 0 11.1 20 400 1677 83 3075 0 11.2 40 800 3652 181 5929 0 10.5 completed. ************************ Fri Oct 16 01:05:39 EDT 2009