10/04/2009 - MapServer ===================== (jmckenna & msmith) *EPSG:4326* *format:image/jpeg* shp_edges_merge Label Count Avg Min Max Errors Throughput 1 100 213 113 840 0 4.6 10 200 542 115 5323 0 14.9 20 400 1096 133 13863 0 15.4 40 800 1990 115 32000 0 15.6 pg_edges_merge (localhost) Label Count Avg Min Max Errors Throughput 1 100 246 151 567 0 4.0 10 200 876 159 3344 0 10.3 20 400 1460 159 5760 0 12.2 40 800 2579 152 16541 0 13.8 pg_edges_merge (192.168.0.8) (Oracle running) Label Count Avg Min Max Errors Throughput 1 100 262 122 632 0 3.8 10 200 1399 162 6213 0 6.6 20 400 3304 125 20502 0 5.3 40 800 5558 129 27784 0 6.5 pg_edges_merge (192.168.0.8) (Oracle shutdown) Label Count Avg Min Max Errors Throughput 1 100 175 121 364 0 5.6 10 200 610 138 1834 0 14.7 20 400 1127 137 10111 0 15.3 40 800 2116 128 31037 0 15.8 oraclespatial_edges_merge (first run) Label Count Avg Min Max Errors Throughput 1 100 478 223 2430 0 2.1 10 200 1638 340 9326 0 5.6 20 400 3002 350 15648 0 5.7 40 800 4870 241 30377 0 7.3 oraclespatial_edges_merge (second run - restarted DB) Label Count Avg Min Max Errors Throughput 1 100 537 226 3500 0 1.9 10 200 2973 354 15604 0 2.9 20 400 7492 253 68445 0 2.4 40 800 6584 252 64271 0 5.5 oraclespatial_edges_merge (third run - warm DB) Label Count Avg Min Max Errors Throughput 1 100 299 213 554 0 3.3 10 200 845 266 1674 0 10.8 20 400 1687 257 6549 0 10.8 40 800 3027 248 37662 0 11.4 oraclespatial_fcgi_edges_merge Label Count Avg Min Max Errors Throughput 1 100 156 59 489 0 6.3 10 200 1333 66 2097 0 7.1 20 400 2964 110 4832 0 6.4 40 800 2659 119 6952 0 14.5 oracle_ogr_edges_merge Label Count Avg Min Max Errors Throughput 1 100 1662 1340 4672 0 0.6 10 200 5697 1405 46056 0 1.6 20 400 11315 1445 125801 1 1.5 40 800 22650 1493 226373 10 1.6 sde_edges_merge (mapserver 5.4.2) Label Count Avg Min Max Errors Throughput 1 100 962 828 5068 0 1.0 10 200 1228 852 2627 0 7.7 20 400 2417 964 6847 0 7.9 40 800 4480 839 28020 0 8.3 sde_fcgi_edges_merge (mapserver 5.4.2) Label Count Avg Min Max Errors Throughput 1 100 157 70 632 0 6.3 10 200 905 73 2164 0 10.3 20 400 1975 135 5488 0 9.6 40 800 2858 80 5638 0 13.4 **************************************************************** 10/05/2009 - GeoServer ===================== (aaime) shapefiles Label Count Avg Min Max Errors Throughput 1 100 135 66 364 0 7.2 10 200 648 69 4776 0 13.3 20 400 1322 84 19071 0 12.2 40 800 2423 108 34306 0 13.2 shapefiles (alternate renderer) Label Count Avg Min Max Errors Throughput 1 100 130 67 306 0 7.5 10 200 582 70 4693 0 14.5 20 400 1214 79 18773 0 12.6 40 800 2460 74 32166 0 13.2 postgis 192.168.0.8, Oracle running (run a few times, pg was completely swapped out) Label Count Avg Min Max Errors Throughput 1 100 126 66 316 0 7.7 10 200 497 70 3047 0 17.3 20 400 1029 87 12380 0 15.7 40 800 2037 74 30680 0 16.0 postgis 192.168.0.8, Oracle running, with -DUSE_FILTER_RULES=false so that rule filters are not turned into sql equivalents for the datastore (-> postgres actually takes advantage of the extra filtering instead of being drawrfed by it like Oracle... go figure...) Label Count Avg Min Max Errors Throughput 1 100 138 66 349 0 7.1 10 200 532 71 3148 0 16.2 20 400 1053 104 13584 0 14.8 40 800 2150 74 29643 0 15.6 oracle (very high load on the Oracle side, 100% CPU used on the db machine) Label Count Avg Min Max Errors Throughput 1 100 476 160 5245 0 2.1 10 200 1579 153 7617 0 5.8 20 400 4787 265 20168 0 3.9 40 800 6388 217 70499 0 5.6 oracle with -DUSER_FILTER_RULES and upgrading commons-pool to 1.5.3 to avoid deadlocks at high concurrency levels Label Count Avg Min Max Errors Throughput 1 100 161 72 524 0 6.1 10 200 691 82 6493 0 12.5 20 400 1535 91 20439 0 10.3 40 800 2936 82 40156 0 11.1 sde (very high load on the Oracle side, 100% CPU used on the db machine, there are also heavy variations between one run and the next one) Label Count Avg Min Max Errors Throughput 1 100 411 159 738 0 2.4 10 200 1257 163 7858 0 7.2 20 400 2586 258 16891 0 6.8 40 800 5008 169 38018 1 7.1 sde with -DUSE_FILTER_RULES=false so that rule filters are not turned into sql equivalents for the datastore Label Count Avg Min Max Errors Throughput 1 100 167 78 498 0 5.9 10 200 677 112 5140 0 13.2 20 400 1373 117 19647 0 11.4 40 800 2725 89 39707 0 12.0 **************************************************************** 10/05/2009 - MapServer ===================== (jmckenna) *EPSG:4269* *format:image/png* shp_edges_merge Label Count Avg Min Max Errors Throughput 1 100 196 130 336 0 5.0 10 200 680 134 11922 0 10.7 20 400 1459 140 30455 0 10.7 40 800 2638 139 58370 0 11.3 pg_edges_merge (192.168.0.8) (Oracle running) Label Count Avg Min Max Errors Throughput 1 100 219 133 448 0 4.5 10 200 802 153 4216 0 11.2 20 400 1563 195 10065 0 11.3 40 800 2879 154 41889 0 11.5 oraclespatial_edges_merge Label Count Avg Min Max Errors Throughput 1 100 600 267 2583 0 1.7 10 200 5855 378 42958 0 1.6 20 400 14140 461 94660 0 1.3 40 800 17876 328 194364 2 2.0 oraclespatial_fcgi_edges_merge Label Count Avg Min Max Errors Throughput 1 100 306 78 1784 0 3.2 10 200 3123 106 27914 0 2.9 20 400 1886 86 38311 0 8.6 40 800 2718 92 57912 0 12.8 oracle_ogr_edges_merge Label Count Avg Min Max Errors Throughput 1 100 1884 1416 5367 0 0.5 10 200 7046 1412 79257 0 1.2 20 400 11503 1398 182408 1 1.5 40 800 22095 1400 213002 8 1.6 sde_edges_merge Label Count Avg Min Max Errors Throughput 1 100 1026 846 3587 1 1.0 10 200 1367 297 2849 1 7.0 20 400 2645 936 8959 4 7.2 40 800 4859 864 14873 7 7.7 sde_fcgi_edges_merge Label Count Avg Min Max Errors Throughput 1 100 231 85 794 0 4.3 10 200 816 93 4374 0 10.9 20 400 1791 125 17342 0 9.7 40 800 3339 106 18688 0 11.0 *********************************************************************** 10/06/2009 - MapServer ===================== (jmckenna) *labelled minor roads, scale 3000* ************************ shp_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 391 159 920 0 2.5 10 200 2058 182 10451 0 4.5 20 400 2808 165 19354 0 6.5 40 800 3014 158 50673 0 10.5 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 195 132 343 0 5.0 10 200 702 138 11949 0 10.9 20 400 1390 139 22840 0 10.7 40 800 2625 158 53076 0 11.4 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 195 130 337 0 5.1 10 200 741 136 11586 0 10.7 20 400 1484 153 22010 0 11.0 40 800 2861 138 38957 0 11.4 ************************ pg_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 305 132 745 0 3.3 10 200 1296 171 4547 0 7.2 20 400 5218 153 37548 0 3.1 40 800 6667 155 48767 0 5.2 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 318 145 1560 0 3.1 10 200 1187 171 3970 0 7.4 20 400 3104 148 20045 0 5.8 40 800 2934 151 34425 0 11.5 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 227 134 555 0 4.3 10 200 804 170 3372 0 11.3 20 400 1617 193 12369 0 11.2 40 800 2916 150 31239 0 11.6 ************************ oraclespatial_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 540 239 2994 0 1.8 10 200 4830 267 51951 0 1.9 20 400 10659 288 83317 0 1.7 40 800 19248 283 222564 2 1.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 437 242 1290 0 2.3 10 200 1302 277 4437 0 7.2 20 400 2498 310 13316 0 7.3 40 800 3751 272 53401 0 8.9 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 345 226 709 0 2.9 10 200 1068 265 2151 0 8.7 20 400 2073 294 11239 0 8.4 40 800 3684 277 65519 0 8.9 ************************ oraclespatial_fcgi_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 189 98 515 0 5.2 10 200 2041 109 3023 0 4.7 20 400 2358 154 5655 0 8.1 40 800 3729 100 6298 0 10.4 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 187 90 513 0 5.3 10 200 1036 107 1932 0 9.1 20 400 2291 168 4427 0 8.3 40 800 1235 122 4932 589 31.2 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 128 12 3721 50 7.6 10 200 72 13 331 187 80.8 20 400 173 12 1358 383 85.9 40 800 390 12 1179 760 88.1 ************************ oracle_ogr_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 1677 1337 6712 0 0.6 10 200 6139 1535 19857 0 1.5 20 400 11343 1448 99381 0 1.6 40 800 22496 1421 213532 9 1.6 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 1662 1368 3488 0 0.6 10 200 5921 2030 19322 0 1.6 20 400 11686 1453 98528 0 1.5 40 800 22607 1403 239773 11 1.6 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 1637 1369 3428 0 0.6 10 200 5760 1456 17175 0 1.6 20 400 11325 1424 98148 0 1.5 40 800 22181 1435 228290 7 1.6 ************************ sde_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 1011 189 3381 2 1.0 10 200 1358 861 2823 0 6.8 20 400 2554 948 9409 1 7.4 40 800 4844 969 25747 7 7.8 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 971 838 1527 0 1.0 10 200 1329 224 2902 1 7.0 20 400 2563 897 10524 3 7.2 40 800 4819 860 49337 5 7.4 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 969 838 1534 0 1.0 10 200 1364 871 2971 0 7.0 20 400 2522 656 9834 2 7.3 40 800 4825 528 49024 9 7.4 ************************ sde_fcgi_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 213 87 781 0 4.6 10 200 2411 100 4026 0 4.0 20 400 2710 144 7153 0 7.0 40 800 3751 129 9382 0 10.3 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 208 85 760 0 4.7 10 200 815 97 3960 0 11.2 20 400 1768 146 14516 0 9.7 40 800 3312 105 26759 0 11.1 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 208 85 779 0 4.7 10 200 785 99 4382 0 11.2 20 400 1675 116 16847 0 9.7 40 800 3293 118 17423 0 11.2 **************************************************************** 10/07/2009 - MapServer ===================== (jmckenna) ************************ shp_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 195 130 349 0 5.1 10 200 739 135 9728 0 10.2 20 400 1386 144 24399 0 10.7 40 800 2740 139 42461 0 11.5 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 199 132 342 0 5.0 10 200 765 135 5614 0 10.8 20 400 1434 145 24990 0 10.8 40 800 2794 137 51161 0 11.5 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 195 131 337 0 5.1 10 200 733 142 9430 0 11.2 20 400 1448 152 28388 0 11.1 40 800 2814 138 39687 0 11.5 ************************ pg_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 301 132 794 0 3.3 10 200 1382 169 4578 0 6.5 20 400 3258 144 26405 0 5.5 40 800 5275 154 30027 0 6.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 219 132 451 0 4.5 10 200 800 152 2691 0 11.4 20 400 1548 191 14956 0 11.3 40 800 2886 151 37008 0 11.8 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 219 133 453 0 4.5 10 200 782 153 4034 0 11.3 20 400 1538 182 15070 0 11.2 40 800 2850 150 43039 0 11.6 ************************ pg_fcgi_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 154 61 697 0 6.4 10 200 1566 80 2189 0 6.1 20 400 3358 123 4949 0 5.7 40 800 3388 155 7010 1 11.4 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 149 62 382 0 6.6 10 200 812 85 1365 0 11.5 20 400 1786 158 2936 0 10.7 40 800 3383 87 4859 0 11.4 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 149 62 383 0 6.6 10 200 818 81 1366 0 11.4 20 400 1781 148 2957 0 10.7 40 800 3449 89 5725 1 11.2 ************************ oraclespatial_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 699 257 2988 0 1.4 10 200 7651 352 42718 0 1.2 20 400 11968 302 82757 0 1.5 40 800 18320 295 224064 3 1.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 481 240 1828 0 2.1 10 200 3150 272 42578 0 3.0 20 400 6214 282 68763 0 3.0 40 800 3701 262 62507 0 9.1 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 347 237 1108 0 2.9 10 200 1049 269 2820 0 8.8 20 400 2077 303 10192 0 8.4 40 800 3748 273 38055 0 9.1 ************************ oraclespatial_fcgi_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 174 78 508 0 5.7 10 200 1887 96 2834 0 5.1 20 400 2269 161 5611 0 8.4 40 800 3545 98 6307 0 10.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 178 86 509 0 5.5 10 200 806 94 1637 0 11.5 20 400 1782 144 4154 0 10.7 40 800 3399 160 5037 0 11.3 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 182 85 506 0 5.4 10 200 828 104 1667 0 11.3 20 400 1795 148 4191 0 10.5 40 800 3781 108 65118 1 7.8 ************************ oracle_ogr_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 1694 1362 3573 0 0.6 10 200 5926 1515 18828 0 1.6 20 400 11275 1383 100394 0 1.5 40 800 22089 1441 221247 9 1.6 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 1639 1361 3484 0 0.6 10 200 5896 1485 18769 0 1.6 20 400 11282 1447 98136 0 1.6 40 800 21898 1421 224244 7 1.6 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 1605 1338 3359 0 0.6 10 200 5854 1466 19316 0 1.6 20 400 11166 1465 95494 0 1.6 40 800 21625 1423 232069 8 1.6 ************************ sde_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 1053 841 8973 0 0.9 10 200 1339 348 3036 2 6.8 20 400 2561 902 10355 3 7.1 40 800 4826 904 25405 11 7.8 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 969 837 1520 0 1.0 10 200 1356 880 2892 0 7.0 20 400 2574 731 9525 3 7.4 40 800 4914 878 24508 5 7.7 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 970 851 1526 0 1.0 10 200 1350 880 3141 0 6.8 20 400 2520 907 11070 5 7.5 40 800 4813 860 25120 6 7.7 ************************ sde_fcgi_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 209 86 749 0 4.7 10 200 2327 100 3911 0 4.1 20 400 2886 153 6598 0 6.6 40 800 4984 106 8349 0 7.8 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 208 83 755 0 4.8 10 200 1180 102 2717 0 7.9 20 400 2751 158 6577 0 6.9 40 800 4992 104 8420 0 7.7 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 210 85 798 0 4.7 10 200 1182 100 2699 0 7.9 20 400 2745 159 6528 0 7.0 40 800 5000 107 8390 0 7.7 ************************ shp_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 183 127 281 0 5.4 10 200 612 136 10781 0 12.2 20 400 1240 143 19464 0 12.4 40 800 2431 146 39680 0 12.7 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 183 126 285 0 5.4 10 200 634 132 10500 0 12.1 20 400 1288 149 24927 0 12.5 40 800 2442 147 43897 0 12.6 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 183 127 281 0 5.4 10 200 612 145 10649 0 12.4 20 400 1297 157 18162 0 12.8 40 800 2441 145 36129 0 12.7 ************************ pg_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 249 146 520 0 4.0 10 200 718 178 3025 0 12.5 20 400 1320 164 14184 0 13.1 40 800 2466 158 35949 0 12.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 192 136 292 0 5.1 10 200 698 145 3731 0 12.8 20 400 1321 162 14060 0 13.2 40 800 2469 156 39291 0 13.0 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 192 139 289 0 5.1 10 200 712 141 3165 0 12.9 20 400 1328 164 13606 0 13.1 40 800 2477 161 35223 0 13.0 ************************ pg_fcgi_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 121 65 219 0 8.1 10 200 1129 101 1482 0 8.3 20 400 2243 105 2641 0 8.5 40 800 3534 122 5263 0 11.0 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 123 67 221 0 8.0 10 200 566 66 779 0 16.1 20 400 1113 93 1381 0 16.7 40 800 2336 106 2738 0 16.4 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 123 67 220 0 8.0 10 200 569 78 765 0 16.0 20 400 1922 129 2616 0 9.8 40 800 3513 122 5151 0 11.1 ************************ oraclespatial_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 365 240 1311 0 2.7 10 200 873 301 2203 0 10.5 20 400 1626 313 11904 0 11.2 40 800 2993 237 48061 0 11.0 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 307 226 398 0 3.2 10 200 863 260 1975 0 10.7 20 400 1614 262 9222 0 11.1 40 800 3055 244 54135 0 11.1 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 319 242 767 0 3.1 10 200 854 258 1922 0 10.8 20 400 1586 273 10726 0 11.1 40 800 3057 243 40072 0 11.0 ************************ oraclespatial_fcgi_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 155 84 251 0 6.4 10 200 1463 155 1878 0 6.5 20 400 2900 116 3349 0 6.6 40 800 3088 163 6329 0 12.5 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 148 75 239 0 6.6 10 200 693 94 982 0 13.2 20 400 1377 122 1686 0 13.7 40 800 2868 116 3372 0 13.4 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 150 77 240 0 6.6 10 200 700 96 937 0 13.1 20 400 1401 146 1670 0 13.5 40 800 2990 120 5289 0 12.9 ************************ sde_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 919 831 1680 0 1.1 10 200 1095 874 1466 0 8.6 20 400 1944 898 2471 0 9.9 40 800 3866 857 24349 0 9.6 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 911 837 1047 0 1.1 10 200 1083 257 1478 1 8.8 20 400 1919 945 2524 2 10.0 40 800 3769 858 13068 1 9.8 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 911 836 1051 0 1.1 10 200 1094 272 1425 1 8.6 20 400 1890 946 2373 4 10.2 40 800 3712 858 13606 3 9.9 ************************ sde_fcgi_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 155 83 252 0 6.3 10 200 1484 148 1974 0 6.4 20 400 2916 157 3453 0 6.6 40 800 3230 164 6204 0 12.0 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 155 80 259 0 6.4 10 200 739 84 1011 0 12.5 20 400 1463 136 1766 0 12.9 40 800 3004 129 3617 0 12.8 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 154 80 254 0 6.4 10 200 739 85 1006 0 12.5 20 400 1464 144 1765 0 12.9 40 800 3106 124 5624 1 12.4 **************************************************************** 10/08/2009 - MapServer ===================== (jmckenna) ************************ shp_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 221 139 360 0 4.5 10 200 761 174 10158 0 11.1 20 400 1386 154 23849 0 10.7 40 800 2728 138 54290 0 11.3 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 196 130 337 0 5.0 10 200 712 136 12068 0 10.7 20 400 1466 143 18679 0 11.0 40 800 2774 140 43752 0 11.4 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 196 130 342 0 5.0 10 200 754 138 9019 0 11.0 20 400 1474 176 22317 0 11.0 40 800 2901 139 49102 0 11.5 ************************ pg_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 920 230 3324 0 1.1 10 200 4596 281 34807 0 2.0 20 400 4366 156 48586 0 4.0 40 800 5723 157 42776 0 6.1 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 730 134 6569 0 1.4 10 200 1196 177 8265 0 7.5 20 400 1661 190 13525 0 10.5 40 800 2897 151 44434 0 11.6 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 220 133 452 0 4.5 10 200 829 153 2578 0 11.3 20 400 1590 189 18057 0 11.1 40 800 2903 151 35207 0 11.7 ************************ pg_fcgi_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 150 62 383 0 6.6 10 200 564 77 1656 0 15.8 20 400 1210 119 3529 0 15.3 40 800 2356 100 4474 0 16.3 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 149 62 384 0 6.6 10 200 569 81 1548 0 15.8 20 400 1193 148 3762 0 15.4 40 800 2345 91 4079 0 16.4 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 148 62 382 0 6.6 10 200 567 80 1543 0 15.8 20 400 1208 120 3931 0 15.1 40 800 2345 95 3885 0 16.4 ************************ oraclespatial_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 800 306 4484 0 1.2 10 200 9969 371 77768 0 0.9 20 400 16002 316 132708 1 1.1 40 800 18858 407 127883 1 1.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 474 259 1192 0 2.1 10 200 3007 248 39791 0 3.0 20 400 3976 282 37077 0 4.6 40 800 3790 252 42876 0 8.9 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 377 237 2111 0 2.6 10 200 1088 281 2815 0 8.4 20 400 2130 364 10305 0 8.5 40 800 3804 279 46568 0 9.0 ************************ oraclespatial_fcgi_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 175 77 508 0 5.6 10 200 716 91 1861 0 12.8 20 400 1540 143 4999 0 12.2 40 800 2985 113 5679 0 12.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 175 80 505 0 5.6 10 200 726 93 2445 0 12.8 20 400 1564 149 5580 0 12.0 40 800 2999 141 5301 0 12.8 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 176 82 506 0 5.6 10 200 724 95 2186 0 12.6 20 400 1601 138 6112 0 11.6 40 800 2991 99 5997 0 12.8 ************************ oracle_ogr_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 1658 1345 5212 0 0.6 10 200 5918 1493 18109 0 1.6 20 400 11332 1430 99851 0 1.6 40 800 22044 1444 234949 7 1.6 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 1607 1335 3365 0 0.6 10 200 5838 1546 21302 0 1.6 20 400 11018 1390 89361 0 1.5 40 800 21881 1381 205833 7 1.6 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 1616 1361 3372 0 0.6 10 200 5861 1453 19251 0 1.6 20 400 11189 1438 100845 0 1.6 40 800 22138 1402 213202 7 1.6 ************************ sde_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 1050 840 9021 0 0.9 10 200 1334 862 2929 0 6.9 20 400 2549 811 9792 5 7.4 40 800 4875 927 15258 7 7.7 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 969 839 1520 0 1.0 10 200 1339 486 3165 1 6.9 20 400 2553 902 9978 5 7.3 40 800 4852 712 27116 12 7.7 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 967 842 1524 0 1.0 10 200 1363 434 3103 2 6.7 20 400 2576 858 9022 1 7.3 40 800 4820 870 15275 5 7.7 ************************ sde_fcgi_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 225 84 779 0 4.4 10 200 815 97 3175 0 11.1 20 400 1876 155 10722 0 9.8 40 800 3486 124 8700 0 11.0 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 208 84 756 0 4.7 10 200 829 96 3321 0 11.1 20 400 1872 145 10886 0 9.8 40 800 3471 106 8797 0 11.0 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 209 85 786 0 4.7 10 200 827 97 3181 0 11.1 20 400 1858 116 10855 0 9.7 40 800 3506 125 8897 0 11.0 ************************ shp_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 188 129 280 0 5.3 10 200 627 129 11325 0 11.9 20 400 1277 148 16812 0 12.8 40 800 2525 145 34322 0 12.7 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 184 128 282 0 5.4 10 200 621 132 11800 0 12.2 20 400 1254 146 15864 0 12.3 40 800 2238 148 39648 0 12.6 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 183 129 279 0 5.4 10 200 661 140 10219 0 11.9 20 400 1268 152 20346 0 12.7 40 800 2612 149 34001 0 12.6 ************************ pg_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 258 144 512 0 3.8 10 200 714 156 2153 0 12.4 20 400 1297 164 15433 0 12.9 40 800 2563 157 30476 0 12.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 193 137 290 0 5.1 10 200 690 150 5447 0 12.6 20 400 1325 161 12610 0 13.0 40 800 2610 168 28397 0 13.0 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 193 140 289 0 5.1 10 200 648 150 9650 0 12.2 20 400 1334 164 13620 0 13.1 40 800 2600 157 36829 0 13.0 ************************ pg_fcgi_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 122 66 220 0 8.0 10 200 478 71 1042 0 18.6 20 400 957 131 1651 0 19.4 40 800 1997 122 2969 0 19.1 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 122 66 220 0 8.0 10 200 484 68 1112 0 18.6 20 400 953 95 1629 0 19.4 40 800 2001 160 2747 0 19.1 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 122 66 220 0 8.0 10 200 488 67 1304 0 18.6 20 400 963 109 1538 0 19.4 40 800 2004 131 2873 0 19.1 ************************ oraclespatial_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 364 222 640 0 2.7 10 200 866 269 3058 0 10.4 20 400 1844 260 10264 0 9.9 40 800 3046 246 46429 0 11.0 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 299 239 401 0 3.3 10 200 858 274 2394 0 10.5 20 400 1641 279 7825 0 11.2 40 800 3075 283 29276 0 11.1 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 309 221 395 0 3.2 10 200 865 265 2047 0 10.8 20 400 1626 262 10110 0 11.2 40 800 3132 256 48177 0 10.9 ************************ oraclespatial_fcgi_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 143 81 240 0 6.8 10 200 527 83 1126 0 17.1 20 400 1055 135 1617 0 17.7 40 800 2210 129 3000 0 17.4 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 142 79 236 0 6.9 10 200 534 83 1161 0 17.0 20 400 1065 114 1836 0 17.6 40 800 2216 140 2871 0 17.3 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 144 82 244 0 6.8 10 200 540 79 1162 0 16.8 20 400 1067 106 1644 0 17.5 40 800 2222 182 3062 0 17.3 ************************ oracle_ogr_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 1472 1325 2855 0 0.7 10 200 211 65 2493 200 36.4 20 400 437 65 5512 400 36.7 40 800 897 66 11585 800 37.5 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 1363 1258 1562 0 0.7 10 200 214 64 3170 200 36.2 20 400 420 64 5633 400 36.9 40 800 871 65 11906 800 37.3 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 1379 1247 1578 0 0.7 10 200 208 64 3346 200 35.5 20 400 436 66 6318 400 36.9 40 800 817 64 14927 800 37.3 ************************ sde_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 920 837 1488 0 1.1 10 200 1103 897 1566 0 8.7 20 400 2010 915 2415 0 9.6 40 800 3924 854 24451 3 9.1 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 913 833 1109 0 1.1 10 200 1104 875 1625 0 8.5 20 400 2021 914 2453 0 9.5 40 800 3717 427 94544 1 7.0 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 911 837 1044 0 1.1 10 200 1077 250 1464 2 8.8 20 400 1939 914 2460 1 9.9 40 800 3764 862 24391 0 9.7 ************************ sde_fcgi_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 153 81 250 0 6.4 10 200 543 80 1331 0 16.8 20 400 1081 133 1831 0 17.4 40 800 2234 125 3148 0 17.2 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 153 80 250 0 6.4 10 200 549 83 1128 0 16.4 20 400 1078 148 1793 0 17.4 40 800 2234 154 2979 0 17.2 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 153 80 258 0 6.4 10 200 538 80 1393 0 16.4 20 400 1074 113 1848 0 17.4 40 800 2228 137 3286 0 17.2 **************************************************************** 11/08/2009 - GeoServer ===================== (aaime) ************************ shp_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 129 67 309 0 7.6 10 200 594 71 5469 0 14.7 20 400 1230 81 16437 0 12.8 40 800 2361 73 35755 0 13.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 129 66 307 0 7.6 10 200 578 70 3948 0 14.6 20 400 1198 89 16455 0 13.1 40 800 2484 75 33478 0 13.4 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 128 66 305 0 7.6 10 200 585 69 4393 0 15.0 20 400 1180 82 17174 0 12.9 40 800 2299 73 32700 0 13.9 ************************ pg_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 794 116 4762 0 1.3 10 200 5043 147 54899 0 1.6 20 400 6549 81 71373 0 2.6 40 800 6681 73 75700 0 4.8 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 251 64 11737 0 3.9 10 200 525 70 2680 0 15.5 20 400 1091 95 14257 0 14.5 40 800 2175 73 28789 0 15.0 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 134 64 350 0 7.3 10 200 546 70 3029 0 16.0 20 400 1062 73 15860 0 14.3 40 800 2148 74 29654 0 15.5 ************************ oracle_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 380 99 2260 0 2.6 10 200 7491 139 95451 0 1.2 20 400 11991 94 123964 0 1.4 40 800 19252 86 256377 0 1.8 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 183 72 1301 0 5.4 10 200 2236 77 41777 0 3.7 20 400 7244 73 100477 0 2.3 40 800 3001 84 45868 0 10.3 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 164 70 631 0 6.0 10 200 714 77 6858 0 11.8 20 400 1516 85 20407 0 9.7 40 800 3149 83 45042 0 10.5 ************************ sde_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 170 75 1013 0 5.8 10 200 720 80 5243 1 11.0 20 400 1412 97 18999 0 10.7 40 800 5362 77 79382 0 5.4 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 211 75 855 0 4.7 10 200 943 82 16089 0 8.5 20 400 1842 98 27022 0 8.9 40 800 2613 88 36196 0 11.9 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 162 75 415 0 6.1 10 200 630 80 4378 0 12.8 20 400 1423 113 21292 0 11.4 40 800 2650 88 35597 0 11.9 ************************ shp_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 158 66 341 0 6.2 10 200 674 63 2483 0 13.5 20 400 1330 88 5688 0 13.6 40 800 2865 85 13871 0 12.4 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 156 67 421 0 6.3 10 200 648 63 2598 0 13.4 20 400 1303 80 6401 0 13.6 40 800 2832 84 15384 0 12.8 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 178 66 2346 0 5.5 10 200 656 72 2674 0 13.3 20 400 1281 88 6908 0 13.7 40 800 2789 84 13949 0 12.8 ************************ pg_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 377 65 1211 0 2.6 10 200 840 87 4142 0 10.4 20 400 1240 92 6163 0 14.5 40 800 2690 85 14589 0 13.3 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 152 64 326 0 6.5 10 200 618 62 2670 0 14.2 20 400 1198 118 5824 0 14.7 40 800 2707 93 16387 0 13.3 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 151 65 365 0 6.5 10 200 623 62 2340 0 14.2 20 400 1222 79 5361 0 14.6 40 800 2715 90 13412 0 13.2 ************************ oracle_edges_merge_dallas ************************ ******** Manual run, found an error in the scripts after the automated one ******** Label Count Avg Min Max Errors Throughput 1 100 157 71 502 0 6.3 10 200 703 80 5785 0 12.2 20 400 1503 100 22153 0 10.5 40 800 2872 83 39420 0 11.3 ************************ sde_edges_merge_dallas ************************ MIA. will rerun later **************************************************************** 15/08/2009 - GeoServer ===================== (aaime) (the SDE tests have been run the 16th) ************************ shp_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 168 77 1609 0 5.8 10 200 640 78 3451 0 13.7 20 400 1436 110 11094 0 12.7 40 800 2532 74 9394 0 14.9 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 129 67 304 0 7.6 10 200 568 72 3776 0 14.7 20 400 1329 83 9415 0 13.1 40 800 2539 74 9514 0 15.0 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 128 68 302 0 7.6 10 200 576 70 3468 0 15.0 20 400 1335 73 11907 0 13.1 40 800 2516 161 8624 0 15.1 ************************ pg_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 318 90 1748 0 3.1 10 200 2314 161 17075 0 3.8 20 400 5622 103 24362 0 3.3 40 800 7349 115 26154 0 5.1 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 144 64 475 0 6.8 10 200 551 70 2703 0 15.6 20 400 1250 102 8849 0 14.6 40 800 2377 101 6343 0 16.1 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 136 64 456 0 7.2 10 200 535 69 3363 0 16.3 20 400 1205 110 8441 0 14.8 40 800 2275 72 6426 0 16.6 ************************ oracle_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 229 70 2020 0 4.3 10 200 2582 76 16955 0 3.3 20 400 11760 110 62938 0 1.5 40 800 18638 132 90481 0 2.0 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 265 71 1200 0 3.7 10 200 2890 97 48418 0 2.9 20 400 5720 115 36987 0 3.3 40 800 3005 94 10302 0 12.6 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 168 69 1005 0 5.9 10 200 653 77 4156 0 12.5 20 400 1541 94 12389 0 11.5 40 800 2962 89 11390 0 12.7 ************************ sde_edges_merge ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 164 76 417 0 6.0 10 200 653 86 3612 0 13.2 20 400 1553 103 12512 0 11.5 40 800 2866 96 10289 0 13.1 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 163 77 416 0 6.0 10 200 682 83 4478 0 12.8 20 400 1540 106 11992 0 11.6 40 800 2954 94 10083 0 12.9 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 162 76 456 0 6.1 10 200 663 82 3695 0 13.3 20 400 1539 114 12150 0 11.6 40 800 2906 88 9128 0 13.0 ************************ shp_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 192 67 623 0 5.1 10 200 703 112 2040 0 12.8 20 400 1389 135 3121 0 13.6 40 800 2841 170 4954 0 13.5 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 157 65 336 0 6.3 10 200 673 64 1761 0 13.2 20 400 1416 88 4241 0 13.2 40 800 2821 133 5097 0 13.6 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 157 65 460 0 6.3 10 200 677 63 1895 0 13.4 20 400 1347 88 3302 0 13.9 40 800 2908 129 5816 0 13.2 ************************ pg_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 233 65 608 0 4.2 10 200 645 113 2237 0 14.2 20 400 1252 104 2869 0 14.9 40 800 2612 104 3954 0 14.7 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 152 65 327 0 6.5 10 200 625 63 1795 0 14.5 20 400 1351 120 3747 0 14.0 40 800 2604 118 4388 0 14.7 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 150 65 319 0 6.6 10 200 646 63 1566 0 14.3 20 400 1247 132 3277 0 14.9 40 800 2606 105 4239 0 14.7 ************************ oracle_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 229 72 613 0 4.3 10 200 707 94 2140 0 12.9 20 400 1459 100 4827 0 12.8 40 800 2787 128 5015 0 13.8 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 163 70 353 0 6.0 10 200 709 68 1848 0 13.2 20 400 1367 119 3023 0 13.6 40 800 2873 110 5969 0 13.3 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 164 71 350 0 6.0 10 200 676 69 2276 0 13.2 20 400 1336 100 2954 0 13.9 40 800 2826 120 4663 0 13.5 ************************ sde_edges_merge_dallas ************************ ******** RUN 1 ******** Label Count Avg Min Max Errors Throughput 1 100 174 73 367 0 5.7 10 200 707 73 2602 0 12.8 20 400 1398 107 2852 0 13.4 40 800 2903 123 5489 0 13.3 ******** RUN 2 ******** Label Count Avg Min Max Errors Throughput 1 100 178 75 365 0 5.5 10 200 698 72 1910 0 12.9 20 400 1401 163 3206 0 13.4 40 800 3033 188 5992 0 12.7 ******** RUN 3 ******** Label Count Avg Min Max Errors Throughput 1 100 177 76 359 0 5.6 10 200 692 76 2318 0 12.8 20 400 1409 152 2773 0 13.3 40 800 2915 126 5514 0 13.1