Benchmark REST Dynamic-AGS10

Environmental Systems Research Institute, Inc., 380 New York St.
, Redlands, CA 92373-8100 USA TEL 909-793-2853 FAX 909-307-3014
Performance and Scalability Benchmark

ArcGIS Server 10 REST Dynamic Map Service Export Map
Version 2.0
Prepared by:
ESRI Professional Services
Enterprise Implementation Services Team
Redlands, California
June 28, 2010
Performance and Scalability Benchmark: ArcGIS Server 10 REST Dynamic Map Service Export Map
OBJECTIVE ................................................................................................................................................... 3
APPLICATION ARCHITECTURE ............................................................................................................ 3
HARDWARE AND SOFTWARE CONFIGURATION ............................................................................ 3
BENCHMARK RESULTS ............................................................................................................................ 4

4.1
4.2
CAPACITY PLANNING .............................................................................................................................. 6

5.1
5.2
5.3
CPU SPECRATE .............................................................................................................................................. 7

PERFORMANCE AND SCALABILITY ....................................................................................................................... 7
CPU SERVICE TIME ......................................................................................................................................... 7
TRANSACTION SIZE .......................................................................................................................................... 7
BENCHMARK VARIATION IMAGE SIZE ........................................................................................ 10

7.1
7.2
7.3
CPU SPECRATE .............................................................................................................................................. 6

CPU SERVICE TIME ......................................................................................................................................... 6
TRANSACTION SIZE .......................................................................................................................................... 6
BENCHMARK VARIATION IMAGE FORMAT .................................................................................. 7

6.1
6.2
6.3
6.4
PERFORMANCE AND SCALABILITY ....................................................................................................................... 4

RESOURCE UTILIZATION ................................................................................................................................... 5
PERFORMANCE AND SCALABILITY ..................................................................................................................... 10

CPU SERVICE TIME ....................................................................................................................................... 10
TRANSACTION SIZE/TIME ............................................................................................................................... 10
APPENDIXES .............................................................................................................................................. 13
8.1 BENCHMARK APPROACH ................................................................................................................................ 13
8.2 BENCHMARK CONFIGURATION......................................................................................................................... 13
8.3 TRANSACTION DESCRIPTION ............................................................................................................................ 13
8.4 DATA DESCRIPTION ....................................................................................................................................... 13
8.5 TESTING TOOLS ............................................................................................................................................ 13
8.6 APPLICATION ............................................................................................................................................... 14
8.7 MXD DESCRIPTION ....................................................................................................................................... 14
8.8 DEFINITIONS ................................................................................................................................................ 17
8.8.1 Performance and Scalability ............................................................................................................. 17
8.8.2 CPU Service Time Web ...................................................................................................................... 17
8.8.3 CPU Service Time ArcGIS SOC ............................................................................................................ 17
8.8.4 CPU Service Time DB ......................................................................................................................... 17
Objective
This benchmarks objective is to measure and present the performance and scalability of the ArcGIS Server 10
REST API map service using the Portland Metro Area dataset. The dataset was tested without the raster layers.
For details on the benchmarking process, see Capacity Planning and Performance Benchmark Reference Guide.
Application Architecture
This benchmark will isolate the ArcGIS Server 10 REST API dynamic map service.
For details on ArcGIS Server services, see: ArcGIS Server Web Service API.
Hardware and Software Configuration

Figure 1: Hardware Diagram
Diagram Key:
Web SOM SOC RDBMS File
Benchmark Results
This section reports key performance and scalability information. For details and practical application of these
results, see Capacity Planning and Performance Benchmark Reference Guide.
4.1
Performance and Scalability

Figure 2: Key Test Results
System capacity marker

defined by maximum throughput
Max Throughput
Applied Load
Avg. Response Time Avg. Response Time
(Transactions/hour) At Max Throughput
At Applied = 1
At Max Throughput
(Sec.)
(Sec.)
6
0.21
0.37
58,580
4.2
Resource Utilization
Figure 3: Key Resource Utilization
Counter
Instance
Category
Computer
Applied Load
% Processor Time
% Idle Time
Available MBytes
Bytes Sent/sec
_Total
_Total
0 C:
Broadcom BCM5708C NetXtreme II GigE [NDIS VBD Client]
LoadTest:Scenario
Processor
PhysicalDisk
Memory
Network Interface
Test Client
ArcGIS Server
ArcGIS Server
ArcGIS Server
ArcGIS Server
Color Range
10
100
100
10,000
1,000,000
Min
Max
Avg
1
13.9
95.3
5,891
58,248
6
100
100
6,251
768,797
4
74.5
99.8
6,059
532,772
Capacity Planning
This section provides the input for a capacity planning model. For details and practical application of the
capacity planning information, see Capacity Planning and Performance Benchmark Reference Guide.
5.1
CPU SpecRate
SpecRate/CPU = 13.425
Total CPU Cores = 4
5.2
CPU Service Time

Web SOC/SOM
Database
(Sec.)
(Sec.)
(Sec.)
0.01
0.20
N/A: RDBMS not utilized
5.3
Transaction Size
Average map size: 40,865 bytes
Benchmark Variation Image Format
This section provides supplemental benchmarks conducted subsequently. This benchmark has been varied by
image format type.
JPEG, 1280x1024
PNG 8, 1280x1024
PNG 24, 1280x1024
PNG 32, 1280x1024
6.1
CPU SpecRate
4 CPU cores.
SpecRate/CPU= 13.425
6.2
Variation
JPEG
PNG 8
PNG 24
PNG 32
6.3
Maximum Throughput
User Load
(Transactions/hour)
At Max Throughput
46,860
58,580
52,880
53,280
6
6
6
6
Avg. Response Time Avg. Response Time

At User Load = 1
At Max Throughput
(Sec.)
(Sec.)
0.027
0.46
0.21
0.37
0.024
0.41
0.024
0.40
CPU Service Time

Variation Web SOC/SOM
Database
(Sec.)
(Sec.)
(Sec.)
JPEG
0.01
0.25
PNG 8
0.01
0.20
PNG 24
0.01
0.23
PNG 32
0.01
0.23
6.4
Transaction Size
Variation Transaction Size
(bytes)
JPEG
239,164
PNG 8
40,865
PNG 24
75,625
PNG 32
78,183
Figure 4: Image Type Variation Throughput
Figure 5: Image Type Variation Response Time
Benchmark Variation Image Size
This section provides supplemental benchmarks conducted subsequently. This benchmark has been varied by
return image size.
800x600, png8
1024x768, png8
1280x1024, png8
7.1
7.2

Variation
Maximum
Throughput
(Transactions/hour)
User Load at
Max Throughput
800x600
1024x768
1280x1024
172,400
77,400
58,580
5
5
6
Avg. Response
Time
At User Load = 1
(Sec.)
0.07
0.16
0.21
CPU Service Time

Variation
Web SOC/SOM
Database
(Sec.)
(Sec.)
800x600
0.01
0.06
1024x768 0.01
0.16
1280x1024 0.01
0.20
7.3
Transaction Size/Time
Variation
Transaction Size
(bytes)
800x600
6,310
1024x768
26,957
1280x1024
40,865
10
Avg. Response Time

At Max Throughput
(Sec.)
0.10
0.23
0.37
Figure 6: Image Size Variation Throughput
11
Figure 7: Image Size Variation Response Time
12
8
8.1
Appendixes
Benchmark Approach
This benchmark has been designed to isolate and measure the performance and scalability of ArcGIS Server 10
REST Export Map within the defined environment. This will be accomplished by applying a load using
Microsoft Visual Studio 2008 System (VSTS) 2008.
The VSTS benchmark script will apply load by randomly requesting 1280 x 1024 PNG 8 images from a large
pool of defined map extents. As this load is increased, the benchmark environment will react accordingly. Load
will be increased at a constant rate until the performance trends are observed and key values identified.
8.2
Benchmark Configuration
Property
TestID
Service Type
SOC/CPU
Think Time
Image Resolution
Image Format
Applied Load Increase
8.3
Value
8352
Map Service (msd)
2.5
0
1280 x 1024
PNG 8
16, by 1
Transaction Description
A transaction is defined as one requested map extent.

8.4
Data Description
Portland Metro Area, File Geodatabase (approx. 4.5 GB)
8.5
Testing Tools
Microsoft Visual Studio Test System 2008 edition
Perfmon
SPECint2000
13
8.6
Application
Figure 8: Application Sample
8.7
MXD Description
Item
1
2
3
4
7
8
9
10
11
12
At Scale
101,814
101,814
101,814
101,814
50,000
50,000
50,000
50,000
50,000
50,000
Layer Name
Railroad
Major Roads
Portland Metro
Rivers and Lakes
Park and Ride
Railroad Station
Light-rail
Railroad
Major Roads
Portland Metro
Features
540
1382
1
15
13
6
20
93
746
1
14
Vertices
1897
17710
4919
75113
0
0
469
412
7137
4919
Layer Type
esriGeometryPolyline
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
Refresh Time
(sec.)
0.13
0.63
0.17
0.11
0.06
0.06
0.06
0.08
0.33
0.08
Item
13
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
54
55
56
57
58
59
At Scale
50,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
24,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
10,000
5,000
5,000
5,000
5,000
5,000
5,000
Layer Name
Rivers and Lakes
Schools
City Hall
Fire Stations
Hospitals
Libraries
Airports
Park and Ride
Railroad Station
Light-rail
Railroad
Major Roads
Portland Metro
Streams
Streams and Ponds
Rivers and Lakes
Parks
Schools
City Hall
Fire Stations
Hospitals
Libraries
Airports
Park and Ride
Light-rail Stops
Railroad Station
Light-rail
Railroad
Major Roads
Minor Streets
Portland Metro
Streams
Streams and Ponds
Rivers and Lakes
Parks
Zoning
Schools
City Hall
Fire Stations
Hospitals
Libraries
Airports
Features
1
27
0
1
0
3
0
4
1
0
1
15
1
602
14
0
149
7
0
0
0
1
0
0
0
0
0
0
0
532
1
129
4
0
50
230
1
0
0
0
0
0
15
Vertices
42431
0
0
0
0
0
0
0
0
0
7
1069
4919
9125
488
0
5152
0
0
0
0
0
0
0
0
0
0
0
0
3975
4919
2422
77
0
1450
14657
0
0
0
0
0
0
Layer Type
esriGeometryPolygon
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
Refresh Time
(sec.)
0.09
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.08
0.06
0.08
0.11
0.09
0.08
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.08
0.06
0.06
0.06
0.13
0.11
0.08
0.09
0.06
0.06
0.06
0.06
0.06
0.06
Item
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
At Scale
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
5,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
1,000
Layer Name
Park and Ride
Bus Stops
Light-rail Stops
Railroad Station
Light-rail
Railroad
Major Roads
Minor Streets
Portland Metro
Streams
Streams and Ponds
Rivers and Lakes
Building Permits
Tax Lots
Parks
Zoning
Schools
City Hall
Fire Stations
Hospitals
Libraries
Airports
Park and Ride
Bus Stops
Light-rail Stops
Railroad Station
Light-rail
Railroad
Major Roads
Minor Streets
Portland Metro
Streams
Streams and Ponds
Rivers and Lakes
Building Permits
Tax Lots
Parks
Zoning
Features
0
16
0
0
0
0
0
148
1
30
3
0
148
1062
6
84
0
0
0
0
0
0
0
0
0
0
0
0
0
6
1
6
1
0
7
61
0
8
16
Vertices
0
0
0
0
0
0
0
918
4919
552
64
0
0
14152
209
5873
0
0
0
0
0
0
0
0
0
0
0
0
0
21
4919
104
27
0
0
976
0
1439
Layer Type
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPoint
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPoint
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPoint
esriGeometryPolygon
esriGeometryPolygon
esriGeometryPolygon
Refresh Time
(sec.)
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.13
0.06
0.06
0.14
0.13
0.09
0.11
0.08
0.09
0.06
0.06
0.06
0.13
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.06
0.16
0.16
0.06
0.08
0.08
0.08
8.8
8.8.1
Definitions
Performance can be expressed as response time (RT) at a single-user load.
Scalability is determined using one of the following criteria:
o When first error occurs
o When maximum throughput is reached
o When required response time is exceeded
8.8.2 CPU Service Time Web

Calculated from the following process:
W3wp.exe
8.8.3 CPU Service Time ArcGIS SOC
Calculated from the following process:
ArcSOC.exe
8.8.4
CPU Service Time DB

17

Benchmark REST Dynamic-AGS10

Загружено:

Сведения о документе

Авторское право

Доступные форматы

Поделиться этим документом

Поделиться или встроить документ

Параметры публикации

Этот документ был вам полезен?

Это неприемлемый материал?

Авторское право:

Доступные форматы

Benchmark REST Dynamic-AGS10

Загружено:

Авторское право:

Доступные форматы

Environmental Systems Research Institute, Inc., 380 New York St.

, Redlands, CA 92373-8100 USA TEL 909-793-2853 FAX 909-307-3014

Performance and Scalability Benchmark

APPLICATION ARCHITECTURE ............................................................................................................ 3

HARDWARE AND SOFTWARE CONFIGURATION ............................................................................ 3

BENCHMARK RESULTS ............................................................................................................................ 4

CAPACITY PLANNING .............................................................................................................................. 6

CPU SPECRATE .............................................................................................................................................. 7

BENCHMARK VARIATION IMAGE SIZE ........................................................................................ 10

CPU SPECRATE .............................................................................................................................................. 6

BENCHMARK VARIATION IMAGE FORMAT .................................................................................. 7

PERFORMANCE AND SCALABILITY ....................................................................................................................... 4

PERFORMANCE AND SCALABILITY ..................................................................................................................... 10

Hardware and Software Configuration

Performance and Scalability

System capacity marker

CPU Service Time

Benchmark Variation Image Format

Performance and Scalability

Avg. Response Time Avg. Response Time

CPU Service Time

Figure 4: Image Type Variation Throughput

Figure 5: Image Type Variation Response Time

Benchmark Variation Image Size

Performance and Scalability

CPU Service Time

Avg. Response Time

Figure 6: Image Size Variation Throughput

A transaction is defined as one requested map extent.

8.8.2 CPU Service Time Web

CPU Service Time DB

Вам также может понравиться