Академический Документы
Профессиональный Документы
Культура Документы
Corporation. All other names are used for identification purposes only
and may be trademarks of their respective owners.
Empirix, Inc.
Contents
Contents
Preface
About This Guide ............................................................................................v
Conventions......................................................................................................v
Related Documentation...................................................................................vi
e-TEST Suite Printed Manuals ..............................................................vi
Other Printed Manuals ..........................................................................vii
Electronic Documentation......................................................................vii
Using Help ...................................................................................................viii
Obtaining Technical Support .........................................................................ix
Chapter 1
Using e-Reporter
System Requirements .......................................................................................2
Installing and Starting e-Reporter ...................................................................3
e-Test Console..................................................................................................3
Main Window Features...................................................................................4
Overview of the Menu Options................................................................6
Setting the Chart Application...........................................................................7
Saving Data for Reporting ...............................................................................8
Using the e-Reporter Wizard ........................................................................10
Generating e-Load Reports ....................................................................10
Generating e-Monitor Reports...............................................................16
Changing Report Options ......................................................................21
Opening Reports in Microsoft Excel .....................................................22
Running Scenario Reports .............................................................................24
Exporting Generated Data.............................................................................25
Exporting Generated Data......................................................................25
Exporting HTML..................................................................................26
Managing Session Data .................................................................................27
iii
Contents
Using WebReporter
System Requirements .....................................................................................50
Installation ......................................................................................................50
Starting WebReporter....................................................................................51
Using Help .............................................................................................53
Generating e-Load Reports ...........................................................................54
Selecting Data for Reporting ..................................................................54
Selecting Data Series...............................................................................55
Generating e-Monitor Reports ......................................................................59
Selecting Data for Reporting ..................................................................59
Selecting Data Series...............................................................................61
Using the Chart View.....................................................................................64
Using the Data View...............................................................................65
About Report Names ..............................................................................66
About Support Files and Directories......................................................66
I n d e x ..........................................................................................................67
iv
Preface
Welcome to the e-Reporter User Guide. This guide explains the system
requirements, installation, and how to use the features and options of
e-Reporter and WebReporter.
Conventions
This guide uses the following typographical conventions to identify
specific items:
Convention
Description
Sans Serif
Fixed-Pitch type
Program code.
Preface
Related Documentation
The e-TEST suite includes a complete set of printed manuals, electronic
manuals, and online help.
vi
Preface
ServerStats User Guide explains how to use the features and options of
ServerStats to monitor operational performance of a variety of application
servers, Web servers, database servers and systems.
e-Reporter User Guide explains how to use the features and options of
e-Reporter and WebReporter to generate graphs and reports for e-Load,
e-Monitor, and ServerStats performance data.
Electronic Documentation
The e-TEST suite download from our Web site automatically installs an
Adobe Portable Document Format (PDF) version of the Getting Started
with e-TEST suite manual and an e-Spider Tutorial. These documents
require the Adobe Acrobat Reader, version 4.x, to open and view the
.PDF files. You can download the free Acrobat Reader from the Adobe
Web site: http://www.adobe.com/products/acrobat/readstep2.html.
The Getting Started with e-TEST suite PDF file is an option on the
e-TEST suite Start menu. The e-Spider Tutorial PDF file is copied to the
e-TEST suite installation directory (C:\Empirix\eTEST is the default).
The installation also includes a readme.doc file that contains release notes
and the latest updates to the product documentation. The readme.doc file
opens in Microsoft Wordpad when you select the Release Notes option
on the e-TEST suite Start menu. Also included is an e-Monitor v5.0 to
v5.1 conversion documentation (Wm50-51Conv.pdf) file that explains how
to migrate existing 5.0 Shell Scripts to 5.1 jobs and schedules.
The full e-TEST suite documentation set is provided on the product CDROM in Adobe Portable Document Format (PDF). You can use the
vii
Preface
Acrobat Reader, version 4.x, to view, search, and print the documentation
set. The e-TEST suite CD-ROM includes the Acrobat Reader application.
You can install Acrobat Reader using the e-TEST suite CD-ROM setup
program or by selecting ar40eng.exe in the Acrobat Reader directory. See
the Adobe Web site, http://www.adobe.com, for additional information
about Acrobat Reader.
The full documentation set includes the following files:
All of the .PDF files are in the Documentation directory of the product
CD-ROM. The e-Test Suite Getting Started.pdf, e-Spider Tutorial.pdf,
WM50-51Conv.pdf, and readme.doc files are installed during the e-TEST
suite setup procedure. You can copy the user guide .PDF files to a local
drive or open them in Acrobat Reader from the CD-ROM.
If you downloaded the product from the our Web site and wish to receive
electronic versions of the User Guides in .PDF format, please send an
email message to webtest_support@empirix.com. Youll need the Acrobat
Reader v4 to open and view the documents.
The e-TEST suite CD-ROM also includes the Microsoft Visual Basic
Scripting Edition (VBScript) Language Reference documentation. You
can install the files using the e-TEST suite CD-ROM setup program or by
selecting vbsdoc.exe in the MS VB Script Documentation directory.
Using Help
e-Reporter provides a comprehensive online help system. The help topics
include step-by-step how to instructions for common tasks and a
complete reference.
You can press the F1 key at any open dialog box for an explanation of the
options. You can select Help Contents to open the online help contents
and index.
viii
Preface
Fax.
Key Requests: To request a software license key, please call (781) 9938500 or send your request via email to keys@empirix.com.
ix
Preface
Chapter 1
Using e-Reporter
e-Reporter lets you generate a variety of reports based on performance
data and statistics from an e-Load Autopilot session or from an
e-Monitor session. The e-Reporter database also stores data from
ServerStats counters.
You can use e-Reporter to select the session and generate reports or you
set the e-Load Session Management options to automatically generate a
report at the end of an Autopilot session.
e-Reporter generates the following types of reports for e-Load sessions:
E Errors vs. Time
E Errors vs. Users
E Performance vs. Time
E Performance vs. Users
E Statistics vs. Time
You can choose specific user profiles to include in an e-Load session report.
You can also combine e-Load session data and ServerStats counter data in
e-Load reports.
System Requirements
System Requirements
The e-TEST suite has the following system requirements:
E Operating System: Microsoft Windows NT 4.0, Windows 2000, or
recommended
suite.
1.
e-Test Console
e-Reporter runs from the e-TEST Console, along with e-Load,
ServerStats, and e-Monitor.
The toolbars that are displayed in the Console window are based on the
application with which you are working and can be selected by clicking
the right mouse button and choosing the toolbar you want.
This chapter explains the e-Reporter menus and interface. Refer to the
appropriate manuals for the other menus and features.
e-Load Statistics
Values on Left
Y-Axis
ServerStats Counter
Values on Right Y-Axis
The graphs appear as a window within the reports pane. The reports pane
can have multiple reports open at the same time. e-Reporter also lets you
open and customize the graph and access the raw data.
The legends show which color line represents which virtual user profile,
Visual Script page, and ServerStats counter. The legends for e-Load data
show the session, the virtual user profile, and the Visual Scripts page. The
legends for ServerStats data show the machine name, counter object,
counter instance, and counter in the form machine.object.instance.counter.
e-Reporter Menu
These menu options let you work with e-Reporter reports. The following
options are available:
Query Wizard Load Data opens the e-Reporter Wizard, which provides a
convenient way to generate reports from e-Load and ServerStats session data.
Query Wizard Monitor Data opens the e-Reporter Wizard, which provides
E Statistics vs Time displays the statistics vs time report for the latest
load session.
Latest Monitor
Monitor Job generates reports for the latest e-Monitor job. The
following options are available:
E Performance Chart displays the performance chart report for the
Database Management
Management opens a dialog box for converting 5.0 data to the
new 5.1 schema, and committing and deleting Autopilot session data in
the database.
Create New Database opens a dialog box for creating a new database.
2.
Open the RSW.INI file in any ASCII text editor, such as Notepad. The
RSW.INI file is located in the WINNT directory for Windows NT.
3.
UseExcel=FALSE
4.
2.
Set the Save data for reporting option to either Yes or Ask.
3.
4.
Set the Assign new session name option to either Yes or Ask.
5.
Click OK.
6.
7.
If you set options to Ask, e-Load opens a dialog box for selecting the
e-Load session name and the ServerStats workspace and configuration
file to use for reporting.
10
time of execution.
user count.
count.
11
Click the Next button to display the Time Options screen of the wizard.
date and time values or a relative timeline. The following options are available:
E Absolute when selected, the generated reports are based upon the
actual start and end date and times of the profile/timer. You can
specify the Start-End dates and times in the form mm/dd/yy
hh:mm:ss [AM|PM].
Precision specifies the precision of the data points in the graph. The
job.
in the report.
Click the Next button to get to the Data Series screen of the Wizard.
13
include in the report graphs. The profile is the name of the virtual user
profile(s) that were run in the Autopilot session. Select the counter(s)
and click the arrow button or double-click with the mouse to add
counters(s) to the Selected Data Series list.
E Timer Folders list the page timers available to include in the report
14
click the arrow button or double-click with the mouse to add timer(s)
to the Selected Data Series list.
E ServerStats Folders
Folders list the ServerStats counters available to include in
the report graph. The ServerStats counters are based upon the data
source(s) and counters that were included in the ServerStats Data
Source configuration when the e-Load or e-Monitor session was run.
Select the counter(s) and click the arrow button or double-click with
the mouse to add counter(s) to the Selected Data Series list.
Selected Data Series lists the selected counters that will be included in
the report.
Use the arrow buttons to add counters to or remove counters from the
Selected Data Series list.
Run Default generates the default report for the selected report type
using the selected session data, time options, and data series.
Finish generates the report using the selected settings.
Select the data series you want to include in the chart and click Finish. The
chart appears in a new window in the Console.
You can export the data to an HTML file, .csv file, or a Microsoft Excel
Workbook file.
Chapter 1: Using e-Reporter
15
16
time of execution.
execution.
Select the type of report and click Next to display the Time Options screen
of the Wizard or Run Default.
17
date and time values or a relative timeline. The following options are available:
E Absolute when selected, the generated reports are based upon the
actual start and end date and times of the profile/timer. You can
specify the Start-End dates and times in the form mm/dd/yy
hh:mm:ss [AM|PM].
E Relative
Relative when selected, the generated reports are based upon
Precision specifies the precision of the data points in the graph. The
Time Range specifies the start and end dates and times for data included
in the report. The following options are available:
E Maximal time range specifies to retrieve all data for the session or
job.
in the report.
Click the Next button to get to the Data Series screen of the Wizard.
19
in the job, and each page of each Visual Script in the job. Select the
counter(s) and click the arrow button or double-click with the mouse to
add counter(s) to the Selected Data Series list.
the report graph. The ServerStats counters are based upon the data
source(s) and counters that were included in the ServerStats Data
Source configuration when the e-Load or e-Monitor session was run.
Select the counter(s) and click the arrow button or double-click with
the mouse to add counter(s) to the Selected Data Series list.
Selected Data Series lists the selected counters that will be included in
the report.
Use the arrow buttons to add counters to or remove counters from the
Selected Data Series list.
Run Default generates the default report for the selected report type
using the selected session data, time options, and data series.
Finish generates the report using the selected settings.
20
Select the data series you want to include in the chart and click Finish. The
chart appears in a new window in the Console.
You can export the data to an HTML file, .csv file, or a Microsoft Excel
Workbook file.
21
3.
4.
5.
22
1.
2.
3.
The workbook contains a chart sheet and a worksheet. You can use the
features and capabilities of Microsoft Excel to change the chart format.
You can also view the actual data values by clicking the data tab:
23
The filename of the workbook is the current date and time with a .xls
extension.
The A1 cell contains the session information. Rows two and three contain
the profile, timer, and counter headings and the report type. Subsequent
rows contain the actual data values for the chart.
24
Select a session and click OK. e-Reporter opens window containing the report.
2.
3.
4.
Click Save.
25
You can import the .csv file into another application, such as Microsoft
Excel, to create additional report types.
The first line of the .csv file contains the field names separated by
commas. Each additional line contains the data values separated by
commas. The following is an example of a .csv file from a Performance
vs. Time report:
Time,Entire Job,tutor1,tutor4,
04-09-2001 15:59:48,,.6,,
04-09-2001 16:00:00,,,.13,
04-11-2001 17:08:04,,1.15,,
04-11-2001 17:08:29,1.39,,.24,
04-11-2001 17:09:19,,.98,,
04-11-2001 17:09:25,,,.12,
The additional lines of the .csv file list the actual data (the time values
followed by the number of seconds).
The .csv file for each type of report will contain the type of data specific to
the report type.
Exporting HTML
When you export HTML from a table report, e-Reporter exports an .htm
file and a subdirectory. The subdirectory contains an HTML file for each
chart, a cascading style sheet file, an .xml file, and .gif files for
graphics.
The subdirectory <name> is the name you specified when you exported
the HTML with _files appended to it. You can open the report in a
browser by double-clicking <name>.htm in the Reporter directory.
The HTML files (chart<number>.htm) contain the table structure and
headings for each chart. The cascading style sheet (name.css) file contains
the formatting information for the table.
If you distribute the exported files, you should distribute all of the files
together to properly view the reports. You can view the report in Internet
Explorer without the .css file, but the formatting (color, text style, and
alignment) will be lost.
26
2.
3.
Enter a <name> for the subdirectory that will contain the files.
4.
Click Save.
By default, e-Reporter saves the files to the Reporter directory under the
Empirix installation directory (C:\Empirix\eTEST is the default).
Autopilot. e-Load lets you specify a name for the session data when
you start the Autopilot to playback virtual users.
E Start shows the time of day the virtual user session was started.
Chapter 1: Using e-Reporter
27
E End shows the time of day the virtual user session ended.
E Delete deletes the selected session data from the database.
E Update updates session data in the database for committed
sessions.
28
Save data
server
convert to SQL and keep the data for use in version 5.1, you must convert
the database to SQL in version 5.0 using the importing procedure. You
cannot convert from MSAccess to SQL in version 5.1 and keep the 5.0
data.
The following sections explain the procedures for creating a blank SQL
database, importing to SQL, and connecting to SQL Server.
29
30
2.
Right click on Microsoft SQL Server and select New SQL Server
Registration. The Wizard opens the introduction screen.
3.
Click Next
Next. The Wizard opens the Select a SQL Server screen.
4.
5.
Click Next. The Wizard displays the Select and Authentication Mode
Screen.
6.
7.
8.
9.
31
32
10.
Click Next. The Wizard displays the Select SQL Server Group
screen.
11.
Accept the defaults and click Next. The Wizard displays the
Completing the Register SQL screen.
12.
Click Finish. The server will now be listed in the tree on the left.
Expand the tree.
13.
33
14.
15.
16.
17.
18.
19.
20.
Enter the database name as created in the DSN field in the ODBC
Data Source Administrator.
21.
22.
Click Create.
34
2.
Click Next. The Wizard opens the Choose a Data Source screen:
3.
Select Microsoft Access in the Source list. The Wizard changes the
settings for Microsoft Access:
4.
Click the
copy from.
Chapter 1: Using e-Reporter
35
36
5.
Click Next. The Wizard opens a screen for specifying the destination:
6.
Select Microsoft OLE DB Provider for SQL Server in the Destination list.
7.
8.
9.
10.
11.
Click OK.
12.
Click Next. The Wizard opens a screen for specifying the Table Copy
setting:
13.
14.
Click Next. The Wizard opens a screen for selecting the source tables:
37
38
15.
Select the check boxes next to all of tables in the Source Tables list.
The Wizard updates the screen to the Destination Tables and the
transform buttons:
16.
Click the
button in the CounterHdr row. The Wizard opens a
screen for Column Mappings and Transformations:
17.
18.
19.
Click Edit SQL. The Wizard opens a dialog box for editing the SQL:
20.
21.
39
22.
23.
Click the
button in the CounterRun row. The Wizard opens a
screen for Column Mappings and Transformations:
24.
40
25.
26.
25.
Source
From
To
CounterRun
counterTS
smalldatetime
datetime
ErrorRun
errorAbsTS
smalldatetime
datetime
groupedData
interfract
smalldatetime
datetime
loadDistBins
interfract
smalldatetime
datetime
SessionRun
start_TS
finish_TS
smalldatetime
datetime
41
42
26.
Click Next after all of the tables are updated. The Wizard opens a
scheduling screen:
27.
28.
29.
Click Finish. The Wizard shows the progress of the data transfer:
30.
43
44
2.
3.
4.
5.
6.
Select SQL Server and click Finish. The ODBC Administrator opens
a dialog box for naming the data source:
7.
8.
9.
Select the SQL Server where the e-Reporter SQL database is located.
45
46
10.
11.
12.
If the Network
Network libraries option is set to Named Pipes, change it to
TCP/IP.
13.
14.
12.
Change the default database to the correct reporter database on the SQL
Server. The name is the same name that was defined when the e-Reporter
MSAccess database was converted to an SQL Server database.
13.
14.
If necessary, set any information for your system and click Finish.
47
15.
16.
All e-TEST suite components that access the e-Reporter database will now
use the SQL Server database.
48
Chapter 2
Using WebReporter
WebReporter is subset of the capabilities provided in e-Reporter.
WebReporter can be run on a Web Server and accessed using the
Internet Explorer browser. WebReporter accesses the e-Reporter database
to generate reports about e-Load sessions, e-Monitor sessions, and
ServerStats counters.
You can use WebReporter to select the session and generate reports. The
session data must be saved and committed to the e-Reporter database
before you can use WebReporter to generate reports.
WebReporter requires Microsoft Excel to be installed on the server.
WebReporter generates the following types of e-Load/ServerStats reports:
E Errors vs. Time
E Errors vs. Users
E Performance vs. Time
E Performance vs. Users
E Statistics vs. Time
E Statistics vs. Users
You can choose specific user profiles to include in an e-Load session
report. You can also combine e-Load session data and ServerStats counter
data in e-Load reports.
WebReporter generates the following types of e-Monitor/ServerStats
reports:
E Distribution of Average Performance
E Distribution of Number of Errors
E Distribution of Error Rate
E Errors vs. Time
E Errors vs. Time, Daily Schedule
E Errors vs. Time, Weekly Schedule
E Performance vs. Time
49
System Requirements
You can choose specific e-Monitor data and scripts to include in an eMonitor session report. You can also combine e-Monitor session data and
ServerStats counter data in e-Monitor reports.
Before you can use WebReporter to generated charts, you must first have
generated data using e-Load, e-Monitor, or ServerStats. See the Saving
Data for Reporting section in the Using e-Reporter chapter of the e-Load
User Guide for specific details.
System Requirements
WebReporter has the following system requirements:
E Microsoft Windows NT Server or Windows 2000 Server
E Microsoft Windows NT 4.0 Option Pack
E Microsoft Internet Information Server (IIS)
E Microsoft Excel 2000
E Microsoft Internet Explorer
E e-TEST suite v5.0 or higher
WebReporter is also supported on Microsoft Windows NT Workstation
and Personal Web Server.
Installation
Be sure you have installed the required Microsoft NT and Web server
components before installing Web Reporter.
There are two ways that you can install e-TEST suite:
1.
50
Starting WebReporter
2.
Starting WebReporter
WebReporter is an Active Server Pages application that runs in a browser.
To start WebReporter:
1.
2.
Using WebReporter
51
Starting WebReporter
3.
52
Starting WebReporter
Using Help
Each page of WebReporter includes a help link that opens the online help
for the page. The Help information appears in a secondary window on top
of WebReporter:
Click the
Using WebReporter
53
54
execution.
E Errors vs. Users reports the number of errors by active virtual user count.
E Performance vs. Time reports performance by time of execution.
E Performance vs. Users reports performance by active virtual user count.
E Statistics vs. Time reports the total Kbytes/hits/transactions by e-Load
Using WebReporter
55
The available data series differ depending upon the type of query you
selected.
Performance vs. Time returns the performance values over time. You
can select performance for the overall session or performance for specific
Visual Scripts or ServerStats counters.
Performance vs. Users returns the average run time for the number of
transaction.
E Min Server Time/Trans the minimum server request wait time per
transaction.
E Max Server Time/Trans the maximum server request wait time per
transaction.
Errors vs. Time returns the percentage of virtual users with errors over
time.
Errors vs. Users returns the percentage of errors for the total number of
aggregation interval.
E Trans Failed (User Test)/sec the rate at which User Test transactions
Statistics vs. Time returns the average hits, transactions, and kilobytes
E Pages Rcvd/sec the number of pages received for the interval divided
Using WebReporter
57
Each type of report has a different set of fields. Select one or more fields
to include in the report and click Next. WebReporter generates a
Microsoft Excel chart in the browser.
Click one of the tabs to view charts for individual data series. Click the
Data Table tab to view the data.
58
name.
Select Query lists the available reports, as follows:
Using WebReporter
59
of execution.
execution.
60
Using WebReporter
61
The available data series are the same for all reports. Select the job and the
script for which you want to generate a report and click Next.
WebReporter generates a Microsoft Excel chart in the browser.
62
Click one of the tabs to view charts for individual data series. Click the
Data Table tab to view the data.
Using WebReporter
63
The left-side y-axis represents the values for e-Load statistics. The rightside y-axis represents the values for the ServerStats statistics.
The tabs at the bottom of the graph let you switch among various chart
views and the data view.
You can use the browser options to print the graph or save the file to
different name.
64
You can use the browser options to print the graph or save the file to
different name. You can also open the report in Microsoft Excel using the
Edit with Microsoft Excel for Windows option on the Internet Explorer File
menu.
Using WebReporter
65
66
Index
Average Performance Distribution
menu option, 6
Chart View, 64
Create New Database menu option, 7
Data Series, 55, 61
Data View, 65
Database Management menu option, 7
e-Load Reports, 54
e-Monitor
Job Report, 6
e-Reporter
Absolute Time, 12, 18
Connect SQL Server Database, 44
Create SQL Database, 29
Deleting sessions, 28
Export Generated Data, 25
Export HTML, 26
Export HTML Page, 7
Finish Time, 13, 19
Import Database to SQL Server, 34
Management, 7
Managing Sessions, 27
Menu options, 6
Relative Time, 12, 18
Return to e-Reporter Wizard, 7
Save ServerStatistics, 8
Scenario Report, 6
Session Description, 27
Session Name, 27
Session Report, 6
Show Legend, 7
SQL Server, 28
Start Time, 13, 19
Switch to Microsoft Excel, 7
System requirements, 2
Using the Wizard, 10
Export CSV file menu option, 7
Export HTML Page menu option, 7
Generate Reports, 10
Generating
e_Monitor Reports, 59
e-Load Reports, 54
Generating Queries, 6
Help, 53
Installation, 50
Introduction, 1
Latest Load Session menu option, 6
Latest Monitor Job menu option, 6
Load Reports, 54
Main Window Features, 4
Menu options
Average Performance Distribution,
6
Create New Database, 7
Database Management, 7
Export CSV File, 7
Export HTML Page, 7
Latest Load Session, 6
Latest Monitor Job, 6
Performance Chart, 6
Performance Chart, Weekly
Schedule, 6
Performance vs Time Report, 6
Performance vs Users, 6
Query Wizard Load Data, 6
Query Wizard Monitor Data, 6
Report Right Click, 7
Return to e-Reporter Wizard, 7
Scenario Report, 6
Session, 6
Show Legend, 7
Statistics vs Time, 6
Switch to Microsoft Excel, 7
Monitor Reports, 59
Naming Conventions for Reports, 66
Performance Chart menu option, 6
Performance Chart, Weekly Schedule
menu option, 6
67
Index
68
Session menu, 6
Show Legend menu option, 7
SQL Server
Connect e-Reporter Database, 44
Creating an e-Reporter Database, 29
Importing e-Reporter Database, 34
Using with e-Reporter, 28
Starting WebReporter, 51
Statistics vs Time menu option, 6
Switch to Microsoft Excel menu
option, 7
System Requirements, 50
System Requirements, 2
WebReporter
Installation, 50
Starting, 51
System Requirements, 50
Wizard, 10