Академический Документы
Профессиональный Документы
Культура Документы
Quality Manager
Skill Level: Intermediate
28 Oct 2008
For this exercise, you will be testing BookPool.com. It is good to use as an example
because it is intuitive (most people have ordered something online) and it has plenty
of features and content. Before you start testing, you need to create a new user.
2. If this is the first time that you have started Rational Quality Manager on
this server, it can take a couple minutes to load. When the dashboard
finishes loading, look for the Admin menu. From that menu, select Jazz
User Administration (see Figure 1).
3. That will load the User Management screen with "Active Users" as the
default. On that screen, select Create User.
4. Enter a name (use your name), user ID, and e-mail address (your
e-mail address), and then select the appropriate Repository
,Permissions and Client Access Licenses for your new user (see
Figure 2).
Note:
Notice that the new user is created with a default password that is the same as the
user ID. Later, that user ID and password will be what you use to log in.
6. When the user has been created, you should see the confirmation
message that says "User created successfully. Return to Manage Users"
(Figure 3).
7. When you see that message, click the Return to Manage Users link. You
will see the user that you created listed under Active Users.
• Create and manage test cases and associate them with the test plan
• Size the overall test planning and test execution effort and define
schedules for each test iteration
Follow these steps to see how to create a simple test plan by using the default test
plan configuration:
1. Log out of Rational Quality Manager and log back in as the user that you
just created. This time when your dashboard loads, you will see your
name (assuming that you entered your name when you created the user
record).
2. In the left navigation area, click the Planning icon and select Create Test
Plan.
3. When the Create Test Plan tab finishes loading, start by entering a name
for the test plan in the header and selecting the template type. Set the
Template field to Default Test Plan Template.
4. After you have done that, click Save. (Until you get comfortable working in
the tool, save early and save often.)
6. This brings up the Create Work Item dialog view (Figure 5). All you need
to do is to select an owner and a due date. When you have done that,
click OK.
• First, it creates a task link in the Work Item field where the Create link
used to be.
• Second, it creates a work item that is assigned to you for tracking
something that you need to do.
Note:
You do not need to navigate all 15 sections of the default test plan now. All you need
in the plan is basic information so that you can navigate through the key features of
the tool.
7. Next, navigate to the Requirements section and click the Add New
Requirement icon:
8. This will open a form for entering requirement details. Under the
Overview tab, enter a Summary and a Description.
This example also includes a requirement for the Subject navigation panel on the
BookPool.com home page, with details copied from that Web site into the form.
Figure 6 shows the completed information:
9. You can add any requirement. When you are finished, click Save.
You should see your requirement added to the table in the section detail, as Figure 7
shows. Notice the link under the Status ID column. (But do not click it, because it is
another Work Item link, and you' will see more on that later in this article).
10. Next, navigate to the Test Cases section and click the Add New Test
Case icon:
11. This will open a form for entering test case details. Enter a Name,
Description, Template, and Owner.
This example shows a test case added for the navigation panel referenced in the
requirement added previously (see Figure 8).
Note:
You have the option to enter Category, Function, and Theme. Those three values
are included to give you a way to classify test cases for subsequent grouping and
reporting. On a default installation, the drop-down menus beside those fields are
probably blank. When you log in as an administrator, you can assign values to them
by going to Admin > System Properties > Test Case Categories, or you can
simply click the Manage Test Case Categories icon, which is available in both the
test plan and test case views:
12. Before you move on, make sure that you enter a Weight. The idea behind
setting a weight for a test case is that not all test cases are equal; some
are more important than others. Later, after you run the test, you can use
the weight to distribute your results (youll see that in what follows). If a
test marginally passes, but some things dont fully work, you can say 70%
pass, 30% fail by using the weight sliders. With a weight of 1, this is
impossible. That is why using a scale of 1-100 works well.
You should see your test case added to the list in the section detail (Figure 9).
14. That should be enough to get you going, so click Save again.
After saving, you can close the test plan tab by clicking the X icon next to the test
plan name:
Or, you could dig into specific work items contained in your test plan by selecting
them directly from the plan.
In many enterprise-level tools, one of the biggest challenges can be tracking the
work assigned to you. Rational Quality Manager helps with that by providing
customizable dashboards that can help you not only track project status but also
keep track of the work you and the rest of the team need to do.
Navigate back to the default dashboard to see some of the default viewlets:
1. Either close your test plan or simply click the Home tab to return to the
default dashboard.
2. When you get there, you may need to refresh the view to get the update
that shows the work that you just did. To do that, simply click the Refresh
button:
3. One of the first viewlets to load, under the Welcome viewlet, should be
one titled My Tasks. That viewlet should contain both the test case and
the test plan section documentation task that were created earlier.
Selecting any of those links takes you directly to the work item so you can work on it.
Tip:
Clicking on this viewlet takes you to a more detailed reporting tool for requirements
coverage where you can customize parameters for reporting.
5. You should also see an "Execution status per tester" chart and another
chart for "Unfinished work item count." They are not included here
because they are large and, at this point, not very exciting.
You will see additional viewlets for defect tracking and test execution. The goal here
is to get those to populate before you finish this exercise. However, it is also
important that you see how easy it is to create your own viewlets to customize your
dashboard.
Now that you have a request out there, it is time to look at some of the different
options that you have to find it. There are two basic ways to monitor requests:
• The first is the brute force method, which is to look at all the requests and
filter based on different criteria.
• The second method is similar but a bit more elegant, you can add a
viewlet to your dashboard.
Here, you will add a viewlet, but you can get to the same files by clicking the Lab
Management icon and selecting All Requests.
6. On your dashboard (the Home tab), click the down arrow on the General
tab (Figure 12) and select Add Viewlet.
8. This should add the Work Item Statistics viewlet to your dashboard,
probably at the top of the screen. You can move it around, but wherever it
is, you should see a message stating "No work item query defined" yet.
To define a query, click the Select a query link in that status message
(Figure 14).
The first thing that you need to do is to select the query that you want to run. To
keep this example fairly simple, you wll use one of the predefined queries.
9. Click Edit next to the Query field, where you can select any of the
predefined queries in the Work Item Queries view. For this exercise,
selected Open assigned to me.
10. When you have selected the query, click OK. This carries your query over
to the viewlet settings.
11. Next, under the Preferences tab, select the Parameter that you want to
view. For now, select Type from the drop-down menu next to the
Parameter field (see Figure 16).
12. When you click Save, the viewlet should load, based on the query
settings you selected (Figure 17).
This is an interactive viewlet. Selecting one of the areas of the viewlet will load a
table of work items related to the query. Using these views can be easy ways to
track the work that you have in front of you, as well as to navigate Rational Quality
Manager.
1. In the navigation pane at the left, select the Requirements icon and then
select All Requirements.
2. That will load a table containing the requirement for the various
BookPool.com subject categories. Click the requirement ID link in the
table to load the requirement.
The first thing to do is to get this requirement moving through the requirements
process workflow.
3. To start work on the requirement, click the arrow next to the drop-down
menu by the title field and select Start Working:
That action signals to the rest of the team that you are working on this.
Your description already contains the list of categories from when you created it
earlier, but assume that you want to add a new category called Software Testing.
6. If you look back to the top, you will see that the status changed
automatically to In Progress.
7. To submit this requirement for approval, select Stop Working from the
status drop-down menu.
Now that the requirement is updated, it is time to go back to the dashboard and take
a look at that test case you created earlier.
Test cases describe what you are going to test. In Rational Quality Manager, they
often include preconditions and post-conditions for test execution and describe the
expected results. You can create a new test case independent of any test plan, or
you can create a new test case in the context of an existing test plan. When you add
a test script to a test case, it is listed in the Test Scripts section of the test case.
Note:
Rational Quality Manager integrates with IBM® Rational® Functional Tester, IBM®
Rational® Manual Tester, IBM® Rational® Performance Tester, and IBM®
1. In the navigation view on the left, click the Construction icon and select
My Test Cases.
2. That should load a table containing your test case for testing
BookPool.com navigation by subject category. Go ahead and click on the
test case id link in the table to load the test case.
3. You should notice a layout similar to the test plan you saw earlier: table of
contents, section detail, and header. Things work pretty much the same.
Select the section you want to work with, make your changes, and save.
6. This loads a a table of your current requirements. Select the check box
next to your subject categories requirement and click OK. You will then
see your requirement listed in the Requirements table in the test case
(see Figure 19).
7. Click Save so that you do not lose what you have done.
8. For a quick diversion, click the Home tab and check your test coverage
report again. You will need to Refresh your dashboard view. When it has
reloaded, you will see that you now have 100% requirements coverage
(see Figure 20).
9. To go back and run your test case, click the Test subject navigation tab
(the tab for your test case) to returns to where you were before when you
added the requirement.
Next, you need to add a simple test script to your test case. This example requires
only a couple of steps, but it gives you a feel for the entire workflow.
1. To create a test script, select the Test Scripts section in the Table of
Contents.
2. To add a test script to your test case, click the Add New Test Script icon:
.
3. When the New Test Script dialog loads (see Figure 21), enter a Name
and Description. Unless you have other tools integrated with Rational
Quality Manager, the only type of test script available will be Manual.
4. When you are finished, click OK to list the new test script in the Test
Scripts section (Figure 22).
5. Click the test script link. If you are asked to save the test case before
viewing the new test script, click Yes. This loads a new tab with your test
script.
6. Under the Manual Steps section (Figure 23), click the Click to add link to
start adding test steps. The default test step type is Execution Step. Each
time that you add a new step, the Click to add link moves down one row
in the Manual Steps table.
8. Add a second step to verify that the subjects you added in the
requirement that you created earlier are listed. To turn that step into a
Verification Point, click the icon next to the step number and select
Verification Point (Figure 24).
9. To save the test script, click Save and then close it and return to the test
case.
Now you can run the test case and look at your results in the dashboard:
1. In the upper-right corner of the test case, click Run Test Case, which will
open the Run Test Case dialog. (Most of the fields on that dialog cannot
be populated, because there is additional setup required for some
features before you are production-ready).
Figure 25
This opens the script execution screen. You should see a test progress bar and a
section detailing the test script steps. As you run your test, you can add
attachments, log defects, and add comments to the script. In the Script Steps
section, the small yellow arrow points to the row that shows the status of the step
(Figure 26).
4. When you are ready to execute a step, click the Apply icon to move to
the next step:
You will see that the Result for Step 1 gets checked off, and the execution progress
bar moves to 50% (Figure 27).
5. When you are executing a verification point, you can select several
results. In this example, select Fail so that you can see some of the other
features at work. When you apply the Failed status, you should see a
Failed result. The progress bar moves to 100%, and an "Execution
Complete" message is added to your script (Figure 28).
6. When you are finished, click Close and show results to bring up the
Execution Result screen.
7. From there, you can set the Actual Result for your test, as Figure 29
shows (in case you want to show the test as passed, blocked,
inconclusive, or another status, instead).
Tip:
Although this example did not show it, you can also see what test environment the
script was executed against .
9. Review the Results Detail by clicking the Link to Results History option
for that test case (Figure 31).
11. For another quick diversion, click the Home tab and check the test
execution report. You will need to Refresh your dashboard again. When it
has reloaded, you should see that you now have execution results (Figure
32).
12. To go back to the execution results, click the Execution Result tab.
For this example, the test result is set to Failed for two reasons.
• First, BookPool.com does not have the Software Testing category that
you added to the requirements.
• Second, that offers a chance to explain how to log a defect. Just follow
the next steps.
13. From the Execution Result screen, click the Defects icon and select Add
New Defect from the drop-down menu.
14. This should open the defect entry dialog. You will be required to enter a
Summary (or title), and it is advisable to also set the Priority.
When you return to your test results, you should see the defect related to the results
in the upper-right corner (Figure 33).
This gives you a defect that is tied to your test execution results, which is tied to your
test case, which is also tied to both your test plan and your requirement. You
probably get the picture from here: reports galore!
Next steps
Rational Quality Manager is intended to be an environment for both decision-makers
and testers. Like all Rational software, it comes with default workflows and settings,
but you can customize most of it for your projects. Rational Quality Manager
captures test-related data in one central location and makes that data available to
everyone on the team. It tracks task ownership and responsibility for individuals and
teams, which makes task progress and status of deliverables clear.
Your challenge as you start to get more involved in using this software will hot be
getting it to do what you want but will be in figuring out how to effectively use all of
the information provided and learning how to customize some of the common
features and artifacts to be most effective for you and the way you work. Keep an
eye on IBM® developerWorks® for future articles on intermediate and advanced
Rational Quality Manager topics.
Digg
this
story
Post
to
del.icio.us
Slashdot
it!
Resources
Learn
• Visit the Rational software area on developerWorks for technical resources and
best practices for Rational Software Delivery Platform products.
• Read author Mike Kelly's related article on developerWorks: Lab management
with IBM Rational Test Lab Manager.
• For tips, tricks, and updates, track the IBM Rational Quality Manager blog for
technical resources and best practices for Rational Software Delivery Platform
products.
• See the Rational Quality Manager product roadmap on developerWorks - a
resource roadmap for all users.
• Explore Rational computer-based, Web-based, and instructor-led online
courses. Hone your skills and learn more about Rational tools with these
courses, which range from introductory to advanced. The courses on this
catalog are available for purchase through computer-based training or
Web-based training. Additionally, some "Getting Started" courses are available
free of charge.
• Subscribe to the Rational Edge newsletter for articles on the concepts behind
effective software development.
• Subscribe to the IBM developerWorks newsletter, a weekly update on the best
of developerWorks tutorials, articles, downloads, community activities, webcasts
and events.
• Browse the technology bookstore for books on these and other technical topics.
Get products and technologies
• To find more information about IBM Rational Quality Manager and related
products, see the Rational Quality Manager page on developerWorks.
• Download trial versions of IBM Rational software.
• Download these IBM product evaluation versions and get your hands on
application development tools and middleware products from DB2®, Lotus®,
Tivoli®, and WebSphere®.
Discuss
• Participate in the discussion forum for this content.
• Check out developerWorks blogs and get involved in the developerWorks
community.