Alpha- and Beta- testing for CS

192 Software Engineering II

Software Engineering 1
 Objective
●
At the end of the session, student should be able to:
– Understand alpha- and beta-testing procedures and protocols to be
used in their projects
– Know the expected deliverables at each testing activity

Software Engineering 2
 Alpha & Beta Testing
●
It is a form of validation testing which consists of a
series of acceptance tests that enables customers
and end-users to validate all requirements.
●
Alpha-testing
– is conducted with people who are involved in the
development process.
– Testers: 5 CS 192 Classmates
●
Beta-testing
– is conducted with people who are the intended users of the
software.
– Testers: 30 non-CS 192 Classmates

Software Engineering 3
 Alpha-testing Activity
Tasks
Testing Environment Prepare software for
alpha-testing
Prepare testing
environment
Checklist Prepare the Alpha-testing
Checklist
Prepare alpha-testing
result tally sheet
Facilitation Facilitate alpha-testing
with testers
Test other group’s
software
Report Tally alpha-testing results
Synthesize and Compile
Alpha-testing
Software Engineering
Output
Alpha Release (link
created at github)
Test Environment
(Hardware, Software, etc.)
5 hardcopies of the Alpha-
testing Checklist
1 softcopy of alpha-testing
results tally sheet
Filled-up Alpha-testing
Checklist
Filled-up alpha-testing
results tally sheet
Alpha-testing Report
4
 Alpha Release
●
Alpha-release of the software in github.
– To define a release, here is the instructions:
https://help.github.com/articles/creating-releases/

Software Engineering 5
 Document Template
Alpha-testing Checklist Alpha-testing Checklist.odt
Alpha-testing Results Tally Sheet Alpha-testing Tally.ods
Alpha-testing Report Alpha-testing Report (version 2.0)odt

Software Engineering 6
 Alpha-testing Points
●
Quality of Software Released (80 pts.)
– From Tally Sheet: ((Functionality + SUS)/2)*.8)
●
Effort (max 20 pts.)
– Testing Environment (max of 10 pts.)
– Facilitation (max of 10 pts.)
– Tester of other group (max of 5 pts.)
– Checklist ( max of 5 pts.)
– Report (max of 5 pts.)

Software Engineering 7
 Beta-testing Tasks
Tasks Output
Testing Environment Prepare software for beta- Beta Release (link created
testing at github)
Prepare testing Test Environment
environment (Hardware, Software, etc.)
Checklist Prepare the Beta-testing 30 hardcopies of the Beta-
Checklist testing Checklist
Prepare beta-testing result 1 softcopy of beta-testing
tally sheet results tally sheet
Facilitation Facilitate beta-testing with Filled-up beta-testing
testers checklist
Report Tally beta-testing results Filled-up beta-testing
results tally sheet
Synthesize and Compile Terminal Report
Terminal Report
Video Presentation of Video of Project
Project

Software Engineering 8
 Beta Release
●
Beta-release of the software in github.
– To define a release, here is the instructions:
https://help.github.com/articles/creating-releases/
●
Installation and Configuration instructions a page in
your github project site.

Software Engineering 9
 Document Templates
Beta-testing Checklist Beta-testing Checklist.odt
Beta-testing Results Tally Sheet Beta-testing Tally.ods
Terminal Report Terminal Report (version 1.0).odt

Software Engineering 10
 Beta-testing Points
●
Quality of Software Released (70 pts.)
– From Tally Sheet: ((Functionality + SUS)/2)*.7)
●
Effort (max 20 pts.)
– Testing Environment (max of 10 pts.)
– Facilitation (max of 10 pts.)
– Checklist ( max of 5 pts.)
– Report (max of 5 pts.)
– Video (max of 5 pts.)

Software Engineering 11
 Video Presentation
●
A video containing your project.
●
Outline:
– I. Project Description
– II. Methodology
●
How was the Agile Methdology used within your project
– III. Results
●
A. Use Case (implemented only)
●
B. Software Architecture (implemented only)
●
C. Beta-testing Results
●
D. Demonstration of Software
●
E. Lessons Learned
– IV. Summary
●
Duration: 15-20 minutes.
Software Engineering 12
 Summary
●
Alpha-testing
– Activities
– Points
●
Beta-testing
– Activities
– Points

Software Engineering 13