ExampleApp Functional Specification Author: Version:

Overview:

Structure:

The "Details" worksheet contains the detailed specification for each story. Each story is specified in "use case" format (ref. "Writing Effective Use Cases", Alistair Cockburn, 2001).

The "Actors" workheet specifies all actors (users and external systems) The "Stats" worksheets show development progress for individual increments, in the form of a "burn down chart"

ExampleApp Functional Specification Tony Heap This is a living document and is not formally version controlled. Accordingly, there is no formal sign-off of the document as a whole. Rather, each "acceptance criterion" is signed off individually (see the "Agreed" columns on the "Details" worksheet). This document (together with a number of supplementary documents) is the functional specification for the "ExampleApp" project. This document specifies what the system will do as opposed to how it will do it (i.e. It is not a technical specification). This document specifies only the changes to the system; it does not specify existing functionality. The functional specification consists of a set of "stories". Each story describes some aspect of the system's behaviour, either functional or non-functional. A story is the smallest unit of system delivery - a story is either delivered or it is not. In practice, stories are grouped together and delivered as (time-boxed) "increments" every 3-4 weeks. The "Summary" worksheet is an inventory of all the stories, along with various information for each one. In particular, the "Status" column in the "Summary" worksheet indicates the status of each story, from "being elaborated" right through to "gone live". The "Details" worksheet contains the detailed specification for each story. Each story is specified in "use case" format (ref. "Writing Effective Use Cases", Alistair Cockburn, 2001). See the column heading comments on the "Summary" and "Details" worksheets for further details on the format of the specification. The "Actors" workheet specifies all actors (users and external systems) The "Stats" worksheets show development progress for individual increments, in the form of a "burn down chart"

Story ID Story Name

As a... (Actor)

I can... (Goal)

S001 S002 S003 S004 S005 S006

Timeout Submission Warning Submission E-mail Approval E-mail Log Thingy New User E-mail Thingy "Not Relevant" Extras

Logged In User Assessment Submitter Assessment Submitter DIP Team XYZ ABC User Thingy Assessment Completer General User Thingy User Thingy User Assessment Completer General User General User General User

Have the system log me out if I do not use it for a period Receive a warning before I submit my assessment Receive an e-mail confirming my assessment submission View a record of the sending of an approval e-mail Send thingy-specific "new user" e-mails when I create user accounts Be able to answer "not relevant" for certain requirements View an amended thingy Knowledge Base document View helpdesk details in any page footer View helpdesk details when self registering for a Thingy Add and amend general comments for my requirement response Better understand the requirements list View key information about a (v8+) requirement View the requirement description for a (v8+) requirement View the guidance text for a (v8+) requirement View and access the knowledge base resources that are relevant to a (v8+) requirement View the requirement origins for a (v8+) requirement View a list of material changes that have been made in this (major) version of the (v8+) requirements View the training tool text for a (v8+) requirement View (v8+) requirement-specific training tool text View attainment levels and attainment criteria for a (v8+) requirement View standard evidence types against each attainment criterion

S007 S008 S009 S010 S012 S013 S014 S015 S016

Thingy KB Doc Change Thingy Footer Details Thingy Request Registration Add Widget Comments View Widgets List (Enhancements) View Widget Header Information (v8+) View Widget Description (v8+)

View Widget Guidance Text General User (v8+) View Knowledge Base Resources General User (v8+) View Widget Origins (v8+) View Widget Changes (v8+) General User General User

S017 S068

S018 S019 S020

View Training Tool Text (v8+)

General User

View Training Tool Custom Text General User (v8+) View Attainment Levels (v8+) General User

S021

View Evidence Types

General User

S049

Expand and Collapse Widget (v8+) Indicate Widget As Not Relevant (v8+) Enter Comments for an Attainment Criterion Add Custom Evidence Type

General User

Expand or collapse the various sections of the (v8+) requirement page Indicate that a (v8+) requirement is not relevant to my organisation Enter comments for an attainment criterion

S023 S024

Organisation User Organisation User Organisation User

S025

Add a custom evidence type to an assessment criterion (because the standard evidence types are not appropriate for me)

S026 S027 S028 S131

Indicate Evidence Obtained Enter Evidence Comments Specify External Evidence Location Specifiy Evidence Location Improvement

Organisation User Organisation User Organisation User Organisation User

Indicate that I have obtained a particular evidence type Enter comments against a specific evidence type Specify an external location for my evidence Specify an external location for my evidence (improved UI)

S030 S031

Upload Evidence View Evidence

Organisation User Organisation User Organisation User Organisation User Organisation User Organisation User Organisation User

Upload evidence to the PQRT server View evidence files that I have previously specified in my requirement response Indicate that an evidence type is a duplicate of another one I've already specified (and cross reference it) View duplicate evidence files that I have previously specified in my requirement response Be prevented from deleting custom evidence which is referenced from elsewhere Specify an existing uploaded evidence file against another evidence item Specify an existing uploaded evidence file against another evidence item (enhanced/simplified version) Configure whether evidence provision is mandatory or optional for each org type

S029

Specify Duplicate Evidence

S140

View Duplicate Evidence

S139

Cannot Delete Referenced Custom Evidence Link to Existing Uploaded Evidence Link to Existing Uploaded Evidence (Mark 2)

S149

S163

S032

Configure Evidence Provision Status

Sys Admin

S033

Indicate Attainment Criterion Achieved Indicate Attainment Level 0 (v8+) Determine Current Attainment Level (v8+) Determine Widget Status Grant Widget Exemption View Widget Exemption Grant Evidence Exemption

Organisation User Organisation User Organisation User Organisation User XYZ ABC User Organisation User XYZ ABC User

Indicate a given attainment criterion as achieved either directly or indirectly Explicitly indicate that my organisation is at Attainment Level 0 Have the system determine my current attainment level for a given requirement Have the system determine the status of my requirement response Grant an exemption from a requirement to an organisation View a requirement exemption granted to my organisation Grant an exemption from a mandatory evidence type to an organisation Grant an exemption from a mandatory evidence type to all organisations of a specific type View an evidence exemption granted to my organisation Save changes I have made to my requirement response

S034 S036

S037 S038 S039 S044

S045

Grant Evidence Exemption to Org Type View Evidence Exemption Save Widget

XYZ ABC User

S046 S047

Organisation User Organisation User

S022

View Printable/Downloadable Version of Widget Download Widgets In Bulk

General User

View a printable/downloadable version of a requirement Download printable versions of requirements in bulk, for viewing off-line or for printing out Download printable versions of requirements in bulk, for viewing off-line or for printing out (specifically, per-initiative booklets) Download the requirement set as a spreadsheet for offline working Create bulk emails to be sent to users Attach files to pending bulk emails Have the system send all due bulk emails View bulk emails (both sent and pending) Amend a pending bulk email Delete a pending bulk email View a sent email Have a nice look & feel for the bulk email function

S050

Logged In User

S076

Download Widgets In Bulk (Per- Logged In User Initiative Booklets)

S069 S056 S057 S058 S059 S060 S061 S080 S102

Download Widgets Spreadsheet General User Create Bulk Email Add Bulk Email Attachments Send Bulk Email View Bulk Emails Amend Bulk Email Delete Bulk Email View Bulk Email Bulk Email Look & Feel XYZ ABC User XYZ ABC User XYZ ABC User XYZ ABC User XYZ ABC User XYZ ABC User XYZ ABC User XYZ ABC User

S063 S070 S064 S071

View Glossary Term Definition

General User

View Glossary Term (Printable) General User View Glossary View Printable/Downloadable Version of Glossary Publish Widgets - Printable Version Publish Widgets - ZIP File Downloads Publish Widgets - Booklet Downloads Publish Widgets - Per-Initiative Booklets Publish Widgets - Spreadsheet (Technology Spike) General User General User

View the definition of a term that is defined in the glossary Identify glossary terms in the printable version of a requirement View the entire glossary View a printable/downloadable version of the glossary Publish or re-publish the printable versions of the requirements Publish or re-publish the ZIP file downloads for the requirements Publish or re-publish the booklet downloads for the requirements Publish or re-publish the per-initiative booklet downloads for the requirements Publish or re-publish the XL spreadsheet download for the requirements (simple version to prove technology) Publish or re-publish the booklet downloads for the requirements, including a glossary section Publish a new version of the glossary based on the data held in RAT View summary data about my assessment View my target score along with my assessment summary Use the application easily and without aesthetic insult to my eye Have an enhanced aesthetic experience, with lovely soft curves caressing my visual senses Navigate the site more easily Be able to navigate to the information mapping functions Be able to access the Views Maintenance function View information on the home page Find out when my next assessment deadline is Be told the (correct) submission deadline when I do a Performance Update Log in to the system Log out from the system

S082 S099 S100 S101

Sys Admin Sys Admin Sys Admin Sys Admin

S151

Sys Admin

S072

Publish Widgets - Booklets with Sys Admin Glossaries

S067 S073 S136 S077 S104

Publish Glossary View Assessment Summary View Assessment Summary Target Score Look and Feel Look and Feel v2

Sys Admin Organisation User Organisation User General User General User

S078 S096 S074

Improved Navigation Improved Navigation Information Mapping Navigate to Views Maintenance

S079 S091 S125

Home Page Next Deadline Info View Submission Deadline on Performance Update Log In Log Out

General User Information Mapping User XYZ ABC User, Organisation Administrator General User Logged In User Organisation Admin General User Logged In User

S092 S093

S090 S089 S083 S097 S098 S075 S105 S108 S110 S111

Register For an Account Contact Us View "About" Info Improved Navigation - Widgets Home Page - What Next Search Knowledge Base Context Sensitive Help Mechanism Look & Feel - Widget Details Can't Enter Widget Level Comments Smaller PQR Assurance Statement Pop-up Submission Email Log Specify A Widget Owner Add Improvement Action

General User General User General User General User Logged In User General User Developer General User Organisation User Organisation User Organisation User Organisation Administrator Organisation User XYZ ABC User Organisation User Organisation Admin Organisation Admin Organisation User

Register for an PQRT account Contact XYZ ABC about the PQRT Read general information about PQRT Navigate more sensibly to the requirements list page Once I have logged in, view instructions on what I can do next Search for knowledge base documents based on various criteria Implement context sensitive help in a straightforward and flexible manner Have a nice look & feel for the requirement details page Not enter requirement-level comments for a (v8+) requirement Be able to view the PQR Assurance Statement Pop-up on an 800x600 screen View a record of the sending of an submission e-mail Specify a user from my organisation as the owner for a given requirement Add an improvement action against a specific attainment criterion View improvement actions Produce an improvement plan for my organisation Send ad-hoc email reminders to requirement owners with outstanding improvement actions Send regular email reminders to requirement owners with outstanding improvement actions View my attainment level for a (v8+) requirement on my previous assessment Set a target attainment level and date for a given (v8+) requirement

S112 S117 S113

S138 S114 S116

View Improvement Actions Produce Improvement Plan and Evidence Report Send Ad-hoc Improvement Action Reminders Send Regular Improvement Action Reminders View Past Attainment Level

S115

S121

S122

Set Target Attainment Level and Organisation Date User

S137 S123 S124

Set Target Attainment Level of 0, NR or EX Mark Widget as Complete Mark Widget as Confirmed

Organisation User Organisation User Organisation Reviewer

Set a target attainment level of 0, NR or EX Mark a (v8+) requirement response as complete Mark a (v8+) requirement response as confirmed

S127 S128

Odds and Ends

General User

Unsubmit Baseline/Performance XYZ ABC User Update: Changed Permissions

See a range of random and unrelated point improvements across the site Unsubmit baselines and performance updates whereas organisation admins cannot Receive warnings when submitting baselines and performance updates

S129

Submit Baseline/Performance Update Warnings

Organisation Admin

S130

Can't Delete Widget Owner User Organisation Not delete a user who is a requirement Admin, XYZ ABC owner User

S132 S133 S135

Beta Test Phase 1 Defects Odds and Ends 2 Organisation Type Names

General User General User General User

See various defects/issues resolved that appeared in Beta Test Phase 1 See a range of random and unrelated point improvements across the site See better, shorter names for organisation types Receive a message about the PQRT release cycle as part of the approval email View the correct "guidance" document from the Performance Progress Report for a v8+ assessment View a (v8+) requirement with a table within the guidance text View a (v8+) requirement with a main heading within the guidance text View a (v8+) requirement with a hyperlink within any RATML field Have the system take exemptions into account when calculating overall % scores Submit my (v8+) assessment once I have entered a score for each requirement View the fact that I have been exempt from a requirement in the requirements list View an organisation's assessment details as an XYZ ABC user, with the relevant fields visible but read-only Receive a warning if I attempt to leave the Widget Details page without saving my changes

S141

PQRT Release Cycle Info in Approval Email Text

Organisation Admin

S150

View Widget from Performance Organisation Progress Report User View Widget Containing Table View Widget Containing Main Heading View Widget Containing Hyperlink Incorporate Exemptions into Report Scores Sumbit Assessment (Simplified Interface) General User General User General User General User

S153 S154 S157 S155

S156

Org User

S158

View Exemption in Widgets List Org User

S159

View Assessment as an XYZ ABC XYZ ABC User User Receive Dirty Flag Warning for Widget Org User

S161

S103 S173

Look & Feel - Forgotten User Details Assessment Summary Mark 2

General User Organisation User

Get help with forgotten user details (org code, user ID, password) See various enhancements as suggested during Beta Test Phase 1

S176

Auto Create Assessment

Organisation User

Have the user auto create a new assessment for me instead of having to create it myself

S166 S183 S167 S169 S170

Widget Details Page Enhancements Widget Details Page Callouts Widget PDF Enhancements Contact Us Page Mark 2 Registration Mark 2

General User Organisation User General User General User General User

See various enhancements as suggested during Beta Test Phase 1 See "help" callouts on the requirement details page See various enhancements as suggested during Beta Test Phase 1 See various enhancements as suggested during Beta Test Phase 1 See various enhancements as suggested during Beta Test Phase 1

S171 S174

Home Page Mark 2 Greyed Out Submit Buttons

General User Organisation User

See various enhancements as suggested during Beta Test Phase 1 See greyed out submit buttons on the Assessment Summary page

S175 S085 S181

Widgets List Mark 2 View Quick Start Guide Odds and Ends 3

Organisation User General User General User

See various enhancements as suggested during Beta Test Phase 1 Get up to speed with using PQRT as quickly as possible See a range of random and unrelated point improvements across the site

S182

Maintain Users (Simplified Interface) Add Improvement Action Usability View Improved Assessment Report View Improved Assessment Report (Own Org) View Improved Assessment Report - Breakdown by Attainment Level View Improved Assessment Report - Stages and Targets

Organisation User Organisation User General User General User General User

S184

Create, amend and delete users within my organisation user (using the simplified interface) Be able to add improvement actions more easily, with less reliance on pop-ups View an organisation's Assessment Report with various enhancements View an organisation's Assessment Report with various enhancements View an organisation's Assessment Report broken down by attainment level View an organisation's Assessment Report including baseline, performance update and target scores View an organisation's Assessment Report broken down by initiative Be able to view requirements and complete assessments for eyecare organisations Read information about PQRT accessibility Use the application via all XYZ ABC supported web browsers View PQRT terms & conditions View updated Terms & Conditions when registering for an PQRT account See the major version number as a prefix to the requirement number (v8+ only) Be less confused when uploading evidence Left over defects not yet fixed Experience better call-out help on the Widget Details page Receive context sensitive help as necessary across the whole site

S142 S143 S144

S145

Organisation User

S146

View Improved Assessment General User Report - Breakdown by Initiative New Org Type: Eyecare General User

S177

S084 S087

View "Accessibility" Info Alternative Browser Support

General User General User

S086 S094 S206

View Terms & Conditions View Updated Registration Terms & Conditions Widget Number Prefix

General User General User General User

S207 S185 S208 S109

Upload Evidence Last Chance Saloon Miscellaneous Defects Better Call-Outs on Widget Details Page Context Sensitive Help

Organisation User Developer Organisation User General User

S202 S203

Odds and Ends 4 Publish Widgets Without PDFs

General User Sys Admin

S190

View Help Topics

General User

See a range of random and unrelated point improvements across the site Be able to publish the requirements without generating all the PDF files (to save time) View various help topics

S205

Improved Local File Specification Organisation User

Be able to type the file name, see the full path view "local file" evidence

S147 S148

View Improved Assessment Report - HTML Version Publish Widgets - Spreadsheet (Report Sheet) User Friendly Error Page

General User Sys Admin

S212

General User

Create an HTML version of the assessment report Publish or re-publish the XL spreadsheet download for the requirements (report sheet) Receive a user friendly error message when a system error occurs, including a reference number to help ABC diagnose the problem Be able to republish the knowledge base without wiping out links with requirements See a range of random and unrelated point improvements across the site Left over defects not yet fixed Upload an audit report for a give assessment Mark individual requirements as audited View statistics on the auditing of individual requirements Publish a new version of the Knowledge Base based on the data held in RAT

S201

Publish Knowledge Base Enhancements Odds and Ends 5 Misc Defects 2 Upload Audit Report Mark Widget as Audited View Widget Audit Stats Publish Knowledge Base

Sys Admin

S209 S210 S198 S199 S200 S066

General User Developer Organisation Auditor Organisation Auditor Organisation Auditor Sys Admin

S065

Publish Widgets - Online Version Sys Admin

Publish a new version of the requirements based on the data held in RAT Publish a new version of the glossary based on the data held in RAT (advanced version including PDF generation within PQRT) View an organisation's assessment details as a General user, with the relevant fields visible but read-only View an organisation's assessment details as a General user, with the relevant fields visible but read-only View an organisation's Assessment Report broken down by key requirement status

S081

Publish Glossary (Advanced)

Sys Admin

S160

View Assessment as a General User View Assessment as a General User (Mark 2) View Improved Assessment Report - Breakdown by Key Widget Status Accessibility

General User

S165

General User

S152

General User

S187

General User

Be able to access the site as a disabled user

S106

Publish Widgets - Spreadsheet (List Sheet)

Sys Admin

Publish or re-publish the XL spreadsheet download for the requirements (requirements list sheet) Publish or re-publish the XL spreadsheet download for the requirements (requirements list sheet) Experience a yet further enhanced look and feel See "really" disabled tick boxes as greyed out but see "auto tick by system" tick boxes as not greyed out Left over defects not yet fixed See a range of random and unrelated point improvements across the site Set up Thingy HQ users Import relationships between pharmacies and pharnacy HQs from TDB Be able to view Performance Performance Reports of Pharmacies as a Thingy HQ View graphs within my Assessment Summary XL file Assign the "Organisation Auditor" role to users within my organisation Access existing functions as appropriate to my status Mark an assessment as audited Approve a bulk email to be sent See roughly how many users bulk emails will be sent to Improve email validation within the registration process by sending an email to the user and forcing them to acknowledge it Receive user details reminders for multiple accounts and with a more secure password reset solution Have the browser "back" button operate more gracefully Enter my own password during registration Drill down into the details of an assessment report for specific breakdown figures (e.g. Key requirements met/not met)

S107

Publish Widgets - Spreadsheet (Details Sheet)

Sys Admin

S172 S204

Look and Feel Mark 3 Tri State Tick Boxes on Widget Details Page Misc Defects 3 Odds and Ends 6

General User Organisation User Developer General User

S215 S214 S178 S179

New Org Type: Thingy HQ XYZ ABC User Import Thingy HQ Relationships Sys Admin

S180

View Thingy Reports as Thingy HQ Assessment Report - Graphs Assign Organisation Auditor Role Organisation Auditor Permissions Mark Assessment As Audited

Organisation User General User

S189 S195 S196 S197 S192 S193 S188

Organisation Admin Organisation Auditor Organisation Auditor Approve Bulk Email XYZ ABC User View Number of Recipeients for XYZ ABC User Bulk Emails Validate Email Address General User

S213

Forgotten User Details Enhanced Use the Browser Back Button Enter Own Password in Registration View Improved Assessment Report - Drill Down on Breakdown

General User

S164 S211 S162

General User General User General User

S040

Grant Criterion Exemption

XYZ ABC User

Grant an exemption from an attainment criterion to an organisation Grant an exemption from an attainment criterion to all organisations of a specific type View a criterion exemption granted to my organisation Have the system determine my current attainment level for a given requirement, given that I have a criterion exemption Be able to select from three variants of the requirement PDF Have the system capture and display the "date last modified" for each individual attainment criterion Navigate quickly from one requirement to another Review all the details I have entered for my (v8+) assessment so far Review a submitted (v8+) assessment prior to approval View a list of undelivered bulk emails so that I can consider whether to amend user details Get access to the various file viewers I need to view PQRT files (e.g. Acrobat Reader) See which (non live) environment I am connected to and also which software build I am using Specify a user from my organisation as the second owner for a given requirement Have the system auto complete the improvement action owner as I type Have the system capture and display the date and user who marked an improvement action as complete Have a simplified configuration structure for the Publish Tool

S041

Grant Criterion Exemption to Org Type View Criterion Exemption

XYZ ABC User

S042 S043

Organisation User Determine Current Attainment Assessment Level Given Criterion Exemption Completer

S168 S035

View Widget PDF Variants Capture Date Last Modified

General User Organisation User Organisation User Organisation User XYZ ABC User XYZ ABC User

S048 S054 S055 S062

Jump To Widget Review My Assessment Review Submitted Assessment View Undelivered Bulk Emails

S088

File Viewers

General User

S095

Show Environment Name and Build Number

General User

S118

Specify a Second Widget Owner Organisation Administrator Auto Complete Improvement Action Owners Capture Improvement Action Completion Audit Trail Publish Tool Config Refactor Organisation User Organisation User Developer

S119

S120

S134 S216 S217 S218 S219 S220 S221

Status

Priority

Dependencies Story Points Dev Dev Owner Increment

Dev Complete Date

Live Live Live Live Live Live

v7.3 v7.3 v7.3 v7.3 v7.3 v7.3

Live Live Live Live Implement Implement Implement Implement Implement Must Must Must Must Must S075

v7.3 v7.3 v7.3 v7.3 2 v8.0 (i1) 2 v8.0 (i1) 0.5 v8.0 (i1) 0.25 v8.0 (i1) 2 v8.0 (i1) CC CC CC CC CC 2/4/2010 1/26/2010 1/27/2010 1/27/2010 1/29/2010

Implement Implement

Should Should

0.5 v8.0 (i1) 0.5 v8.0 (i1)

CC CC

1/27/2010 1/27/2010

Implement Implement Implement

Should Should Must

0.25 v8.0 (i1) 0.25 v8.0 (i1) 3 v8.0 (i2)

CC CC CC

1/28/2010 1/28/2010 2/24/2010

Implement

Must

S020

5 v8.0 (i2)

RJM

2/23/2010

Implement

Must

S014-S020

2 v8.0 (i1)

CC

1/27/2010

Implement Implement

Must Must

1 v8.0 (i2) 1 v8.0 (i2)

CC CC

2/25/2010 3/5/2010

Implement

Must

4 v8.0 (i2)

RJM

3/8/2010

Implement Implement Implement Implement

Must Must Should Must S028, S030

2 v8.0 (i2) 2 v8.0 (i2) 5 v8.0 (i3) 2 v8.0 (i4)

RJM RJM RJM RJM

3/1/2010 3/2/2010 3/19/2010 4/7/2010

Implement Implement

Should Should S028, S030

3 v8.0 (i4) 2 v8.0 (i4)

RJM RJM

4/14/2010 4/16/2010

Withdrawn

Must

S029

4 N/A

RJM

Withdrawn

Should

1 N/A

RJM

Withdrawn

Must

2 N/A

RJM

Withdrawn

Must

4 v8.0 (i5)

RJM

4/23/2010

Implement

Must

1 v8.0 (i5)

RJM

4/30/2010

Implement

Must

0.5 v8.0 (i3)

NL

3/18/2010

Implement

Must

6 v8.0 (i3)

CC

3/23/2010

Implement Implement

Must Must S033, S034

1.5 v8.0 (i3) 5 v8.0 (i3)

CC RJM

3/18/2010 3/23/2010

Implement Implement Implement Withdrawn

Must Must Must Could S038

1 v8.0 (i3) 3 v8.0 (i4) 1 v8.0 (i4) N/A

NL RJM RJM

3/18/2010 4/19/2010 3/31/2010

Withdrawn

Could

S044

N/A

Withdrawn Implement

Could Must

S044

N/A 0.5 v8.0 (i3) RJM/CMC 3/25/2010

Implement

Must

0.5 v8.0 (i2)

NL

2/22/2010

Implement

Must

2 v8.0 (i2)

NL

3/4/2010

Implement

Should

S050

1 v8.0 (i2)

NL

3/4/2010

Implement Implement Implement Implement Implement Implement Implement Implement Implement

Must Must Must Must Must Must Must Must Should

0 v8.0 (i3) 5 v8.0 (i1) 3 v8.0 (i2) 5 v8.0 (i5) 1 v8.0 (i1) 1.5 0.5 1 1 v8.0 (i1) v8.0 (i1) v8.0 (i1) v8.0 (i5)

NL DES DES DES DES DES DES DES DES

3/8/2010 2/10/2010 3/5/2010 5/14/2010 2/12/2010 2/12/2010 2/12/2010 2/12/2010 5/14/2010

S056 S056 S056, S058 S059 S059 S059 S056, S057, S058, S059, S060, S061

Implement Implement Implement Implement

Must Must Must Must

S064 S022

3 v8.0 (i1) 0 v8.0 (i4) 2 v8.0 (i1) 0.5 v8.0 (i2)

RJM TM RJM RJM

2/4/2010 4/12/2010 2/8/2010 2/17/2010

Implement Implement Implement Implement

Could Could Could Could

S065 S065 S065 S065, S076

4 v8.0 (i4) 3 v8.0 (i4) 4 v8.0 (i4) 2 v8.0 (i4)

TM TM TM TM

4/16/2010 4/22/2010 4/16/2010 4/16/2010

Implement

Must

S065

2 v8.0 (i5)

TM

4/29/2010

Withdrawn

Could

S100, S101

N/A

Implement Implement Implement Implement Implement

Must Should Should Must Must S077

2.5 v8.0 (i1) 6 v8.0 (i4) 1 v8.0 (i5) 6 v8.0 (i2) 5 v8.0 (i2)

RM NL NL TM TM

2/11/2010 4/21/2010 4/28/2010 2/25/2010 3/4/2010

Implement Implement Withdrawn

Must Must Should

S078

2 v8.0 (i2) 1 v8.0 (i3) N/A

DES NL

2/18/2010 3/19/2010

Implement Implement Implement

Must Should Must

2 v8.0 (i2) 3 v8.0 (i3) 0.5 v8.0 (i3)

TM NL NL

2/24/2010 3/26/2010 3/23/2010

Implement Implement

Must Must

S079 S079, S092

2 v8.0 (i2) 1 v8.0 (i2)

TM TM

2/25/2010 2/24/2010

Implement Implement Implement Implement Implement Implement Implement Implement Implement Implement

Should Must Must Should Must Must Must Must Must Must S016 S078 S078

2 v8.0 (i2) 2 v8.0 (i2) 0 v8.0 (i5) 1 v8.0 (i3) 2 v8.0 (i3) 5 v8.0 (i3) 2 v8.0 (i3) 5 v8.0 (i3) 0 v8.0 (i4) 0.25 v8.0 (i3)

DES DES NL NL NL DES RJM RJM CC CC

3/5/2010 2/23/2010 5/7/2010 3/23/2010 3/19/2010 3/23/2010 3/24/2010 3/16/2010 3/29/2010 3/16/2010

Implement Implement Implement

Must Should Should

0.25 v8.0 (i3) 3 v8.0 (i4) 5 v8.0 (i4)

CC DES DES

3/16/2010 4/1/2010 4/13/2010

Withdrawn Implement Implement

Must Should Should

N/A 6 v8.0 (i4) 4 v8.0 (i5) DES DES 4/20/2010 5/5/2010

Implement

Could

4 v8.0 (i5)

DES

5/10/2010

Implement

Must

0.5 v8.0 (i3)

RJM

3/25/2010

Implement

Must

0.5 v8.0 (i4)

RJM

3/30/2010

Implement Implement Implement

Must Must Must

1 v8.0 (i5) 3 v8.0 (i5) 2 v8.0 (i5)

RJM RJM RJM

4/26/2010 4/27/2010 4/27/2010

Implement Implement

Could Must

2 v8.0 (i4) 0.5 v8.0 (i4)

CC NL

4/15/2010 4/9/2010

Implement

Must

1 v8.0 (i4)

NL

4/9/2010

Implement

Must

0.5 v8.0 (i5)

NL

4/22/2010

Implement Implement Implement

Must Should Must

v8.0 (i5) 5 v8.0 (i5) 0.5 v8.0 (i5)

CC CC NL

4/26/2010 5/13/2010 4/22/2010

Implement

Must

0 v8.0 (i5)

NL

4/22/2010

Implement

Must

1 v8.0 (i5)

NL

5/10/2010

Implement Implement Implement Implement

Must Must Must Must

0 v8.0 (i5) 0.5 v8.0 (i5) 0 v8.0 (i5) 2.5 v8.0 (i5)

TM TM TM NL

5/5/2010 5/5/2010 5/5/2010 5/14/2010

Implement

Must

3 v8.0 (i5)

NL

5/12/2010

Implement

Must

1 v8.0 (i5)

RJM

4/30/2010

Implement

Must

0.5 v8.0 (i5)

RJM

4/27/2010

Implement

Should

2 v8.0 (i5)

RJM

4/30/2010

Implement Implement

Should Must

2 v8.0 (i5) 1.5 v8.0 (i5)

NL CC

5/7/2010 5/18/2010

Implement

Must

0 v8.0 (i5)

CC

5/13/2010

Implement Implement Implement Implement Implement

Should Should Should Should Should

2 v8.0 (i6) 2 v8.0 (i6) 2 v8.0 (i6) 0.5 v8.0 (i6) 1 v8.0 (i6)

RJM RJM CC DES DES

5/21/2010 6/4/2010 5/26/2010 5/18/2010 5/19/2010

Implement Implement

Should Must

3 v8.0 (i6) 0 v8.0 (i6)

DES/CMC CC

6/4/2010 5/18/2010

Implement Implement Implement

Should Must Must S078

2 v8.0 (i6) 0.5 v8.0 (i6) 2 v8.0 (i6)

RJM RJM

5/25/2010 6/4/2010 6/4/2010

Implement

Should

0.5 v8.0 (i6)

CMC

5/27/2010

Implement

Could

2 v8.0 (i6)

RJM

5/28/2010

Implement Implement Implement

Must Must Must S142 S142

4 v8.0 (i6) 2 v8.0 (i6) 3 v8.0 (i6)

CC CC CC

5/27/2010 5/27/2010 5/28/2010

Implement

Must

S142

2 v8.0 (i6)

CC

6/1/2010

Implement

Must

S142

5 v8.0 (i6)

CC

6/2/2010

Implement

Should

0.5 v8.0 (i6)

CC

5/27/2010

Implement Implement

Must Must

S078

0 v8.0 (i7) 1.5 v8.0 (i7)

RJM RJM

6/17/2010 6/15/2010

Implement Implement Implement

Must Should Must

0 v8.0 (i7) 0 v8.0 (i7) 0.5 v8.0 (i7)

RJM RJM CC

6/17/2010 6/18/2010 6/18/2010

Implement Implement Implement Implement

Should Must Could Must S105

1 v8.0 (i7) v8.0 (i7) 1 v8.0 (i7) 1 v8.0 (i7)

RJM

6/22/2010 6/25/2010 6/23/2010 6/11/2010

RJM RJM

Implement Implement

Must Should

3 v8.0 (i7) 1 v8.0 (i7) TM

6/25/2010 6/18/2010

Implement

Must

0.5 v8.0 (i7)

NL

6/24/2010

Withdrawn

Should

N/A

Implement Implement

Should Could

S142-S146, S152 S107

3 v8.0 (i8) 5 v8.0 (i8)

CC TM

7/21/2010 7/5/2010

Implement

Should

1 v8.0 (i8)

RJM

7/1/2010

Implement

Should

3 v8.0 (i8)

TM

7/21/2010

Implement Implement Withdrawn Withdrawn Withdrawn Test (Low)

Could Must Should Could Could Must S075

2 v8.0 (i8) v8.0 (i8) 2 N/A 3 N/A 1 N/A 6 v8.0 (i3) DES 3/17/2010

Test (Low)

Must

S022, S066

12 v8.0 (i3)

TM

3/30/2010

Fix (Low)

Could

S067, S082

4 v8.0 (i1)

RM

2/12/2010

Fix (Low)

Must

2 v8.0 (i5)

RJM

4/29/2010

Fix (Low)

Should

0.5 v8.0 (i5)

RJM

4/30/2010

Fix (Low)

Should

S142

3 v8.0 (i6)

CC

6/1/2010

Fix (Low)

Must

2 v8.0 (i7)

RJM

6/17/2010

Fix (Low)

Must

S151

2 v8.0 (i7)

TM

6/10/2010

Fix (Low)

Must

S106

7 v8.0 (i7)

TM

6/23/2010

Fix (Low) Fix (Low)

Should Could

2 v8.0 (i7) 1 v8.0 (i8)

DES RJM

6/25/2010 6/30/2010

Fix Dev Dev Dev

Could Must Must 1.5 1

Dev

Must

Dev Dev Dev Dev Dev Dev Dev

Should Should Should Should Should Should Should

2 0.5 2 1 2 1 3

Dev

Should

Req Dev Dev

Could Could Could S147

2 1 3 CC

Dev

Should

Dev

Could

Dev Dev

Should Should

S040, S041 S040, S041

Dev Dev

Could Should

Req Req Req Req

Could TBC TBC Could

Req

Could

Dev

Should

Req

Could

S117

Req

Could

Req

Could

Dev

Could

CC

Actual Dev Time Fixing Notes Time Defects (man (man days) days)

Beta Test Phase

Tester

Phase 1 Phase 1 Phase 1 Phase 1 Phase 1

Phase 1 Phase 1

Phase 1

5.5

Phase 1

Phase 1

1 4 Much more complicated than initially estimated for

Phase 2 Phase 1

more complicated than Phase 1 originally thought. Required integration with main page for testing save functionality Phase 1 Phase 1 Phase 1 Was more complex than anticipated, plus all of the associated bubbling of events needed to be changed. Phase 1

3 2 4 4

4 3

Phase 2 Phase 2

N/A

N/A

N/A

Superseded by S163

N/A

Phase 2

0.5

N/A

Phase 1

1.5 4

Phase 1 Phase 1

0.25 2 1

Phase 2

N/A

N/A

N/A 0.5 0.5 days. Most of the Phase 1 functionality was already implemented through other stories. nili: Time Taken includes Phase 1 configuration and set-up time Phase 2

1.5

Phase 2

Phase 2

4.5

NL

Phase 1 0 Phase 2 Phase 1 0.5

Phase 2 Phase 2 Phase 2 Phase 2

Phase 2

Decided we don't want to N/A include a 30 page glossary at the end of every booklet

7 1 4 4

Phase 2 Phase 2 Phase 1 Phase 1

2 0.5 Delay until we agree whether we are getting rid of Views 2 3 0

Phase 1 Phase 1 N/A

Phase 1

1 0.5

Phase 1

3.5 2.5 0.25 0.5 0.75 5 1 6 0 0.25

Incorporated Full-text search Phase 1 Phase 1 Phase 1 Phase 1

Phase 1 Phase 1 Phase 1 N/A

0.25 3.5 6.5 Had some issues with the jQuery Datepicker formatting.

N/A Phase 2 Phase 2

N/A 6 4 Phase 2 Phase 2 EP EP

4.5

Phase 2

EP

0.5

0.5 1 1

Problem with persisting Phase 2 related data to the database. Found bug in v7 fixed with CMC help. Phase 2

2 0.5

Phase 1

0.5

0.5

WidgetOwner is already checked, but there were a number of other tables which referenced the OrganisationUserID which were not being checked.

0.5

actual dev time includes time for work done for S141 actual dev time included in time for work done for S135

0.5

1.5

Nb CMC also spent some time on this

0.5

0.5

0.5

2 2 More than estimate as Phase 2 existing screen wasnt fully working therefore extra effort was required to rework/fix existing functionality. Hence spilled over into Increment 5 period by a day or so CMC:Was actually bit longer Phase 2 from when gave estimate as encompassed the new "Reset" functionality on assessment details page. Have also changed the description for auto-created assessments to match the new Version 8 (2010-2011) format Phase 2 Phase 2 Phase 2

0.5

3 2 0 0 2 Had to completely re-write the entire wizard to implement the 'primary key' CSS

3 0.5

Phase 2 More than estimate owing to Phase 2 fact that the tooltip wordings were status specific Phase 2 Phase 2 Phase 2 (priority "Highest" items only)

2 0.5

Phase 2

3.5 0.5 0.5

Phase 2 Phase 2 Phase 2

NL NL NL

Phase 2

NL

Phase 2

NL

Phase 2

0 1.5 Needs to include markup to force IE8 to operate in IE7 compatibility mode EP

0 0 0.5

EP

1 1 1 day sofar. Implemented on Phase 1 a number of pages specified in the ContextHelp.xml file

EP EP

0.5

See the ebay "Easy Lister" photo upload pop-up for an example of showing the full path name. 4 4.5

3.5

Including integrating with the Ratty tool and Developing Staging Database build project Phase 2

0.5

Phase 2

NL

EP

Phase 2

Phase 2

GT GT

N/A

Story ID S012

Story Name

As a... (Actor)

I can... (Goal)

Flow

Step When I... (Action)

Then... (Acceptance Criterion)

Prototyped Agreed PW/MG

Agreed TUG

Agreed Dev

Notes

Test Status Defect

Defect Priority

Defect Status

Defect Notes

View Widgets List (Enhancements)

General User

Better understand the widgets list

Main

1 2

Request to view the widgets list (any org type) The column headings indicate what happens when the column content is clicked Column 1 header is "Req No" (previously "Seq No") The widgets are grouped by initiative (with initiative sub-headers and colour coding) Y 11/18/2009 11/25/2009 CMC Pass

3 4

Y Y

11/18/2009 11/23/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass

A new column "Key Req" indicates whether key Y widget (including use of icons and/or colour) For each answered key widget, the Attainment Level column includes a "status" indicator showing whether or not Attainment Level 2 reached Y

11/23/2009

11/25/2009 CMC

CMC: Will need to have ALT text for the Icon as well for accessibility CMC: Again also needs ALT text for icon

Pass

11/23/2009

11/25/2009 CMC

Pass

1) Alt text should read "Attainment Level 2 met/not met for Key Widget".

Medium

Closed

CMC: (1) Currently alt text reads "Key Widget Minimum Level Met/Not met". Think this is a better wording as there is no guarantee that 2 will remain as the min level for key widgets. (2)You can test this as have set page to display for V7 assessment sets in order to allow testing. Suggest using V7 assessment for organisation code REM.

Pass

It's showing the cross icon correctly Medium but it's showing the key icon instead of the tick icon

Closed

S013

View Widget Header Information (v8+)

General User

View key information about a (v8+) widget

Main

1 2

Request to view a specific (v8+) widget The header panel is re-organised to list key data Y down the RHS (widget no, initiative, whether key widget, org type, widget version number) The version number is of the format <major>.<minor> e.g. 8.0. Note that individual widgets in the same set can be at different minor versions. The HORUS categorisation is removed (this only applies for v8+ widgets - it is to be retained for v7- widgets) Y 11/16/2009 11/25/2009 CMC Pass

11/30/2009

3/17/2010 CMC

CMC: Needs investigation as to how this will integrate with RATI tool

Pass

11/16/2009

11/25/2009 CMC

TBC knock-on effect on TDB. CMC Pass Will definitely have knock on effect on TDB will require at the least some TDB reports being pulled and at worst changes to TDB data structures and associated batch and SP processes as well. Pass

The MSPrPe categorisation is removed (this only applies for v8+ widgets - it is to be retained for v7- widgets) The Category categorisation is removed (this only applies for v8+ widgets - it is to be retained for v7- widgets) The header panel is colour coded to indicate which initiative it belongs to (see PQRT v8 Colour Palette v1) The header panel is colour coded to indicate whether it is a key widget (see PQRT v8 Colour Palette v1) Request to view a specific (v8+) widget

11/16/2009

11/25/2009 CMC

11/16/2009

11/25/2009 CMC

Pass

11/16/2009

11/25/2009 CMC

Pass

11/16/2009

11/25/2009 CMC

Pass

S014

View Widget Description (v8+)

General User

View the widget description for a (v8+) widget

Main

Precondition: the relevant widget text has been converted from RATML into HTML by S065 (Import Widgets Data) The widget description for the widget appears below the header panel (heading: "Widget Description"). This is the text that previously appeared with the widget question in the blue box on the Guidance Document. Y 11/18/2009 11/25/2009 CMC Pass

S015

View Widget Guidance Text (v8+)

General User

View the guidance text for a (v8+) widget

Main

1 2

Request to view a specific (v8+) widget Precondition: the relevant widget text has been converted from RATML into HTML by S065 (Import Widgets Data) The guidance text is presented (correctly formatted) Y 11/18/2009 11/25/2009 CMC Pass 1) Paragraph indenting is out. The Medium answer here (I think) is to remove the 5 x &nbsp; at the beginning of each para in the HTML. 2) In IE, the first H3 displays fine but the second and subsequent ones are indented and too small. It seems to be because they are embedded within a <ul> (but so is the first one!), because if I close the <ul> before the <h3> and open it again afterwards it's OK. But then the paragraph numbering goes to cock, unless youe explicitly use the "Start" attribute of <ul>. Closed CMC:I copied the HTML as was given in the prototype at the time of development. The HTML which will get produced is really part of the publish story, as such . not sure there's too much point frigging with the test HTML to get the result we want. Propose leaving this till testing of the publish process. TH 16/3: I will attempt to "fix" these in the prototype and then you can take the latest cut of the prototype HTML TH 22/3: fixed in prototype (see email from me the other day) CMC 06/04 Think this is now fixed looks ok to me with published data from RATTY anyway TH 12/04: the publish function may work OK but the test data itself needs to be valid, both for manual and automated testing purposes CMC 26/04 Guidance text fixed for Acute Test widget 101

The guidance text has paragraph numbers (for easy reference) Request to view a specific (v8+) widget

11/16/2009

11/25/2009 CMC

Pass

S016

View Knowledge Base Resources (v8+)

General User

View and access the Main knowledge base resources that are relevant to a (v8+) widget

2 3 4

There is a list of all knowledge base resources Y relevant to the widget The title of section is "Knowledge Base Y Resources" The resources are grouped into "Key Y Resources", "Exemplars" and "Useful Websites" The resources are tabulated Y Each resource title is a hyperlink through to the Y resource (be it a document on our server or an external URL)

11/18/2009 11/18/2009 11/18/2009

11/25/2009 CMC 11/25/2009 CMC 11/25/2009 CMC

Pass Pass Pass 1) Order of tabs should be Key Medium Resources, Exemplar Materials, Useful Web Sites Visited weblinks are the same colour as not visited links (OK) but with no underline (not OK) Medium Closed CMC:Fixed as part of reskin of widgets page

5 6

11/18/2009 11/18/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass

Closed

CMC: Are now underlined as per re-skin of widgets page 22/10 TH: Failed retest. Note that some links are not underlined even before I have visited them.

7 8

When a hyperlink is clicked, the resoruce is Y displayed in a new tab or window For each resource there is a description of the Y resource to help users determine the content of the resource and whether it will be useful to them For each resource there is an indicator Y indicating whether the resource is located internally on the PQRT website or whether it is on an external web page (this gives the user a hint that the content they are looking at is not "owned" by XYZ ABC)..

1/11/2010 N/A 11/16/2009

CMC

Pass Pass

11/25/2009 CMC

11/30/2009

11/25/2009 CMC

Pass

1) Can you put a tooltip on the external web site link saying "External web site link" (as per prototype) 2) Can you include the external website link within the <a> tag so it is clickable along with the link itself.

Low

Closed

CMC: Ok have added tooltip to the a href as well as the image and added the space, try again.

10

For each internally located resource, the file type and size is displayed

11/30/2009

11/25/2009 CMC

CMC: Possible security access Pass implications as will need to access file system to get this information. TH: the fiel type and size will be in the DB (calculated by RATty)

Can you remove the leading dot e.g. "DOC", not ".DOC"

Low

Closed

CMC:Data issue only, fixed in test data set up script

S017

View Widget Origins (v8+)

General User

View the widget origins for a (v8+) widget

Main

Request to view a specific (v8+) widget

Precondition: the relevant widget text has been converted from RATML into HTML by S065 (Import Widgets Data) There is a section containing the widget origins (after the (optional) Training section) Y 11/16/2009 11/25/2009 CMC Pass

4 1a Request to view a specific (v8+) widget which has no widget origins

The widget origins section is a bullet list of free Y format text items

11/16/2009

11/25/2009 CMC

Pass

The widget origins section is empty i.e. this case N is treated as a bullet list with zero items in it (on the basis that it is not expected to arise)

1/12/2010 N/A

CMC

CMC:This looks pretty odd if the situation of 0 orgins does arise

Pass

S068

View Widget Changes (v8+)

General User

View a list of material changes that have been made in this (major) version of the (v8+) widgets

Main

Request to view a specific (v8+) widget

Precondition: the relevant widget text has been converted from RATML into HTML by S065 (Import Widgets Data) There is a section containing a list of material changes to the current (major) version of the widget The section is a bullet list of free format text items Request to view a specific (v8+) widget which has no material changes The "changes" section states that there are no material changes in this version of the widget N 12/7/2009 3/17/2010 CMC Pass Rather than saying, "The following is a Medium list..." followed by a bulleted "There are no material changes...", just say "There are no material changes" (not bulleted) Closed Y 12/7/2009 3/17/2010 CMC Pass Put a colon at the end of "The following is a list..." instead of a full stop Low Closed

4 1a 1

12/7/2009

3/17/2010 CMC

Pass

S018

View Training Tool Text (v8+)

General User

View the training tool text for a (v8+) widget

Main

Request to view a specific (v8+) widget for which the training tool text is relevant The training tool text is displayed (after the knowledge base resources) Y 11/30/2009 3/17/2010 CMC Pass 1) Make link to training tool open in new window 2) Put full stop after training tool link (as per prototype) Medium Closed

1a

Request to view a specific (v8+) widget for which the training tool text is *not* relevant The training tool text is *not* displayed (after the knowledge base resources) N 11/30/2009 3/17/2010 Pass Looking at the database table High WidgetOrganisationType, I can not see a data field which indicates whether or not the training tool text is required (in RATTY it's called XXX). I'm therefore guessing that this widget has not been implemented Closed CMC:Was a misinterpretation of the widget. I thought it was only the custom text which was conditional and thought that IO could simply check whether it was null or not. So to confirm if the Training Text relevant flag is set you display the traing text section and if theres some custom text you also display that. Correct ?

S019

View Training Tool Custom Text (v8+)

General User

View (v8+) widgetMain specific training tool text

Request to view a specific (v8+) widget for which the training tool text is relevant and for which there is widgetspecific training tool text Precondition: the relevant widget text has been converted from RATML into HTML by S065 (Import Widgets Data) The widget-specific training tool text is displayed as a paragraph immediately prior to the training tool link. Precondition: the relevant widget text has been converted from RATML into HTML by S065 (Publish Widgets Data) Request to view a specific (v8+) widget The Attainment Levels section is called Y "Attainment Levels" The Attainment Levels section is the last section Y (so that the user is encouraged to view all the guidance materials first) The attainment levels 0-3 are displayed along Y with the summary description for each. For each attainment level, its "child" attainment criteria are dispayed with their individual IDs (1a, 1b, 1c etc.) The attainment level criteria are based on the Y current improvement plan items - expressed as an outcome instead of an action e.g. "The Trust should document its current arrangements..." has become "The Trust's current arrangements are documented..." It is not possible for users to alter the criteria (edit, add or remove) Attainment Level 0 has standard text: "Insufficient evidence to attain Level 1" Y Y 11/18/2009 11/18/2009 11/25/2009 CMC 11/25/2009 CMC Pass Pass Y 12/7/2009 3/17/2010 CMC Pass

S020

View Attainment Levels (v8+)

General User

View attainment levels and attainment criteria for a (v8+) widget

Main

2 3 4

2/5/2010 N/A

CMC

Pass

2/5/2010 N/A

CMC

Pass

11/16/2009

11/25/2009 CMC

CMC:Should be able to keep existing AttainmentItemPlanTask data structure

Pass

8 9

11/16/2009 11/18/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass Can you put a full stop at the end of Low this sentence please? (sorry, my fault) Superseded by S108 Closed CMC:Data issue as this text held in database. Have changed test data setup script to include full stop

10

The screen layout is such that it is clear that the Y criteria are cumulative (i.e. To get attainment level 2 you need to achieve all attainment level 1 and 2 criteria)

11/18/2009

11/25/2009 CMC

CMC:Will need to be enforced N/A through validation i.e. can't click a criteria unless all previous criteria also clicked TH: this point is really just to do with the way that the page looks, The validation is covered off by S036 (Determine Current Attainment Level)

2a

Request to view a (v8+) widget which has Level 3 Maintenance criteria Level 3 can include "maintenance" criteria (note: these are criteria which only need to be achieved if the organisation was at level 3 in the previous year) The maintenance criteria are explicitly identified as being maintenance criteria The maintenance criteria do not have criteria Ids The maintenance criteria are displayed *after* the main Level 3 criteria, in any order (the business rule is that there should only ever be one maintenance criterion, so irder isn't important) Request to view a (v8+) widget for which "not relevant" is a valid response "Not Relevant" is included as a valid Attainment Y Level There is some widget-specific text to explain Y what "not relevant" means. Request to view a (v8+) widget for which "not relevant" is *not* a valid response "Not Relevant" is *not* included as a valid Attainment Level Request to view a specific (v8+) widget N 11/30/2009 11/25/2009 CMC Pass 11/30/2009 11/30/2009 11/25/2009 CMC 11/25/2009 CMC Pass Pass Y 11/30/2009 11/25/2009 CMC Pass

Y Y Y

11/30/2009

11/25/2009 CMC CMC CMC

Pass Pass Pass

2/8/2010 N/A 2/8/2010 N/A

2b

2 3 2c 1

S021

View Evidence Types

General User

View standard evidence types against each attainment criterion

Main

Each attainment criterion has zero or more "standard" evidence types associated with it.

11/16/2009

11/25/2009 RJM

Pass

All standard evidence types are mandatory Y (optional evidence types were considered but rejected) - although see story S081 re. evidence type strengths View a specific (v8+) widget

11/30/2009

11/25/2009 RJM

Pass

Remove "Type" column (and any High associated underlying data structures) we are no longer including "Type"

Closed

S049

Expand and Collapse Widget (v8+)

General User

Expand or collapse the various sections of the (v8+) widget page

Main

2 3 4 5

All "top-level" sections are expanded by default Y There are options to individually collapse each top-level section There is an option to collapse all top-level sections at once There is an option to expand all top-level sections at once All "attainment criterion details" sections are collapsed by default There are options to individually expand the each attainment criterion details section The collapse button for each attainment criterion details section is to the LHS of the attainment criterion's "Achieved" tick box Request to collapse a top-level section The section is collapsed Y Y Y Y Y Y

11/18/2009 11/18/2009 11/30/2009 11/30/2009 11/18/2009 11/18/2009

11/25/2009 CMC 11/25/2009 CMC 11/25/2009 CMC 11/25/2009 CMC 11/25/2009 CMC 11/25/2009 CMC

Pass Pass Pass Pass Pass Pass

11/30/2009 N/A

CMC

Pass

8 9 10

11/18/2009 11/18/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass

Jerky action - needs to be smoother

Medium

Closed

CMC:Have been changed to Jquery panels as part of reskin

There is an option to expand the section, which Y has replaced the option to collapse the section Request to expand the collapsed section The section is expanded Y

11 12 13

11/18/2009 11/18/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass

Jerky action - needs to be smoother

Medium

Closed

CMC:Has been changd as part of reskin

There is an option to collapse the section, which Y has replaced the option to expand the section Request to collapse all top-level sections All top-level sections are collapsed There are options to individually expand each section, which have replaced the options to collapse each section Request to expand all top-level sections All top-level sections are expanded There are options to individually collapse each section, which have replaced the options to collapse each section Request to expand an attainment criterion details section The section is expanded Y Y Y Y Y

8a

1 2 3

11/30/2009 11/30/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass

4 5 6

11/30/2009 11/30/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass

8b

1 2

11/18/2009

11/25/2009 CMC

Pass

Works OK at first. Then if I expand one High of the top level sections and then try to expand an attainment level, it expands then collapses again! Each time I expand or collapse a top level section, it adds another iteration fo expanding or collapsing to the attainment level. Weird, huh? Will test once above defect fixed

Closed

CMC:Fixed as part of re-skin

There is an option to collapse the section, which Y has replaced the option to expand the section Request to collapse the expanded section The section is collapsed Y There is an option to expand the section, which Y has replaced the option to collapse the section Request to collapse a top-level section Request to expand an attainment criterion details section Navigate to a different widget

11/18/2009

11/25/2009 CMC

Pass

4 5 6

11/18/2009 11/18/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass

8c

1 2 3

CMC: Only for Next/Prev buttons if go back via breadcrumb to the widgets list then panel states are reset to default

The top-level section that was collapsed for the N previous widget is collapsed for the new widget

11/18/2009

11/25/2009 CMC

Pass

Why doesn't it remember the panel Medium states if I go out of the widgets screen and back in again? Is there a technical issue?

Withdraw CMC:Because you didn't ask it to. You n only asked it to remember when clicking the Next and Previous buttons. See predevelopment note for step 3 for 8c above. Is that what you want then ? TH: No, leave it as it is, it's fine

The attainment criterion details section that was expanded for the previous widget is *not* expanded for the new widget

11/18/2009

11/25/2009 CMC

Pass

S023

Indicate Widget As Not Relevant (v8+)

Organisation User

Indicate that a (v8+) widget is not relevant to my organisation

Main

Request to view a (v8+) widget

2 3 4 Indicate that the widget is not relevant to my organisation. Request to save my changes

The system validates that "not relevant" is a N valid response There is an option to indicate that the widget is Y not relevant to my organisation

11/23/2009 11/23/2009

11/25/2009 11/25/2009

Pass Pass

5 6 7

The not relevant status is persisted against the Y widget The system does *not* require me to provide Y details as to why the widget is not relevant (the "not relevant" text already makes clear the valid reasons for a widget not being relevant). "Not relevant" is not a valid response There is *not* an option to indicate that the widget is not relevant to my organisation Y

11/23/2009 12/21/2009

11/25/2009 CMC 3/17/2010 CMC

Pass Pass

2a

1 2

11/23/2009

11/25/2009

Pass

S024

Enter Comments for an Attainment Criterion

Organisation User

Enter comments for an attainment criterion

Main

1 2

Request to view a specific (v8+) widget There is a data field for entry/amendment of comments against each attainment criterion (free form text) Enter comments on an individual attainment criterion Request to save my changes The comments are persisted against the appropriate attainment criterion (TBC link to logical Data Model?) Request to view a widget which already has comments for an attainment criterion The comments are displayed and are editable Edit the comments Request to save my changes The (updated) comments are persisted against the appropriate attainment criterion N/A 11/16/2009 11/25/2009 Pass Y 11/16/2009 11/25/2009 Pass Y 11/16/2009 11/25/2009 Pass Y 11/16/2009 11/25/2009 Visible to healthcare commission? Pass

3 4 5

1a

2 3 4 5

S025

Add Custom Evidence Type

Organisation User

Add a custom evidence type to an assessment criterion (because the standard evidence types are not appropriate for me)

Main

Request to view a specific (v8+) widget

There is an option to add a "custom" evidence type against a specific attainment criterion

11/16/2009

11/25/2009 RJM

Pass

Capital A for "add"

Low

Closed

Pass

Pass

Pass

Pass

Can you make the cursor focus in the pop-up (currently the focus is on the OK button) Can you make the pop-up appear relative (near) to the "add other evidence" link - or alternatively can you create a new row in the evidence table and allow the user to type directly into the table? Can you make the OK button on the popup the default one which fires if I hit return, and the Cancel button fire if I hit "Escape" If I click "add new evidence", then type in the evidence name, then hit Enter, the page refreshes but the text I entered has not been remembered. If I remove the bottom evidence item, confirm, and then float over the "Add other evidence" link, the bottom border of the evidence table disappears. Floating inside the table sometimes makes it reappear. Strange!

Low

Withdraw n Withdraw CMC:Think this should be withdrawn as is n no longer a pop up for adding custom evidence

Low

Low

Withdraw CMC:Think this should be withdrawn as is n no longer a pop up for adding custom evidence Closed 7/5 Still occurs in system test (a.test:acute, reqt 101, criterion 1a)

Medium

Pass

Low

Closed

3 4 5

Add a custom evidence type and give it a name (free form text) Request to save my changes The custom evidence type is persisted against the appropriate attainment criterion for the assessment Request to view a widget which already has a custom evidence type against one of its attainment criteria The existing custom evidence type is displayed (below standard evidence types) Y 11/16/2009 11/25/2009 RJM Pass Y 11/16/2009 11/25/2009 RJM Pass

1a

3 4

There is an indicator to show that it is a custom Y (not standard) evidence type There is an option to add a second "custom" N evidence type against a specific attainment criterion (any number of custom evidence types can be added) Add a second custom evidence type and give it a name (free form text) Request to save my changes The second custom evidence type is persisted against the appropriate attainment criterion Request to view a widget which already has a custom evidence type against one of its attainment criteria There is an option to edit the name of the custom evidence type Y N/A

2/5/2010 N/A 11/16/2009

RJM

Pass Pass

11/25/2009 RJM

6 7

11/16/2009

11/25/2009 RJM

Pass

1b

11/16/2009

11/25/2009 RJM

Pass Pass

7/5 Can the popup get the focus when Low it opens 7/5 Can the label "Edit Evidence" be in Low black, not gray, so it doesn't look like the pop-up is disabled?

Closed Closed

3 4 5

Edit the custom evidence type name Request to save my changes The updated custom evidence type name is persisted against the appropriate attainment criterion Request to view a widget which already has a custom evidence type against one of its attainment criteria There is an option to remove the custom evidence type Request to remove the custom evidence type Request to save my changes The custom evidence type and all associated information is removed from the persistent store. Request to view a specific (v8+) widget Y 11/23/2009 11/25/2009 RJM Pass Y 11/23/2009 11/25/2009 RJM Pass Y 11/16/2009 11/25/2009 RJM Pass

1c

2 3 4 5

S026

Indicate Evidence Obtained

Organisation User

Indicate that I have obtained a particular evidence type

Main

2 3 4 5 Indicate a specific evidence type as obtained Request to save my changes

There is an option to mark each evidence type as "obtained"

11/16/2009

11/25/2009 RJM

Pass

The fact that the evidence type has been obtained is persisted Request to view a specific (v8+) widget

11/16/2009

11/25/2009 RJM

Pass

S027

Enter Evidence Comments Organisation User

Enter comments against a specific evidence type

Main

There is an option to enter comments against each evidence type (free form text) - perhaps via pop-up Note: this option is available even if the user has not yet specified the evidence type as having been obtained Enter comments Request to save my changes The comments are persisted against the evidence type Request to view a specific (v8+) widget which already has evidence comments The existing evidence comments are displayed (perhaps via a pop-up) Edit an evidence comment Request to save my changes The updated comments are persisted against the evidence type Request to view a specific (v8+) widget for which there is an evidence type that has been indicated as obtained

11/16/2009

11/25/2009 RJM

Pass

As per "add evidence" popup can you make the text field focussed initially

Low

Closed

3 4 5 1a 1

11/16/2009

11/25/2009 RJM

Pass

2 3 4 5

11/16/2009

11/25/2009 RJM

Pass

11/16/2009

11/25/2009 RJM

Pass

S028

Specify External Evidence Organisation Location User

Specify an external location for my evidence

Main

There is an option to specify the evidence Y location type as one of the following: 0) Unspecified (the default, but not an acceptable answer!) 1) Uploaded 2) Internet 3) Intranet 4) Local file 5) Other 6) Duplicate (i.e. a reference to evidence already obtained against another attainment criterion) The system highlights the fact that evidence has Y been obtained but the evidence location type has not been specified Specify the evidence location type as "other" The system no longer highlights the fact that evidence has been obtained but the evidence location type has not been specified The system presents an option to specify the evidence location details (free form text, multiple lines) The system highlights the fact that the user has not yet specified evidence location details Specify the evidence location details (free form text) The system no longer highlights the fact that Y the user has not yet specified evidence location details Request to save my changes The evidence location and details are persisted Request to view a specific widget for which there is an evidence type that has *not* been indicated as obtained Proceed as per main flow but ignore steps 3 and 5 Specify the evidence location as "local file" Proceed as per main flow (the user specifies the Y full path and filename as the evidence details) Specify the evidence location as "intranet" Proceed as per main flow (the user specifies the Y relevant URL as the evidence details) Specify the evidence location as "internet" Proceed as per main flow (the user specifies the Y relevant URL as the evidence details) Y N/A Y

11/18/2009

11/25/2009 RJM

complete

Pass

11/30/2009

11/25/2009 RJM

complete

Pass

4 5

11/30/2009

11/25/2009 RJM

complete

Pass

11/30/2009

11/25/2009 RJM

complete

Pass

11/18/2009

11/25/2009 RJM

complete

Pass

No red cross next to details

Medium

Closed

8 9

11/18/2009

11/25/2009 RJM

complete

Pass

Can't test until above defect fixed

10 11 1a 1

11/30/2009

11/25/2009 RJM

complete

Pass

2 4a 1 2

4/20/2010

11/25/2009 RJM

complete

Pass

Red cross still appears

Medium

Closed

3/4/2010

11/25/2009 RJM

complete

Pass

Issues with red crosses as per main flow

Medium

Closed

4b

1 2

3/4/2010

11/25/2009 RJM

complete

Pass

Issues with red crosses as per main flow

Medium

Closed

4c

1 2

3/4/2010

11/25/2009 RJM

complete

Pass

Issues with red crosses as per main flow

Medium

Closed

S131

Specify Evidence Location Organisation Improvement User

Specify an external location for my evidence (improved UI)

Main

Request to view a specific (v8+) widget

For each evidence type, there is an option to specify the evidence location (icon launching pop-up)

N/A

N/A

RJM

Pass

Context help appears behind the popup Tooltip missing from the icon (see prototype)

Medium

Closed

Pass 3 4 5 6 7 Specify the evidence location The system displays the evidence location details appropriate to the evidence location type (dynamically, within the same pup-up) as specified in S028 Specify evidence location details Close the pop-up The evidence location type is updated in the evidence table N N/A N/A RJM Pass Y N/A N/A RJM Pass Request to specify the location for a particular evidence type The system displays the Evidence Location pop- Y up There is an option to specify the evidence Y location type (drop down as per S028) N/A N/A N/A N/A RJM RJM Pass Pass

Medium

Closed

8 9 10

On the pop-up, can you put "Cancel" to the right of "Done" as per standard practice - I keep clicking "Cancel" by mistake!

Low

Closed

RJM:Cancel is placed here in order to be consistent with the requesirements page. Do you want this one changed to be different from the main page? CMC: Fixed as per defect description but as Richard mentioned need to consider order of buttons on the page as well TH 28/3: button order also changed on Widget Details page to match

11 12

Request to save the widget The evidence location type and details are persisted At "Specify External Evidence Location" step 4, specify the evidence location as "uploaded" The system presents an option to upload the evidence file Select the option to upload The system makes it clear that the file will be uploaded to the DH server and provides details of who will be able to access it. The system highlights the fact that the user has not yet uploaded the evidence file Specify the file to upload (type file name or via file browser) and request to upload it The system validates that the file exists The system validates that the file is not bigger than the maximum file size (configurable, initially 5MB) The system uploads the file to the server (note: at this point the file is officially an orphan file until the user saves their changes. If they never save, the uploaded file will have to be cleared out somehow) (tech note:if it's easy to do it might be a good idea to compress the files for storage) N N 3/4/2010 3/4/2010 3/17/2010 RJM RJM Pass Pass Y 4/6/2010 RJM Pass Y 3/4/2010 3/17/2010 RJM Pass N N/A N/A RJM Pass

S030

Upload Evidence

Organisation User

Upload evidence to the PQRT server

Main

2 3 4

3/4/2010

RJM

7 8

3/4/2010

3/17/2010 RJM

Pass

10

11 12

The system persists the date and time of upload N and the current user along with the uploaded file The system displays the uploaded file name Y The system displays the date and time of upload Y and the user name and user ID of the user who uploaded it. The system no longer highlights the fact that N the user has not yet uploaded the evidence file Request to save the widget response data The system persists my changes including the reference to the uploaded file Request to remove the uploaded file from the server The system asks me to confirm Confirm The system indicates that the uploaded file has N been removed (but does not actually remove at this point - only when the user saves their changes - just in case they cancel or crash out) The system re-presents the option to upload an N evidence file Request to save my changes The system persists my changes including removing the reference to the uploaded file (tech note: the uploaded file could also be removed at this point or it could be left to a periodic housekeeping function) Change the evidence location to something else other that "uploaded" Change the evidence location back to "uploaded" The system re-displays the same uploaded file as before Change the evidence location to something else other that "uploaded" Request to save my changes The system persists my changes including removing the reference to the uploaded file (tech note: the uploaded file could also be removed at this point or it could be left to a periodic housekeeping function) File doesn't exist System displays error message File too big System displays error message N N N N N N N

3/4/2010

3/17/2010 RJM

Pass

3/4/2010 3/4/2010

3/17/2010 RJM 3/17/2010 RJM

Pass Pass

13

3/4/2010

RJM

Pass

13 14 13a 1 2 3 4

3/4/2010

3/17/2010 RJM

Pass

3/4/2010 3/4/2010

3/17/2010 RJM 3/17/2010 RJM

N/A N/A

Superseded by S163 Superseded by S163

5 6 7

3/4/2010

3/17/2010 RJM

N/A

Superseded by S163

3/4/2010

3/17/2010 RJM

N/A

Superseded by S163

13b

2 3 13c 1

3/4/2010

RJM

Pass

Doesn't remember the uploaded file

Low

Closed

Only remembers it if it has been saved but that's good enough

2 3

3/4/2010

RJM

Pass

Can;t test until above defect fixed

6a 7a

1 2 1 2

3/4/2010 3/4/2010

RJM RJM

Pass Pass When I try to upload a large file it High "never" completes. Specifically, if I load a 2.4MB file it uploads in ~5 seconds but if I upload a 4MB file (still below 5MB) it hadn't completed after 4 minutes so I aborted. Closed Required a new setting in the webconfig file

S031

View Evidence

Organisation User

View evidence files that I Main have previously specified in my widget response

Request to view a (v8+) widget for which the evidence location type has already been specified as one of "uploaded", "internet", "intranet" or "local file" and the evidence details have also been specified There is an option to view the evidence file Request to view the evidence file The system opens the specified file in a new N browser window (tech note: different file types have different behaviour re. opening a new window e.g. for a PDF you have to explicitly launch a new window whereas for Word/Excel you don't) 3/4/2010 11/25/2009 RJM Cant view 'duplicate' type as this story Pass hasn't been defined & implemented. Viewing a local file within the browser will not be possible as it breaches the browser security. TH 07/04: de-scoped "view duplicate evidence" from this story New browser window needs scroll bars Medium Closed CMC:Not sure what the issue is here haven't been to replicate yet Y 3/4/2010 11/25/2009 RJM Pass

2 3 4

S029

Specify Duplicate Evidence

Organisation User

Indicate that an evidence Main type is a duplicate of another one I've already specified (and cross reference it)

At "Specify External Evidence Location" step 4, specify the evidence location as "duplicate"

The system presents an option to specify the Y evidence location details. This is a list of all evidence types across all other widgets (for the current assessment), including custom evidence. For each evidence type in the list, the following Y information is provided: - widget number - attainment criterion ID or "maint" for a maintenance criterion - evidence type name (standard or custom) first 50 chars plus ellipsis if overflowed - whether it has been "fully specified" Proposed format is a simple drop-down with items in the following format: "R<req no>/<criteria ID or "maint">:<evidenve type desc> [(incomplete)]" e.g. "R101/1a:Job description (incomplete)"

11/23/2009

11/25/2009

11/25/2009

The system highlights the fact that the user has not yet specified evidence location details Select one of the evidence types from the list

11/23/2009

11/25/2009

5 6

The system no longer highlights the fact that N the user has not yet specified evidence location details. This happens even if the referenced evidence is not fully specified Request to save my changes The evidence location and details are persisted Y

11/23/2009

11/25/2009

7 8

11/23/2009

11/25/2009

S140

View Duplicate Evidence

Organisation User

View duplicate evidence Main files that I have previously specified in my widget response

Request to view a (v8+) widget for which the evidence location type has already been specified as "duplicate" and the evidence details have also been specified There is an option to view the referenced evidence Request to view the evidence file The system validates that the referenced N evidence is viewable i.e. - it is of type "uploaded" and has been uploaded, or - it is of type "internet" or "intranet" and the URL has been specified, or - it is of type "local file" and the filename has been specified The system opens the specified file in a new N browser window (tech note: different file types have different behaviour re. opening a new window e.g. for a PDF you have to explicitly launch a new window whereas for Word/Excel you don't) The referenced file is not viewable The system displays an appropriate error message Withdrawn Withdrawn Withdrawn Withdrawn Withdrawn Withdrawn Y 3/4/2010 11/25/2009 Withdrawn

2 3 4

3/4/2010

11/25/2009 Withdrawn

4a

S139

Cannot Delete Referenced Organisation Custom Evidence User

Be prevented from Main deleting custom evidence which is referenced from elsewhere

Request to view a widget which already has a custom evidence type against one of its attainment criteria

2 3 4 Request to remove the custom evidence type

There is an option to remove the custom evidence type

Withdrawn

Withdrawn

Withdrawn

The system validates that the evidence type does have references to it from other evidence types (i.e. There are evidence types marked as location "Duplicate" with a reference to this evidence type) The system informs me that I cannot remove this evidence type because it is referenced. The system lists all the references to this evidence type in the format "R<req no>/<criteria ID or "maint">:<evidenve type desc>" At "Specify External Evidence Location" step 4, specify the evidence location as "uploaded"

Withdrawn

Withdrawn

Withdrawn

Withdrawn

Withdrawn

Withdrawn

Withdrawn

Withdrawn

Withdrawn

S163

Link to Existing Uploaded Organisation Evidence (Mark 2) User

Specify an existing Main uploaded evidence file against another evidence item (enhanced/simplified version)

The system includes an option to select an existing uploaded file

4/22/2010

RJM

Pass Pass In IE6, when I first specity the evidence Medium location type as "uploaded", the "Loading" div appears for a second and then disappears again. If I change the evidence location type to something else and then back again, it doesn't happen In IE6, if I drag and drop the evidence pop-up, the buttons remain transparent after I have dropped it Low Withdraw Not a fault. Access to the server will cause n a loading panel. This happens on first use of upload facility to get the content for the drop down list. The loading panel is displayed for a minimum 0.9s.

Pass

Closed

ie6 is crap. This is being caused by the big yellow button widget causing IE6/7 to render incorrectly. I have changed the button type for the evidence popup from submit's to button's.

Pass 3 The list of existing uploaded files includes all N files uploaded against the current assessment (this might change in future to include previous assessments too) 4/22/2010 RJM Pass

The Done button should be to the left Low of the Cancel button The list included "orphaned" files Medium which were not currently linked to the assessment (they were previously linked but I unlinked them by changing the evidence location type back to "[select]". When I selected one of these files, the system also told me that it was still linked to the widget that I had unlinked it from.

Closed Closed

This will be 3rd time swapped. Are you sure?

4 5 6

The list is in alphabetical order The default value is unselected ("[Select]")

N N

4/22/2010 4/22/2010

RJM RJM RJM

Pass Pass Pass

It's a blank line instead of "[select]"

Low

Closed Closed Not found TH 18/5 tester error

The system indicates that I have not yet either N selected an uploaded file or uploaded a new file

If I click "Done" at this point to go back High to the Widget Details screen, the evidence is marked as "Uploaded" with no red corss, even though I have not uploaded a file.

8 9

Select a file from the list The system displays the audit trail data for the selected file (date and time uploaded, user name and user ID) The system displays the other widgets that the file is also linked to N 4/22/2010 RJM Pass

10

4/22/2010

RJM

Pass

Sometimes it says "This file is linked Medium to" and sometimes it says "this file is *also* linked to". What's the difference between the two scenarios? Shouldn't it always say "this file is *also* linked to"

Closed

RM 18/5: Have changed this but not as discussed as the technical issues involved are complex. Have changed the wording. The 'also' is removed when the only link is itself. Ie it isn't 'also' linked to itself. TH 18/5 as discussed, change this to (a) not display the current criterion as linked and (b) always say "also"

11

12 13 14 15 16 Request to view the file

The system no longer indicates that I have not either selected an uploaded file or uploaded a new file The system enables an option to view the selected file The system displays the file in a new window Select a new local file and request to upload it

RJM

Pass

4/22/2010

RJM

Pass

4/22/2010

RJM

Pass

If the currently selected file is linked to any N other widgets, the system (in a model pop-up) asks me whether I want to: a) Replace the file (so that all widgets are linked to the new file) or b) Add a new file (leaving other widgets linked to the existing one)

4/22/2010

RJM

Pass

Can you change the button and associated text from "New" to "Add" so that it is a verb (more consistent with the other buttons)

Low

Closed

Pass

I should only be asked this question if Medium the currently selected document is also linked to other widgets - if it's not linked elsewhere then there is no difference between "Add" and "Replace" and the question is confusing and intrusive

Closed

18/5: technically difficult - not done. there is a difference but have removed the option and it now does a replace only if there are not other links. TH 18/5 as discussed can you try to make it only ask this question if the widget is linked to any *other* criteria (i.e. Excluding the link to the current criterion)

Pass

Related to the above, can you add the following text to the top of the popup: "This evidence is linked to other widgets. Please select one of the following options:" or similar. After having replaced an existing uploaded file, I tried to replace it a second time. I selected the file and then I got a pop-up appearing very briefly and then disappearing again, and the file was not uploaded. If I leave the Widget Details page and reenter it, I am able to replace the file (presume re-loading the page clears out some bad state)

Medium

Closed

Pass

Medium

Closed

Not found TH 18/5 still occurring (and demonstrated to RJM). RM 19/5 Fixed

Pass

The pop-up disappeared after a Medium period. I'm sure there's a reason it does this, but it seems wrong for a pop-up to disappear of its own accord is there anything we can do about this?

Closed

Popup timeout is 30s. Can be set to infinity or other time very simply.

17 18 8a 1

Indicate whether I want to replace or add The system replaces or adds the file accordingly N (details as per S030) Instead of selecting a file from the list, select a new local file and request to upload it The system uploads the file as per S030 N 4/22/2010 RJM Pass Not really a defect since I didn't ask for it, but could you display a modal pop-up once the upload has succeeded saying "File upload complete" or similar? That way the user gets a very positive message that their file has been uploaded. Medium Closed Dont like it but fixed. TH 18/5 Less obtrusive alternative: make the upload "hourglass" more obvious and say "uploading". RM19/5 implemented loading display 4/22/2010 RJM Pass

The system adds the new file to the list of uploaded files and shows it as the selected file Rejoin main flow at step 9

4/22/2010

RJM

Pass

4/22/2010

RJM

Pass

I attempted to upload a file > 5MB. I Medium got the failure pop-up as expected but when I clicked "Done" on the Evidence Location pop-up I got a pop-up saying "You haven't uploaded the selected file. Are you sure you want to cancel the operation?" The same thing happens if I try to upload a file with an ".accdb" suffix. This message is wrong in this scenario but also it's probably obsolete because we no longer have a 2-stage upload so there's no way you can select a file without uploading it.

Closed

Not found

S032

Configure Evidence Provision Status

Sys Admin

Configure whether Main evidence provision is "overall mandatory" or "overall optional" for each organisation type. This determines whether an organisation is mandated to provide evidence against each attainment criterion.

Specify whether evidence provision is "overall mandatory" or "overall optional" for each organisation type (does not need to be via a GUI)

nili

nili: addition of flag for each organisation type specifying whether evidence is 'overall mandatory'.

Pass

2 3 4 5

Request to save my changes Restart the system The system has persisted my changes Note: the initial configuration for PQRT v8 is that evidence provision is mandatory for large XYZ trusts i.e. Acute, AMT, MHT, GHJ and EFG N/A N/A 11/23/2009 11/18/2009 11/25/2009 nili 11/25/2009 nili Pass Pass

S033

Indicate Attainment Criterion Achieved

Organisation User

Indicate a given attainment criterion as achieved either directly or indirectly

Main

Am completing a (v8+) assessment for an organisation type for which evidence provision is "overall mandatory" There is an option to indicate that each attainment criterion is achieved Attempt to indicate that a given attainment criterion is achieved The system does not mark the attainment criterion as achieved The system notifies me that I must first complete the details for the attainment criterion Am completing a (v8+) assessment for an organisation type for which evidence provision is "overall mandatory" Enter evidence details for the attainment criterion such that all evidence types are "fully specified" Definition: a "fully specified" evidence type is one for which the evidence has been marked as obtained, the location type has been specified and the relevant evidence location details have been entered. The system automatically marks the attainment N criterion as achieved 11/18/2009 11/25/2009 Pass I added new custom evidence and marked it obtained but didn't specify the evidence location. Nevertheless, the system marked the criterion as achieved High Closed N N 11/18/2009 11/18/2009 11/25/2009 11/25/2009 Pass Pass N 11/18/2009 11/25/2009 Pass

2 3 4 5

1a

5 6 7

Request to save my changes The system persists the fact that the attainment N criterion is achieved. Change evidence details so that not all evidence types are fully specified. The system automatically marks the attainment N criterion as not achieved Request to save my changes The system persists the fact that the attainment N criterion is not achieved. Attempt to indicate that a given attainment criterion is not achieved The "achieved" flag is not editable and remains set to "achieved" Am completing a (v8+) assessment for an organisation type for which evidence provision is "overall optional" There is an option to indicate that each attainment criterion is achieved (flag name "Achieved") Indicate that a give attainment criterion is achieved The system marks the attainment criterion as achieved The system encourages me to add details for the attainment criterion by expanding the attainment criterion details section The system makes it clear that adding the details for the attainment criterion is optional but recommended Request to save my changes The system persists the fact that the attainment Y criterion is achieved. Request to view a specific (v8+) widget 11/30/2009 11/25/2009 Pass Y Y 11/30/2009 1/12/2010 11/25/2009 3/17/2010 Pass Pass Y 11/30/2009 11/25/2009 Pass N 11/18/2009 11/25/2009 Pass 11/18/2009 11/25/2009 Pass 11/18/2009 11/25/2009 Pass 11/18/2009 11/25/2009 Pass

8 9 10 1a.5a 3

4 1b 1

3 4 5

1/12/2010

3/17/2010

Pass

6 7

S034

Indicate Attainment Level Organisation 0 (v8+) User

Explicitly indicate that my Main organisation is at Attainment Level 0

There is an option to explicitly indicate Attainment Level 0 for the widgets (this allows the system to distinguish this state from a "not answered" state) Explicitly indicate Attainment Level 0 Request to save my changes

11/30/2009

11/25/2009 CMC

Pass

3 4 5 6

The system persists the fact that I have Y explicitly indicated Attainment Level 0 Note: even when I have explicitly indicated Y Attainment Level 0, the system might ignore me - see "Determine Current Attainment Level 0"

11/30/2009 11/30/2009

11/25/2009 CMC 11/25/2009 CMC

Pass Pass

S035

Capture Date Last Modified

Organisation User

Have the system capture Main and display the "date last modified" for each individual attainment criterion

Request to view a specific (v8+) widget, which includes an attainment criterion that has not yet had any details specified

2 3 4 Specify some details for the attainment criterion

The "date last modified" for the attainment criterion is blank The "date last modified" for the attainment criterion is read only

Y Y

11/23/2009 11/18/2009

11/25/2009 11/25/2009

5 6

Request to save my changes The "date last modified" for the attainment criterion is displayed as the date and time that the system saved the changes Make some further changes but then reverse the changes Request to save my changes The "Date last modified" remains unchanged Y 11/23/2009 11/25/2009 Y 11/23/2009 11/25/2009

7 8 9

S036

Determine Current Attainment Level (v8+)

Organisation User

Have the system determine my current attainment level for a given widget

Main

Request to view a specific (v8+) widget

2 3 4

The widget is marked as not relevant The system displays my current attainment level Y as "NR" The current attainment level (along with past Y and tagret attainment levels) is displayed in large font size below the scoring matrix (it is no longer shown as a radio button selection within the scoring matrix) All level 1, 2 and 3 criteria have been achieved (including level 3 maintenance criteria) and the previous assessment was at attainment level 3 The system displays my current attainment level Y as "3" 11/18/2009 11/25/2009 RJM Pass Working as a.test:acute 2 on reqt 101 High (past level=3)... When I fully specified the evidence for criterion 3a, 3b and 3c, the system did not tick the 3a, 3b or 3c achieved box. When I went out and back in again, the system ticked the box. Didn't have the same problem for level 1 or level 2, or for 3d (a maintennace criterion) Closed There appears to be a bug in the system that is preventing saving of any details data outside of criterion 1a . I suspect some test data is missing that wouldn't be missing if the assessment had been created by the system. RM 21/5: Issue created by change criterion from 1a/1b etc to a/b etc 11/23/2009 12/10/2009 11/25/2009 RJM RJM Pass Pass

2a

Pass

Working as a.test:acute 2 on reqt 101 High (past level=3)... When I fully specified the evidence for criteria 3a, 3b, 3c and 3d, the system ticked Level 3 but did not update Current Level to 3 (remained at 2)

Closed

As above

2b

All level 1, 2 and 3 criteria have been achieved, excluding level 3 maintenance criteria, and last year's assessment was not at attainment level 3 The system displays my current attainment level N as "3" 11/30/2009 11/25/2009 RJM Pass a.test:acute, req't 101, achieved 3a, no High previous assessment, but L3 not shown a.test:acute2, req't 101, past level 2, High achieved 3a,3b,3c but L3 not shown had to complete 3d to get L3 even though past level not 3 Likewise, req't 201 - no past level, but still required to achieve 3d to get L3 Closed

Pass

Closed

2c

1 2

All level 1 and 2 criteria have been achieved The system displays my current attainment level Y as "2" All level 1 criteria have been achieved The system displays my current attainment level Y as "1" 11/18/2009 11/25/2009 RJM Pass If I have achieved all L2 criteria but not Medium all L1 criteria then it is correctly showing Current Level=0 but it is showing L2 as ticked. If not all L1 criteria achieved then L2 should remain unticked even if all L2 criteria are achieved Closed Currently the FS doesn't specify this way of indicating level. Will the FS be changed first? Probably 2-4 days work to change it. 11/18/2009 11/25/2009 RJM Pass

2d

1 2

2e

1 2

Level 0 is explicitly marked as achieved The system displays my current attainment level Y as "0" The user has entered *any* data against the widget The system displays my current attainment level Y as "0". This ties in with S037 - changing the status from "Not Started" to "In Progress" - once a widget has any data put against it, it can be considered In Progress and thus legitimate to assume a score of 0 if not achieved level 1 or higher. None of the above is true The system displays my current attainment level N as undetermined 11/30/2009 11/25/2009 RJM Pass For org a.test:acute, req't 101 - AL1 and AL2 are ticked even though the criteria are not Weont into a "fresh" req't, ticked L0, saved, went out, back in, unticked L0 but Current Level did not go blank (even though no data has been entered) High Closed RJM: this is a test data issue. 11/30/2009 11/25/2009 RJM Pass 11/30/2009 11/25/2009 RJM Pass

2f

1 2

2g

1 2

Pass

Low

Closed

S037

Determine Widget Status

Organisation User

Have the system determine the status of my widget response

Main

View the widgets list for an in-progress assessment (any version) where one of the widgets has not yet been started The system displayes the widget status as "Not Started" (previously "Not Answered") Make some changes to the widget and save my changes View the widget list again The system displayes the widget status as "In Progress" (previously "Answered") Note: other statuses remain as-is (no change) Y Y 11/30/2009 11/30/2009 11/25/2009 11/25/2009 Pass Pass Y 11/30/2009 11/25/2009 Pass

3 4 5 6

S038

Grant Widget Exemption

XYZ ABC User

Grant an exemption from Main a (v8) widget to an organisation

View an in-progress (v8+) assessment for a specific organisation View a specific widget within the assessment for which "not relevant" is *not* an option There is an option for me to mark the organisation as being exempt from the widget Y 11/23/2009 11/25/2009 Pass The exemption description is "Exemption Description for Req 102". This is not supposed to be a widgetspecific description, it is just static text (wording as per prototype) Fixing the above defect by adding the static text from the prototype will fix this Closed

Note: the exemption only applies to the current N/A assessment and not to future assessments Mark the organisation as exempt from the widget The current attainment level changes to EX Y There is an option for me to add free-form Y notes to explain the exemption [not mandatory] Add free form notes Request to save my changes The system persists my changes (including the current attainment level) The system also persists who granted the exemption and when View a specific widget which has already been marked as exempt The system displays the fact that the widget is Y exempt, who exempted it, when and comments There is an option to unexempt the widget There is an option to amend the notes Amend the notes Request to save my changes The system persists the changed notes but does N not change the person or date of exemption Unexempt the widget Request to save my changes The system persists the unexemption and clears N out the person, date and comments Y Y Y Y

11/18/2009

3/17/2010

Pass

Closed

5 6 7

11/23/2009 11/23/2009

11/25/2009 11/25/2009

Pass Pass

There is a superfluous context help icon to the RHS of "Reason"

Closed

8 9 10 11 2a 1 2

11/23/2009 11/23/2009

11/25/2009 11/25/2009

Pass Pass

N/A

N/A

Pass

3 4 5 6 7

N/A N/A

N/A N/A

Pass Pass

N/A

N/A

Pass

8 9 10

N/A

N/A

Pass

As org user I marked a req't as L0. Then as ABC I marked it exempt, and then marked it as not exempt. Instead of changing the Current Level back to L0, it blanked it out. To get it back to L0 again I have to log back in as org user, untick L0 and then tick it again (and save)

Closed

CMC:Note there was also an issue whereby if the organisation had scored the widget and then CfH marked it as exempt when you actually saved it it wasn't persisitng the exempt setting, this is now also fixed

11 12 13 2a 1

Re-exempt the widget [no connets this time] Request to save my changes The system persists the exemption along with the person, date and comments View a specific widget within the assessment for which "not relevant" *is* an option There is *not* an option for me to mark the organisation as being exempt from the widget N 11/30/2009 11/25/2009 Pass N N/A N/A Pass

S039

View Widget Exemption

Organisation User

View a widget exemption Main granted to my organisation

View a specific widget for my inprogress (v8+) assessment for which my organisation has been granted an exemption The system indicates that my organisation has been granted an exemption for this widget Y 11/30/2009 11/25/2009 RJM Pass

3 4

I cannot override the exemption Y The system shows the exemption details: notes, Y date and who granted it

11/30/2009 11/30/2009

11/25/2009 RJM 11/25/2009 RJM

Pass Pass

There is a superfluous context help icon to the RHS of "Reason"

Closed

6 S040 Grant Criterion Exemption XYZ ABC User Grant an exemption from Main an attainment criterion to an organisation 1 View an in-progress (v8+) assessment for a specific organisation

It is clear that the exemption applies to the current assessment only and not to any future assessments My attainment level is shown as "EX"

11/30/2009

3/17/2010 RJM

Pass

Fixing the above defect in S038 by adding the static text from the prototype will fix this

Closed

11/30/2009

3/17/2010 RJM

Pass

2 3

View a specific widget within the assessment There is an option for me to mark the Y organisation as being exempt from each individual attainment criterion Note: the exemption only applies to the current N/A assessment and not to future assessments Mark the organisation as exempt from a specific attainment criterion There is an option for me to add free-form notes to explain the exemption Add free form notes Request to save my changes The system persists my changes The system also persists who granted the exemption and when View an in-progress (v8+) assessment for a specific organisation Y Y 11/23/2009 11/23/2009 11/25/2009 11/25/2009 Y 11/23/2009 11/25/2009 11/23/2009 11/25/2009

11/18/2009

3/17/2010

5 6 7 8 9 10

S041

Grant Criterion Exemption to Org Type

XYZ ABC User

Grant an exemption from Main an attainment criterion to all organisations of a specific type

2 3

View a specific widget within the assessment There is an option for me to mark the Y organisation *type* as being exempt from each individual attainment criterion. Note: the exemption only applies to the current N/A version of the widgets and not to future versions Mark the organisation type as exempt from a specific attainment criterion There is an option for me to add free-form Y notes to explain the exemption (these notes are distinct from the notes provided against my specific organisation) Add free form notes Request to save my changes The system persists my changes The system also persists who granted the exemption and when (this data is distinct from data for any exemption provided against my specific organisation) View a specific widget for a specific organisation type, but not within the context of a specific organisation's assessment There is *not* an option for me to mark the N organisation *type* as being exempt from each individual attainment criterion. View a specific widget for my inprogress (v8+) assessment for which my organisation has been granted an exemption against a specific attainment criterion The system indicates that my organisation has been granted an exemption for the specific attainment criterion I cannot override the exemption The system shows the exemption details: notes, date and who granted it It is clear that the exemption applies to the current assessment only and not to any future assessments View a specific widget for my inprogress assessment for which my organisation *type* has been granted an exemption against a specific attainment criterion The system indicates that my organisation has been granted an exemption for the specific attainment criterion I cannot override the exemption The system shows the exemption details: notes, date and who granted it It is clear that the exemption applies to the current assessment only and not to any future assessments View a specific widget for my inprogress assessment for which both my organisation *and* my organisation type have been granted an exemption against a specific attainment criterion The system shows the exemption details for my Y organisation: notes, date and who granted it The system does *not* show the exemption details for my organisation *type* Y 1/12/2010 Y 11/23/2009 11/25/2009 Y 11/23/2009 11/25/2009 12/21/2009 N/A Y Y 11/23/2009 11/23/2009 11/25/2009 11/25/2009 11/23/2009 11/25/2009 11/23/2009 11/25/2009

11/18/2009

3/17/2010

7 8 9 10

1a

S042

View Criterion Exemption Organisation User

View a criterion Main exemption granted to my organisation

3 4 5

Y Y Y

11/23/2009 11/30/2009 11/30/2009

11/25/2009 11/25/2009 3/17/2010

1a

3 4 5

Y Y Y

11/23/2009 11/30/2009 11/30/2009

11/25/2009 11/25/2009 3/17/2010

1b

1/12/2010 N/A

S043

Determine Current Attainment Level Given Criterion Exemption

Organisation User

Have the system Main determine my current attainment level for a given widget, given that I have a criterion exemption

Request to view a specific (v8+) widget

The widget is marked as exempt (ref. S038 - Grant Widget Exemption) The system displays my current attainment level Y as "EX" XYZ ABC is able to mark a specific standard TBC evidence item as exempt for a specific organisation. The system captures who marked the exemption, when, and their comments. 11/30/2009 11/25/2009

S044

Grant Evidence Exemption

XYZ ABC User

Grant an exemption from a mandatory evidence type to an organisation

Withdrawn

11/25/2009

S045

Grant Evidence Exemption to Org Type

XYZ ABC User

Grant an exemption from a mandatory evidence type to all organisations of a specific type

TBC do we need this?

TBC

Withdrawn

11/25/2009

S046

View Evidence Exemption Organisation User

View an evidence exemption granted to my organisation Save changes I have made to my widget response when I request it or when I perform various navigation tasks Main 1 View a specific widget for an inprogress (v8+) assessment

TBC

TBC

Withdrawn

11/25/2009

S047

Save Widget

Organisation User

3a

2 3 4 1 2 1 2 1 2 3 1 2 3 1 2 3 4 5 6

Make some changes Request to save the widget The system saves my changes Request to move to the next widget The system saves my changes Request to move to the previous widget The system saves my changes Indicate that I am done with the current widget The system saves my changes The system returns me to the widgets list Request to cancel my changes The system does not save my changes The system returns me to the widgets list View a specific widget for an inprogress (v8+) assessment There is an option to request to jump to another widget Make some changes Request to jump to another widget (and specify which one) The system saves my changes The system displays the specified widget Request to view a specific (v8+) widget TBC TBC 11/25/2009 11/25/2009 nili TBC 11/25/2009 Y Y 12/21/2009 12/21/2009 3/17/2010 RJM 3/17/2010 RJM Pass Pass Y Y 11/30/2009 11/30/2009 11/25/2009 RJM 11/25/2009 RJM Pass Pass Y 11/30/2009 11/25/2009 RJM Pass Y 11/30/2009 11/25/2009 RJM Pass Y 11/23/2009 11/25/2009 RJM Pass

3b

3c

3d

S048

Jump To Widget

Organisation User

Navigate quickly from one widget to another

Main

S022

View Printable/Downloadable Version of Widget

General User

View a printable/downloadable version of a widget

Main

2 3 4 Request to print or download the widget

There is a (single) option to print or download the widget

11/18/2009

11/25/2009 nili

Pass

The system opens up the printable/downloadable version of the widget in a new browser window The printable version is in PDF format - it is designed for viewing offline or printing out, and not for filling in. Options to save or print the widget are available (standard Acrobat Reader functions so no need to actually test them) The PDF document is a static placeholder document - this will change once S065 and/or S082 are delivered

11/18/2009

11/25/2009 nili

Pass

File not found - is this a problem with the system test environment? Can't test until above test passes

High

Closed

nili: folder holding widget documents is now specified by test web.config

11/18/2009

11/25/2009 nili

Pass

12/21/2009

nili

Pass

N/A

N/A

nili

Pass

S050

Download Widgets In Bulk

Logged In User

Download printable versions of widgets in bulk, for viewing off-line or for printing out

Main

Request to view the (v8+) widgets list

2 3 4 5 6 Request to download widgets in bulk

There is an option to download widgets in bulk

11/18/2009

11/25/2009 nili

Pass

No link on widgets list page

High

Closed

The widget downloads page is displayed Downloads are only available for my own org type Widget documents are available for download in three formats: 1) Full widget format (guidance plus attainment levels/checklist) 2) Guidance only format 3) Attainment levels/checklist only format Widgets documents are available for download in the following groupings: 1) Booklet: all widgets as a single doc 2) Individual widgets: widgets as individual docs, zipped together There is a warning that the booklet is a large file (because it is > 250MB)

Y Y Y

11/18/2009 11/18/2009 11/18/2009

11/25/2009 nili 11/25/2009 nili 11/25/2009 nili

Pass Pass Pass

11/18/2009

11/25/2009 nili

Pass

The "booklets" list item is incorrectly in bold (lloking at the HTML it looks like it is tagged up as <h3>)

Low

Closed

11/18/2009

11/25/2009 nili

Pass

There are warnings for all files - it should just be for the "All widgets" booklet

Medium

Closed

Pass

Can you put the large file warning in Low bold red (in the prototype I have done it using <span class="warning"> - the warning style would also need adding to the stylesheet See prototype for appropriate wording Medium

Closed

nili: The warning depends upon the file size setting in web.config. I suspect the web.config for the test site does not include this setting. TH 15/3 not sure why you have done it based on file size - the spec doesn't say anything about this, only that the "all widgets" booklet should be marked as a large file nili: I've used the existing 'errorMessage' class which displays the message in red

The system tells advises me how to view and download the files (right click/Save Target As...) Download and open the file The booklet is in PDF format The PDF document is a static placeholder document - this will change once S065 and/or S082 are delivered Download and open the file The download is a ZIP file The ZIP file is a static placeholder file Request to view a specific widget There is an option to download widgets in bulk Request to download widgets in bulk The widget downloads page is displayed Downloads are only available for my own org type Navigate to the Resources page There is an option to download widgets in bulk N Y Y Y Y N Y N

N/A

nili

Pass

Closed

10 11 12

1/12/2010 N/A N/A N/A

nili nili

Pass Pass

File not found

High

Closed

nili: Test web.config now specifies the directory for these documents.

8a

1 2 3 1 2 3 4 5

1/12/2010 N/A N/A N/A

nili nili nili

Pass Pass Pass

File not found

High

Closed

nili: Test web.config now specifies the directory for these documents.

1a

11/18/2009 N/A

11/18/2009 N/A nili 11/18/2009 11/25/2009 nili

Pass Pass

1b

1 2

11/18/2009 N/A

nili

Pass

The link doesn't work - because the High <a> tag doesn't have an href attribute in it. This was previously working so maybe it's a config issue that has been re-created when the test server DB was rebuilt?

Closed

3 4 5 1c 1 2 3 4

Request to download widgets in bulk The widget downloads page is displayed Downloads are only available for my own org type Log in as an XYZ ABC user Request to download widgets in bulk The widget downloads page is displayed There is an option to select the org type (all "assessable" org types in the list, alphabetical, default Acute Trust) Y Y 11/18/2009 N/A 2/22/2010 N/A nili nili Pass Pass N N 11/18/2009 N/A nili 11/18/2009 11/25/2009 nili Pass Pass

Default is blank

Medium

Closed

nili: fixed, but defaults to first orgtype (in ascending alphabetical order) ... Which is usually Acute.

Pass

Formatting of label - should be bold check the styling used elsewhere (e.g. Register page) and copy that. Default is blank

Low

Closed

The downloads for the (default) selected org type are displayed

2/22/2010 N/A

nili

Pass

Medium

Closed

No downloads displayed until I click "View Downloads" - the downloads for Acute should be displayed without me having to click "View Downloads"

Select another org type and request to view the downloads for it The downloads for the newly selected org type are displayed N 2/22/2010 N/A nili Pass 1) I can't test this because there are no High downloads set up for any org type other than Acute Test. Can you add some test data Closed CMC: Have added test entries for Test Acute and XYZ org types. NOTE: Think we may need to consider how this screen works for XYZs and other "simplified interface" types e.g. is it appropriate to have initiative booklets for such a small number of widgets etc TH 23/3: no test data for acute - has it got wiped out by the test server rebuild? Suggest adding test data for "a.test:General Practice" since this is a test org type nili: 2 - amended mark-up format to errormessage for the 'no documents available'message. TH 15/3: Error message shown in black, not red - you have used class "errormessage" - are you sure this is the right one?

Pass

2) The message telling me that there Low are no documents available for a given org type: can you format it as an error instead of an instruction. Check with Tom re. what CSS class to use for an error

Closed

1d

1 2 3 4 5 6 7

Log out Navigate to the Resources page There is *not* an option to download widgets in bulk Navigate to the widgets list for any org type There is *not* an option to download widgets in bulk Navigate to a specific widget There is *not* an option to download widgets in bulk N 1/12/2010 N/A nili Pass Pass Option is there High Closed Withdraw This is a general issue across the whole n site, not just specific to this page separate story required to fix it. CMC:People need to get a bit smarter about how pages are called not just case of getting to the page but also need to make sure query string parameters aren't spoofed etc. These are the kind of issues which will cause us to fail Pen Test if not careful N 1/12/2010 N/A nili Pass Link is there High Closed N 1/12/2010 N/A nili Pass

If I open a fresh browser window, High don't log in and type "http://igttest1dr/igt/DocumentDownl oad.aspx" into the URL, I can get to the downloads page. Shouldn't there be some sort of role-based security which blocks the page if I don't have the relevant permissions?

S076

Download Widgets In Bulk (Per-Initiative Booklets)

Logged In User

Download printable Main versions of widgets in bulk, for viewing off-line or for printing out (specifically, per-initiative booklets)

Request to download widgets in bulk

2 3

The widget downloads page is displayed N Widgets documents are available for download N in the following groupings (additional to S050): 1) Per-Initiative booklets: all widgets from a given initiative in a single booklet

1/12/2010 1/12/2010

3/17/2010 nili 3/17/2010 nili

Pass Pass

All the booklets seem to point to the same (non existent) PDF file - is this just because of how you've set up the test data? If so, can you set up test data with different file names so I can see that you're displaying the correct link?

Medium

Closed

CMC: Have set up different dummy "placeholder" files for test acute and XYZ types

6 7 8

Download and open the file The booklet is in PDF format The content of the PDF document is "Widget Document Placeholder" - this will change once S065 and/or S082 are delivered Y N 1/12/2010 3/17/2010 nili N/A N/A nili Pass Pass File not found Can you make the pop-up window a bit taller - currently it's not so tall and you can only see the (blank) top third of the booklet. Can you make it tall enough so that some of the booklet header page text is visible? Medium Closed Closed CMC:The link is just a standard a href tag with target of blank. Therefore size is not being explicity set and will just take the default browser behaviour TH 22/05: can you change it so that it *does* open the window at a specific size then please? CMC: Made to be maxiumum size think we can get away with whilst still supporting 800x600 resolution

S069

Download Widgets Spreadsheet

General User

Download the widget set Main as a spreadsheet for offline working

Request to download widgets in bulk

There is an option to download the widgets as a Y spreadsheet for my org type

2/25/2010

3/17/2010 nili

Pass

Even though it's only a test file for now, the text should read "All widgets"

Medium

Closed

Pass

For some reason this link is underlined Low but all the others are not. Can you get them consisten please (check with Tom re. link styling)

Closed

CMC: This is fixed by using the spreadsheet PQRT_Widgets_workbook_AcUTE_v8 (draft A).xls as mentioned below nili: all the links should now be underlined

3 4

Download and open the file The file is an MS Excel workbook (XLS format i.e. compatible with Excel 97-2003) Y 2/25/2010 nili Pass File not found - there is an example Medium file you can use in the prototype folder Closed Nili: test web.config amended to specify folder holding widget documents TH 23/3: the link works now but CMC:Am using suggested file for Test Acute org type

The spreadsheet is a static placeholder document - this will change once S106 is delivered.

N/A

N/A

nili

Pass

Could you use the example Low spreadsheet in the prototype ("PQRT_widgets_workbook_ACUTE_v8 (draft A).xls") as the placeholder file?

Closed

S055

Review Submitted Assessment

XYZ ABC User

Review a submitted (v8+) assessment prior to approval

TBC previously done via widgets list but Show all widgets and all details (readonly) TBC now there's extra detail to worry about Include links for evidence Doesn't need to be printable Ability to add review comments (at what level?) TBC Also for use by auditor Remove general comments from widgets list TBC TBC

S056

Create Bulk Email

XYZ ABC User

Create bulk emails to be sent to users

Main

1 2 3 4 5

Request to view a list of bulk emails The system displays the "Bulk Email List" screen Y There is an option to create a new bulk email Request to create a bulk email The system displays the "Bulk Email Details" screen The system tells me that the email will be sent overnight The system requests me to specify details for the email, as follows: Organisation type(s) to send the email to (multiple selection, default none selected) Role(s) to send the email to (multiple selection, default none selected) Assessment status of organisations to send the email to (multiple selection, default none selected) Subject line of the email (default blank) Body text of the email (rich text, default blank) Date to send the email (default today) Enter details for the email Request to create the email The system validates that: I have selected at least one organisation type I have selected at least one role I have selected at least one assessment status I have specified a subject line I have specified some body text I have specified a date to send the email it is either today (but only if the current time is before 6pm) or a date in the future N/A N/A N/A N/A N/A N/A 12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A Des Des Des Des Des Des Pass Pass Pass Pass Pass Pass Error text - "atleast" should be "at least" Error text - "atleast" should be "at least" Error text - "atleast" should be "at least" Low Low Low Closed Closed Closed Y 12/21/2009 N/A Des Pass Page title - change to "Bulk Email Details" - no hyphen and capital "D" Low Closed Y 12/21/2009 N/A 12/21/2009 N/A Des Des Pass Pass

6 7 8

Y Y Y

12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A

Des Des Des

Pass Pass Pass

9 10

Y Y

12/21/2009 N/A 12/21/2009 N/A

Des Des

Pass Pass "Not yet created" should be "(not yet created)" Low Closed

11 12 13 14 15 16

Y Y Y

12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A

Des Des Des

CMC: Need for rich text/HTML editor

Pass Pass Pass

I put a blank date and no error message came up I typed "efkverk" in the date field and got a server error

Medium

Closed

Pass 17 18 The system creates (persists) a "pending" email Y with all the details I have specified The system returns to the "Bulk email List" Y screen The system informs me that it has created a new bulk email which is "pending" Y 12/21/2009 N/A 12/21/2009 N/A Des Des Pass Pass

High

Closed

19

12/21/2009 N/A

Des

Pass

20 21

The system reminds me the date that the email Y will be sent The system reminds me that I can amend or Y delete the email up to 6pm on the date it will be sent Validation criteria not met The system highlights the failed validation criteria Rejoin main flow at step 14 Request to cancel The system returns to the "Bulk email List" screen N N

12/21/2009 N/A 12/21/2009 N/A

Des Des

Pass Pass

The breadcrumb trail shows "Org Admin -> Bulk E-mails List -> Bulk Emails List"! Change "is created" to "created" (present tense inappropriate) Remove underline from message subject Remove hyphen before message subject or add another one after message subject Change "e-mail" to "email" Change "e-mail" to "email" Change "e-mail" to "email"

Low

Closed

Low

Closed

Low Low

Closed Closed

16a

1 2 3 1 2

12/21/2009 N/A

Des

Pass

15a

12/21/2009 N/A

Des

Pass

The breadcrumb trail shows "Org Admin -> Bulk E-mails List -> Bulk Emails List"!

Low

Closed

S057

Add Bulk Email Attachments

XYZ ABC User

Attach files to pending bulk emails

Main

1 2 3

Request to create a bulk email The screen displays the "Bulk Email Details" screen The system provides an option to specify attachments Y Y 12/21/2009 N/A 12/21/2009 N/A Des Des Pass Pass 1) Can you add a label "Filename:" to the left of the field in the attachment popup 2) Can you make the filename field maybe twice as wide (so you can see more of the filename at one time) Closed

4 5 6 7

Enter (valid) details for the email Specify one or more files to attach to the email The system validates that the file is not too large (configurable but default 1MB) The system displays the name(s) of the file(s) specified N Y 3/4/2010 N/A 12/21/2009 N/A Des Des Pass CMC: Presumably this process Pass uploads said file to the server. Do we need to ensure files are unique across emails i.e. can't get overwritten by another upload. Store as BLOBs or on FileSystem ? BLOBS gets round issue of multiple web servers Pass Selected file, clicked "Add Attachment" and got a server error Closed

Tried adding the same file twice and Low got a server error: "An item with the same key has already been added." Only fix this if it is relatively easy to do

Closed

User will be informed, if they try to add the same filename. Is this okay or do we need to allow the user to attach the same file more than once. TH 23/3: rete4sted this - I still get a server error; needs to be a user-friendly error. CMC 26/4 Cannot get this error to occur on local mahcine or test server, suspect may have been some config changes, Suggest re-testing

8 9 6a 1

Request to create the email The system persists the files along with the pending email File too large The system displays an appropriate error message N 3/4/2010 N/A Des Pass I get the following error message in the pop-up: Server Error in '/PQRT' Application. ------------------------------------------------------------------------------Maximum request length exceeded. Medium Closed CMC: Cannot get to occur, have made confiog changes, suggest re-test. N/A 12/21/2009 N/A Des Pass

8a

1 2 3 1 2

Request to remove one of the attachments The system no longer displays the name of the removed attachment Rejoin main flow at step 7 Request to view an attachment (click on its file name) The system opens the specified file in a new N browser window (tech note: different file types have different behaviour re. opening a new window e.g. for a PDF you have to explicitly launch a new window whereas for Word/Excel you don't) Wait until the morning after a bulk email was due to be sent Validate that the system was *not* in bulk email test mode (configurable) The system has sent the bulk email to all specified recipients N/A N/A N/A N/A CMC CMC: Individual recipients or enmasse recipients ? TH: can be either so long as users don't see other users' e-mail addresses 12/21/2009 N/A Des Pass N 12/21/2009 N/A Des Pass

8b

S058

Send Bulk Email

XYZ ABC User

Have the system send all due bulk emails

Main

CMC: SQL Agent job? If so need files as BLOBS in database. SQL CLR code to convert BLOB to file Pass Pass

2 3

12/21/2009 N/A

4 5

The system has *not* sent the email to users with locked accounts The email "from" address is a "do not reply" address

N/A N/A

12/21/2009 N/A 12/21/2009 N/A

CMC CMC

Pass Pass Shown as from "PQR App Administrator" - remove this name so the email address only is showing Medium Closed Des 24/05 - Fixed

The e-mail (when received) does not contain the e-mail addresses of any other recipients. The subject line is as specified The body text is as specified (with rich text formatting) The attachments are as specified The email is marked as "sent"

N/A

4/26/2010 N/A

CMC

Pass

7 8 9 10

N/A N/A N/A N/A

12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A

CMC CMC CMC CMC

CMC: Needs to be sent HTML mail then

Pass Pass

Pass CMC: What happens if not sent Pass TH: the only reason it would not be sent is due to a technical failure - not something I would document in the FS - but obviously you need to code for data integrity i.e. Don't mark it as sent unless it was actually sent

Still marked as pending

Closed

Des 24/05 - Fixed

Pass

As discussed, email sender should Medium write some output to a log file stating what time it ran and a summary of the results of the run (number of emails sent, Ids of emails sent, number of recipients for each one)

Closed

Des 24/05 - Fixed

2a

1 2

System is in bulk email test mode The system has sent the bulk email to a single (configurable) test account (default value tony.heap@nhs.net) N/A N/A N/A Pass Email content needs to be exactly as users would see it Closed Des 24/05 - Fixed

The email includes an attachment or appendix which is a list of the recipients that it would have sent it to if not in test mode Rejoin main flow at step 3 (but use the attachment/appendix to determine the intended recipients) Request to view a list of bulk emails The system displays a list of all bulk emails, pending and sent The list is in reverse chronological order For each email the system tells me the subject line For each email the system tells me the "send date" (the date it was sent or is due to be sent) For each email the system tells me the status (Sent or Pending) There are currently no bulk emails The system displays a message to indicate that there are no bulk emails

N/A

N/A

N/A

Pass

N/A

N/A

N/A

Pass

S059

View Bulk Emails

XYZ ABC User

View bulk emails (both sent and pending)

Main

1 2

Des Y 12/21/2009 N/A Des Pass Page title - change "E-mail" to "Email" Low (also in breadcrumb) Closed TH 10/3 - breadcrumb needs to change from "Bulk Email List" to "Bulk Emails" to match main page title

3 4 5

Y Y Y

12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A

Des Des Des

Pass Pass Pass

6 2a 1

12/21/2009 N/A

Des Des Des

Pass

N/A

N/A

Pass

Message says "No Bulk Email sent yet" Low - change it to "No Bulk Emails created yet" (notice plural!)

Closed

TH 10/3 - the message is in blue on a blue background so I can't see it! Can you change it to a simple paragraph of text instead of putting it in a table?

S060

Amend Bulk Email

XYZ ABC User

Amend a pending bulk email

Main

1 2 3 4 5 6 7 8 9 10

Request to view a list of bulk emails For each pending email there is an option to edit the email Request to edit a pending email The system displays the "Bulk Email Details" screen All details of the email are populated All details of the email are editable Edit the email details Request to save my changes The system performs the same validations as per S056 (Create Bulk Email) The system updates (persists) the "pending" email with all the details I have specified The system returns to the "Bulk Email List" screen Validation criteria not met The system highlights the failed validation criteria Rejoin main flow at step 7 Request to cancel The system returns to the "Bulk Email List" screen Request to view a list of bulk emails For each pending email there is an option to delete the email Request to delete a pending email The system asks me to confirm N 12/21/2009 N/A Y 12/21/2009 N/A N 12/21/2009 N/A N 12/21/2009 N/A N N 12/21/2009 N/A 12/21/2009 N/A Y N Y 12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A Y 12/21/2009 N/A

Des Des Des Des Des Des Des Des Des Des Pass

Pass Pass Pass

Pass Pass

11 9a 1 2 3 1 2

12/21/2009 N/A

Des Des Des Des Des Des

Pass

Pass

8a

Pass

S061

Delete Bulk Email

XYZ ABC User

Delete a pending bulk email

Main

1 2 3 4

Des Des Des Des Pass

Pass

5 6 7 8 3a 1 2 3 4 5

Confirm The system deletes the email The system re-displayes the "Bulk Email List" screen The deleted email has been removed from the list Request to edit a pending email The system displays the "Bulk Email Details" screen There is an option to delete the email Request to delete the email Rejoin main flow at step 4 N 12/21/2009 N/A Y N 12/21/2009 N/A 12/21/2009 N/A N N N 12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A

Des Des Des Des Des Des Des Des Des Des

Pass Pass Pass Pass

The popup box styling is all wrong (e.g. High Transparent background) - it used to be OK so presume it got broke by the re-styling activity The popup box is not modal High

Closed

Closed

Pass Pass Pass Email was deleted without asking for confirmation High Closed TH 23/3: failed retest

S080

View Bulk Email

XYZ ABC User

View a sent email

Main

1 2 3 4 5 6

Request to view a list of bulk emails For each sent email there is an option to view the email Request to view a sent email The system displays the "Bulk Email Details" screen All details of the email are populated All details of the email are *not* editable N N N 12/21/2009 N/A 12/21/2009 N/A 12/21/2009 N/A Y 12/21/2009 N/A

Des Des Des Des Des Des Pass

Pass Pass Pass

There is *not* an option to save the email

12/21/2009 N/A

Des

Pass

Is it possible (easy) to make the Body Low section non-editable? If not, don't worry, there is no "Save" button so it's not a big deal Can you change the Cancel button to a Low Done button

Closed

Closed

S102

Bulk Email Look & Feel

XYZ ABC User

Have a nice look & feel for the bulk email function

Main

Go to the Bulk Email List screen

Des

Look & feel is as per prototype page "bulk_email_list.html"

N/A

Des

Pass Pass

"Create Bulk Email" should be "Create Low new bulk email" Context help icons should be below Low the table headings (use <br>) The "New bulk email created" messages should be within a <div class="infoMessage"> Can you make the tab section a bit taller so that all the User Roles fit in without needing a scroll bar The "required field" marker for Subject has wrapped on to the next line (IE6, IE7). Perhaps make the subject box a little narrower? "Add Attachments" should be "Add attachment" (lower case A and singular) Created a new bulk email with no attachments. Tried to edit it and got a system error (see email from TH to Des on 20/05/2010) Low

Closed Closed

Des 24/05 - Fixed Des 24/05 - Fixed

Pass

Closed

Des 24/05 - Fixed

3 4

Request to create a bulk email Look & feel is as per prototype page "bulk_email_details.html" Y N/A

Des Des

Pass

Low

Closed

Des 24/05 - Fixed

Pass

Low

Closed

Des 24/05 - Fixed

Pass

Low

Closed

Des 24/05 - Fixed

Pass

High

Closed

Des 24/05 - Fixed

S062

View Undelivered Bulk emails

XYZ ABC User

View a list of undelivered bulk emails so that I can consider whether to amend user details

TBC

TBC

12/21/2009 N/A

Needs technical investigation into how it can be achieved

S063

View Glossary Term Definition

General User

View the definition of a term that is defined in the glossary

Main

View a (v8+) widget that has a phrase marked up as a glossary term within any of its RATML fields The phrase is highlighted so that it looks similar Y to but distinct from a normal hyperlink (e.g. Underlined but in a different colour) 1/12/2010 3/17/2010 CMC

CMC: Note glossary terms marked by <g></g>. Within these tags will either have the term or acronym. CMC:Could use dotted underline if Pass possible

Dotted underline good. Can your remove the italics (apparently it's not so good for disabled users) Can you change the colour (I'm thinking green - I'll put something in the prototype

Low

Close4d

3 4 5 6 7

Float the mouse cursor over the term The mouse cursor changes to a "hand" shape as Y it would for a hyperlink The "explanation" of the phrase appears in a Y float-over window (like a "tooltip") The explanation appears immediately (no delay) N The explanation remains indefinitely whilst the N mouse cursor is positioned over the term (tech note: standard tooltip using "title" attribute of <a> tag disappears after a few seconds. Suggest using jquery tooltip plugin or similar) The explanation consists of data from the N matching glossary entry. A glossary entry matches if either the term or acronym is a (case insensitive) match for the marked up phrase. If more than one glossary entry matches the marked up phrase then the selection of which entry to display is arbitrary. 1/12/2010 1/12/2010 1/12/2010 1/12/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010 CMC CMC CMC CMC Pass Pass Pass Pass

1/12/2010

3/17/2010

RJM

Pass

The format of the explanation is "term (acronym): definition" (but see below for qualifiers and exceptions)

1/12/2010

3/17/2010

CMC

CMC:Will always have term but acronym and defintion are optional

Pass

Don't have enough test data to test Medium this - can you add some more glossarised terms to the guidance text so I can try out the various options. Whilst you're at it, can you remove the glossary tags from Caldicott Guardian and IM&T (I think they have been copied across from the prototype HTML) Can you change the formatting so that Low (a) all the text is a bit bigger -standard Windows tooltip size and (b) the acronym is in bold but not italics

Closed

See guidance for Acute Test 101 widget for examples of glossary items

Closed

CMC: previously text size was set to xsmall have now set it to small which is the next size up. If this is too large then we would have to explicity set the font-size to a paticular point which is not good accessibility practice. See guidance for Acute Test 101 widget for an example

10

The term is capitalised as per a title e.g. "Code of Conduct"

4/26/2010

3/17/2010

CMC

Pass

11

12

If the acronym is not specified then it is omitted Y along with its surrounding parentheses and leading space. If the definition is not specified then it is Y omitted along with the leading colon. Move the mouse cursor away and float it over the term again The explanation appears again. Click the term The system displays the entire glossary in a separate (non-modal) tab/window (ref. S064 View Glossary), scrolled down to the selected term. Y Y

1/12/2010

3/17/2010

RJM

Pass

Not really a fail but can you confirm that you haven't actually coded anything for this - it's supposed to be an authoring note to the Policy Team, as opposed to anything the system needs to do. Can't test - need test data

Low

Closed

Medium

Closed

See guidance for Acute Test 101 widget for examples of glossary items See guidance for Acute Test 101 widget for examples of glossary items

1/12/2010

3/17/2010

RJM

Pass

Can't test - need test data

Medium

Closed

13 14 15 16

1/12/2010 1/12/2010

3/17/2010 3/17/2010

CMC CMC

Pass Pass

1b

View a widget within the widget list that has a term marked up as a glossary term within the widget question text Rejoin main flow at step 2 View the printable version of a (v8+) widget that has a term marked up as a glossary term within any of its RATML fields The term is highlighted in some way so as to indicate that it is a glossary term (e.g. Italics). The term is *not* hyperlinked through to anywhere View any page There is an option to view the glossary (on the nav bar) Request to view the glossary The system displays the glossary in a separate (non-modal) tab/window The glossary lists all glossary terms The terms are in alphabetical order (case insensitive) - using the full term, not the acronym Y Y Y 12/21/2009 12/21/2009 12/21/2009 3/17/2010 3/17/2010 3/17/2010 Pass Pass Pass Y 1/12/2010 3/17/2010 N/A Superseded by S078 - link is on Resources page instead Y 1/12/2010 CMC Pass Y 1/21/2010 3/17/2010 RJM Pass

2 S070 View Glossary Term (Printable) General User Identify glossary terms in Main the printable version of a widget 1

1/12/2010

CMC

Pass

S064

View Glossary

General User

View the entire glossary

Main

1 2 3 4 5 6

There is no indicator as to which letter Medium of the alphabet you are looking at this is a problem for e.g. "E" where there are no glossary terms. How about making the current letter a different colour, or not a link?

Closed

Highlights selected letter in red with no underline

7 8

For each term, the acronym is displayed if applicable For each term, the definition is displayed if applicable (might not be applicable if the term is in the glossary purely to expand an abbreviation)

Y Y

12/21/2009 12/21/2009

3/17/2010 3/17/2010

Pass Pass No test data so can't test - can you add Medium a glossary term which is an abbreviation only. Also, how will this be displayed in terms of alphabetical order? Closed CMC:test data now there try N for No defintion glossary term. Note glossary entry always has a term and it is this which is used to order the glossary as per step 6 above

S071

View Printable/Downloadable Version of Glossary

General User

View a printable/downloadable version of the glossary

Main

View the glossary

2 3 4 Request to print or download the glossary

There is a (single) option to print or download the glossary

1/12/2010

3/17/2010

RJM

Pass

5 6

The system opens up the Y printable/downloadable version of the glossary in a new browser window The printable version is in PDF format. Y Options to save or print the glossary are Y availavle (standard Acrobat Reader functions so no need to actually test them). The content of the glossary is as per the online version Page footer includes page number (central) Y

1/12/2010

3/17/2010

RJM

Pass

1/12/2010 1/12/2010

3/17/2010 3/17/2010

RJM RJM

Pass Pass

1/12/2010

3/17/2010

RJM

Pass

1/12/2010

RJM

Pass

Will test when new XSL is in place (also need to run Glossary PDF publish process) No page footer. I have updated the Medium glossary XSL to include a page footer (available on request) but note that it will also require a change to the glossary XML file because I have refactored it a bit

Closed

9 S066 Publish Knowledge Base Sys Admin Publish a new version of Main the Knowledge Base based on the data held in RAT 1 Manually copy all (new or amended) KB "internal" files to the correct location on the PQRT web server(s) Request to import KB data from RAT into PQRT staging tables

The glossary is *not* version controlled

N/A

1/12/2010

CMC Des

Pass

2 3 4 5 6

Des PQRT staging tables populated with KB data from RAT (identical format) N/A N/A N/A Des Pass

Run KB "publish" process The system validates that all "internal" KB resources exist on the PQRT web server(s) The system updates its KB tables to match the data in the staging tables N/A N/A N/A N/A N/A N/A Des Des Pass Pass Using real KB data...System bombed High out with no error message. I think it was part way through processing as it has copied 202 out of 244 KB docs from Source to KnowledgeBaseNew. The first defect is that there should be an error message Once you have got it to display the error message, fix the underlying defect too! High Closed

Pass

Closed

Note that the "weblink" field is in MS Access weblink format - to get the "raw" URL, take the string between the first and second "#" symbol

N/A

N/A

N/A

Pass

10

Any records in the staging table for which Title, N/A Type or Location is not specified are *not* published, and the user is presented with a warning message to this effect. Any records for which Location is "External" N/A and "Weblink" is not specified are *not* published, and the user is presented with a warning Any records for which Location is "Internal" and N/A "FileName" is not specified are *not* published, and the user is presented with a warning The system determines the file type (extension) N/A and size for each "internal" resource file and records this in the DB

N/A

N/A

Pending

N/A

N/A

Pending

N/A

N/A

Pending

11

N/A

N/A

Des

Pass

Pass 12 13 14 15 5a 1 One or more KB resources are missing from the PQRT web server(s) System displays error including list of missing resources Abandon the function Request to import widget and knowledge base data from RAT into PQRT staging tables N/A N/A N/A N/A N/A N/A Request to view a specific (internal) KB resource (ref. S075) Resource is correctly displayed (as per existing KB functionality) N/A N/A N/A View the KB via the PQRT web interface (ref. S075) Correct (new) version of the KB is displayed (as per existing KB functionality) N/A N/A N/A Des Des Des Des Des Pass Pass

File size slightly out - you need to divide the number of bytes by 1024, not 1000, to get KB Can you put the file type in caps and remove the leading dot?

Low

Closed

Desi 08/06: Fixed

Low

Closed

Desi 08/06: Fixed

No KB docs being displayed (but are appearing in req'ts pages)

High

Closed

2 3 S065 Publish Widgets - Online Version Sys Admin Publish or re-publish a Main version of the widgets based on the data held in RAT (online widgets only) 1

Des Des

Pass Pass

The system populates PQRT staging tables with widget data form RAT (identical format) Request to run widget "publish" process (in PQRT).

N/A

N/A

N/A

thma1

Pass

System says "files have been exported Low successfully" - should say "imported"

Closed

RJM

3.1

PQRT looks at the version info in its own N/A database to determine the major version number for the "current" widget set PQRT determines and displays the widgets that N/A would be added by the re-publish process (i.e. Widget variants in the staging tables but not in the live PQRT database for the "current" major version) PQRT determines and displays the widgets that N/A would be uplifted to a new minor version by the re-publish process (i.e. Widget variants already in the PQRT live database but at a lower minor version for the "current" major version) PQRT determines and displays the widgets that (in theory) would be deleted by the re-publish process (i.e. Widget variants in the PQRT live database but not in the staging tables for the "current" major version), and makes it clear that deletion is a manual process. If there are any widgets to be added, uplifted or deleted for a given org type, PQRT validates that there are no existing assessments from an affected organisation where the assessment status is anything other that "started". Confirm that I wish to proceed PQRT runs the "knowledge base publish" function first (ref. S066) in order to make sure the PQRT database has the latest knowledge base data in it N/A N/A

N/A

N/A

thma1

Pass

N/A

N/A

thma1

Pass

When displying the org type, display the org type name, not the org type short name

Low

Closed

N/A

N/A

thma1

Pass

Version numbers are reversed (e.g. It says "will be uplifted from v8.1 to v8.0")

Low

Closed

N/A

N/A

thma1

Pass

N/A

N/A

N/A

thma1

Pass

8 9

N/A

N/A

thma1

Pass

I deliberately caused the KB publish to Low fail by removing some of the KB files. The system did fail and tell me why but it also gave me the following error: "Publication failed with: Unable to cast object of type 'System.Int32' to type 'System.String'." which sounds like a coding error to me Got error: "Publication failed with: High Unable to cast object of type 'System.Int32' to type 'System.String'."

Closed

11

PQRT updates its widget records to match the data in the staging tables, as follows:

N/A

N/A

N/A

thma1

Pass

Closed

12

Widgets that don't already exist (according to widget number, major version number and org type) are added.

N/A

N/A

N/A

thma1

Pass

13

Widgets that require a minor version uplift are N/A replaced with the new minor version. Note: it can be assumed that attainment levels, attainment criteria and evidence items are not added or removed from one minor version to the next (this would cause problems with existing assessments), but that widget origins and widget changes may be added or removed.

N/A

N/A

thma1

Pass

14 15

References to KB resources are correctly N/A mapped across from staging tables. Where a KB resource does not exist in the PQRT N/A database (because it failed the KB publish process as per S066), the widget is not linked to it, and no warning message is displayed. Links to existing assessments are maintained RATML fields are converted into HTML "snippets" as appropriate for display (see stories S013-S021) View online version of widget (ref. stories S013-S021) Correct (new) version of widget is displayed. Note: format/content of page is specified in S013-S021. N/A N/A N/A

N/A N/A

N/A N/A

thma1 thma1

N/A N/A

Superseded by S201 Superseded by S201

16 17

N/A N/A

N/A N/A

thma1 thma1

Pass Pass

18 19

N/A

N/A

thma1

Pass

Evidence items have speech marks around them

Medium

Closed

Pass

In the KB table, can the file type be in caps and with no leading dot? This probably needs fixing within the knowledge base publish function

Low

Closed

RJM

7a

There are existing assessments that would be affected by an *added* widget PQRT displays a list of affected organisations N/A (including Name, organisation Code, assessment status) The system tells me that it cannot proceed with N/A the re-publish because some organisations would be affected. N/A N/A thma1 Pass

N/A

N/A

thma1

Pass

Would not let me proceed when adding a req't for an XYZBP even though the only affected assessment was for a CTP (which was only affected by deletions)

Medium

Closed

7b

There are existing assessments that would be affected by an uplifted or deleted widget PQRT displays a list of affected organisations (including Name, organisation Code, assessment status) The system warns me that I should only proceed with the re-publish if it is to reflect a simple change (e.g. Typo fix) because some organisations would be affected. N/A N/A N/A thma1 Pass

N/A

N/A

N/A

thma1

Pass

The system told me I *cannot* publish, Medium even though I only have req'ts to be uplifted, not added

Closed

Pass

The system warning was displayed *before* the summary of affected orgs instead of after

Low

Closed

4 S082 Publish Widgets Printable Version Sys Admin Publish or re-publish the printable versions of the widgets Main 1 This story extends S065 by also generating the printable versions of the widgets (continue on from the end of S065). Request to view the printable version of a widget

Rejoin main flow at step 8 (confirmation)

thma1

Pass

2 3

Correct (new) version of widget document is displayed.

N/A

N/A

N/A

Pass

The publish tool crashed out before copying the widget documents up to the web server - suspicion is it's to do with file permissions - not being able to overwrite existing files The system didn't provide any sort of error message when it crashed out

High

Withdraw TH 16/6 for now it's a manual process to n copy the files into the web server folder, but needs addressing longer term TH 6/7 raised a separate defect in Misc Defects 2 Closed

Pass

Medium

Pass

The document does not have a specific title - it begins with the Header Panel.

1/12/2010

thma1

Pass

Pass

The system didn't roll back the High database changes when it crashed out trying to copy the files Your XSL files are out of date. I will High send you a new set. When you get these, do not reformat them or prettyprint them because it causes FOP to insert whitespace where it's not wanted. I notice in the App/Resources folder Low you have widgetPreview.xsl, widgetCore.xsl and widgetBookletFullWidget2fo.xsl. You do not need these files. Suggest removing to avoid confusion/clutter.

Closed

Closed

Closed

Pass

On the test server, I notice the XML files generated in "Output" are suffixed ".PDF.XML" whereas they should probably just be ".XML". Not a functional fail, obviously, but confusing for support usersf

Low

Withdraw This helps grouping them together in the n file space - I can delete these after publish...?? TH 9/6 fair enough - leave as-is

Page footer includes page number and page Y count (central) and key info (RHS): req't no., org type, req't version (major/minor) e.g. "R101 | Acute Trust | v8.0" All sections are the same as the on-line widgets Y page except where stated below.

11/30/2009

11/25/2009 thma1

Pass

11/30/2009

11/25/2009 thma1

Pass

Key reqt icon not appearing in header box - is this due to a missing GIF?

Medium

Closed

Pass

Pass

The Guidance Section excludes the section heading "Guidance" The Attainment Levels section is titled "Attainment Levels (including Checklist)" in order to make it clear that the previously separate checklists documents have been incorporated The Attainment Levels section mirrors the content on the on-line widgets page but in a format suitable for printing and filling in by hand (including evidence types and space to make notes).

1/12/2010 N/A

thma1

Pass

Knowledge base items are not in the Medium correct order - should be ordered by sequence ID Knowledge base "exemplar" section Medium missing in some cases e.g. Acute reqt 3. They appear to be missing from the XML file. Guidance section heading is present - Low needs removing from XSL (Tony to do) Just Attainment Levels (Tony to fix in XSL) Low

Closed

Closed

Closed

11/30/2009

11/25/2009 thma1

Pass

Closed

10

11/18/2009

11/25/2009 thma1

Pass

Attainment c riterion ID section can be Low narrower now we don't have Maint

Closed

Pass

Maintenance criteria are not showing Medium the preliminary phrase "[Only required if Attainment Level 3 was achieved in the previous assessment]". This is present and correct in the XSL but needs to be triggered by the presence of a <maintenanceCriterion/> tag in the XML file

Closed

11

12

The Past Level box has a footnote indicating Y that this information can be found online via the PQRT For a logged on user, the printable version is Y *not* populated with any of the data they have entered so far (a separate report will be provided to address this need)

1/12/2010

thma1

Pass

11/30/2009

11/25/2009 thma1

Pass

S099

Publish Widgets - ZIP File Sys Admin Downloads

Publish or re-publish the Main ZIP file downloads for the widgets

This story extends S065 by also generating the ZIP file downloads for the widgets (continue on from the end of S065). Download and open the full widget format individual widgets (ref. S050) The ZIP file contains a file for each widget for the org type N 1/12/2010 3/17/2010 thma1 Pass The filename should be "PQRT_Widgets_<org code>.zip" High Closed 7/5/10 You have used org name instead of org code e.g. It should be "AMT" not "Ambulance Trust" TH 27/5: now the org type is blank meaning that the files for the different org types have overwritten one another TH 27/5: you have used the Org Type ID instead of the Org Type "Code" field

The widget file names are such that the widgets N appear in ascending numerical order, even if the widgets have different numbers of digits Each widget file is a PDF file Each widget is in the same format as the individual printable version (ref. S022) Download and open the guidance only format individual widgets The ZIP file is as per the full widget format except for the differences stated below: The Attainment Levels section is omitted from each widget N N Y Y

1/12/2010

3/17/2010 thma1

Pass

The reqt numbers need to be padded to 3 digits with zeros to make sure they will appear in numerical order

Low

Closed

CMC:With new numbering convention have 0 padded to 4 characters rather than 3.

5 7 2a 1 2 3

1/12/2010 1/12/2010

3/17/2010 thma1 3/17/2010 thma1

Pass Pass

1/12/2010 1/12/2010

3/17/2010 thma1 3/17/2010 thma1

Pass Pass

The footer indicates that the booklet is "guidance only" format

1/12/2010

3/17/2010 thma1

Pass

No footer - can you check it's the Medium latest version of widgetGuidanceOnly2fo.xsl, containing: <xsl:call-template name="widgetFooter"> <xsl:with-param name="variant">guidanceOnly</xsl:wi th-param> </xsl:call-template>

Closed

TH 7/6 Failed retest (need to rebuild test?)

2b

Download and open the attainment levels/checklist only format individual widgets The ZIP file is as per the full widget format except for the differences stated below: For each widget, the header information is in a more compact format For each widget, all sections other that the Attainment Levels section are omitted The footer indicates that the booklet is "attainment levels/checklists only" format This story extends S065 by also generating the PDF booklet downloads for the widgets (continue on from the end of S065). Download and open the full widget format booklet (ref. story S050) The booklet has a title page which includes the org type, widgets version and issue date Y 1/12/2010 thma1 Pass On the Downloads page, the "all High widgets booklet" label is "Confidentiality and Data Protection Assurance (All Widgets, 107 KB), whereas it should be "All widgets (PDF, 107 KB)" The booklet filename should be Medium "PQRT_Widgets_Booklet_<org code>_v<major version>.pdf The booklet header page includes High "Confidentiality and Data Protection Assurance" which it shouldn't. Looking at the source XML file, you have incorrectly inserted an "<initiativeName>" tag at the top level this should only be inserted for an initiative-specific booklet On the downloads page, the "All Widgets" booklet should be after the individual initiative booklets Low Closed N N N N 1/12/2010 1/12/2010 1/12/2010 1/12/2010 3/17/2010 thma1 3/17/2010 thma1 3/17/2010 thma1 3/17/2010 thma1 Pass Pass Pass Pass

2 3 4 5

S100

Publish Widgets - Booklet Sys Admin Downloads

Publish or re-publish the booklet downloads for the widgets

Main

2 3

Pass

Closed

You have put version before org code

Pass

Closed

Pass

Closed

CMC:Will now dipslay below Initoative booklets and Initiative booklets will be in the correct "Initiative" order (previously they weren't ordered at all)

Page footer includes page number and page count (central) and key info (RHS): org type, req't version (major) e.g. "Acute Trust | v8" The booklet has a table of contents which mirrors the format of the "Widget List" page The TOC includes a page number for each widget

1/12/2010

thma1

Pass

1/12/2010

thma1

Pass

1/12/2010

thma1

Pass Pass On the TOC page the first initiative heading is not being displayed. This is an XSL fix by Tony Medium Closed

7 8 9 2a 1 2 Download and open the guidance only format booklet

The booklet includes all widgets for the org type N The widgets are in ascending numerical order The content of each widget is as per the individual prinatble version of the widget N Y

1/12/2010 1/12/2010 1/12/2010

thma1 thma1 thma1

Pass Pass Pass

The booklet is as per the full widget format except for the differences stated below:

1/12/2010

thma1

Pass

The booklet filename should be "PQRT_Widgets_Booklet_<org code>_v<major version>_Guidance_Only.pdf

Medium

Closed

3 4 9b 1 Download and open the attainment levels/checklist only format booklet

The title page and footer indicate that the booklet is "guidance only" format The Attainment Levels section is omitted from each widget

N N

1/12/2010 1/12/2010

thma1 thma1

Pass Pass

The booklet is as per the full widget format except for the differences stated below:

1/12/2010

thma1

Pass

The booklet filename should be Medium "PQRT_Widgets_Booklet_<org code>_v<major version>_Attainment_Levels_Only_Onl y.pdf

Closed

You have put a suffix of "Guidance_Only_Attainment_Levels_Only "! CMC: And you've put a suffix of Only_Only.pdf to the left ;-) However pretty sure I know what you want and have fixed it

4 5

The title page and footer indicate that the booklet is "attainment levels/checklists only" format For each widget, the header information is in a more compact format For each widget, all sections other that the Attainment Levels section are omitted This story extends S065 by also generating the PDF per-initiative booklet downloads for the widgets (continue on from the end of S065). Download and open full widget format per-initiative booklet (ref. story S050) The booklet is as per the full widget format "all widgets" booklet except for the differences stated below:

1/12/2010

thma1

Pass

Y Y

1/12/2010 1/12/2010

thma1 thma1

Pass Pass

S101

Publish Widgets - PerInitiative Booklets

Sys Admin

Publish or re-publish the per-initiative booklet downloads for the widgets

Main

1/12/2010

thma1

Pass

The booklet filename should be "PQRT_Widgets_Booklet_<org code>_v<major version>_<initiative name with underscores instead of spaces>.pdf" For the "guidance only" and "attainment levels only" add the relevant suffix "_Guidance_Only" or "_Attainment_Levels_Only"

Medium

Closed

RJM: No fault found. Require more information. Can not identify any truncated files. Can not find any files with incorrect filename. TH:You have put a suffix of "Guidance_Only_Attainment_Levels_Only "! Also it looks like the filename may have been truncated at some point (difficult to tell where)

4 5 6

It only includes the widgets for the specified N initiative The TOC only shows the initiatives for the N specified initiative The header indicates which initiative is covered N

1/12/2010 1/12/2010 1/12/2010

thma1 thma1

Pass Pass Pass Sorry I have sneaked this in as an extra Medium widget. I have updated the XSL but you will also need to add a new tag into the XML - <initiativeName> immediately following <organisationTypeLongName> in the general header section (not within each individual widget) Closed RJM: No fault found. InitiativeName tag is being added to the WidgetSet node as required. TH 16/6:Initiative name not showing - I checked the XML and you don't have an <initiativeName> tag within the <widgetSet>.

S151

Publish Widgets Sys Admin Spreadsheet (Technology Spike)

Publish or re-publish the Main XL spreadsheet download for the widgets (simple version to prove technology)

This story extends S065 by also generating the XL spreadsheet for the widgets (continue on from the end of S065).

2 3

Download and open widget spreadsheet (ref. story S069) The spreadsheet file is an MS Excel workbook (XLS file i.e. compatible with Excel 97-2003) Y 2/25/2010 TM Pass Can you change it so that the filename Medium uses OrganisationType.Code instead of OrganisationType.Description? This also applies to all PDFs, booklets and ZIP files. The label for the spreadsheet link should read "All widgets" The filename should have "_v8" not just "_8" in it High Low Closed

Pass Pass 4 5 6 The spreadsheet has a sheet called "Widget Y List" (first sheet) The sheet has the org type shown in the title (as Y per prototype) The general layout/formatting of the sheet is as Y per "PQRT_widgets_workbook_ACUTE_v8.xls" within the prototype The various column headings have comments as per the prototype This story extends S151 by also generating the details in the "List" sheet. Y 2/28/2010 4/26/2010 2/26/2010 3/17/2010 TM TM 3/17/2010 TM Pass Pass Pass

Closed Closed

2/27/2010

TM

Pass

S106

Publish Widgets Spreadsheet (List Sheet)

Sys Admin

Publish or re-publish the Main XL spreadsheet download for the widgets (widgets list sheet)

2 3 4 5

Download and open widget spreadsheet (ref. story S069) The Widget List sheet contains a summary list of all widgets, one per row The widgets are in sequential order Each widget has the following fields (columns): - Widget number - Key widget status - Widget question text - Past level - Current level - Target level Y Y Y 3/1/2010 3/2/2010 3/3/2010 3/17/2010 TM 3/17/2010 TM 3/17/2010 TM Pass Pass Pass Formatting of description field first row is incorrect Medium Closed TH 16/6 re-tested this and now it is showing the template row as well as the real data rows (need to delete it?)

Pass Fail

Pass

Remove hyperlink from description High field Rows are not quite high enough to fit Low the descriptions in - if I double-click the row header to auto-adjust the height it makes each one a bit bigger and then it's OK. Can you simulate this via ASPOSE to get them all the right height? Past and Target levels are showing as Medium '0' instead of blank

Closed Failed TM 20/7 Cannot replicate

Closed

The widgets are grouped by initiative, with coloured initiative headers This story extends S151 by also generating the "Details" sheet.

Pass

PQRM initiative header wrong colour

Low

Closed

S107

Publish Widgets Spreadsheet (Details Sheet)

Sys Admin

Publish or re-publish the Main XL spreadsheet download for the widgets (widgets list sheet)

2 3 4

The spreadsheet has a sheet called "Details" Y (second sheet) The sheet has the org type shown in the title (as Y per prototype) The general layout/formatting of the sheet is as Y per "PQRT_widgets_workbook_ACUTE_v8.xls" within the prototype

3/5/2010

3/17/2010 TM TM

Pass Pass Pass Req No field still too wide - bear in mind the req numbers are in the format "8-101", not "8-8101" Low Closed

2/26/2010

3/17/2010 TM

Fail Pass

The rows are not high enough to Low display all the descriptions The description for Attainment Level 0 Low (column E) should ne "Insufficient evidence to attain Level 1." The criteria should be just "a, b, c" instead of "1a, 1b, 1c" etc. (sorry, my fault, the prototype was wrong Low

Failed Closed

TM 20/7 Cannot replicate

Pass

Closed

5 6

The various column headings have comments as per the prototype The Details sheet has one row per widget attainment criterion

Y Y

2/27/2010 3/6/2010

TM 3/17/2010 TM

Pass Pass Set up some test data with 'NR Medium allowed' set for reqt 101 but an NR row was not included on the spreadsheet For the NR row, I think that columns F Low thru K should be greyed out the same as attainment level 0 Closed There is an 'X' in the "achieved" column for the NR row

Pass

Closed

The criteria are ordered by widget number first, Y attainment level second (0,1,2,3,NR), criteria ID third (1a, 1b rtc. Or 2a, 2b etc or 3a, 3b, Maint) Each criterion has the following fields Y (columns): - Widget number - Key widget status - Widget question text - Attainment level - Attainment level description - Attainment criterion ID - Attainment criterion description (for level 0 this is defaulted to "There is insufficient evidence to attain Level 1") - Evidence required (single cell with one line per "standard" evidence item - Evidence obtained (blank for user to complete) - Owner (blank for user to complete) - Actions (blank for user to complete) - Achieved (blank for user to complete) - Past level - Current level - Target level The Attainment level and attainment level Y description fields are merged into a single cell for each attainment level The req no, key req status, req question text, Y past level, current level and target level fields are merged into a single cell for each widget The current level field is calculated Y automatically based on which criteria the user has marked as achieved, as follows (see prototype for an example formula): - (NR explicitly marked as achieved) = level NR - (past level = 3) and (all level 1,2 and 3 criteria achieved) = level 3 - (past level = 2 or less) and (all level 1,2 and 3 criteria except level 3 maintenance achieved) = level 3 - (all level 1 and 2 criteria achieved) = level 2 - (all level 1 criteria achieved) = level 1 - (level 0 explicitly marked as achieved) = level 0 - otherwise blank (i.e. not yet answered)

3/7/2010

3/17/2010 TM

Pass

3/8/2010

3/17/2010 TM

Pass

3/9/2010

3/17/2010 TM

Pass

10

3/10/2010

3/17/2010

Pass

11

3/11/2010

3/17/2010

Pass

If I mark NR achieved, the Current Level field is still blank

Medium

Closed

Pass 12 The past, current and target level fields on the Y "List" sheet are are read-only and automatically copied from the corresponding fields on the Details sheet This story follows on from S106 3/4/2010 3/17/2010 TM Pass

If I mark level 0 achieved, the field is still blank

Medium

Closed

S148

Publish Widgets Spreadsheet (Report sheet)

Sys Admin

Publish or re-publish the Main XL spreadsheet download for the widgets (report sheet)

2 3

The spreadsheet has a sheet called "Report" (third sheet) The sheet has (auto populated) summary data as follows: - no. of reqts not yet answered - no. of reqts answered at level 0 - no. of reqts answered at level 1 - no. of reqts answered at level 2 - no. of reqts answered at level 3 - no. of reqts answered "not relevant" - current score - target score

Y Y

3/12/2010 3/13/2010

3/17/2010 TM 3/17/2010 TM

Pass Pass

The current score is calculated as follows: Y (sum of all scores) divided by (3 x total no. of widgets excl. Those marked as N/R) Expressed as a percentage to the nearest whole number Taget score is calculated as per current score but based on target attainment levels Y

3/14/2010

3/17/2010 TM

Pass

3/15/2010

3/17/2010 TM

Pass

Sorry, my fault: all the current and target scores need to be rounded down to the nearest whole percentage. You can achieve this by wrapping your formula within "=FLOOR(<formula>, 0.01)" As above

Medium

Closed

Medium

Closed

6 7

The summary data is shown per initiative and Y also as an overall total There is a pie chart based on the summary data Y as demonstrated in the prototype The sheet has the org type shown in the title (as Y per prototype) This story extends S065 by also including the glossary in the PDF booklets and ZIP files (continue on from the end of S065). Request to download a widgets booklet (any format) The widgets booklet includes a complete glossary at the end Request to download individual widgets The ZIP file includes the glossary as a separate PDF file Manually copy glossary PDF (as created by RATty) to the correct location on the PQRT web server(s) View printable version of glossary in PQRT (see story S071) Correct (new) version of glossary is displayed. Note: format/content of document is specified in S071. Request to import glossary data from RAT into PQRT staging tables PQRT staging tables populated with glossary data form RAT (identical format) Run glossary "publish" process (in PQRT) PQRT updates its Glossary records to match the N/A data in the staging tables View online version of glossary (ref. story S064) Correct (new) version of glossary is displayed. Note: format/content of document is specified in S064. N/A N/A N/A Y Y

3/16/2010 3/17/2010

3/17/2010 TM 3/17/2010 TM

Pass Pass

TM

Pass

S072

Publish Widgets Booklets with Glossaries

Sys Admin

Publish or re-publish the booklet downloads for the widgets, including a glossary section

Main

2 3 2a 1 2

12/21/2009

12/21/2009

S067

Publish Glossary

Sys Admin

Publish a new version of Main the glossary based on the data held in RAT

2 3

N/A

N/A

N/A

Superseded by S081

4 5 6 7 8 9

N/A

N/A

N/A

Superseded by S081

N/A

N/A

N/A

Superseded by S081

N/A

N/A

N/A

Superseded by S081

S081

Publish Glossary (Advanced)

Sys Admin

Publish a new version of Main the glossary based on the data held in RAT (advanced version including PDF generation within PQRT)

Request to import glossary data from RAT into PQRT staging tables (using Meerkat)

2 3 4 5 Run glossary "publish" process (in PQRT)

Meerkat populates PQRT staging tables with data form RAT (identical format)

N/A

N/A

N/A

Pass

PQRT updates its Glossary records to match the N/A data in the staging tables PQRT creates the Glossary PDF file and N/A publishes it to the correct location on PQRT web server(s).

N/A N/A

N/A N/A

Pass Pass On system test env't, the PDF file is Medium not being created. We suspect this is due to folder access permissions (readonly folder) - it works OK in UAT - but I can't test this until it works Copying the file to the web server is Low currently a manual process and needs automating Closed

Pass

Withdraw TH 6/7 raised as separate defect in Misc n Defects 2

PQRT re-creates the various widgets booklets and ZIP files that contain the glossary as specified in S082 View online version of glossary (S064) PQRT displays the correct (new) version of glossary. Note: format/content of document is specified in S064.

N/A

N/A

N/A

N/A

Superseded - glossary no longer included in booklets

7 8

N/A

N/A

N/A

Fail

Glossary includes terms that have been deleted and are presumably being cached somewhere in memory. Can the publish process clear out the cache?

Low

Failed

TM 20/7 - Have added credentials as part of request to see if it is a proxy problem pls retest and let me know if fixed. TH 21/7 still not clearing the cache - TM says the web service is being called OK (checked Meerkat logs) so problem must be within the cache clearing code (originally written by RJM)

Fail

I added a new term via RATty and ran the publish process. The new term appeared in the PQRT database table GlossaryTerm but does not appear when I view the online glossary. A caching issue perhaps?

Medium

Failed

TM 20/7 - As above.

Pass

View the glossary for the letter "B" Medium which has enough terms to produce a scroll bar. Scroll down and notive that the table content scrolls behind the (static) table headings

Closed

RJM TH 16/6 Retested - there is no scroll bar now so I can't scroll the pop-up (IE7). RJM tested in all browsers, cant find a problem with scroll bar. Appears when more data is present than page length permits. Problem was in Resources/glossary terms link not in the general glossary pop-up.

9 10

View printable version of glossary in PQRT (see story S071) PQRT displays the correct (new) version of the printable glossary. Note: format/content of document is specified in S071. View widgets booklets and ZIP files PQRT displays correct (new) version of the widget booklets and ZIP files Request to view a summary of my current and previous assessments The system validates that I am *not* in a Y position to start a new assessment - specifically that I have an in-progress assessment or I have completed my most recent assessment but there is *not* a new version of the widgets available yet [no change] The system displays all of my assessments, in reverse order (most recent first) [no change] N N/A N/A nili N/A Superseded by S173 N/A N/A N/A N/A Superseded - glossary no longer included in booklets N/A N/A N/A Pending Awaiting defect fix above

11 12

S073

View Assessment Summary

Organisation User

View summary data about my assessment

Main

1 2

N/A

N/A

nili

N/A

Superseded by S173

The top-most (most recent assessment), even if Y it is "not yet started", is titled as "Your Current Assessment" and the remaining assessments (if any) are titled as "Your Previous Assessments" For each assessment (whatever version), the system displays the following information: - Widgets version (in the header) - Widget set start year (as determined by start date) and end year (as determined by submission date) - Assessment ref - Current status - Status history (pop-up), in reverse chronological order - Next deadline as per S091 - Baseline score (if assessment is 3-stage and has been baselined) - Performance Update score (if assessment is 3stage and has been Performance Updated) Y

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

6 7

3/18/2010 3/18/2010

3/17/2010 nili 3/17/2010 nili

Pass Pass

8 9 10 11 12 13

Y Y Y Y Y Y

3/18/2010 3/18/2010 3/18/2010 3/18/2010 3/18/2010 3/18/2010

3/17/2010 nili 3/17/2010 nili 3/17/2010 nili 3/17/2010 nili 3/17/2010 nili 3/17/2010 nili

Pass Pass N/A Pass N/A N/A

Superseded by S173

Superseded by S173 Superseded by S173

14

15

16

- Current score - this includes widgets that are Y still at status "in progress" where they have a score [If the assessment has already been submitted, N the label for the current score is "Overall Score"] - The number of widgets that fall into each of Y the following categories: - Not Yet Answered (i.e. no attainment level calculated - not based on widget status) - Level 0 - Level 1 - Level 2 - Level 3 - Not Relevant - Exempt (only display category if count >0) - Total (a sum of all the other counts) For each category except Exempt, if the value is zero, display the category but leave the count blank

3/18/2010

3/17/2010 nili

Pass

4/6/2010

nili

Pass

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

17 18 19

20

[The attainment levels are colour coded: red for 0-1, green for 2-3] - As above for the baseline (if assessment is 3stage and has been baselined) - As above for the performance update (if assessment is 3-stage and has been Performance Updated) The system does *not* show the assessment description (removal of existing feature)

Y Y Y

3/18/2010 3/18/2010 3/18/2010

3/17/2010 nili 3/17/2010 nili 3/17/2010 nili

N/A N/A N/A

Superseded by S173 Superseded by S173 Superseded by S173

3/18/2010

3/17/2010 nili

Pass

21

22

The system presents a list of actions that can be Y performed (as per existing actions but presented as a list of links instead of a mixture of links and buttons) If the assessment is against v8+ widgets, the system additionally displays the following: - Grade, as follows: Y - "Not Satisfactory" (background red) if not achieved level 2 in *all* widgets - "Satisfactory" (background green) if achieved level 2 or above in *all* widgets - The percentage scores are *not* colour-coded Y (we do not want to RAG overall percentages) (removal of existing feature) If the assessment is against v7+ widgets, the system additionally displays the following: - All scores (current, target, baseline, perf update) are RAG coloured as per existing rules - *not* Grade All buttons and links for each assessment are shown as per current [no change] I am in a position to start a new assessment The system displays a "shell" assessment summary for the new version widgets at the top of the page, above my other assessments. This is labelled as "Your Current Assessment" The following information is included: - Widgets version (in the header) - Widget set start year (as determined by start date) and end year (as determined by submission date) - Current status of "not yet started" - Next deadline as per S091 The system provides an option to create a new assessment (existing function) The system does *not* prompt me for an assessment description in order to create a new assessment My existing assessments are displayed below this "shell" assessment as per Main Flow My existing assessments are labelled as "Your Previous Assessments" Request to view a summary of my current and previous assessments For each assessment which has one or more target scores set, the system displays the following information: - target score - calculated as (total of target attainment levels) / (3 x total number of req'ts excluding thise with a taregt of NR or EX) - target grade (satisfactory/not satisfactory) based on target scores. Any target scores not set count as not having attained level 2, whereas NR and EX are OK Y N

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

23

3/18/2010

3/17/2010 nili

Pass

24

3/18/2010

3/17/2010 nili

Pass

25

26

3/18/2010

3/17/2010 nili

Pass

27 28 2a 1 2

N N

3/18/2010 3/17/2010 nili N/A N/A nili

Pass Pass

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

3 4 5 6

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

3/18/2010 3/18/2010

3/17/2010 nili 3/17/2010 nili

N/A N/A

Superseded by S173 Superseded by S173

7 8 9 10

Y Y Y Y

3/18/2010 3/18/2010 3/18/2010 3/18/2010

3/17/2010 nili 3/17/2010 nili 3/17/2010 nili 3/17/2010 nili

N/A N/A N/A N/A

Superseded by S173 Superseded by S173 Superseded by S173 Superseded by S173

11

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

12

3/18/2010

3/17/2010 nili

N/A

Superseded by S173

S136

View Assessment Summary Target Score

Organisation User

View my target score along with my assessment summary

Main

4/12/2010

nili

N/A

Superseded by S173

4/12/2010

nili

N/A

Superseded by S173

4/12/2010

nili

N/A

Superseded by S173

S077

Look and Feel

General User

Use the application easily Main and without aesthetic insult to my eye

View any page (using IE7 "Gold" on Win XP SP2)

The width of the main panel is a fixed width of Y 760px (i.e. Just the right width to be fully visible when viewed in a maximised browser on an 800px wide screen. The header and footer are variable width, expanding or contracting as the browser is resized. Y

2/22/2010

3/17/2010 thma1

Pass

content panel too wide

High

Closed

2/22/2010 N/A

thma1

Superseded by S104

N/A

4 5

The header and footer re-size gracefully (i.e. N Graphics don't crash into text or links) If the browser window is too narrow for the nav N bar and main panel to be completely visible, the main panel is *not* displayed below the nav bar; it remains to the right of it If the browser window is narrower than the main panel, a horizontal scroll bar is displayed Y

2/22/2010 N/A 2/22/2010 N/A

thma1 thma1

Superseded by S104

N/A Pass

2/22/2010

3/17/2010 thma1

Pass

Scroll bar appears even if browser Low window is wider than the page - there seems to be about 300px of whitespace to the right of the page

Closed

7 8

Header bar is XYZ blue (as per ABC branding), Y with dark blue bottom border Application title ("Information Governance Y App") appears in header bar (white, large, bold, LHS) Application title also appears in windows Y header bar (i.e. Via html <title> tag)

2/8/2010 N/A 2/8/2010

thma1

Superseded by S104

N/A Pass

3/17/2010 thma1

2/11/2010

3/17/2010 thma1

Pass

10

XYZ logo (not XYZ ABC logo) appears in header bar (LHS), but doesn't link through to any other website

2/22/2010

3/17/2010 thma1

Pass

Title in windows header bar is "PQR Medium App Home" and I'm guessing it changes as the page changes. It needs to be "Information Governance App" on every page XYZ Logo looks fuzzy because it's anti- Low aliased around the outside edge. Can you make it have a nice crisp outside edge? Even the XYZ letters look to have fuzzy edges - can you reduce (not completely remove) the anti-aliasing effect to sharpen it up a bit?

Closed

11

DH logo appears in header bar (RHS) - clicking on it opens DH website in new window

2/11/2010

3/17/2010 thma1

Pass

Likewise the DH logo is fuzzy - can you Low sharpen it up a bit?

12

Header bar includes link to DH home page (opens in new window)

2/9/2010

3/17/2010 thma1

Pass

Link works but links in this section need to be separated by a vertical bar "|" or similar

Medium

Withdraw TM - I took this from the nhs logo n website. Do you still want me to se if I can find a better one? TH 15/3 - The logo I downloaded from nhsidentity.nhs.uk is nice and crisp - I suspect that it has got fuzzified by your painting software when you have resized it. TH 9/6 superseded by S172 Withdraw Again took it fro their site, the scaling n seems to have that effect. Superseded by S172 TH 15/3 See comment above Closed TH 15/3 still no separators in the header links

13 14 15

Header bar includes link to XYZ ABC home page Y (opens in new window) Header bar includes link to Accessibility page Y Header bar includes link to Contact Us page Y

2/9/2010 2/11/2010 2/11/2010

3/17/2010 thma1 3/17/2010 thma1 3/17/2010 thma1

Pass Pass Pass I clicked "Widgets" then "Contact Us" Low and noticed that (a) The breadcrumb says "You are Here: Widgets > Contact Us" instead of "Home > Contact Us" and (b) the Widgets nav bar item is highlighted as being the current one, instead of "Home". Closed Fixed by CC (15/3) TH 22/3: Failed retest.CMC: Contact Us no longer directly avaialbel from main navigation menu so think this can be withdrawn, have marked as Fixed for now TH 20/5 - Contact Us available as a link from the header links on every page CMC: Also same issue fixed for Accessibility and About header links

16 17

18 19 20 21 22 23

Header bar includes link to About page Header bar includes a "Skip to Content" link which takes the user to an anchor/div at the top of the main panel. This is for accessibility purposes Nav bar appears on LHS Nav bar items are single level Nav bar items are white text on dark blue background, with white separating line Selected nav bar item has XYZ blue background and arrow indicator at RHS Nav bar has bottom "finisher" with curvy corners Breadcrumb trail (2nd level nav) appears at top of main panel

Y Y

2/11/2010 2/11/2010

3/17/2010 thma1 3/17/2010 thma1

Pass Pass

Took me to the start of the main section *after* the breadcrumb

Medium

Withdraw n

Y Y Y Y Y Y

2/8/2010 3/17/2010 thma1 2/8/2010 3/17/2010 thma1 2/8/2010 N/A thma1 2/12/2010 N/A 2/8/2010 2/8/2010 thma1

Superseded by S104 Superseded by S104

Pass Pass N/A N/A Pass Pass It's in the right place but I don't like "You are here >>" - can you change it to "You are Here:" or convince me otherwise :) Low Closed TH 15/3 Failed retest TH 22/3 can you remove the space between "here" and the colon

3/17/2010 thma1 3/17/2010 thma1

24 25

Fonts and sizes are as per the XYZ ABC website

2/11/2010 N/A 2/11/2010

thma1 thma1

Superseded by S104 Superseded by S171

N/A N/A Changing the font size via the browser Medium had no effect on the page TH 11/05 - the latest cut of the prototype includes relative font sizes talk to me about how best to incorporate these Withdraw n

All font sizes are relative, to allow users the Y option to change the font size via their browser

26 27 28

Footer separated from main page by horizontal Y line in XYZ blue Footer contains "(c) Crown Copyright 2000Y 2010" Footer contains link to XYZ ABC Privacy Y Statement (opens in new window)

2/8/2010 N/A 2/11/2010 N/A 2/11/2010 N/A

thma1 thma1 thma1

Superseded by S104

N/A Pass Pass Pass Didn't open in a new window Also, can you put a bar separator between the links in the footer Didn't open in a new window Medium Low Medium Closed Closed Closed

29 30

31 32

Footer contains link to XYZ ABC Copyright Statement (opens in new window) Footer contains link to PQRT Terms & Conditions (opens in same window, ref. story S086) - no change No logos in footer Footer does not contain helpdesk info (instead users use the "contact us" link in the header bar View any page (using IE6 SP2 on Win XP SP2) All "Look and Feel" acceptance criteria fulfilled (rejoin Main flow at step 2) View any page (using Firefox 3.5 on Win XP SP2) All "Look and Feel" acceptance criteria fulfilled (rejoin Main flow at step 2) View any page (using IE8 on Win XP SP2) All "Look and Feel" acceptance criteria fulfilled (rejoin Main flow at step 2) View any page (using Google Chrome 4 on Win XP SP2) All "Look and Feel" acceptance criteria fulfilled (rejoin Main flow at step 2) View any page

Y Y

2/11/2010 N/A 2/11/2010 N/A

thma1 thma1

Pass Pass

Y Y

2/11/2010 N/A 2/11/2010 N/A

thma1 thma1

Pass Pass

1a

1 2

Date Unknown

N/A

Superseded by S087

1b

1 2

Date Unknown

N/A

Superseded by S087

1c

1 2

Date Unknown

N/A

Superseded by S087

1d

1 2

Date Unknown

N/A

Superseded by S087

S104

Look and Feel v2

General User

Have an enhanced aesthetic experience, with lovely soft curves caressing my visual senses

Main

Look & feel is as per S077 except where listed below: The header and footer are fixed width Header bar is XYZ blue as per the XYZ logo colour Lovely curves here and there as per Tom's prototype

TBC TBC TBC TBC

2/25/2010 2/25/2010 2/25/2010 2/25/2010

Pass Pass Pass Pass Some of the straight lines (e.g. Top edge of header) look a bit fuzzy because of the anti-aliasing - can you sharpen them up a bit please? Low Withdraw TM Without the aiasing they would be n jaggy. I cant control the level of antialiasing. Superseded by S172

Application title is centred, not LHS Nav bar items are white text on XYZ blue background, with no separating line Selected nav bar item has DH sea green background and arrow indicator at RHS

TBC TBC TBC

2/25/2010 2/25/2010 2/25/2010

Pass Pass Pass When I hover over a nav bar <li> item, Low it goes light blue (nice) but I can only click on it if am hovering the actual <a> - if I click within the <li> but outside the <a> then nothing happens, which is a bit confusing because it is highlighted blue, suggesting I should be able to click it Pass TM Without rewriting the whole nav bar not to use links, not sure on this one. RJM: Fixed TH 14/06 - an improvement but we could also do with (a) the pointer changing to a hand shape and (b) the tooltip appearing wherever you are in the blue rectangle. This probably means changing the styling for the <a> tag to cover the whole of the rectangle area. Shout me if you want me to see if I can do it in the prototype

Breadcrumb has XYZ blue background Breadcrumb expands on to multiple lines if content is too long

TBC TBC

2/25/2010 2/25/2010

Pass Pass

If I select Req'ts/A.TEST:Acute/All/101 Medium then the words crash into the graphics on the RHS Testing of this will be picked up as a separate exercise and new stories raised as appropriate

Withdraw Not found n TH 14/06 no longer an issue

The main content of the page "looks nice" and TBC is consistent with the overall theme. This item is time-boxed: it is to be applied to as many of the pages as possible in the time available for the story. The reaminder will be picked up in a separate story if necessary.

2/25/2010

N/A

S078

Improved Navigation

General User

Navigate the site more easily

Main

1 2 3 4 5 6 7 8 1 2 3 4 5 7 8 9 10 1 2 3 4 5 6

View any page (not logged in) The nav bar has the following options: Home (goes to Home [not logged in] page) What's New (goes to What's New page) Widgets (goes to Widgets (Org Types) page) Reports (goes to Reports page) Resources (goes to Resources page [new]) Help (goes to Help page [new]) View any page (logged in as org user) The nav bar has the following options: Home (goes to Home [logged in] page [new]) What's New (goes to What's New page) Widgets (goes to Widgets Categories page) Reports (goes to Reports page) Resources (goes to Resources page [new]) Admin (goes to Admin page [new]) Help (goes to Help page [new]) View any page (logged in as org admin) The nav bar has the following options: Home (goes to Home [logged in] page [new]) What's New (goes to What's New page) Widgets (goes to Widgets Categories page) Assessments (goes to Assessments Summary and History page)

Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des

Y Y Y Y Y Y

2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010

Pass Pass Pass Pass Pass Pass

1a

N N N N N N N

2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010

Pass Pass Pass Pass Pass Pass Pass

1b

Y Y Y Y

2/11/2010 2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010

Pass Pass Pass Pass

1c

7 8 9 10 1 2 3 4 5 6 7 8 9 10 1 2

Reports (goes to Reports page) Resources (goes to Resources page [new]) Admin (goes to Admin page [new]) Help (goes to Help page [new]) View any page (logged in as XYZ ABC user) The nav bar has the following options: Home (goes to Home [logged in] page [new]) What's New (goes to What's New page) Widgets (goes to Widgets (Org Types) page) Assessments (goes to Assessments Org Chooser page) Reports (goes to Reports page) Resources (goes to Resources page [new]) Admin (goes to Admin page [new]) Help (goes to Help page [new]) Request to view help (not logged in or logged in as any type of user) Help page displayed - blank for now Note: the contents of the help page are specified in other stories

Y Y Y Y

2/11/2010 2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010

Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des Des

Pass Pass Pass Pass

N N N N N N N N

2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010

Pass Pass Pass Pass Pass Pass Pass Pass

1d

2/11/2010

3/17/2010

Pass

Help page should just be blank for now (eventually it will contain a number of help options) - it seems to be populated with a load of help content

Low

Closed

1e

1 2 3 4 5 6

Request to view resources (not logged in) Resources page displayed The following options are available: Knowledge Base (goes to Knowledge Base Org Type Chooser page) Knowledge Base Archive (goes to Knowledge Base Archive page) Glossary (displays Glossary page as non-modal pop-up) Request to view resources (logged in a "simplified interface" user) Resources page displayed The following options are available: Downloads (goes to Widgets Downloads page) Y Y 2/11/2010 2/11/2010 3/17/2010 3/17/2010 Y Y Y Y 2/11/2010 2/11/2010 2/11/2010 2/11/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010

Des Des Des Des Des Des Pass Pass Pass Pass Didn't open as a pop-up Medium Closed TH 15/3 Check with Richard - there is a particular size that the glossary pop-up should be

1f

1 2 3 4

Des Des Des Des Pass Pass Link OK but too much whitespace Low between menu options - due to using a separate <ul> tag for the optional list items. Any way you can incorporate them all into a single <ul> so that we can re-style things more easily in the future? Same goes for the Admin page ISO/IEC link shown but should not be High shown for simplified interface users Closed

All options for not logged in users (join flow 1e at step 3) Request to view resources (logged in as an organisation user, admin or XYZ ABC user) Resources page displayed The following options are available: ISO/IEC 27002:2005 (goes to ISO/IEC 27002:2005 page) All options for "simplified interface" users (join flow 1f at step 3) Request to view admin (logged in) The system displays the Admin page The following options are available: My Details (goes to the My Details page) My Password (goes to the My Password page) Request to view admin (logged in as non-XYZ ABC admin) The system displays the Admin page The following options are available: User Admin (goes to User List page) My Organisation (goes to View/Amend Organisation Details page) All options for logged in users (join flow 1h at step 3) Request to view admin (logged in as XYZ ABC admin) The system displays the Admin page The following options are available: Organisation Admin (goes to Organisation Admin Org Chooser page) Bulk Emails (goes to Bulk Email List page) All options for logged in users (join flow 1h at step 3) View any page (logged in as user with "Information Mapping User" permission) The nav bar has the following options (in addition to any other options applicable to the user):

2/11/2010

3/17/2010

Des

Pass

Closed

1g

Des

2 3 4 5 1h 1 2 3 4 5 1 2 3 4 5 6 1j 1 2 3 4 5 6

Y Y Y

2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010

Des Des Des Des Des Des Des Des Des Des

Pass Pass Pass

Y Y Y

2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010

Pass Pass Pass

1i

Y Y Y Y

2/11/2010 2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010

Des Des Des Des Des Des

Pass Pass Pass Pass

Y Y Y Y

2/11/2010 2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010

Des Des Des Des Des

Pass Pass Pass Pass

S096

Improved Navigation Information Mapping

Information Mapping User

Be able to navigate to the 1k information mapping functions

2/22/2010

3/17/2010

nili

Pass

When I go to user admin to check if the user has info mapping permissions, for some reason, the info mapping roles are not displayed (even if I go to the "New User" screen they are not there) Logged in as user without info mapping user permissions and Information Mapping is still visible on the nav bar High

Closed

Information Mapping (goes to Information Mapping page) - appears between "Resources" and "Admin" View any page (logged in as user with "Information Mapping Admin" permission) Request to view admin page Admin page displayed with the following options (in additon to any other options applicable to the user):

2/22/2010

3/17/2010

nili

Pass

Withdraw nili: Org. Admin users also have access to n Inf Mapping. If user only has Org User/Reviewer permisions the navbar option does not appear.

1l

2 3

nili

Pass

Information Mapping/Area Administration Y (goes to Area Administration page) [note this option is not available to org types which use the "information Mapping Simplified Interface"]

2/22/2010

3/17/2010

nili

nili: not displayed if using Inf. Mapping simplified interface as they don't use Areas.

Pass

Logged in as user without info mapping admin permissions and Information Mapping options are still visible on the nav bar Breadcrumb should say "Information Mapping Area Admin"

High

Low

Withdraw nili: Org. Admin users also have access to n Inf Mapping. If user only has Org User/Reviewer permisions the navbar option does not appear. Closed

Pass

Information Mapping/Data Item Administration Y (goes to Data Item Administration page) Information Mapping/Location Administration (goes to Location Administration page) Y

2/22/2010

3/17/2010

nili

Pass

Area Admin page should have a page title of "Information Mapping Area Admin" Breadcrumb and page title as above

Low

Closed

Change page title as per email to NL

Low

Closed

Change page title as per email to NL

2/22/2010

3/17/2010

nili

Pass

Breadcrumb and page title as above

Low

Closed

Change page title as per email to NL

S074

Navigate to Views Maintenance

XYZ ABC User, Organisation Administrator

Be able to access the Views Maintenance function

1h

Request to view widgets (logged in as org admin (not "simplified interface") or XYZ ABC user) System displays Widgets Categories page There is an option to maintain widget views Request to maintain widget views System displays Views page View the home page (not logged in) There is a short introduction to PQRT with an option to see more (links to "About" page ref. Story S083) There is a section for registered users allowing them to log in or deal with a forgotten password Y 2/8/2010 3/17/2010 thma1 Pass Y N/A N/A N/A Y Y N/A N/A N/A N/A N/A N/A

2 3 4 5 S079 Home Page General User View information on the home page Main 1 2

2/8/2010

3/17/2010 thma1

Pass

Wording in "Registered Users..." Low section needs to match prototype wording, including "Forgotten user details?" link (which admittedly might have changed after you copied it!) Need single quotes around 'quick start' Low

Closed

There is a section for new users allowing them to register or view the "quick start" guide. There is a section for casual visitors with links to "reports" and "widgets"

2/8/2010

3/17/2010 thma1

Pass

Closed

2/8/2010

3/17/2010 thma1

Pass

1) Reports link doesn't link through to Medium the reports page. 2) Widgets link doesn't link through to the widgets page

Closed

TH 22/3: Links work now but nav bar shows "Home" not "Reports" or "Widgets" respectively

The various sections are in "magazine boxes" with curvy corners and a pale blue background

2/8/2010

3/17/2010 thma1

Pass

Smaller organisations - context sensitive help N saying which org types - changed text instead to simple "register" link There is an optional "alert" box at the top of the Y content pane. The content of the pane is configurable by a sys admin. The default message is "welcome to PQRT version 8", with a link through to the relevant "what's new" article for the v8 release

2/11/2010

3/17/2010 thma1

Pass

2/11/2010

3/17/2010 thma1

Pass

Needs to be configurable (CMC says it currently isn't)

Medium

Closed

Des 08/06: Not going to be impletemented now as we need to finalise various scenarios of the user input content. TH 9/6 chatted with CC and he proposes storing the HTML in the DB (ask him for details) Des 15/06: FIXED TH 16/6: if the text in the config DB table is blank, don't display the yellow box at all Des 16/06: Fixed

1a

1 2

Log in (any user type) The system tells me when I last logged in (date if before today or time if earlier today) Y 2/8/2010 3/17/2010 thma1 Pass Given that I have just logged in, this High actually needs to tell me the last but one time I logged in (i.e. Not the time just now!) Also, if last login was today, it should say "last logged in at", not "last logged in on" Also, can you get rid of the indentation (padding left) of "You last logged in..." Closed CMC: Fixed

1b

1 2

Log in (assessed user type) The system validates that I am in a position to N start a new assessment (same criteria as for the "Create new assessment" dialog on the Assessment Summary page, ref. S073) 4/26/2010 CMC Pass

The system says my most recent assessment is N the new version and that my status is "not yet started" - consistent with Assessment Summary (S073) I am not in a position to start a new assessment The system validates that I have at least one assessment on record The system tells me the version and status of my most recent assessment. N Y

4/26/2010

CMC

Pass

1b.2a

1 2 3

2/8/2010 2/8/2010

3/17/2010 CMC 3/17/2010 CMC

Pass Pass Formatting should be "<strong>Version 7</strong> (Status: <strong>Started</strong>)" Low Withdraw TH 23/3: failed retest n TH 19/04: failed retest Superseded by new story Closed

Pass

If my most recent assessment is not the latest version (and I have not yet submitted it), it warns me of this.

2/8/2010

3/17/2010 CMC

Pass

This section seems to have Medium disappeared completely! (logged in as a.test:acute) You need to dynamically populate the Medium latest version Bold red is OK but the underline is too Low much - suggest removing it. Remove "More details" i.e. link to FAQ Medium page for now - I'd rather it was not there than look incomplete.

Closed

TM Need to clarify

Pass Pass

Closed Closed TM Need to clarify

5 1b.2a.2 1 a I do not have any assessments on record

The "At A Glance" information is nicely lined up Y for clarity

2/12/2010

3/17/2010 thma1

Pass

The system tells me that I have not yet created an assessment

3/17/2010 CMC

CMC:Note it is unlikely that we now N/A have condition flow 1b above that this situation would occur i.e. have no assessments and are not able to create an assessment

Didn't bother testing this since unlikely to occur

1c

1 2

Log in (any user type) There is a section for new users inviting them to Y view the "quick start" guide (ref. story S085) There is an option to remove the "New Users..." Y section There is a summary of what's new with an Y option to subscribe to the RSS feed and a link to the "what's new" page (no change) What's new items - formatting not as per prototype Y 2/11/2010 3/17/2010 thma1 Pass Single quotes on 'quick start' Low Closed TH 22/3 failed retest Des 24/05 - Fixed

4 5

2/22/2010 2/8/2010

3/17/2010 thma1 3/17/2010 thma1

Pass Pass 1) What's New link doesn't go to High What's New page 2) RSS feed link doesn't go to RSS feed See prototype for how it should be Low Closed

2/11/2010

3/17/2010 thma1

Pass

Closed

The various sections are in "magazine boxes" with curvy corners and a pale blue background Request to remove the "New Users..." section System removes "New Users..." section Log out and back in again New Users section is not there (and there is no way of getting it back!) Log in (assessed user type)

2/8/2010

3/17/2010 thma1

Pass

White background not blue

Low

Closed

TM - Chris and I thought we iked the way IE formatted the rss feeds and mimicked that. ?? Des 26/05: Fixed Des 26/05: Fixed

9 10 11 12

N N

2/22/2010 2/22/2010

3/17/2010 thma1 3/17/2010 thma1

Pass Pass

Section not removed

Medium

Closed

Des 0806: Fixed

S091

Next Deadline Info

Organisation User

Find out when my next assessment deadline is

Main

1 2

The system validates that I either have an N assessment in progress or I have not yet started the current year's assessment (if I have completed this year's assessment, no deadline information is displayed) The system validates that , if I am an "in-year N/A assessee", this is *not* my first assessment. Inyear assessees are those org types that tend to submit their first assessment throughout the year and as such should not be presented with a deadline for this. The org type list is the same as for the "Send Submission Notification Email to Exeter Helpdesk" The system tells me when my next deadline is, according to the following rules: - If my current assessment is subject to 3 stage reporting, and I have not yet baselined it, the deadline is the Baseline Date Y

3/22/2010

3/17/2010 nili

Pass

2/25/2010 N/A

nili

Pass

3/22/2010

3/17/2010 nili

Pass

Org type a.test:acute should be 3 stage reporting but next deadline is showing as submission Can't test until above defect fixed

Medium

Closed

CMC: Changed test data so Acute tests now do 3 stage assessments

6 7

- Ditto performance update N - If neither of the above is true, the deadline is N the submission date. Note that the Submission Date is separate from the Version End Date (the date after which it is not possible to create a new assessment) - If I do not have an assessment in progress (i.e. N I have not yet started this year's assessment), this is treated the same as having started this year's assessment. The system tells me what deadline it is, in the format "Version <version> <type> Deadline", where <type> is one of "Baseline", "Performance Update" or "Submission" The system tells me how many days there are left to go until the deadline. If it is overdue, the system tells me how many days overdue it is instead, and this information is highlighted (e.g. Bold red). The deadlines for v8 assessments are as follows: - Baseline: 30/09/2010 - Performance Update: 31/12/2010 - Submission: 31/03/2011 - Version End Date: leave blank for now as per usual The Submission Date for previous assessments is 31st March in the appropriate year (not necessarily the same as the Version End Date) Y

3/22/2010 3/22/2010

3/17/2010 nili 3/17/2010 nili

Pass Pass

3/22/2010

3/17/2010 nili

Pass

3/22/2010

3/17/2010 nili

Pass

I changed my mind on the format: can Low you remove the word "Deadline" so it just says e.g. "Version 99 Submission"

Closed

10 11

Y N

3/22/2010 3/22/2010

3/17/2010 nili 3/17/2010 nili

Pass Pass If the deadline is today it says "0 days Low overdue"" instead of "0 days to go!". Perhaps in this case it should be in red to highlight it Looking at the DB, the EndDate has Medium been set to 31/03/2011 rather than having been left blank Closed

12

3/22/2010

nili

Pass

Closed

nili:V8 end dates now shd be null

13

N/A

N/A

nili

Pass

S125

View Submission Organisation Deadline on Performance Admin Update

Be told the (correct) Main submission deadline when I do a Performance Update

Request to do a Performance Update

The system provides information (in a pop-up) to tell me when I need to submit my assessment. The date displayed is the Submission Date (currently the Version End Date) S092 Log In General User Log in to the system Main 1 2 View the home page There is an option to enter my Organisation Code, User ID and Password Y

4/26/2010

Pass

Completed all req'ts for a.test:acute but Baseline button didn't appear

High

Closed

CMC: Changed test data so Acute tests now do 3 stage assessments

2/11/2010

3/17/2010

Pass

1) The org code and User ID fields are too wide - suggest making them 8 characters wide as per existing system, or 10 at the most if 8 looks too narrow on the screen

Low

Closed

TM. 1 - Are you not worried that this will leave a lot of 'blue space'? Have limited the boxes to 10 characters and 15 character entry. TH 15/3 - Update - DIP team has asked for all 3 fields to be the same width, so can we make the password field 15 chars wide and the others to match its width? TH 14/6 still too wide but losing the will to live on this one so closing anyway

Pass

Pass

2) The password field is too wide - I can enter a max of 15 characters so I guess this field should be 15 chars wide 3) I think the data field labels should be in bold so they stand out more (applies generally across the application i.e. a stylesheet change).

Low

Closed

Low

Closed

3. Labels are bold.

3 4 5 6 7 8

Enter my Organisation Code, User ID and Password Request to log in System validates that my Organisation Code exists System validates my user ID and password (against my Organisation Code) System displays Home [logged in] page System displays my user information (name and organisation) in box above nav bar User info to include e-mail address and phone number, plus option to amend Organisation Code doesn't exist System re-displays Home [not logged in] page System displays error message to say the Organisation Code was invalid N N 2/11/2010 N/A 2/11/2010 N/A thma1 thma1 Pass Pass 1) Can you change the error message to "Organisation Code not recognised" (Not "Error," at the beginning) 2) Can you get rid of the underline for the error message? Low Closed RJM N N Y Y 2/11/2010 2/11/2010 2/11/2010 2/11/2010 3/17/2010 thma1 3/17/2010 thma1 3/17/2010 thma1 3/17/2010 thma1 Pass Pass Pass Pass

2/11/2010

3/17/2010 thma1

Pass

Update details link should take user to High Admin/My Details page

Withdraw TH 08/04 retested and I get a system n error when I click this link TH 9/6 Superseded

5a

1 2 3

5b

User left org code field blank System re-displays Home [not logged in] page System displays error message saying "Organisation Code not entered" (wording change only) N N N/A N/A N/A N/A Pass Pass System displayed red star to right of Org Code field instead of specified error message Medium Closed RJM

6a

1 2

Invalid user ID/password combination System re-displays Home [not logged in] page N 2/11/2010 N/A thma1 Pass

System displays error message to say that my log-in details were invalid

2/11/2010 N/A

thma1

Pass

Can you change the error message to: "Incorrect User ID/Password combination"

Low

Closed

RJM TH 14/6 Message is incorrect in case where I have a valid user ID/password combo but have typed an existing but incorrect org code - it sayd "Invalid Username/Password combination"

6b

1 2 3

User left user ID and/or password field blank System re-displays Home [not logged in] page N N/A N/A N/A N/A

Pass Pass Pass System displayed red star to right of fields instead of specified error messages Medium Closed RJM

System displays error message(s) saying "User N ID not entered" and/or "Password not entered" (wording change only) Request to log out System displays Home [not logged in] page Y

S093

Log Out

Logged In User

Log out from the system

Main

1 2

2/11/2010

3/17/2010 thma1

Pass

S090

Register For an Account

General User

Register for an PQRT account

Main

1 2

Request to register for an PQRT Account The system displays "Registration Step 1 Organisation Search" Y 2/11/2010 3/17/2010

Des Des Pass 1) The "Register Now" button works High but the "register for a user account" link doesn't work 2) Too much whitespace bewteen the buttons on all register pages - can you make them closer together please as per prototype? Move both data fields to the right a bit Low so that "Organisation Name Keywords:" fits onto a single line Closed TH 10/3 the "register for a user account" link still doesn't work TH 15/3 still doesn't work

There is an option to enter my organisation Code and/or Organisation Name Keywords There is a link to the ODS Organisation Code lookup service (opens the name/address/postcode search in a new window) Enter my Organisation Code and/or Organisation Name Keywords and request to proceed The system displays "Registration Step 2 Confirm Organisation" The system validates that I entered an Organisation Code The system validates that there is an organisation in the database with a matching Organisation Code The system displays details for my organisation (Name, Organisation Code, Organisation Type) Request to proceed The system displays "Registration Step 3 Registration Method" The system validates that there is not already an (unlocked) user with admin rights for the organisation The system tells me I can register online Request to register online (click "Next") The system displays "Registration Step 4 - User Details" There is an option to enter my user details (Name, Email, Confirm Email, Telephone)

2/11/2010

3/17/2010

Des

Pass

Closed

Dev environment looks fine TH 10/3 retested OK

2/12/2010

3/17/2010

Des

Pass

Des

6 7 8

Y Y Y

2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010

Des Des Des

Pass Pass Pass

2/11/2010

3/17/2010

Des

Pass

10 11 12

Y Y

2/11/2010 2/11/2010

3/17/2010 3/17/2010

Des Des Des

Pass Pass

13 14 15 16

2/11/2010

3/17/2010

Des Des Des Des

Pass

Y Y

2/11/2010 2/11/2010

3/17/2010 3/17/2010

Pass Pass Move fields to right so that "Name (Forename and Surname):" fits on a single line. Also, "Email:" needs to drop to the left! Low Closed Dev environment looks fine TH 10/3 retested OK

17 18

Enter my user details (and request to proceed) The system validates my user details (as per current) Y 2/11/2010 3/17/2010

Des Des Pass 1) Can you change error message from Low "User must have both forename and surname entered" to "Name must include both forename and surname" 2) Can you change error message "Full first name..." to "Full forename..." Closed

19

The system validates that Email and Confirm Email are the same (new)

2/11/2010

3/17/2010

Des

Pass

Formatting of error message - can you Low liaise with Tom to agree how this should look - he has used bold red text on other pages and also he suggested a "cross" icon.

Withdraw Des 18/03:Is this just for this instance or n on all error messages TH 23/3: I will write a separate story to fix this across the site

20 21 22 23 24 25 Accept the Terms and Conditions (and request to proceed)

The system validates that I have entered a telephone number (don't care whether numeric, just has to exist) The system displays "Registration Step 5 Terms and Conditions" The system displays the Ts & Cs of registration There is an option to accept the Terms and Conditions

2/11/2010

3/17/2010

Des

Pass

Y Y Y

2/11/2010 2/11/2010 2/11/2010

3/17/2010 3/17/2010 3/17/2010

Des Des Des Des

Pass Pass Pass

The system displays "Registration Step 6 Confirm Details" The system displays my organisation details (Organisation code, org name, org type) and user details (name, email and telephone) and asks me to confirm that I wish to register the account Request to create account The system displays "Registration Step 7 Account Created"

Y Y

2/11/2010 2/11/2010

3/17/2010 3/17/2010

Des Des

Pass Pass

26 27

2/11/2010

3/17/2010

Des Des

Pass

Got a Server Error - presume some config issue in the system test environment with sending the email Data integrity issue - suggest trying to send email before creating user in database - that way, if the email fails, the user is not created - and the user will be able to try again.

High

Closed

Des

Pass

Medium

Closed

Des 18/03: Need to discuss about the sequence of the process. TH 23/3: Chris, when you get round to fixing this give me a shout to discuss if it's not clear Des 08/06: Fixed TH 14/6 not re-tested; assumed OK, low priority

Des

Pass

The two alert boxes should be pink, Medium not blue - looking at the source you do have the alertBox in the class, so I guess it's the stylesheet that needs tweaking

Closed

28 29 30 31 7a 1 2 3 I did not enter an Organisation Code

The system confirms that my account has been set up The system displays my account details (Organisation code, user ID) The system tells me the email address that my password will be sent to. I receive an email containing my password (no change)

Y Y Y N

2/11/2010 2/11/2010 2/11/2010 N/A

3/17/2010 3/17/2010 3/17/2010 N/A

Des Des Des Des Des

Pass Pass Pass Pass The email received has no formatting Closed

The system validates that I entered Organisation Name Keywords The system validates that there is a *unique* organisation in the database with matching keywords in the organisation name (in any order, case insensitive)

Y Y

2/11/2010 2/11/2010

Des Des

Pass Pass Is it possible to match on *partial* keywords? For example, if I type "aintree park" it matches (org code N82053) but if I enter "aintr park" it won't match. Medium Closed Des 11/03: Handling this scenario is possible (ie. Searching with Prefix). However searching with Suffix (ie. *tree park) is not possible. TH 23/3: well go ahead and do it then! Des 09/06: Fixed

8a

4 1 2 3

Rejoin Main Flow at Step 7 There was no matching organisation code The system displays "Registration Step 2 Confirm Organisation" The system tells me it can't find a matching organisation Request to proceed

2/11/2010

Des Des Des Des

Pass

Y Y

2/11/2010 2/11/2010

Pass Pass Formatting - missing bullet points probably needs the stylesheet tweaking - check with Tom Low Closed

4 5 6 7

The system displays "Registration Step 3 Y Registration Method" The system tells me I can register via the Y helpdesk. There is a hyperlink through to the "Contact us" Y page

2/11/2010 2/25/2010 2/11/2010

Des Des Des Des

Pass Pass Pass Doesn't link through to the contact us page Medium Closed Link works OK but styling is an issue because the link is blue within blue text and no underline. Maybe chat to Tom re. putting the underline back?

7a.2a

1 2

I did not enter Organisation Name Keywords Proceed as per Flow 8a Y 2/11/2010

Des Des Pass Got a validation error - but should have gone to Registration Step 2 (as per flow 8a) High Closed CMC:Have changed, have also added an extra bullet point to display for step 8a as otherwise reads rather confusingly in this instance TH 23/3: if you enter neither the org code nor any org name keywords it should take you directly to step 2 instead of displaying a validation error

7a.3a

There is no organisation that matches on Organisation Name Keywords (or I left them blank) Proceed as per Flow 8a There is already an admin for my org The system tells me who my admin is (name Y only, not email or telephone) - if there are multiple admins, it shows the one that logged in most recently The system tells me I should register via them Y or, if I can't contact them, contact the helpdesk There is a hyperlink through to the "Contact us" Y page Attempt to cut & paste Email into Confirm Email field Email not pasted Y 2/25/2010 2/22/2010 3/17/2010 Y 2/11/2010

Des

10a

2 1 2

Des Des Des

Pass

Pass

1) Can you change the label from "Name:" to "PQR App Administrator Name:" and make sure it all fits on a single line

Low

Closed

2/11/2010

3/17/2010

Des

Pass

4 16a 1

2/11/2010

3/17/2010

Des Des Des Des Des

Pass

Pass

S089

Contact Us

General User

Contact XYZ ABC about the PQRT

Main

Request to contact XYZ ABC (via link in header bar) (not logged in user)

The system displays the "Contact us" page

2/22/2010

Des

Pass

Page H1 header "Contact Us" not displayed (this seems to be common across quite a lot of pages - is there a stylesheet problem?) Ordering (Exeter Helpdesk first) and wording as per latest version of prototype please Ordering (Exeter Helpdesk first) and wording as per latest version of prototype please 1) Can you put a highlight box around the data fields as per prototype

Medium

Closed

The system displays the Exeter Helpdesk phone number (01392 251289) The system displays the Thingy helpdesk number (0113 394 6540) There is an option to submit an online enquiry, with the following data entry fields: - Name (text) - Email (text) - Telephone (text) - Organisation Type (drop down) - Subject (drop down) - Details (text area) - Email me a Copy of my Enquiry (checkbox, default not selected)

2/22/2010

Des

Pass

Medium

Closed

2/22/2010

Des

Pass

Medium

Closed

2/22/2010

Des

Pass

Low

Closed

Des

Pass

Des

Pass

2) Can you put mandatory field markers against the fields as per the prototype 3) Can you make the sentence above the data fields into an "instruction" class as per the prototype (<p class="instruction">) 4) Can you size the details field as per the prototype 5) In "Email me a copy of my Enquiry", can you put a lowercase "e"on "Enquiry"? (sorry, my fault, the prototype was wrong) Can you put Pharma/Dentist before Medium Other as per prototype

Closed

Closed

Des Des

Pass Pass

Closed Closed

15/3 Failed retest

7 8

The options for Organisation Type are: - Thingy/Dentist - Other The default for Organisation Type is "<Select>" The options for Subject are: - PQR App - Account Registration - PQR App - Policy - PQR App - Assessments - PQR App - Reports - PQR App - PQR Statement if Compliance (PQRSoC) - PQR App - Technical Issue - PQR App - Feedback - PQR App - Other The default for Subject is "<Select>" Enter details of my enquiry and click "Submit" The system validates that: - Name is not blank - Email is a well-formatted email address - Telephone is not blank - Organisation Type has been selected - Subject has been selected - Details is not blank

2/22/2010

Des

Pass

Closed

Y Y

2/22/2010 2/22/2010

Des Des

Pass Pass Can you order as per prototype please Medium Closed

9 10 11

2/22/2010

Des Des Des

Pass

2/22/2010

Pass

1) Can you move the validation errors Low so they appear just above the data fields highlight box 2) Can you change the wording so it says "Name must be entered", "Email must be entered", "Organisation Type" must be entered etc. so that the words in the error message exactly match the field names on the screen (for consistency)

Closed

12 13

The system validates that I selected an org type N of "Other" The system sends an email to Exeter Helpdesk N (exeter.helpdesk@nhs.net)

2/22/2010 2/22/2010

Des Des

Pass Pass System error displayed - presume this is to do with connfig of system test environment re. sending emails

14

15 16 17

The email subject is based on the subject I selected, as follows: - PQR App - Account Registration -> PQRT Registration - PQR App - Policy -> PQRT - Policy - PQR App - Assessments -> PQRT Assessment - PQR App - Reports -> PQRT - Reports - PQR App - PQR Statement if Compliance (PQRSoC) -> PQRT - PQRSoC" - PQR App - Technical Issue -> PQRT Technical - PQR App - Feedback -> PQRT - General (Feedback) - PQR App - Other -> PQRT - General The email body includes Name, Email, Telephone and Details The system validates that I didn't select "Email me a Copy" The system re-displays the "Contact Us" page with all the fields reset to their default values The system tells me that it has submitted my enquiry

2/22/2010

Des

Pass

N N N

2/22/2010 2/22/2010 2/22/2010

Des Des Des

Pass Pass Pass

18

2/22/2010

Des

Pass

15/3 Sorry, I didn't spot this first time Low round...can you put the submission (a) in red and (b) in the "Contact us Online" section - as per the validation errors

Closed

11a

1 2 3 1 2 3 1 2 3

Validation fails The system displays all validation failures Rejoin Main flow at step 10 (re-enter details) I selected an org type of "Thingy/Dentist" The system sends an email to Thingy Assurance N (thingy.assurance@nhs.net) Rejoin Main flow at step 14 (email subject) N I requested a copy of the enquiry by email The system sends a copy of the enquiry email to N the email address I specified Rejoin Main flow at step 17 (confirmation of N submission) Logged in as a non-Thingy/Dentist user As per Main flow except: My name, email and telephone details are prepopulated N N 2/22/2010 2/22/2010 2/22/2010 2/22/2010 2/22/2010 2/22/2010 N N 2/22/2010 2/22/2010

Des Des Des Des Des Des Des Des Des Des Des Des

Pass Pass

12a

Pass Pass

16a

Pass Pass

1a

1 2 3

Pass Pass

All fields are OK but can you make the Low Name, Email and Telephone fields wider - currently the email box is too narrow to show an average email address (e.g. Adam.tester@madeup.com)

Closed

4 5

My organisation type is defaulted to "Other" The system doesn't display the Thingy Assurance phone number

N N

2/22/2010 2/22/2010

Des Des

Pass Pass 1) Can you change the wording to a single paragraph (no bullet point): "You can contact us by phone on 01392 251289 (Mon-Fri, 8am-5pm)". Note that the word "us" is currently missing (my fault as I missed it off in the prototype) 2) Can you add the word "us" into the text shown to not logged-on users Low Closed

The email body includes my User ID, Org Code and Org Type

2/22/2010

Des

Pass

I expected to see Org Code on one line Medium and Org Type on a separate line but I actually got a single line which said "Organisation Code: A.TEST:ACUTE A.TEST: Acute Trust Organisation Type: Acute ". It looks like you have also included org name, which is OK, but can you put 3 separate lines - org code, org name and org type?

Closed

TH 15/3 failed retest TH 22/3: failed retest Des 18/5: Fixed

1a.1a

1 2 3 4

Logged in as a Thingy or Dentist user As per flow 1a except: N My organisation type is defaulted to N "Thingy/Dentist" The system doesn't display the Exeter Helpdesk N phone number 2/22/2010 2/22/2010 2/22/2010

Des Des Des Des

Pass Pass 1) Can you change the wording to a Low single paragraph (no bullet point): "You can contact us by phone on 0113 394 6540 (Mon-Fri, 9am-5pm)". Note that the word "us" is currently missing (my fault as I missed it off in the prototype) Help page is all wrong! High Closed

1b

1 2

Request to view the Help page There is an option to contact us Y 2/22/2010

Des Des

Pass

Closed

TH 15/3 No option to contact us - see prototype for how it should be (just include the contact us link for new, we will add the others in as we develop the relevant pages) TH 22/3: page title should be "Help", not "Contact Us"

3 4 S083 View "About" Info General User Read general information Main about PQRT 1

Request to contact XYZ ABC (via Help page) The system displays the "Contact us" page View any page Y 2/22/2010

Des Des Pass Can't test until fixed step 2 above

2 3 4 Request to view the "About" page

There is an option to view the "About" page in the header bar System displays the About page

2/11/2010

nili

Pass

2/11/2010

nili

Pass

If I click "return to home page" link at Low bottom, the home page is idsplayed by the nav bar says "Help" and the breadcrumb says "Help > About > Home"

Closed

5 1a 1 2 3 4 1 View the home page

About page content is as per prototype page "about.html" There is an option to view the "About" page in the main panel Request to view the "About" page Rejoin main flow at step 4 View the help page

4/29/2010

nili

Pass

2/8/2010

nili

Pass

2/11/2010

nili

Pass

1b

There is an option to view the "About" page in the main panel

2/11/2010

nili

Pass

Wording and ordering as per prototype, and whilst you're at it, can you put a capital "U" on "Contact Us"

Low

Closed

3 4 S084 View "Accessibility" Info General User Read information about PQRT accessibility Main 1

Request to view the "About" page Rejoin main flow at step 4 Click the Accessibility link in the footer bar on any page The system displays the Accessibility page with text as per prototype View the help page There is an option to view the Accessibility page Y (wording and ordering as per prototype) Click the Accessibility link in the footer bar on any page The system displays the Accessibility page with text as per prototype Click the Terms and Conditions link in the footer bar on any page The system displays the Terms and Conditions page with text as per prototype Request to register for an account, and progress through the process to the Terms and Conditions page System displays updated Terms and Conditions as per prototype Y 6/15/2010 Pass Y 6/15/2010 Pass Content not changed! Medium Closed Y 6/24/2010 Pass 6/24/2010 Pass Closed Y 6/24/2010 Pass N 2/11/2010 nili Pass

2 1a 1 2

3 4

S086

View Terms & Conditions General User

View PQRT terms & conditions

Main

1 2

S094

View Updated Registration Terms & Conditions

General User

View updated Terms & Conditions when registering for an PQRT account

Main

S095

Show Environment Name General User and Build Number

See which (non live) environment I am connected to and also which software build I am using

Main

Browse to the home page on a non-live environment

2 3

The system displays the environment name (e.g. Somewhere in the header bar) The system displays the software build number (e.g. Somewhere in the header bar)

S097

Improved Navigation Widgets

General User

Navigate more sensibly to Main the widgets list page

View any page (not logged in)

2 3 4 5 6 Request to view widgets

There is an option to view widgets ("Widgets" nav bar item) (no change) The system displays the Widgets (Org Chooser) page Select an org type The system displays the Widgets List page (i.e. Skips over the current widgets "wheel" page) Y

2/22/2010

3/17/2010 nili

Pass

2/22/2010

3/17/2010 nili

Pass

2/22/2010

3/17/2010 nili

Pass

If I select an org type which has no widgets set up, I get a server error. In the current live system it just displays an empty list (e.g. For Dentists)

High

Closed

The Widgets List page includes *all* widgets that are applicable to my organisation type View any page (logged in as a nonassessable org type e.g. XYZ ABC) Proceed as per main flow (from step 2) View any page (logged in as a user from an assessable org type - any role) There is *not* an option to view widgets (i.e. No "Widgets" nav bar item) View any page (logged in as an Org User or Org Reviewer from an assessable org type) There is an option to view Assessments (currently only available to Org Admin users needs to be extended to Org User and Org Reviewer roles) Request to view assessments The system displays the Assessments Summary and History page There are *not* options to delete, baseline, perf update or submit the assessment - these actions can only be performed by Org Admin users There *is* an option to view the PQR Assurance Statement There *is* an option to view the implementation plan Log in

2/22/2010

3/17/2010 nili

Pass

1a

1b

2 1

2/22/2010

3/17/2010 nili

Pass

2 1c 1

3/18/2010

3/17/2010 nili

Pass

3/18/2010

3/17/2010 nili

Pass

3 4 5

3/18/2010 3/18/2010

3/17/2010 nili 3/17/2010 nili nili: this functionality already exists

Pass Pass

6 7

3/25/2010 3/25/2010

nili nili

nili: this functionality already exists nili: this functionality already exists

Pass Pass

S098

Home Page - What Next

Logged In User

Once I have logged in, Main view instructions on what I can do next

2 3

The system displays the Home (logged in) page There is an instruction (in the "At a Glance" box) to select an option from the nav bar Log in as a user of an "assessable" org There is an option (in the "At a Glance" box) to start working on your current assessment (by clicking on the "Assessments" nav bar item) Select this option

Y Y

2/22/2010 2/22/2010

3/17/2010 nili 3/17/2010 nili

Pass Pass

1a

1 2

3/18/2010

3/17/2010 nili

Pass

3 4

System behaves as if I had clicked the Y "Assessments" nav bar option i.e. takes me to the Assessments page (note, currently nonadmin users cannot see the "Assessments" tab but it's OK, we're going to change this in a later story

3/18/2010

3/17/2010 nili

nili: page uses the navbar permissions Pass to determine whether to show the 'assessments' instruction. If the navbar permissions change, the page should reflect that change automatically.

S075

Search Knowledge Base

General User

Search for knowledge base documents based on various criteria

Main

Request to view the knowledge base (not logged in or logged in as a nonassessable org type) The system asks me to select an organisation type to view the knowledge base for There is also an option to view the entire knowledge base (i.e. All org types) Select to view the KB for a specific org type The system displays the Knowledge Base page The page includes a list of all KB resources (DB table KnowledgeBaseDocument) that are relevant to the selected org type - specifically this is a list of all KB resources which are referenced from any Widget Variant (DB table WidgetOrganisationType) which is (a) applicable to the selected org type and (b) part of the current widget set Y Y 3/18/2010 3/18/2010 Des Des Pass Pass N 3/18/2010 Des Pass

3/18/2010

Des

Pass

4 5 6

7 8 9 10 11 12 13 14 15

The list is in alphabetical order by title For each KB resource, the following info is displayed: Title External resource indicator to the RHS of the title - if its Location is "External" Description (via float-over pop-up, in order to make better use of space) Type Creation Date Last Reviewed Date Related Widget(s) - a comma-separated list of Widget Numbers for all related widgets as identified in step 5 above (in ascending numerical order, with duplicates removed)

3/18/2010

Des

Pass

Y Y N Y Y Y Y

3/18/2010 3/18/2010 3/18/2010 3/18/2010 3/18/2010 3/18/2010 3/18/2010

Des Des Des Des Des Des Des

Pass Pass Pass Pass Pass Pass Pass Float over isn't working (it used to work so must be broken!) High Closed Des 24/05 - Fixed

Need to test with real data

16

There is an option to view each KB resource Y (the Title of each resource (including the external resource indicator if displayed) is a hyperlink to the KB resource itself - based on its Filename if internal or Weblink if external) Request to view an internal KB resource The system opens the KB resource in a new window N

3/18/2010

Des

Pass

17 18

3/18/2010

Des

Pass

Tested in UAT - some docs loaded OK High (e.g. "Audit Programme - Mobile and Remote Working") but others gave me "file not found" e.g. "Bite-sized Good Practice Guide: Application Security"

Closed

Des 15/06: Need to check if the file physically exists. TH 16/6 CMC says this is now sorted out it was an env't problem

17a

1 2

Request to view an external KB resource The system opens the KB resource in a new window Request to view the knowledge base (logged in as an assessable org type) Skip the org type chooser (go to Main flow step Y 5), displaying information for my own org type Select to view the entire KB Proceed as per main flow but include KB resources related to widgets which are in the current widget set for any org type. The Knowledge Base page also includes search filters for the KB resources, as follows: Keyword(s) - free form text, default blank Y 3/18/2010 Des Pass N 3/18/2010 Pass 3/18/2010 Des Pass N 3/18/2010 Des Pass

1a

4a

1 2

17b

Widget - drop down menu containing a list of all widgets which are relevant to the selected org type (or all org types if no org type was selected) The format of each widget is "<Widget Number> (<Initiative Name>)" Enter search criteria and request a search The system changes the list of KB resources to include only those that match ALL of the following criteria (change from current which matches ANY): The KB resource is related to the specified widget number (if specified) The KB resource title or description contains any of the specified keywords in any order (no change from current)

3/18/2010

Des

Pass

4 5

3/18/2010

Des

Pass

6 7

N N

3/18/2010 3/18/2010

Des Des

Pass Pass If I type in a keyword and then click Medium "Search" it's OK, but if I type in a keyword and hit "Enter" then the page is re-displayed as-is without taking into account the keyword I entered Closed Des 15/06: Fixed

S105

Context Sensitive Help Mechanism

Developer

Implement context sensitive help in a straightforward and flexible manner

Main

Insert a "context sensitive help" marker into a web page with a specific ID

Deploy a (test) context sensitive help configuration file with the application (including some simple HTML formatting e.g. <strong> and <p>). Run the application and float the mouse over the context sensitive help marker The system displays the relevant text from the context sensitive help configuration file The text is displayed in a popup The text is formatted as per the HTML markup Y N/A N/A RJM Pass

5 6

Y N

Date unknown N/A

N/A N/A

RJM RJM

Pass Pass

Popup appears off-screen if near RHS of screen HTML formatting needs styling up properly (e.g. See Org Code help on Home Page)

Medium Low

Closed Closed

The popup remains displayed indefinitely (i.e. not not a standard tooltip) This story builds on S105 by implementing all context sensitive help items as specified in ContextHelp v2.xml For each context sensitive help item specified in ContextHelp v2.xml (in \\data1brind\data\Information governance\PQRT Version 8\Functional Specification): Navigate to the specified page The system displays a context sensitive help icon at the specified location within the page Float over the icon The system displays the relevant description

Date unknown

N/A

RJM

Pass

S109

Context Sensitive Help

General User

Receive context sensitive Main help as necessary across the whole site

3 4

Date unknown

N/A

RJM

Pass

5 6

6/24/2010

RJM

Pass

On Widgets List page hover over 'Status'. My widget states 'Answered' in this column but this is not one of the stated statuses in the context sensitive help popup

Low

Closed

TH - I have updated the relevant text in contextHelp v3 WIP.xml - just needs copying across

EP - Intranet help updated, internet ? Has been removed.

Pass

Pass

Evidence location dialog box. Choose Low 'Internet' or 'Intranet'. The ? Next to URL line states 'context help is not available' The ? Next to the 'Upload New File' Low button in the evidence location dialog box is missing the word 'to'. Needs to say: Click this button to upload a file from your local PC or network to our server.

Closed

Needs update to context help

Closed

S108

Look & Feel - Widget Details

General User

Have a nice look & feel for the widget details page

Main

View the widget details page (as a logged in user from an "assessable" organisation) The formatting of each attainment level is as per the prototype Y 3/4/2010 3/17/2010 RJM complete Pass Checkbox icons don't match prototype Low - can you change back as per e-mail conversation with RJM and TM on 18/3 Withdraw TH 20/5 leave as-is n

The "achieved" boxes only appear if the screen N is being viewed in the context of completing an application The formatting of the attainment levels Y summary is as per the prototype The formatting of each attainment criterion is Y as per the prototype

N/A

3/17/2010 RJM

complete

Pass

3/4/2010 3/4/2010

3/17/2010 RJM 3/17/2010 RJM

complete complete

Pass Pass Not a fail, since not in prototype, but Low Level 3 Maint label is too big. See latest cut of prototype for markup and CSS to make it smaller By default all sections should be Medium collapsed, whereas Attainment Level 1 and Criterion 1a are expanded Is there any way of making the Low collapse of the other section a smooth "roll-up"? I would think roll up the other one first then roll down the selected one. Closed

Each attainment level can be expanded to show Y the attainment criteria within, and collapsed again When an attainment level is expanded, if Y another attainment level is already expanded, it is collapsed (i.e. Accordion style)

3/4/2010

3/17/2010 RJM

complete

Pass

Closed

3/4/2010

3/17/2010 RJM

complete

Pass

Closed

Each attainment criterion can be expanded to show the details within, and collapsed again

3/4/2010

3/17/2010 RJM

complete

Pass

When an attainment criterion is expanded, if Y another attainment criterion is already expanded (within the same attainment level), it is collapsed (i.e. Accordion style) The evidence comments pop-up is accessed via an icon in the RHS of the Comments column Y

3/4/2010

3/17/2010 RJM

complete

Pass

As above, can it be smoother?

Low

Closed

3/4/2010

3/17/2010 RJM

complete

Pass

Pass If an evidence comment has been entered, the Y first 30 characters of the comment is displayed, with CRs replaced by spaces, and with "..." on the end if the comment is more than 30 characters long Header panel layout is as per prototype Y 3/15/2010 3/17/2010 RJM complete Pass

Not a fail (in fact it's very nice) but is Low there any way to make the pop-up position relative (close) to the icon the user clicks? Tooltip missing from icon (see Medium prototype) If I enter a CR then it displays as a Low "wide" space. If I leave the screen and come back it's a normal space. Only fix this if trivial Padding between border and content is larger than on prototype Low

Closed

Closed Withdraw TH 20/5 not a big deal so withdrawn n

3/15/2010

3/17/2010 RJM

These items will probably take an extra 1 days

Pass

Withdraw TH 20/5 Changed prototype to match site! n Closed

Pass Header panel background colour is light blue (no matter whether widget is a key widget or not) Widget question text preceded by the key icon for a key widget Top row of buttons to appear below header panel, not above page title Print/Download to be changed from links to buttons (as per prototype) Print/Download Multiple to be changed from links to buttons (as per prototype) Cancel button takes you back to widgets list screen without saving any changes Y 3/15/2010 3/17/2010 RJM complete Pass

Right padding/margin is too big in the Low RH column of the inner table

Y Y Y Y Y

3/15/2010 3/15/2010 3/15/2010 3/15/2010 3/15/2010

3/17/2010 RJM 3/17/2010 RJM 3/17/2010 RJM 3/17/2010 RJM 3/17/2010 RJM

complete complete complete complete complete

Pass Pass Pass Pass Pass The Cancel button should only appear if the screen is being viewed in the context of completing an application Medium Closed

Done button saves changes and takes you back to widgets list screen The unordered lists in the Widget Origins and Changes sections have circular bullet points (currently no bullet points) The top level section headings (Widget Description, Guidance etc.) are <h2> level headings (or have equivalent formatting) The style of the knowledge base tabs is as per the prototype

Y Y

3/15/2010 N/A

3/17/2010 RJM N/A RJM

complete complete

Pass Pass

N/A

N/A

RJM

complete

Pass

3/15/2010

3/17/2010 RJM

complete

Pass Pass

The selected tab has a black line between the tab and content The unselected tabs need to be a darker grey colour as per prototype (the shade you have used looks OK on some monitors but is too pale on others)

Low Low

Withdraw TH 20/5 too difficult to fix n Closed TH 08/04 Retested - Dark gray as per prototype, not blue please

S110

Can't Enter Widget Level Comments

Organisation User

Not enter widget-level comments for a (v8+) widget

Main

View a widget for an in-progress (v8+) assessment There is *not* an option to enter requireemntlevel comments Y 3/15/2010

S111

Smaller PQR Assurance Statement Pop-up

Organisation User

Be able to view the PQR Main Assurance Statement Popup on an 800x600 screen

Pre

My assessment is ready to be submitted

Pre

My organisation is not exempt from the PQR Assurancer Statement Submit the assessment, from the assessment summary page (including confirmation) The system displays the PQR Assurance N Statement (no change) The PQR Assurance Statement pop-up is small N enough to fit into a browser which is maximised on an 800x600 resolution screen 3/18/2010 N/A 3/18/2010 N/A CMC CMC Pass Pass Pop-up way too big on 800x600. Also, High if I have my screen on full-res but the window not full size, the pop-up is still too big Closed CMC:Looks ok on my monitor at 800x600 on both IE7 and IE6. Can you re-test please to see if this is still an issue. RJM has fixed this TH 14/06 Just tried it in IE7 and

2 3

1a

Submit the assessment, from the widgets list page (including confirmation)

Proceed as per Main Flow

3/18/2010 N/A

CMC

Pass

The footer appears in front of the PQR Medium Assurance Statement

Closed

RJM

S112

Submission Email Log

Organisation User

View a record of the Main sending of an submission e-mail

Pre

My assessment is ready to be submitted Submit the assessment (including confirmation and PQR Assurance Statement) The system marks the assessment as submitted N (no change) The system sends a submission e-mail to the N relevant users at the organsiation (no change) The system creates a new entry in the N assessment status history (no change) The system records the fact that the e-mail was N sent and to whom in the "notes" field of the new assessment status history record 3/18/2010 N/A 3/18/2010 N/A CMC CMC Pass Pass

2 3

4 5

3/18/2010 N/A 3/18/2010 N/A

CMC CMC

Pass Pass

S117

Specify A Widget Owner

Organisation Administrator

Specify a user from my Main organisation as the owner for a given widget

Request to view the widget list for an inprogress (v8+) assessment

Des

2 3 4 5 Request to specify requierment owners

There is an option to specify widget owners

4/6/2010

Des Des

Pass

The system displays the "Widget Owners" page

4/6/2010 4/6/2010

Des Des

Pass Pass

6 7 8 9 Select the widget owner for one or more widgets Request to save my changes

For each widget, there is an option to specify Y the widget owner - this is a drop-down list of all users from my organisation (excluding those with locked accounts). By default there is no owner (and this is an Y allowed state)

4/6/2010

Des Des Des Des

Pass

10 11 1a 1 Logged on as any user type, request to view the widget list for an assessment from my *own* organisation which has had one or more owners specified.

The system persists the widget owner for each widget (it is an attribute of the Widget Response) The system displays the Widget List page The system displays the widget owners (read only)

4/6/2010

Pass

4/6/2010 4/6/2010

Des Des

Pass Pass

2 1b 1 Logged on as an XYZ ABC user, request to view the widget list for an assessment which has had one or more owners specified.

The system displays the widget owners (read only)

4/6/2010

Des Des

Pass

2 1c 1 Logged on as any user type, request to view the widget list for an assessment from another organisation which has had one or more owners specified.

The system displays the widget owners (read only)

4/6/2010

Des Des

Pass

The system doesn *not* display the widget owners (read only)

4/6/2010

Des

Pass

Need to be able to get an assessment to status approved first Also need Assessment Report to be working

1d

Not logged on, request to view the widget list for an assessment which has had one or more owners specified. The system doesn *not* display the widget owners (read only) N 4/6/2010

Des

Des

Pass

Need to be able to get an assessment to status approved first Also need Assessment Report to be working

S118

Specify a Second Widget Owner

Organisation Administrator

Specify a user from my Main organisation as the second owner for a given widget

TBC this is as per S117 but allows the admin to specify a second owner - this is primarily for GHJs who generally have two owners - one "commissioner" owner and one "provider" owner

S113

Add Improvement Action

Organisation User

Add an improvement action against a specific attainment criterion

Main

Request to view a widget for an inprogress assessment

2 3 4 5 6 7 8 9 10 11 Enter details for the action Request to save the widget response Request to add an improvement action to an attainment criterion

For each attainment criterion there is an option Y to add an improvement action

3/18/2010

3/17/2010

Des

Pass

The system adds an improvement action, with the following fields: Description (free format text, default blank)

3/18/2010 Y 3/18/2010 3/18/2010 3/18/2010 3/18/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010 3/17/2010

Des Des Des Des Des

Pass Pass Pass Pass Pass

Owner (free format text, default widget owner) Y Due date (calendar selection, can be any date past or future) Completed flag (default not completed) Y Y

The system validates the data fields (description N is mandatory, the others are optional) The system persists the improvement action Y

4/26/2010

Des

Pass

12

3/18/2010

3/17/2010

Des

Pass

The system does not persist the Owner, Date or Complete status for a newly-created action (only for a preexisting action)

High

Closed

RJM: caused by change of criterion from 1a, 1b etc to a, b, etc

10a

1 2

Request to add another improvement action The system adds another improvement action (rejoin main flow at step 4) Request to view a widget for an inprogress assessment which has an existing improvement action There is an option to edit the improvement action Edit the improvement action (this includes the option to mark it as completed) Request to save the widget response The system persists the changes Request to view a widget for an inprogress assessment which has an existing improvement action There is an option to delete the improvement action Request to delete the improvement action The system asks me to confirm Confirm The improvement action disappears from the screen Request to save the widget response The system persists the deletion Request to view a widget for an assessment which has an existing improvement action when it is "not editable by me" Definition of "not editable by me": 1) I am not a user from the owning organisation, or 2) The widget status is past "In Progress" The actions are displayed There is not an option to add an action There is not an option to edit or remove individual actions Request to produce an evidence and action report N N N 4/26/2010 4/26/2010 4/26/2010 Y 3/18/2010 3/17/2010 Des Pass 3/18/2010 3/17/2010 Des Pass 3/18/2010 3/17/2010 Des Pass N 3/18/2010 3/17/2010 Des Pass Y 3/18/2010 3/17/2010 Des Pass N 3/18/2010 3/17/2010 Des Pass Y 3/18/2010 3/17/2010 Des Pass

1a

2 3

4 5 1

1b

2 3 4 5 6 7 8 S138 View Improvement Actions General View improvement actions Main 1

3 4 5

S114

Produce Improvement Organisation Plan and Evidence Report User

Produce an improvement Main plan for my organisation

Des

Pass

On the "Reports" page, can you move the Improvement Plan and Evidence Report link to the bottom of the list Edge case not tested

Low

Closed

Des 25/05 - Fixed

2 3

The system validates that the user has at least one v8+ assessment There is an option to select the assessment to report on (v8+ assessments only)

Y Y 3/18/2010 3/17/2010

Des Des

Pass Pass

The format of the assessments in the dropY down is: Version <version number> (<start year>-<end year>)" There is an option to select the widget owner (a Y list of all users from the organisation plus an option to specify all owners [default]) There is an option to select the Report Type, including: - Improvement Plan (incomplete items only) (default) - Improvement Plan (including completed items) - Completed Items Only There is an option to set report options, including: - Evidence (default checked) - Actions (default checked) Y

Des

Pass

4/6/2010

3/29/2010

Des

Pass

3/18/2010

3/17/2010

Des

Pass

3/18/2010

3/29/2010

Des

Pass

Both boxes should be ticked by default Medium

Closed

Des 25/05 - Fixed

Pass 8 9 10 Select report criteria Request to produce report The system displays the report in a new window Y 3/18/2010 3/17/2010 Des Pass

Context help icon missing to RHS of options

Low

Closed

Des 25/05 - Fixed

If I have previously opened the report Medium and I open it again, it reuses the same popup window but doesn't bring it to the front. Either bring it to the front or open in a new window Organisation name not displayed Medium

Closed

Des 25/05 - Fixed

Pass Pass

Closed Closed

Des 25/05 - Fixed Des 02/06 - Fixed

corners are not curved but other than Pass that all looks good.

Look and feel needs some work - try to Low match prototype as much as possible e.g.: - font - line spacing a bit wider between paragraphs - left hand margin Please can you add curved corner boxes around each widget. This will clearly separate each widget. I think this is something we can do quickly and easily to make it appear better. Tony to compile prototype. He has now done this (improvement_plan_report_results.ht ml) and it's important to note the gap in between each req. Please make sure it's roughly the same gap as shown. Also, the org name is formatted using <h2>

Closed

Des 15/06 - FIXED Des 16/06: Refer to Christ email dt.16.06.10 18:19

11

The report includes all widgets for which there is one or more attainment criteria to display (see below) The displayed widgets are in numerical order

3/18/2010

3/17/2010

Des

Pass

Current level NR, target level 2 - the High widget should be displayed (it's up to the user to change their target level to NR to get it to not display)

Closed

Des 25/05 - Fixed TH 26/5 - it only displays the criteria that are not marked as achieved but that is OK

12 13 14 15

3/18/2010 3/18/2010 3/18/2010 3/18/2010

3/17/2010 3/17/2010 3/17/2010 3/17/2010

Des Des Des Des

Pass Pass Pass Pass Pass If there is no widget owner, don't display the line at all Low Closed Closed Closed Des 25/05 - Fixed Des 25/05 - Fixed Des 25/05 - Fixed

For each displayed widget, the widget question Y is included For each displayed widget, the widget owner (if Y any) is included For each displayed widget, the current level is included Y

If there is no current level then display Low "(not answered)" If the current level is exempt, it should Low display "Exempt" instead of blank On reflection, the suffixes Low (excluding/including maintenance) are confusing so remove them (sorry!)

16

For each displayed widget, the "calculated target level" is included, as follows: - If the org has set a target level for this req't then use that target level - If the org has not set a target level then use level 3 but display "Not set (assumed Level 3) - If the target level determined above is level 3 and the org achieved L3 for this widget in their previous assessment, then the target level is level 3 including maintenance criteria, otherwise it is level 3 excluding maintenance criteria - so display a suffix of " - excluding maintenance" or " - including maintenance" as appropriate

3/18/2010

3/17/2010

Des

Pass

Closed

Des 25/05 - Fixed

Pass

If the target level is NR it's showing "4" and if the target level is EX is is showing "5"

Low

Closed

17

The report includes all attainment criteria for which any of the following is true:

Des

Pass

The attainment criteria Ids are beign High displayed as just "a", "b", "c" etc. instead of "1a", "1b", "1c". This is because we have changed the way we store the ID in the database - you need to construct the displayed ID from the attainment level and the criteria ID e.g. "1" & "a" -> "1a" A.test:acute, req 204, current level 0, High target level 3: the system is displaying criteria 1a, 1b, 2c and 3d but not 2b, 2c, 3a, 3b or 3c. It seems that each letter is only displayed once - is it deduplicating letters and if so this might be fixed by fixing the above defect which will make each criterion ID unique

Closed

Des 26/05 - Fixed TH 7/6 - can you change "NR" to "Not Relevant" and "EX" to Exempt so it matches the "Current Level" labels? Des 09/06: Fixed Des 25/05 - Fixed

Pass

Closed

Des 25/05 - Fixed

18

- The Report Type specifies incomplete items and the attainment criterion is "outstanding" (see definition below) Definition of "outstanding": an attainment criterion is defined as "outstanding" if: 1) it is not marked achieved AND 2) it is within the "calculated target level" (see definition above)

3/18/2010

3/17/2010

Des

Pass

19

3/18/2010

3/17/2010

Des

Pass

EP - I need to try and re-produce this because Des can't recreate this and neither can I now EP - Can't reproduce this now. Weird things happening with imp plan.

I have a gp assessment where first 2 High reqs are set to level 2 but their target levels are 3. These both show when I produce an imp plan report. However, the third req is set to level 1 with no target level set so can see a red cross. I would also expect to see this on the imp plan report but it isn't. Also tried to send an ad-hoc email to the req owner of the third one but their name is not in the list to send an email to. Just the first 2 owners of the first 2 reqs.

Closed

Des 21/06: Not able to re-produce

20

For the avoidance of doubt, if the target level is N NR or EX then the attainment criterion is *not* outstanding

N/A

N/A

Des

Pass

Widgets are showing with a target of NR (currently showing as "4" due to another defect) and EX (currently showing as 5)

Medium

Closed

Des 26/05 - Fixed Des 11/06: Fixed TH 7/6 - still showing a widget which is current level "Exempt" and target level "EX". Suspect this will be fixed when above defect re. changing "EX" to "Exempt" is fixed, although the system probably shouldn't be relying on the exact wording to detect a match!

will only show completed items on the plan if there is evidence obtained and ticked or actions complete. I didn't have any items under the NR & EX widgets

I have a login a.test:gp and set: 1st req to current level 3 and target level 3 2nd req to current level NR and target level NR 3rd req to current level EX and target level EX I choose to display an 'improvement plan (uncluding completed items)' and only the 1st req shows (should show all of them. Same happens with the 'Completed items only' plan. Pass Related to the above, I added evidence and actions under the NR & EX widgets and they still don't show on the completed items improvement plans

Closed

EP - This was because I was logged in as XYZ and ticking the obtained box didn't automatically tick the box to the right hand side. Once I manually tick this, the details do show on the imp plan. Emailed Tony to confirm if this is correct processing. Tony raising new story for gp issue should auto tick the criterion box once all evidence/actions beneath are obtained/complete

Closed

DES - fixed 17/06 / 18/06

EP - a.test:gp is currently in this state. I am now using acute2 user for further tests for now EP - This defect is not occuring now for some reason.

Same scenario as above, for the 1st req that shows, in the 'improvement plan (uncluding completed items)' plan it shows the yellow evidence secion but in the 'Completed items only' plan it doesn't show this evidence section. Both tickboxes to show this detail are ticked for both plans. UPDATE 17/06 The 'improvement plan (uncluding completed items)' plan shows evidence & actions but the 'Completed items only' plan only shows evidence, not actions. Odd

Closed

21

- The Report Type specifies completed items N and the attainment criterion is marked achieved The displayed attainment criteria are in alpha order within their parent widget (Level 3 Maintenance criteria appear after other L3 criteria) For each displayed attainment criterion, the attainment criterion description is included

3/18/2010

3/17/2010

Des

Pass

22

3/18/2010

3/17/2010

Des

Pass

23

3/18/2010

3/17/2010

Des

Pass

24

25

For each displayed attainment criterion, the attainment criterion "achieved" status is displayed If the user requested for evidence to be displayed then evidence items are displayed under each of the displayed attainment criteria according to the following rules: - If the Report Type specified incomplete items then show evidence items which are not "fully specified" as per definition in S033

3/18/2010

3/17/2010

Des

Pass

26

3/18/2010

3/17/2010

Des

Pass

I marked an evidence item as obtained Medium but did not fully specify the evidence location. It should have been included in the report (because it is not "fully specified"). Chat to Richard about the business rules for "fully specified" there may be some business logic that can be re-used

Closed

Des 28/05 - Fixed

Pass

Pass

If the evidence location is not specified, display "[not specified]" instead of leaving it blank For an uploaded file, display "Uploaded" followed by the filename (see defect below - the filename also needs to be a hyperlink) Need to fix above defect first

Low

Closed

Des 02/06 - Fixed

Low

Closed

Des 02/06 - Fixed

27

28

- If the Report Type specified complete items Y then show evidence items which are "fully specified" as per definition in S033 For each evidence item, Evidence Location Y includes a hyperlink to view the document (in a new window) for appropriate location types If the user requested for actions to be displayed then actions are displayed under each of the displayed attainment criteria according to the following rules: - If the Report Type specified incomplete items Y then show actions which are not marked complete - If the Report Type specified complete items Y then actions items which are marked complete The org has no v8+ assessments The system displays a single option of "<No assessments at v8 or greater>" All other options are displayed as per main flow The "Show Report" button is disabled Request to produce an evidence and action report, logged on as XYZ ABC user System displays "Reports Single Organisation Chooser" (as used in other reports) There is an option to search for and select an organisation to report on Search for and select an organisation to report on Rejoin main flow at step 2, reporting on the specified organisation Request to administer improvement plan settings

3/18/2010

3/17/2010

Des

Pass

Closed

3/18/2010

3/17/2010

Des

Pass

No hyperlink for uploaded evidence

Medium

Closed

Des 02/06 - Fixed

29

30

3/18/2010

3/17/2010

Des

Pass

Due date is showing time as well as date (only date required)

Medium

Closed

Des 26/05: Fixed

31

3/18/2010

3/17/2010

Des

Pass

2a

1 2 3 4 1

Des Des Des

Pass Pass Pass

Edge case not tested Edge case not tested Edge case not tested

1a

4/6/2010 N/A

Des

Pass

3 4 5

4/6/2010 N/A

Des

Pass

4/6/2010 N/A

Des

Pass

S116

Send Ad-hoc Improvement Action Reminders

Organisation Admin

Send ad-hoc email Main reminders to widget owners with outstanding improvement actions

Des

2 3

The system displays the Improvement Plan Y Admin page The system validates that the organisation has Y an "in-progress" assessment (not yet confirmed or submitted as appropriate) The system validates that there is at least one Y widget owner with "incomplete" widgets on the current assessment (as per steps 9 and 10 of S115) There is an option to send an ad-hoc email reminder, including the following data entry fields: "To" - a list of all widget owners with "incomplete" widgets on the current assessment (as per steps 9 and 10 of S115). There is also an option to send a reminder to them all. The default value is "<Select>" Y

3/18/2010

3/17/2010

Des Des

Pass Pass I marked the assessment as confirmed Low but the system didn't display the error message Closed Des 03/06 - Fixed

Des

Pass

Closed

3/18/2010

3/17/2010

Des

Pass

3/18/2010

3/17/2010

Des

Pass

Not in the spec but the list of Medium "incomplete" widgets needs to exclude any that are "marked complete" (also applies to S115)

Closed

Des 04/06 - Fixed

Pass

Setup an EXEMPT req. This has a req owner setup. When I send the ad hoc email an email is sent to this person but it is completely blank. Label should be "Cc:", not "CC:"

High

Closed

Des 21/06: Fixed.

7 8 9 10 11 Enter details for the ad-hoc reminder Request to send the ad-hoc reminder

"Cc" - a free format text box (default blank) Preamble - a free format text area (default blank)

Y Y

3/18/2010 3/18/2010

3/17/2010 3/17/2010

Des Des

Pass Pass

Low

Closed

Des 02/06 - Fixed

The system validates that I have selected a recipient (or "All") in the "To" field The system validates that I have specified zero or more valid email addresses in the "CC" field (separated by semi-colons or commas)

N/A

3/18/2010

3/17/2010

Des

Pass

Error message refers to "Widget Owner" but field label is "To" error message - should be "The following emails are not valid"

Low

Closed

Des 04/06 - Fixed

12

N/A

3/18/2010

3/17/2010

Des

Pass

Low

Closed

Des 02/06 - Fixed

Pass

System won't handle whitespace after Medium the comma or semicolon - it says the secont email address is invalid

Closed

Des 02/06 - Fixed

13

14 15

The system sends a separate reminder email to each specified recipient (if they have an email address set up) Each email is copied to all email addresses in the "CC field" The content of the email is as specified in S115

3/18/2010

3/17/2010

Des

Pass

Y Y

3/18/2010 3/18/2010

3/17/2010 3/17/2010

Des Des

Pass Pass Pass Waiting for fixes to S114 before testing Heading font too large (e.g. "A Message from your PQR App Administrator")

Low

Closed

Des 03/06 - Fixed

Pass

Remove "PQR App Administrator" Medium name from the sender details so it just displays DONOTREPLAY@... remove gap between recipient name and comma Increase paragraph spacing Low Low

Closed

Des 02/06 - Fixed

Pass Pass Pass

Closed Closed Closed

Des 02/06 - Fixed Des 04/06 - Fixed Des 02/06 - Fixed

16

The email also includes the preamble (see prototype for location)

TBC

3/18/2010

3/17/2010

Des

Pass

Outstanding evidence not displayed (I High haven't tried but I'm guessing that outstanding actions are not displayed either) The system should treat newlines in Low the preamble as starting a new paragraph (i.e. insert <p> tags as appropriate. If there are two newlines together, do not include a blank paragraph (assuming of course that you have set up the formatting to include a bit of whitespace between paras)

Closed

Des 04/06 - Fixed

17 18 19

20 3a 1 2 The organisation does not have an inprogress assessment

Any HTML special characters (&, <, > etc.) are correctly displayed in the email The email does not have to be sent immediately but is sent within 30 minutes The system confirms who it has sent an email to and who it has failed to send an email to due to a lack of email address The system tells the user that the emails will be sent within 30 minutes

N N/A N

N/A 4/6/2010 4/6/2010

N/A

Des Des Des

Pass Pass Pass See prototype for wording Low Closed Des 03/06 - Fixed

4/6/2010

Des

Pass

See prototype for wording

Low

Closed

Des 03/06 - Fixed

The system displays a message to say I can't send an ad-hoc reminder at the moment (see prototype for wording) There is *not* at least one widget owner with "incomplete" widgets on the current assessment (as per steps 9 and 10 of S115) The system displays a message to say I can't send an ad-hoc reminder at the moment (see prototype for wording)

Des

Pass

Waiting for defect at MF step 3 to be fixed

4a

Des

MSG - You cannot send an ad-hoc reminder at the moment because there are no widget owners with incomplete widgets

Pass

S115

Send Regular Improvement Action Reminders

Organisation Admin

Send regular email Main reminders to widget owners with outstanding improvement actions

Request to administer improvement plan settings

2 3

The system displays the Improvement Plan Admin page There is an option to indicate whether regular email reminders should be sent

Y Y

3/18/2010 3/18/2010

3/17/2010 3/17/2010

Des Des

Pass Pass

The system validates that all potential email recipients have email addresses set up

4/6/2010

Des

Had to setup a user at an acute trust Pass to test this. Set up and chose option 'don't email' in dropdown. When this user is then set as a req owner and you go to the imp plan admin page you get a msg to say the user does not have an email address

5 6 7 8 9

Indicate that regular email reminders should be sent Request to save my changes The system persists my changes Wait until the 1st of the month The system validates that the organisation has an assessment which is: a) v8 or above and b) not yet submitted The system sends an email to each widget owner with "incomplete" widgets on this assessment (so long as they have an email address). A widget is "incomplete" if either: i) the current level is lower than target level, or ii) it has incomplete improvement actions However, a widget is *not* incomplete if it has been marked complete. N/A 4/6/2010 3/17/2010 Des Pass Y 3/18/2010 3/17/2010 Des Pass

10

4/6/2010

3/17/2010

Des

EP - I have a setup where I am the widget owner of 3 widgets and all 3 are currently not answered. I run the job and no email is sent. If I change one of the widgets to level 1 (so still not obtained properly) the email is sent. This email then contains details of all 3 req's, even though 2 are still completely unanswered

Pass

Closed

DES fixed 17/06

11

For the avoidance of doubt, if the target level is N/A "NR" or "EX" then the widget is *not* incomplete

N/A

N/A

Des

If current and target levels are NR / Pass EX, widgets do not show on the email. If current level is NR or EX but target level is blank, widgets do show on the email. Pass Pass Pass Pass

Set 3 widgets to me as the owner. 1st is set to level 3 and complete, 2nd is NR & 3rd is EX. When I run the job I get an email but there are no incomplete items on it. I shouldn't get an email in this case.

High

Closed

DES 22/06: Fixed

12 13 14 15

The email includes a list of the incomplete widgets For each incomplete widget, the email states the current attainment level For each incomplete widget, the email states the target attainment level (if set) For each incomplete widget, the email includes a list of all evidence (including whether obtained, location type and comments) For each incomplete widget, the email includes a list of all actions (if any), including all details For each action, the email includes the description, owner and due date If the due date is in the past the action is flagged as overdue

Y Y Y Y

4/6/2010 4/6/2010 4/6/2010 4/6/2010

4/6/2010 4/6/2010 4/6/2010 4/6/2010

Des Des Des Des

16

4/6/2010

4/6/2010

Des

Pass

17 18

Y Y

4/6/2010 4/6/2010

4/6/2010 4/6/2010

Des Des

Pass Pass Setup an action with a due date in the Medium past but it appears on the email like the rest of the future due date actions. Is not specifically flagged as overdue (that I can see anyway)! Closed DES 22/06: Fixed

19 20 4a 1 There are one or more potential email recipeints who do not have an email address set up

The email includes a link to the PQR App website The email includes contact details for the organisation's PQRT administrator

Y Y

4/6/2010 4/6/2010

3/17/2010 3/17/2010

Des Des

Pass Pass

3 S121 View Past Attainment Level Organisation User View my attainment level Main for a (v8+) widget on my previous assessment 1 Request to view a (v8+) widget, within the context of an assessment

The system displays a warning listing the potential email recipients who do not have email addresses set up Rejoin main flow at next step

4/6/2010

Des

Pass

4/6/2010

Des

Pass

3 4

The system displays my "past attainment level" for this widget, as follows (this is as per existing functionality for v7- widgets): - If I have no previous assessments, it is blank. Y - If my most recent assessment was against a widget set which did not have the same widget number in, it is blank. N

N/A N/A

N/A N/A

RJM RJM

Pass Pass Working as a.test:acute2, req 102 High should have past level 3 and req 103 should have no past level (req 103 doesn't exist in previous assessment). But if I click "Next" from req 102, it shows past level as 3 for req 103 (looks like it is remembering the past level from req 102 instead of blanking it out) Closed

- Otherwise, it is the attainment level I achieved N against the same widget number in my most recent assessment. Request to view a (v8+) widget, within the context of an assessment There is an option to set a target attainment Y level (the options are blank [default], 1, 2 and 3 not 0 or NR). There is an option to set a target date (default Y blank). Set the target level and date The system validates that the target date is a valid date (future or past) N

N/A

N/A

RJM

Pass

S122

Set Target Attainment Level and Date

Organisation User

Set a target attainment Main level and date for a given (v8+) widget

3/25/2010

RJM

Pass

3 4 5

N/A

N/A

RJM

Pass

N/A

N/A

RJM

Pass

If I type an invalid date and hit enter, Low the screen fades to white and back again but no pop-up is displayed. If I tab out of the field I do get the popup.

Closed

6 7

Request to save my changes The target level and date are persisted along with the widget response N N/A N/A RJM Pass If I set the target level and date and then navigate to the next widget, the same target level and date are redisplayed Set target level -> done -> select previous reqt -> next -> target level is blank High Closed

Pass

High

Closed

RJM/CMC

S137

Set Target Attainment Level of 0, NR or EX

Organisation User

Set a target attainment level of 0, NR or EX

Main

Request to view a (v8+) widget, within the context of an assessment There is an option to set a target attainment level of 0 If NR is allowed for this widget, there is an option to set a target attainment level of NR Y Y 4/12/2010 RJM RJM Pass Pass If I set the target level as NR and then click "Next" I get a system error If I set the target level as exempt and then click "Next" I get a system error High Closed Data removed from database script. Needs re-instating. Data removed from database script. Needs re-instating.

If the organisation has been exempted from this N widget, there is an option to set a target attainment level of EX S123 Mark Widget as Complete Organisation User (or Reviewer or Admin) Mark a (v8+) widget response as complete Main 1 This story implements the same functionality for v8+ widgets as already exists for v7- widgets Request to view a (v8+) widget, within the context of an in-progress assessment The system validates that the user's org type is not a "simplified interface" org type The system validates that the widget response includes a current attainment level (you can't mark it complete if you haven't answered it). This is *not* synonymous with a widget status of "In Progress" If the assessment is subject to 3-stage reporting, the system validates that the user's assessment has been performance updated N

4/12/2010

RJM

Pass

High

Closed

4/22/2010

RJM

Pass

4/22/2010

RJM

Pass

Need test data (org type with not simplified interface and not 3 stage reporting)

4/22/2010

RJM

Pass

6 7 8 9 Mark the widget response as complete Request to save my changes

There is an option to mark the widget response Y as "complete"

4/22/2010

RJM

Pass

The system persists the fact that the widget has N been marked complete and also captures the date and time and the current user The system displays the date and time the N widget response was marked complete and the user who marked it complete The widget is now "locked down" and is no N longer editable (the only way to unlock it is to untick "widget complete") Return to the widget list page The widget response status is "Marked Complete" Request to view a (v8+) widget, within the context of an in-progress assessment, as an XYZ ABC user The system performs validations as per Main Flow steps 3, 4 and 5 The system displays whether the widget is marked complete (read-only e.g. Disabled checkbox) This story implements the same functionality for v8+ widgets as already exists for v7- widgets, but with some "improvements" Request to view a (v8+) widget, within the context of an in-progress assessment The system validates that the user's org type is not a "simplified interface" org type N N N N

4/22/2010

RJM

Pass

10

4/22/2010

RJM

Pass

11

4/22/2010

RJM

Pass

Logged in as ABC user and was still able to mark the widget as exempt

Medium

Closed

12 13 2b 1

4/22/2010

RJM

Pass

2 3

4/22/2010 4/22/2010

RJM RJM

Pass Pass

S124

Mark Widget as Confirmed

Organisation Reviewer (or Admin)

Mark a (v8+) widget response as confirmed

Main

4/22/2010

RJM

Pass

4 6

The system validates that the widget response N is already marked "Complete" There is an option to mark the widget response Y as "confirmed complete"

4/22/2010 4/22/2010

RJM RJM

Pass Pass Can you make it so that when I mark Low complete, the caonfirmed checkbox immediately becomes enabled rather than me having to save it first? This is not actually a valid real-life scenario because it's supposed to be a different user doing the "confirm" but I know that some orgs have a single person doing both and also it will speed up testing quite a bit. Closed

7 8 9 10

Mark the widget response as confirmed complete The system "locks" the "complete" flag by making it read-only Request to save my changes The system persists the fact that the widget has N been confirmed complete and also captures the date and time and the current user The system displays the date and time the widget response was confirmed complete and the user who marked it complete Return to the widget list page The widget response status is "Confirmed Complete" The widget is not already marked "complete" There is an option to mark the widget response N as "confirmed complete" but it is disabled 4/22/2010 RJM Pass N 4/22/2010 RJM Pass N 4/22/2010 RJM Pass N 4/22/2010 RJM Pass

11

4/22/2010

RJM

Pass

14 15 4a

9a

Mark the widget as *not* confirmed complete The system "unlocks" the "complete" flag by making it editable N 4/22/2010 RJM Pass

2a

Request to view a (v8+) widget, within the context of a "confirmed" assessment The system displays the "complete" and "confirmed" statuses (both will be ticked) but they are read-only N 4/22/2010 RJM Pass Complete and confirmed flags not displayed Medium Closed

Pass

Attainment level checkboxes not Medium displayed - should be displayed "greyed out" (although Current Level is displayed correctly)

Closed

2b

Request to view a (v8+) widget, within the context of an in-progress assessment, as an XYZ ABC user The system performs validations as per Main Flow steps 3, 4 and 5 The system displays whether the widget is marked confirmed (read-only e.g. Disabled checkbox) The tooltip on the User ID field on the Home Page refers to "User ID" not "login name" N N 4/22/2010 4/22/2010 RJM RJM Pass Pass

2 3

S127

Odds and Ends

General User

See a range of random Main and unrelated point improvements across the site

N/A

N/A

CMC

DONE

Pass

2 3

The What's New section of the Home Page displays just the top 4 news articles The links on the Admin page are in the same order as per the prototype

Y Y

3/18/2010 N/A

3/17/2003 CMC N/A CMC

DONE DONE

Pass Pass Not really a fail, but the prototype was Low wrong, sorry. Can you move the Information Mappign Admin links below "Improvement Plan Admin" please? Closed

On the Org Admin org chooser screen, the note next to the Look For field says organisation code not NACS code The Cancel button on the Widget Details page has a tooltip "Cancel your changes and return to the widget list" The Done button on the Widget Details page has a tooltip "Save your changes and return to the widget list" When logged in, the Previous and Next buttons on the Widget Details page have tooltips "Save any changes and go to the previous (next) widget" When not logged in, the Previous and Next buttons on the Widget Details page have tooltips "Go to the previous (next) widget" The Save button on the Widget Details page has a tooltip "Save your changes and remain on this page" All "custom" (i.e. jquery) tooltips have a 15 second timeout to cater for the fact that in some cases they don't disappear when the mouse leaves the relevant hover zone Section headers are black, not blue Glossary text is green, not black (including underline) When you float over a hyperlink the underline disappears rather than getting a blue background Home page alert says "<h2>PQRT Version Beta Test Phase 1</h2><p>Welcome to the PQRT Version 8 Beta Test site. Thank you for agreeing to take part in the beta testing. If you don't already have one, you will need <a href="...">a copy of the test script</a>. Happy testing!</p>" Register Step 3 - wording matches wording on prototype (including "contact our Helpdesk" instead of "contact us") Contact Us page - insert a space between "Frequently Asked Questions" and "(FAQ)" Contact Us page - add a third bullet after "the Online Help": "your local PQR App Administrator" (see prototype - but don't put the "(who is this?)" link, because we haven't done that yet!

N/A

N/A

CMC

DONE

Pass

N/A

N/A

RJM

DONE

Pass

N/A

N/A

RJM

DONE

Pass

N/A

N/A

RJM

DONE

Pass

N/A

N/A

RJM

DONE

Pass

10

N/A

N/A

RJM

DONE

Pass

11

N/A

N/A

RJM

DONE

Pass

13 14 15

Y Y N

N/A N/A N/A

N/A N/A N/A

CMC CMC CMC

DONE DONE DONE

Pass Pass Pass

16

N/A

N/A

CMC

PARTLY DONE: Need Test script URL reference adding

Pass

Sorry, I missed out an "8" between Version and Beta

High

Closed

17

N/A

N/A

CMC

DONE

Pass

19 20

Y Y

N/A N/A

N/A N/A

CMC CMC

DONE This was already done, including the Who Is This link. Maybe tested when not logged in or logged in under XYZ CfH which would explain why it wasn't displayed ? TH 08/04: fair point. Tested and raised defect to right

Pass Pass The "who is this" floater isn't obviously a floater - I propose the following CSS (see prototype): span.floatable {color:blue; borderbottom:dashed 1px blue; cursor:pointer} Low Closed

Pass

Pass

When I float over "Who is this", most Medium of the header bar of the page suddenly goes white, even after the pop-up has disappeared When I float over "Who is this", the Low tooltip is positioned OK but if I scroll the page down a bit and try again, the tooltip is positioned too high up the page (IE6 and IE7)

Closed

Closed

RJM

21 22

23

Widgets org type chooser - the list of org types Y is supposed to have bullet points Widget Details page - header bar data on RHS Y needs to *not* have lots of padding to the right) Widget Details page - Attainment Levels section - N context help icons for attainment levels and attainment criteria should only be displayed if the tick boxes they refer to are displayed Widget Details page (not logged in) - too much white space below the evidence table - suspect this is due to an invisible/not displayed "add evidence" link. N

N/A N/A

N/A N/A

CMC CMC

DONE DONE

Pass Pass

N/A

N/A

RJM

DONE

Pass

24

N/A

N/A

RJM

DONE

Pass

25

If I expand 1a and then expand 1b then the N accordian facility works, but 1a does not collapse slowly, it just disappears, meaning that section 1b opens but then suddenly jumps updards and I lose track of where it is. Can this be made smoother?

N/A

N/A

RJM

CANT BE DONE IN IE WORKS OK IN Pass FIREFOX AND CHROME. IE CANT HANDLE THE SLIDE VERY WELL SO THIS HAS TO BE SHOWN OR HIDDEN. FIREFOX/CHROME HANDLE SLIDE REALLY NICELY AS IS VERY ELEGANT. IE IS CLUNKY. TH 08/04 Let's see what the users say about it in beta testing

26

29

Widget Details page - level 3 maintetnance Y criteria - include an extra sentence below the criterion description as follows:"<br/><br/>[Only required if Attainment Level 3 was achieved in the previous assessment]" Can you add a skeleton "About" page - title: N "About the PQR App" with content of "Content TBC" and link to it from (a) the top links and (b) the intro paragraph on the Home Page Likewise the "quick start" guide, linked in from the home page (both not logged in and logged in variants) Widgets list page - only display the "not met key widget" cross if the user has actually answered the question Widget Details page: remove or hide "Date Last Modified", which isn't working properly anyway (it changes the date last modified for all criteria at the same time, even if I only modify one of them) a.test:acute, req't 102 - criteria 1b, 2b and 2c are being (incorrectly) displayed as if they were Level 3 Maintenance criteria - this is probably a test data issue [logged in as XYZ ABC] View a 3-stage assessment for an organisation which has been baselined but not performance updated There is an option to unsubmit the baseline N N

N/A

N/A

CMC

DONE

Pass

N/A

N/A

CMC

DONE

Pass

Title is too small - use <h1>

Low

Closed

30

N/A

N/A

CMC

DONE

Pass

Title is too small - use <h1>

Low

Closed

31

N/A

N/A

CMC

DONE

Pass

34

N/A

N/A

CMC

DONE: Note we should either treat this problem though as a DR or else remove date modified entirely i.e. from database model as well etc Low priority:DONE wouldn't have affected UAT anyway

Pass

35

N/A

N/A

CMC

Pass

S128

Unsubmit Baseline/Performance Update: Changed Permissions

XYZ ABC User

Unsubmit baselines and performance updates whereas organisation admins cannot

Main

3/15/2010

nili

Pass

1a

3 4 1

Request to unsubmit the baseline The system unsubmits the baseline [logged in as XYZ ABC] View a 3-stage assessment for an organisation which has been performance updated but not submitted There is an option to unsubmit the performance N update Request to unsubmit the performance update The system unsubmits the performance update N [logged in as an org admin] View my 3-stage assessment which has been baselined but not performance updated There is *not* an option to unsubmit the baseline [logged in as an org admin] View my 3-stage assessment which has been performance updated but not submitted There is *not* an option to unsubmit the performance update View my 3-stage assessment which is ready to be baselined N 3/15/2010 nili Pass N 3/15/2010 nili Pass 3/15/2010 nili Pass 3/15/2010 nili Pass N 3/15/2010 nili Pass

2 3 4 1b 1

2 1c 1

S129

Submit Baseline/Performance Update Warnings

Organisation Admin

Receive warnings when Main submitting baselines and performance updates

2 3 4 5 Request to submit a baseline

There is an option to submit a baseline [no change] The option is labelled "submit baseline", not just "baseline" The system presents the following warning: "Once you have submitted your Baseline you will not be able to unsubmit it without contacting us", with options to proceed or cancel Request to proceed The system submits the baseline as per current functionality [no change] Request to cancel The system does not submit the baseline View my 3-stage assessment which is ready to be performance updated There is an option to submit a performance update [no change] The option is labelled "submit performance update", not just "performance update" Request to submit a performance update

N N

3/15/2010 3/15/2010

nili nili

Pass Pass

3/15/2010

nili

Should the message be clearer about who they might need to contact? (ie who is the 'us' in the message)?

Pass

6 7 6a 1b 1 2 1

3/15/2010

nili

Pass

3/15/2010

nili

Pass

2 3

N N

3/15/2010 3/15/2010

nili nili

Pass Pass

4 5

The system presents the following warning: N "Once you have submitted your Performance Update you will not be able to unsubmit it without contacting us", with options to proceed or cancel Request to proceed The system submits the performance update as N per current functionality [no change] Request to cancel The system does not submit the performance update Request to edit details for a user N

3/15/2010

nili

Should the message be clearer about who they might need to contact? (ie who is the 'us' in the message)?

Pass

6 7

3/15/2010

nili

Pass

1b.6a

1 2

3/15/2010

nili

Pass

S130

Can't Delete User

Organisation Not delete a user who is Admin, XYZ ABC referenced from various User other data within the system

Main

3 4 5 6 7 8 9 10 11 12 13 14 15 16

The system validates that the user is related to (or referenced from) any of the following data items: Widget.Owner AssessmentCriterion. ModifiedUserId AssessmentCriterionEvidence. CustomCreatedUserId AssessmentCriterionEvidence. ModifiedUserId AssessmentCriterionEvidenceUpload. UploadedUserId AssessmentCriterionImprovementAction. CreatedUserID AssessmentCriterionImprovementAction. ModifiedUserID AssessmentHistory.OrganisationUserID AssessmentWidget.ExemptionGrantedBy AssessmentWidgetScore.OrganisationUserID BulkEmail. CreatedBy BulkEmail. UpdatedBy

N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A

4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010 4/6/2010

nili

Pass N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A

PQRAFOrganisationSubmitted. N/A SubmittedByUserId System does *not* provide the option to delete N/A the user Glossary terms are not matching e.g. Req 210 "information assets" - suspect it might be due to differences in capitalisation N/A

nili

N/A

Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority Not tested due to lack of time and low priority

S132

Beta Test Phase 1 Defects General User

See various defects/issues resolved that appeared in Beta Test Phase 1

Main

N/A

N/A

CMC

done

Pass

Evidence items truncated by commas e.g. req N/A 210, 1b evidence. Also, evidence for req 210 2b has two items the second item text is actually part of the first item text looks like a problem with comma delimiters. Also, speech marks around the evidence items

N/A

N/A

CMC

done

Pass

Evidence location has red cross even though N/A evidence not marked as obtained Evidence Location does not have [select] When I click Evidence Location pop-up arrow, screen refreshes and no pop-up appears Seems to work OK for custom evidence, so maybe its a data problem (perhaps the publish process?)

N/A

N/A

RIMA

done

Pass

4 5 6 7

When I click "Save" on the Widget Details page, I get "The page cannot be displayed" Widget PDFs not there Need to link home page through to test script when it's ready Glossary PDF is out of date - suspect it has not been correctly re-published (how can there even be a PDF file in there if the glossary PDF publish failed - is there a default PDF file in SourceSafe - if so remove it because it hides the problem) Defect fixes/enhancements to Home Page "At a Glance" section as per S079 Knowledge Base section layout is wrong when viewed in IE6 (tabs on left, content on right) Tooltips disappear off the RHS of the screen

N/A N/A N/A N/A

N/A N/A N/A N/A

N/A N/A N/A N/A

RIMA CMC CMC CMC

done done done done

Pass Pass Pass Pass

N/A

N/A

N/A

CMC

done

Pass

One defect remaining (recorded against S079) but is cosmetic

N/A

N/A

RIMA

done

Pass

10 11

N/A

N/A 4/26/2010

N/A

CMC CMC

12

Widget Details page: When you attempt to click N an attainment criterion tick box, the system warns you that you need to enter evidence details. Can you make it so that it also expands the attainment criterion to make the evidence visible? Widget Details page: When you attempt to click N an attainment level tick box, can you make the system warn you that you need to complete the individual criteria (same text as for the context help tooltip to the side - which is different for each attainment level) Can you also make it so that it expands the attainment level to make the criteria visible (and because it is accordian style you will need to collapse any other open section)?

done, also handles bottom of the [page as well a right hand side done

Pass Pass

4/26/2010

CMC

done

Pass

13

Replace "TBCs" with real context help on the Widget Details page (ref. context help file v2) If I select an org type which has no widgets set up, I get a server error. In the current live system it just displays an empty list (e.g. For Dentists) Tooltip for Current Level context help appears behind Target Level drop down (IE6)

N/A

N/A

CMC

done

Pass

14

N/A

N/A

CMC

done

Pass

Test using SUO

15

N/A

N/A

RIMA

done

Pass

16 17

18

Widget Details page - remove context help N criterionComments - no longer required Assessment Summary page - in IE6, create or N delete an assessment - page content goes blank and page header partially blanked out. Click refresh and it's OK again Widget Details page (when completing an N assessment) - NR option is displayed even though NR isn't an option (it's OK on the readonly view)

N/A N/A

N/A N/A

CMC CMC

done done

Pass Pass

N/A

N/A

CMC

done

Pass

19

When I float over a glossary definition, N sometimes I get: "Undefined - unable to get definition from the server", and when I float over it again a comple of seconds later I get the correct definition. A timing issue perhaps? A simple fix might be to change the message to say "temporarily unavailable" or "loading, try again in a few seconds" Evidence upload - this is not disabled but it N doesn't work properly. Needs disabling (as per Duplicate Evidence) Created new acute org "acutest11" and user N "test"/"4testing", log in, create assessment then nav to req 202. Attainment levels showing -1 instead of 1,2,3. Req 210 the same but Req 310 and 312 are OK Req 312 - when I complete criteria 1a and 1b, N they are both ticked but AL1 is not ticked. Tried Req 310 which is OK Widget Details page, KB section - tab headers Y should be Key Resources, Exemplar Materials, Useful Websites, not Key Resources, Exemplar, Exemplar Materials When I navigate from one req't to another, the attainment levels should always start out collapsed (unlike the top-level sections, which should be the same as the previous page). N

N/A

N/A

CMC

done, I think. Found some issues with Pass glossary terms which I think may have ben causing the issue hard to be 100% sure as problem only occurred sporadically.

20

N/A

N/A

RIMA

done

Pass

21

N/A

N/A

CMC

done

Pass

22

N/A

N/A

CMC

done

Pass

23

N/A

N/A

CMC

done

Pass

24

N/A

N/A

CMC

done

Pass

25

Not logged in, navigate the req 210, observe 2x N material changes. Then click Next then Previous and it says "no material changes"

N/A

N/A

CMC

done

Pass

S133

Odds and Ends 2

General User

See a range of random Main and unrelated point improvements across the site

A marked up glossary term which is a plural matches against a glossary which is singular. For example "Calditott Guardians" should match "Caldicott Guardian" and "spies" should match "spy" Widget Details page (read only) - "Evidence Required" as a bullet list (as per prototype) instead of table Context help to RHS of "Evidence Required:" when not logged in - to be same as per "Evidence Required" column header when logged in (see context help file v2 for details) For better alignment of attainment levels, change the following CSS in igt.requireemnt.css: "div.attainmentLevel div.attainmentLevelNumber {float:left; width:41px; font-weight:bold; font-size:1.5em; text-align:right; padding-right:4px; lineheight:80%} " On the Widgets List page, if the widget set is v7 or before, when I select a widget it should display it using the "old style" Widget Details page Home page - logged in as XYZABC user - At A Glance - don't display "start working on your assessment" for ABC users Org type a.test:gp - req't 101 and 102 are showing attainment levels of NR and -1. Might be a test data issue, if so can you add suitable test data (need to be able to test XYZs)

4/6/2010

CMC

done

Pass

4/26/2010

done

Pass

N/A

N/A

done

N/A

Superseded

4/8/2010 N/A

done

Pass

10

N/A

N/A

done.

Pass

11

N/A

N/A

Done

N/A

Superseded

13

N/A

N/A

Done

Pass

16

17

The email address validator should allow N apostrophes (well, at least fay o'sullivan thinks so). This applies to all screens which accept email address input (I am hoping we use a single validator in all cases) A widget should only have a status of N "Answered" (aka "In Progress") if it actually has an answer i.e. An attainment level, NR or EX. If the user subsequently edits the widget response such that there is no answer (e.g. Unticks "NR") then the status should revert back to "Not Answered" (aka "Not Started") On the Widget Details page, for the non N simplified interface, if all other conditions are met, the Mark Complete and Confirm Complete options should be available if the widget response is "NR" or "EX" (not just if an attainment level has been obtained). This should be synonymous with a widget status of "Answered". On the Assessment Summary page, for the N purposes of determining whether the various Submit options (baseline, performance update and final) should be available, a widget response of "EX" should be considered as a valid answer to a widget. Put another way, if all other conditions for submittion are met, a widget response of "EX" should not block the submission. Currently if you mark a widget as exempt if its a key widget when you go back to the widgets list screen it shows the word Exempt but also shows a red cross to indicate you havent met the minimum level. This is wrong, no cross should be displayed as per for widgets marked Not Relevant. N

N/A

N/A

Done. Problem was new areas of code i.e. Registration rewrite and Contact Us didn't use existing email validation Done

Pass

N/A

N/A

Pass

18

N/A

N/A

Done

Pass

19

N/A

N/A

Done

Pass

20

N/A

N/A

Done

Pass

S135

Organisation Type Names General User

See better, shorter names Main for organisation types

Request to view the Widgets Org Chooser page The org type names are as per "PQRT v8 Organisation Type Names v1.docx" Request to view an Assessment Report The org type names in the Organisation Type N drop-down are as per "PQRT v8 Organisation Type Names v1.docx" Note: the org type names appear elsewhere in N the system too but it is assumed that they are always populated from the same source (in the database) so this story does not explicitly check each appearance 2/11/2010 nili Pass As above Closed Y 2/11/2010 nili Pass Org type names have not changed possibly due to migration script not having run Medium Closed

3 4

2/11/2010

nili

N/A

S141

PQRT Release Cycle Info in Approval Email Text

Organisation Admin

Receive a message about Main the PQRT release cycle as part of the approval email

Have an XYZ ABC user approve my submitted assessment

The system sends me an approval email (no N change) The email includes the following amended N paragraph: "Note that the PQR App assessment must be completed annually whilst an organisation continues to use XYZ Connecting For Health systems and services such as N3. Each new version of the PQR App assessment is usually made available by 30th June and must be submitted by 31st March in the following year."

4/22/2010 4/22/2010

nili nili

Pass Pass Text OK but formatting bad. Needs Low blank lines here & there and also there are newlines where there shouldn't be e.g. Between "31st" and "March" Closed nili: re-formatted text

S142

View Improved Assessment Report

General User

View an organisation's Assessment Report with various enhancements

Main

Request to view reports

2 3 4 5 Request to view an Assessment Report

There is an option to view another organisation's Assessment Report The supplementary text is as per the prototype

Y Y

4/22/2010 4/22/2010

CMC CMC

Pass Pass

The system displays the Assessment Report Org Y Chooser page

4/22/2010

CMC

Pass

I've updated the prototype - can you get the new heading/preamble wording from there please

Low

Closed

6 7 8 9 10 Search for and select an organisation

The "Search" button is the default button i.e. It fires if I hit Enter

N/A

CMC

Pass

The system displays the Assessment Report Criteria page The system displays the organisation name

Y Y

4/22/2010 4/22/2010 4/22/2010

CMC CMC CMC

Pass Pass Pass

Single quotes around 'Show Report' please

Low

Closed

11

12

There is an option to select an assessment to Y report on, including all *approved* assessments in reverse date order - default latest assessment (no change) The format of the assessment in the list is: Y Version <version number> (<start year>-<end year>)" There is an option to compare with previous Y assessments, with a sub-option to select which assessment to go back to (list of all assessments except the most recent one, default is the lastbut one assessment) There is *not* an option to select the report Y breakdown (this is specified in a separate story S143) There is *not* an option to order the results Y (initiatives are to be displayed in a fixed order 100s, 200s etc.)

4/22/2010

CMC

Pass

4/29/2010

CMC

Pass

13

4/22/2010

CMC

Pass

14

4/22/2010

CMC

Pass

15 16 17

Select report criteria Request report The system opens the report as an MS Excel document (XLS format i.e. compatible with XL 97-2003) Y 4/22/2010 CMC Pass System error - Aspose licence not installed If I create a report XLS but don't close it, then try to create another report, the system brings the first report into focus rather than opening a new report - probably due to same filename. Maybe we could add the current time to the filename or some other unique suffix? High Closed

Pass

Medium

Closed

CMC:Was fixed as part of new approach taken to get over other issues with the Excel report opening

18 19 20 21 22

The report includes the organisation name

4/22/2010 4/22/2010 4/22/2010 4/22/2010 4/22/2010

CMC CMC CMC CMC CMC

Pass Pass Pass Pass Pass

The report includes the assessment version, Y start year and end year. The report includes the date it was prepared on Y The report contains a table with a row of data for the selected assessment If the user selected "compare with previous assessments", the table contains a row of data for the all assessments in the selected range Y Y

23 24 25

The assessments are in reverse date order Y For each assessment, the following data is displayed: - Assessment version number, start date and Y end date. Format: "Version 8 (2010-2011)", and in the HTML version, use a non-breaking hyphen (&#8209;) to ensure the best layout - Overall Score (expressed as a percentage) Y

6/24/2010

CMC

Pass

4/22/2010

CMC

Pass

26 27

4/22/2010 4/26/2010

CMC CMC

Pass Pass

28 29

The percentage scores take into account where N/A a widget has been assessed as EX (i.e. Excluded from score as per NR) - Grade, as follows: Y - For a v7- assessment, this is the RAG status Y calculated from the Overall Score (no change)

4/22/2010 4/22/2010

CMC CMC

Pass

30

31

- For a v8+ assessment, this is "Satisfactory" or Y "Not Satisfactory", as per Assessment Summary page For a v7- assessment, the background colour of Y the Grade matches the RAG status (no change, but currently not working in sys test) For a v8+ assessment, the Grade is colour coded - green for Satisfactory or Red for Not Satisfactory There is a key to explain the Assessment Grade (see prototype) The key includes v7 details if there are any v7 or before assessments in the report The key includes v8 details if there are any v8 or after assessments in the report Request to view reports Y

4/22/2010

CMC

Pass

4/22/2010

CMC

Pass

32

4/22/2010

CMC

Pass

34 35 36

Y Y Y

4/22/2010 6/24/2010 6/24/2010

CMC CMC CMC

Pass Pass Pass

S143

View Improved General User Assessment Report (Own Org)

View an organisation's Assessment Report with various enhancements

Main

2 3 4 5 6 Request to view an Assessment Report on my own organisation

There is an option to view my own organisation's Assessment Report

4/22/2010

CMC

Pass

The system displays the Assessment Report Criteria page Proceed as per S142 except: - the list of available assessments includes any non-approved assessment as well as all approved ones - if the report includes a not-yet submitted assessment, the report includes a "Stage Column" which says "Final" for submitted assessments and "Current" for non-submitted assessments (see prototype example 2) Request to view my Assessment Summary For each assessment (in progress or approved) there is an option to view a summary report Request to view a summary report for a given assessment

Y Y

4/22/2010 4/22/2010 4/22/2010

CMC CMC CMC

Pass Pass Pass

4/22/2010

CMC

Pass

1a

1 2

4/26/2010

CMC

Pass

3 4 5

The system displays the Assessment Report Y Criteria page Proceed as per S142 except that the default Y assessment is the selected assessment from the Assessment Summary page Request to view reports as an XYZ ABC user There is an option to view another organisation's Assessment Report (no change) Request to view an Assessment Report Proceed as per S142 except: - Allow in-progress assessments as per Main Flow above Request to view reports as an EFG user There is an option to view another organisation's Assessment Report (no change) Request to view an Assessment Report Proceed as per S142 except allow in-progress assessments as per Main Flow above if the selected organisation is a trust within my EFG area (same business rule as for PPR report) Request to view reports as an GHJ user There is an option to view another organisation's Assessment Report (no change) Request to view an Assessment Report Proceed as per S142 except allow in-progress N assessments as per Main Flow above if the selected organisation is a XYZ, thingy or Prison Health Unit within my EFG area (same business rule as for PPR report) This story extends S142 - branch from S142 after step 15 N N N N

4/26/2010 4/26/2010

CMC CMC

Pass Pass

1b

1 2

4/22/2010

CMC

Pass

3 4

4/22/2010

CMC

Pass

1c

1 2

4/22/2010

CMC

Pass

3 4

4/22/2010

CMC

Pass

1d

1 2

4/22/2010

CMC

Pass

3 4

4/22/2010

CMC

Pass

S144

View Improved General User Assessment Report Breakdown by Attainment Level

View an organisation's Assessment Report broken down by attainment level

Main

2 3 Select report criteria, including option to show breakdown by attainment criteria Request report

There is an option to show a breakdown by attainment level

4/22/2010

CMC

Pass

4 5

The report includes the following additional columns (see prototype example 3): - no of reqts not yet answered (column only shown if there are any non-zero values in it) Y 4/22/2010 CMC Pass

7 8

- no. of reqts at level 0, 1, 2 and 3 (four Y separate columns) - no. of reqts marked Not Relevant (column only Y shown if any non-zero values in it) - no. of reqts marked Exempt (column only shown if any non-zero values in it) - total no. of reqts This story extends S142 - branch from S142 after step 15 Y Y

4/22/2010 4/22/2010

CMC CMC

Pass Pass

9 10 S145 View Improved Assessment Report Stages and Targets Organisation User View an organisation's Main Assessment Report including baseline, performance update and target scores 1

4/22/2010 4/22/2010

CMC CMC

Pass Pass

There is an option to show Baseline and Performance Update scores

4/22/2010

CMC

CMC:The role for this story is Pass organisation user but have made this option avaialable to XYZ CfH and also any parent organisation e.g. EFGs viewing a Trust as this information is available anyway from other reports so for consistency feels like should be accessible by these types of users here as well CMC:Have made this option available Pass for XYZ CfH users as well just so that support staff can view the report if necessary CMC:Permissions for this as for Step Pass 2. Have also made this option only selectable if the Baseline and Performance Update scores are selected as otherwise doesn't seem to make sense, paticularly as we dont display a stage column in all the assessments are at the submitted stage (see step 7 for S143 above) Make available for EFG and GHJ too Medium Closed

There is an option to show target scores

4/22/2010

CMC

There is an option to show the date for each reporting stage

4/22/2010

CMC

Make available for EFG and GHJ too

Medium

Withdraw CMC: It is available to parent EFG/GHJs n not sure why this has been raised TH 12/7 - sorry, my mistake - withdrawn

5 6 7

Select report criteria Request report The report includes the following additional data (see prototype example 3):

- If I selected to show Baseline and Performance Y Update scores, the report includes an extra row of data for each Baseline or Performance Update that has been "captured" for the displayed assessments (this can be derived based on the assessment status and whether the assessment is subject to 3-stage reporting) - The data shown for the Baseline and PU stages N/A is the data as it was at the date and time when the Baseline or PU was performed (not as of the official Baseline or PU date, which might be different) If I selected to show target scores, the report Y includes an extra row for each assessment showing target scores (but only if there is one or more target score for the assessment)

4/22/2010

CMC

Pass

4/22/2010

CMC

Pass

10

4/22/2010

CMC

CMC:Although we expect either all or Pass no target scores to be set for an assessment the application doesn't enforce this so have to allow for only partial targets set. Therefore if not all targets set it includes the Not Yet Answered column count for those widgets not given a target. If we have this for partially targeted assessments do we not also want to display this column if no targets set, it seems more consistent that way. Pass

11

If I selected to show the date for each reporting Y stage, the report includes a column showing this data for Baseline, Performance Update and Current/Final data sets (note this is the official stage date, not the date that the organisation actually completed the stage)

4/22/2010

CMC

S146

View Improved Assessment Report Breakdown by Initiative

General User

View an organisation's Main Assessment Report broken down by initiative

This story extends S142 - branch from S142 after step 15

2 3 Select report criteria, including the option to show a breakdown by initiative Request report

There is an option to show a breakdown by initiative

4/22/2010

Pass

Alignment of text "Iniiative" - extra space on LHS

Low

Closed

4 5

The report includes the following additional data (see prototype example 4): - the whole table of data in the report is Y repeated once per initiative - the initiative name is shown as the overall Y header for the table - the initiatives are displayed in the following Y order: - Information Governance Management - Confidentiality and Data Protection Assurance - Information Security Assurance - Clinical Information Assurance - Secondary Use Assurance - Corporate Information Assurance - the overall totals (i.e. Across all initiatives) are Y shown last, with a heading of "Overall" - the set of initiatives used is the superset of all N initiatives across all assessments included in the report - a given assessment is only included under a N given initiative if it includes one or more widgets from the initiative - the data within each initaitve table is N (obviously) based only on widgets belonging to that initiative

4/22/2010 4/22/2010 4/22/2010

CMC CMC CMC

Pass Pass Pass Appear to be alphabetically ordered (in sys test) - this is probably due to the test data not having the correct order plumbed in, cos it seems OK for v8 data Low Closed Was a data issue but only for the test i.e. Acute:Test and Gp:Test org types was missing the ordering in the test data script

4/22/2010

CMC

Pass

4/22/2010

CMC

Pass

4/22/2010

CMC

Pass

4/22/2010

CMC

Pass

In order for the report to look tidy, if Low any of the initiatives include a "Not Yet Answered", "NR" or "EX" column, then you should include these columns in all tables so it all lines up nicely and so the Grade column is always in the same place (otherwise it's not always wide enough)

Closed

S152

View Improved Assessment Report Breakdown by Key Widget Status

General User

View an organisation's Assessment Report broken down by key widget status

Main

This story extends S142 - branch from S142 after step 15

There is an option to show a breakdown by key widget status

4/26/2010

CMC

CMC:Note wasn't sure if Key Widgets applied to target scores as prototype didn't make this clear have assumed they do. Have also assumed a key widget will never be marked Not Relevant or Exempt and thus if one were to me marked as such it would currently appear as Not Met.

Pass

4 5

Select report criteria, including option to show breakdown by key widget status Request report The report includes the following additional columns (see prototype example 5): - no. of key widgets not yet answered (only shown if it contains any non-zero values) Y 4/26/2010 CMC Pass

7 8

- no. of key widgets not achieved "pass" Y attainment level (generally level 2) - no. of key widgets achieved "pass" attainment Y level (generally level 2)

4/26/2010 4/26/2010

CMC CMC

Pass Pass Fail NR or EX should be treated as Key Medium Widget Met In order for the report to look tidy, if Low any of the initiatives include a "Key Req'ts Not Yet Answered" column, then you should include this columns in all tables so it all lines up nicely and so the Grade column is always in the same place (otherwise it's not always wide enough) Closed Raised

9 S147 View Improved Assessment Report HTML Version General User Create an HTML version Main of the assessment report 1 This story extends S142 by first displaying an HTML version of the report and then allowing the user to create an XL version if they wish Branch from S142 Main Flow at step 16 (request report)

- total no. of key widgets

4/26/2010

CMC

Pass

2 3

The system displays the report in HTML format on the same page, below the report criteria

4/26/2010

CMC

Pass

The content and layout of the HTML format Y report are as per the XL report (ref. stories S142S146, S152 and also see the prototype)

4/26/2010

CMC

Pass

Include <h2> tage Report Results as per prototype

Low

Closed

Pass

Remove date prepared - I know Low someone might print out the report so the date might be useful but it just looks a bit weird on an online report with the criteria at the top Table format - change all table styles from "listing" to "simple" Button to create XL: change label to "Export Report (MS Excel) - with a tooltip "Click to export the report to Microsoft Excel (XLS format)" Use classes "RAGRed", "RAGAmber" and "RAGGreen" for the RAG/grade colours (see prototype) Low Low

Closed

Pass Pass

Closed Closed

Pass

Low

Closed

Pass

Don't put the report within a scrollable Low frame (the prototype seems OK re. the table going off the RHS of the page) Put an <hr> before "Report Results" (as per prototype) You have a empty <tr> at the end of the report table which is showing up as an extra horizontal black line Low Low

Closed

Content is being cut off at the RHS due to overflow:hidden in IE6.css

Pass Pass

Closed Closed

Pass

You are not using the "odd" and Low "even" classes to set the background colours for alternate rows in the table instead you have a black border separator. Note that all rows for a gve version should be the same bg colour (see. Prototype example 3] You have black borders hard-coded in as HTML styles - remove them Context help link not there Low

Closed

Pass

Closed

5 6

7 8 9 Request to drill down on one of the scores

There is a context help to explain the Assessment Grade (HTML version only) There is an option to drill down on each *current* or *final* score (by initiative or overall) There is *not* an option to drill down on stage or target scores

Y Y

4/22/2010 4/26/2010

CMC CMC

Pass Pass

Low

Closed

4/26/2010

CMC

Pass

Tested target but not stages

The system displays the Widgets List page for the selected assessment (no change)

N/A

CMC

Pass

When clicked "back to Assessment High Report" got a system error (specifically if no previous assessment to report on)

Closed

10

If I selected a drill down on a given initiative, the system only displays the results for that initiative (no change)

N/A

CMC

Pass

11

12 7a 1 2 3 7b 1 2 3 Request to drill down on one of the scores as an XYZABC user Request to drill down on one of the scores for my own organisation

The system does not display the widget status (currently displays it for "overall results" drilldown but not for a single initiative drilldown) The system does not display widget owners

4/26/2010

CMC

Pass

4/26/2010

CMC

Pass

The widget status *is* displayed The widget owners *are* shown (but only if there actually are any widget owners)

Y Y

4/26/2010 4/26/2010

CMC CMC

Pass Pass

The widget status *is* displayed The widget owners *are* shown (but only if there actually are any widget owners) Branch from S147 Main Flow after step 6

Y Y

4/26/2010 4/26/2010

CMC CMC

Pass Pass

S162

View Improved General User Assessment Report - Drill Down on Breakdown

Drill down into the details Main of an assessment report for specific breakdown figures (e.g. Key widgets met/not met)

If the report include a breakdown by attainment N level, there is an option to drill down on individual attainment level counts (for current, final and target scores) If the report include a breakdown by key widget N status, there is an option to drill down on individual attainment level counts (for current, final and target scores) Request to drill down on an individual widget count The system displays the Widgets List page for N the selected assessment The list includes the subset of widgets that were N included in the selected widget count. For example, if the user clicked on Target/Level 3, the system displays just those widgets with a target of level 3.

4/29/2010

4/29/2010

4 5 6

4/29/2010 4/29/2010

S150

View Widget from Performance Progress Report

Organisation User

View the correct Main "guidance" document from the Performance Progress Report for a v8+ assessment

Request to view an (individual) PPR for a specific organisation and v8+ assessment (either directly from reports or via a multiple org PPR) The system displays the Individual PPR page (no N change) For each widget, there is a "Details" link N (instead of the "Guidance" link for v7- widgets (if it's easier, you can change the v7- link to "Details" too)) Select the "Details" link for a specific widget The system displays the widget PDF document for the selected assessment version, org type and widget number. Request to view an (individual) PPR for a specific organisation and v7+ assessment (either directly from reports or via a multiple org PPR) The system displays the Individual PPR page For each widget, there is a "Guidance" or "Details" link Select the "Details" link for a specific widget The system displays the widget guidance (MS Word) document for the selected assessment version, org type and widget number. N 4/22/2010 nili Pass URL is High "https://www.igt.connectingforhealth. nhs.uk/PQRTTest/WidgetDocuments/" whereas in live it is something like "https://www.igt.connectingforhealth. nhs.uk/Guidance/PQRM_Acute_101_V 7%2009-03-24.doc" Closed N N 4/22/2010 4/22/2010 nili nili Pass Pass N 4/22/2010 nili Pass URL is High "https://www.igt.connectingforhealth. nhs.uk/PQRTTest/UserControls/" with no document name Closed 4/22/2010 4/22/2010 nili nili Pass Pass It says "Guidance" for v8+ and "Details" for v7-...the wrong way round! Low Closed

2 3

4 5

1a

2 3 4 5

S153

View Widget Containing Table

General User

View a (v8+) widget with a table within the guidance text

Main

Add a table into a (v8+) widget using RATty using the RATML <table> format (as specified in LDM v5) Preview the widget in RATty in both HTML and PDF format Publish the widget to PQRT View the widget in PQRT in HTML format The table is displayed and the formatting is as per the RATty preview N 4/26/2010 Pass Bullet lists in tables (e.g. Reqt 101 in UAT): - less white space before, after and between each para - indent the bullets a bit Low Closed Need an example in test data.

2 3 4 5

6 7

View the widget in PQRT in PDF format The table is displayed and the formatting is as per the RATty preview Add a main heading into a (v8+) widget using RATty using the RATML <mh> format (as specified in LDM v5) Preview the widget in RATty in both HTML and PDF format Publish the widget to PQRT View the widget in PQRT in HTML format The main heading is displayed and the formatting is as per the RATty preview View the widget in PQRT in PDF format The main heading is displayed and the formatting is as per the RATty preview Add a hyperlink into a (v8+) widget using RATty using the RATML <a> format (as specified in LDM v5) Preview the widget in RATty in both HTML and PDF format Publish the widget to PQRT View the widget in PQRT in HTML format The hyperlink is displayed and the formatting is N as per the RATty preview View the widget in PQRT in PDF format The hyperlink is displayed and the formatting is N as per the RATty preview Request to view a Performance Progress Report (Multiple) 4/29/2010 Pass 4/29/2010 Pass N 4/26/2010 Pass N 4/26/2010 Pass N 4/26/2010 Pass

S154

View Widget Containing Main Heading

General User

View a (v8+) widget with a main heading within the guidance text

Main

2 3 4 5 6 7

S157

View Widget Containing Hyperlink

General User

View a (v8+) widget with a hyperlink within any RATML field

Main

2 3 4 5 6 7

S155

Incorporate Exemptions into Report Scores

General User

Have the system take exemptions into account when calculating overall % scores

Main

The total score calculation takes into account any exemptions that the widget has been granted on individual widgets (they are treated the same as "not relevant"

4/26/2010

nili

Pass

The total % score is also excluding High "not answered" widgets from the calc instead of treating them as Attainment Level 0 - the correct formula is being used on the Assessment Summary page so it might be worth trying to hook into the same code

Closed

3 4

Request to export to CSV The total score calculation takes into account any exemptions that the widget has been granted on individual widgets (they are treated the same as "not relevant" Request to view a Performance Progress Report (Individual) The total score calculation takes into account any exemptions that the widget has been granted on individual widgets (they are treated the same as "not relevant" N 4/26/2010 nili Pass N 4/26/2010 nili Pass

5 6

S156

Submit Assessment (Simplified Interface)

Org User

Submit my (v8+) assessment once I have entered a score for each widget

Main

2 3 4

I have an assessment where I have not got an "answer" for all widgets (an "answer" is an attainment level, NR or EX) Request to view the assessment summary page There is not an option to submit my assessment N Complete my assessment such that I have an "answer" for all requierements Request to view the assessment summary page There *is* an option to submit my assessment Request to submit my assessment The system submits my assessment as per current View a specific widget within the assessment The widget is "locked out" - all the fields are disabled read-only As an XYZ ABC user, request to unsubmit the assessment The system unsubmits my assessment as per current View a specific widget within the assessment The widget is no longer "locked out" - all the fields are disabled read-only N 4/26/2010 nili Pass N 4/26/2010 nili Pass N 4/26/2010 nili Pass N 4/26/2010 nili Pass N 4/26/2010 nili Pass 4/26/2010 nili Pass

5 6 7 8 10 11 12 13 14 15

S158

View Exemption in Widgets List

Org User

View the fact that I have Main been exempt from a widget in the widgets list

Log in as XYZ ABC

2 3

Locate a (v8+) assessment for any organisation Browse to a specific widget for which "not relevant" is *not* an option Mark the widget as exempt Save my changes The system updates the status of the widget response to "In Progress" Return to the Widgets List page The widget status is shown as "In Progress" The Attainment Level is shown as "Exempt" Log in as an org user for the amended organisation Go to the Widgets List page for the same assessment The widget status is shown as "In Progress" The Attainment Level is shown as "Exempt" Answer all other widgets at level 0 Go to the assessment summary page There is an option to submit a Baseline Request to view a (v8+) assessment for a specific organisation (one which has widgets owners set up) N N/A Pass N N N/A N/A Pass Pass N N N/A N/A Pass Pass N N/A Pass

4 5 6 7 8 9 10 11 12 13 14 15 16 S159 View Assessment as an XYZ ABC User XYZ ABC User View an organisation's Main assessment details as an XYZ ABC user, with the relevant fields visible but read-only 1

2 3

Request to view the details of a specific widget The attainment level tickboxes are visible and N correctly set, but disabled (greyed out to make it clear that this data is read-only to a ABC user) This includes the NR tickbox where appropriate N The attainment criteria tickboxes are visible and N correctly set, but disabled Attainment criterion comments are displayed N read-only The evidence details are visible but read-only N (including location and comments pop-ups) 4/29/2010 Pass

4 5 6 7

4/29/2010 4/29/2010 4/29/2010 4/29/2010

Pass Pass Pass Pass There is a pencil icon agains the Low comments column - I can't edit the comments but the icon shouldn't be there. Likewise action owner and there is also a calendar icon for the action date TH 16/6 as discussed, change back to a pencil icon but hide the pencil if the comments field is shorter than 30 chars Closed

8 9

There is *not* an option to add new evidence The action details are visible but read-only (including location and comments pop-ups) There is *not* an option to add an improvement action Request to view a (v8+) assessment for a specific organisation (one which has widgets owners set up)

N N

4/29/2010 4/29/2010

Pass Pass See defect above Low Closed

10

4/29/2010

Pass

S160

View Assessment as a General User

General User

View an organisation's Main assessment details as a General user, with the relevant fields visible but read-only

2 3

Request to view the details of a specific widget The attainment level tickboxes are visible and correctly set, but disabled (greyed out to make it clear that this data is read-only to a general user) N 4/29/2010 Fail NR tickbox shown but level 0-3 tickboxes not shown Low Raised

Pass 4 5 6 This includes the NR and EX tickboxes where N appropriate The attainment criteria tickboxes are visible and N correctly set, but disabled None of the detail below each attainment N criterion is displayed (and there is no expander because there is nothing to expand) - NOTE: if this is tricky to code we could look at simpler alternatives e.g. Display evidence list and evidence obtained but nothing else The past level is not shown (including the label) N The target level and date are not shown (including the labels) The widget complete and confirmed fields are not shown (including the labels) This story is an amendment to S160 N N 4/29/2010 N/A N/A Pass N/A N/A

Version 8 assessment (approved), org a.test:acute - got system error

High

Closed

Superseded by S165 Superseded by S165

7 8 9

4/29/2010 4/29/2010 4/29/2010

Pass Pass Pass

S165

View Assessment as a General User (Mark 2)

General User

View an organisation's Main assessment details as a General user, with the relevant fields visible but read-only

3 4

2 Request to view a (v8+) assessment for a specific organisation (one which has widgets owners set up) Request to view the details of a specific widget None of the detail below each attainment level is displayed (and there is no expander because there is nothing to expand) - NOTE: if this is tricky to code we could look at simpler alternatives e.g. Display evidence list and evidence obtained but nothing else This includes EX - a general user should not be able to view the reason for exemption N 4/29/2010 RJM Fail Attainment criteria are shown - there should be no expanders against the attainment levels Low Raised

4/29/2010

RJM

Fail

The data is not shown but the expander is there - remove it if the user is not entitled to see the details

Low

Raised

S161

Receive Dirty Flag Warning for Widget

Org User

Receive a warning if I attempt to leave the Widget Details page without saving my changes

Main

View a specific (v8+) widget within the context of an in-progress assessment

2 3 4 5 6 5a 1 2 3 1

Amend any data on the page Request to Cancel my edits The system asks me to confirm that it is OK to lose my changes Confirm The system displays the Widgets List page (without persisting my changes) Cancel the cancel (!) The system remains on the Widget Details page N My amendments remain in place Navigate to any other page by clicking a link on the page (e.g. Contact Us) Rejoin main flow at step 4 Navigate to any other page by explicitly typing a URL Rejoin main flow at step 4 From the home page (not logged in), indicate that I have forgotten my user details The system displays the "Forgotten User Details" page There is an option to receive a reminder of my user details by email, including an input field for my email address and a sub-option to have my password reset. Enter details and request a password reminder The system validates that there is a uniquely Y matching active account for the specified email address The system sends me a reminder email containing my org code and user ID (see prototype for wording) The email is from the standard "DONOTREPLY" PQRT email address The system validates that I requested a password reset The system resets my password The system sends me an email containing my new password (see prototype for wording) The email is from the standard "DONOTREPLY" PQRT email address The system tells me that it has sent me a reminder email If I requested a password reset, the system tells me it has reset my password and sent it in a separate email The system tells me how to log on (including a link to the home page) There is no matching active account for the specified email address Y 5/6/2010 nili Pass If I type my email address and hit "Enter", it doesn't fire the "Remind Me" button (the page refreshes but nothing else) Can you put in some blank lines to make the email easier to read e.g. After "Dear PQR App user" Medium Closed Y Y 5/6/2010 5/6/2010 nili nili Pass Pass N 4/29/2010 Pass N 4/29/2010 Pass N 4/29/2010 4/29/2010 Pass Pass N 4/29/2010 Pass N 4/29/2010 Pass

3a

3b

2 1 2

S103

Look & Feel - Forgotten User Details

General User

Get help with forgotten user details (org code, user ID, password)

Main

2 3

4 5

5/6/2010

nili

Pass

Low

Closed

7 8 9 10

Y Y Y Y

N/A 5/6/2010 5/6/2010 5/6/2010 nili nili nili

Pass Pass Pass Pass

Can you put in some blank lines to make the email easier to read e.g. After "Dear PQR App user"

Low

Closed

11 12 13

Y Y Y

N/A 5/6/2010 5/6/2010 nili nili

Pass Pass Pass

14 5a 1

5/6/2010

nili

Pass

The system tells me this and provides a link to the "contact us" page

5/6/2010

nili

Pass

Can you top justify the error test with the error icon (use <div class="infoMessage"> which sorts it for free and also gives you the icon

Low

Closed

5b

There are multiple matching active accounts for the specified email address The system tells me this and provides a link to the "contact us" page Y 5/6/2010 nili Pass Can you top justify the error test with the error icon (use <div class="infoMessage"> which sorts it for free and also gives you the icon Low Closed

8a

1 2 1

Password reset not requested Skip to Main Flow step 12 View the Widget Details page for a (v8+) widget Y 5/6/2010 nili Pass

S166

Widget Details Page Enhancements

General User

See various enhancements as suggested during Beta Test Phase 1

Main

2 3

The top-level sections are initiailly collapsed WITHDRAWN: When I move to a new widget the top levels are also initially collapsed (the system does not remember how I left them) The Attainment Levels section is after the Guidance section The tables within the KB section do not have a table heading which repeats the name on the tab (e.g. "Key Resources") The tables within the KB section do not have rounded corners (see prototype) If there are no widget changes to display, the system displays the text: "There are no material changes since the last major version of this widget." instead of just "There are no material changes." The attainment levels expand and collapse normally rather than in "accordion" style The attainment criteria expand and collapse normally rather than in "accordion" style

Y N

5/6/2010 N/A

RJM

done

Pass

4 5

Y Y

5/6/2010 5/6/2010

RJM RJM

done done

Pass Pass

6 7

Y N

5/6/2010 5/6/2010

RJM RJM

done done

Pass Pass

8 9

Y Y

5/6/2010 5/6/2010

RJM RJM

done done

Pass Pass

10

11

The attainment criterion ID for Level 3 Y Maintenance criteria is displayed instead of the word "Maint" For Level 3 maintenance criteria, the phrase Y "[Only required if Attainment Level 3 was achieved in the previous assessment]" appears above the criterion description instead of below The width of the attainment criterion ID div has Y narrowed (because its contents have narrowed, since e.g. "1a" is now just "a" and "Main" is now just e.g. "c") Specifically, style "attainmentCriterionNumber" is 53px wide instead of 56 and "attainmentCriterionDescription" is 586px wide instead of 583px There is a sentence below the Attainment Levels Y heading indicating that the attainment levels are cumulative There is a sentence within each attainment level Y (1-3) indicating that all criteria must be satisfied If evidence provision is mandatory for the Y current org type, the evidence heading reads "The following evidence must <strong>all</strong> be obtained:" (currently "<strong>Evidence Required:</strong>)

5/6/2010

RJM

TH: RJM says no change required

Pass

5/6/2010

RJM

done

Pass

12

5/6/2010

RJM

done

Pass

13

5/6/2010

RJM

done

Pass

14

5/6/2010

RJM

done

Pass

15

5/6/2010

RJM

done

Pass

When not logged in, the system displays a blank line followed by bullets

Medium

Closed

Pass

Pass

The bullets are too far indented Low relative to the new pre-bullet staement. On the prototype I have the bluuets less indented but an alternative would be to indent the prebullet statement if you think it looks better that way When not logged in, Can't get through High to the widget details page as there is no link from the widgets list page! (the "Action" column has disappeared! Text showing is "The following evidence must all be obtained" Medium

Closed

Closed

16

If evidence provision is optional for the current N org type, the evidence heading reads "The following evidence should <strong>all</strong> be obtained (recommended but not mandatory):" (currently "<strong>Evidence Required:</strong>) The context help next to "Evidence Required:" is Y no longer needed and can be removed. The Print and Download buttons appear at the bottom of the page as well as at the top The print button is labelled "Print (PDF) The tooltip for the print button is "View a printable (PDF) version of this widget" The Cancel button is always available, not just once changes have been made to the response The expander icon is used for the evidence location and evidence details pop-ups (instead of the "down arrow" icon) Y

5/6/2010

RJM

done

Pass

Closed

17

5/6/2010

RJM

done

Pass

18

5/6/2010

RJM

done

N/A

Superseded by later widget

19 20 21

Y Y Y

5/6/2010 5/6/2010 N/A

RJM RJM RJM

done done done

N/A Pass Pass

Superseded by later widget

22

5/24/2010

RJM

done

Pass

23

The key icon in the widget header panel (if Y present) has style "vertical-align:middle" which gives a good compromise between it poking out the top too much versus too big a gap between first and second line of text The "expand all/collapse all" icons are topaligned The "missing information" icon in the Location column, and in various places on the Evidence Location pop-up, is as per the prototype. The training tool boilerplate text (first para) says "The Information Governance Policy team within the Department of Health (DH) has developed an Information Governance Training Tool (PQRTT)." (defect) Section expanders aren't working! Glossary terms within attainment levels have dashed underlines (currently they are green but with no underline) The "expand all", "collapse all", "print" and "download" buttons are links (style/wording/position as per prototype). The tooltips are still in place for them. Note that the download button only appears for logged in users. View the Widget Details page for a (v8+) widget within the context of an assessment The attainment level tick boxes are not greyed Y out The attainment criterion tick boxes are not Y greyed out If I attempt to click on the "Current Level" field, N I get a (pop-up) warning saying, "You cannot enter the Current Level yourself. The system calculates it automatically based on the data you enter in the table above." If I attempt to mark an attainment criterion as N achieved (and evidence provision is mandatory), the message displayed is the same as the context help text i.e. "You cannot tick this box yourself. The system ticks it automatically once you have obtained all required evidence and either uploaded it or otherwise fully specified its location." If evidence provision is mandatory for the current org type, there is a sentence within each criterion indicating that all of the stated evidence items must be obtained Y Y Y

N/A

RJM

done

Pass

24 25

N/A 5/24/2010

RJM RJM

done done

Pass Pass

26

5/17/2010

RJM

done

Pass

27 28

N/A N/A

N/A N/A

RJM RJM

done done

Pass Pass

29

5/24/2010

Pass

The spacing around the bar separators Low is inconsistent - in some places you have double spaces and in others you have single spaces

Closed

1a

2 3 4

5/6/2010 5/6/2010 5/6/2010

RJM RJM RJM

done done done

Pass Pass Pass

5/6/2010

RJM

done

Pass

Text is still "You cannot directly mark Low an attainment criteria as achieved. Please use the criteria section to enter evidence for the criteria"

Closed

5/6/2010

RJM

done

Pass

If evidence provision is optional for the current N org type, there is a sentence within each criterion saying "The following evidence should <strong>all</strong> be obtained (recommended but not mandatory):"

5/6/2010

RJM

done

Pass

The sentence "It is not mandatory to enter details for the criteria but it is recommended" below the attainment level needs to be the same as for "evidence provision mandatory" i.e. "The following criteria must all be satisfied:"

Low

Closed

8 9

The evidence comments column is renamed as "Details" If the assessment is in progress and this is not the last widget, the "Next" button is yellow

Y Y

5/6/2010 5/11/2010

RJM RJM

done done

Pass Pass If I am looking at the widget not within Low the context of an assessment, there should be no yellow button (neither "Next" nor "Done") Closed

10

If the assessment is in progress and this *is* the N last widget, the "Done" button is yellow "Add Improvement Action" link - change to "Add an action" View the Widget Details page for a (v8+) widget within the context of an assessment, as a ABC user or as a user from another org The various tick boxes are read-only but not greyed out N Y

5/11/2010

RJM

done

Pass

11 1b 1

N/A

RJM

done

Pass

5/6/2010

RJM

done

Pass

If I click any of the tick boxes I do not get a warning message about not being able to tick the box If I click in the Current Level box I do not get a warning about not being able to enter the current level View the Widget Details page for a (v8+) widget within the context of an assessment

5/6/2010

RJM

done

Pass

5/6/2010

RJM

done

Pass

S183

Widget Details Page Callouts

Organisation User

See "help" callouts on the Main widget details page

When I first view the page, there is a callout (or Y other device) drawing my attention to the first expander explaining what it does e.g. "To see the details for each section, click on the expander icon:". The callout has an option to close and an option to "don't show me this again" When a glossary term is first visible, there is a Y callout (or other device) drawing my attention to the first glossary term explaining what it does e.g. "<p>To see a definition of this term, hover your mouse pointer over it.</p> <p>To view the Glossary in full, click on it.</p>". The callout has an option to close and an option to "don't show me this again"

5/6/2010

RJM

done

Pass

5/6/2010

RJM

done. Not possible to show on load becuase the terms are hidden in expandable divs.

N/A

When I first view the page, there is a callout (or Y other device) drawing my attention to the Attainment Levels section explaining what it does e.g. "Expand this section to enter or edit your answer to this widget.". The callout has an option to close and an option to "don't show me this again" When I mark an evidence item as obtained, and Y the evidence location is not fully specified, the system displays a red cross in the evidence location field (no change) and also displays a call-out to explain what the red cross means. The call-out includes a "close" option and a "don't show me this again" option

5/6/2010

RJM

done

Pass

5/6/2010

RJM

done

Pass

S167

Widget PDF Enhancements

General User

See various enhancements as suggested during Beta Test Phase 1

Main

View the PDF version of a (v8+) widget

The attainment criterion ID for Level 3 N Maintenance criteria is displayed instead of the word "Maint" For Level 3 maintenance criteria, the phrase N "[Only required if Attainment Level 3 was achieved in the previous assessment]" appears above the criterion description instead of below The width of the attainment criterion ID div has narrowed (because its contents have narrowed, since e.g. "1a" is now just "a" and "Main" is now just e.g. "C") Individual table cells within attainment levels are not split across a page Section headings are not split from the first paragraph below them Long tables split across multiple pages (currently expanding into the footer) The page footer is lower down, providing more space on the page Keep table header with at least the first table row Widget booklets - start each widget on a new odd page Check booklet footer to make sure version number and org type appearing Numbered paragraphs - first line correctly aligned Special characters (e.g. Left and right hand quotes) are correctly displayed in all fields Request to print a (v8+) widget N

5/6/2010

done

Pass

5/6/2010

done

Pass

CMC:Dont think it could have been putting this in at all as the XML was missing the maintenanceCriteria element

Closed

5/6/2010

done

Pass

5 6 7 8 9 10 11 12 13

N N N N N N Y Y N/A

5/6/2010 5/6/2010 5/6/2010 5/6/2010 5/6/2010 5/24/2010 N/A N/A N/A

done done done done done done done done done

Pass Pass Pass Pass Pass Pass Pass Pass Pass

S168

View Widget PDF Variants General User

Be able to select from three variants of the widget PDF

Main

The system displays a pop-up asking "Please select an option:" then three radio buttons: "Full widget", "Guidance only", "Attainment levels/checklist only". Select the "Full widget" option The system displays the full widget variant of the widget PDF Select the "Guidance only" option

5/6/2010

3 4 3a 1 2

5/6/2010

The system displays the "guidance only" variant N of the widget PDF (note, this may require some enhancements to the publish process) Select the "Attainment levels/checklist only" option The system displays the "attainment levels only" N variant of the widget PDF (note, this may require some enhancements to the publish process) View the "Contact Us" page

5/6/2010

3b

1 2

5/6/2010

S169

Contact Us Page Mark 2

General User

See various enhancements as suggested during Beta Test Phase 1

Main

Des

2 3

The wording of the "Contact Us by phone" Y section has changed (as per prototype) The headings "Contact us Online and Contact us Y by Phone" have a capital "U" for "Us" The label "Email me a Copy of my Enquiry" has a capital "E" on "Enquiry" The SLA text is as per the prototype The required field markers are a bit bigger (1.2em) and there is an explanation of what they mean at the bottom of the blue box (see prototype) There is an option to specify my Organisation Name (not mandatory, default blank) There is an option to specify my Organisation Code (not mandatory, default blank) If I am logged in, both the above fields are prepopulated Click Submit The email subject line says "PQR App", not "PQRT" and is suffixed with "query" The email includes the org name and org code specified Request to register an account N N Y Y Y

5/11/2010 5/11/2010

Des Des

Pass Pass

Wording doesn't match prototype

Low

Closed

Des 20/05 - Fixed

4 5 6

5/11/2010 5/24/2010 5/11/2010

Des Des Des

Pass Pass Pass

5/11/2010

Des

Pass

5/11/2010

Des

Pass

9 10 11 12

5/11/2010

Des Des Des Des

Pass

5/11/2010 5/11/2010

Pass Pass

S170

Registration Mark 2

General User

See various enhancements as suggested during Beta Test Phase 1

Main

2 3 4

6 7

The system displays Register Step 1 There is *not* a link through to the ODS Online Enquiries facility The last para says if I don't know the above information the contact us, with a link through to the Contact Us page There is a (gray) "Contact Us" button after the Next button which also goes to the Contact Us page The "Next" button is yellow Enter an org code for an org which already has an administrator The system displays Register Step 2 The "Next" button is yellow Click "Next"

Y Y Y

5/11/2010 5/6/2010 5/6/2010

Des Des Des

Pass Pass Pass

Des

Pass

Button should be gray not yellow

Low

Pass

Des 24/05 - Fixed

5/11/2010

Des

Pass

8 9 10 11 12

Y Y

5/11/2010 5/11/2010 5/11/2010 5/11/2010

Des Des Des Des

Pass Pass Pass Pass

13

The system displays Register Step 3 (see Y prototype "register_3b.html" The system tells me that it cannot provide Y contact details for the local admin for security reasons There is a (yellow) "Contact Us" button after the Y Next button which also goes to the Contact Us page Enter an unknown org code and click "Next" The system displays Register Step 2 The system tells me that it didn't recognise the org code (see prototype "register_2b.html") Y Y

5/11/2010

Des

Pass

6a

1 2 3

5/11/2010 5/11/2010

Des Des

Pass Pass

4 5

6b

6 1

The system gives me options to go back or Y contact us (hyperlink to Contact Us page) There is a (yellow) "Contact Us" button after the Y Next button which also goes to the Contact Us page There is no "Next" button Y Enter org name keywords which won't generate a unique match and click "Next" The system displays Register Step 2 The system tells me that it couldn't find a uniquely matching organisation (see prototype "register_2c.html") The system gives me options to go back or contact us (hyperlink to Contact Us page) There is a (yellow) "Contact Us" button after the Next button which also goes to the Contact Us page There is no "Next" button Leave both fields blank and click "next" Y Y

5/11/2010 5/11/2010

Des Des

Pass Pass

5/11/2010

Des

Pass

5/11/2010 5/11/2010

Des Des

Pass Pass

Y Y

5/11/2010 5/11/2010

Des Des

Pass Pass

5/11/2010

Des

Pass

6c

The system displays a validation error telling me N I must enter one or the other View the home page (not logged in)

5/11/2010

Des

Pass

S171

Home Page Mark 2

General User

See various enhancements as suggested during Beta Test Phase 1

Main

Des

2 3

The log in button is yellow Y The "Register Now" button is labelled "Register" Y (less emphasis on ability to do it right now) The register button is yellow Y The context help icon for "Organisation Code" is Y just one space away from the field (currently there is a gap which is taken up by a hidden mandaotry field marker but there is another defect elsewhere to get rid of this) Log in The "At a Glance" section includes a "User Details" table containing the followiong data: Y

5/11/2010 5/11/2010

Des Des

Pass Pass

4 5

5/11/2010 N/A

Des Des

Pass Pass

6 7

5/11/2010

Des Des

Pass

Styling as per prototype please - it is Low OK to use table tags to present this data because it really *is* a table of data - no need to convert to dvis (table class="assessmentSummaryData")

Closed

Des 26/05: Fixed

8 9 10 11 12

- user name - organisation name - user email address - user phone number - last log in

Y Y Y Y Y

5/11/2010 5/11/2010 5/11/2010 5/11/2010 5/11/2010

Des Des Des Des

Pass Pass Pass Pass Pass

12

Below the table there is an option to update my Y user details (links through to the "update user details" page

5/11/2010

Des

Pass

If I have never logged in before, display "(first log in)" instead of leaving it blank This link is a "shortcut" to Admin/My Details, so (a) the Nav Bar should be highlighted on "Admin" and (b) the breadcrumb should show "Admin -> My Details"

Low

Closed

Des 26/05: Fixed

Low

Closed

TH 7/6 failed re-test Des 07/06: Latest version might not have been in the test

13

The user details panel (in the nav bar) does not include my email address and phone number The user details panel (in the nav bar) does not include an option to update my user details The "At a Glance" section includes a "Current Assessment" table containing the followiong data:

5/11/2010

Des

Pass

14

5/11/2010

Des

Pass

15

5/11/2010

Des

Pass

Styling as per prototype please - it is Low OK to use table tags to present this data because it really *is* a table of data - no need to convert to dvis (table class="assessmentSummaryData") Current Assessment section (including Medium out of date warning) should not appear for a non-assessing org type e.g. XYZ ABC Logged in as REM, whose latest High assessment is v7. Version was showing as v8 (whereas status was correctly showing as "Updated"). If I go to the Asessments page it correctly shows v7 as the most recent.

Closed

Des 26/05: Fixed

Pass

Closed

16

- Version

5/11/2010

Des

Pass

Closed

CMC:Fixed

17 18 19

- Status - Next deadline Below the table there is a (yellow) button labelled "Go To The Assessments Page" which links through to the assessment summary page

Y Y Y

5/11/2010 5/11/2010 5/11/2010

Des Des Des

Pass Pass Pass

"Assessments" should be plural

Low

Closed

Des 26/05: Fixed

Pass

20

If this is not the latest version of my assessment, the system tells me (no functional change but see prototype for new wording) The "New Users..." section is at the top, above the "At a Glance..." section This story extends/alters S073

N/A

Des

Pass

Nav bar should highlight Medium "Assessments" and breadcrumb should show "Assessments" (i.e. It should be the same as if you clicked the "Assessments" option on the nav bar As well as the correct text showing on High the RHS of "At a Glance", the old version of the text is also showing on the LHS

Closed

TH 7/6 failed re-test Des 07/06: Latest version might not have been in the test

Closed

Des 26/05: Fixed

21

5/24/2010

Des

Pass

S173

Assessment Summary Mark 2

Organisation User

See various enhancements as suggested during Beta Test Phase 1

Main

2 3

Request to view a summary of my current and previous assessments The system displays a list of all my assessments Y (there will always be at least one assessment) The assessments are ordered by creation date (i.e. Primary key), most recent first Y 5/11/2010 CMC Pass Missing full stop at end of introductionary para "This page gives you..." Low Closed

5/11/2010

CMC

Pass

5 6 7 8

The system validates that I am *not* using the Y "simplified interface" For each assessment, the system does the following: The system validates that the assessment is not Y yet approved If the assessment is not the latest version of my Y assessment, the system warns me that it is out of date (see prototype for new wording) The system displays the following "headline" information: - Assessment Ref - Status - Next Deadline (unless already submitted) The system displays the following "widget status" information: - No. of reqts "not answered" (aka not started) - No. of reqts "answered" (aka in progress" - No. of reqts marked complete - No. of reqts confirmed complete The above figures include reqts marked NR or EX The system displays the following "score" information: - Current score - Target score (only if I have set any target scores)

5/11/2010

CMC

Pass

5/11/2010 5/11/2010

CMC CMC

Pass Pass

9 10 11 12 13 14 15 16 17 18 19 20 21

Y Y Y

5/11/2010 5/11/2010 5/11/2010

CMC CMC CMC

Pass Pass Pass

Y Y Y Y N/A

5/11/2010 5/11/2010 5/11/2010 5/11/2010 5/11/2010

CMC CMC CMC CMC CMC

Pass Pass Pass Pass Pass

Y Y

5/11/2010 5/11/2010

CMC CMC

Pass Pass

Showing a target score of 0%. I have Medium not set any target scores so the system should not show this table row I set target levels of <blank>, 2 and 3. Medium The <blank> should be treated as 0 to give a target score of (2+3+0)/(3*3) = 55% However, the <blank> is being ignored to give a target score of (2+3)/(3*2)=87%

Closed

Pass

Closed

22 23

24

25

26 27

- Current grade (in v8 or v7 notation as appropriate) - Target grade (in v8 or v7 notation as appropriate) (only if I have set any target scores) Current and target grade are colour-coded RAGRed, RAGAmber or RAGGreen as appropriate There is context help for current/target score and current/target grade (keys as per prototype) Ther context help for current/target grade relates to v8 or v7 notation as appropriate There is an option to view the assessment status history (no change)

Y Y

5/11/2010 5/11/2010

CMC CMC

Pass Pass Widgets not answered should be treated as level 0 for the purposes of determining the grade Medium Closed

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

Some context help not showing - need Medium latest version of context help file installing

Closed

RJM

Y Y

5/11/2010 5/11/2010

CMC CMC

Pass Pass Pass Status history pop-up doesn't work change "View History" link to "view history" (i.e. No caps) High Low Closed Closed RJM

28

29

30

31

32

The system validates that the assessment is not yet "locked down" (confirmed for nonsimplified interface or submitted for simplified interface) There is an option to "Work On This Assessment" (button) which links through to the Widgets List page. This is instead of the "View widgets" link but only if the assessment is in progress The "Work On This Assessment" button is yellow unless another button is yellow (see below), otherwise it is gray If I am in a position to perform a baseline or PU (and I have the relevant permissions), and the current date is within 7 calendar days of the baseline or PU deadline (or after) then the relevant submission button (baseline, PU) is yellow If I am in a position to perform a confirm or final submission then the relevant submission button (confirm, submit) is yellow If present, the "Performance Update" button is labelled "Submit Performance Update" If present, the "Baseline" button is labelled "Submit Baseline" I am using the simplified interface Proceed as per main flow except: - don't display reqts marked complete - don't display reqts confirmed complete The system is already approved Proceed as per main flow except: - don't display Next Deadline - don't display "widget status" information The assessment is "locked down"

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

33

5/11/2010

CMC

Pass

34 5a 1 2 3 4 1 2 3 4 1

5/11/2010

CMC

Pass

N N

5/11/2010 5/11/2010

CMC CMC

Pass Pass

7a

N N

5/11/2010 5/11/2010

CMC CMC

Pass Pass

28a

2 3 2a 1 2 3 View thw assessment summary as an XYZ ABC user

Proceed as per main flow except: - the system displays "view details" instead of "Work on This Assessment"

5/11/2010

CMC

Pass

Proceed as per main flow except: - the system displays "view details" instead of "Work on This Assessment" (regardless of assessment status) The available "state change" buttons are appropriate for an XYZ ABC user

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

I am unable to unapprove the assessment once approved (don't need to fix for beta test phase 2)

High

Closed

TH 16/6 CMC says he fixed this yesterday

If the Approve button is present then it is yellow N

5/11/2010

CMC

Pass

S174

Greyed Out Submit Buttons

Organisation User

See greyed out submit buttons on the Assessment Summary page

Main

Request to view my assessment summary

The system validates that I have an in-progress assessment that hasn't yet been submitted The system validates that the next stage for my assessment is a baseline but that it is not yet ready for a baseline (because not all widgets answereed) The system validates that I have the necessary permissions to perform a baseline

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

5 6

3a

The system displays the "Submit Baseline" Y button but it is disabled The tooltip on the "Submit Baseline" button Y says "You cannot submit a baseline until all widgets have been answered" The system validates that the next stage for my N assessment is confirmation but that it is not yet ready for confirmation (because not all widgets confirmed complete) The system validates that I have the necessary permissions to perform a confirm The system displays the "Confirm" button but it is disabled The tooltip on the "Confirm" button says "You cannot confirm this assessment until all individual widgets have been confirmed complete" The system validates that the next stage for my assessment is final submission but that it is not yet ready for submission (because not all widgets answered) The system validates that I have the necessary permissions to submit The system displays the "Submit" button but it is disabled The tooltip on the "Submit" button says "You cannot submit this assessment until all widgets have been answered" Request to view the widgets list for my own in-progress assessment N

5/11/2010 5/11/2010

CMC CMC

Pass Pass

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

3 4

N N

5/11/2010 5/11/2010

CMC CMC

Pass Pass

3b

5/11/2010

CMC

Pass

2 3 4

N N N

5/11/2010 5/11/2010 5/11/2010

CMC CMC CMC

Pass Pass Pass

S175

Widgets List Mark 2

Organisation User

See various enhancements as suggested during Beta Test Phase 1

Main

2 3

The system displays the "Widgets List" page The page title is: h1: "Version <version> (<start year>-<end year>) Assessment" h2: "Widgets List" The table headings and look and feel of the page and table are as per the prototype ("widgets_list_acute_logged_in.html")

Y Y

5/11/2010 5/11/2010

RJM RJM

done done

Pass Pass

5/11/2010

RJM

done

Pass

Table shouldn't have thick blue border Low

Closed

Pass

Req numbers should be larger, bold, black Table text should be black Initiative headnings should be black Remove nbsp from "Req No" table heading so column can be narrower

Low

Closed

Font size still too small - see prototype for appropriate style "widgetNumber"

Pass Pass Pass

Low Low Low

Closed Closed Closed

Pass

Pass

Although gramatically correct, can you Low remove the "." from "Req." in "Req. No" and "Key Req." column headings please Remove nbsp from "Attainment Level" Low table heading so column can be narrower

Closed

Closed

The PQRAF pass/fail icons in the "Attainment Y Level" column are top-aligned. To do this, insert style="vertical-align:top;" within the <img> tag. The widget status for a "not started" widget is Y displayed as "Not Answered" (yes, it's a u-turn!) The widget status for an "in progress" widget is Y displayed as "Answered" (yes, it's a u-turn!) The widget descriptions are *not* clickable For each widget there is a button (in a separate column) which links through to the widget details page If the widget is "not answered" then the button label is "Answer" If the widget is "not answered" then the button label is "Edit" If there are any widgets that are "not answered", the button for the topmost one is coloured yellow There is an option "Back To Assessments page" (button) - links back to the Assessments page Y Y

5/24/2010

RJM

done

Pass

5/11/2010

RJM

done

Pass

5/11/2010

RJM

done

Pass

7 8

5/11/2010 5/11/2010

RJM RJM

done done

Pass Pass

9 10 11

Y Y Y

5/24/2010 5/24/2010 5/11/2010

RJM RJM RJM

done done done

Pass Pass Pass

12

5/24/2010

RJM

done

Pass

13

14

If the assessment is "ready to advance" i.e. If N the "next stage" button on the Assessment Syummary page would be displayed in yellow then the "Back To Assessments Page" button is yellow If I am in a position to perform a final N submission, and I am using the simplified interface, there is *not* an option to submit the assessment from this page (rather, I need to return to the Assessment Summary page) The links "Printable version", "Downloads and booklets" and "Assign widget owners" (if available to the current user) are positioned on a single line as per prototype. Request to view a printable version of the page The system displays the printable version (no change) The page title is as per the non-printable version of the page Request to view the widgets list for my own "confirmed" (i.e. Not in progress) assessment As per main flow except: The widget details button labels are all "View" Y

5/24/2010

done

Pass

This button should only be yellow if the assessment is "ready to advance" (check with Chris for rules). If not, all buttons should be gray (which I admit is not perfect)

Medium

Closed

5/24/2010

RJM

done

Pass

15

5/24/2010

RJM

done

Pass

15 16

5/27/2010

RJM

done

Pass

17 1a 1

5/27/2010

RJM

done

Pass

The printable version includes an empty Action column - can you remove it? Showing as "Matching Widgets"

Low

Closed

Medium

Closed

2 3

5/24/2010

RJM

done

Pass

Note the buttons are changed to "View" once each req't is marked complete which is OK

1b

Request to view the widgets list for another organisation's assessment (including XYZ ABC user) As per main flow except: The widget details button labels are all "View" Request to view the widgets list for a given org type (i.e. Not within the context of an assessment) As per main flow (where applicable outside of an assessment) except: The page title is: h1: "Acute Trust Version <version> (<start year><end year>)" h2: "Widgets List" The table headings and look and feel of the page and table are as per the prototype ("widgets_list_acute.html") View any page N 5/24/2010 RJM done Pass

2 3 1c 1

2 3

5/27/2010

RJM

done

Pass

Currently says "Acute Assessment"

Medium

Closed

5/27/2010

RJM

done

Pass

S172

Look and Feel Mark 3

General User

Experience a yet further enhanced look and feel

Main

2 3

All pages have <h1> headings (some currently have no headings) All buttons are styled as per prototype (unless otherwise stated in a specific story, all buttons are gray, not yellow). If there are any yellow buttons in the page, the first yellow button is the default button.

N Y

N/A 5/11/2010

Des 22/06: Implemented done

Pass Pass

6/24/2010

Des 25/06: Implemented

Pass

The Nav Bar options have (standard) tooltips as Y per the prototype (index.html and index_logged_in.html)

5/11/2010

Des 22/06: Implemented

Pass

All font sizes are relative, to allow users the Y option to change the font size via their browser

N/A

Pass

What's New article headers seem to be fixed size

Low

Closed

current 1.1em for <h3> and 0.9em for <p> TH 25/6 - need to update #mainContent.h3 to 1.1em too

7 8

9 10 11

12 13

14

All alert boxes are yellow instead of pink Hyperlinks within the breadcrumb are underlined by default and the underline disappears on hover The logos in the header bar have sharper definition (see prototype) The title in the header bar matches the font for the rest of the site There are various stylesheet changes (Tony to provide updated versions of master.css and igt.widgets.css) When a modal pop-up is displayed, the main page fades to dark, not to white On all modal pop-ups, the background colour for the button bar is the same as for the rest of the pop-up The blue colour below the nav bar and around the bottom of the page is a little lighter

Y Y

5/11/2010 6/24/2010

done Medium

Pass Pass

No underlines - CSS problem I suspect

Low

Closed

Y Y Y

6/24/2010 6/24/2010 N/A

done done

Pass Pass Pass

N N

N/A N/A

Des 23/06: Implemented Des 23/06: Implemented

Pass Pass

5/11/2010

Pass

15 16 17

All context help icons are top-aligned Y The context help icons (normal and alternate) Y are as per the prototype All errors and warnings use the "info" icon as Y per the prototype with the text to the right of it (<div class="infoMessage"> includes the image automatically as a background - see prototype "assessments.html" for an example of use)

N/A N/A

done Des 22/06: Implemented

Pass Pass Fail Home page - log in validation failure doesn't have a "!" icon Low Fixed

18 19

The PQRAF pass/fail icons are as per the Y prototype Context help HTML formatting - see Register N Step 1/Organisation Code - there needs to be less space between paragraphs and the text for bullet points needs to remain indented on the second line Transparent PNGs don't work in IE6 - keep them N as PNGs but use a workaround (see google for details!) ISO/IEC page - make main title an <h1> tag N

done N/A N/A done

Pass Pass Text for a bullet point which goes onto Low a second line could be better indented Closed Des 23/06: Fixed

20

N/A

N/A

High

Pass

Closed

Des 23/06: Could not find any issue. Need specific instances. Des 23/06: Fixed

21

N/A

N/A

Des 22/06: Implemented

Pass

Remove the <h3> tag starting "BSI ISO/IEC" which is immediately below the <h1> tag

Low

Closed

22

On the Create Organisation page change "National Code" to "Organisation Code" What's New - in IE6 the separator bar is about 10 px deep. Note there is a related defect to format as per prototype somewhere

N/A

N/A

Des 22/06: Implemented

Pass

23

N/A

N/A

Pass

24

All field sets use <table class="dataLayout"> for Y layout. Two reasons: (1) the label widths adjust automatically, (2) the formatting is more consistent when I change the browser text size See index.html for example

N/A

N/A

done

Pass

Registration Step 1 - can you explicitly Low set the width of the first column in both tables to the same so that they line up (see prototype for markup)

Closed

Pass

Registration Step 6 - can you explicitly Low set the width of the first column in both tables to the same so that they line up (see prototype for markup) You've added tables but not set the class "dataLayout" (you will also need to copy the relevant styles from master_delta.css") Medium

Closed

Pass

Closed

S176

Auto Create Assessment

Organisation User

Have the user auto create Main a new assessment for me instead of having to create it myself

Log in

The system validates that my organisation is in N a position to start a new assessment i.e. I do not already have an assessment for the latest widget version and I do not have an incomplete previous assessment The system automatically creates an N assessment for me. Note that this already happens for the simplified interface, so this is only a change for non-simplified interface

5/11/2010

CMC

Pass

5/11/2010

CMC

Pass

Working as a.test:acute2: Medium - deleted v99 assessment manually via database (since you can no longer delete via the front end) - unapproved v7 assessment (manually via DB since "Unapprove" button not available on Ass Summ screen defect) - cycled v7 assessment through various statre changes, finally ending up at "approved" again - Logged out and logged in - System showing v7 assessment but hasn't created v99 assessment

Closed

CMC:This was a problem with the test data set up in that you had 2 different versions (Acute Test V7 and V99) which had the same start/end dates. This would never happen in real life and so have changed the test data to make it reflect how it would be in real life (V7 being set to have data reange of a year before V99) and all works ok. TH 16/6 didn't retest since only test data

1a

1 2 3

Log in Request to view my assessment The system validates that I am in a position to delete the current assessment (no change) The system provides an option to "Reset" the assessment (previously "Delete" Request to delete the assessment The system deletes the assessment (no change) N The system automatically creates a new assessment of the same version (as per autocreate above) View the help page N 5/24/2010 5/24/2010 CMC CMC Pass Pass N 5/24/2010 CMC Not Tested Not tested since no change fron current

4 5 6 7

5/24/2010

CMC

Pass

S085

View Quick Start Guide

General User

Get up to speed with using PQRT as quickly as possible

Main

2 3 4 Request to view the quick start guide

There is an option to view the quick start guide

5/24/2010

RJM

done

Pass

The system displays the quick start guide page (in a new window) The page content is as per the prototype (including images) There is an option to print the page (selecting this triggers the print dialog) View the home page (not logged in) There is an option to view the quick start guide (within the "New Users" panel) - see prototype for "stronger" wording Request to view the quick start guide The system displays the quick start guide page (in a new window) Log in There is an option to view the quick start guide (within the "New Users" panel) - see prototype for "stronger" wording Request to view the quick start guide The system displays the quick start guide page (in a new window) Performance Progress Report - when logged in as XYZ ABC and viewing the PPR of another organisation, the report shows the XYZ ABC admin, whereas it should show the reported org admin Admin page - typo on "User Admin" line Resources page - make Downloads the topmost link (only if avialable to user) PPR report (individual) - needs gaps between the 3 tables (currently merged together) ABC org admin page - make sure hyperlinks are on separate lines (or separated by a bar character) The alert box on the Home Page says "PQRT Version 8 Beta Test", and there are two links one to the "Trust Phase 2 test script" and one to "XYZ test script". Assessment report org chooser - change table heading "National Code" to "Organisation Code" Knowledge base page - include file type and size after filename for internal files (as per widget details page) Reports page: improvement plan and evidence report to appear after PPR

5/24/2010

RJM

done

Pass

I'm pretty sure the help topic HTML files should not be in the knowledgebasenew folder

Low

Closed

CMC/RJM

5 6 1a 1 2

Y Y

5/24/2010 5/24/2010

RJM RJM

done done

Pass Pass

5/24/2010

RJM

done

Pass

3 4 1b 1 2

5/24/2010

RJM

done

Pass

5/24/2010

RJM

done

Pass

3 4

5/24/2010

RJM

done

Pass

S181

Odds and Ends 3

General User

See a range of random Main and unrelated point improvements across the site

N/A

N/A

CMC

Done

Pass

3 4 5

N N N

N/A N/A N/A

N/A N/A N/A

CMC CMC CMC

Done Done Done

Pass Pass Pass

N/A

N/A

CMC

Done

Pass

N/A

N/A

CMC

Done

Pass

10

N/A

N/A

CMC

Done

Pass

11

N/A

N/A

CMC

Done

Pass

14

N/A

N/A

CMC

16

17

Assessment Summary page - in Google Chrome the button bar sticks out of the bottom of the blue <div>. OK in prototype. Publish process - the text "[DRAFT] is prefixed to the Question Text field". This is to support beta test phase 2 and will need to be removed for go-live (so make it configurable if you like) glossary.pdf, contextHelp.xml and contextHelp.xsd should probably *not* be published to the folder KnowledgeBaseNew (which is supposed to be for knowledge base docs)

N/A

N/A

Done. CMC:Also fixed security hole Pass with Improvement plan report whereby querystring params could be spoofed to view another organisations report Done Pass

N/A

N/A

Done

Pass

18

N/A

N/A

CMC

CMC:Very much agree, Done

Pass

S184

Add Improvement Action Usability

Organisation User

Be able to add improvement actions more easily, with less reliance on pop-ups

Main

View an in-progress (v8+) widget within the context of an in-progress assessment Request to add an action against a given attainment criterion The system provides the option to add details for the action The method of input is easier to use than current in that it does *not* involve using multiple individual pop-ups for each data field. But at the same time the page is not littered with white input fields on a yellow background (looks too untidy/cluttered). One option would be to have a single pop-up that takes input for all three fields (Action, Owner, Due Date). An alternative would be to dynamically insert input fields into the yellow table if the user clicks "edit". N N 5/27/2010 5/27/2010 RJM RJM done done Pass Pass Can you make the cursor focus in the "action" field when I click "add an action" Low Closed

2 3 4

Pass

Can you change the Evidence Location Low and Evidence Description "plus" icons to "pencil" (edit) icons (and the minus icon to "tick" icons)

Closed

5 6 2a 1 2 3 Request to edit an existing action

It is still possible to enter a date by typing N rather than only via the calendar selector It is still possible to mark the action as complete N without going via a pop-up The system provides the option to edit details for the action As per "add", the method of input is easier to use than current. If my email address is too long (e.g. marie.greenfield@dh.dsi.gov.uk) then in IE7 it extends past the RHS of the "user info" box. In IE6 it causes the user info box to widen and forces the main panel down below the nav bar N N

5/27/2010 5/27/2010

RJM RJM

done done

Pass Pass

5/27/2010 5/27/2010

RJM RJM

done done

Pass Pass

S185

Miscellaneous Defects

Developer

Left over defects not yet fixed

Main

N/A

N/A

THMA

Medium

Pass

RJM

Widget Details page (Req 202), IE6: scroll down N so that para 1 is near the top of the screen. Float over "National Information Governance Board for Health and Social Care" (para 5), which should be near the bottom and then float over "Caldicott Guardians" (para 6). The tooltip appears near the top of the screen instead of next to the text. If the widget is *not* a key widget, the "Key Widget" box in the header panel should *not* be coloured in yellow In IE6, req't 210 (not logged in), the main content panel is displayed below the nav bar instead of to the right of it. Other reqts are OK and 210 in context of assessment is OK too. Resources page - ISO/IEC link - mis-spelling of "access" (IE6) Contact Us page - Organisation Type context help pop-up appears behind the Subject drop-down field On the widget details page, if I change the target date, the save button is not enabled Widgets list screen, for older assessments (or maybe current ones as well) if a widget has comments entered against it then the row shading on the new View button on the right hand side goes wrong. Specifically it doesnt look as if its allowing for the extra row(s) for the comments. If you log in as CfH go to the Assessments option and pick an organisation to view their assessments (e.g. REM). Drill down into the View Details link to get the widgets list. If you now click the Back To Assessments Page its lost the details of what organisation was being viewed. On widgets details page had a problem that when logged on as CfH user if set a widget to Exempt and click Next or Prev button to save it, it doesnt get saved. Widgets List page - if I am working on an assessment and there is a widget marked Not Relevant or Exempt, the button says "View" instead of "Edit" As a.test:gp, completed all widgets then submitted assessment. Went back to Req Details page and the attainment level and attainment criteria tickboxes were still enabled (although there was correctly no save button) N/A

N/A

N/A

Low

Pass

IE6 fix: Keep your eyes closed then you wont notice. No widget 202. Not sufficient information on conditions to recreate problem.

N/A

N/A

Low

Pass

RJM

N/A

N/A

N/A

Medium

Pass

Withdraw RJM: NOT FOUND: Req 210 does not exist n in test data so unable to test or verify it. TH 14/06: req 210 was in UAT but no longer there so cannot recreate

6 7

N/A N/A

N/A N/A

N/A N/A

Medium Low

Pass Pass RJM: problem with z-index on IE6. Placed jQuery bgiframe plugin onto master page to overcome it RJM RJM

8 10

N/A N/A

N/A N/A

N/A N/A

Medium Medium

Pass Pass

11

N/A

N/A

N/A

Medium

Pass

RJM:Not found

12

N/A

N/A

N/A

Medium

Pass

RJM

13

N/A

N/A

N/A

Low

Pass

RJM

14

N/A

N/A

N/A

High

Pass

The checkboxes are disabled but I get Low the "you can't tick this yourself" warnings whereas in this case they are *really* disabled because the assessment is submitted so the warning is not appropriate

Closed

By implementation of s208

15 16 17

PQRAF statement hidden behind nav bar in IE6 Javascript error when trying to define new info mapping report (see CC for details) On UAT site, created a new user "test" under org "RVV" with just user permissions. Attempted to edit user and got a server error. Other (existing) users can be edited OK. Assessments page very slow to load, especially for orgs with a full assessment history going back to v1 Widgets List page very slow to load, especially for orgs with a full assessment history going back to v1 About page - "HS" should be "XYZ" in UAT, v8 baseline deadline is showing as 31 July - I think it should be 31 Oct 2010 in UAT, with full widget set, the Improvement Plan Report pop-up very slow to load (probably slower due to having full reqt set) In UAT: Not logged in, select Reports/Assessment Report. Search for KMH123, click "Report" and get a system error. Other orgs are OK. KMH123 is a test org created by Kim Hobday In UAT, Contact Us page, not logged in, fill in contact form and submit - Org Name, Org Code not being included on email Improvement Plan report - Incomplete Items Only - widget was not yet answered and target not set - and it wasn't included in the report - I would expect it to assume current level 0 and target level 3 and thus show all criteria in levels 1, 2 and 3 (subject to rules on Level 3 Maintenance) Improvement Plan report pop-up - context help icon image filenames are wrong - is this because PNGs have changed to GIFs?

N N N

N/A N/A N/A

N/A N/A N/A

High High High

Pass Pass Pass Closed

RJM RJM

18

N/A

N/A

High

Pass

Closed

19

N/A

N/A

High

Pass

20 21 22

N N N/A

N/A N/A N/A

N/A N/A N/A

Low High Withdrawn - couldn't re-create

Pass Pass N/A

Re-test in UAT once re-deployed

Closed

RJM CMC

23

N/A

N/A

N/A

Fixed

Pass

25

N/A

N/A

N/A

Medium

Pass

Des 16/06: Fixed

26

N/A

N/A

N/A

Medium EP - This seems to have rectified itself. Perhaps with a subsequent fix for another defect.

Pass

27

N/A

N/A

N/A

Medium

Pass

28

29

Org a.test:sc - answered all widgets then went N/A to Req List page. It displayed the "submit now" panel which was supposed to have been removed. In IE6 it is possible to tick attainment criteria N/A (for an acute org) - details from Ellie or Richard Create new user as an Org Admin (Acute, XYZ or N/A any other type) - the system should only present the "General New User" email template, and not the "PQRScO Applicant" email template Req Details page - system error when clicking N/A "Next" (intermittant) - screenshot of error message sent to RJM on 10/06/2010 Evidence Location pop-up - if I specify "Local N/A File" and select a file and then do the same again (same file) against another evidence item, the filename won't populate. If I click Save on the Req Details page and then try again it works. Quick Start Guide - missing word: "The PQR App N/A has been designed to be used..."

N/A

N/A

Medium

Pass

RJM

N/A

N/A

High

Pass

RJM

30

N/A

N/A

Low

Pass

CMC

31

N/A

N/A

High

Pass

Withdraw Not found n TH 22/6 - can't re-create

32

N/A

N/A

High

Pass

RJM

33

N/A

N/A

Low

Pass

RJM

34

Evidence upload: uploaded Word doc then clicked "View" - got MS Word pop-up message "Word cannot start the converter mswrd32.wpc". IE7. Originally raised by Kim Hobday (2nd line, Exeter) if you need a demo!

N/A

N/A

N/A

Medium

Pass

35

36

Improvement Plan Report - if no records, you get the message "There aren't any record to generate..." Record should be plural i.e. Records. About page: Change the sentence Organisations are required to carry out selfassessments of their compliance against the PQR widgets. To The organisations described below are required to carry out selfassessments of their compliance against the PQR widgets.

N/A

N/A

N/A

Low

Pass

Withdraw RJM: Not a defect. It is a feature of IE6/7. n They need to ask their own tech support to fix the issue with Word/IE6/7. The problem occurs with .docx files - ie the new word 2007 format. If you just click OK, OK, OK... the file will display. This message can appear if: The converter was not properly registered. The converter was inadvertently deleted without removing the registry information. The converter support files are corrupt. The converter installation was removed and the uninstall tool did not finish clearing the registry settings. The hard disk is damaged where the converter files were stored. Usually, reinstalling the converter will overcome this problem. If the converter reports that it is already installed, first uninstall it so that the setup program can remove the files and registry settings. If removing and reinstalling the converter is not successful, there may be a problem with a resource on the computer (for example, an executable file that is needed to properly register the converters on the RJM

N/A

N/A

N/A

Low

Pass

Closed

Not found TH 22/6 - Last sentence in para under heading "What is the PQR App?"

37

38

About page: Change hyperlink text Guidance N/A about Compliance: Essential standards of quality and safety to Essential standards of quality and safety IE6, one of the beta testers: Assessment report - N/A when click "Show report" I get the XLS file displayed as raw text in the browser window (email sent to CC/RJM on 11/6) Beta tester: Evidence location pop-up: N/A Uploaded a file, the changed the drop down back to [select]. Then clicked "View" and got an error saying "Unable to find the specified file. It may have been removed form the Server"! Improvement Plan Admin: Only widget owners that have started the widgets are listed. Need this changed to those that are not answered as well Req List/Req Details - click yellow "Answer" button and get system error "Invalid postback or callback argument" (full error sent in email to RJM/CC on 11/6) Assessment Report in UAT - org code RDE, compare with v1, not showing result for v2 assessment even though it is displayed on Assessment Summary page HTML markup within the Evidence Required field of the yellow evidence table is being displayed raw e.g. "<strong>Blah blah blah</strong>"(example req 203 criterion 2a) N/A

N/A

N/A

Low

Pass

RJM

N/A

N/A

High

Pass

CMC

39

N/A

N/A

Medium

Pass

RJM

40

N/A

N/A

High

Pass

Des 15/06: Fixed

41

N/A

N/A

N/A

High

Pass

RJM

42

N/A

N/A

N/A

High

Pass

CMC

43

N/A

N/A

N/A

Low

Pass

RJM

44

46

Req List page, logged in as nhscfh - viewing assessments for org a.test:acute, the "Back to Assessments Page" button takes me the assessments page but with no assessment data showing As a CTP, when I have answered all req'ts I am still getting the Submit panel on the Req List page. This needs to go.

N/A

N/A

N/A

Low

Pass

RJM

N/A

N/A

N/A

Medium

Pass

Closed

RJM: this was discussed and agreed that it would stay for Simplified Interface User's. However, the submit panel has now been completely removed for all users as per this new request that overrides the agreed way of doing it. CMC

47

Logged into UAT as nhscfh user (elpe) and I go N/A to the admin area and search for org RXL. I click to view users and then on edit next to the first user pabu. I get an error: Conversion failed when converting the varchar value 'tohe1' to data type int Interestingly this does not occur in sys test environment.

N/A

N/A

Pass

Closed

48

49

Downloads - download ZIP and try to open PDFs N/A - PDFs won't open (OK in WinRAR but not Windows Explorer) PDF version of req't (and probably booklets too) N/A - Changes section always blank even when there are changes in the online widget - presume the publish process isn't populating the XML file correctly PDF booklet - widgets not being ordered by N/A req't number (e.g. 116 and 324 are out of order at the end) [email from Rees Cox, sent to RJM/CMC] N/A IE8, UAT env't - Req Details page (logged in) reqt 8603 - expand Attainment Levels then expand Guidance. Blue boxes obscure the guidance text

N/A

N/A

High

Pass

N/A

N/A

Medium

Pass

50

N/A

N/A

Medium

Pass

Need UAT rebuild with full req't set

Closed

Tried in sys test and its still not grouping by initiative Not found

52

N/A

N/A

High - Ellie can re-create this consistently EP - retest with latest UAT build (25/06) and looks fine now.

Pass

Closed

53

Resources -> Knowledgebase Archive -> Search (without specifying text) -> Exception Details: System.Data.OleDb.OleDbException: Service is not running.

N/A

N/A

N/A

54

55

57

Log on as acute trust user with no permissions. "Go to Assessments Page" button should not be displayed (in the same way that the Assessments option on the nav bar is not displayed (and if you click the button you get an error) Registratuion Step 7 - the two yellow alert N/A boxes need the "!" icon adding (use <div class="infoMessage">) On the Forgotten User Details screen the N/A sentence at the top reads 'To receive a reminder of your user details by email, fill in the form below, then click 'Remind Me': Please can you change the : to be a . As per the prototype Logged in as XYZABC, Assessments ->Select org - N/A > Req List -> Req Details -> Done -> Go Back to Assessment Page - takes me back into the req details page instead of back to the assessments page Attempt to upload virus-infected file and then N/A attempt to upload a normal file immediately afterwards. Get error re. startIndex (see eamil from Pete Spence, 22/06) Req Details page, not logged in - NR option not showing for reqt which allows NR Whats new articles should show the date only, and not the time PDFs (individual and booklets) - Not Relevant Reason not appearing in the Attainment Levels table In UAT: v8 acute assessment says "2010-1" (defect previously raised but through to only affect test data) N/A

Withdrawn - environment issue due N/A to MS Index Server not being installed on test server - not worth installing to test. Chris promises it will be Okk in live Medium Pass

CMC

N/A

N/A

Low

Pass

Closed

N/A

N/A

Low

Pass

Closed

58

N/A

N/A

Medium

Pass

Closed

59

N/A

N/A

Medium EP - Tested in IE7

Pass

Closed

Nothing to do with sequence. It's due to attempting to upload a file without an extension.

63

N/A

N/A

Medium

Pass

Closed

64 65

N/A N/A

N/A N/A

N/A N/A

Low Medium

Pass Pass It's an issue with widget2fo.xsl - TH has emailed update to TM EP - retested again 24/06 on UAT (IE6&7) with login P87024 / elpe / 4testing and i can see the same thing (2010-1). This does not however happen on system test environment where it shows 'Version 99 (20102011). 25/06 EP - Need to retest once UAT rebuilt 25/6 TH re-tested OK in sys test but EP to retest in UAT EP - retested in systest by creating a proper gp new user showing a V8 (not a V99). Looks fine.

Closed

66

N/A

N/A

N/A

Medium

Pass

Closed

67 71

72 73

Click "Register" - the system displays register step 7! Home page (logged in) - Help On Assessments link doesn't work - suggest removing the link for now Widgets XL download - Report and Calculations tabs need removing Noticed now that when I click to open an improvement plan, it opens in a new browser window but on the task bar instead of being visable immedialtely on your screen in a new window.

N/A N/A

N/A N/A

N/A N/A

High Medium

Pass Pass RJM Closed

N/A N/A

N/A N/A

N/A N/A

Medium Medium

Pass Pass

Closed Closed Des 25/06: Fixed EP - Retest passed 25/06

74

Opened up an improvement plan and clicked to N/A open a piece of attached evidence but I get the error: Unable to view the document. An exception occurred: Value cannot be null. Parameter name: String View the widgets (not logged in)

N/A

N/A

High

Pass

Closed

Des 25/06: Fixed EP - Retest passed 25/06

S177

New Org Type: Eyecare

General User

Be able to view widgets and complete assessments for eyecare organisations

Main

There is an option to view widgets for a new org type: "Eye Care Service" (code "EYE")

5/27/2010 N/A

Pass

Properties of eye care org type are as per thingy N

5/27/2010 N/A

Pass

S187

Accessibility

General User

Be able to access the site Main as a disabled user

View any page The first element within the <body> of each Y page should be an <h1> containing the site title "Information Governance App" First set of links "DH Home, XYZ ABC Home, etc." are less important than the main navigation links. These should move down the mark-up. Possibly move to the bottom and use CSS to display them at the top. Y N/A N/A Pass RJM

N/A

N/A

Pass

RJM

All data input fields with a label should have the Y label marked up with the <label> tag, and the <label> tag should have a 'for="**"' element referring to the ID of the labelled element

N/A

N/A

Pass

home page - extraneous <label> tag in Medium TD cell to left of "Log In" button

Closed

Fail

Regsiter 1 - no "for" in labels

Medium

Failed

Pass Pass

ReportsOrganisationChooser.aspx - no Medium "for" in Org Code label Assessment Report page - Assessment Medium label not marked up as a label Assessment Report page - First group Medium of checkboxes not marked up as labels Assessment Report page - second group of checkboxes *are* marked up as labels and are consequently appearing in bold, which looks wrong. Suggest adding a new style checkboxLabel and making them not bold Register Step 4 Fields: Name (Forename Surname) Email Confirm Email Telephone Admin link New User link Field: Name (Forename Surename) Admin link My Details link Field: Name (Forename Surename) Admin link My Password link Fields: Current Password New Password Confirm New Password Logged in as ABC Admin link Organisation Admin link Field: Organisation Type dropdown Widget Details screen Fields: Target Level Target Date Evidence Location dialog box Fields: Evidence Location dropdown Uploaded File (Uploaded File) URL (Internet/Intranet) Fielname (Local File) Details (Other) Trust User Submit Baseline & Performance Update Widget Details screen Fields: Widget Complete Widget Confirmed Low

Closed Closed

The "for" ID is wrong - looks like a static ID instead of matching the .net created ID. After discussion with TH left for next iteration. The "for" ID is wrong - it's missing "_ddlOrgTypes" off the end

Pass

Closed

EP - Retest failed

Pass

Closed

Fail

Medium

Raised

nili: after discussions with TH left for next iteration

Pass

Medium

Closed

EP - Retest failed

Pass

Medium

Closed

EP - Retest failed TH - need suffix "_txtName" in "for" field

Pass

Medium

Closed

Pass

Medium

Closed

EP - Retest failed TH - you need a suffix "_ddlOrgTypes" on the ID in the "for" field

Fail

Medium

Raised

nili: after discussions with TH left for next iteration

Fail

Medium

Raised

nili: after discussions with TH left for next iteration

Fail

Medium

Raised

nili: after discussions with TH left for next iteration

Fail

EP NEW Medium Assessment Report screen aka ReportsOrganisationChooser.aspx Organisation Type drop down

Raised

S202

Odds and Ends 4

General User

See a range of random and unrelated point improvements across the site

On the Widgets List page, when viewing my N own assessment, if the assessment is "locked" i.e. Status of "confirmed" or later, there is *not* an option to add or amend requireemnt owners Contact Us page - probably need to remove link N to FAQ since we aren't going to have any FAQ (leave this until confirmed) Assessments page - for each (v8+) assessment Y there is a link through to the Improvement Plan and Evidence report (and when you get there, the relevant assessment is selected by default) Widget Details page: in IE6 there are big whitespace gaps between the Attainment Level description and the <hr> tag. Likewise for Attainment Criteria. These don't appear in IE7 Y

N/A

N/A

Low

Pass

N/A

N/A

High

Pass

Have commented it out.

6/24/2010

Des 18/06: Implemented

Pass

N/A

N/A

Low

Pass

Assessment Summary page - when I click N "Reset", the wording on the warning pop-up makes it clear that it will create me a latest version assessment Home page (logged in) and Assessment N Summary page - wording re. out-of-date assessment should refer to "Reset" instead of "Delete" Home Page/At a Glance/Last Log In - if last log N in was today, display "Today" abd then the time New user and password emails - URL links to N site at bottom of email need updating (currently refer to GettingStartedChooser.aspx) - change them to point to the home page Put a link to "Change Password" page from N "Update User Details" page Unless there's a good reason not to, can we N make the default style for bullet lists to actuall display the bullet points and then get rid of the class "bulletList" - check first with Tom why he did it this way in the first place in case there's a good reason. This will also resolve a defect that the training tool text on tyhe Req Details page is not showing bullet points Assessment Summary page - "view history" link - N exclude brackets from hyperlink Improvement Plan pop-up - add a "Print this N page" link jsut below the title which triggers the browser print function (see quickstart.html for a cut&paste example) Glossary PDF - don't break table rows across N pages Widget PDF filenames - change reqt no from 4 N digits to 3 Request to create an assessment report

N/A

N/A

RJM

done

Pass

Above the reset box it randomly says: "Question 30:"

Low

Closed

N/A

N/A

Medium

Pass

N/A

N/A

Low

Pass

It says "Today" but not the time!

Medium

Closed

10

N/A

N/A

Medium

Pass

Could you also remove the text "and Low read the appropriate "Getting Started" material" - this is now obsolete

Closed

12 14

N/A N/A

N/A N/A

Des 18/06: Implemented Des 18/06: Implemented

Pass Pass

15

N/A

N/A

Low

Pass

16

N/A

N/A

Des 16/06: Implemented

Pass

18 19

N/A N/A

N/A N/A

Done Low

Pass Pass

S189

Assessment Report Graphs

General User

View graphs within my Assessment Summary XL file

Main

2 3

The system displays the Assessment Report Y Criteria page There is an sub-option under "break down by Y attainment level" which is to include a pie chart The sub-option is disabled Select break down by attainment level The sub-option is now enabled Select to include a pie chart Request to generate the report The report includes a pie chart below the data table The pie chart references the attainment level break down for the current/final scores on the selected assessment (not any historical assessments also in the report) Y Y N N

6/14/2010 6/14/2010

CMC CMC

Pass Pass

4 5 6 7 8 9 10

6/14/2010

CMC

Pass

6/14/2010

CMC

Pass

6/14/2010 6/14/2010

CMC CMC

Pass Pass

11

The formatting and segment colours are as per the prototype

6/14/2010

CMC

CMC: Have slightly changed the segment colours as thought the Not Relevant/Exmpt/Not Answered segments were'nt clear.

Pass

GT - This may not be a defect but should the key grade colours match the atainment colours? E.g. Atainment Level 2 Yellow equals Grade Satisfactory Yellow as satisfactory is level two and above? GT - You mentioned colours have changed however I'm not sure which ones. Grade colour - Red appears to be a slightly different red. You mentioned - Not yet answered colour has been changed this was previously grey and is now pink. GT - There now appears to be multiple piecharts each of these are current.

12

The pie chart title is as per the prototype

6/14/2010

CMC

Pass

13

If I selected breakdown by initiativwe, there is one pie chart for each initiative and one for overall

6/14/2010

CMC

CMC: Note only a chart for an Pass initiative if that initiative contains break down for the main assessment, can be instances where it isn't e.g. when displaying historical initiative which no longer exist for current assessments

S206

Widget Number Prefix

General User

See the major version Main number as a prefix to the widget number (v8+ only, req list, req details and PDFs only)

View the widgets list for a v8+ assessment

Each widget number has a prefix of the major version number and a dash e.g. "8-101" View the widget details for one of the widgets The widget number has a prefix of the major version number and a dash e.g. "8-101" View the printable version (having done a re-publish) The widget number has a prefix of the major version number and a dash e.g. "8-101" View the various widget booklets (having done a re-publish)

6/14/2010

CMC

Done

Pass

3 4

6/14/2010

CMC

Done

Pass

5 6

6/14/2010

THMA

Pass

Each widget number on the contents page has a N prefix of the major version number and a dash e.g. "8-101" Each widget number on the individual widget N pages has a prefix of the major version number and a dash e.g. "8-101" View the widgets XL download Each widget number on the list tab has a prefix Y of the major version number and a dash e.g. "8101" Each widget number on the details tab has a Y prefix of the major version number and a dash e.g. "8-101" View the widgets list for a v7assessment No prefixes on the req numbers Y

6/14/2010

THMA

XSL updates available from Tony on request XSL updates available from Tony on request

Pass

6/14/2010

THMA

Pass

9 10

6/14/2010

THMA

Pass

Column A needs to be a bit wider to accommodate the wider text

Medium

Closed

11

6/14/2010

THMA

Pass

1a

1 2

6/14/2010

CMC

Done

Pass

S190

View Help Topics

General User

View various help topics

Main

1 2

View the help page There is an option to view the Improvement Plannign help topic (order and wording as per prototype) Request to view the Improvement Planning help topic Improvement Planning help topic displayed in new window Content as per prototype including images There is an option to print the page at the top of the page (which triggers the standar print dialog) There is an option to close the window at the bottom of the page (which closes the window) Request to assign widget owners There is an option to view the Improvement Planning help topic (style as per prototype) Request to view the Improvement Planning help topic Improvement Planning help topic displayed in new window Go to improvement plan report page There is an option to view the Improvement Planning help topic (style as per prototype) Request to view the Improvement Planning help topic Improvement Planning help topic displayed in new window Go to improvement plan admin page There is an option to view the Improvement Planning help topic (style as per prototype) Request to view the Improvement Planning help topic Improvement Planning help topic displayed in new window View the help page There is an option to view the Organisation Types help topic (order and wording as per prototype) Request to view the help topic Organisation Types help topic displayed in new window Content as per prototype including images There is an option to print the page at the top of the page (which triggers the standar print dialog) There is an option to print the page at the bottom of the page (which triggers the standar print dialog) There is an option to close the window at the bottom of the page (which closes the window) View widgets org type chooser page There is an option to view the Organisation Types help topic (style as per prototype) Request to view the help topic Organisation Types help topic displayed in new window View the "Create Organisation page" (as an XYZ ABC user) There is an option to view the Organisation Types help topic (not prototyped) Request to view the help topic Organisation Types help topic displayed in new window View the help page There is a link to Assessment help for XYZs etc. Y 6/24/2010 6/24/2010 6/24/2010 nili nili nili Pass Pass Pass Y 6/24/2010 nili Pass N 6/24/2010 nili Pass Y 6/24/2010 nili Pass Y 6/24/2010 nili Pass Y Y Y 6/24/2010 6/24/2010 6/24/2010 nili Pass Pass Pass Y 6/24/2010 nil nili: help page only seems to include CTPs & XYZ BP's Pass Y 6/24/2010 nili Pass Y 6/24/2010 nili Pass Y 6/24/2010 nili Pass Y 6/24/2010 nili Pass Y 6/24/2010 nili Pass Y 6/24/2010 nili Pass Y Y Y 6/24/2010 6/24/2010 6/24/2010 nili nili nili Pass Pass Pass Y 6/24/2010 nili done Pass

3 4 5 6

6/24/2010

nili

Pass

1a

1 2

3 4 1b 1 2

3 4 1c 1 2

3 4 1d 1 2

3 4 5 6

nili

nili

Pass

6/24/2010

nili

Pass

1e

1 2

3 4 1f 1 2

3 4 1g 1 2 3 4 5 6 7

There is a link to Assessment help for Trusts etc. Y There is a link to Assessment help for Social Care etc. Click any of the three links The relevant help topic opens in a new window Content as per prototype including images Y Y Y

6/24/2010 6/25/2010

nili nili

Pass Pass Link to quick start guide (under step 1 Medium of 5) doesn't work - needs to open in a new window - applies to all 3 help files Closed

10

There is an option to print the page at the top of the page (which triggers the standar print dialog) There is an option to print the page at the bottom of the page (which triggers the standar print dialog) There is an option to close the window at the bottom of the page (which closes the window) View the quick start guide The content is as per the prototype (needs updating) At the bottom there are links to the three assessment help topics Each link opens the relevant heop topic in a new window View any of the help topics The following styles render as per the prototype (see master_delta.css for definitions): - p.screenshot - #mainContent.helpPage h2 - #mainContent.helpPage h2.mainSubHeading

6/26/2010

nili

Pass

6/27/2010

nili

Pass

6/28/2010

nili

Pass

1h

1 2 3 4

Y Y Y

6/28/2010 6/28/2010 6/28/2010

nili nili nili

Pass Pass Pass

Not updated yet

Medium Medium Medium

Closed Closed Closed

1i

6/28/2010

nili

Pass

Not yet done

S207

Upload Evidence Last Chance Saloon

Organisation User

Be less confused when uploading evidence

Main

From the widget details page, request to specify evidence location The system displays the Evidence Location pop- Y up The "Uploaded" option is changed to "Upload Y File" 6/24/2010 6/24/2010 done done Pass Pass Closed Closed

2 3

Pass

TH: "Upload File" looks good when you Medium first go into the dialog, but it looks bad in the evidence table back on the Req Details page, and also not so good if you go back into the Evidence pop-up tyo edit it. Is it possible to make it display as "Upload File" only if the file hasn't already been uploaded and "Uploaded" otherwise?

Closed

Pass

Upload a document as evidence and click 'Done', then upload another piece of evidence. When you get the dialog box up the option in the 'Evidence Location' dropdown says 'Uploaded'. For a new piece of evidence it should state 'Upload File'

Closed

25/06 EP - WHAT I ACTUALLY MEANT TO WRITE WAS: After uploading one document as evidence, click on the pencil icon against that 'Uploaded' status to open the evidence location dialog box again. the drop down in the middle should show the uploaded document name with the 'View' button enabled. It is showing '[select a previously uploaded file]' and the 'View' button is disabled. You have to actually select the file in the drop down to view it which is wrong. Should show there by default.

Pass

24/06 EP - RAISED INCORRECTLY After uploading one document as evidence, click to add another piece of evidence and select 'Uploaded' (which should actually be 'Upload File' as per previous defect). The 'Upload File' drop down in the middle (where you can select a file shows '[select a previously uploaded file]'. By default this area should show the file that has already been uploaded i.e 'DOC.docx'

Closed

Very odd change request that makes no sense and completely changes the way the upload evidence works currently. Will take several hours to do. TH 25/6 - explained to RJM on the phone and now understood and already fixed!

4 5 6 7 Select "Upload File"

The "Local File" option is no longer available

6/24/2010

done

Pass

Closed

The "Upload New File" button is above the Y "Uploaded File" drop-down The context help icon to the RHS of the "Upload Y New File" button has tag "evidenceLocationUploadNewFile" The context help icon to the RHS of the "Uploaded File" button has tag "evidenceLocationUploadedFile" The default option for Uploaded File is "[Select a previously uploaded file]" Select "intranet" There is a context help icon to the RHS of the Y "View" button, tag evidenceLocationIntranetView (intranet only, not internet) The context help file has been updated to cover Y the new tags mentioend above Y

6/24/2010 6/24/2010

done done

Pass Pass Tested by TH

Closed

6/24/2010

done

Pass

Tested by TH

6/24/2010

done EP - Only if one file is uploaded and available to select done

Pass

Closed

10 11

6/24/2010

Pass

12

6/24/2010 6/24/2010

done

Pass Pass Not specifically related to test above but it's in this area. I uploaded the same file in different places: Req 102 - 1a Req 102 - 1b Req 102 - 2a Then whilst uploading to 3a I noticed it says it's already linked to widgets 102(a), 102(b). This should probably say 102(1a), 102(1b), 102(2a). As it stands it's missing one out. Low Closed EP - This info doesn't appear to even be there anymore. Need to check if ok? RJM: these items are being displayed ok now as required. Dont understand above comment? EP - Forgot to actually click 'save' after adding documents! Whoops!. All fine.

S208

Better Call-Outs on Widget Details Page

Organisation User

Experience better call-out Main help on the Widget Details page

View the widget details page within the context of a (v8+) assessment The system displays the "expanders" call-out (no change) The system does not display the "Attainment Levels" call-out Close the "expanders" call-out The system displays the "Attainment Levels" call- N out Expand the Attainment Levels section The system displays a call-out on the expander for Attainment Level 1 saying something like "Click here to view the attainment criteria." Click an attainment level 1, 2 or 3 Instead of the warning pop-up, the system displays a warning call-out (including the standard "close" and "don't show me this again" options Click on an attainment criterion (as an org type for whom evidence is "overall mandatory" Instead of the warning pop-up, the system displays a warning call-out (including the standard "close" and "don't show me this again" options N 6/24/2010 done Pass Closed N 6/24/2010 done Pass Closed N 6/24/2010 done EP - System automatically expands this section Pass Closed 6/24/2010 done Pass Closed N N 6/24/2010 6/24/2010 Pass Pass Closed Closed

Pass

The callout that states: (next to attainment level 1) Expand this section to enter or edit your answer to this attainment criteria. Should say: Expand this section to view and edit the criteria for this attainment level.

Low

Closed

Pass

The callout that states: (next to criterion 1) Expand this section to enter your attainment criteria evidence. Please change the message to read: Expand this section to enter evidence and comments.

Low

Closed

S209

Odds and Ends 5

General User

See a range of random Main and unrelated point improvements across the site

Assessment report XLS - change the filename suffix to format yyyy_mm_dd_hh_mm_ss so that multiple saved files would appear in date order in Windows Explorer XYZ ABC users shouldn't really get the yellow buttons on the Req List and Req Details pages Rename the Assessments page to "Assessment Summary". This should affect the <h1> tag and also the breadcrumb On the home page, relabel the "Go To The Assessments Page" button to "Go To The Assessments Section" On the Req Details page, the label "Widget Confirmed" needs to be "Widget Confirmed Complete" Change text on submission email from the original: You have successfully submitted your organisation's Information Governance App (PQR App) assessment. To: Thank you for submitting your organisation's Information Governance App assessment. Before it is approved, you may be requested to supply an Improvement Plan or clarification. Changes to igt.widgets.css as per prototype file igt.widgets.css_delta. In particular, this will hopefully fix the problem that the font in the header panel on the Req Details pags has shrunk! Update Organisation Type help page (see prototype)

N/A

N/A

Low

Pass

N/A

N/A

Done

Pass

6/24/2010 N/A

Done

Pass

6/24/2010 N/A

Done

Pass

6/24/2010 N/A

Done

Pass

Richard has put "Widget Complete Confirmed" instead of "Widget Confirmed Complete"

Low

Closed

6/24/2010 N/A

Low

Pass

N/A

N/A

Done

Pass

10

7/5/2010 N/A

Low. CMC: Also changes so open all help pages in a window without toolbars etc

Pass

Criteria preamble (class Low "attainmentLevelPrompt") and evidence preamble (class "attainmentCriterionPrompt") are now too small Dental Practice section, "PQR App Low view" para - should be in italics. EFG section - ditto (not bold). Sorry, my fault - prototype was wrong.

Closed

Closed

11

Downloads page - large file size warning should N only be displayed for files larger than 1MB Rename What's New page to "News" - also N rename the Nav Bar menu too (the tooltip is OK though)

N/A

N/A

Low

Pass

12

7/5/2010 N/A

Low

Pass

Home page "What's New..." section should not have been changed - since it only shows the last 4 articles. Don't forget the ellipses either :)

Low

Closed

13

Archive various articles on the "What's New" N page (see email from Magi Nwolie 28/06/2010)

7/5/2010 N/A

Low

Pass

Closed

14

Bulk Email Create page - page loads and immediately scrolls down to bottom - presume bacsue default button is the Create button and it wants to get it on the page. Can we change it somehow so that the top of the page displays initially

N/A

N/A

Low: CMC Is a more generalised issue Pass in that Des made the yellow button the default button by always focusing on it. This causes the page to jump to the button. Is also apparent in other screens such as Contact Us etc. Also can cause a problem on screens such as Widget details where the first yellow button is actually the Done button for the evidence upload even though its not shown. Have now fixed so that yellow button should work consistently across the site.

Need to rebuild test

Closed

15

Assessment Report: if no reports available, put N message "No reports are currently available for this organisation" instead of "This organisation does not have any assessments you able to report on" (requested by Alistair Donaldson; he can't find anything more significant that needs changing :) Knowledge Base search - below the keywords input field add "(only shows results where <strong>all</strong> keywords match)". See prototype for styling N

N/A

N/A

Low

Pass

16

N/A

N/A

Low

Pass

Need "s" on the end of "show" and need bold for "all"

Low

Closed

17

Improvement Plan and Evidence Report - add Y the date - see prototype for wording and styling Org type Prison Health Unit needs changing back to Prison Health (feedback from prison staff apparently!) Some KB docs are in .XLSX/.DOCX format and need converting to XLS/DOC and re-publishing to the toolkit (Magi to update RATty DB and convert docs) When increase browser text size, top menu links and nav bar links overspill. Not sure what the best way is to fix this - make them fixed size? About page: update "Who has to carry out an information governance assessment?" section content as per prototype. N

N/A

N/A

Medium

Pass

Org name and date should be <h2> not <h3> Changed wording in some help files as well

Low

Closed

18

N/A

N/A

20

N/A

N/A

Low. CMC: Changed wording in some Pass help files as well (sent mail to TOHE to update his opies) Medium Pass

21

N/A

N/A

22

N/A

N/A

Low: CMC Have fixed font sizes for Pass navigation headers etc as was unuseable anyway if increased text size Low: CMC, couldn't actually see any Pass difference ? Have also changed breadcrumb so that when about is accessed correctly shows Help._About rather than Home->About, have done the same for Contact Us and Accessibility in the page header Medium Pass

Nav bar items have grown slightly in Low font size and now Information Mapping crashes into the current item marker at the RHS TH: Sorry, my fault, hadn't copied the Low prototype across to the shared drive. Have a look at it now.

Closed

Closed

23

Widgets List page: link to downloads should not N be displayed for a v7 or less assessment. At some future point we will have to extend in preparation for v9 (separate item added to scope list for this). ISO/IEC 27002:2005 - rename page to "BS ISO 27000 Series of Information Secuerity Standards", including link on Resources page. Breadcrumb can be shortened to "BS ISO 27000 Series" Quick Start Guide: 1) Change "hover" to "move" (3 places) 2) Change "picture" to "symbol" (1 place) 3) After 1st para ("The PQR App has been designed...", add the following para: "It also includes links to specific help on how to comple an PQR App assessment." (no hyperlinks though as we want to user to scroll through the page to find the links!) Assessment report - preamble para - change "RAG status" to "grade". Also on Report chooser page Req Details page - add whitespace between "Add other edidence" and the context help icon. Ditto "Add an action" and context help icon Evidence Location pop-up, Upload File option, info message "Evidence files are stored on our secure server...". Change text from bold red to normal black by changing class from (I think) "infoMessage error" to "infoMessage" Y

N/A

N/A

24

N/A

N/A

Low

Pass

25

N/A

N/A

Low

Pass

Spare " at the end of added para

Closed

26

N/A

N/A

Low

Pass

27

N/A

N/A

Low

Pass

Too much - I only wanted a single space!

Closed

28

N/A

N/A

Low

Pass

29

30 31

Assessment Summary page: make the N assessment status larger - font-size 1.2em (see prototype for styling) Reqt Owners page - add a Save button to the N top as well as at the bottom. Also Req Owners page: Owner column: context help - N change tag to "widgetOwnerEditable" and get latest context help file Req Owners page - add a "Cancel" button which returns to the Req List page without saving changes Req Owners page - add white space between the table and the Save button. In the prototype I have a class "buttons" defined in master_delta.css Req Owners page - change table style to match that on Req List page Req Details page - evidence bullet list - second and subsequent lines need to be indented N

N/A

N/A

Low

Pass

N/A N/A

N/A N/A

Low Low

Pass Pass

32

N/A

N/A

Low

Pass

33

N/A

N/A

Low

Pass

34 35

N Y

N/A N/A

N/A N/A TH

Low Done by TH via chanegs to igt.widgets.css Low CMC Low

Pass Pass

36 40

Downloads page - XLS download - change ".XLS" Y to just "XLS" Further updates to Assessment Help (simplified Y and Social Care) as per email from TH to CMC on 19/07/2010 (ref. Magi) Info Mapping pages need styling e.g. Tabbed control with no borders (ref. Niall) N

N/A N/A

N/A N/A

Pass Pass

S214

Odds and Ends 6

General User

See a range of random Main and unrelated point improvements across the site

N/A

N/A

Low

2 3

System Error page - make it not log the user out Y if possible System Error page - in test environment only, Y provide direct link to the error display page System Error display page - make the system cauture and display date & time the error occurred News Article page - change "Back to What's New page" to "Back to News page" On the Assessments Page, click "Work on this Assessment" before page properly loaded (in IE8) gives an error "Validation of Viewstate MAC failed". Suggested fix is to disable the buttons until the page is fully loaded. Y

N/A N/A

N/A N/A

Low Low

N/A

N/A

Low

N/A

N/A

Low

S210

Misc Defects 2

Developer

Left over defects not yet fixed

Main

N/A

N/A

High

Pass

Closed

Problem in live, ok in UAT: Create new user. N Once created, the user details are re-displayed for editing. The breadcrumb says just "Edit" and you can't easily get back to the list of users for that org. In live: create bulk email; add attachment; view N attachment - attachment not shown. Also click save bulk email and get an error (says Des) Improvement Plan Report - context help icon N not being displayed Improvement Plan report - can't view evidence N files - get permissions error (when logged in as XYZ ABC viewing evidence file from org code RDE) Assessment Report XLS - problems opening file N (unknown file type) in IE6/XL2002 -seems to be worst when all three breakdown options are ticked (OK if only tick one or two options). See email from Magi 29/06/2010 Yellow buttons no longer yellow in Chrome Contact Us page: Tooltips for Org Name and Org Code need changing (cut & pasted from Telephone field) Updates needed to content of XYZ and Trust assessment help as per prototype Contact Us email - no newlines between Org Name, Org Type and content N N

N/A

N/A

Medium

Pass

CMC: Tested this in live and couldn't recreate all appeared fine so marking as fixed

Withdraw TH 6/7 couldn't re-create either! n

N/A

N/A

Medium

Pass

Closed

4 5

N/A N/A

N/A N/A

Low Medium

Pass Pass

CMC:Again appeared fine in live so marking as Fixed

Closed Closed

TH 6/7 needs testing in live (can't test in sys test)

N/A

N/A

High

Pass

Need to test in live

Closed

6/7 tested OK in live

7 8

N/A N/A

N/A N/A

Low Low

Pass Pass

Closed Closed

9 10

N N

N/A N/A

N/A N/A

Medium Low

Pass Pass

CMC: Also made this change live CMC: Fixed this issue and some other issues with this page i.e. was showing the Org type as the code

Closed Closed TH 6/7 couldn't re-test since original issue came by way of a help desk call

11

Registration - step 6 - click "create account" (thingy org type) and get system error

N/A

N/A

High

Pass

Closed

Fixed in UAT but problem still occurring in live e.g. Org code FVG16 (Pearl Chemist) TH 12/7: re-tested OK by user

12

Assessment Report criteria - when I tick or N untick options there is a jitter which I think is due to running a bit of javascript (maybe some ajax) to update the "Compare With Previous" drop-down contents. It makes ticking the boxes a bit tricky and unpredictable, especially in IE6. The JS doesn't need to fire on every field, just on the Assessment Version one. KB items with links to toolkit e.g. Link to ISO N page don't work Assessments screen N/A Logged in as gp on UAT environment where gp has a V8 plus some other previous versions. The 'reset' and 'submit' buttons aren't placed correctly within the blue section of V8. They kind of straddle the V8 and the previous V7 blue section.

N/A

N/A

Low

Pass

Closed

14 26

N/A N/A

N/A N/A

Medium Low

Pass Pass DEV - login details p87639/elpe/4testing. Not found. Need more info re browser version etc. Tested with IE8/Chrome. EP - Thats cos UAT has been rebuilt. You just need to setup another gp user to test this with.

Closed Closed CMC:Cant re-create on local or UAT enviroment. I wonder iof changes to this screen have fixed this issue anyway so marked as fixed TH 13/7 assumed fixed without retest

28

30

32

37

38 39

43

44

Some knowledge base files are missing from the live site. Example: 4 x XLSX files in req't 8-401 including "XYZ Number standard_Training Review Log.xlsx" GHJ Overview Report - assessment status column - should be "Not Started" as opposed to "Not Answered" XL publish (when adding a new widget) needs to include all widgets in the XL sheet, not just the added one. Widgets XLS: The "Description" column on both the Req List and Details tabs should containg the Widget Question Text, not the Widget Description. Knowledge Base page - Widget dropdown is empty Improvement Plan Admin page - CC field context help not showing - checked source code and I think the tag is wrong - should have a lower case "c" at the end of "improvementPlanReminderCc" Evidence upload - every time I save a widget it updates the "date uploaded" for each associated piece of evidence. The date uploaded should remain as the date and time it was actually first uploaded. Unless of course it is re-uploaded Req Details page. Add an action, type enough words to over fill the input box. Then add an owner, then click on the calendar icon to add a date. In IE7, the table becomes too wide to fit in the surrounding DIV and disappears off the RHS. In IE8, the whole left hand half of the main panel disappears. See email from Rees Cox, 13/06,2010 - forwarded by Tony Heap to Chris Clark on 13/06/2010

N/A

N/A

N/A

Done

Pass

Closed

N/A

N/A

N/A

Low

Pass

Closed

High

Pass

THMA Re-working

Closed

N/A

N/A

N/A

Medium

Pass

Closed

N/A N/A

N/A N/A

N/A N/A

Medium Low

Pass Pass

Closed Closed

N/A

N/A

N/A

CMC

Medium

Pass

Closed

N/A

N/A

N/A

Medium

Pass

Closed

47 48

50

Req Details page: the key widget image should N/A be Key.gif, not Key.png On live organisation RXYZ, widget 207 try and N/A view evidence against criteria 1a and you get an error. a.test:acute - answer level 0 on all req'ts, baseline, perf update, mark all req'ts complete and confirmed, then confirm assessment, submit, approve. Now unapprove, unsubmit, unconfirm. Drill down to Req 99-101. Got a system error "Object reference not set to an instance of an object" Req 8-210 needs to be a Key Req't - fix it with a N/A DB tweak Evidence Location pop-up: using IE6 on Citrix, N/A select "Upload File". System displays "Loading" message and progress indicator, but progress indicator is not animated and the system does not respond (waited for 10 minutes)

N/A N/A

N/A N/A

Low High

Pass Pass

Closed Closed tested by cmc

CMC

Pass

Closed

51 52

7/2/2010 N/A N/A N/A

High Medium

Pass Pass

DB tweak done - PDF files need recreating TH 14/7 Suspect this is a Citrix security permissions issue so have asked user to check it out with their IT people (lyndaharris2@nhs.net; 01582 568935). Awaiting a response Works OK in UAT - problem is sys test doesn't have Symantec installed - so just need to fix in sys test env't

Closed Withdraw TH 23/07 Assumed client-side problem n user never got back to us to confirm

53

In sys test, cannot upload any evidence files getting a virus checker error message (even for a gif)

N/A

N/A

N/A

Low

Pass

Closed

S215

Misc Defects 3

Developer

Left over defects not yet fixed

Main

1 2

Bulk email send failed in live (see log for details) - every 31st email address fails On the Req Details page, if I have achieved 1a but not 1b, the score should be 0, not blank. More generally, only leave the score blank if I have not yet achieved *any* criteria.

N N/A

N/A N/A

N/A N/A

Medium Low

Fail Fail

Raised Raised RJM: Makes sense that if anything entered mark as L0. Doesn't make sense that if 1a changed but not 1b mark 0. What if 1a && 1b are changed? What if level is NR or EX when you change any of the other criteria? TH: I agree so only leave the score blank if I have not yet achieved *any* criteria.

Create new user (Simplified Interface) - when I N/A create the new user it shows (greyed out) the Reviewer and User permissions but not the Admin permission - this is a bit confusing because the system then allocates them Admin permissions, plus also Info Mapping Admin and Info Mapping User. I can guess why it works this way but it doesn't seem right. Performance Progress Report - an PQRAF req't which is NR or Exempt should have a green background, not blue On UAT, as ABC user, view assessment for org ctptest2. Unapprove it. The page is redisplayed but the bottom of the blue box is missing. N/A

N/A

N/A

Low One for CC probably

Fail

Raised

N/A

N/A

CMC

Low

Pending

Raised

N/A

N/A

N/A

Low

Fail

Raised

IE7, Req Details page - top nav not showing (it's N/A OK on other pages, just this one!) Firefox 3.5.2: yellow buttons aren't yellow, unless you hover! Some problem in the CSS perhaps? FF 3.5.2: on an evidence item which has a location of "[select]", upload an evidence file and then go back to the Req Details page. The location remains as "[select]" even though the evidence is there if you open the pop-up again. Clicking "Save" updates the evidence table so it is correct. FF 3.5.2: clicking "Add other evidence" or "Add an action" doesn't work (sends you to the top of the page but doesn't add a blank row for you to fill in) Firefox 3.6.3 - completed req't up to level 3 (did level 3 first followed by 1 and 2) but Current Level not populated Performance Progress Report Interestingly, when I click on the 'Guidance' link, the hyperlink line is removed underneath the word 'Guidance' (although it is still a link) Performance Progress Report The Choose Assessment drop down - there is no gap between that and the 'Contact' section below Submit baseline (a.test:acute) - message says "go to your version 7 widgets" - should say "go to your version 99 widgets". Message for performance update is correct Publish process - copying of files to web servers is currently a manual process due to issues with file permissions. Need to find a way of automating this. Includes widgets, knowledge base and glossary Improvement Plan report: in live, using Chrome, log in as XYZ ABC, select Improvement Plan and Evidence Report, search for RDE, select Show Report. The report window does not open. Req Details page: the time uploaded for an evidence file gets updated every time the widget is saved. Obviously it should remain at the time the file was actually uploaded Req Details page (IE6) - target date calendar icon wraps onto separate line About page, "Who has to carry out..." section, 1st bullet - "HS" should be "XYZ" (sorry, my fault - prototype was wrong) In live (using Firefox): org NP201, req 206 level 1 and 2 ticked but current level shows as blank. Firefox: yellow buttons not yellow (only yellow on hover) Firefox: News page: RSS Feed logo on RHS too low down Assessments page: logged in as nhscfh, view assessments for a.test:acute when the v99 assessment is approved. Importantly, the main content is shorter than the nav bar. Unapprove the assessment. The main panel grows in length and overflows into the footer. The main content does not expand. I think this is because somewhere in javascript there is a bit which sets the main content height to the same as the nav bar height if it is smaller (to avoid a pale blue background) - i am guessing that this function isn't being triggered when the page refreshes with the unapproved assessment. The most elegant solution to this would be to change the main content background to white and get rid of the height fixer function (but then again the height fixer is in there for a reason...) N/A

N/A

N/A

CMC

Low

Pending

Raised

N/A

N/A

CMC

Low

Pass

Closed

CMC:Was only occuring on those widgets which didn't have a Training Tool section entry. Firefox has a whole heap of it's own quirks As above

N/A

N/A

N/A

CMC

Low

Pass

Closed

N/A

N/A

N/A

CMC

Medium

Pass

Closed

As above. There are many issues on several pages with Firefox.

10

N/A

N/A

CMC

High

Pass

Closed

11

N/A

N/A

N/A

Low

Fail

[tohe] Stylesheet change required for "vsisted" style of the link

Raised

12

N/A

N/A

N/A

Low

Fail

Failed

EP - Retest failed 25/06

13

N/A

N/A

N/A

Low

Fail

Raised

14

N/A

N/A

N/A

Medium

Fail

Raised

15

N/A

N/A

N/A

Medium

Fail

Raised

16

N/A

N/A

N/A

Low

Fail

Raised

17 18

N/A N/A

N/A N/A

N/A N/A CMC

Low Low

Fail Pending

Raised Raised

19

N/A

N/A

N/A

CMC

Low

N/A

Withdraw This is related to problem outlined in step n 10 Withdraw This is duplicate of step 7 n Raised Raised

20 21 22

N/A N/A N/A

N/A N/A N/A

N/A N/A N/A

CMC CMC

Low Low Low

N/A Pending Fail

23

The breadcrumb trail is unable to display the full trail path due to size limitation in the sites design.

N/A

N/A

N/A

Low

Fail

Raised

24

Get error when viewing widgets details page when not logged in if just open the page directly from previously saved breadcrumb without navigating through the site

N/A

N/A

N/A

Medium

Pass

Closed

25

Can mark a widget as exempt even though the assessment is submitted

N/A

N/A

N/A

CMC

Medium

Pending

Raised

26

27

When a requrement has been exempted if you N/A clear the exemtpion although the reason for the exemption is clared on screen it remains in the database even after a save and so gets redisplayed even though the widget is no longer exempt when expand the criteria for an With IE6 N/A attainment level the display jumps and puts the main display below the navigation header

N/A

N/A

CMC

Medium

Pending

Raised

N/A

N/A

CMC

Medium

Pass

Closed

S212

User Friendly Error Page

General User

Receive a user friendly error message when a system error occurs, including a reference number to help ABC diagnose the problem

Main

Do something to cause a system error

To view the error details logon as nhscfh goto admin and then view system error. On the page enter the error reference to view the detail

The system displays the user friendly "system error" page (see error.html in prototype)

N/A

N/A

6/30/2010 done

Pass

The system displays an error reference code in Y the format "PQRT-<server code>-<ref number>" The server code is "L" for Leeds or "E" for Y Exeter followed by "W" for WWW server or "N" for N3 server e.g. "LW" or "EN" The system logs the details of the error to an N error log file, including the error reference as displayed to the user

N/A

N/A

6/30/2010 done

Pass

The wording on the error page is confusing - Do I click the error ID or click the email link? No server code in sys test - suspect this needs configuring so I can re-test

Medium

Closed

Medium

Closed

N/A

N/A

6/30/2010 done

Pass

N/A

N/A

6/30/2010 done

Pass

When I click on the error ref the Medium system creates an email to the help desk out of the back of the system. This is probably a bad idea since the error might be that the system cannot send emails. Perhaps would be better to do the following: when the user clicks the help desk email address the system opens an outlook email with the error ref already populated

Closed

Pass

I suspect that the error details are being stored in the DB - this is a bad idea since the error might be that the DB is down. Rather it should send the error details to an error log

Medium

Closed

Changed the error handling so that if it cannot write to the database it outputs a particular error message stating this. Writing to log files etc can produce their own errors anyway

Pass

Created a system error using the High facility provided for ABC users under "admin". Attempted to view the error using the provided error viewer page but it gave an error "Incorrect error reference specified"

Closed

S178

New Org Type: Thingy HQ XYZ ABC User

Set up Thingy HQ users

Main

1 2 3

Request to create a new organisation One of the available org types is "Thingy HQ" Create a Thingy HQ org, using the correct ODS code as already specified in ODS - format is "Pxxx" Request to create a new user for the org There is only one possible role - "Organisation Admin" or similar (model it on the healthcare commission) Log in as the new user There are *not* details of my assessment There is *not* an Assessments option on the nav bar Request to view reports There are *not* any reports related to assessments for my organisation Wait overnight 6/30/2010 N N 6/30/2010 N/A 6/30/2010 N/A N 6/30/2010 N/A N 6/30/2010 N/A

4 5

6 7

8 9

S179

Import Thingy HQ Relationships

Sys Admin

Import relationships Main between pharmacies and pharnacy HQs from TDB

The system imports the parent/child relationships between pharmacies and thingy HQs from TDB, based on thingy HQ org code and thingy org code Log in as a thingy HQ user

6/30/2010 N/A

S180

View Thingy Reports as Thingy HQ

Organisation User

Be able to view Performance Performance Reports of Pharmacies as a Thingy HQ

Main

2 3 4 5

Request to view reports There is a report "Thingy HQ Overview Report" Select this report The system asks me to select which version assessment I want to report on (default most recent as per GHJ overview report) Select version Request to view reports The system displays a report on all pharmacies belonging to the Thingy HQ. The content of the report is as per the GHJ Overview report N 6/30/2010 N/A N 6/30/2010 N/A N 6/30/2010 N/A

6 7 8

S195

Assign Organisation Auditor Role

Organisation Admin

Assign the "Organisation Auditor" role to users within my organisation

Main

Request to create a new user for my own organisation

2 3

The system validates that I am *not* using the simplified interface There is an option to give them a role "Organisation Auditor"

N N

6/30/2010 N/A 6/30/2010 N/A

CMC CMC

GT - Not sure on this - simplified interface? Pending GT - When editing a users role, once Low updated the screen should either return to the previous screen and/or provide confirmation that the role has been updated. Also the commas between each role title are sepearated by an extra space between each title e.g. Organisation Administrator , Organisation Auditor , User admin sceen needs a Cancel button. Raised CMC:Have added a user updated message to the screen. Also changed to remove extra whitespace in role summary on user summary screen. Have also added Cancel button to User details screem

4 5 6

Give them this role Create the user System displays new user details including the fact that they have the new role I am using the simplified interface The "Organisation Auditor" role is not displayed N Create the user The Organisation Auditor role is not assigned to N the user Request to create a new user for an organisation (as an XYZ ABC user) As per main flow (simplified interface check applies to created user org type, not my own org type) Request to view reports N 6/30/2010 N/A CMC 6/30/2010 N/A CMC 6/30/2010 N/A CMC N 6/30/2010 N/A CMC

Pass Pass GT - This is displayed but the user has Pass to browse back to the user admin page

2a

1 2 3 4

1a

1 2

Pass

S196

Organisation Auditor Permissions

Organisation Auditor

Access existing functions Main as appropriate to my status

PPRs and GHJ overvioew reports are not available to me

6/30/2010 N/A

CMC

CMC: Note this is only PPR report on other organisations. Should still be able to see it for own organisation

Pass

GT - Assessment, PPR and High Improvement Plan Reports are all visible for my organisation and PPR for other organisations

Withdraw CMC:Cannot re-create locally or on n system test will need to check with Gee what org type he used etc.

3 4 5

Go to the Widgets List page There is not an option to assign widget owners Drill down to the Widget Details page for an in-progress assessment The widget answer is read only Log on as an Information Mapping User or Information Mapping Admin (but not org admin) Request to view reports PPRs and GHJ overvioew reports are not available to me N 6/30/2010 N/A CMC Pass GT - Assessment, PPR and High Improvement Plan Reports are all visible for my organisation and PPR for other organisations Withdraw CMC:Cannot re-create locally or on n system test will need to check with Gee what org type he used etc. N 6/30/2010 N/A CMC N 6/30/2010 N/A CMC The widgets link was not visible for the user with Organisation Auditor permissions? Pass Pass

1a

6 1

2 3

S197

Mark Assessment As Audited

Organisation Auditor

Mark an assessment as audited

Main

1 2

Go to the Assessments page For each assessment (current and past), there a Y row in the "Headlines" table indicating whether each assessment has been audited There is an option to edit the audit details Request to edit audit details System displays the Audit Details page The following fields are available (all default to blank) - Assessment Audited (checkbox) - Audit Date (date field) - Scope of Audit (text area) - Lead Auditor (text) - Auditor Organisation (text) - Auditor Address (text) - Auditor Telephone (text) - Auditor Email (text) Mark the assessment as audited and enter the audit data Y Y Y Y Y Y Y Y Y Y 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 CMC CMC CMC CMC CMC CMC CMC CMC CMC CMC Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Y 7/5/2010 CMC Pass

3 4 5 6 7 8 9 10 11 12 13 14 15

7/5/2010

CMC

Pass

16 17 18 19 16a 1 2 3 1a 1

Click "Save" The system saves my changes Y The system displays the "Assessment Summary" Y page The assessment is marked as having been Y audited Click Cancel My changes are not saved Y The system displays the "Assessment Summary" Y page Go to the assessments page (as a user who does not have the Organisation Auditor role) For each assessment (current and past), there a Y row in the "Headlines" table indicating whether each assessment has been audited If an assessment has been audited, there is an option to view the audit details Request to view audit details System displays the Audit Details page The system displays the same data as for the auditor but it is all read-only Click Done The system displays the "Assessment Summary" Y page An assessment hasn't been audited There is not an option to view the audit details Y 7/5/2010 CMC Pass 7/5/2010 CMC Pass Y Y 7/5/2010 7/5/2010 CMC CMC Pass Pass Y 7/5/2010 CMC Pass 7/5/2010 7/5/2010 CMC CMC 7/5/2010 7/5/2010 7/5/2010 CMC CMC CMC GT - If you click cancel then no amendments are saved Pass Pass Pass Pass Pass

3 4 5 6 7 8 3a 1 2

7/5/2010

CMC

Pass

S204

Tri State Tick Boxes on Widget Details Page

Organisation User

See "really" disabled tick Main boxes as greyed out but see "auto tick by system" tick boxes as not greyed out

Story details TBC

Pass

As an nhscfh user i am unable to tick the "Exempt" box (it's greyed out)

Medium

Closed

Fail

Tick widget as complete - all Low attainment level and criterion boxes grey out The untick complete and the other boxes correctly un-grey. Tick as complete again then click Save Now untick complete. Only Level 0 achieved ungreys - level 1,2,3 and attainment criteria remain gray. In the original spec we said that the checkboxes would only ever go grey or ungrey on save, but the current state is somewhere in between, which is probably a bit confusing for users

Raised

S213

Forgotten User Details Enhanced

General User

Receive user details reminders for multiple accounts and with a more secure password reset solution

Main

Indicate that I have forgotten my user details

2 3 4 5

The system displays the "Forgotten User Details" page The system asks for my email address The system does *not* ask me whether I want to reset my password or not The system tells me it will send me an email including instructions on how to reset my password (see prototype for wording) Enter my email address and click "Remind Me" The system validates that the email address matches exactly one user account The system sends an email to the specified email address The email lists the following details for the matching account: Org name Org code User ID User Role(s) The email includes a link to follow to reset the password The link is unique to this request and not guessable The system tells me it has sent me an email (see prototype for wording) Click on the "reset password" link in th email The system opens the "Reset Password" page in a new browser window The system validates that less than an hour has passed since the email was sent The system displays my org name, org code and user id The system asks me for my password and to confirm my password The system displays details of the password rules Enter my password (including confirm) The system validates my password (as per current) The system resets my password to the new password The system tells me it has reset my password Password reset link timed out

Y Y Y Y

7/5/2010 7/5/2010 7/5/2010 7/5/2010

CMC CMC CMC CMC

Pending Pending Pending Pending

6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 18a 1 2

Y Y

7/5/2010 7/5/2010

Y Y Y Y Y N/A Y

7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010

Y Y Y Y Y

7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010

N/A N/A Y

7/5/2010 7/5/2010 7/5/2010

3 7a 1 2 3 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 Enter my password (including confirm) Click on the "reset password on all accounts" link in the email There is no matching account

The system tells me that the password reset has Y expired and that I need to get another user details reminder. There is a link to the Forgotten User Details Y page The system does not send an email The system displays exactly the same message as if it had sent me an email There are multiple matching accounts The system sends an email to the specified email address The email tells me how many accounts are registered to the same address The email includes a link to reset all passwords at once The email lists details for all accounts (as per Main Flow) The email puts "Account 1", "Account 2" etc. above each set of account details The email includes a link to reset the password on each individual account Y Y Y Y Y Y 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010 N/A Y 7/5/2010 7/5/2010

7b

The system opens the "Reset Password" page in a new browser window The system validates that less than an hour has passed since the email was sent For each account to be reset, the system displays my org name, org code and user id The system asks me for my password and to confirm my password The system displays details of the password rules

Y Y Y Y Y

7/5/2010 7/5/2010 7/5/2010 7/5/2010 7/5/2010

The system validates my password (as per current) The system resets my password (on all accounts) to the new password The system tells me it has reset my password

N/A N/A Y

7/5/2010 7/5/2010 7/5/2010

S188

Validate Email Address

General User

Improve email validation within the registration process by sending an email to the user and forcing them to acknowledge it

Main

Request to register an account, and work through registration steps 1 and 2

2 3 4

The system validates that I am able to register Y online (no change) The system displays step 3 and tells me i can Y register online (no change) The page includes a warning that I need to have Y access to my email account to complete registration. (see prototype for wording) At Registration Step 6, request to create an PQR App account The system sends an email to the supplied email address The email content is as per the prototype (register_7.html) The email contains a URL for the user to click Y Y Y

N/A N/A 6/30/2010

N/A N/A

N/A N/A

5 6 7 8 9 10 11 12 13

6/30/2010 6/30/2010 6/30/2010 6/30/2010 6/30/2010

The URL is unique and not guessable N/A The system displays "Registration Step 7 - Email Y Validation" Click the link in the email The system validates that less than an hour has passed since the email was sent The system creates the user account and sends account and password details in separate emails (as per current). The system displays "Registration Step 8 Account Created" (NB ignore prototype which has changed to due to story S211) An hour has passed since the email was sent N/A N

6/30/2010 6/30/2010

14

6/30/2010

12a

The system tells me that my registration token has expired (see prototype for wording) There is an option to try again Request to try again The system displays Registration Step 1 In Meerkat, request to publish widgets

6/30/2010

3 4 5 S201 Publish Knowledge Base Enhancements Sys Admin Be able to republish the knowledge base without wiping out links with widgets Main 1

Y Y

6/30/2010 6/30/2010

2 3

The system does not publish the knowledge base The system publishes the widgets to the database only (as per current), including additions and uplifts to widgets The system does not publish the widgetknowledge base links

N N

N/A N/A

N/A N/A

Pass Pass

N/A

N/A

Pass

Published new req't 102 to acute, went into web app, viewed req't and KB links were there - they should not have been.

Medium

Closed

1a

6 1 2 3

The system does not publish any PDFs (and therefore does not publish the PDF file names to the database) The system does not publish any XL sheets Request to publish the knowledge base

N/A

N/A

Pass

N/A

N/A

Pass

The system publishes the knowledge base (as N per current) The system publishes or re-publishes the widget- N knowledge base links - this is a complete replacement, so the old set of links is first removed Request to publish the widget PDFs The system republishes the full set of PDFs, N booklets and ZIPs for the current widget version

N/A N/A

N/A N/A

Pass Pass

System error as sent to Tom

High

Closed

1b

1 2

N/A

N/A

Pass

Published req data then published req High PDFs. In web app, went to req list page and got a system error "Item has already been added. Key in dictionary: '101' Key being added: '101'" screenshot sent to Tom

Closed

TH retected still failed

The system publishes or republishes the PDF and ZIP filenames to the database so that the download links all work OK Request to publish the widgets XLSs The system republishes the full set of widgets XLSs for the current widget version

N/A

N/A

Pass

1c

1 2

N/A

N/A

Pass

Started RATty, didn't import data into staging tables, ran XLS publish, RATty crashed with no error message Started RATty, did import data, didn't publish data, ran XLS publish, got the following error: "Publish failed & Rolled Back with: Object cannot be cast from DBNull to other types

Medium

Closed

19/07 TH retested still failed

Pass

High

Closed

The system publishes or republishes the XLS N filenames to the database so that the download links all work OK

N/A

N/A

Pass

Pass

Tried to publish XLS based on full RATty DB (not just a subset). Got the following error: "A an item with the same key has already been added"

High

Closed

S211

Enter Own Password in Registration

General User

Enter my own password during registration

Main

Request to register an account, and work through steps 1, 2 and 3 The system displays Registration Step 4 There is an option to enter my password There is an option to confirm my password The valid password rules are displayed Enter user details The system validates that I have entered a password The system validates the password against the PQRT password validation rules The system validates that I have confirmed my password and that it matches the password I entered The system displays Registration Step 5 Work through registration to the point where I have validated my email address The system displays Regsitration Step 8 Y Content is as per prototype Y The system sends me an email containing my Y account details (but not my password) - content as per registration_8.html Request to view the list of bulk emails 7/22/2010 7/22/2010 7/22/2010 Y Y Y 7/22/2010 7/22/2010 7/22/2010 Y Y Y Y 7/22/2010 7/22/2010 7/22/2010 7/22/2010

2 3 4 5 6 7 8 9

10 11

7/22/2010

12 13 14

S193

View Number of Recipeients for Bulk Emails

XYZ ABC User

See roughly how many users bulk emails will be sent to

Main

For each unsent email, the system tells me the Y approximate number of users the email will be sent to, based on current user numbers and roles For each sent email, the system tells me how Y many users it was successfully sent to (captured at the time of sending) For each sent email, if there were any email Y failures, the system tells me how many users it failed to send to (captured at the time of sending) View the bulk email list All emails that are not sent (and not approved) Y are marked as "Draft" (state name change from "Pending") Request to view a Draft bulk email System validates that I have the "Bulk Email Approver" role (this is a role that can only be assigned by the sys admin) There is an option to approve the email Make some changes to the email Request to approve the email System saves my changes System approves the email System displays the bulk email list The email is marked as approved There is an option to view the email and an option to delete the email (but not to edit it) View the email again The email is read only There is an option to unapprove the email Wait overnight The system sends all approved emails that are on or past their send date The system does not send any draft emails Request to unapprove the email System unapproves the email (changes it back to draft) System displays the bulk email list The email is marked as draft Y Y Y Y Y Y Y N/A Y Y Y Y Y

7/22/2010

7/22/2010

7/22/2010

S192

Approve Bulk Email

XYZ ABC User

Approve a bulk email to be sent

Main

1 2

7/22/2010

3 4

7/22/2010

5 6 7 8 9 10 11 12

7/22/2010

7/22/2010 7/22/2010 7/22/2010 7/22/2010 7/22/2010

13 14 15 16 17 18 1 2 3 4

7/22/2010 7/22/2010 7/22/2010 7/22/2010 7/22/2010 7/22/2010 7/22/2010

16a

Actor Name General User Anonymous User Logged In User Organisation User

Description Any user, whether logged in or not Any user who is not logged in Any user who is logged in User responsible for basic operations within their organisation e.g. entering widget responses Organisation Reviewer User responsible for reviewing widget responses for their organisation Organisation User responsible for performing admin tasks for their Administrator organisation Organisation Auditor User responsible to auditing assessments for a specific organisation XYZ ABC User User within XYZ ABC responsible for performing various crossorganisation admin tasks Sys Admin System administrator

Story Point Count Summary Increment Story Points Man Days Velocity v8.0 (i1) v8.0 (i2) v8.0 (i3) v8.0 (i4) v8.0 (i5) v8.0 (i6) v8.0 (i7) v8.0 (i8) Total 30.75 47.00 58.00 48.00 50.50 37.00 22.50 13.00 306.75 29 60 59 70 59.5 37 69.5 37 421 1.06 0.78 0.98 0.69 0.85 1.00 0.32 0.35 0.73

Increment Total Story Name Points In Scope v8.0 (i1) 30.75

Total Man Estimated Total Story Actual Days Velocity Points Velocity Delivered 29 1.06 30.75 1.06 Week 1

Date

Man Days Man Days (Today) (Cumulative)

Story Points (Est Cumulative) 1.06 2.12 3.18 4.24 5.30 5.30 5.30 8.48 11.66 14.84 18.03 21.21 24.39 27.57 30.75

Story Points (Actual Today)

Week 2

Week 3

1/25/2010 1/26/2010 1/27/2010 1/28/2010 1/29/2010 2/1/2010 2/2/2010 2/3/2010 2/4/2010 2/5/2010 2/8/2010 2/9/2010 2/10/2010 2/11/2010 2/12/2010

1 1 1 1 1 0 0 3 3 3 3 3 3 3 3

1 2 3 4 5 5 5 8 11 14 17 20 23 26 29

0 2 3.75 0.5 2 0 0 0 5 0 2 0 5 2.5 8

35.00 30.00 25.00 Story Points 20.00 15.00 10.00 5.00 0.00 Estimated Actual

Story Points (Actual Cumulative) 0 2 5.75 6.25 8.25 8.25 8.25 8.25 13.25 13.25 15.25 15.25 20.25 22.75 30.75 0 0 0 0 0 0 0 0 0 0 2 2 0.5 0.25 2 0.5 0.5 0.25 0.25 0

Estimated Actual

Increment Total Story Name Points In Scope v8.0 (i2) 47

Total Man Estimated Total Story Actual Days Velocity Points Velocity Delivered 60 0.78 47 0.78 Week 1

Date

Man Days Man Days (Today) (Cumulative)

Story Points (Est Cumulative) 0.00 1.57 4.70 7.83 10.97 14.88 18.80 22.72 26.63 30.55 33.68 36.82 39.95 43.08 46.22 47.00

Story Points (Actual Today)

Week 2

Week 3

Week 4
50.00 45.00 40.00 35.00 Story Points 30.00 25.00 20.00 15.00 10.00 5.00 0.00

2/15/2010 2/16/2010 2/17/2010 2/18/2010 2/19/2010 2/22/2010 2/23/2010 2/24/2010 2/25/2010 2/26/2010 3/1/2010 3/2/2010 3/3/2010 3/4/2010 3/5/2010 3/8/2010

0 2 4 4 4 5 5 5 5 5 4 4 4 4 4 1

0 2 6 10 14 19 24 29 34 39 43 47 51 55 59 60

0 0 0.5 2 0 0.5 7 6 9 0 2 2 0 8 6 4

Estimated Actual

0.00

Story Points (Actual Cumulative) 0 0 0.5 2.5 2.5 3 10 16 25 25 27 29 29 37 43 47

Estimated Actual

Increment Total Story Name Points In Scope v8.0 (i3) 58

Total Man Estimated Total Story Actual Days Velocity Points Velocity Delivered 59 aim for 0.98 0.8 47.2 58 0.98 Week 1

Date

Man Days Man Days (Today) (Cumulative)

Story Points (Est Cumulative) 3.93 6.88 9.83 12.78 15.73 21.63 26.54 31.46 36.37 40.31 44.24 49.15 53.08 57.02 57.02 57.02 58.00

Story Points (Actual Today)

Week 2

Week 3

Week 4

3/8/2010 3/9/2010 3/10/2010 3/11/2010 3/12/2010 3/15/2010 3/16/2010 3/17/2010 3/18/2010 3/19/2010 3/22/2010 3/23/2010 3/24/2010 3/25/2010 3/26/2010 3/29/2010 3/30/2010

4 3 3 3 3 6 5 5 5 4 4 5 4 4 0 0 1

4 7 10 13 16 22 27 32 37 41 45 50 54 58 58 58 59

0 0 0 0 0 0 5.5 6 3 8 0 17.5 2 1 3 0 12

70.00 60.00 50.00 Story Points 40.00 30.00 20.00 10.00 Estimated Actual

10.00 0.00

Story Points (Actual Cumulative) 0 0 0 0 0 0 5.5 11.5 14.5 22.5 22.5 40 42 43 46 46 58

Chris

Richard

Tom

Des

Niall

1 1 1 1 1 1 1 1 1

0 1 1 1 1 1 1 1 1 1 1 1 1 1

1 1 1 1 1 1 1 1 1 1 1 1 1 1

2 1 1 1 1 2 1 1 1 1 1 1

1 1 1 1

1 1 1

Estimated Actual

Increment Total Story Name Points In Scope v8.0 (i4) 48

Total Man Estimated Total Story Actual Days Velocity Points Velocity Delivered 70 aim for 0.69 0.75 52.5 48 0.69 Week 1

Date

Man Days Man Days (Today) (Cumulative)

Story Points (Est Cumulative) 0.00 2.06 4.80 7.54 7.54 7.54 10.97 14.40 17.83 22.63 26.06 29.49 32.91 36.34 41.14 44.57 46.63 47.66 48.00

Story Points (Actual Today)

Week 2

Week 3

Week 4

3/29/2010 3/30/2010 3/31/2010 4/1/2010 4/2/2010 4/5/2010 4/6/2010 4/7/2010 4/8/2010 4/9/2010 4/12/2010 4/13/2010 4/14/2010 4/15/2010 4/16/2010 4/19/2010 4/20/2010 4/21/2010 4/22/2010

0 3 4 4 0 0 5 5 5 7 5 5 5 5 7 5 3 1.5 0.5

0 3 7 11 11 11 16 21 26 33 38 43 48 53 60 65 68 69.5 70

0 0.5 1 3 0 0 0 2 0 1.5 0 5 3 2 12 3 6 6 3

60.00 50.00 40.00 Story Points 30.00 20.00 10.00

10.00 0.00

Story Points (Actual Cumulative) 0 0.5 1.5 4.5 4.5 4.5 4.5 6.5 6.5 8 8 13 16 18 30 33 39 45 48

Chris

Richard

Tom

Des

Niall

0 1 1 1 0 0 1 1 1 1 1 1 1 1 1 1 0 0 0

0 1 1 1 0 0 1 1 1 2 1 1 1 1 2 1 0 0 0

0 0 1 1 0 0 1 1 1 1 1 1 1 1 1 1 1 1 0.5

0 1 1 1 0 0 1 1 1 2 1 1 1 1 2 1 1 0 0

0 0 0 0 0 0 1 1 1 1 1 1 1 1 1 1 1 0.5 0

Series1 Series2

Increment Total Story Name Points In Scope v8.0 (i5) 50.5

Total Man Estimated Total Story Actual Days Velocity Points Velocity Delivered 59.5 aim for 0.85 0.75 44.625 50.5 0.85 Week 1

Date

Man Days Man Days (Today) (Cumulative)

Story Points (Est Cumulative) 0.00 1.70 4.67 8.49 12.31 14.85 16.97 19.95 23.34 27.58 27.58 29.28 31.40 33.95 37.34 39.89 42.44 44.98 47.53 49.65 49.65 50.50

Story Points (Actual Today)

Week 2

Week 3

Week 4

Week 5

4/19/2010 4/20/2010 4/21/2010 4/22/2010 4/23/2010 4/26/2010 4/27/2010 4/28/2010 4/29/2010 4/30/2010 5/3/2010 5/4/2010 5/5/2010 5/6/2010 5/7/2010 5/10/2010 5/11/2010 5/12/2010 5/13/2010 5/14/2010 5/17/2010 5/18/2010

0 2 3.5 4.5 4.5 3 2.5 3.5 4 5 0 2 2.5 3 4 3 3 3 3 2.5 0 1

0 2 5.5 10 14.5 17.5 20 23.5 27.5 32.5 32.5 34.5 37 40 44 47 50 53 56 58.5 58.5 59.5

0 0 0 1 4 1 5.5 1 4 4.5 0 0 4.5 0 2 5 0 3 5 8.5 0 1.5

60.00 50.00 40.00 Story Points 30.00

Story Points

20.00 10.00 0.00

Story Points (Actual Cumulative) 0 0 0 1 5 6 11.5 12.5 16.5 21 21 21 25.5 25.5 27.5 32.5 32.5 35.5 40.5 49 49 50.5

Chris

Richard

Tom

Des

Niall

0 1 1 1 0.5 1 0.5 1 1 1 0 0 0 0 0 1 1 1 1 1 0 1

0 1 1 1 1.5 1 1 1 1 2 0 0 0 0 0 0 0 0 0 0 0 0

0 0 0 0.5 0.5 1 1 1 1 1 0 1 1 1 1 0 0 0 0 0 0 0

0 0 1 1 1.5 0 0 0 0 0 0 1 1 1 2 1 1 1 1 1 0 0

0 0 0.5 1 0.5 0 0 0.5 1 1 0 0 0.5 1 1 1 1 1 1 0.5 0 0

Series1

Series1

Series2

Increment Total Story Name Points In Scope v8.0 (i6) 37

Total Man Estimated Total Story Actual Days Velocity Points Velocity Delivered 37 aim for 1.00 0.75 27.75 37 1.00 Week 1

Date

Man Days Man Days (Today) (Cumulative)

Story Points (Est Cumulative) 0.00 2.00 5.00 8.00 10.00 12.00 15.00 18.00 21.00 25.00 25.00 27.00 31.00 34.00 37.00

Story Points (Actual Today)

Week 2

Week 3

5/17/2010 5/18/2010 5/19/2010 5/20/2010 5/21/2010 5/24/2010 5/25/2010 5/26/2010 5/27/2010 5/28/2010 5/31/2010 6/1/2010 6/2/2010 6/3/2010 6/4/2010

0 2 3 3 2 2 3 3 3 4 0 2 4 3 3

0 2 5 8 10 12 15 18 21 25 25 27 31 34 37

0 0.5 1 0 2 0 2 2 7 5 0 5 5 0 7.5

40.00 35.00 30.00 Story Points 25.00 20.00 15.00 10.00 5.00 0.00

Story Points (Actual Cumulative) 0 0.5 1.5 1.5 3.5 3.5 5.5 7.5 14.5 19.5 19.5 24.5 29.5 29.5 37

Chris

Richard

Tom

Des

Niall

0 0 1 1 0 0 1 1 1 1 0 1 1 1 1

0 1 1 1 1 1 1 1 1 1 0 1 1 1 1

0 0 0 0 0 0 0 0 0 0 0 0 1 0 0

0 1 1 1 1 1 1 1 1 2 0 0 1 1 1

0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Series1 Series2

Increment Total Story Name Points In Scope v8.0 (i7) 22.5

Total Man Estimated Total Story Actual Days Velocity Points Velocity Delivered 69.5 aim for 0.32 0.75 52.125 22.5 0.32 Week 1

Date

Man Days Man Days (Today) (Cumulative)

Story Points (Est Cumulative) 0.65 1.46 3.08 4.69 6.31 7.93 9.55 11.17 12.79 14.41 16.03 17.64 19.26 20.88 22.50

Story Points (Actual Today)

Week 2

Week 3

6/7/2010 6/8/2010 6/9/2010 6/10/2010 6/11/2010 6/14/2010 6/15/2010 6/16/2010 6/17/2010 6/18/2010 6/21/2010 6/22/2010 6/23/2010 6/24/2010 6/25/2010

2 2.5 5 5 5 5 5 5 5 5 5 5 5 5 5

2 4.5 9.5 14.5 19.5 24.5 29.5 34.5 39.5 44.5 49.5 54.5 59.5 64.5 69.5

0 0 0 2 1 0 1.5 0 2 1.5 0 1 8 0.5 5

25.00

20.00

Story Points

15.00

10.00

5.00

0.00

Story Points (Actual Cumulative) 0 0 0 2 3 3 4.5 4.5 6.5 8 8 9 17 17.5 22.5

Chris

Richard

Tom

Des

Niall

0 0.5 1 1 1 1 1 1 1 0 1 1 1 1 1

0 0.5 1 1 1 1 1 1 1 2 1 1 1 1 1

1 0.5 1 1 1 1 1 1 1 1 1 1 1 1 1

1 0.5 1 1 1 1 1 1 1 1 1 1 1 1 1

0 0.5 1 1 1 1 1 1 1 1 1 1 1 1 1

Series1 Series2

Increment Total Story Name Points In Scope v8.0 (i8) 15

Total Man Estimated Total Story Actual Days Velocity Points Velocity Delivered 37 aim for 0.41 0.75 27.75 13 0.35 Week 1

Date

Man Days Man Days (Today) (Cumulative)

Story Points (Est Cumulative) 0.41 2.03 3.65 4.86 5.68 6.49 7.30 8.11 8.92 8.92 9.73 10.54 11.35 12.16 12.97 13.38 14.19 15.00

Story Points (Actual Today)

Week 2

Week 3

Week 4

6/28/2010 6/29/2010 6/30/2010 7/1/2010 7/2/2010 7/5/2010 7/6/2010 7/7/2010 7/8/2010 7/9/2010 7/12/2010 7/13/2010 7/14/2010 7/15/2010 7/16/2010 7/19/2010 7/20/2010 7/21/2010

1 4 4 3 2 2 2 2 2 0 2 2 2 2 2 1 2 2

1 5 9 12 14 16 18 20 22 22 24 26 28 30 32 33 35 37

0 0 1 1 0 5 0 0 0 0 0 0 0 0 0 0 0 6

16.00
14.00 12.00 Story Points 10.00 8.00 6.00 4.00 2.00