Вы находитесь на странице: 1из 20

SYSTEM TESTING AND DEPLOYMENT

Lecture Seven (Chapter 7, Notes; Chapter 8, Textbook)

Chapter 7: System Testing and Deployment

System Testing & Deployment in the KMSLC


Capture Tools Programs, books, articles, experts KNOWLEDGE CAPTURE (Creation)

Intelligence gathering

Shells, tables, tools, frames maps, rules

KNOWLEDGE CODIFICATION

DATABASES

Explicit Knowledge

TESTING AND DEPLOYMENT

KNOWLEDGE SHARING

KNOWLEDGE TRANSFER
KNOWLEDGE BASE

7-2

Chapter 7: System Testing and Deployment

Quality Assurance

KM system should meet expectations of members represented in the KM team. Performance depend highly on quality of explicit/tacit knowledge stored in KB. For expert, quality relates to reasoning process that produces reliable and accurate solutions. For user, quality relates to systems ease of use and efficiency. For knowledge developer, quality relates to how valid the knowledge sources are and how well they are codified into KB.

7-3

Chapter 7: System Testing and Deployment

KMS Testing
To

control quality, performance and efficiency of both KB and KMS. Types of Testing
Logical

Testing, make sure that the system produces correct results. User Acceptance Testing, follows logical testing and check systems behaviour in a realistic environment.

7-4

Chapter 7: System Testing and Deployment

Hurdles in KMS Testing


Subjective Lack

nature of tacit knowledge. of reliable specifications to guide testing

How

to decide whether knowledge is complete


errors of time interface un-friendly
7-5

Human Lack User

Chapter 7: System Testing and Deployment

Logical Testing Approaches


Knowledge
Structure

base formation

of knowledge as it relates to circular or redundant errors Consistency, correctness, and completeness of knowledge base rules
Knowledge
Reliability

base functionality
of knowledge base
7-6

Confidence

Chapter 7: System Testing and Deployment

Logical Errors

Circular errors - contradictory in meaning or logic Redundancy errors - offer different approaches to the same problem Unusable knowledge - comes up no matter conditions succeed or fail Subsumption errors - if one rule is true, one knows the second rule is always true Inconsistent knowledge - the same inputs yield different results
7-7

Chapter 7: System Testing and Deployment

User Acceptance Testing Approach


Select

a person or a team for testing


on user acceptance test criteria

Decide

Develop

a set of test cases unique to the system


a log on various versions of the tests and test results the system
7-8

Maintain

Field-test

Chapter 7: System Testing and Deployment

Requirements for Test Team

Independent of the design or codification of the system

Understand the knowledge problem and computer technology Well versed in the organizations goals
Know how the system being tested will fit into the designated area of operation
7-9

Chapter 7: System Testing and Deployment

Content of Test Plan


Items

of KM system that require testing of user acceptance testing

Schedule

Description

of test methods that are approved by user and company for documenting
7-10

Guidelines

test results

Chapter 7: System Testing and Deployment

User Acceptance Criteria


Accuracy

and correctness of outcome for test items Adequacy of the solutions Adaptability to novel input Ease of use Face validity or credibility Robustness Technical/operational test
7-11

Chapter 7: System Testing and Deployment

User Acceptance Test Techniques


Face Test

validation Cases

Sub-systems

validation
7-12

Chapter 7: System Testing and Deployment

Factors affecting System Deployment


Technical Organizational

Procedural
Behavioural

Political
Economical
7-13

Chapter 7: System Testing and Deployment

Steps in KMS Deployment


Transfer

of KM System from knowledge developer to the organizations operating unit. of KMs skills from knowledge developer to the organizations operators.
7-14

Transfer

Chapter 7: System Testing and Deployment

Successful KM System Deployment

User has prior experience with computer applications User has been involved in the building of the KM system Benefits of the KM system is immediate and measurable First impression Management support the system from start Adequate user training

7-15

Chapter 7: System Testing and Deployment

Factors affecting User Training


Primary
The

users knowledge of knowledge-based system

Complexity

of KM system and user interfaces ease of use


technical experience/ communication skills of training venue
7-16

Secondary
Trainers

Environment

Chapter 7: System Testing and Deployment

Pre User Training Session

Define how the KM system agrees with organizational mission

Demonstrate how the system can support organizational goals


Allocate adequate resources for the training project Advocate positive effects of the system

Explain cost-benefit analysis of the KM system


7-17

Chapter 7: System Testing and Deployment

Overcome Resistances to Change


User

attitude survey

Communication

sessions
Role

negotiation
7-18

Chapter 7: System Testing and Deployment

Post-Implementation Review

How KM System has changed accuracy/timeliness of decision making How KM System has affected attitude of end users Whether the system has caused constructive organizational changes? Whether the system has benefited the operation cost?
7-19

Chapter 7: System Testing and Deployment

Security Issues
The

new system should provide password / protocol protection. procedures should be consistently observed. should be restricted regarding update of the KB.
7-20

Security

Access