Opening Briefing Presentation

C
Appraisal Id: xxxxx
January/6, 2008

Standard CMMI Appraisal Method for Process

Improvement (SCAMPISM )
Crest Consulting

SM
SCAMPI is a service mark of Carnegie Mellon University
Page 1
 Preliminary Findings Presentation

C
Appraisal Id: xxxxx
January/6, 2008

Standard CMMI Appraisal Method for Process

Improvement (SCAMPISM )
Crest Consulting

SM
SCAMPI is a service mark of Carnegie Mellon University
Page 2
 Final Findings Presentation

C
Appraisal Id: xxxxx
January/6, 2008

Standard CMMI Appraisal Method for Process

Improvement (SCAMPISM )
Crest Consulting

SM
SCAMPI is a service mark of Carnegie Mellon University
Page 3
 Presentation Topics
Objectives of Appraisal
Overview of Appraisal
Appraisal Activities
Scope of Appraisal
Capability Maturity Model® Integration
Findings
Ratings

® Capability Maturity Model, Capability Maturity Modeling, and CMM are registered in the U.S. Patent & Trademark Office.

Page 4
 Objectives of Appraisal
• Process Improvements Business Objectives
- a;
- a;
- a

• SCAMPI Objectives
- Appraise the organization’s processes against the CMMI
v1.2, Maturity Level 2 Process Areas using Staged
Representation, and provide detailed findings of the results;
- Report on the findings of the Appraisal including Strengths
and Weaknesses;
- Supply recommendations for process improvement.

Page 5
 Overview of Appraisal
Organization Undergoing Appraisal
C
Sponsor of the Appraisal:
R

Point-of-Contact of the Appraisal:

C

Three (3) Projects will be appraised

1-
2-
3-

Page 6
Appraisal Team PA Assignment

Page 7
Appraisal Participants

Page 8
 Scope of Appraisal (Model)

Maturity Level: 2 - Investigating 6 Process Areas

–Requirements Management
–Project Planning
–Project Monitoring and Control
–Measurement and Analysis
–Process and Product Quality Assurance
–Configuration Management

PA will not be evaluated

- Supplier Agreement Management

Page 9
 CMMI Overview - Staged
Level Focus Process Areas

Continuous
Process Organizational Innovation and Deployment
5 Optimizing Causal Analysis and Resolution
Improvement

4 Quantitatively Quantitative Organizational Process Performance

Managed Management Quantitative Project Management

Requirements Development
Technical Solution
Product Integration
Verification
Validation
Organizational Process Focus
Organizational Process Definition +IPPD
3 Defined Process Organizational Training
Standardization Integrated Project Management +IPPD
Risk Management
Decision Analysis and Resolution

Requirements Management
Project Planning
Basic Project Monitoring and Control
2 Managed Project Supplier Agreement Management
Management Measurement and Analysis
Process and Product Quality Assurance
Configuration Management
Risk
Rework
1 Initial

Page 10
 Pre-appraisal activities
Pre-appraisal
•Identify appraisal team leader activities
•Determine appraisal objectives
•Determine appraisal constraints
•Determine appraisal scope
•Determine outputs
•Identify needed resources
•Determine cost and schedule
•Plan and manage logistics
•Document and manage risks
•Select team members
•Prepare team
•Obtain initial objective evidence
•Perform readiness review
•Prepare data collection plan
Page 11
 Source of Information

Document Review

Interviews
Compliance Matrix

Draft Findings Briefing

Appraisal
Presentations Team

Page 12
 Types of Findings
Strength – exemplary or noteworthy implementation of a CMMI
model practice.

Compliant – indicates in the team judgment an effective

implementation of a component of the reference model.

Weakness – indicates in the team judgment an ineffective

implementation of a component of the reference model or one
that is not institutionalized.

Recommendation – suggestion for improvement.

Page 13
 Rating Decision
Rating decisions reflect judgment on findings:
Findings are based on facts
All findings are validated by the team
Rating decisions reflect team consensus
A model component can be rated satisfied even though it has validated weaknesses

Types of ratings:
– Practices: Fully Implemented, Largely Implemented, Partially Implemented,
Not Implemented
– Goals: satisfied or unsatisfied
– PAs:
– Maturity Level:

Ratings will be provided for each:

Practice Characterization,
Goal,
Maturity Level

Page 14
 Rating of CMMI Goals

The goal is rated Satisfied if

– there are no findings that document the weaknesses
associated with a goal,
OR
– (a) all associated practices are characterized at the
organizational unit level as either Largely Implemented or
Fully Implemented, and
– (b) the aggregate of weaknesses associated with the goal
does not have a significant negative impact on goal
achievement.

Otherwise the goal is rated Unsatisfied.

Page 15
 Goal Rating Profile

GG5 GG5
GG4 GG4
GG3 NA NA NA NA GG3
GG2 NA NA NA NA GG2
GG1 NA NA NA NA GG1

SG3 SG3
SG2 NA NA NA NA SG2
SG1 NA NA NA NA SG1
P As= > O P F O P D O T O P P O ID PP P M C S AM IP M RS KMQ P M

P A - P roc es s A rea G oal S atis fied

S G - S pec ific G oal G oal Uns atis fied
G G - G eneric G oal
NA /NR P A 's are not s hown

Page 16
 Rating of Process Areas

Satisfied - all of the goals of the process area are rated as satisfied

Unsatisfied - one or more of the goals of the process area are rated
unsatisfied

Not Applicable - the process area is outside the organizational unit’s

scope of work

Not Rated
– Insufficient data is available to determine satisfaction
– Process area is outside appraisal scope (model)

Page 17
 Process Area Profile
Optimizing
Causal analysis & resolution
Organizational innovation and deployment
Quantitatively Managed
Quantitative project management
Organizational process performance
Defined
Decision analysis & resolution
Risk management
Integrated project management
Organizational training
Organizational process definition
Organizational process focus
Validation
Verification
Product Integration
Technical solution
Requirements Development satisfied

Managed
not satisfied
Configuration management
Process & product quality assurance
Measurement & analysis not applicable
NA
Supplier agreement management
Project monitoring & control
Project planning NR not rated
Requirements management
Page 18
 Ground Rules

Findings will adhere to non-attribution principles. Participants

must also adhere to this for non-attribution to work.

The results are confidential to the extent deemed appropriate by

the sponsor.

The interview notes contain attribution. All notes will be

disposed of when the final report is completed.

Page 19
 Participant Role – Conduct Appraisal

Please be prompt to all interviews and briefings for which you

are scheduled.

Please be open and candid:

the team needs to understand how business is done;
greater collaboration results in improved accuracy in the
findings;
this makes the data more useful for process improvement efforts.

Page 20
 Appraisal Results

A Preliminary findings will be presented to the organization

upon completion of the on-site period:
Thursday, January/8 @ 3:30pm

A Final findings will be presented:

Friday, January/9 @ 2:00pm

Action planning will be done based on the results of the

appraisal.

Page 21
 Reporting Appraisal Results

A Final findings will be presented:

Friday, January/9 @ 2:00pm

Action planning will be done based on the results of the

appraisal.

Page 22
 Deliverables
The results of the appraisal will provide:
– A set of findings for all PAs;
– Ratings against each component of the model (Scampi A);
– A final briefing indicating findings.
Deliverables include:
– Appraisal Plan
– Final Findings Briefing
– Appraisal Disclosure Statement (Scampi A)
– Appraisal Data (non-attributable)

Page 23
Detailed Schedule

Page 24
 Tuesday, Jan/6
From/To Activity Participants Location
7:30am/8:00am Team Arrives Appraisal Team Sala 3 - Diretoria
8:00am/8:30am Setup Opening Briefing Appraisal Team Sala 3 - Diretoria
8:30am/9:30am Opening Briefings PresentationAll Participants Auditório

9:30am/10:15am Org. presentation All Participants Auditório

10:15am/10:30am Break Auditório
10:30am/11:00am Org. Processes presentation Appraisal Team Auditório

11:00am/11:45am Org. Tool Demonstration Appraisal Team Auditório

11:45am/12:30pm Lunch Appraisal Team Restaurant
12:30am/4:00pm Document Review Appraisal Team Sala 3 - Diretoria
4:00pm/4:15pm Break Appraisal Team Sala 3 - Diretoria
4:15pm/6:30pm Document Review Appraisal Team Sala 3 - Diretoria
6:30pm/07:00pm Process Notes Appraisal Team Sala 3 - Diretoria

Page 25
 Wednesday, Jan/7
From/To Activity Participants Location
7:30am/8:00am Team Arrives Appraisal Team Sala 3 - Diretoria
8:00am/9:00am Prepare for Interviews Appraisal Team Sala 3 - Diretoria
9:00am/10:15am Project Manager Interview C.Ossandon Sala 3 - Diretoria
10:15am/10:30am Break and Tag Notes Appraisal Team Sala 3 - Diretoria
10:30am/11:30am Configuration Management F.Silva Sala 3 - Diretoria
Interview

11:30am/11:45am Break and Tag Notes Appraisal Team Sala 3 - Diretoria

11:45am/12:30pm Lunch Appraisal Team Restaurant
12:30pm/1:00pm Prepare for Interviews Appraisal Team Sala 3 - Diretoria
1:00pm/2:15pm Metrics Interview R.Lopes Sala 3 - Diretoria
2:15pm/2:45pm Break and Tag Notes Appraisal Team Sala 3 - Diretoria
2:45pm/4:00pm Requirements Interview Carlos Bernardo Sala 3 - Diretoria
4:00pm/4:30pm Break and Tag Notes Appraisal Team Sala 3 - Diretoria
4:30pm/5:30pm QA Interview N.Fernandes Sala 3 - Diretoria
5:30pm/6:00pm Break and Tag Notes Appraisal Team Sala 3 - Diretoria
6:00pm/6:30pm Process Review Appraisal Team Sala 3 - Diretoria

Page 26
 Thursday, Jan/8
From/To Activity Participants Location
7:30am/8:00am Team Arrives Appraisal Team Sala 3 - Diretoria
8:00am/10:00am Document review and Craft Appraisal Team Sala 3 - Diretoria
Observations

10:00am/11:45am Full Team Consensus Appraisal Team Sala 3 - Diretoria

11:45pm/12:15pm Lunch Appraisal Team Restaurant
12:15pm/1:30pm Full Team Consensus (Contd) Appraisal Team Sala 3 - Diretoria

1:30pm/2:30PM Create Draft Findings Appraisal Leader Auditorio

Presentation

2:30pm/3:30pm Review Draft Findings Appraisal Team Auditorio

Presentation

3:30pm/5:00pm Preliminary Findings All Participants Auditorio

Presentation

5:00pm/6:30pm Document Review and Update Appraisal Team Sala 3 - Diretoria

findings

6:30pm/7:00pm Process Notes Appraisal Team Sala 3 - Diretoria

Page 27
 Friday, Jan/9

From/To Activity Participants Location

7:30am/8:00am Team Arrives Appraisal Team Sala 3 - Diretoria

8:00am/10:00am Full Team Consensus on Appraisal Team Sala 3 - Diretoria

Modified Observations

10:00am/11:45am Prepare Final Findings Appraisal Leader Auditório

Presentation

11:45pm/12:30pm Lunch Appraisal Team Restaurant

12:30pm/2:00pm Review Final Findings Appraisal Team Auditório

Presentation

2:00pm/3:15pm Present Final Findings All Participants Auditório

3:15pm/4:00pm Executive Session Sponsor and Invitees Auditório

4:00pm/5:00pm Appraisal Close Out Appraisal Team Auditório

Page 28
 Findings Summary

Maturity Level 2 Process Areas

Process Areas
Generic Practices

Page 29
 Generic Practices
GP 2.1 Establish an Organizational Policy
COMPLIANCE:
The

Page 30
 Generic Practices
GP 2.1 Establish an Organizational Policy
RECOMMENDATION:
1-

Page 31
 Generic Practices
GP 2.1 Establish an Organizational Policy
WEAKNESS:
None.

Page 32
 Generic Practices
GP 2.2 Plan the Process
COMPLIANCE:
The

Page 33
 Generic Practices
GP 2.2 Plan the Process
RECOMMENDATION:
1-

Page 34
 Generic Practices
GP 2.2 Plan the Process
WEAKNESS:
None.

Page 35
 Generic Practices
GP 2.3 Provide Resources
COMPLIANCE:
The

Page 36
 Generic Practices
GP 2.3 Provide Resources
RECOMMENDATION:
1-

Page 37
 Generic Practices
GP 2.3 Provide Resources
WEAKNESS:
None.

Page 38
 Generic Practices
GP 2.4 Assign Responsibility
COMPLIANCE:
The

Page 39
 Generic Practices
GP 2.4 Assign Responsibility
RECOMMENDATION:
None.

Page 40
 Generic Practices
GP 2.4 Assign Responsibility
WEAKNESS:
None.

Page 41
 Generic Practices
GP 2.5 Train People
COMPLIANCE:
The

Page 42
 Generic Practices
GP 2.5 Train People
RECOMMENDATION :
1-

Page 43
 Generic Practices
GP 2.5 Train People
WEAKNESS:
None.

Page 44
 Generic Practices
GP 2.6 Manage Configurations
COMPLIANCE:
The

Page 45
 Generic Practices
GP 2.6 Manage Configurations
RECOMMENDATION:
1-

Page 46
 Generic Practices
GP 2.6 Manage Configurations
WEAKNESS:
1-

Page 47
 Generic Practices
GP 2.7 Identify and Involve Relevant Stakeholders
COMPLIANCE:
1-

Page 48
 Generic Practices
GP 2.7 Identify and Involve Relevant Stakeholders
RECOMMENDATION:
None.

Page 49
 Generic Practices
GP 2.7 Identify and Involve Relevant Stakeholders
WEAKNESS:
1-

Page 50
 Generic Practices
GP 2.8 Monitor and Control the Process
COMPLIANCE:
The

Page 51
 Generic Practices
GP 2.8 Monitor and Control the Process
RECOMMENDATION:
None.

Page 52
 Generic Practices
GP 2.8 Monitor and Control the Process
WEAKNESS:
None.

Page 53
 Generic Practices
GP 2.9 Objectively Evaluate Adherence
COMPLIANCE :
The

Page 54
 Generic Practices
GP 2.9 Objectively Evaluate Adherence
RECOMMENDATION :
1-

Page 55
 Generic Practices
GP 2.9 Objectively Evaluate Adherence
WEAKNESS :
None.

Page 56
 Generic Practices
GP 2.10 Review Status with Higher Level Management
COMPLIANCE:
1-

Page 57
 Generic Practices
GP 2.10 Review Status with Higher Level Management
RECOMMENDATION:
None.

Page 58
 Generic Practices
GP 2.10 Review Status with Higher Level Management
WEAKNESS :
None.

Page 59
 Findings Summary

Maturity Level 2 Process Areas

Process Areas
Specific Practices

Page 60
 Requirements Management
Description:
The purpose of Requirements Management is to manage
the requirements of the project's products and product
components and to identify inconsistencies between
those requirements and the project's plans and work
products.

SG 1 Manage Requirements

Compliances:
Recommendations:
Weakness:
Crest Consulting - YYYY - Appraisal A Page 61
 Requirements Management
SG 1 Manage Requirements
The

Crest Consulting - YYYY - Appraisal A Page 62

 Requirements Management
RECOMMENDATION :
1-

Page 63
 Requirements Management
WEAKNESS:
1-

Page 64
 Project Planning
Description:
The purpose of Project Planning is to establish and
maintain plans that define project activities.

SG 1 Establish Estimates
SG 2 Develop a Project Plan
SG 3 Obtain Commitment to the Plan

Compliances:
Recommendations:
Weakness:

Page 65
 Project Planning
SG 1 Establish Estimates
The

Page 66
 Project Planning
SG 2 Develop a Project Plan
The

Page 67
 Project Planning
SG 3 Obtain Commitment to the Plan
P

Page 68
 Project Planning
RECOMMENDATION:
None.

Page 69
 Project Planning
WEAKNESS:
1-

Page 70
 Project Monitoring and Control
Description:
The purpose of Project Monitoring and Control is to provide an
understanding of the project’s progress so that appropriate
corrective actions can be taken when the project’s performance
deviates significantly from the plan.

SG 1 Monitor Project Against Plan

SG 2 Manage Corrective Action to Closure

Compliances:
Recommendations:
Weakness:

Page 71
 Project Monitoring and Control
SG 1 Monitor Project Against Plan
The

Page 72
 Project Monitoring and Control
SG 2 Manage Corrective Action to Closure
Data

Page 73
 Project Monitoring and Control
RECOMMENDATION:
1-

Page 74
 Project Monitoring and Control
WEAKNESS:
1-

Page 75
 Measurement and Analysis
Description:
The purpose of Measurement and Analysis is to develop and
sustain a measurement capability that is used to support
management information needs.

SG 1 Align Measurement and Analysis Activities

SG 2 Provide Measurement Results

Compliances:
Recommendations:
Weakness:

Page 76
 Measurement and Analysis

SG 1 Align Measurement and Analysis Activities

The

Page 77
 Measurement and Analysis
SG 2 Provide Measurement Results
The

Page 78
 Measurement and Analysis
RECOMMENDATION:
None.

Page 79
 Measurement and Analysis
WEAKNESS:
1-

Page 80
 Measurement and Analysis
WEAKNESS:
4-

Page 81
 Measurement and Analysis
WEAKNESS:
7-

Page 82
 Process and Product Quality Assurance
Description:
The purpose of Process and Product Quality Assurance is to
provide staff and management with objective insight into
processes and associated work products.

SG 1 Objectively Evaluate Processes and Work Products

SG 2 Provide Objective Insight

Compliances:
Recommendations:
Weakness:

Page 83
 Process and Product Quality Assurance
SG 1 Objectively Evaluate Processes and Work Products
The

Page 84
 Process and Product Quality Assurance
SG 2 Provide Objective Insight
The

Page 85
Process and Product Quality Assurance
RECOMMENDATION:
1-

Page 86
Process and Product Quality Assurance
WEAKNESS:
None.

Page 87
 Configuration Management
Description:
The purpose of Configuration Management is to establish and
maintain the integrity of work products using configuration
identification, configuration control, configuration status
accounting, and configuration audits.

SG 1 Establish Baselines
SG 2 Track and Control Changes
SG 3 Establish Integrity

Compliances:
Weaknesses:
Recommendations:

Page 88
 Configuration Management
SG 1 Establish Baselines
The

Page 89
 Configuration Management
SG 2 Track and Control Changes
The

Page 90
 Configuration Management
SG 3 Establish Integrity
The

Page 91
 Configuration Management
RECOMMENDATION:
1-

Page 92
 Configuration Management
WEAKNESS:
None.

Page 93
 Supplier Agreement Management
Description:
The purpose of Supplier Agreement Management is to manage
the acquisition of products from suppliers.

SG 1 Establish Supplier Agreements

SG 2 Satisfy Supplier Agreements

Compliances: -3
Weaknesses: -0
Recommendations: - 0

Crest Consulting - Ação Sistemas - Appraisal A Page 94

 Supplier Agreement Management
SG 1 Establish Supplier Agreements

Crest Consulting - Ação Sistemas - Appraisal A Page 95

 Supplier Agreement Management
SG 2 Satisfy Supplier Agreements

Page 96
 Supplier Agreement Management
RECOMMENDATION:

Page 97
 Supplier Agreement Management
WEAKNESS:

Page 98
 Findings Summary

Compliances:

Recommendations:

Weaknesses:

Strengths:

Page 99
Strengths

Page 100
 Reporting Appraisal Results

A Final findings will be presented:

Friday, January/25 @ 2:00pm

Action planning will be done based on the results of the

appraisal.

Page 101
Generic Practices

Page 102
Specific Practices

Page 103
Page 104
 Comments
The organization already executes some practices required by
ML 3 PAs like:
– Organizational Process Focus
– Organizational Process Definition
– Verification (peer-review)
– Validation
– Technical Solution
– Product Integration
– Requirements Development
Recommendation
- Analyze all Weaknesses and Recommendations targeting their
adoption.
- Maintain the SCAMPI target date: march/2-6

Page 105
 Appraisal Data

• #Hours worked: 175hs

• Daily Start time: 8:00am
• Max time team stayed on any day: 7:00pm
• Appraisal documents:

Page 106
 Thanks to

1. Appraisal Participantes
2. Sponsor -
3. POC -
4. ATMs
1. S
2. E
3. R
4. P

Page 107
 Appraisal Team Signature Page
I support the findings in this presentation and affirm that to the best of my
knowledge it represents an accurate portrayal of the state of the process in
the appraised organization.
Team Role Name (printed/typed) Signature Date

Page 108