Академический Документы
Профессиональный Документы
Культура Документы
Here is Mike’s latest ANOVA Gage R&R Spreadsheet with Graphs. Calculations have been verified with AIAG
examples.
1. My Business Objectives
2. The process that produces product
3. The specifications I need my product to meet
4. The measuring system
Business Objectives
I want to use the most cost-effective way of measuring output from my process. Before I even think about
optimizing processes, my initial concern is that if I produce out-of-spec product, my measuring system needs to
tell me.
Measurement Error
The process produces each product at a certain size, but I can never exactly know the true size of any
particular product. That’s because, I have to use a measuring device to measure the product, and this device
will always introduce some amount of measurement error. The measurement error may be so small as to be
irrelevant, or it may be large enough to completely mislead me about the state of the product. The danger in a
poor measurement system is that it may tell me that a product is within spec., when in fact the product is out of
spec, or vice versa.
Measuring System
Things get even more complicated when we introduce the measuring system, because the measuring system
itself has variation. If I use it to measure the same product 3 times and get 3 different measurements, or if
myself and my colleague measure the same product and get measurements that disagree, then I need to take
this variation into account
Just like process variation, we’ll use the normal distribution to model the measurement variation.
Because I’m using the normal distribution to model the variations, the following holds up:
The observed process is what we see after we have measured the true value process output
We cannot measure the standard deviation of the true value process, but we can do a process capability study
to determine the observed process capability, and we can conduct a gage r&r study to estimate the standard
deviation of the measurement system variation.
If we manipulate the formula we can set up an expression to calculate the true value process capability in
terms of known factors - i.e. the observed process capability and the Precision To Tolerance Ratio - as below.
This is the same model that's derived in Appendix B of the AIAG MSA Manual 3rd Edition
"Good" Process
"OK" Process
“Poor” Process
1.0 10% This process is going to require a lot
of attention - Any drift and I get out-
of-spec product. Spend money on
the process. The gage has hardly
any impact on process capability.
The curves overlap each other on
the chart below, so only the blue line
is visible
1.0 30% Same as above. Even though my
gage is above the AIAG
recommended % it doesn’t really
matter. My priority for spending
money has to be reducing the true
value process spread. Even if I
improve the gage to 10%, I still have
a process problem
1.0 50% Maybe here it’s worth improving the
gage, rather than the process, but
you would have to answer - What’s
the cheapest way to improve this
system? - it may be the gage, it may
be the process.Chart below.
What To Do Instead
1. The first thing you need to do is to get a picture of your process by using my True Process Capability
Calculator.
2. Next, decide if you need to do anything at all. We all want to improve our processes, but we don’t have
unlimited money, so we have to prioritize where the money gets spent. Just because a gage has a 30%
Precision To Tolerance Ratio, doesn’t mean it’s no good for the process. It depends on the process. In fact,
spending your money should really depend on what return you’ll get, not a % Precision To Tolerance Ratio.
3. If you do need to do something, you’ll need to weigh up the most cost-effective option. This may be improving
the process, it may be improving the gaging, or both. But, again I’ll emphasize that a lot of things will go into
this decision, and it’s not as simple as throwing out the gaging system based on some arbitrary percentage
value.
High Gage R&R Percentages and Handling Customers and Auditors
For most people, if you can provide a sensible rationale for doing what you did, they are satisfied. With that in
mind, print off the True Process Capability Calculator, write your reasoning onto the page, and shove it into
your Gage R&R file - Most people are pleasantly surprised at how big gage variation can be before it starts to
have a major impact on classifying product. This is especially true if you are running reasonably stable
processes.
Enter your name and email below to get early access to my book
Finally...
I'm writing a book about Gage R&R, and Measurement System Analysis. The book has 4 objectives:
Give a solid understanding of Gage R&R Theory, with a minimum of mathematics
Give a really practical Guide for planning, designing, and analyzing Gage R&R Studies - checklists,
flowcharts, statistical tools - the whole lot
Demolish the myths about interpreting Gage R&R Study Results
Position the reader as his company's expert in Gage R&R
This web page is an early draft of one of the chapters from the book, and I generally add new pages,
calculators, simulators, or videos every couple of weeks, so you may want to bookmark this site, and visit
again.
Thanks for reading, and please sign up on the right, or if you are looking for more articles go to Learn Gage
R&R
Figure 1:
Requirements
Following are general requirements of all capable measurement systems:
Statistical stability over time.
Variability small compared to the process variability.
Variability small compared to the specification limits (tolerance).
The resolution, or discrimination of the measurement device must be small relative to the smaller of either
the specification tolerance or the process spread (variation). As a rule of thumb, the measurement system
should have resolution of at least 1/10th the smaller of either the specification tolerance or the process
spread. If the resolution is not fine enough, process variability will not be recognized by the measurement
system, thus blunting its effectiveness.
Measurement Systems Analysis Fundamentals
1. Determine the number of appraisers, number of sample parts, and the number of repeat readings. Larger
numbers of parts and repeat readings give results with a higher confidence level, but the numbers should be
balanced against the time, cost, and disruption involved.
2. Use appraisers who normally perform the measurement and who are familiar with the equipment and
procedures.
3. Make sure there is a set, documented measurement procedure that is followed by all appraisers.
4. Select the sample parts to represent the entire process spread. This is a critical point. If the process
spread is not fully represented, the degree of measurement error may be overstated.
5. If applicable, mark the exact measurement location on each part to minimize the impact of within-part
variation (e.g. out-of-round).
6. Ensure that the measurement device has adequate discrimination/resolution, as discussed in
the Requirements section.
7. Parts should be numbered, and the measurements should be taken in random order so that the appraisers
do not know the number assigned to each part or any previous measurement value for that part. A third
party should record the measurements, the appraiser, the trial number, and the number for each part on a
table.
Stability Assessment
1. Select a part from the middle of the process spread and determine its reference value relative to a traceable
standard. If a traceable standard is not available, measure the part ten times in a controlled environment
and average the values to determine the Reference Value. This part/sample will be designated as
the Master Sample .
2. Over at least twenty periods (days/weeks), measure the master sample 3 to 5 times. Keep the number of
repeats fixed. Take readings throughout the period to capture the natural environmental variation.
3. Plot the data on an x̄ & R chart - consult the Statistical Process Control section of the Toolbox and calculate
control limits.
4. Evaluate the control chart for statistical control. Again, consult the Statistical Process Control section of the
Toolbox for assistance with this assessment.
Bias Assessment
1. Referring to the & R chart, subtract the Reference Value from to yield the Bias:
3. Analyze the results. If there is a relatively high value, examine the following potential root causes:
Appraisers not following the measurement procedure
An error in measuring the Reference Value
Instability in the measurement. If the SPC chart shows a trend, the measurement device could be wearing
or calibration could be drifting.
Repeatability and Reproducibility Assessment (Gage R&R):
This discussion refers to the data collection sheet sample that follows as Figure 2. You can download the data
collection and analysis spreadsheet at the end of this section. Follow the steps below to conduct a Gage R&R
study:
1. Determine the number of appraisers, trials, and parts, which may vary from study to study. A rule of thumb
is 2-3 appraisers, 2-3 trials, and 5-10 parts - with 10 being greatly preferred. The downloadable
MoreSteam.com spreadsheet will accommodate any combination within this range. In this example we will
use 2 appraisers, 3 trials, and 10 parts.
2. Identify three appraisers who are all trained in the proper measurement procedure and identify them as A, B
& C.
3. Fill in the yellow blanks at the top of the form with the required background information (Gage Type, Date,
etc.). Also fill in the blank at the bottom of the form asking for the total specification tolerance.
4. Collect ten parts that represents the range of process variation. If the parts don't vary as much as the
process, the gage error will be overstated.
5. Identify each part with a number 1-10 in such a way that the appraisers can not see the numbers as they
take the measurements.
6. Please refer to the data collection chart below. You will see that appraiser A's three trials are recorded in
rows A-1, A-2, and A-3. Likewise, Appraiser B has rows B-1, B-2, and B-3, and Appraiser C has rows C-1, C-
2, and C-3.
7. Start with Appraiser A and measure each of the ten parts in random order. A third party should record the
results of the first trial in row A-1. Proceed to Appraisers B & C following the same process. Then repeat the
process for trials two and three.
The analysis of measurement error is output in the green-shaded boxes on page 2 of the spreadsheet, which is
shown below:
Variation from the measurement device, or Repeatability, equals 25.98% of the total part variation, and
28% of the specification tolerance.
Variation from the appraisers, or Reproducibility, is equal to 6.02% of the total part variation, and 7% of the
specification tolerance.
Total variation from Repeatability and Reproducibility combined (they are not directly additive) is 26.67% of
the total variation, and 29% of the specification tolerance.
The rule of thumb for acceptance of a measurement system is a total Gage R&R of 30% or less of the lessor of
Total Variation or the Specification Tolerance. In this case, the measurement system is capable, and can be
used as a basis of decision making.
If the measurement system has error in excess of 30%, the first step to improve results is to analyze the
breakdown of the error source. If the largest contributor to error is Repeatability, then the equipment must be
improved. Likewise, if Reproducibility is the largest source of error, appraiser training and adherence to
procedures can yield improvement.
You can download a functional version of the Gage R&R spreadsheet.
MoreSteam Hint: If the measurement system is not capable (error above 30%), error can be normalized by taking
multiple measurements and averaging the results. This can be time consuming and expensive, but it can be used to provide
reliable measurement data while the measurement system process is being improved.
Further Analysis
There are other methods that can be used to evaluate measurement systems. Most statistical software
packages, including Minitab, support ANOVA methods. You can download free trial versions of several software
packages through the Toolbox.
For additional information on Measurement System Analysis, consult the following:
An excellent statistics handbook is available free online from a partnership of SEMATECH and NIST (National
Institute of Standards and Technology - U.S. Commerce Department)
at http://www.itl.nist.gov/div898/handbook/mpc/section4/mpc4.htm
You can purchase an excellent guide to Measurement System Analysis (MSA) for a nominal charge from
the Automotive Industry Action Group under the publications/quality section of their Web site, or by calling
(248) 358-3570. The AIAG also offers publications on other topics:
QS-9000
Advanced Product Quality Planning (APQP)
Failure Mode and Effects Analysis (FMEA)
Statistical Process Control (SPC)
Juran's Quality Handbook (Juran's Quality Handbook, 5th Ed) by Joseph M. Juran (Editor), A.
Blanton Godfrey (Editor), A. Blanford Godfrey ISBN: 007034003X
Summary
Measurement Systems Analysis is a key step to any process improvement effort. By understanding existing
measurement systems a team can better understand the data provided by those systems and make better
business decisions.
Measurement system analysis (MSA) uses scientific tools to determine the amount of total variation is
from the measurement system. An objective method to assess the validity of a measurement system
and minimize these factors that could excessively contribute to the variation in the data.
Objective:
Confirm that the measurement used to collect the data is valid. Goal is to quantify the
equipment/process variation and appraiser variation and the total measurement system variation.
The following areas components of measurement error needs to be studied and quantified before
establishing capability of a process making decisions from the data.
ACCURACY / BIAS
RESOLUTION / DISCRIMINATION
LINEARITY
STABILITY
This is often a very time consuming component of the project and can slow the team’s quick progression
through the process.
Continue to focus on low hanging fruit that may be momentum sustainers and work vigorously through the
MSA process. Most of this can be done by the GB/BB outside of the team meetings and results shared with
them when complete.
Accuracy / Bias
The difference from the true value and the value from the measurement system. Accuracy represents the
closeness to a defined target. Precision is different than accuracy and is covered in Gage R&R under
Repeatability.
1) Accept all data as it is collected. Assigning special cause and scrutinizing the data can come later.
4) On the data collection plan, record as many details around the data such as the exact source, machine,
operator, conditions, collector’s name, material, gage, and time. Record legibly and carefully.
The data should be screened for misplaced decimal points, duplicate data entries by mistake or improper
recording procedure, missing date points if frequency is important, and other obvious non-representative
data.
5) Verify the gage is accurate. If using a weigh scale, verify it with a known and calibrated weight. Use
gage blocks for calipers or micrometers. Use hardness blocks to verify hardness testers.
Resolution / Discrimination
Adhere to the 10-bucket rule. If your measurement system requires measurements to the hundredths (x.xx),
then divide that by 10. Collect and record the data to the nearest thousandths (x.xxx). The measurement
system shall be sensitive to change and capable of detecting change.
The lack of resolution will not allow a measurement system detect change. If you are measuring the
downtime and using measurement to the nearest hour and most downtime is less than an hour then most of
the reading will either be a 0 (for 0 hours) or a 1 (for 1 hour).
However, using a stop watch and recording data to the nearest minute will provide 60x more resolution and
allow better distribution of data points, more variety of data, with fewer repeat measurements. You could
have 60 different readings. Actually recording the nearest 6 minutes would satisfy the 10-bucket rule, but it
is a guide to help ensure resolution in the measurement system.
This part of the MSA is usually the easiest to fix such as finding a micrometer, caliper, hardness tester that
can capably read to the next nearest decimal.
TROUBLESHOOTING:
Try acquiring a larger samples size, with the idea that some of these may create new observations or
measurements.
Linearity
When gathering data only collect with the acceptable limits where there is proven linearity. This is a test to
examine the performance of the measurement system throughout the range of measurements. For example,
does the bathroom scale perform the same when weighing a pet of 10 lbs to a man of 250 lbs?
Stability
Stability of a measurement system is analyzed using control charts. Ensuring the measurements taken by
appraiser(s) for the process is stable and consistent over time.
SPC Charts use a variety of tests to determine stability. Many software programs will have these as options
to include when analyzing data and will even indicate the point(s) and test that each failed.
Some of the corrective measures once again include Standard Operating Procedures. Each appraiser should
measure the same way every time over a long period of time and each appraiser should measure the same
way as all the others. Recall that special causes can also occur with the process control limits and these
must be given corrective action before proceeding to validate the measurement system.
Gage R&R
Variable Gage R&R
In a variable Gage R&R there are generally two to three operators appraisers with 5-10 process outputs
measured by each appraiser. Each process output is measured 2-3 times by each operator.Depending on the
cost and time involved you can add more appraisers and measurements and replications.
When performing the replicated appraisals it is critical that the measurement are randomized so that no
patterns or predictability can be entered in by the appraiser. This bias will mislead the team and create a
useless Gage R&R.
For example, an appraiser may remember the 7th part that was measured was borderline and made a
decision to give it one measurement. He/she may have spend a lot of time of that part and if the 2nd round
of measurements are not randomized, that person will remember the measurement (appraisal) they gave it
on the first round.
So, move the parts around each repeat set of measurements. However, the parts must be indentified so the
person entering the data into the statistical software enters the reading under the correct part.
The following four areas will be asssessed. A statisical software program will produce these values once
the data is properly entered. The GB/BB will be responsible for finding these values and determining
whether each passes and if the entire measurement system is adequate to determine process capability.
Process capability can not be determined with reliablity if the measurements (the data) is suspect.
Ideally, all four categories should be in the GREEN zone. Examining the visual aids below shows
commonly used judgement criteria for each category.
2) % Tolerance
Shown below is an example of a % TOLERANCE calculation. In this case we are using 3 appraisers
measuring 6 different parts.
This study shows the measurement error as a percent of tolerance in short period of time. It oncludes both
repeatability and reproducibility, can not be separated.
The TOP TABLE at the top is a part of the d2 distribution. This value is a constant that is found by looking
at the column with 3 appraisers and going across with the row with 6 parts. In this example the d2 value is
1.73.
THe LOWER TABLE shows that actual measurements that each of the appraisers cam up with using their
variable gage. The range of the three measurements for each part is shown on the right. Then the average
range is shown (=0.69) and this is carried on to the Gage Error formula.
To convert this gage error of 2.05 to a percentage of tolerance multiply by 100 and divide by the process
tolerance for the analysis.
The process tolerance is the difference in the specification limits. For example, if the USL is 27 and the
LSL is 2, then the tolerance is 25.
Referring back to the RED/YELLOW/GREEN criteria display for % TOLERANCE, it shown that 8.2% is
a passing value and this part of the Variable Gage R&R is successful.
REPRODUCIBILITY:
Ability of one appraiser to get the same result and another appraiser or the ability of all appraisers to get
the same results AMONG each other.
1) Create visual aids, templates, definitions, or other specific criteria for each to meet a certain rating,
value, or appraisal. Pictures of good, bad, in the middle, and colors, will help each appraiser standardize
their response, improving the reproducibility.
Note: If these corrective actions are needed to pass the Gage R&R, it should be instituted as a formal work
instruction and everyone involved throughout the company or plant should adhere to same instructions.
1) Create a Standard Operating Procedure with visual aids and definitions. When using humanly subjective
"touch" devices such as micrometers and calipers it is important that all appraisers "squeeze" the same
amount. Too little or much pressure at higher levels of resolution can be enough to alter the Gage R&R.
2) Visual aids also help. Even when using an optical comparator to get a higher resolute data point there is
subjectivity where to place the template or the starting and end point(s) on the shadow. Pictures of
acceptable and non-acceptable will help reduce this variation.
REPEATABILITY
This describes the ability for an appraiser to repeat his/her measurements each time when analyzing the
same part, unit, etc. In destructive testing (such as tensile testing) these reading will not be possible and
some statistical software programs have options to select for destructive testing.
The goal is to have an appraiser repeat unit readings at least three times. The person administering the test
should randomize the sequence each time to prevent and patterns and bias (the appraiser may remember or
try to remember what a measurement was and tend to alter real measurements to get the Gage R&R to
pass). It is important for the administrator to record carefully to ensure readings correlate the correct
part/unit each time.
Avoid writing down measurements and then typing them into a statistical program. The fewer times
measurements are recorded and copied the lower the risk for human error to add even more variation and
possibly fail (or pass) the Gage R&R when it shouldn't have.
Precision is the ability to have the same repetitive result (or appraisal in this case). Visually, it means that
all your shots of an arrow are very close to one another. It does not mean that they are near the bulls eye. In
other words, it does not mean that your shots are accurate.
If your shots are accurate and precise, then they are tight circle centered around the target. It is also
possible to be somewhat accurate without being precise. You may have several shots all around the bulls
eys (target) but they may be scattered around it. If you take a look at the group the center (mean) may be
the bulls eye but the shots are not in control or precise. In others words, there is a lot of unpredictability or
variation.
Home » Lean Six Sigma Tips » MSA / Gage R&R
Because I worked in a predominantly service industry, I couldn't quite grasp how measurement could be a common cause of variation. But, if you
work in manufacturing, you know that gages and how they are used can be a key cause of variation.
Measurement Systems Analysis (MSA)
MSA is actually quite simple, but even seasoned SPC veterans don't seem to understand it. So I thought I'd simplify it for you.
First, Gage R&R studies are usually performed on variable data - height, length, width, diameter, weight, viscosity, etc.
Second, when you manufacture products, you want to monitor the output of your machines to make sure that they are producing products that
meet the customer's specifications. This means that you have to measure samples coming off the line to determine if they are meeting your
customer's requirements.
Third, when you measure, three factors come into play:
1. Part variation (differences between individual pieces manufactured)
1. five to ten parts (# each part) that span the distance between the upper and lower spec limits. The parts should represent the actual
or expected range of process variation. Rule of thumb: if you're measuring to 0.0001, the range of parts should be 10 times the
resolution (e.g., 0.4995 to 0.5005).
5. a Gage
R&R tool like the Gage R&R excel template in the QI Macros.
QI Macros for Excel Gage R&R Template
Here are samples of the Gage R&R template input sheet and results sections using sample data from the AIAG Measurement Systems Analysis
Third Edition.
Gage R&R System Acceptability
% R&R<10% - Gage System Okay
(Most variation caused by parts, not people or equipment)
% R&R<30% - May be acceptable based on importance of application and cost of gage or repair
% R&R>30% - Gage system needs improvement
(People and equipment cause over 1/3 of variation)
What To Look For
Repeatability: Percent Equipment Variation
(%EV - Can the same person using the same gage measure the same thing consistently)
If you simply look at the measurements, can each appraiser get the same result on the same part consistently, or is there too much variation?
If repeatability (Equipment variation) is larger than reproducibility (appraiser variation), reasons include:
Appraiser Variation: (Appraiser 1, Part 1: 0.65, 0.65; Appraiser 2, Part 1: 0.66, 0.66)
If you look at the line graph of appraiser performance, you'll be able to tell if one person over reads or under reads the measurement.
If reproducibility (appraiser variation) is larger than repeatability (equipment variation), reasons include:
1. Operators need to be better trained in a consistent method for using and reading the gage
2. Calibrations on gage are unclear
3. Fixture required to help the operator use gage more consistently
Mistakes People Make
Many people call us because they don't like the answer they get using the Gage R&R template. Most of the time, it's because they didn't follow
the instructions for conducting the study. Here are some of the common mistakes I've seen:
1. Forgetting that the Gage R&R study is evaluating their measurement system and NOT their products. Gage R&R does not care
about how good your products are. It only cares about how good you measure your products.
2. Using only one part. If you only use one part, THERE CAN'T BE ANY PART VARIATION, so people and equipment are the ONLY
source of variation.
3. Using the one part measurement for all 10 parts (again, there won't be any part variation, so it all falls on the people and equipment).
4. Using too many trials (if you use five trials, you have more opportunity for equipment variation).
5. Using too many appraisers (if you use all three, you have more opportunity for appraiser variation).
6. Using fake data. Try using the AIAG SPC data the QI Macros loads on your computer at c:\qimacros\testdata.
7. Using a gage that measures in too much detail. If your part is 74mm +/- 0.05, then you don’t need a gage that measures to a
thousandth of an inch (0.001) you only need one that measures to the hundredth of an inch (0.01).
If you manufacture anything, measurement system analysis can help you improve the quality of your products, get more business from big
customers, and baffle your competition. Enjoy.
http://www.youtube.com/watch?feature=player_embedded&v=gj0z4inhFv8&list=PL80107E3FBD4C8C62#t=0s
R&R Analysis Using ANOVA
Analysis of Variance, or ANOVA for short, is an experimental design technique that looks at a
number of variables at the same time.
It is used to help determine which of the variables under study have a statistically significant
impact on the process output.
With measurement systems, we can explore how the test equipment and appraiser variables
affect the measurement system output.
The use of ANOVA does have some advantages over standard GR&R studies:
Disadvantage of ANOVA:
Calculations using ANOVA are more complex than those with other techniques. It is
best to use a computer with DOE software for the calculations.
Where:
a = number of levels of a
b = number of levels of b
n = sample size per cell
N = total number of measurements made
Mean square values are calculations of variance. The variance is the standard deviation
squared.
Mean square values are calculated for the Parts (MSParts), Appraisers (MSAppraisers), the Parts x
Appraisers Interaction (MSPxA), the Error (MSError), and a “Pooled” term MSPool, if appropriate.
PxA Interaction
We will evaluate the significance of the Parts x Appraisers Interaction using the F-test.
o If this interaction is significant, we will need to investigate the reasons for it.
o If it is not significant, we will assume it is really part of the experimental error and pool
the PxA Interaction value in with the Error Value.
Calculating Repeatability
If the PxA Interaction is not significant, then the Repeatability statistic, sE, is determined by
pooling the MSError and MSPxA.
If the interaction is significant, then the Repeatability statistic, sE, is determined from
the MSError
Calculating Reproducibility
The Reproducibility, sA, is determined by the MSAppraisers with a correction term to account for
confounding from the instrument variation.
R&R Calculations
If the PxA Interaction is statistically significant, the R&R calculation is more involved:
where:
r=number of trials
We prefer the measurement system to take up less than 10% of the Total Tolerance.
If it takes up 30% or more of the TT, the measurement system needs work.
If the %GR&R is greater than 30% of the total variation, then the measurement system
should be improved.
To calculate the percentage of the total variation taken up by the measurement system, we
need to know both the Part Variation (PV) and the Total Variation, TV.
If the PxA Interaction is significant:
We can also calculate the contribution that the measurement system actually makes
to the total variation. The formula for the % Contribution is:
With non-destructive measurements, data for GR&R studies are collected by measuring the
same part or sample several times, using the same measurement device, with measurements
conducted by the same appraiser.
With destructive measurements, we cannot use the same part or sample again; by definition,
it is consumed or destroyed.
Since we cannot repeat measurements on the same part or sample, we must use techniques
to separate sample-to-sample variation from actual measurement system variation.
Homogenous samples:
The best approach, when possible, is to ensure homogenous samples are used. If we
can create nearly homogenous samples, we can assume the samples are essentially
equal and perform the analysis exactly the same way as it was done with non-
destructive measurements.
When homogenous samples cannot be created, the repeatability inherent within the
equipment used to prepare the test specimen and the repeatability (or variation) within the
material are confounded.
The use of ANOVA techniques allows us to determine if the impact of test specimen
preparation is statistically significant.
R&R Analysis for Attribute Measurements
Attribute Measures
Attribute measures can range from objective GO/NOGO dimensional gages to fairly subjective
cosmetic sorting measures.
Techniques for evaluating attribute measurement systems are not as statistically based as are
analysis techniques for evaluating variable measurement systems.
dUSL = last reference value outside the upper spec with all parts identified as bad – first
reference value inside the upper spec with all parts identified as good.
dLSL = last reference value inside the lower spec with all parts identified as good – first
reference value outside the lower spec with all parts identified as bad.
If you are only evaluating a one-sided tolerance, use only dUSL or dLSL to define the spread of
the region that the measurement system has problems in.
Estimate R&R
AIAG allows the use of 6s to cover 99.7% of the variation, instead of the historical 5.15s,
which covers 99% of the variation. This is at the discretion of the organization.
Calculate %GR&RTV.
The total variation could be determined from the parts used in the study (using the sample
standard deviation of the reference values).
If the process capability is high so that out-of-spec parts had to be generated for the
measurement system study, then do no use the sample standard deviation of all of the parts
in the measurement system study. Instead, use the historical process standard deviation in
the calculation for TV.
Calculate %GR&RTolerance
This method looks at how effective an attribute measurement system is in accepting good
parts and sorting out bad parts.
o It also looks at the probability of a bad part being missed and a good part being
rejected (a false alarm).
To use this method, some bad parts or samples must be included in the analysis.
o Again, the bad parts or samples must be identifiable to the team conducting the study,
but not to the appraisers being evaluated as part of the measurement system study.
Each of the parts or samples should be evaluated multiple times by the appraisers.
o Use at least 20 parts (more is preferable).
o Two or more appraisers.
o Two or more checks per part/sample per appraiser.
Calculate the Effectiveness (E), Probability of a Miss (PMiss), and Probability of a False Alarm
(PFA) for each appraiser and for the overall measurement system.
Evaluate the attribute measurement system:
Control charts used to monitor test equipment variation and appraiser variation.
Scatter plots to look at how consistent different appraisers are to each other as well
as their consistency taking measurements of the same part or sample.
Whiskers charts to view how consistent each appraiser is in measuring the same part
as well as to check the consistency between appraisers.
With Scatter Plots, each measurement taken in the study is plotted by the part or sample and
by appraiser.
o This is a variation of the standard Scatter Diagram. We can use these plots to look at
how consistent the appraisers are relative to each other and how consistent they were
in measuring the same part/sample.
A Whiskers Chart plots the range of the measurements for each part and for each appraiser.
This provides a view of how consistent each appraiser is in making measurements on the
same part/sample. It can also be used to look at consistency between appraisers.
When a process is not capable, most organizations start to scramble to improve the
process. But it could be that the process is fine and it is the measurement system
variation that is leading us to think we have a poor process. We could be wasting time
trying to reduce the process variation when the first thing we should be working on is
the measurement system.
When the percentage of the total variation that the measurement system takes up is
very low (such as 20%), we don't see much of an impact on the process capability.
But once the measurement system starts to take up a great deal of the total
variation, then our view of our capability is seriously distorted by the impact of the
measurement system variation. We could have a capable process, but get a capability
number that indicates it is not.
ASTM E2782 - 11
Active Standard ASTM E2782 Developed by Subcommittee: E11.20 |Book of Standards Volume: 14.02
Historical (view previous versions of standard) ASTM License Agreement Shipping & Handling
ASTM E2782
Significance and Use
1.2 Units—The system of units for this guide is not specified. Dimensional
quantities in the guide are presented only as illustrations of calculation
methods and are not binding on products or test methods treated.
1.3 This standard does not purport to address all of the safety concerns, if
any, associated with its use. It is the responsibility of the user of this
standard to establish appropriate safety and health practices and determine
the applicability of regulatory limitations prior to use.
Keywords
ICS Code
DOI: 10.1520/E2782-11