Вы находитесь на странице: 1из 48

ANALYTICAL DATAINTERPRETATION AND

TREATMENT

USP GENERAL CHAPTER <1010>

Presented by

Kh. Farjana Urmi


Sr. Quality Control Officer
ACI Limited, Kh. Farjana Urmi

INTRODUCTION TO GENERAL CHAPTER <1010>


This chapter provides information regarding
Acceptable practices for the analysis and consistent interpretation of data
obtained from chemical and other analyses.
Basic statistical approaches for evaluating data
The treatment of outliers and comparison of analytical methods
AIM:
The aim of this training is to provide a practical guide to the implementation of
<1010> as part of best laboratory practices for the analysis and evaluation of
analytical data

ACI Limited, Kh. Farjana Urmi

INTRODUCTION TO GENERAL CHAPTER <1010>


Session 1:Prerequisite laboratory practices and principles
Sound Record Keeping

Sampling considerations

Use of reference standards

System performance verification

Method validation and verification

Session 2: Measurement Principles and Variation


Sources and types of error

Normal distribution of analytical data

Standard deviation, mean, and averaging

Introduction to confidence intervals

Precision studies and ANOVA

ACI Limited, Kh. Farjana Urmi

INTRODUCTION TO GENERAL CHAPTER <1010>


Session 3: Comparison of Results
Comparison of Analytical Methods
Accuracy and precision
The role of t and ANOVA
Equivalence testing, largest acceptable difference between two
methods

ACI Limited, Kh. Farjana Urmi

Session 1:Prerequisite
laboratory practices and
principles

ACI Limited, Kh. Farjana Urmi

Prerequisite laboratory practices and principles


The sound application of statistical principles to laboratory data
(Information ,facts /figures) requires the assumption that such data have
been collected in a traceable (i.e., documented) and unbiased manner. To
ensure this, the following practices are beneficial:
Sound Record Keeping:
Laboratory records are maintained with sufficient detail, so that other
equally qualified analysts can reconstruct the experimental conditions and
review the results obtained. When collecting data, the data should generally
be obtained with more decimal places than the specification requires and
rounded only after final calculations are completed.

ACI Limited, Kh. Farjana Urmi

Significant figures, Addition &


Subtraction

ACI Limited, Kh. Farjana Urmi

Significant figures,
Addition & Subtraction

What is 16.874 + 2.6 ?

What is 16.874 2.6 ?

ACI Limited, Kh. Farjana Urmi

Prerequisite laboratory practices and principles


Sampling considerations:
A portion of a material collected according to a defined sampling
procedure. The size of any sample should be sufficient to allow all
anticipated test procedures to be carried out, including all repetitions
and retention samples.
Types of Sampling:
1. Nonrandom or convenience sampling
2. Simple random sampling
3. Systematic random sampling
4. Stratified random sample
ACI Limited, Kh. Farjana Urmi

Prerequisite laboratory practices and principles


Types of Sampling :
Types

Description

Nonrandom /conveni Risks the possibility that the estimates will be biased.
ence sampling
Simple random
sampling

A process in which every unit of the population has an


equal chance of appearing in the sample.

Systematic random
sampling

A unit is randomly selected from the production process at


systematically selected times or locations (e.g., sampling
every 30 minutes from the units produced within the 12hour process) to ensure that units taken throughout the
entire manufacturing process are included in the sample

Stratified random
sample

A stratified random sample, which randomly samples an


equal number of sample from each of the same operation
in multiple machines.

ACI Limited, Kh. Farjana Urmi

System Performance Verification


Verifying an acceptable level of performance for an analytical system in routine
or continuous use can be a valuable practice.
The performance of a system is verified by:
01. Analyzing a control sample at appropriate intervals.
02. Variation among the standards ( Calibration curve).
03. System suitability test, etc.
Trend analysis of performance verification:
Trend analysis on performance should be performed at regular intervals to
evaluate the need to optimize the analytical procedure or to revalidate all or a
part of the analytical procedure. If an analytical procedure can only meet the
established system suitability requirements with repeated adjustments to the
operating conditions stated in the analytical procedure, the analytical procedure
should be reevaluated, revalidated, or amended, as appropriate.
ACI Limited, Kh. Farjana Urmi

Validation and Verification

Difference between verification and


validation

Limited,
Farjana
Urmi
ACIACI
Limited,
Kh.Kh.
Farjana
Urmi

Method Validation
All methods are appropriately validated as specified under Validation
of Compendial Methods 1225 .

Methods published in the USPNF have been validated and meet


the Current Good Manufacturing Practices regulatory requirement for
validation as established in the Code of Federal Regulations.
A validated method may be used to test a new formulation (such as
a new product, dosage form, or process intermediate) only after
confirming that the new formulation does not interfere with the accuracy,
linearity, or precision of the method.

It may not be assumed that a validated method could correctly


measure the active ingredient in a formulation that is different from
that used in establishing the original validity of the method.

ACI Limited, Kh. Farjana Urmi

Session 2: Measurement Principles


and Variation

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation


True Value:
This is an ideal concept which can not be achieved.
Accepted True Value:
The value approximating the true value, the difference between the
two values is negligible or with in acceptable limit.
Error and types of error:
Error is the collective noun for any departure of the result from the "true"
value*. Analytical errors can be:
1. Random or unpredictable errors are caused by the natural uncertainty
that occurs with any measurement. Random errors cant be corrected.
ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation


2. Systematic or predictable regular errors are reproducible and cause a bias in
the same direction for each measurement.
For example , a poorly trained operator that consistently makes the same
mistake will cause systematic error. Systematic error can be corrected.
Mean:
It describe the Central tendency of the data set, it identifies the target value. The
average of a set of n data xi:

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation


Standard Deviation:
The standard deviation measures a tests precision or how close individual
measurements are to each other.
The standard deviation, denoted as s.d. or S, is calculated as
Coefficient of variation (CV) & Relative standard deviation (RSD) :
A further measure of precision, known as the Relative Standard Deviation
(R.S.D.), is given by:
This measure is often expressed as a percentage, known as the coefficient of
variation

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

Normal distribution of analytical data :

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

Control Sample: A control sample is defined as a homogeneous


and stable sample that is tested at specific intervals sufficient to
monitor the performance of the method for which it was
established. Test data from a control sample can be used to
monitor the method variability or be used as part of system
suitability requirements. The control sample should be
essentially the same as the test sample and should be treated
similarly whenever possible. A control chart can be constructed
and used to monitor the method performance.

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

A control chart (also called process chart or quality


control chart) is a graph that shows whether a sample of
data falls within the common or normal range of
variation. A control chart has upper and lower control
limits that separate common from assignable causes of
variation. The common range of variation is defined by
the use of control chart limits. We say that a process is
out of control when a plot of data reveals that one or
more samples fall outside the control limits.
ACI
Limited,
Kh.
Farjana
Urmi
ACI
Limited,
Kh.
Farjana
Urmi

Measurement Principles and Variation

To construct the upper and lower control limits of the chart, we use the following
formulas:

Where, x= mean of the sample means or a target value set for the process
z = number of normal standard deviations
x = standard deviation of the sample means
= / n
= population standard deviation
n = sample size

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

Setting Control Limits


Hour Mean Hour Mean
Hour 1
1
16.1
7
15.2
Sample
Weight of
2
16.8
8
16.4
Number
Oat Flakes
3
15.5
9
16.3
1
17
4
16.5
10 14.8
2
13
5
16.5
11 14.2
3
16
6
16.4
12 17.3
4
18
n=9
Here, z = 3
5
17
6
16
UCLx = x + z x = 16 + 3(1/3) = 17 ozs
7
15
8
17
LCLx = x - z x = 16 - 3(1/3) = 15 ozs
9
16
Mean 16.1
ACI
Limited,
Kh.
Farjana
Urmi
ACI
Limited,
Kh.
Farjana
Urmi
=1

Measurement Principles and Variation

Accuracy refers to how closely a measurement matches


the true or actual values

To be accurate only requires the true value (bulls eye) &


one measurement (for the arrow to hit the target)
Highly accurate data can be costly and difficult to
acquire

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

Precision refers to the reproducibility of the measurement


and exactness of description in a number.

To decide on precision, you need several measurements


(notice multiple arrow holes), and you do not need to
know the true value (none of the values are close to the
target but all the holes are close together.)
ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

In order to be accurate and precise, one must pay close attention


to detail to receive the same results every time as well as hit the
target.

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

Comparing Accuracy & Precision

Accurate &
Precise

Precise but
not
Accurate

Accurate but
not
Precise

ACI Limited, Kh. Farjana Urmi

Not Accurate &


not Precise

Measurement Principles and Variation


Consider the data (in cm) for the length of an object as measured
by three students. The length is known to be 14.5 cm. Which
student had the most precise work, and which student had the
most accurate work?
Trial Trial 2 Trial 3 Trial 4 Trial 5
1
Student
A

14.8

14.7

14.8

14.7

14.8

Student
B

14.7

14.2

14.6

14.6

14.8

Student
C

14.4

14.4

14.5

14.4

14.5

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation


Most precise: Student A (0.1 cm difference)
Most accurate: Student C (2 were true value, rest within 0.1 cm)
Trial
1

Trial 2

Trial 3

Trial 4

Trial 5

Student
A

14.8

14.7

14.8

14.7

14.8

Student
B

14.7

14.2

14.6

14.6

14.8

Student
C

14.4

14.4

14.5

14.4

14.5

ACI Limited, Kh. Farjana Urmi

Measurement Principles and Variation

Interpolation and Significant


figure:
What is the volume of water in
the graduated cylinder?
Always measure the volume of
a liquid at the bottom of the
meniscus of the liquid.
The Volume of the water is
52.8 ml. Here 52 ml are
exactly known and the 0.8 ml
is uncertain because is was
interpolated or estimated.
ACI Limited, Kh. Farjana Urmi

OUTLYING RESULTS
Outliers: occasionally, observed analytical results are very different from those
expected. Aberrant, anomalous, contaminated, discordant, spurious, suspicious or
wild observations; and flyers, rogues, and mavericks are properly called outlying
results. Like all laboratory results, these outliers must be documented, interpreted,
and managed. Such results may be accurate measurements of the entity being
measured, but are very different from what is expected.
Outliers, in statistics, refer to relatively small or large values which are considered
to be different from, and not belong to, the main body of data. The problem of what
to do with outliers is a constant dilemma facing research scientists. If the cause of
an outlier is known, resulting from an obvious error, for example, the value can be
omitted from the analysis and tabulation of the data.

ACI Limited, Kh. Farjana Urmi

OUTLYING RESULTS
Factors to be considered when investigating an outlying result include
but are not limited to
Human error, instrumentation error, calculation error, and product or component
deficiency. If an assignable cause that is not related to a product or component
deficiency can be identified, then retesting may be performed on the same
sample, if possible, or on a new sample.
The precision and accuracy of the method, the Reference Standard, process
trends, and the specification limits should all be examined. Data may be
invalidated, based on this documented investigation, and eliminated from
subsequent calculations.

ACI
Limited,
Kh.
Farjana
Urmi
ACI
Limited,
Kh.
Farjana
Urmi

OUTLYING RESULTS
Outlier identification is the use of statistical significance tests to confirm that
the values are inconsistent with the known or assumed statistical model.
When used appropriately, outlier tests are valuable tools for pharmaceutical
laboratories. Several tests exist for detecting outliers. Examples illustrating three of
these procedures, the Extreme Studentized Deviate (ESD) Test, Dixon's Test, and
Hampel's Rule.
Outlier rejection is the actual removal of the identified outlier from the data set.
However, an outlier test cannot be the sole means for removing an outlying result
from the laboratory data.
All data, especially outliers, should be kept for future review. Unusual data, when
seen in the context of other historical data, are often not unusual after all but reflect
the influences of additional sources of variation.
ACI Limited, Kh. Farjana Urmi

OUTLYING RESULTS
An outlier test may be useful as part of the evaluation of the significance of that
result, along with other data. Outlier tests have no applicability in cases where the
variability in the product is what is being assessed, such as content uniformity,
dissolution, or release-rate determination. In these applications, a value
determined to be an outlier may in fact be an accurate result of a non uniform
product.
In summary, the rejection or retention of an apparent outlier can be a serious
source of bias. An outlier test can never take the place of a thorough laboratory
investigation. Rather, it is performed only when the investigation is inconclusive
and no deviations in the manufacture or testing of the product were noted.

ACI Limited, Kh. Farjana Urmi

OUTLYING RESULTS
Given the following set of 10 measurements: 100.0, 100.1, 100.3, 100.0, 99.7,
99.9, 100.2, 99.5, 100.0, and 95.7 (mean = 99.5, standard deviation = 1.369) are
there any outliers?
Dixon-Type Tests
Stage 1 (n= 10)The results are ordered on the basis of their magnitude (i.e., Xn
is the largest observation, Xn1 is the second largest, etc., and X1 is the smallest
observation). Dixon's Test has different ratios based on the sample size (in this
example, with n = 10), to declare X1 an outlier, the following ratio, r11, is calculated
by the formula:

ACI Limited, Kh. Farjana Urmi

OUTLYING RESULTS

If, r11 > Qtable, where Qtable is a reference value corresponding to the sample
size and confidence level, then reject the questionable point. Note that only
one point may be rejected from a data set using this test.
ACI
ACILimited,
Limited,Kh.
Kh.Farjana
FarjanaUrmi
Urmi

Session 3: Comparison of Results

ACI Limited, Kh. Farjana Urmi

COMPARISON OF ANALYTICAL METHODS


Accuracy:
Precision:
How close you are to the actual
How finely tuned your
value
measurements are or how
Depends on the person measuring
close they can be to each
other
Calculated by the formula:
Depends on the measuring
% Error = (YV AV) x 100 AV
tool
Where: YV is YOUR measured Value
Determined by the number
& AV is the Accepted Value
of significant digits

ACI Limited, Kh. Farjana Urmi

COMPARISON OF ANALYTICAL METHODS


Accuracy & Precision may be demonstrated by shooting at a target.
Accuracy is represented by hitting the bulls eye (the accepted value)
Precision is represented by a tight grouping of shots (they are finely tuned)
Accuracy - Calculating % Error
How Close Are You to the Accepted Value (Bulls Eye)
If a student measured the room width at 8.46 m and the accepted value was
9.45 m what was their accuracy?
Using the formula:
% error = (YV AV) x 100 AV
Where YV is the students measured value &
AV is the accepted value

ACI Limited, Kh. Farjana Urmi

COMPARISON OF ANALYTICAL METHODS


Accuracy - Calculating % Error ,How Close Are You to the Accepted Value
(Bulls Eye)
If a student measured the room width at 8.46 m and the accepted value was 9.45 m what was
their accuracy?
Using the formula: % error = (YV AV) x 100 AV
Where YV is the students measured value & AV is the accepted value
Since YV = 8.46 m, AV = 9.45 m
% Error = (8.46 m 9.45 m) x 100 9.45 m
= -0.99 m x 100 9.45 m
= -99 m
9.45 m
= -10.5 %
Note that the meter unit cancels during the division & the unit is %. The (-) shows that YV
was low
The student was off by almost 11% & must remeasure

ACI Limited, Kh. Farjana Urmi

COMPARISON OF ANALYTICAL METHODS

Comparison of the accuracy of methods provides information useful in


determining if the new method is equivalent, on the average, to the current
method. A simple method for making this comparison is by calculating a
confidence interval for the difference in true means, where the difference is
estimated by the sample mean of the alternative method minus that of the
current method.
The confidence interval should be compared to a lower and upper range
deemed acceptable, a priori, by the laboratory. If the confidence interval
falls entirely within this acceptable range, then the two methods can be
considered equivalent, in the sense that the average difference between
them is not of practical concern. The lower and upper limits of the
confidence interval only show how large the true difference between the
two methods may be, not whether this difference is considered tolerable.
ACI Limited, Kh. Farjana Urmi

COMPARISON OF ANALYTICAL METHODS


Reasons for Selecting a New Method

improve accuracy and / or precision over existing


methods

to reduce reagent cost

to reduce labour cost

new analyzer or instrument

to measure a new analyte


ACI Limited, Kh. Farjana Urmi

COMPARISON OF ANALYTICAL METHODS


The confidence interval method just described is preferred to the practice of
applying a t-test. This is a test used for small samples; its purpose is to
compare the mean from a sample with some standard value and to express
some level of confidence in the significance of the comparison to test the
statistical significance of the difference in averages. When a new analytical
method is being developed it is usual practice to compare the values of the
mean and precision of the new (test) method with those of an established
(reference) procedure.
The value of t when comparing two sample means x1 and x2, is given by the

where sp, the pooled standard deviation, is calculated from the two sample
standard deviations s, and s,, as follows:
ACI Limited, Kh. Farjana Urmi

COMPARISON OF ANALYTICAL METHODS


The following results were obtained in a comparison between a new method and standard
method for the determination of the percentage nickel in a special steel.

Test at the 5 percent probability value if the new method mean is significantly different from the
standard reference mean.

At the 5 percent level, the tabulated value of t for (n, + n, - 2), i.e. nine degrees of freedom, is
2.26. Since t calculated 2.66> tabulated 2.26, there is a significant difference, at the specified
probability, between the mean results of the two methods.
ACI Limited, Kh. Farjana Urmi

COMPARISON OF ANALYTICAL METHODS

t-Test
Looks at differences between two groups on some variable of interest
Ex: Do males and females differ in the amount of hours they spend
shopping in a given month?

ANOVA
Tests the significance of group differences between two or more groups
Only determines that there is a difference between groups, but doesnt
tell which is different
Ex: Do SAT scores differ for low-, middle-, and high-income students?

ACI Limited, Kh. Farjana Urmi

What is ANOVA?
A statistical method for testing whether two or more dependent

variable means are equal (i.e., the probability that any differences in
means across several groups are due solely to sampling error).
Variables in ANOVA (Analysis of Variance):
Dependent variable is metric.
Independent variable(s) is nominal with two or more levels
also called treatment, manipulation, or factor.
One-way ANOVA: only one independent variable with two or more
levels.
Two-way ANOVA: two independent variables each with two or
more levels.

ACI Limited, Kh. Farjana Urmi

Measurement is the first step that leads to control and eventually to


improvement. If you cant measure something, you cant
understand it. If you cant understand it, you cant control it. If you
cant control it, you cant improve it.

ACI Limited, Kh. Farjana Urmi

Thank you

ACI Limited, Kh. Farjana Urmi

Вам также может понравиться