International Journal Advanced Quality, Vol. 44, No. 3, 2016. year, Belgrade, Serbia.

PROLAB SOFTWARE FOR DATA EVALUATION OF

INTERLABORATORY STUDIES
UDC:004.388
Jelena M. Bebi 1, Luka S. Gaevi 1 , C. Blul 2
1 Laboratorija za referente materijale, Grupa za metrologiju u hemiji, Direkcija za
mere i dragocene metale, Mike Alasa 14, Beograd, Srbija; jelenabebic@dmdm.rs,
lukagazevic@dmdm.rs;
2 QuoData GmbH, Prellerstrae 14, Dresden, Saxony 01309, Germany;
blaeul@quodata.de
Paper received: 05.07.2016.; Paper accepted: 11.08.2016.

Abstract: Interlaboratory studies represent a form of external quality control for laboratories. International
standards that are used for interlaboratory comparisons, ISO 17043, ISO 13528, ISO 5725, define ways of
organisation of comparisons and data treatment of participating laboratories results. Intercomparison results can
be exploited, apart from the main goal for laboratory performance evaluation, also for method validation and
production of Certified Reference Materials. PROLab is a comprehensive, globaly accepted and standardized
software package for evaluating interlaboratory studies. It provides large data set structures, graphical and
computational methods for optimal use of the data. Directorate of Measures and Precious Metals has purchased and
installed software package PROLab Plus, licenced as the only one in the Republic of Serbia. As such, it will be
available to all interested organisers of interlaboratory comparisons, in our country.
Key Words: PROLab software, interlaboratory comparisons

1. INTRODUCTION The software helps run ISO 17043-based

Measurement errors are a part of every
measurement. But errors must be predicted, described
and controlled. One way of doing this is participating
in interlaboratory studies. There are several types of
interlaboratory studies, such as: for testing the
competence of individual laboratories (Proficiency
Testing), determination of the method precision
(Interlaboratory study for method validation, or
certification of Reference Materials. The purpose of
interlaboratory comparisons is usually just one of the
above, but data can be used for many purposes [1].
International standards that are used for
organizing, for conducting of comparisons, and for
data treatment are: ISO 17043, ISO 13528, ISO
20612, ISO 5725:1-6, ISO Guide 35 for Reference
materials [2-10].
Standard ISO 17043:2010 specifies general
requirements for the competence of the providers of
PT schemes as well as for the development and
implementation.
PROLab is a software family for planning,
organizing, performing and analyzing interlaboratory
tests - that is, for both proficiency tests assessing the
performance of laboratories (typically according to
ISO 13528) and collaborative studies for the
validation of analytical methods. It was created by the
company QuoData GmbH, Germany, and it
encompasses a family of software programs
(PROLab Smart for ISO 13528, PROLab Smart
for ISO 5725-2, PROLab Standard, PROLab
Plus). Directorate of Measures and Precious Metals
has PROLab Plus, the most comprehensive of all
packages, and that program will be presented in this
paper.
proficiency testing schemes. Additionally, it allows
you to evaluate your interlaboratory method validation
studies.
The software is designed to handle large numbers
of participating laboratories as outline in the above
standards. Therefore, Directorate of Measures and
Precious Metals has the capacity to analyze data sets
from up to 300 laboratories. PROLab has the added
benefit of producing customized reports from the
interlaboratory comparisons.
2. PROLAB SOFTWARE
PROLab is a software package specially conceived
to achieve efficient performance of the various tasks
arising in connection with interlaboratory studies,
from statistical analysis to professional data treatment.
PROLab can be used for the certification of reference
materials, the validation of analytical methods and for
the assessment of laboratories. The generic term ring
test will be used to denote all three types of
interlaboratory studies.
PROLab proves useful at every step of a ring test.
It provides tools which assist an operator with the
planning stage all the way to the performance of
homogeneity tests, automatic data input from
laboratories, statistical analysis and finally report
generation.
Several statistical methods are available in
PROLab: DIN ISO 5725-2, DIN 38402 A42 (German
standard for method validation studies for water
analysis), Swiss Food Manual, Q-Method/Median
(robust statistical method), Q-Method/Huber (robust
method for proficiency tests used e.g. by the German
co-operation for water analysis LAWA), DIN 38402
A45 (robust Q-method and Hampel estimator), DIN
23
 International Journal Advanced Quality, Vol. 44, No. 3, 2016. year, Belgrade, Serbia.
ISO 13528/5725-5 (algorithm A+S), Nested Design
2x2 (ISO 5725-3/5), Nested Design (DIN ISO 5725-
3), (empirical) Horwitz function.
Different protocols for the assessment of
laboratories are also included, such as the international
Harmonized Protocol of IUPAC, ISO and AOAC1,
DIN ISO 13528, DIN 38402, A45, CD ISO 20612 and
the LAWA2 protocol.
More specifically, the laboratories can be assessed
by Z scores, Zu scores, Zeta scores, Z scores, En
scores, Youden plots, RSZ (Rescaled Sum of Z
Scores), RLP (Relative Laboratory Performance),
Percentage of successful measurements.
PROLab allows flexible data input, whether
manually or through the import of digital files. The
easy-to-use data entry program RingDat is provided
and may be forwarded to the participating laboratories
without extra charge. Additional information on the
laboratories and the methods can be entered into the
system, such as addresses, quantification and detection
limits, sample preparation method and analytical
method.
A powerful data selection program assists the user
in the evaluation and the presentation of results,
enabling application of data filters as convenient, to
generate individual reports. Up to 19 selection patterns
per interlaboratory study can be saved.
All results are saved in the database. Comments
relating to participants, measurements and charts can
be saved.
Numerous specialised chart-generating functions
are provided to assist in the presentation of results,
while a powerful report designer enables the
generation of editable reports. Reports can be exported
into the formats PDF, RTF (Word), XLS (Excel),
HTML, Text and CSV. Charts can be converted into
Bitmaps (BMP), Scalable Vector Graphics (SVG) and
the Windows Meta File format (WMF).
3. OVERVIEW OF PROLAB
FUNCTIONALITIES
PROLab uses throughout the program some
specific or generic terms:
Ring test: this term refers to a method validation
study, a proficiency test or a certification of
reference material at the same time
Measurand: this term denotes what should be
evaluated (measured) by the laboratories
Laboratory: this term denotes a participant in the
ring test
S.d.: is the abbreviation for standard deviation
Target s.d.: refers to the standard uncertainty for
proficiency assessment (see ISO 13528)
All terms can be changed via the menu File
Settings in the tab Caption to fit your individual needs
better.
The main menu is the starting point of every
evaluation using PROLab, and it opens as soon as
PROLab successfully starts. The main menu contains
eight modules, which can be selected using the
common Windows techniques (mouse, arrow keys or
input of the corresponding character):
File
Data
Homogeneity/stability
Selection
Statistics
Charts and tables
Window
Help
One starts in the module File with the definition of
settings for PROLab itself and reports. That is
followed by the description of the ring test, of the
samples and measurands that are to be examined and
evaluated, and of the encoding of laboratories and
samples. Once the results start coming in, they will
thus be able to be imported or entered manually. All
necessary functions for the latter procedure are located
in the module Data.
If required, a test of the homogeneity of the
samples in preparation for the ring test can be
conducted in the module Homogeneity/stability,
which also provides the necessary functions for any
stability tests to be conducted later on.
The Selection module provides all relevant tools
for the selection of samples, measurands and
laboratories to be included in assessment and analysis
procedures or in the presentation of results.
The evaluation, analysis and assessment
procedures are then carried out in the module
Statistics, while reports and charts in various layouts
can be generated and displayed in the module Charts
and tables.
Each step within this sequence affects subsequent
steps. All statistical results obtained at any stage will
be directly stored in the database. Earlier results of the
same ring test will be overwritten automatically. If
there are some modifications to implement (e.g. in the
calculation of Z scores) it is not necessary to create a
new test: changing the data at the earliest relevant step
is sufficient.
4. WORKING AND EVALUATING IN
PROLAB
In the FILE - SETTINGS - CAPTIONS, there is a
table with the fundamental terms and their
abbreviations.
24
 International Journal Advanced Quality, Vol. 44, No. 3, 2016. year, Belgrade, Serbia.

Figure 1. Settings panel

It should be noted in particular the abbreviation s.d. is for standard deviation, and the use of the term target
standard deviation is to refer to the standard deviation for proficiency assessment.
The user can replace the first four terms (ring test, sample, measurand, and laboratory) with other terms. For
example, if user likes to use the term analyte instead of measurand, he should carry out the following
changes:

Figure 2. Changing captions

To define a new ring test under DATABASE - BASIC TABLES, the RING TESTS tab should be opened,
and a name for the ring test should be entered in the first row. (It is empty and marked with a star on the left.)

Figure 3. Basic tables

To import your data it is important that the relevant ring test is displayed in the long box under the main
menu bar (indicates ring test that is currently being worked with) and that it is in EDIT MODE.

25
 International Journal Advanced Quality, Vol. 44, No. 3, 2016. year, Belgrade, Serbia.

Figure 4. Selection of ring tests tables

In the DATABASE - IMPORT - STRUCTURE / RING TEST RESULTS, data can be imported by clicking
on OPEN FILE of via Copy & Paste (e.g. from Excel), and for each relevant column, choosing the correct header
from the list in the selection menu (in some cases, this assignation is carried out automatically).

Figure 5. Importing structure/ring test results

It may be simpler to import data for each sample-measurand combination separately. If this is the case,
indicate the sample and the measurand in the boxes on the right.

26
 International Journal Advanced Quality, Vol. 44, No. 3, 2016. year, Belgrade, Serbia.

Figure 6. Importing structure/ring test results

To define the mode of the assigned value and of the target s.d., use the menu item DATABASE -
CHARACTERISTICS OF MEASURANDS, tab called FORM.
For evaluation according to the ISO 13528 robust statistics:
Mode of assigned value: M Mean (Consensus value)
Target s.d. mode: S Reprod. s.d. (empirical)
For evaluation with a reference value and a predefined relative standard deviation:
Mode of assigned value: R Reference value
Target s.d. mode: L Limited (relative s.d.)
and type e.g. 10 in the "Rel s.d. min (%)" and "Rel s.d. max (%)" boxes to have a target s.d. of 10 % of the
assigned value

Figure 7. Evaluation according to the ISO 13528

To calculate mean and standard deviation, e.g. for evaluation according to ISO 13528, in the menu item
STATISTICS - RING TEST PARAMETERS select the desired statistical method on the right, and click on
COMPUTATION.

Figure 8. Computation of ring test parameters

Also, to calculate z scores go to STATISTICS - COMPUTATION OF SCORES AND TOLERANCE
LIMITS.

27
 International Journal Advanced Quality, Vol. 44, No. 3, 2016. year, Belgrade, Serbia.

Charts are generated in CHARTS AND TABLES - SUMMARY RESULTS. In the box labelled VIEW,
chart contents should be defined.

Figure 9. Summary results of measured values

In CHARTS AND TABLES - SURVEY OF Z SCORES. appropriate chart type should be selected.

Figure 10. Survey of Z scores

5. CONCLUSION
Only basic features and basic steps of working
with PROLab were presented in this paper, but it
shows that comprehensive and standardized software
like PROLab can provide computation methods and
structure data for use in different types of
interlaboratory studies thereby enabling the optimized
use of ones data.
Directorate of Measures and Precious Metals has
installed software package PROLab Plus, licenced as
the only one in the Republic of Serbia, and as such, it
will be available to all interested organisers of
interlaboratory comparisons, in our country.
Software was a donation from the Physikalisch-
Technische Bundesanstalt (PTB) project "Support of
the Quality Infrastructure in Serbia", as a help from
the Republic of Germany in the field of Metrology in
Chemistry.
REFERENCES
[1] http://www.quodata.de
[2] PROLab Plus Manual (2015). QuoData GmbH.
[3] ISO IEC 17043 (2010) Conformity assessment General
requirements for proficiency testing
[3] ISO 5725, Accuracy (trueness and precision) of
measurement methods and results
[4] ISO 5725-1:1994, Part 1: General principles and
definitions
[5] ISO 5725-2:1994, Part 2: Basic method for the
determination of repeatability and reproducibility of a
standard measurement method
[6] ISO 5725-3:1994, Part 3: Intermediate measures of the
precision of a standard measurement method
[7] ISO 5725-4:1994, Part 4: Basic methods for the
determination of the trueness of a standard measurement
method
[8] ISO 5725-5:1998, Part 5: Alternative methods for the
determination of a standard measurement method
[9] ISO 5725-6:1994, Part 6: Use in practice of accuracy
values
[10] ISO/IEC 13528, Statistical methods for use in
proficiency testing by interlaboratory comparisons.
28