Академический Документы
Профессиональный Документы
Культура Документы
Richard L. Haspel,1 Yulia Lin,2 Ranjeeta Mallick,3 Alan Tinmouth,4 Joan Cid,5 Hermann Eichler,6
Miguel Lozano,5 Leo van de Watering,7 Patrick B. Fisher,8 Asma Ali,8 and Eric Parks8
for the BEST-TEST Investigators
B
lood transfusion is the most common hospital
BACKGROUND: Blood transfusion is the most procedure performed in the United States.1
common hospital procedure performed in the United There is ample evidence, however, of inappro-
States. While inadequate physician transfusion medi- priate use of transfusions with a number of
cine knowledge may lead to inappropriate practice, studies documenting a lack of evidence-based practice.2-4
such an educational deficit has not been investigated In fact, a Joint Commission and American Medical Asso-
on an international scale using a validated assessment ciation (AMA) report identified transfusion as one of the
tool. Identifying specific deficiencies is critical for devel- five most overused medical procedures.5 Furthermore,
oping curricula to improve patient care. transfusions can pose risks, such as circulatory overload
STUDY DESIGN AND METHODS: Rasch analysis, a
method used in high-stakes testing, was used to vali-
date an assessment tool consisting of a 23-question
ABBREVIATION: PGY = postgraduate year.
survey and a 20-question examination. The assessment
tool was administered to internal medicine residents to From the 1Department of Pathology, Beth Israel Deaconess
determine prior training, attitudes, perceived ability, and Medical Center and Harvard Medical School, Boston,
actual knowledge related to transfusion medicine. Massachusetts; the 2Department of Clinical Pathology,
RESULTS: A total of 474 residents at 23 programs in Sunnybrook Health Sciences Centre, and the Department of
nine countries completed the examination. The overall Laboratory Medicine and Pathobiology, University of Toronto,
mean score of correct responses was 45.7% (site Toronto, Ontario, Canada; the 3Clinical Epidemiology Program,
range, 32%-56%). The mean score for Postgraduate Ottawa Hospital Research Institute, and the 4Department of
Year (PGY)1 (43.9%) was significantly lower than for Medicine, Ottawa Hospital and University of Ottawa, Ottawa,
PGY3 (47.1%) and PGY4 (50.6%) residents. Although Ontario, Canada; the 5Department of Hemotherapy and
89% of residents had participated in obtaining informed Hemostasis, University Clinic Hospital, Barcelona, Spain; the
6
consent from a patient for transfusion, residents scored Institute of Clinical Hemostaseology and Transfusion Medicine,
poorly (<25% correct) on questions related to transfu- Saarland University Hospital, Homburg/Saar, Germany; the
7
sion reactions. The majority of residents (65%) would Center for Clinical Transfusion Research, Sanquin/LUMC,
find additional transfusion medicine training “very” or Leiden, the Netherlands; and the 8American Society for Clinical
“extremely” helpful. Pathology (ASCP), Chicago, Illinois.
CONCLUSION: Internationally, internal medicine resi- Address reprint requests to: Richard L. Haspel, MD, PhD,
dents have poor transfusion medicine knowledge and Beth Israel Deaconess Medical Center, 330 Brookline Avenue,
would welcome additional training. The especially Yamins 309, Boston, MA 02215; e-mail:
limited knowledge of transfusion reactions suggests an rhaspel@bidmc.harvard.edu.
initial area for focused training. This study not only rep- This study was funded by the Biomedical Excellence for
resents the largest international assessment of transfu- Safer Transfusions (BEST) Collaborative.
sion medicine knowledge, but also serves as a model Received for publication July 29, 2014; revision received
for rigorous, collaborative research in medical October 3, 2014, and accepted November 3, 2014.
education. doi: 10.1111/trf.12968
© 2014 AABB
TRANSFUSION **;**:**-**.
and transfusion-related acute lung injury (TRALI), which less of specialty. These residents were eligible to take the
can result in significant morbidity and mortality.6 Transfu- exam as were those individuals then specializing in inter-
sions have also been associated with worse outcomes in a nal medicine and completing the subsequent additional
variety of clinical settings.7-10 required training (up to 3 years). As such, the majority of
To ensure appropriate and safe transfusions, physi- data are derived from responses by Postgraduate Year
cians must learn evidence-based practice. Unfortunately, (PGY) 1 to 3 residents with a small percentage of PGY4
data suggest that there is significant variability and con- or 5.
siderable room for improvement in transfusion medicine
education.11,12 In a survey of 86 medical schools in the Design of the exam
United States, the majority spent less than 3 hours of cur- The exam design and validation process has been previ-
ricular time on didactic teaching related to transfusion ously published.19 Briefly, content was generated by
medicine topics.11 The Joint Commission and AMA report members of the Biomedical Excellence for Safer Transfu-
recognized “gaps in medical school and continuing pro- sions (BEST) Collaborative (http://www.bestcollaborative
fessional education” and noted that “there are very short .org). Using a modified Delphi method, this international
exposures to transfusion medicine in crowded medical group of transfusion medicine experts generated a priority
school and residency curricula, and most ordering physi- list of “knowledge or skills related to transfusion medicine
cians do not receive additional education on transfusion that are absolutely essential for physicians who are not
medicine.”5 transfusion medicine specialists (e.g., internists, cardiolo-
A transfusion medicine knowledge needs assessment gists), but whose practice includes the transfusion of
is required to best understand and then address these edu- blood products.” Based on this list, questions were then
cational deficits.13 While several studies have administered developed by BEST Collaborative members with the assis-
transfusion medicine assessment tools to physicians, the tance of the American Society of Clinical Pathology.
exams and surveys underwent minimal validation.14-18 In This organization oversees the US Pathology Resident
addition, generalizability was limited as the study popula- In-service Exam as well as laboratory technologist certifi-
tions were confined to either a single center or a region. cation exams.24 Questions were multiple choice with one
We previously published a rigorously validated correct answer and four distractors. Validation was per-
transfusion medicine exam.19 Using Rasch analysis, a formed by administering the exam to individuals with
method used in high-stakes testing, our exam showed expected a priori basic, intermediate, and expert knowl-
excellent reliability and ability to distinguish between edge of transfusion medicine. Results were evaluated
individuals with different levels of transfusion medicine using Rasch analysis (Winsteps; www.winsteps.com). This
knowledge.19-22 In this study, we administered this exam, psychometric approach, used in testing for medical licen-
as well as a validated survey regarding attitudes and per- sure and certification, compares exam results to those
ceived abilities related to transfusion medicine, interna- predicted by a model based on question difficulty and
tionally to internal medicine residents. Encompassing examinee ability.20,21 Exam quality is determined by calcu-
more than 23 sites in nine countries, this study represents lating the “fit” of each question with the model with an
one of the largest medical education needs assessments ideal score of 1.00. The final 20-question exam demon-
and can help direct future transfusion medicine educa- strated a reliability of 0.80 and an ideal average question fit
tional initiatives. In addition, our work demonstrates the score of 1.00.
utility of a collaborative approach, similar to oncology
study groups that enroll large numbers of patients to Design of the survey tool to assess resident
answer important clinical questions, in medical education attitudes and perceived knowledge
research.23 The survey included questions on demographics, prior
transfusion medicine training during medical school and
MATERIALS AND METHODS residency, and resident attitudes and perceived knowl-
edge related to transfusion medicine. The survey was par-
Participants tially based on a prior validated survey examining resident
Participants included residents specializing in internal knowledge of biostatistics.25 The current survey was vali-
medicine in all years of training or residents completing dated using responses from anesthesiology residents and
internal medicine training before entering another spe- faculty. This group was chosen as one having transfusion
cialty (e.g., anesthesiology). Individuals who had already experience but who would not be involved in the internal
entered subspecialty training (e.g., hematology, cardiol- medicine resident study. A total of 35 anesthesiology resi-
ogy) were excluded. The majority of programs have up to dents and faculty took the survey and were included in the
3 years of internal medicine training before entering a validation. Again, Rasch analysis was used to determine
subspecialty. In some countries, there are 1 or 2 years of reliability and question fit.22 The Rasch model compares
“foundation” training, completed by all physicians regard- the individuals surveyed and the questions in the context