Вы находитесь на странице: 1из 7

Research Report

Standards for Reporting Qualitative Research:


A Synthesis of Recommendations
Bridget C. O’Brien, PhD, Ilene B. Harris, PhD, Thomas J. Beckman, MD,
Darcy A. Reed, MD, MPH, and David A. Cook, MD, MHPE

Abstract
Purpose the reference lists of retrieved sources; items. The authors define and explain
Standards for reporting exist for many and contacting experts. Specifically, two key elements of each item and provide
types of quantitative research, but authors reviewed a sample of sources examples from recently published articles
currently none exist for the broad to generate an initial set of items that to illustrate ways in which the standards
spectrum of qualitative research. The were potentially important in reporting can be met.
purpose of the present study was to qualitative research. Through an iterative
formulate and define standards for process of reviewing sources, modifying Conclusions
reporting qualitative research while the set of items, and coding all sources The SRQR aims to improve the transpar-
preserving the requisite flexibility to for items, the authors prepared a near- ency of all aspects of qualitative research
accommodate various paradigms, final list of items and descriptions and by providing clear standards for report-
approaches, and methods. sent this list to five external reviewers for ing qualitative research. These standards
feedback. The final items and descrip- will assist authors during manuscript
Method tions included in the reporting standards
The authors identified guidelines, report- preparation, editors and reviewers in
reflect this feedback.
ing standards, and critical appraisal evaluating a manuscript for potential
criteria for qualitative research by search- Results publication, and readers when critically
ing PubMed, Web of Science, and The Standards for Reporting Qualita- appraising, applying, and synthesizing
Google through July 2013; reviewing tive Research (SRQR) consists of 21 study findings.

Q ualitative research contributes to the Qualitative research is increasingly nearly all cases, the authors do not describe
literature in many disciplines by describ- common and valued in the medical how the guidelines were created, and often
ing, interpreting, and generating theories and medical education literature.1,10–13 fail to distinguish reporting quality from
about social interactions and individual However, the quality of such research the other facets of quality (e.g., the research
experiences as they occur in natural, can be difficult to evaluate because of question or methods). Several authors
rather than experimental, situations.1–3 incomplete reporting of key elements.14,15 suggest standards for reporting qualitative
Some recent examples include studies of Quality is multifaceted and includes research,15,20,29–33 but their articles focus
professional dilemmas,4 medical students’ consideration of the importance of on a subset of qualitative data collection
the research question, the rigor of the methods (e.g., interviews), fail to explain
early experiences of workplace l­earning,5
research methods, the appropriateness how the authors developed the reporting
patients’ experiences of disease and
and salience of the inferences, and the criteria, narrowly construe qualitative
­interventions,6–8 and patients’ perspec- clarity and completeness of reporting.16,17 research (e.g., thematic analysis) in ways
tives about incident disclosures.9 The Although there is much debate about that may exclude other approaches, and/
purpose of qualitative research is to un- standards for methodological rigor or lack specific examples to help others
derstand the perspectives/experiences of in qualitative research,13,14,18–20 there is see how the standards might be achieved.
individuals or groups and the contexts in widespread agreement about the need Thus, there remains a compelling need for
which these perspectives or experiences for clear and complete reporting.14,21,22 defensible and broadly applicable standards
are situated.1,2,10 Optimal reporting would enable for reporting qualitative research.
editors, reviewers, other researchers,
and practitioners to critically appraise We designed and carried out the present
Please see the end of this article for information qualitative studies and apply and study to formulate and define standards
about the authors. synthesize the results. One important step for reporting qualitative research through
Correspondence should be addressed to Dr. O’Brien, in improving the quality of reporting is a rigorous synthesis of published articles
Office of Research and Development in Medical to formulate and define clear reporting and expert recommendations.
Education, UCSF School of Medicine, Box 3202,
1855 Folsom St., Suite 200, San Francisco, CA standards.
94143-3202; e-mail: bridget.obrien@ucsf.edu.
Authors have proposed guidelines for the Method
Acad Med. 2014;89:1245–1251.
First published online June 20, 2014
quality of qualitative research, including We formulated standards for reporting
doi: 10.1097/ACM.0000000000000388 those in the fields of medical education,23–25 qualitative research by using a rigor-
Supplemental digital content for this article is clinical and health services research,26–28 ous and systematic approach in which
available at http://links.lww.com/ACADMED/A218. and general education research.29,30 Yet in we reviewed previously ­proposed

Academic Medicine, Vol. 89, No. 9 / September 2014 1245


Research Report

r­ ecommendations by experts in quali- Qualitative Research (SRQR)—summarized Research design and methods. Reporting
tative methods. Our research team in Table 1. on research design and methods of
consisted of two PhD researchers and one data collection and analysis highlights
physician with formal training and ex- To explicate how the final set of stan- several distinctive features of qualitative
perience in qualitative methods, and two dards reflect the material in the origi- research. Many of the criteria we
physicians with experience, but no formal nal sources, two of us (B.O., D.A.C.) reviewed focus not only on identifying
training, in qualitative methods. ­selected by consensus the 25 most com- and describing all aspects of the methods
plete sources of recommendations and (e.g., approach, researcher characteristics
We first identified previously proposed identified which standards reflected the and role, sampling strategy, context,
recommendations by searching PubMed, concepts found in each original source data collection and analysis) but also on
Web of Science, and Google using com- (see Table 2). justifying each choice.13,14 This ensures
binations of terms such as “qualitative that authors make their assumptions and
methods,” “qualitative research,” “qualita- decisions transparent to readers. This
Results standard is less commonly expected in
tive guidelines,” “qualitative standards,”
and “critical appraisal” and by reviewing The SRQR is a list of 21 items that quantitative research, perhaps because
the reference lists of retrieved sources, we consider essential for complete, most quantitative researchers share
reviewing the Equator Network,22 and transparent reporting of qualitative positivist assumptions and generally
contacting experts. We conducted our research (see Table 1). As explained agree about standards for rigor of various
first search in January 2007 and our last above, we developed these items study designs and sampling techniques.14
search in July 2013. Most recommenda- through a rigorous synthesis of prior Just as quantitative reporting standards
tions were published in peer-reviewed recommendations and concepts from encourage authors to describe how
journals, but some were available only published sources (see Table 2; see they implemented methods such as
on the Internet, and one was an interim also Supplemental Digital Appendix randomization and measurement validity,
draft from a national organization. We 1, found at http://links.lww.com/ several qualitative reporting criteria
report the full set of the 40 sources ACADMED/A218) and expert review. recommend that authors describe how
These 21 items provide a framework they implemented a presumably familiar
reviewed in Supplemental Digital
and recommendations for reporting technique in their study rather than
Appendix 1, found at http://links.lww.
qualitative studies. Given the wide simply mentioning the technique.10,14,32
com/ACADMED/A218.
For example, authors often state that
range of qualitative approaches and
data collection occurred until saturation,
Two of us (B.O., I.H.) reviewed an methodologies, we attempted to select
with no mention of how they defined
initial sample of sources to generate a items with broad relevance.
and recognized saturation. Similarly,
comprehensive list of items that were
authors often mention an “iterative
potentially important in reporting The SRQR includes the article’s title
process,” with minimal description of
qualitative research (Draft A). All of us and abstract (items 1 and 2); problem
the nature of the iterations. The SRQR
then worked in pairs to review all sources formulation and research question (items
emphasizes the importance of explaining
and code the presence or absence of each 3 and 4); research design and methods
and elaborating on these important
item in a given source. From Draft A, we of data collection and analysis (items
processes. Nearly all of the original
then distilled a shorter list (Draft B) by 5 through 15); results, interpretation, sources recommended describing the
identifying core concepts and combining discussion, and integration (items 16 characteristics and role of the researcher
related items, taking into account the through 19); and other information (i.e., reflexivity). Members of the research
number of times each item appeared in (items 20 and 21). Supplemental Digital team often form relationships with
these sources. We then compared the Appendix 2, found at http://links.lww. participants, and analytic processes are
items in Draft B with material in the com/ACADMED/A218, contains a highly interpretive in most qualitative
original sources to check for missing detailed explanation of each item, along research. Therefore, reviewers and readers
concepts, modify accordingly, and add with examples from recently published must understand how these relationships
explanatory definitions to create a qualitative studies. Below, we briefly and the researchers’ perspectives and
prefinal list of items (Draft C). describe the standards, with a particular assumptions influenced data collection
focus on those unique to qualitative and interpretation.15,23,26,34
We circulated Draft C to five experienced research.
qualitative researchers (see the acknowl- Results. Reporting of qualitative research
edgments) for review. We asked them to Titles, abstracts, and introductory results should identify the main analytic
note any omitted or redundant items and material. Reporting standards for titles, findings. Often, these findings involve in-
to suggest improvements to the wording abstracts, and introductory material terpretation and contextualization, which
to enhance clarity and relevance across a (problem formulation, research question) represent a departure from the tradition
broad spectrum of qualitative inquiry. In in qualitative research are very similar in quantitative studies of objectively
response to their reviews, we consolidated to those for quantitative research, except reporting results. The presentation of
some items and made minor revisions that the results reported in the abstract results often varies with the specific quali-
to the wording of labels and defini- are narrative rather than numerical, tative approach and methodology; thus,
tions to create the final set of reporting and authors rarely present a specific rigid rules for reporting qualitative find-
standards—the Standards for Reporting hypothesis.29,30 ings are inappropriate. However, authors

1246 Academic Medicine, Vol. 89, No. 9 / September 2014


Research Report

Table 1
Standards for Reporting Qualitative Research (SRQR)a

No. Topic Item


Title and abstract
S1  Title Concise description of the nature and topic of the study Identifying
the study as qualitative or indicating the approach (e.g., ethnography,
grounded theory) or data collection methods (e.g., interview, focus
group) is recommended
S2  Abstract Summary of key elements of the study using the abstract format of
the intended publication; typically includes background, purpose,
methods, results, and conclusions
Introduction
S3   Problem formulation Description and significance of the problem/phenomenon studied;
review of relevant theory and empirical work; problem statement
S4   Purpose or research question Purpose of the study and specific objectives or questions
Methods
S5   Qualitative approach and research paradigm Qualitative approach (e.g., ethnography, grounded theory, case study,
phenomenology, narrative research) and guiding theory if appropriate;
identifying the research paradigm (e.g., postpositivist, constructivist/
interpretivist) is also recommended; rationaleb
S6   Researcher characteristics and reflexivity Researchers’ characteristics that may influence the research, including
personal attributes, qualifications/experience, relationship with
participants, assumptions, and/or presuppositions; potential or actual
interaction between researchers’ characteristics and the research
questions, approach, methods, results, and/or transferability
S7  Context Setting/site and salient contextual factors; rationaleb
S8   Sampling strategy How and why research participants, documents, or events were
selected; criteria for deciding when no further sampling was necessary
(e.g., sampling saturation); rationaleb
S9   Ethical issues pertaining to human subjects Documentation of approval by an appropriate ethics review board
and participant consent, or explanation for lack thereof; other
confidentiality and data security issues
S10   Data collection methods Types of data collected; details of data collection procedures including
(as appropriate) start and stop dates of data collection and analysis,
iterative process, triangulation of sources/methods, and modification
of procedures in response to evolving study findings; rationaleb
S11   Data collection instruments and technologies Description of instruments (e.g., interview guides, questionnaires)
and devices (e.g., audio recorders) used for data collection; if/how the
instrument(s) changed over the course of the study
S12   Units of study Number and relevant characteristics of participants, documents, or
events included in the study; level of participation (could be reported
in results)
S13   Data processing Methods for processing data prior to and during analysis, including
transcription, data entry, data management and security, verification
of data integrity, data coding, and anonymization/deidentification of
excerpts
S14   Data analysis Process by which inferences, themes, etc., were identified and
developed, including the researchers involved in data analysis; usually
references a specific paradigm or approach; rationale b
S15   Techniques to enhance trustworthiness Techniques to enhance trustworthiness and credibility of data analysis
(e.g., member checking, audit trail, triangulation); rationaleb
Results/findings
S16   Synthesis and interpretation Main findings (e.g., interpretations, inferences, and themes); might
include development of a theory or model, or integration with prior
research or theory
S17   Links to empirical data Evidence (e.g., quotes, field notes, text excerpts, photographs) to
substantiate analytic findings
Discussion
S18  Integration with prior work, implications, Short summary of main findings; explanation of how findings
transferability, and contribution(s) to the field and conclusions connect to, support, elaborate on, or challenge
conclusions of earlier scholarship; discussion of scope of application/
generalizability; identification of unique contribution(s) to scholarship
in a discipline or field
S19  Limitations Trustworthiness and limitations of findings
(Table continues)

Academic Medicine, Vol. 89, No. 9 / September 2014 1247


Research Report

Table 1
(Continued)

No. Topic Item


Other
S20   Conflicts of interest Potential sources of influence or perceived influence on study conduct
and conclusions; how these were managed
S21  Funding Sources of funding and other support; role of funders in data
collection, interpretation, and reporting
 aThe authors created the SRQR by searching the literature to identify guidelines, reporting standards, and
critical appraisal criteria for qualitative research; reviewing the reference lists of retrieved sources; and
contacting experts to gain feedback. The SRQR aims to improve the transparency of all aspects of qualitative
research by providing clear standards for reporting qualitative research.
  The rationale should briefly discuss the justification for choosing that theory, approach, method, or technique
b

rather than other options available, the assumptions and limitations implicit in those choices, and how those
choices influence study conclusions and transferability. As appropriate, the rationale for several items might
be discussed together.

should provide evidence (e.g., examples, influence of the context surrounding criteria for methodological rigor or criti-
quotes, or text excerpts) to substantiate events or actions; generating theories cal appraisal rather than reporting; for
the main analytic findings.20,29 about new or poorly understood events, these, we inferred the information that
situations, or actions; and understand- would be needed to evaluate the crite-
Discussion. The discussion of quali- ing the processes that led to a desired rion. Occasionally, we found conflicting
tative results will generally include (or undesired) outcome.38 Many dif- recommendations in the literature (e.g.,
connections to existing literature and/ ferent approaches (e.g., ethnography, recommending specific techniques such
or theoretical or conceptual frame- phenomenology, discourse analysis, case as multiple coders or member checking
works, the scope and boundaries of study, grounded theory) and method- to demonstrate trustworthiness); we
the results (transferability), and study ologies (e.g., interviews, focus groups, resolved these conflicting recommen-
limitations.10–12,28 In some qualitative observation, analysis of documents) dations through selection of the most
traditions, the results and discussion may be used in qualitative research, frequent recommendations and by
may not have distinct boundaries; we each with its own assumptions and consensus among ourselves.
recommend that authors include the traditions.1,2 A strength of many quali-
substance of each item regardless of tative approaches and methodolo- Some qualitative researchers have
the section in which it appears. gies is the opportunity for flexibility described the limitations of checklists
and adaptability throughout the data as a means to improve methodological
collection and analysis process. We rigor.13 We nonetheless believe that a
Discussion endeavored to maintain that flexibility checklist for reporting standards will
The purpose of the SRQR is to improve by intentionally defining items to avoid help to enhance the transparency of
the quality of reporting of qualitative favoring one approach or method over qualitative research studies and thereby
research studies. We hope that these others. As such, we trust that the SRQR advance the field.29,39
21 recommended reporting standards will support all approaches and meth-
will assist authors during manuscript ods of qualitative research by making Strengths of this work include the ground-
preparation, editors and reviewers in reports more explicit and transparent, ing in previously published criteria, the
evaluating a manuscript for potential while still allowing investigators the diversity of experience and perspectives
publication, and readers when critically flexibility to use the study design and among us, and critical review by experts
appraising, applying, and synthesizing reporting format most appropriate to in three countries.
study findings. As with other reporting their study. It may be helpful, in the
guidelines,35–37 we anticipate that the ­future, to develop approach-specific ex- Implications and application
SRQR will evolve as it is applied and tensions of the SRQR, as has been done Similar to other reporting guidelines,35–37
evaluated in practice. We welcome for guidelines in quantitative research the SRQR may be viewed as a starting
suggestions for refinement. (e.g., the CONSORT extensions).37 point for defining reporting standards
in qualitative research. Although our
Qualitative studies explore “how?” and Limitations, strengths, and boundaries personal experience lies in health
“why?” questions related to social or hu- We deliberately avoided recommenda- professions education, the SRQR is
man problems or phenomena.10,38 Pur- tions that define methodological rigor, based on sources originating in diverse
poses of qualitative studies include un- and therefore it would be inappropriate health care and non-health-care fields.
derstanding meaning from participants’ to use the SRQR to judge the quality of We intentionally crafted the SRQR to
perspectives (How do they interpret or research methods and findings. Many include various paradigms, approaches,
make sense of an event, situation, or of the original sources from which we and methodologies used in qualitative
action?); understanding the nature and derived the SRQR were intended as research. The elaborations offered in

1248 Academic Medicine, Vol. 89, No. 9 / September 2014


Research Report

Table 2
Alignment of the 21 Standards for Reporting Qualitative Research (SRQR) With
Recommendations From 25 Original Sourcesa

Reference no.b
No. Topic 11,12 15c 19 20c 23 24,25d 26 27 29c,d 30c,d 31c 32c 33 34 41 42 43 44c 45 46 47 48 49 50
S1 Title * * * *
S2 Abstract * * * *
S3 Problem * * * * * * * * * * * * * * * *
formulation
S4 Purpose or * * * * * * * * * * * * * * * * * * * * * * *
research
question
S5 Qualitative * * * * * * * * * * * * * * * * * * *
approach
and research
paradigm
S6 Researcher * * * * * * * * * * * * * * * * * * * * * *
characteristics,
reflexivity
S7 Context * * * * * * * * * * * * * * * * * *
S8 Sampling * * * * * * * * * * * * * * * * * * * * * *
strategy
S9 Ethical issues * * * * * * * * * * * * * *
pertaining to
human subjects
S10 Data collection * * * * * * * * * * * * * * * * * * * * * * * *
methods
S11 Data collection * * * * * * * * * * *
instruments/
technologies
S12 Units of study * * * * * * * * * * * * *
S13 Data processing * * * * * * * * * * *
S14 Data analysis * * * * * * * * * * * * * * * * * * * * * * * *
S15 Techniques * * * * * * * * * * * * * * * * * * * * * * *
to enhance
trustworthiness
S16 Synthesis and * * * * * * * * * * * * * * * * * * * *
interpretation
S17 Links to * * * * * * * * * * * * * * * * * *
empirical data
S18 Integration with * * * * * * * * * * * * * * * * * * * * *
prior work,
implications,
transferability,
and
contribution(s)
S19 Limitations * * * * * * * * * * * *
S20 Conflicts of * *
interest
S21 Funding * * *
 aThe authors created the SRQR by searching the literature to identify guidelines, reporting standards, and critical
appraisal criteria for qualitative research; reviewing the reference lists of retrieved sources; and contacting experts to
gain feedback. The SRQR aims to improve the transparency of all aspects of qualitative research by providing clear
standards for reporting qualitative research. In the table, the asterisks indicate which sources mentioned which topics.
 bThe numbers in column headings are the numbers of the citations in the reference list at the end of this report.
Those citations are of original sources describing criteria for reporting and/or critical appraisal of qualitative
research, which the authors used in creating the SRQR.
 cFocuses on reporting standards (all other sources focus on quality standards or guidelines for critical review/evaluation).
 dAddresses quantitative and qualitative research.

Supplemental Digital Appendix 2 (see description and examples to enable SRQR should apply broadly across
http://links.lww.com/ACADMED/ both novice and experienced researchers disciplines, methodologies, topics, study
A218) should provide sufficient to use these standards. Thus, the participants, and users.

Academic Medicine, Vol. 89, No. 9 / September 2014 1249


Research Report

The SRQR items reflect information Hauer, MD, Ayelet Kuper, MD, DPhil, Arianne 7 Pinnock H, Kendall M, Murray SA, et
essential for inclusion in a qualitative Teherani, PhD, and participants in the UCSF al. Living and dying with severe chronic
weekly educational scholarship works-in-progress obstructive pulmonary disease: Multi-
research report, but should not be perspective longitudinal qualitative study.
group (ESCape) for critically reviewing the
viewed as prescribing a rigid format or Standards for Reporting Qualitative Research. BMJ. 2011;342:d142.
standardized content. Individual study 8 Brady MC, Clark AM, Dickson S, Paton G,
needs, author preferences, and journal Funding/Support: This study was funded in part Barbour RS. Dysarthria following stroke: The
by a research review grant from the Society for patient’s perspective on management and
requirements may necessitate a different
Directors of Research in Medical Education. rehabilitation. Clin Rehabil. 2011;25:935–952.
sequence or organization than that shown 9 Iedema R, Allen S, Britton K, et al. Patients’
in Table 1. Journal word restrictions may Other disclosures: None reported. and family members’ views on how clinicians
prevent a full exposition of each item, enact and how they should enact incident
and the relative importance of a given Ethical approval: Reported as not applicable. disclosure: The “100 patient stories”
qualitative study. BMJ. 2011;343:d4423.
item will vary by study. Thus, although Disclaimer: The funding agency had no role in 10 Kuper A, Reeves S, Levinson W. An
all 21 standards would ideally be reflected the study design, analysis, interpretation, writing introduction to reading and appraising
in any given report, authors should of the manuscript, or decision to submit the qualitative research. BMJ. 2008;337:404–407.
prioritize attention to those items that are manuscript for publication. 11 Giacomini M, Cook, DJ. Users’ guides to the
medical literature: XXIII. Qualitative research
most relevant to the given study, findings,
in health care A. Are the results of the study
context, and readership. Dr. O’Brien is assistant professor, Department of
valid? JAMA. 2000;284:357–362.
Medicine and Office of Research and Development
in Medical Education, University of California,
12 Giacomini M, Cook, DJ. Users’ guides to the
Application of the SRQR need not be San Francisco, School of Medicine, San Francisco, medical literature: XXIII. Qualitative research
limited to the writing phase of a given California. in health care B. What are the results and
how do they help me care for my patients?
study. These standards can assist re- Dr. Harris is professor and head, Department of JAMA. 2000;284:478–482.
searchers in planning qualitative studies Medical Education, University of Illinois at Chicago 13 Barbour RS. Checklists for improving rigour
and in the careful documentation of College of Medicine, Chicago, Illinois. in qualitative research: A case of the tail
processes and decisions made throughout Dr. Beckman is professor of medicine and medical
wagging the dog? BMJ. 2001;322:1115–1117.
14 Dunt D, McKenzie R. Improving the
the study. By considering these recom- education, Department of Medicine, Mayo Clinic
College of Medicine, Rochester, Minnesota. quality of qualitative studies: Do reporting
mendations early on, researchers may guidelines have a place? Fam Pract.
be more likely to identify the paradigm Dr. Reed is associate professor of medicine and 2012;29:367–369.
and approach most appropriate to their medical education, Department of Medicine, Mayo 15 Tong A, Sainsbury P, Craig J. Consolidated
Clinic College of Medicine, Rochester, Minnesota. criteria for reporting qualitative research
research, consider and use strategies for
Dr. Cook is associate director, Mayo Clinic Online
(COREQ): A 32-item checklist for interviews
ensuring trustworthiness, and keep track and focus groups. Int J Qual Health Care.
Learning, research chair, Mayo Multidisciplinary
of procedures and decisions. 2007;19:349–357.
Simulation Center, and professor of medicine and
medical education, Mayo Clinic College of Medicine, 16 Cook DA, Bowen JL, Gerrity MS, et al.
Journal editors can facilitate the review Rochester, Minnesota. Proposed standards for medical education
submissions to the Journal of General
process by providing the SRQR to
Internal Medicine. J Gen Intern Med.
reviewers and applying its standards, thus 2008;23:908–913.
establishing more explicit expectations References 17 Tracy SJ. Qualitative quality: Eight “big-tent”
for qualitative studies. Although the 1 Lingard L, Kennedy TJ. Qualitative research criteria for excellent qualitative research.
recommendations do not address or in medical education. In: Swanwick T, ed. Qual Inq. 2010;16:837–851.
Understanding Medical Education: Evidence, 18 Lincoln YS. Emerging criteria for quality in
advocate specific approaches, methods, or Theory and Practice. Oxford, UK: Wiley- qualitative and interpretive research. Qual
quality standards, they do help reviewers Blackwell; 2010:323–335. Inq. 1995;1:275–289.
identify information that is missing from 2 Harris IB. Qualitative methods. In: Norman 19 Mays N, Pope C. Qualitative research in
manuscripts. GR, van der Vleuten CPM, Newble DI, eds. health care. Assessing quality in qualitative
International Handbook of Research in research. BMJ. 2000;320:50–52.
Medical Education. Dordrecht, Netherlands: 20 Burns N. Standards for qualitative research.
As authors and editors apply the SRQR, Kluwer Academic Publishers; 2002:45–95. Nurs Sci Q. 1989;2:44–52.
readers will have more complete informa- 3 Denzin N, Lincoln Y. Introduction: The 21 Ryan GW. What Are Standards of Rigor for
tion about a given study, thus facilitating discipline and practice of qualitative research. Qualitative Research? 2005. http://www.wjh.
judgments about the trustworthiness, In: The Sage Handbook of Qualitative harvard.edu/nsfqual/Ryan%20Paper.pdf.
Research. 3rd ed. Thousand Oaks, Calif: Sage Accessed April 20, 2014.
relevance, and transferability of findings Publications, Inc.; 2005:1–32. 22 The EQUATOR Network: Enhancing the
to their own context and/or to related 4 Ginsburg S, Bernabeo E, Ross KM, Holmboe quality and transparency of health research.
literature. Complete reporting will also ES. “It depends”: Results of a qualitative http://www.equator-network.org. Accessed
facilitate meaningful synthesis of qualita- study investigating how practicing internists April 6, 2014.
approach professional dilemmas. Acad Med. 23 Côté L, Turgeon J. Appraising qualitative
tive results across studies.40 We anticipate
2012;87:1685–1693. research articles in medicine and medical
that such transparency will, over time, 5 Yardley S, Brosnan C, Richardson J, Hays education. Med Teach. 2005;27:71–75.
help to identify previously unappreci- R. Authentic early experience in medical 24 Bordage G, Caelleigh AS. A tool for reviewers:
ated gaps in the rigor and relevance of education: A socio-cultural analysis “Review criteria for research manuscripts.”
research findings. Investigators, editors, identifying important variables in learning Acad Med. 2001;76:904–951.
interactions within workplaces. Adv Health 25 Task Force of Academic Medicine and
and educators can then work to remedy Sci Educ Theory Pract. 2013;18:873–891. the GEA-RIME Committee. Appendix 1:
these deficiencies and, thereby, enhance 6 Embuldeniya G, Veinot P, Bell E, et al. The Checklist of review criteria. Acad Med.
the overall quality of qualitative research. experience and impact of chronic disease 2001;76:958–959.
peer support interventions: A qualitative 26 Malterud K. Qualitative research: Standards,
Acknowledgments: The authors thank Margaret synthesis. Patient Educ Couns. 2013;92: challenges, and guidelines. Lancet.
Bearman, PhD, Calvin Chou, MD, PhD, Karen 3–12. 2001;358:483–488.

1250 Academic Medicine, Vol. 89, No. 9 / September 2014


Research Report

27 Inui TS, Frankel RM. Evaluating the quality observational studies. BMJ. 2007;335: checklist-31.05.13.pdf#!casp-tools-checklists/
of qualitative research: A proposal pro tem. 806–808. c18f8. Accessed April 6, 2014.
J Gen Intern Med. 1991;6:485–486. 36 Davidoff F, Batalden P, Stevens D, Ogrinc 44 Frambach JM, van der Vleuten CP, Durning
28 Devers KJ. How will we know” good” G, Mooney S; SQUIRE Development SJ. AM last page. Quality criteria in
qualitative research when we see it? Group. Publication guidelines for quality qualitative and quantitative research. Acad
Beginning the dialogue in health services improvement in health care: Evolution of Med. 2013;88:552.
research. Health Serv Res. 1999;34:1153. the SQUIRE project. Qual Saf Health Care. 45 Kuper A, Lingard L, Levinson W. Critically
29 Duran RP, Eisenhart MA, Erickson FD, et al. 2008;17(suppl 1):i3–i9. appraising qualitative research. BMJ.
Standards for reporting on empirical social 37 Schulz KF, Altman DG, Moher D; CONSORT 2008;337:687–689.
science research in AERA publications. Educ Group. CONSORT 2010 statement: Updated 46 Law M, Stewart D, Letts L, Pollock N, Bosch
Res. 2006;35:33–40. guidelines for reporting parallel group J, Westmorland M. Guidelines for the critical
30 Newman M, Elbourne D. Improving the randomised trials. BMJ. 2010;340:c332. review of qualitative studies. McMaster
usability of educational research: Guidelines 38 Maxwell JA. Designing a qualitative study. In: University Occupational Therapy Evidence-
for the reporting of primary empirical Bickman L, Bog D, eds. The SAGE Handbook Based Practice Research Group. 1998. http://
research studies in education (The REPOSE of Applied Social Research Methods. 2nd ed. www.usc.edu/hsc/ebnet/res/Guidelines.pdf.
Guidelines). Eval Res Educ. 2004;18:201–212. Sage Publications, Inc.; 2009:214–253. Accessed April 20, 2014.
31 Knafl KA, Howard MJ. Interpreting and 39 Meyrick J. What is good qualitative research? 47 Pearson A, Field J, Jordan Z. Appendix 2:
reporting qualitative research. Res Nurs A first step towards a comprehensive Critical appraisal tools. In: Evidence-Based
Health. 1984;7:17–24. approach to judging rigour/quality. J Health Clinical Practice in Nursing and Health
32 Kitto SC, Chesters J, Grbich C. Quality Psychol. 2006;11:799–808. Care: Assimilating Research, Experience and
in qualitative research. Med J Aust. 40 Bearman M, Dawson P. Qualitative synthesis Expertise. Oxford, UK: Blackwell Publishing
2008;188:243–246. and systematic review in health professions Ltd.; 2009:177–182. http://onlinelibrary.
33 Rowan M, Huston P. Qualitative research education. Med Educ. 2013;47:252–260. wiley.com/doi/10.1002/9781444316544.app2/
articles: Information for authors and peer summary. Accessed April 13, 2014.
reviewers. CMAJ. 1997;157:1442–1446. References Cited Only in Table 2 48 Popay J, Rogers A, Williams G. Rationale
34 Cohen D, Crabtree B. Guidelines for and standards for the systematic review
designing, analyzing, and reporting qualitative 41 Attree P, Milton B. Critically appraising of qualitative literature in health services
research. Qualitative Research Guidelines qualitative research for systematic reviews. research. Qual Health Res. 1998;8:
Project, Robert Wood Johnson Foundation. Evid Policy. 2006;2:109–126. 341–351.
2006. http://qualres.org/HomeGuid-3868. 42 Blaxter M. Criteria for the evaluation of 49 Sandelowski M, Barroso J. Writing
html. Accessed April 6, 2014. qualitative research. Med Sociol News. the proposal for a qualitative research
35 Elm E von, Altman DG, Egger M, Pocock 1996;22:34–37. methodology project. Qual Health Res.
SJ, Gøtzsche PC, Vandenbroucke JP. 43 Critical Appraisal Skills Programme 2003;13:781–820.
Strengthening the reporting of observational (CASP). Qualitative Research Checklist. 50 Stige B, Malterud K, Midtgarden T. Toward an
studies in epidemiology (STROBE) 2013. http://www.casp-uk.net/wp-content/ agenda for evaluation of qualitative research.
statement: Guidelines for reporting uploads/2011/11/casp-qualitative-research- Qual Health Res. 2009;19:1504–1516.

Academic Medicine, Vol. 89, No. 9 / September 2014 1251

Вам также может понравиться