Вы находитесь на странице: 1из 172

Results of the 2016 NRMP

Program Director Survey

June 2016
www.nrmp.org
Requests for permission to use these data as well as questions about the content of this
publication or the National Resident Matching Program data and reports may be directed to
Mei Liang, Director of Research, NRMP, at datarequest@nrmp.org.

Questions about the NRMP should be directed to Mona M. Signer, President and CEO, NRMP,
at admin@nrmp.org.

Suggested Citation
National Resident Matching Program, Data Release and Research Committee: Results of the
2016 NRMP Program Director Survey. National Resident Matching Program, Washington, DC.
2016.

Copyright 2016 National Resident Matching Program. All rights reserved. Permission to use,
copy and/or distribute any documentation and/or related images from this publication shall be
expressly obtained from the NRMP.
Table of Contents

Introduction .................................................................................................................................................................. 1
All Specialties............................................................................................................................................................... 2

Charts for Individual Specialties


Anesthesiology ....................................................................................................................................................... 9
Child Neurology ................................................................................................................................................... 16
Dermatology ......................................................................................................................................................... 23
Emergency Medicine ........................................................................................................................................... 30
Family Medicine ................................................................................................................................................... 37
Internal Medicine.................................................................................................................................................. 44
Internal Medicine/Pediatrics ................................................................................................................................. 51
Neurological Surgery............................................................................................................................................ 58
Neurology ............................................................................................................................................................. 65
Obstetrics and Gynecology .................................................................................................................................. 72
Orthopaedic Surgery ............................................................................................................................................. 79
Otolaryngology ..................................................................................................................................................... 86
Pathology .............................................................................................................................................................. 93
Pediatrics ............................................................................................................................................................ 100
Physical Medicine and Rehabilitation ................................................................................................................ 107
Plastic Surgery .................................................................................................................................................... 114
Psychiatry ........................................................................................................................................................... 121
Radiation Oncology ............................................................................................................................................ 128
Radiology-Diagnostic ......................................................................................................................................... 135
Surgery ............................................................................................................................................................... 142
Thoracic Surgery ................................................................................................................................................ 149
Transitional Year ................................................................................................................................................ 156
Vascular Surgery ................................................................................................................................................ 163
Introduction
In March 2016, the National Resident Matching Program this survey, program directors were asked to indicate the
(NRMP) conducted its biennial survey of the directors of all percentage of interview invitations sent and interviews
programs participating in the Main Residency Match. The conducted in certain time periods. They also were asked how
primary purpose of the survey was to shed light on the factors often they interviewed and ranked candidates from each
that program directors use to (1) select applicants to interview applicant group. In addition, program directors rated factors
and (2) rank applicants for the Match. used in assessing residents' success. In surveys conducted
prior to 2014, program directors were asked to indicate
The survey was fielded during the 18 days between the Rank factors they used in selecting applicants to interview and to
Order List Deadline and Match Week so that program match rate the importance of each factor in ranking. Beginning with
outcomes would not influence respondents' answers. the 2014 survey, program directors have been asked to
indicate factors they used in selecting applicants to interview
The survey solicited information on:
and rank and rate their importance on a scale of 1 to 5.
the number of applications received, screened, and
reviewed, as well as the number of applicants interviewed Numbers of responses are presented in most of the graphs,
and ranked and some graphs use data from multiple survey questions. In
whether the program typically interviews and ranks specific those cases, different N's are listed. Numbers of applicants
applicant groups ranked and positions in the Match are extracted from the
use of test scores in considering which applicants to i NRMP database. Graphs are suppressed for questions with
nterview, and fewer than five responses.
the factors used for both interview selection and for ranking
applicants. This report presents results by specialty on selected items
from the survey. The NRMP hopes that program directors,
The overall response rate for all specialties in this report was medical school officials, and applicants find these data
39.9 percent. Transitional Year programs and programs in 22 useful as they prepare for and participate in the Main
specialties with 10 or more responses are included in this report. Residency Match.
_______________
Response rates are listed in the table below. The NRMP's data reporting and research activities are guided by
its Data Release and Research Committee. NRMP data and
Additional questions were added to the 2016 questionnaire. In reports can be found at: www.nrmp.org/match-data/.
Specialty Surveys Sent Num ber Responding Response Rate
Anesthesiology 129 57 44.2%
ChildNeurology 70 36 51.4%
Dermatology 113 39 34.5%
EmergencyMedicine 166 80 48.2%
FamilyMedicine 454 190 41.9%
InternalMedicine 408 163 40.0%
InternalMedicine/Pediatrics 79 28 35.4%
NeurologicalSurgery 105 32 30.5%
Neurology 132 55 41.7%
ObstetricsandGynecology 236 95 40.3%
OrthopaedicSurgery 150 66 44.0%
Otolaryngology 100 31 31.0%
Pathology 133 58 43.6%
Pediatrics 188 92 48.9%
PhysicalMedicineandRehabilitation 78 34 43.6%
PlasticSurgery 69 28 40.6%
Psychiatry 185 80 43.2%
RadiationOncology 82 28 34.1%
RadiologyDiagnostic 176 55 31.3%
SurgeryGeneral 277 96 34.7%
ThoracicSurgery 27 12 44.4%
TransitionalYear 88 27 30.7%
VascularSurgery 48 15 31.3%
AllOthers 106 38 35.8%
Total 3,599 1,435 39.9%
NRMP Program Director Survey Results, 2016 1
All Specialties Combined
(N=1,435)
All Specialties
Figure 1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=1,300)
Percent Citing Factor Average Rating
USMLEStep1/COMLEXLevel1score 93% 4.2
Lettersofrecommendationinthespecialty 88% 4.2
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 84% 4.1
USMLEStep2CK/COMLEXLevel2CEscore 83% 4.1
Gradesinrequiredclerkships 79% 4.1
PersonalStatement 78% 3.8
Classranking/quartile 71% 3.9
AnyfailedattemptinUSMLE/COMLEX 70% 4.6
Gradesinclerkshipindesiredspecialty 70% 4.3
Evidenceofprofessionalismandethics 70% 4.5
Perceivedcommitmenttospecialty 71% 4.3
Personalpriorknowledgeoftheapplicant 70% 4.2
Leadershipqualities 66% 4.1
Auditionelective/rotationwithinyourdepartment 66% 4.1
Consistencyofgrades 64% 4.1
PassUSMLEStep2CS/COMLEXLevel2PE 62% 4.2
AlphaOmegaAlpha(AOA)membership 61% 3.9
Perceivedinterestinprogram 61% 4.1
Lackofgapsinmedicaleducation 58% 4.0
Otherlifeexperience 59% 3.7
Awardsorspecialhonorsinclinicalclerkships 58% 3.7
GraduateofhighlyregardedU.S.medicalschool 56% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 54% 3.9
Volunteer/extracurricularexperiences 54% 3.8
GoldHumanismHonorSociety(GHHS)membership 45% 3.8
Demonstratedinvolvementandinterestinresearch 44% 3.7
Visastatus* 42% 4.1
ApplicantwasflaggedwithMatchviolationbytheNRMP 40% 4.7
Awardsorspecialhonorsinbasicsciences 29% 3.3
Interestinacademiccareer 28% 3.8
Awayrotationinyourspecialtyatanotherinstitution 27% 3.7
Fluencyinlanguagespokenbyyourpatientpopulation 26% 3.8
USMLEStep3/COMLEXLevel3score 20% 3.4
Ratings on a scale from 1 (not at all important) to 5 (very important).
100% 50% 0% 1 2 3 4 5
* International Medical Graduates only
NRMP Program Director Survey Results, 2016 3
All Specialties
Figure 2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=1,275)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 95% 4.8


Interpersonalskills 95% 4.8
Interactionswithhousestaffduringinterviewandvisit 90% 4.8
Feedbackfromcurrentresidents 86% 4.7
USMLEStep1/COMLEXLevel1score 78% 4.1
Lettersofrecommendationinthespecialty 73% 4.1
USMLEStep2CK/COMLEXLevel2CEscore 72% 4.1
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 68% 4.1
Evidenceofprofessionalismandethics 67% 4.6
Perceivedcommitmenttospecialty 67% 4.4
Perceivedinterestinprogram 64% 4.2
Personalpriorknowledgeoftheapplicant 60% 4.3
Classranking/quartile 58% 4.0
Leadershipqualities 59% 4.2
Gradesinrequiredclerkships 57% 4.1
PersonalStatement 57% 3.7
Auditionelective/rotationwithinyourdepartment 58% 4.3
PassingUSMLEStep2CS/COMLEXLevel2PE 53% 4.2
Gradesinclerkshipindesiredspecialty 50% 4.2
AnyfailedattemptinUSMLE/COMLEX 47% 4.5
Consistencyofgrades 47% 4.1
AlphaOmegaAlpha(AOA)membership 46% 4.0
Otherlifeexperience 46% 3.8
GraduateofhighlyregardedU.S.medicalschool 41% 3.9
Lackofgapsinmedicaleducation 41% 4.1
Volunteer/extracurricularexperiences 40% 3.8
Awardsorspecialhonorsinclinicalclerkships 38% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 36% 3.9
GoldHumanismHonorSociety(GHHS)membership 34% 3.9
Demonstratedinvolvementandinterestinresearch 32% 3.8
ApplicantwasflaggedwithMatchviolationbytheNRMP 28% 4.7
Visastatus* 26% 4.2
Interestinacademiccareer 25% 3.9
Awardsorspecialhonorsinbasicsciences 21% 3.4
Fluencyinlanguagespokenbyyourpatientpopulation 21% 4.0
Secondinterview/visit 22% 3.7
Awayrotationinyourspecialtyatanotherinstitution 20% 3.9
USMLEStep3/COMLEXLevel3score 19% 3.7
Otherpostinterviewcontact 18% 3.7
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 4


All Specialties
Figure 3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 1 Score


Scores required? Would your program consider applicants who fail the
100% N=1,245 exam on the first attempt?
100% N=1,224

80%
67% 80%

60% 59%
60%

40%
32% 40%
30%
20% 20%
11%
1%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail the
100% exam on the first attempt?
N=1,214 100% N=1,132

80%
80%

60%
60% 57%
49%

40% 34% 40% 35%

20% 17% 20%


8%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

USMLE Step 1 and Step 2 CK Scores


Programs Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170
USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK
N=733 N=522 N=546 N=403

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol in the box represents the mean.

NRMP Program Director Survey Results, 2016 5


All Specialties
Figure 4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores


USMLE Step 2 Clinical Skills (CS) USMLE Step 3
100% N=1,196 100% N=813

90% 90%
80% 78% 80%
72%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
22% 19%
20% 20%
10% 10% 8%
N=46 N=29
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100% N=891 100% N=870

90% 90%
80% 80%
70% 70%
60% 60%
50% 50%
40%
40% 37% 40% 35%
34%
30%
30% 30%
22%
20% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=857 100% N=638

90% 90%
80% 80% 74%
70% 70%
60% 60%
53%
50% 50%
40% 35% 40%
30% 30%
19%
20% 20%
12%
10% 10% 7%

0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 6


All Specialties
Figure 5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and Reviewed
Invitations Sent, and Applicants Interviewed and Ranked 100%
912 90%
900
80%
800
70%
700
60%
600 50%
50% 44%
500
400 40%

300 30%

200 20%
118 94
100 80 10%
7
0 0%
Number of Number of Number of Number of Number of Percentage of applications rejected Percentage of applicants receiving an
positions in the applications interview applicants applicants ranked based on a standardized screening in-depth review
Match received invitations sent interviewed process
N=1,435* N=1,383 N=1,374 N=1,386 N=1,388* N=1,326 N=1,343
* Data from the NRMP database. All Responding programs included

Percentage of Program's Interviews Extended During Each Time Percentage of Program's Interviews Conducted During Each Time
Period Period
100% 100%
90% 90%
80% 80%
70% 70%
60% 60%
50% 47% 50%
40% 40% 34%
29%
30% 25% 30% 26%
20% 16% 20%
8% 10%
10% 3% 10%
1%
0% 0%
Prior to Oct. 1 October 2015 November 2015 December 2015 January 2016 or Prior to Oct. 1 October 2015 November 2015 December 2015 January 2016 or
2015 later 2015 later
N=1,269 N=1,274

Percentage of Programs that Typically Interview and Rank Each Applicant Type
100% 98% 17% of all programs consider all applicant groups
90%
80%
73% 72%
70% 64%
60%
46% 49%
50%
40%
30%
22%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Physician Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
N=1,313

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100%
4%
13% 14%
90% 23% 90% 24%
35% 30% 35% 36% 29% 36%
80% 80%
52% 53%
70% 70%

60% 59% 60% 56%


95% 47% 97% 45%
50% 50%

40% 51% 40% 49%


61% 66% 59% 67%
30% 35% 30% 32%

20% 20%
29% 30% 30% 31%
10% 10%
14% 14% 15% 15%
3% 4% 2% 5%
0% 1% 0% 1%
US Senior Prev. Grad Osteo Pathway Canadian US IMG Non-US IMG US Senior Prev. Grad Osteo Pathway Canadian US IMG Non-US IMG

Often Seldom Never Often Seldom Never


n=1,291 n=1,278

NRMP Program Director Survey Results, 2016 7


All Specialties
Figure 6 Other Topics

Preferred Type of Communication About Applicants During SOAP


100%
90%
80%
70%
60%
50%
50%
40%
30%
22%
20% 16%
12%
10%
0%
We want to receive only We will initiate contact We want to be contacted Other
the ERAS application with references and/or by the applicants medical
the medical school, but school after we have
we do not wish to be initiated contact with the
contacted applicant

N=1,141

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.8
Passing board certification examination 4.8
Academic performance during residenc. 4.4
Personality 4.3
Ability to teach medical students 3.9
Performance in-training examination 3.8
Research and publications 3.3

0 1 2 3 4 5
n=1,230

NRMP Program Director Survey Results, 2016 8


Anesthesiology
(N=57)

NRMP Program Director Survey Results, 2016 9


Anesthesiology
Figure AN-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=51)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 99% 4.3


Lettersofrecommendationinthespecialty 84% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 86% 4.1
USMLEStep2CK/COMLEXLevel2CEscore 84% 4.1
Gradesinrequiredclerkships 79% 4.1
PersonalStatement 70% 3.4
Classranking/quartile 86% 4.1
AnyfailedattemptinUSMLE/COMLEX 75% 4.8
Gradesinclerkshipindesiredspecialty 59% 4.3
Evidenceofprofessionalismandethics 74% 4.5
Perceivedcommitmenttospecialty 56% 4.0
Personalpriorknowledgeoftheapplicant 66% 4.3
Leadershipqualities 66% 4.1
Auditionelective/rotationwithinyourdepartment 64% 4.0
Consistencyofgrades 77% 4.3
PassUSMLEStep2CS/COMLEXLevel2PE 63% 4.2
AlphaOmegaAlpha(AOA)membership 58% 3.9
Perceivedinterestinprogram 63% 3.9
Lackofgapsinmedicaleducation 56% 4.1
Otherlifeexperience 55% 3.6
Awardsorspecialhonorsinclinicalclerkships 61% 3.8
GraduateofhighlyregardedU.S.medicalschool 55% 3.6
Awardsorspecialhonorsinclerkshipindesiredspecialty 46% 3.7
Volunteer/extracurricularexperiences 45% 3.6
GoldHumanismHonorSociety(GHHS)membership 49% 3.8
Demonstratedinvolvementandinterestinresearch 41% 3.4
Visastatus* 32% 3.9
ApplicantwasflaggedwithMatchviolationbytheNRMP 34% 4.8
Awardsorspecialhonorsinbasicsciences 35% 3.4
Interestinacademiccareer 33% 3.7
Awayrotationinyourspecialtyatanotherinstitution 12% 3.4
Fluencyinlanguagespokenbyyourpatientpopulation 15% 3.9
USMLEStep3/COMLEXLevel3score 16% 3.8
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 10


Anesthesiology
Figure AN-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=51)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 97% 4.8


Interpersonalskills 97% 4.9
Interactionswithhousestaffduringinterviewandvisit 91% 4.8
Feedbackfromcurrentresidents 81% 4.7
USMLEStep1/COMLEXLevel1score 85% 4.2
Lettersofrecommendationinthespecialty 63% 4.0
USMLEStep2CK/COMLEXLevel2CEscore 71% 4.2
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 69% 4.1
Evidenceofprofessionalismandethics 65% 4.6
Perceivedcommitmenttospecialty 58% 4.1
Perceivedinterestinprogram 57% 4.0
Personalpriorknowledgeoftheapplicant 59% 4.6
Classranking/quartile 73% 4.0
Leadershipqualities 60% 4.2
Gradesinrequiredclerkships 53% 4.1
PersonalStatement 53% 3.6
Auditionelective/rotationwithinyourdepartment 63% 4.2
PassingUSMLEStep2CS/COMLEXLevel2PE 39% 4.4
Gradesinclerkshipindesiredspecialty 41% 4.0
AnyfailedattemptinUSMLE/COMLEX 42% 4.5
Consistencyofgrades 50% 4.3
AlphaOmegaAlpha(AOA)membership 41% 4.1
Otherlifeexperience 38% 3.8
GraduateofhighlyregardedU.S.medicalschool 33% 3.9
Lackofgapsinmedicaleducation 43% 4.1
Volunteer/extracurricularexperiences 25% 3.7
Awardsorspecialhonorsinclinicalclerkships 41% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 34% 3.7
GoldHumanismHonorSociety(GHHS)membership 35% 4.3
Demonstratedinvolvementandinterestinresearch 22% 3.6
ApplicantwasflaggedwithMatchviolationbytheNRMP 21% 4.8
Visastatus* 24% 3.9
Interestinacademiccareer 23% 3.9
Awardsorspecialhonorsinbasicsciences 25% 3.4
Fluencyinlanguagespokenbyyourpatientpopulation 7% 3.5
Secondinterview/visit 16% 3.4
Awayrotationinyourspecialtyatanotherinstitution 9% 3.3
USMLEStep3/COMLEXLevel3score 19% 3.5
Otherpostinterviewcontact 21% 3.2
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 11


Anesthesiology
Figure AN-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=45 exam on the first attempt?
89% 100% N=49
90%
90%
80%
80%
70%
70%
60%
60% 57%
50%
50%
40% 39%
40%
30% 30%
20% 20%
11%
10% 10% 4%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=44
the exam on the first attempt?
N=45
100% 100%
90% 90%
80% 80%
70%
70% 70%
60%
60%
60%
50% 50%
40% 40% 38%
30% 30%
20% 16% 14% 20%
10% 10% 2%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=37 N=28 N=30 N=24

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 12


Anesthesiology
Figure AN-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=46 100% N=29

90% 90%
83%
80% 80%
69%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 17% 20% 17%
14%
10%
N=46 10% N=29
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=34
100% N=34
90% 90%
80% 80%
70% 70%
60% 56% 60%
50% 50% 44%
40% 40% 38%
29%
30% 30%
20% 15% 20% 18%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=35 100% N=27
90% 90%
80% 80% 78%

70% 70%
60% 60%
50% 46% 50%
40% 34% 40%
30% 30%
20%
20% 20%
11% 11%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 13


Anesthesiology
Figure AN-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
800 100%
721
700 90%

80%
600
70%
500
60%

400 50% 47%


44%
40%
300
30%
200 162 20%
124
106
100 10%
8 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=57* N=56 N=56 N=56 N=56* N=54 N=54

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
13% of Anesthesiology programs consider all applicant groups
N=51
100% 96%
90% 86% 86%
80%
70%
62%
60%
51% 49%
50%
40%
30%
20% 15%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 100%
6% 10% 6% 8%
90% 90%
26% 28%
80% 38% 80% 38%
51% 49%
70% 70% 63%
67%
60% 71% 60% 71%
92% 67% 92% 71%
50% 50%
40% 40%
74% 54% 72% 53%
30% 30%
49% 49%
20% 31% 20% 35%
10% 23% 23% 10% 23% 21%
8% 8% 8% 9%
0% 2% 0% 2% 2%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=51 n=51

NRMP Program Director Survey Results, 2016 14


Anesthesiology
Figure AN-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
59% 60%
60%
50% 50%
40% 40% 36% 34%
30% 30%
17% 17% 19%
20% 20%
11%
10% 6% 2% 10%
0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=49 N=49

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.8
Passing board certification examination 4.9
Academic performance during residenc. 4.3
Personality 4.3
Ability to teach medical students 3.7
Performance in-training examination 4.4
Research and publications 3.1

0 1 2 3 4 5
n=51

NRMP Program Director Survey Results, 2016 15


Child Neurology
(N=36)

NRMP Program Director Survey Results, 2016 16


Child Neurology
Figure CN-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=30)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 100% 4.0


Lettersofrecommendationinthespecialty 97% 4.4
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 97% 4.2
USMLEStep2CK/COMLEXLevel2CEscore 92% 4.1
Gradesinrequiredclerkships 73% 4.1
PersonalStatement 88% 4.0
Classranking/quartile 68% 4.1
AnyfailedattemptinUSMLE/COMLEX 85% 4.4
Gradesinclerkshipindesiredspecialty 78% 4.3
Evidenceofprofessionalismandethics 80% 4.3
Perceivedcommitmenttospecialty 83% 4.3
Personalpriorknowledgeoftheapplicant 66% 4.1
Leadershipqualities 75% 3.9
Auditionelective/rotationwithinyourdepartment 69% 4.2
Consistencyofgrades 66% 4.2
PassUSMLEStep2CS/COMLEXLevel2PE 83% 4.2
AlphaOmegaAlpha(AOA)membership 58% 4.1
Perceivedinterestinprogram 83% 4.2
Lackofgapsinmedicaleducation 67% 4.3
Otherlifeexperience 56% 3.5
Awardsorspecialhonorsinclinicalclerkships 67% 3.9
GraduateofhighlyregardedU.S.medicalschool 66% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 70% 3.9
Volunteer/extracurricularexperiences 49% 3.8
GoldHumanismHonorSociety(GHHS)membership 54% 3.8
Demonstratedinvolvementandinterestinresearch 38% 3.4
Visastatus* 56% 3.7
ApplicantwasflaggedwithMatchviolationbytheNRMP 37% 4.3
Awardsorspecialhonorsinbasicsciences 46% 3.5
Interestinacademiccareer 39% 3.7
Awayrotationinyourspecialtyatanotherinstitution 28% 3.7
Fluencyinlanguagespokenbyyourpatientpopulation 41% 3.5
USMLEStep3/COMLEXLevel3score 45% 3.7
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 17


Child Neurology
Figure CN-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=30)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 97% 4.8


Interpersonalskills 97% 4.7
Interactionswithhousestaffduringinterviewandvisit 90% 4.8
Feedbackfromcurrentresidents 88% 4.5
USMLEStep1/COMLEXLevel1score 84% 4.0
Lettersofrecommendationinthespecialty 85% 4.6
USMLEStep2CK/COMLEXLevel2CEscore 82% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 85% 4.2
Evidenceofprofessionalismandethics 75% 4.4
Perceivedcommitmenttospecialty 86% 4.5
Perceivedinterestinprogram 75% 4.5
Personalpriorknowledgeoftheapplicant 64% 4.2
Classranking/quartile 53% 4.5
Leadershipqualities 59% 4.1
Gradesinrequiredclerkships 74% 4.2
PersonalStatement 75% 4.1
Auditionelective/rotationwithinyourdepartment 52% 4.2
PassingUSMLEStep2CS/COMLEXLevel2PE 70% 4.1
Gradesinclerkshipindesiredspecialty 67% 4.3
AnyfailedattemptinUSMLE/COMLEX 66% 4.4
Consistencyofgrades 58% 4.2
AlphaOmegaAlpha(AOA)membership 41% 4.1
Otherlifeexperience 33% 3.5
GraduateofhighlyregardedU.S.medicalschool 56% 3.9
Lackofgapsinmedicaleducation 62% 4.1
Volunteer/extracurricularexperiences 39% 3.6
Awardsorspecialhonorsinclinicalclerkships 56% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 49% 4.0
GoldHumanismHonorSociety(GHHS)membership 38% 3.8
Demonstratedinvolvementandinterestinresearch 35% 3.5
ApplicantwasflaggedwithMatchviolationbytheNRMP 25% 4.5
Visastatus* 37% 3.8
Interestinacademiccareer 32% 3.7
Awardsorspecialhonorsinbasicsciences 31% 3.6
Fluencyinlanguagespokenbyyourpatientpopulation 40% 3.8
Secondinterview/visit 36% 3.7
Awayrotationinyourspecialtyatanotherinstitution 21% 3.9
USMLEStep3/COMLEXLevel3score 47% 3.8
Otherpostinterviewcontact 30% 3.7
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 18


Child Neurology
Figure CN-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=29 exam on the first attempt?
90% 100% N=24
90%
80%
80%
70%
70%
60%
52% 60% 54%
50% 48%
50%
40% 38%
40%
30% 30%
20% 20%
10% 10% 8%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=28
the exam on the first attempt?
N=24
100% 100%
90% 90%
80% 80%
70% 70%
60% 54% 60%
50% 50% 46% 46%
39%
40% 40%
30% 30%
20% 20%
10% 7% 10% 8%

0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=11 N=9 N=9 N=7

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 19


Child Neurology
Figure CN-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=28 100% N=20
89%
90% 90%
80% 80%
70% 70%
60% 60%
50% 50% 45%
40% 40%
30%
30% 30% 25%
20% 20%
N=28 11% N=20
10% 10%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=24
100% N=22
90% 90%
80% 80%
70% 70%
58% 59%
60% 60%
50% 50%
40% 40%
29% 27%
30% 30%
20% 20% 14%
13%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=22 100% N=19
90% 90%
80% 80%
70% 64% 70%
60% 60%
50% 50%
42%
40% 40%
32%
30% 30% 26%
20% 18% 18% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 20


Child Neurology
Figure CN-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
100 95 100%

90%
80 80%

70%

60 60%
52%
50% 48%

40 40%

30%
24
18 20%
20 15
10%
2 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=36* N=34 N=33 N=33 N=34* N=32 N=33

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
24% of Child Neurology programs consider all applicant groups
98% N=31
100%
92%
90%
80% 78% 77%
70% 65%
60% 56%
50%
40%
30% 27%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100% 4%
90% 90%
31% 32% 26% 36% 33%
80% 39% 80% 40%
37%
70% 60% 70% 60%
68% 67%
60% 60%
93% 97%
50% 50%
48% 39% 47%
40% 52% 40%
55% 70% 53%
30% 59% 30%
33% 30%
20% 26% 20% 27%
10% 21% 10% 25% 20%
16%
7% 6% 7% 6% 7% 10% 7%
0% 0% 3%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=30 n=31

NRMP Program Director Survey Results, 2016 21


Child Neurology
Figure CN-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 58% 60%
50% 50%
40% 37%
40% 32%
30% 30% 23%
21%
20% 15% 20%
10% 4% 10% 7%
2% 0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=29 N=29

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 5.0
Ethics 5.0
Communication skills 4.9
Passing board certification examination 4.9
Academic performance during residenc. 4.4
Personality 4.6
Ability to teach medical students 4.3
Performance in-training examination 3.9
Research and publications 3.6

0 1 2 3 4 5
n=26

NRMP Program Director Survey Results, 2016 22


Dermatology
(N=39)

NRMP Program Director Survey Results, 2016 23


Dermatology
Figure D-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=33)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 94% 4.3


Lettersofrecommendationinthespecialty 91% 4.6
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 91% 4.0
USMLEStep2CK/COMLEXLevel2CEscore 61% 3.9
Gradesinrequiredclerkships 82% 4.3
PersonalStatement 82% 4.2
Classranking/quartile 71% 3.9
AnyfailedattemptinUSMLE/COMLEX 55% 4.8
Gradesinclerkshipindesiredspecialty 68% 4.2
Evidenceofprofessionalismandethics 79% 4.5
Perceivedcommitmenttospecialty 79% 4.4
Personalpriorknowledgeoftheapplicant 80% 4.2
Leadershipqualities 76% 4.2
Auditionelective/rotationwithinyourdepartment 70% 4.4
Consistencyofgrades 76% 4.1
PassUSMLEStep2CS/COMLEXLevel2PE 33% 4.1
AlphaOmegaAlpha(AOA)membership 67% 3.9
Perceivedinterestinprogram 77% 4.3
Lackofgapsinmedicaleducation 30% 4.1
Otherlifeexperience 70% 3.7
Awardsorspecialhonorsinclinicalclerkships 67% 3.6
GraduateofhighlyregardedU.S.medicalschool 42% 4.1
Awardsorspecialhonorsinclerkshipindesiredspecialty 52% 3.9
Volunteer/extracurricularexperiences 61% 3.9
GoldHumanismHonorSociety(GHHS)membership 39% 3.7
Demonstratedinvolvementandinterestinresearch 67% 3.9
Visastatus* 36% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 39% 4.9
Awardsorspecialhonorsinbasicsciences 42% 3.3
Interestinacademiccareer 55% 3.8
Awayrotationinyourspecialtyatanotherinstitution 48% 3.8
Fluencyinlanguagespokenbyyourpatientpopulation 18% 3.0
USMLEStep3/COMLEXLevel3score 24% 3.9
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 24


Dermatology
Figure D-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=33)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 97% 4.9


Interpersonalskills 97% 4.8
Interactionswithhousestaffduringinterviewandvisit 88% 4.9
Feedbackfromcurrentresidents 82% 4.8
USMLEStep1/COMLEXLevel1score 58% 4.2
Lettersofrecommendationinthespecialty 67% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 45% 4.2
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 55% 4.0
Evidenceofprofessionalismandethics 65% 4.7
Perceivedcommitmenttospecialty 64% 4.5
Perceivedinterestinprogram 67% 4.2
Personalpriorknowledgeoftheapplicant 55% 4.4
Classranking/quartile 33% 3.8
Leadershipqualities 55% 4.2
Gradesinrequiredclerkships 48% 3.7
PersonalStatement 42% 4.2
Auditionelective/rotationwithinyourdepartment 55% 4.6
PassingUSMLEStep2CS/COMLEXLevel2PE 33% 4.2
Gradesinclerkshipindesiredspecialty 42% 4.0
AnyfailedattemptinUSMLE/COMLEX 30% 4.6
Consistencyofgrades 45% 3.8
AlphaOmegaAlpha(AOA)membership 30% 3.9
Otherlifeexperience 50% 3.8
GraduateofhighlyregardedU.S.medicalschool 30% 3.9
Lackofgapsinmedicaleducation 21% 4.2
Volunteer/extracurricularexperiences 39% 3.5
Awardsorspecialhonorsinclinicalclerkships 30% 3.7
Awardsorspecialhonorsinclerkshipindesiredspecialty 30% 4.0
GoldHumanismHonorSociety(GHHS)membership 21% 3.5
Demonstratedinvolvementandinterestinresearch 48% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 18% 4.6
Visastatus* 18% 4.6
Interestinacademiccareer 48% 4.1
Awardsorspecialhonorsinbasicsciences 18% 3.2
Fluencyinlanguagespokenbyyourpatientpopulation 9% 3.0
Secondinterview/visit 18% 2.3
Awayrotationinyourspecialtyatanotherinstitution 33% 3.8
USMLEStep3/COMLEXLevel3score 24% 3.6
Otherpostinterviewcontact 9% 3.3
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 25


Dermatology
Figure D-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=34 exam on the first attempt?
90% 100% N=34
82%
90%
80%
80%
70%
70%
60%
60%
50% 50% 50%
50%
40%
40%
30% 30%
20% 18%
20%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=34
the exam on the first attempt?
N=30
100% 100%
90% 90%
80% 80%
70% 70%
60% 60% 57%
50% 50% 43%
40% 35% 40%
32% 32%
30% 30%
20% 20%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230 USMLE Step 2 CK


not reported
220 220
because of low
210 210 response rate
200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1


N=25 N=10 N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 26


Dermatology
Figure D-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=33 100% N=28

90% 90%
80% 80%
71%
70% 64% 70%
60% 60%
50% 50%
40% 36% 40%
30% 30%
20% 20% 14% 14%
10%
N=33 10% N=28
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=15
100% N=16
90% 90%
80% 80%
70% 70%
60% 60%
50% 47% 50% 44%
40% 40% 38%
33%
30% 30%
20% 19%
20% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=15 100% N=13
90% 90%
80% 80%
70% 70%
60% 60%
50% 47% 50% 46%
40% 33% 40%
31%
30% 30% 23%
20%
20% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 27


Dermatology
Figure D-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
449 100%
450
90%
400
80%
350
70%
300 61%
60%
250
50%
200 40%

150 30% 29%

100 20%

38 10%
50 34 30
3 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=39* N=37 N=36 N=36 N=36* N=36 N=36

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
9% of Dermatology programs consider all applicant groups
100% N=35
100%
90% 86%
80%
70%
60%
50% 43%
40% 37% 37%
30% 29%

20%
10% 9%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 3% 3% 3% 100% 3% 3% 3%
6% 9% 3% 6%
12%
90% 13% 90%
80% 80% 44%
47% 35% 45%
70% 42% 48% 70% 44%
48% 68% 65%
60% 60%
50% 97% 50% 100%
93%
40% 84% 40%
30% 30% 56% 58%
53% 52% 48% 52%
47%
20% 39% 20%
29% 32%
10% 10%
0% 3% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=35 n=32

NRMP Program Director Survey Results, 2016 28


Dermatology
Figure D-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
63%
60% 60% 53%
50% 50%
40%
40% 40%
30% 30%
20%
20% 20%
10% 9% 7% 10%
2% 3% 1% 2%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=36 N=36

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.8
Ethics 4.8
Communication skills 4.8
Passing board certification examination 4.9
Academic performance during residenc. 4.6
Personality 4.0
Ability to teach medical students 3.7
Performance in-training examination 3.7
Research and publications 3.4

0 1 2 3 4 5
n=32

NRMP Program Director Survey Results, 2016 29


Emergency Medicine
(N=80)

NRMP Program Director Survey Results, 2016 30


Emergency Medicine
Figure EM-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=73)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 96% 3.9


Lettersofrecommendationinthespecialty 97% 4.9
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 79% 4.0
USMLEStep2CK/COMLEXLevel2CEscore 89% 4.0
Gradesinrequiredclerkships 81% 4.1
PersonalStatement 66% 3.3
Classranking/quartile 77% 4.0
AnyfailedattemptinUSMLE/COMLEX 77% 4.6
Gradesinclerkshipindesiredspecialty 82% 4.8
Evidenceofprofessionalismandethics 71% 4.4
Perceivedcommitmenttospecialty 75% 4.2
Personalpriorknowledgeoftheapplicant 78% 4.2
Leadershipqualities 84% 4.0
Auditionelective/rotationwithinyourdepartment 81% 4.6
Consistencyofgrades 63% 4.0
PassUSMLEStep2CS/COMLEXLevel2PE 52% 4.0
AlphaOmegaAlpha(AOA)membership 67% 3.7
Perceivedinterestinprogram 62% 4.0
Lackofgapsinmedicaleducation 51% 3.9
Otherlifeexperience 75% 3.6
Awardsorspecialhonorsinclinicalclerkships 56% 3.5
GraduateofhighlyregardedU.S.medicalschool 59% 3.6
Awardsorspecialhonorsinclerkshipindesiredspecialty 62% 4.0
Volunteer/extracurricularexperiences 62% 3.7
GoldHumanismHonorSociety(GHHS)membership 53% 3.4
Demonstratedinvolvementandinterestinresearch 41% 3.2
Visastatus* 37% 4.1
ApplicantwasflaggedwithMatchviolationbytheNRMP 34% 4.7
Awardsorspecialhonorsinbasicsciences 15% 2.9
Interestinacademiccareer 23% 3.7
Awayrotationinyourspecialtyatanotherinstitution 79% 4.3
Fluencyinlanguagespokenbyyourpatientpopulation 22% 3.5
USMLEStep3/COMLEXLevel3score 15% 3.6
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 31


Emergency Medicine
Figure EM-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=73)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 99% 4.8


Interpersonalskills 100% 4.8
Interactionswithhousestaffduringinterviewandvisit 95% 4.8
Feedbackfromcurrentresidents 92% 4.6
USMLEStep1/COMLEXLevel1score 79% 3.9
Lettersofrecommendationinthespecialty 88% 4.7
USMLEStep2CK/COMLEXLevel2CEscore 77% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 66% 3.9
Evidenceofprofessionalismandethics 70% 4.6
Perceivedcommitmenttospecialty 68% 4.2
Perceivedinterestinprogram 64% 4.2
Personalpriorknowledgeoftheapplicant 66% 4.3
Classranking/quartile 66% 3.9
Leadershipqualities 74% 4.2
Gradesinrequiredclerkships 56% 4.0
PersonalStatement 48% 3.1
Auditionelective/rotationwithinyourdepartment 77% 4.7
PassingUSMLEStep2CS/COMLEXLevel2PE 47% 4.0
Gradesinclerkshipindesiredspecialty 68% 4.6
AnyfailedattemptinUSMLE/COMLEX 45% 4.5
Consistencyofgrades 51% 4.1
AlphaOmegaAlpha(AOA)membership 52% 3.7
Otherlifeexperience 66% 3.6
GraduateofhighlyregardedU.S.medicalschool 41% 3.6
Lackofgapsinmedicaleducation 37% 4.1
Volunteer/extracurricularexperiences 47% 3.7
Awardsorspecialhonorsinclinicalclerkships 30% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 37% 4.3
GoldHumanismHonorSociety(GHHS)membership 40% 3.7
Demonstratedinvolvementandinterestinresearch 22% 3.5
ApplicantwasflaggedwithMatchviolationbytheNRMP 30% 4.8
Visastatus* 19% 4.1
Interestinacademiccareer 26% 4.0
Awardsorspecialhonorsinbasicsciences 11% 2.8
Fluencyinlanguagespokenbyyourpatientpopulation 11% 3.9
Secondinterview/visit 32% 3.4
Awayrotationinyourspecialtyatanotherinstitution 64% 4.4
USMLEStep3/COMLEXLevel3score 16% 3.1
Otherpostinterviewcontact 23% 3.7
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 32


Emergency Medicine
Figure EM-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=70 exam on the first attempt?
90% 100% N=68
90%
80% 81%
67% 80%
70%
70%
60%
60%
50%
50%
40%
31% 40%
30% 30%
20% 20% 18%
10% 10%
1% 1%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=69
the exam on the first attempt?
N=65
100% 100%
90% 90%
80% 80%
70% 70%
60% 60% 58%
49%
50% 50%
42%
40% 40%
30% 28% 30%
23%
20% 20%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=43 N=34 N=29 N=22

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 33


Emergency Medicine
Figure EM-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=68 100% N=49

90% 90% 84%


80% 80%
70% 63%
70%
60% 60%
50% 50%
40% 37% 40%
30% 30%
20% 20%
N=68 10% N=49 6%
10% 10%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=57
100% N=55
90% 90%
80% 80%
70% 70%
60% 60%
49%
50% 50%
40% 37% 39% 40%
29%
30% 25% 30%
22%
20% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=53 100% N=44
90% 90% 84%
80% 80%
70% 70%
62%
60% 60%
50% 50%
40% 34% 40%
30% 30%
20% 20%
11%
10% 4% 10% 5%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 34


Emergency Medicine
Figure EM-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
1,000
100%
905
90%
800 80%

70%
60%
600 60%

50%
39%
400 40%

30%

188 20%
200 145 133
10%
12 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants standardized screening process
Match received invitations sent interviewed ranked
N=80* N=78 N=77 N=77 N=78* N=72 N=75

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
10% of Emergency Medicine programs consider all applicant groups
100% N=72
100%
90%
82% 81%
80%
70%
60%
50% 46%
40% 33%
30% 24%
20% 13%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 3% 100% 3%
6% 10% 10% 9%
90% 90% 25%
29% 26% 31%
80% 36% 80% 35%
54% 56%
70% 70%
57% 51%
60% 60% 64%
66%
50% 100% 50% 100%
40% 40% 75%
71% 74% 69%
30% 61% 30% 62%
41% 40%
20% 38% 20% 39%
24% 28%
10% 10%
0% 4% 0% 4%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=70 n=70

NRMP Program Director Survey Results, 2016 35


Emergency Medicine
Figure EM-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 58% 60%
50% 50%
40% 40% 35% 33%
30% 30%
22% 21%
20% 20%
10% 6% 9%
10% 4% 10% 3%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=70 N=70

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.8
Communication skills 4.8
Passing board certification examination 4.6
Academic performance during residenc. 4.2
Personality 4.5
Ability to teach medical students 3.7
Performance in-training examination 3.6
Research and publications 3.0

0 1 2 3 4 5
n=72

NRMP Program Director Survey Results, 2016 36


Family Medicine
(N=190)

NRMP Program Director Survey Results, 2016 37


Family Medicine
Figure FM-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=167)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 90% 3.8


Lettersofrecommendationinthespecialty 88% 3.9
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 80% 4.0
USMLEStep2CK/COMLEXLevel2CEscore 89% 4.1
Gradesinrequiredclerkships 68% 3.8
PersonalStatement 88% 4.2
Classranking/quartile 52% 3.5
AnyfailedattemptinUSMLE/COMLEX 80% 4.4
Gradesinclerkshipindesiredspecialty 56% 4.0
Evidenceofprofessionalismandethics 67% 4.6
Perceivedcommitmenttospecialty 89% 4.5
Personalpriorknowledgeoftheapplicant 69% 4.1
Leadershipqualities 68% 4.0
Auditionelective/rotationwithinyourdepartment 65% 4.1
Consistencyofgrades 62% 3.9
PassUSMLEStep2CS/COMLEXLevel2PE 83% 4.3
AlphaOmegaAlpha(AOA)membership 41% 3.5
Perceivedinterestinprogram 65% 4.1
Lackofgapsinmedicaleducation 80% 4.1
Otherlifeexperience 59% 3.8
Awardsorspecialhonorsinclinicalclerkships 45% 3.4
GraduateofhighlyregardedU.S.medicalschool 47% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 44% 3.7
Volunteer/extracurricularexperiences 67% 4.0
GoldHumanismHonorSociety(GHHS)membership 46% 3.7
Demonstratedinvolvementandinterestinresearch 13% 2.9
Visastatus* 56% 4.4
ApplicantwasflaggedwithMatchviolationbytheNRMP 54% 4.8
Awardsorspecialhonorsinbasicsciences 14% 2.9
Interestinacademiccareer 13% 3.4
Awayrotationinyourspecialtyatanotherinstitution 14% 3.5
Fluencyinlanguagespokenbyyourpatientpopulation 43% 3.7
USMLEStep3/COMLEXLevel3score 27% 3.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 38


Family Medicine
Figure FM-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=167)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 96% 4.9


Interpersonalskills 96% 4.9
Interactionswithhousestaffduringinterviewandvisit 90% 4.9
Feedbackfromcurrentresidents 86% 4.8
USMLEStep1/COMLEXLevel1score 78% 3.9
Lettersofrecommendationinthespecialty 60% 3.9
USMLEStep2CK/COMLEXLevel2CEscore 84% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 64% 3.9
Evidenceofprofessionalismandethics 68% 4.7
Perceivedcommitmenttospecialty 84% 4.5
Perceivedinterestinprogram 64% 4.2
Personalpriorknowledgeoftheapplicant 60% 4.2
Classranking/quartile 50% 3.7
Leadershipqualities 60% 4.1
Gradesinrequiredclerkships 50% 3.8
PersonalStatement 69% 3.9
Auditionelective/rotationwithinyourdepartment 63% 4.3
PassingUSMLEStep2CS/COMLEXLevel2PE 77% 4.2
Gradesinclerkshipindesiredspecialty 38% 3.8
AnyfailedattemptinUSMLE/COMLEX 72% 4.4
Consistencyofgrades 43% 3.8
AlphaOmegaAlpha(AOA)membership 30% 3.7
Otherlifeexperience 54% 3.8
GraduateofhighlyregardedU.S.medicalschool 37% 3.9
Lackofgapsinmedicaleducation 54% 3.9
Volunteer/extracurricularexperiences 49% 3.9
Awardsorspecialhonorsinclinicalclerkships 31% 3.5
Awardsorspecialhonorsinclerkshipindesiredspecialty 28% 3.6
GoldHumanismHonorSociety(GHHS)membership 30% 3.9
Demonstratedinvolvementandinterestinresearch 10% 2.9
ApplicantwasflaggedwithMatchviolationbytheNRMP 35% 4.7
Visastatus* 32% 4.3
Interestinacademiccareer 11% 3.2
Awardsorspecialhonorsinbasicsciences 12% 2.7
Fluencyinlanguagespokenbyyourpatientpopulation 34% 3.9
Secondinterview/visit 31% 3.9
Awayrotationinyourspecialtyatanotherinstitution 9% 3.2
USMLEStep3/COMLEXLevel3score 22% 3.8
Otherpostinterviewcontact 28% 3.8
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 39


Family Medicine
Figure FM-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=160 exam on the first attempt?
90% 100% N=155
90%
80%
80%
70%
70%
60% 57% 62%
60%
50% 43% 50%
40%
40% 33%
30% 30%
20% 20%
10% 10% 5%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=158
the exam on the first attempt?
N=150
100% 100%
90% 90%
80% 80%
71%
70% 70%
60% 54% 60%
50% 50%
41%
40% 40%
30% 30%
19%
20% 20%
10%
10% 6% 10%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=60 N=56 N=45 N=42

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 40


Family Medicine
Figure FM-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=155 100% N=105
89%
90% 90%
80% 80% 77%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 20% 18%
N=155 11% N=105 5%
10% 10%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=151
100% N=149
90% 90%
80% 80%
70% 70%
59%
60% 60% 56%
50% 50%
40% 38% 40% 35%
30% 30%
20% 20%
9%
10%
3% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=148 100% N=101
90% 90%
80%
80% 80% 75%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
21%
20% 14% 20%
10% 7% 10% 4%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 41


Family Medicine
Figure FM-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
1,400 100%
1,240
90%
1,200
80%
1,000 70% 66%
60%
800
50%
600 40%

30% 29%
400
20%
200 10%
111 87 67
7 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants standardized screening process
Match received invitations sent interviewed ranked
N=190* N=183 N=178 N=179 N=179* N=174 N=173

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
18% of Family Medicine programs consider all applicant groups
98% N=168
100% 96%
90% 82% 79%
80%
70%
60%
50% 49%
50%
40% 36%
30%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 5% 100% 5%
12% 10%
90% 25% 90%
26%
80% 39% 80% 37%

70% 49% 61% 70% 47% 58%

60% 83% 60% 61%


62% 86%
97% 43% 99% 42%
50% 50%
40% 40%
60% 60%
30% 30%
46% 33% 48% 35%
20% 20%
32% 29% 32%
25%
10% 17% 10% 13%
2% 6% 1% 3% 7%
0% 1% 1% 0% 1%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=162 n=159

NRMP Program Director Survey Results, 2016 42


Family Medicine
Figure FM-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
50% 50%
42%
40% 40% 33% 32%
32%
30% 30%
17% 20% 17% 18%
20%
10% 6% 3% 10%
1%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=154 N=154

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 5.0
Ethics 5.0
Communication skills 4.9
Passing board certification examination 4.8
Academic performance during residenc. 4.4
Personality 4.2
Ability to teach medical students 3.8
Performance in-training examination 4.0
Research and publications 2.8

0 1 2 3 4 5
n=159

NRMP Program Director Survey Results, 2016 43


Internal Medicine
(N=163)

NRMP Program Director Survey Results, 2016 44


Internal Medicine
Figure IM-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=151)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 93% 4.2


Lettersofrecommendationinthespecialty 80% 3.9
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 90% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 91% 4.3
Gradesinrequiredclerkships 75% 4.2
PersonalStatement 73% 3.4
Classranking/quartile 77% 4.1
AnyfailedattemptinUSMLE/COMLEX 81% 4.6
Gradesinclerkshipindesiredspecialty 66% 4.2
Evidenceofprofessionalismandethics 74% 4.5
Perceivedcommitmenttospecialty 52% 3.8
Personalpriorknowledgeoftheapplicant 68% 4.0
Leadershipqualities 55% 3.9
Auditionelective/rotationwithinyourdepartment 52% 3.7
Consistencyofgrades 66% 4.0
PassUSMLEStep2CS/COMLEXLevel2PE 76% 4.3
AlphaOmegaAlpha(AOA)membership 57% 3.8
Perceivedinterestinprogram 55% 3.9
Lackofgapsinmedicaleducation 65% 4.1
Otherlifeexperience 54% 3.6
Awardsorspecialhonorsinclinicalclerkships 51% 3.4
GraduateofhighlyregardedU.S.medicalschool 53% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 50% 3.6
Volunteer/extracurricularexperiences 45% 3.6
GoldHumanismHonorSociety(GHHS)membership 46% 3.8
Demonstratedinvolvementandinterestinresearch 32% 3.3
Visastatus* 52% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 52% 4.7
Awardsorspecialhonorsinbasicsciences 25% 3.0
Interestinacademiccareer 25% 3.3
Awayrotationinyourspecialtyatanotherinstitution 12% 3.1
Fluencyinlanguagespokenbyyourpatientpopulation 42% 3.9
USMLEStep3/COMLEXLevel3score 26% 3.4
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 45


Internal Medicine
Figure IM-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=151)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 93% 4.7


Interpersonalskills 94% 4.8
Interactionswithhousestaffduringinterviewandvisit 81% 4.6
Feedbackfromcurrentresidents 75% 4.5
USMLEStep1/COMLEXLevel1score 89% 4.2
Lettersofrecommendationinthespecialty 74% 3.8
USMLEStep2CK/COMLEXLevel2CEscore 89% 4.3
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 85% 4.3
Evidenceofprofessionalismandethics 72% 4.6
Perceivedcommitmenttospecialty 49% 4.2
Perceivedinterestinprogram 61% 4.1
Personalpriorknowledgeoftheapplicant 64% 4.2
Classranking/quartile 76% 4.2
Leadershipqualities 55% 4.0
Gradesinrequiredclerkships 63% 4.2
PersonalStatement 56% 3.5
Auditionelective/rotationwithinyourdepartment 45% 4.0
PassingUSMLEStep2CS/COMLEXLevel2PE 74% 4.3
Gradesinclerkshipindesiredspecialty 57% 4.3
AnyfailedattemptinUSMLE/COMLEX 63% 4.6
Consistencyofgrades 52% 4.1
AlphaOmegaAlpha(AOA)membership 49% 4.0
Otherlifeexperience 49% 3.8
GraduateofhighlyregardedU.S.medicalschool 47% 4.0
Lackofgapsinmedicaleducation 52% 4.2
Volunteer/extracurricularexperiences 42% 3.6
Awardsorspecialhonorsinclinicalclerkships 40% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 33% 3.9
GoldHumanismHonorSociety(GHHS)membership 41% 4.0
Demonstratedinvolvementandinterestinresearch 26% 3.4
ApplicantwasflaggedwithMatchviolationbytheNRMP 37% 4.7
Visastatus* 44% 4.1
Interestinacademiccareer 23% 3.5
Awardsorspecialhonorsinbasicsciences 24% 3.2
Fluencyinlanguagespokenbyyourpatientpopulation 39% 4.1
Secondinterview/visit 15% 3.2
Awayrotationinyourspecialtyatanotherinstitution 9% 2.9
USMLEStep3/COMLEXLevel3score 25% 3.8
Otherpostinterviewcontact 10% 3.3
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 46


Internal Medicine
Figure IM-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=142 exam on the first attempt?
90% 100% N=129
90%
80% 75%
80%
70%
70% 64%
60%
60%
50%
50%
40%
40%
30% 24% 30% 26%
20% 20%
10%
10% 10%
1%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=144
the exam on the first attempt?
N=132
100% 100%
90% 90%
80% 80%
70% 67%
70% 63%
60% 60%
50% 50%
40% 40%
30%
30% 23% 30%
20% 20%
10% 7%
10% 10%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=96 N=84 N=78 N=66

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 47


Internal Medicine
Figure IM-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=140 100% N=90
89%
90% 90%
79%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 20%
11% 12%
10%
N=140 10% N=90 9%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=109
100% N=111
90% 90%
80% 80%
70% 70%
60% 58% 60% 53%
50% 50%
40% 40%
30% 25% 30% 24% 23%
20% 17% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=108 100% N=72
90% 90%
80% 80% 74%
70% 70%
60%
60% 60%
50% 50%
40% 40%
30% 30%
22%
20% 18% 20% 18%

10% 10% 8%

0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 48


Internal Medicine
Figure IM-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
2,800 100%
2,619
90%
2,400
80%
2,000 70%
61%
60%
1,600
50%
1,200 40%
30%
30%
800
20%
400 248 10%
201 168
15 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants standardized screening process
Match received invitations sent interviewed ranked
N=163* N=160 N=158 N=159 N=159* N=152 N=154

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
26% of Internal Medicine programs consider all applicant groups
98% N=152
100%
90% 84% 86%
80% 79%
70%
70%
60%
60%
50%
40%
32%
30%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 100%
7% 8%
90% 16% 90% 19%
24% 26%
80% 30% 80% 28%
53% 53%
70% 63% 64% 70% 63%
67%
60% 60%
91% 62% 95%
50% 50% 58%

40% 69% 40% 67%


30% 62% 30% 64%
42% 42%
29% 25%
20% 34% 20% 35%
10% 22% 10% 23%
8% 7% 9% 5% 3% 7% 8% 5%
0% 1% 3% 0% 1% 3%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=152 n=152

NRMP Program Director Survey Results, 2016 49


Internal Medicine
Figure IM-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
50% 48% 50%
40% 40% 34% 34%
30% 30% 23%
19% 20%
20% 20%
9% 10%
10% 4% 10%
0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=148 N=148

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 5.0
Professionalism 5.0
Ethics 4.9
Communication skills 4.8
Passing board certification examination 4.8
Academic performance during residenc. 4.3
Personality 4.4
Ability to teach medical students 3.9
Performance in-training examination 3.7
Research and publications 3.1

0 1 2 3 4 5
n=150

NRMP Program Director Survey Results, 2016 50


Internal Medicine/Pediatrics
(N=28)

NRMP Program Director Survey Results, 2016 51


Internal Medicine/Pediatrics
Figure IMP-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=27)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 93% 4.3


Lettersofrecommendationinthespecialty 81% 3.8
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 93% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 89% 4.2
Gradesinrequiredclerkships 81% 4.3
PersonalStatement 70% 3.7
Classranking/quartile 81% 3.9
AnyfailedattemptinUSMLE/COMLEX 85% 4.7
Gradesinclerkshipindesiredspecialty 74% 4.2
Evidenceofprofessionalismandethics 74% 4.7
Perceivedcommitmenttospecialty 74% 4.2
Personalpriorknowledgeoftheapplicant 78% 4.0
Leadershipqualities 74% 4.0
Auditionelective/rotationwithinyourdepartment 70% 3.5
Consistencyofgrades 56% 3.9
PassUSMLEStep2CS/COMLEXLevel2PE 67% 4.2
AlphaOmegaAlpha(AOA)membership 74% 4.1
Perceivedinterestinprogram 41% 3.9
Lackofgapsinmedicaleducation 63% 4.0
Otherlifeexperience 63% 3.7
Awardsorspecialhonorsinclinicalclerkships 63% 4.0
GraduateofhighlyregardedU.S.medicalschool 63% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 59% 4.1
Volunteer/extracurricularexperiences 78% 3.9
GoldHumanismHonorSociety(GHHS)membership 67% 4.1
Demonstratedinvolvementandinterestinresearch 30% 3.5
Visastatus* 33% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 41% 4.6
Awardsorspecialhonorsinbasicsciences 37% 3.3
Interestinacademiccareer 15% 3.8
Awayrotationinyourspecialtyatanotherinstitution 33% 2.9
Fluencyinlanguagespokenbyyourpatientpopulation 26% 3.1
USMLEStep3/COMLEXLevel3score 11% 3.7
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 52


Internal Medicine/Pediatrics
Figure IMP-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=27)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 93% 4.9


Interpersonalskills 89% 4.9
Interactionswithhousestaffduringinterviewandvisit 96% 4.8
Feedbackfromcurrentresidents 93% 4.8
USMLEStep1/COMLEXLevel1score 85% 4.2
Lettersofrecommendationinthespecialty 59% 3.6
USMLEStep2CK/COMLEXLevel2CEscore 85% 4.3
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 89% 4.3
Evidenceofprofessionalismandethics 81% 4.6
Perceivedcommitmenttospecialty 70% 4.4
Perceivedinterestinprogram 63% 4.2
Personalpriorknowledgeoftheapplicant 59% 4.6
Classranking/quartile 81% 4.2
Leadershipqualities 67% 4.4
Gradesinrequiredclerkships 70% 4.3
PersonalStatement 59% 3.4
Auditionelective/rotationwithinyourdepartment 56% 4.1
PassingUSMLEStep2CS/COMLEXLevel2PE 70% 4.3
Gradesinclerkshipindesiredspecialty 59% 4.2
AnyfailedattemptinUSMLE/COMLEX 52% 4.6
Consistencyofgrades 56% 4.1
AlphaOmegaAlpha(AOA)membership 63% 3.9
Otherlifeexperience 52% 3.5
GraduateofhighlyregardedU.S.medicalschool 44% 3.8
Lackofgapsinmedicaleducation 37% 3.8
Volunteer/extracurricularexperiences 52% 4.2
Awardsorspecialhonorsinclinicalclerkships 52% 4.0
Awardsorspecialhonorsinclerkshipindesiredspecialty 48% 3.8
GoldHumanismHonorSociety(GHHS)membership 52% 4.1
Demonstratedinvolvementandinterestinresearch 26% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 26% 5.0
Visastatus* 19% 3.4
Interestinacademiccareer 19% 3.6
Awardsorspecialhonorsinbasicsciences 30% 3.0
Fluencyinlanguagespokenbyyourpatientpopulation 15% 3.5
Secondinterview/visit 26% 2.8
Awayrotationinyourspecialtyatanotherinstitution 26% 3.6
USMLEStep3/COMLEXLevel3score 11% 3.7
Otherpostinterviewcontact 19% 3.4
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 53


Internal Medicine/Pediatrics
Figure IMP-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=26 exam on the first attempt?
90% 100% N=26
90%
80% 73%
80% 77%
70%
70%
60%
60%
50%
50%
40%
40%
30% 27%
30% 23%
20% 20%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=25
the exam on the first attempt?
N=25
100% 100%
90% 90%
80% 80%
70% 70%
60% 56% 60%
60%
50% 50%
40%
40% 40%
32%
30% 30%
20% 20%
12%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=18 N=15 N=17 N=13

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 54


Internal Medicine/Pediatrics
Figure IMP-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=24 100% N=15

90% 83% 90%


80%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20%
20% 17% 20%
10%
N=24 10% N=15
0%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=19
100% N=19
90% 90%
80% 80%
70%
63% 70%
60% 60%
50% 50% 47%
40% 40%
32%
30% 30%
21% 21%
20% 16% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=17 100% N=13
92%
90% 90%
80% 80%
70% 70%
60% 60%
53%
50% 50%
41%
40% 40%
30% 30%
20% 20%
10% 6% 10% 8%
0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 55


Internal Medicine/Pediatrics
Figure IMP-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
280 100%
254
90%
240
80%
200 70%

60% 55%
160
50%
43%
120 40%

76 30%
80
61 57 20%
40 10%
5 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=28* N=27 N=27 N=27 N=27* N=27 N=27

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
12% of Internal Medicine/Pediatrics programs consider all applicant groups
N=26
100% 96%
90%
80%
70%
62%
60% 58%
50%
40% 35%
31% 31%
30%
20%
12%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100%
8% 8% 8% 12% 8%
90% 15% 15% 90% 15%
24%
19% 15%
80% 80%
54% 56%
70% 46% 70% 48%
60% 68% 60% 58%
96% 92%
50% 73% 50% 73%
77% 60%
40% 40% 77%
23% 73% 20%
30% 30%
46% 44%
20% 20%
28% 31%
10% 23% 10% 24%
12% 4% 12% 16%
4% 8% 4%
0% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=26 n=26

NRMP Program Director Survey Results, 2016 56


Internal Medicine/Pediatrics
Figure IMP-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
59% 60%
60%
50% 50%
40% 38% 38%
40%
30% 24% 30%
20% 18%
20% 14%
10% 10% 7%
3% 0% 0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=26 N=26

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 5.0
Ethics 4.8
Communication skills 4.8
Passing board certification examination 4.7
Academic performance during residenc. 4.3
Personality 4.2
Ability to teach medical students 4.0
Performance in-training examination 3.6
Research and publications 2.9

0 1 2 3 4 5
n=26

NRMP Program Director Survey Results, 2016 57


Neurological Surgery
(N=32)

NRMP Program Director Survey Results, 2016 58


Neurological Surgery
Figure NS-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=30)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 93% 4.6


Lettersofrecommendationinthespecialty 97% 4.8
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 73% 3.9
USMLEStep2CK/COMLEXLevel2CEscore 50% 4.3
Gradesinrequiredclerkships 57% 4.1
PersonalStatement 83% 4.0
Classranking/quartile 67% 3.9
AnyfailedattemptinUSMLE/COMLEX 60% 4.9
Gradesinclerkshipindesiredspecialty 70% 4.4
Evidenceofprofessionalismandethics 77% 4.5
Perceivedcommitmenttospecialty 70% 4.5
Personalpriorknowledgeoftheapplicant 53% 4.4
Leadershipqualities 77% 4.3
Auditionelective/rotationwithinyourdepartment 80% 4.4
Consistencyofgrades 67% 4.3
PassUSMLEStep2CS/COMLEXLevel2PE 53% 4.1
AlphaOmegaAlpha(AOA)membership 63% 4.0
Perceivedinterestinprogram 70% 4.4
Lackofgapsinmedicaleducation 40% 4.0
Otherlifeexperience 63% 3.7
Awardsorspecialhonorsinclinicalclerkships 60% 3.8
GraduateofhighlyregardedU.S.medicalschool 63% 4.2
Awardsorspecialhonorsinclerkshipindesiredspecialty 53% 4.3
Volunteer/extracurricularexperiences 47% 3.7
GoldHumanismHonorSociety(GHHS)membership 17% 4.0
Demonstratedinvolvementandinterestinresearch 83% 4.3
Visastatus* 47% 3.8
ApplicantwasflaggedwithMatchviolationbytheNRMP 40% 4.8
Awardsorspecialhonorsinbasicsciences 37% 3.7
Interestinacademiccareer 50% 4.3
Awayrotationinyourspecialtyatanotherinstitution 60% 3.9
Fluencyinlanguagespokenbyyourpatientpopulation 20% 4.5
USMLEStep3/COMLEXLevel3score 10% 4.3
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 59


Neurological Surgery
Figure NS-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=30)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 97% 4.9


Interpersonalskills 90% 4.8
Interactionswithhousestaffduringinterviewandvisit 93% 4.8
Feedbackfromcurrentresidents 90% 4.7
USMLEStep1/COMLEXLevel1score 77% 4.5
Lettersofrecommendationinthespecialty 90% 4.7
USMLEStep2CK/COMLEXLevel2CEscore 43% 4.5
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 50% 4.3
Evidenceofprofessionalismandethics 73% 4.6
Perceivedcommitmenttospecialty 67% 4.7
Perceivedinterestinprogram 73% 4.6
Personalpriorknowledgeoftheapplicant 60% 4.4
Classranking/quartile 37% 4.3
Leadershipqualities 63% 4.6
Gradesinrequiredclerkships 47% 3.9
PersonalStatement 43% 4.0
Auditionelective/rotationwithinyourdepartment 70% 4.7
PassingUSMLEStep2CS/COMLEXLevel2PE 23% 4.2
Gradesinclerkshipindesiredspecialty 43% 4.3
AnyfailedattemptinUSMLE/COMLEX 17% 5.0
Consistencyofgrades 50% 4.4
AlphaOmegaAlpha(AOA)membership 43% 3.9
Otherlifeexperience 33% 3.9
GraduateofhighlyregardedU.S.medicalschool 43% 4.5
Lackofgapsinmedicaleducation 37% 4.0
Volunteer/extracurricularexperiences 33% 3.8
Awardsorspecialhonorsinclinicalclerkships 40% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 40% 4.1
GoldHumanismHonorSociety(GHHS)membership 17% 3.8
Demonstratedinvolvementandinterestinresearch 67% 4.5
ApplicantwasflaggedwithMatchviolationbytheNRMP 23% 4.2
Visastatus* 17% 4.5
Interestinacademiccareer 47% 4.3
Awardsorspecialhonorsinbasicsciences 27% 3.9
Fluencyinlanguagespokenbyyourpatientpopulation 17% 4.3
Secondinterview/visit 20% 4.2
Awayrotationinyourspecialtyatanotherinstitution 23% 4.7
USMLEStep3/COMLEXLevel3score 7% 4.0
Otherpostinterviewcontact 23% 4.2
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 60


Neurological Surgery
Figure NS-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=26 exam on the first attempt?
90% 100% N=26

77% 90%
80%
80%
70%
70%
60% 58%
60%
50%
50%
42%
40%
40%
30% 23% 30%
20% 20%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=24
the exam on the first attempt?
N=22
100% 100%
90% 90%
80% 80%
70% 70%
60% 59%
60%
50% 50%
40% 38% 40% 36%
33%
29%
30% 30%
20% 20%
10% 10% 5%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230 USMLE Step 2 CK


not reported
220 220
because of low
210 210 response rate
200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1


N=19 N=5 N=12

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 61


Neurological Surgery
Figure NS-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=24 100% N=22

90% 90%
80% 80%
73%
70% 67% 70%
60% 60%
50% 50%
40% 33% 40%
30% 30%
20% 20% 18%

10%
N=24 10% N=22 9%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=13
100% N=13
90% 90%
80% 77% 80% 77%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 15% 20% 15%
10% 8% 10% 8%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=13 100% N=13
90% 85% 90% 85%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 15% 20% 15%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 62


Neurological Surgery
Figure NS-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
280 100%
241 90%
240
80%
200 70% 66%
60%
160
50%
120 40%
32%
30%
80
51 20%
40
40 31 10%

2 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=32* N=26 N=26 N=27 N=27* N=25 N=26

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
7% of Neurological Surgery programs consider all applicant groups
N=28
100% 96%
90%
80% 79%
70%
61%
60%
50% 46%
40%
30% 25%
20% 18%
10% 7%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 100% 4%
7% 7% 11% 7% 7% 11%
90% 90% 15%
26%
32% 32% 37%
80% 80%
37%
70% 50% 70% 52%
60% 61% 60%
71% 59%
50% 100% 79% 50% 100% 70%
40% 40%
64% 52% 74%
68%
30% 30% 56%
20% 43% 20% 44%
32% 30%
10% 21% 10%
11% 11% 15%
0% 4% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=29 n=28

NRMP Program Director Survey Results, 2016 63


Neurological Surgery
Figure NS-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
69% 70%
70%
60% 60%
50% 50%
40% 37%
40%
26% 29%
30% 30%
20% 13% 20%
10% 8% 9% 10% 7%
2% 1%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=27 N=27

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 5.0
Quality of patient care 5.0
Professionalism 5.0
Ethics 5.0
Communication skills 4.8
Passing board certification examination 5.0
Academic performance during residenc. 4.8
Personality 4.4
Ability to teach medical students 4.3
Performance in-training examination 4.8
Research and publications 4.4

0 1 2 3 4 5
n=26

NRMP Program Director Survey Results, 2016 64


Neurology
(N=55)

NRMP Program Director Survey Results, 2016 65


Neurology
Figure N-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=50)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 94% 4.0


Lettersofrecommendationinthespecialty 90% 4.1
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 88% 4.0
USMLEStep2CK/COMLEXLevel2CEscore 84% 4.0
Gradesinrequiredclerkships 81% 4.0
PersonalStatement 75% 3.8
Classranking/quartile 72% 3.8
AnyfailedattemptinUSMLE/COMLEX 84% 4.5
Gradesinclerkshipindesiredspecialty 77% 4.4
Evidenceofprofessionalismandethics 63% 4.3
Perceivedcommitmenttospecialty 79% 4.4
Personalpriorknowledgeoftheapplicant 71% 4.1
Leadershipqualities 56% 3.9
Auditionelective/rotationwithinyourdepartment 59% 4.0
Consistencyofgrades 68% 4.1
PassUSMLEStep2CS/COMLEXLevel2PE 69% 4.1
AlphaOmegaAlpha(AOA)membership 45% 4.1
Perceivedinterestinprogram 58% 4.2
Lackofgapsinmedicaleducation 69% 3.9
Otherlifeexperience 54% 3.7
Awardsorspecialhonorsinclinicalclerkships 57% 3.8
GraduateofhighlyregardedU.S.medicalschool 65% 4.0
Awardsorspecialhonorsinclerkshipindesiredspecialty 56% 4.1
Volunteer/extracurricularexperiences 45% 3.5
GoldHumanismHonorSociety(GHHS)membership 33% 3.9
Demonstratedinvolvementandinterestinresearch 50% 3.6
Visastatus* 43% 3.7
ApplicantwasflaggedwithMatchviolationbytheNRMP 37% 4.7
Awardsorspecialhonorsinbasicsciences 32% 3.4
Interestinacademiccareer 28% 4.0
Awayrotationinyourspecialtyatanotherinstitution 26% 3.0
Fluencyinlanguagespokenbyyourpatientpopulation 21% 3.8
USMLEStep3/COMLEXLevel3score 28% 3.7
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 66


Neurology
Figure N-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=50)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 96% 4.9


Interpersonalskills 94% 4.8
Interactionswithhousestaffduringinterviewandvisit 88% 4.7
Feedbackfromcurrentresidents 84% 4.7
USMLEStep1/COMLEXLevel1score 76% 3.9
Lettersofrecommendationinthespecialty 88% 4.1
USMLEStep2CK/COMLEXLevel2CEscore 76% 3.9
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 82% 4.1
Evidenceofprofessionalismandethics 59% 4.6
Perceivedcommitmenttospecialty 78% 4.4
Perceivedinterestinprogram 73% 4.1
Personalpriorknowledgeoftheapplicant 55% 4.3
Classranking/quartile 60% 4.1
Leadershipqualities 54% 4.3
Gradesinrequiredclerkships 59% 4.0
PersonalStatement 54% 3.7
Auditionelective/rotationwithinyourdepartment 50% 4.3
PassingUSMLEStep2CS/COMLEXLevel2PE 69% 4.0
Gradesinclerkshipindesiredspecialty 58% 4.3
AnyfailedattemptinUSMLE/COMLEX 51% 4.3
Consistencyofgrades 60% 4.0
AlphaOmegaAlpha(AOA)membership 37% 3.7
Otherlifeexperience 30% 3.9
GraduateofhighlyregardedU.S.medicalschool 47% 3.7
Lackofgapsinmedicaleducation 41% 4.3
Volunteer/extracurricularexperiences 28% 3.8
Awardsorspecialhonorsinclinicalclerkships 32% 3.5
Awardsorspecialhonorsinclerkshipindesiredspecialty 35% 3.8
GoldHumanismHonorSociety(GHHS)membership 27% 3.6
Demonstratedinvolvementandinterestinresearch 32% 3.5
ApplicantwasflaggedwithMatchviolationbytheNRMP 32% 4.7
Visastatus* 26% 4.1
Interestinacademiccareer 22% 4.0
Awardsorspecialhonorsinbasicsciences 25% 3.4
Fluencyinlanguagespokenbyyourpatientpopulation 14% 4.7
Secondinterview/visit 22% 3.8
Awayrotationinyourspecialtyatanotherinstitution 10% 4.2
USMLEStep3/COMLEXLevel3score 33% 3.9
Otherpostinterviewcontact 22% 3.8
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 67


Neurology
Figure N-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=50 exam on the first attempt?
90% 100% N=51
90%
80%
80% 76%
70%
60% 70%
60%
60%
50%
40% 50%
40%
40%
30% 30%
20% 20% 18%
10% 10% 6%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=49
the exam on the first attempt?
N=47
100% 100%
90% 90%
80% 80%
79%
70% 70%
60% 60%
50% 45% 50%
41%
40% 40%
30% 30%
20% 14% 20% 15%
10% 10% 6%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=23 N=18 N=16 N=12

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 68


Neurology
Figure N-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=48 100% N=41

90% 85% 90%


80% 80%
70% 70% 66%
60% 60%
50% 50%
40% 40%
30% 30%
20%
20% 15% 20% 15%
10%
N=48 10% N=41
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=36
100% N=34
90% 90%
80% 80%
70% 70%
60% 60%
50% 50%
42% 39% 41%
40% 40%
32%
30% 30% 26%
19%
20% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=34 100% N=31
90% 90%
80% 80% 74%
70% 70%
60% 60%
50% 50%
40% 35% 38% 40%
30% 26% 30%
20% 20% 16%
10%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 69


Neurology
Figure N-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
600
100%
530
90%
500
80%

70%
400
60%

50% 48%
300 45%
40%
200 30%

20%
100 79
62 55 10%

5 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=55* N=55 N=55 N=55 N=55* N=52 N=55

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
24% of Neurology programs consider all applicant groups
N=52
100% 97%
90%
90% 83%
81%
80% 77%
70%
62%
60%
50%
40%
29%
30%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 100%
8% 8%
90% 22% 90% 22%
80% 45% 80% 44%
30% 50% 31% 48% 51%
54%
70% 63% 70% 65%
60% 60%
92% 96%
50% 50%
62% 64%
40% 40%
30% 53% 62% 30% 54% 61% 44%
20% 44% 16% 45%
42%
20% 20%
10% 18% 16% 10% 18% 14%
8% 6% 4% 4% 8% 4%
0% 2% 0% 2%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=51 n=51

NRMP Program Director Survey Results, 2016 70


Neurology
Figure N-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
52%
50% 50%
40% 40% 36%
32%
30% 30%
21% 19% 18%
20% 20% 15%
10% 6% 2% 10%
0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=48 N=48

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.8
Passing board certification examination 4.7
Academic performance during residenc. 4.3
Personality 4.3
Ability to teach medical students 4.2
Performance in-training examination 3.5
Research and publications 3.4

0 1 2 3 4 5
n=47

NRMP Program Director Survey Results, 2016 71


Obstetrics and Gynecology
(N=95)

NRMP Program Director Survey Results, 2016 72


Obstetrics and Gynecology
Figure OG-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=86)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 91% 4.2


Lettersofrecommendationinthespecialty 87% 4.2
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 81% 4.0
USMLEStep2CK/COMLEXLevel2CEscore 83% 4.2
Gradesinrequiredclerkships 92% 4.2
PersonalStatement 67% 3.6
Classranking/quartile 79% 4.0
AnyfailedattemptinUSMLE/COMLEX 69% 4.6
Gradesinclerkshipindesiredspecialty 80% 4.3
Evidenceofprofessionalismandethics 60% 4.5
Perceivedcommitmenttospecialty 63% 4.0
Personalpriorknowledgeoftheapplicant 60% 4.2
Leadershipqualities 72% 4.3
Auditionelective/rotationwithinyourdepartment 59% 4.1
Consistencyofgrades 66% 4.2
PassUSMLEStep2CS/COMLEXLevel2PE 66% 4.2
AlphaOmegaAlpha(AOA)membership 71% 3.8
Perceivedinterestinprogram 44% 4.1
Lackofgapsinmedicaleducation 57% 4.2
Otherlifeexperience 59% 3.6
Awardsorspecialhonorsinclinicalclerkships 56% 3.7
GraduateofhighlyregardedU.S.medicalschool 59% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 56% 3.8
Volunteer/extracurricularexperiences 51% 3.8
GoldHumanismHonorSociety(GHHS)membership 58% 4.0
Demonstratedinvolvementandinterestinresearch 47% 3.6
Visastatus* 43% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 30% 5.0
Awardsorspecialhonorsinbasicsciences 21% 2.9
Interestinacademiccareer 13% 3.9
Awayrotationinyourspecialtyatanotherinstitution 10% 3.2
Fluencyinlanguagespokenbyyourpatientpopulation 26% 3.7
USMLEStep3/COMLEXLevel3score 13% 3.3
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 73


Obstetrics and Gynecology
Figure OG-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=86)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 96% 4.8


Interpersonalskills 96% 4.8
Interactionswithhousestaffduringinterviewandvisit 93% 4.9
Feedbackfromcurrentresidents 89% 4.7
USMLEStep1/COMLEXLevel1score 68% 4.3
Lettersofrecommendationinthespecialty 62% 3.9
USMLEStep2CK/COMLEXLevel2CEscore 71% 4.2
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 49% 3.7
Evidenceofprofessionalismandethics 60% 4.6
Perceivedcommitmenttospecialty 59% 4.1
Perceivedinterestinprogram 62% 4.2
Personalpriorknowledgeoftheapplicant 52% 4.3
Classranking/quartile 49% 4.0
Leadershipqualities 56% 4.4
Gradesinrequiredclerkships 51% 4.1
PersonalStatement 39% 3.5
Auditionelective/rotationwithinyourdepartment 56% 4.3
PassingUSMLEStep2CS/COMLEXLevel2PE 48% 4.3
Gradesinclerkshipindesiredspecialty 43% 4.2
AnyfailedattemptinUSMLE/COMLEX 38% 4.6
Consistencyofgrades 41% 4.0
AlphaOmegaAlpha(AOA)membership 44% 4.0
Otherlifeexperience 42% 3.9
GraduateofhighlyregardedU.S.medicalschool 38% 3.9
Lackofgapsinmedicaleducation 24% 4.3
Volunteer/extracurricularexperiences 35% 3.8
Awardsorspecialhonorsinclinicalclerkships 28% 4.0
Awardsorspecialhonorsinclerkshipindesiredspecialty 27% 4.0
GoldHumanismHonorSociety(GHHS)membership 40% 3.9
Demonstratedinvolvementandinterestinresearch 25% 3.7
ApplicantwasflaggedwithMatchviolationbytheNRMP 24% 4.7
Visastatus* 29% 4.1
Interestinacademiccareer 16% 3.7
Awardsorspecialhonorsinbasicsciences 13% 3.5
Fluencyinlanguagespokenbyyourpatientpopulation 20% 3.7
Secondinterview/visit 23% 3.8
Awayrotationinyourspecialtyatanotherinstitution 11% 3.5
USMLEStep3/COMLEXLevel3score 17% 3.6
Otherpostinterviewcontact 23% 3.8
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 74


Obstetrics and Gynecology
Figure OG-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=84 exam on the first attempt?
90% 100% N=84
90%
80%
68% 80% 75%
70%
70%
60%
60%
50%
50%
40%
31% 40%
30% 30%
21%
20% 20%
10% 10% 4%
1%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=81
the exam on the first attempt?
N=80
100% 100%
90% 90%
80% 80%
70% 70%
60% 60% 57%
53%
50% 50%
40%
40% 36% 40%
30% 30%
20% 20%
11%
10% 10% 3%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=51 N=39 N=38 N=29

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 75


Obstetrics and Gynecology
Figure OG-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=82 100% N=45

90% 90%
83%
80% 80%
73%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 17% 20% 18%

10%
N=82 10% N=45 9%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=58
100% N=56
90% 90%
80% 80%
70% 70%
60% 60%
50% 45% 50%
38% 39%
40% 34% 40%
30% 30% 23%
21%
20% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=54 100% N=32
90% 90%
80% 80%
72%
70% 70%
63%
60% 60%
50% 50%
40% 40%
30% 26% 30%
22%
20% 20%
11%
10% 10% 6%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 76


Obstetrics and Gynecology
Figure OG-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
500 488 100%

90%

400 80%

70%

300 60%
53%
50%
42%
200 40%

30%

92 20%
100 73 65
10%
6 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=95* N=93 N=93 N=94 N=94* N=89 N=91

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
7% of Obstetrics and Gynecology programs consider all applicant groups
N=88
100% 97%
90%
80%
70% 68%
64%
60%
50% 47%
40% 38%
30% 28%
20%
10% 8%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 4% 100% 1% 2%
7% 12%
14%
90% 24% 23% 90% 23% 22%
80% 80%
48% 47%
70% 54% 70% 54%
62% 55%
60% 60%
68% 69%
50% 99% 50% 100%
40% 73% 77% 40% 73% 77%
42% 40%
30% 30%
20% 43% 20% 44%
34% 38%
10% 18% 10% 19%
9% 13%
0% 1% 4% 0% 4%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=86 n=84

NRMP Program Director Survey Results, 2016 77


Obstetrics and Gynecology
Figure OG-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
61% 60%
60%
50% 50%
41%
40% 40% 35%
30% 30%
20% 17% 16% 20% 12% 10%
10% 5% 10%
1% 1%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=87 N=87

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.8
Passing board certification examination 4.7
Academic performance during residenc. 4.3
Personality 4.2
Ability to teach medical students 4.2
Performance in-training examination 3.9
Research and publications 3.3

0 1 2 3 4 5
n=79

NRMP Program Director Survey Results, 2016 78


Orthopaedic Surgery
(N=66)

NRMP Program Director Survey Results, 2016 79


Orthopaedic Surgery
Figure OS-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=64)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 98% 4.5


Lettersofrecommendationinthespecialty 94% 4.4
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 73% 3.8
USMLEStep2CK/COMLEXLevel2CEscore 67% 4.0
Gradesinrequiredclerkships 86% 4.3
PersonalStatement 84% 3.5
Classranking/quartile 70% 4.2
AnyfailedattemptinUSMLE/COMLEX 31% 4.9
Gradesinclerkshipindesiredspecialty 67% 4.3
Evidenceofprofessionalismandethics 73% 4.5
Perceivedcommitmenttospecialty 48% 4.5
Personalpriorknowledgeoftheapplicant 81% 4.4
Leadershipqualities 72% 4.2
Auditionelective/rotationwithinyourdepartment 78% 4.4
Consistencyofgrades 56% 4.3
PassUSMLEStep2CS/COMLEXLevel2PE 23% 4.1
AlphaOmegaAlpha(AOA)membership 88% 3.9
Perceivedinterestinprogram 63% 4.2
Lackofgapsinmedicaleducation 34% 4.3
Otherlifeexperience 70% 3.8
Awardsorspecialhonorsinclinicalclerkships 73% 4.0
GraduateofhighlyregardedU.S.medicalschool 41% 3.6
Awardsorspecialhonorsinclerkshipindesiredspecialty 55% 3.9
Volunteer/extracurricularexperiences 53% 3.9
GoldHumanismHonorSociety(GHHS)membership 39% 3.8
Demonstratedinvolvementandinterestinresearch 64% 3.9
Visastatus* 14% 4.1
ApplicantwasflaggedwithMatchviolationbytheNRMP 16% 4.6
Awardsorspecialhonorsinbasicsciences 42% 3.6
Interestinacademiccareer 20% 3.8
Awayrotationinyourspecialtyatanotherinstitution 33% 3.9
Fluencyinlanguagespokenbyyourpatientpopulation 6% 4.0
USMLEStep3/COMLEXLevel3score 2% 4.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 80


Orthopaedic Surgery
Figure OS-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=64)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 94% 4.9


Interpersonalskills 89% 4.8
Interactionswithhousestaffduringinterviewandvisit 94% 4.8
Feedbackfromcurrentresidents 88% 4.8
USMLEStep1/COMLEXLevel1score 67% 4.3
Lettersofrecommendationinthespecialty 75% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 39% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 38% 4.0
Evidenceofprofessionalismandethics 52% 4.5
Perceivedcommitmenttospecialty 42% 4.6
Perceivedinterestinprogram 55% 4.1
Personalpriorknowledgeoftheapplicant 63% 4.3
Classranking/quartile 45% 4.1
Leadershipqualities 50% 4.2
Gradesinrequiredclerkships 59% 4.1
PersonalStatement 45% 3.9
Auditionelective/rotationwithinyourdepartment 61% 4.5
PassingUSMLEStep2CS/COMLEXLevel2PE 16% 4.1
Gradesinclerkshipindesiredspecialty 38% 4.2
AnyfailedattemptinUSMLE/COMLEX 16% 4.9
Consistencyofgrades 45% 4.2
AlphaOmegaAlpha(AOA)membership 53% 4.0
Otherlifeexperience 36% 4.3
GraduateofhighlyregardedU.S.medicalschool 28% 3.9
Lackofgapsinmedicaleducation 27% 3.8
Volunteer/extracurricularexperiences 34% 4.3
Awardsorspecialhonorsinclinicalclerkships 39% 4.0
Awardsorspecialhonorsinclerkshipindesiredspecialty 31% 4.1
GoldHumanismHonorSociety(GHHS)membership 22% 4.0
Demonstratedinvolvementandinterestinresearch 36% 4.1
ApplicantwasflaggedwithMatchviolationbytheNRMP 14% 4.7
Visastatus* 6% 4.8
Interestinacademiccareer 22% 4.0
Awardsorspecialhonorsinbasicsciences 23% 4.0
Fluencyinlanguagespokenbyyourpatientpopulation 8% 4.2
Secondinterview/visit 8% 4.3
Awayrotationinyourspecialtyatanotherinstitution 27% 4.2
USMLEStep3/COMLEXLevel3score 0%
Otherpostinterviewcontact 9% 4.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 81


Orthopaedic Surgery
Figure OS-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=62
94% exam on the first attempt?
90% 100% N=62
90%
80%
79%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30% 30%
21%
20% 20%
10% 6% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=60
the exam on the first attempt?
N=52
100% 100%
90% 90%
80% 79%
80%
70% 70%
60% 60%
50%
50% 50%
40% 35% 40%
30% 30%
21%
20% 15% 20%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=54 N=27 N=30 N=17

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 82


Orthopaedic Surgery
Figure OS-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=54 100% N=35

90% 90%
83%
80% 80%
70% 70%
59%
60% 60%
50% 50%
41%
40% 40%
30% 30%
20% 20% 14%
10%
N=54 10% N=35
3%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=25
100% N=24
90% 90% 83%
80% 80%
72%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 16% 20%
12% 13%
10% 10% 4%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=24 100% N=23
90% 90% 87%
83%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 20%
13%
10% 10% 9%
4% 4%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 83


Orthopaedic Surgery
Figure OS-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
700 669 100%

90%
600
80%
500 70%

60%
400
49%
50% 45%
300 40%

30%
200
20%
100 77 64 10%
53
5 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=66* N=66 N=65 N=65 N=65* N=66 N=65

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
3% of Orthopaedic Surgery programs consider all applicant groups
100% N=62
100%
90%
80%
70% 63%
60%
50%
40%
30%
21% 19%
20% 15% 13%
10% 3%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 5% 5% 5% 2% 100% 5% 5%
7% 7%
90% 19% 90% 20%
32% 32% 34%
80% 33% 80% 28%
32% 40%
42% 43% 39%
70% 70%
60% 60%
50% 98% 50% 100%
40% 81% 40% 80%
63% 62%
62% 66% 67%
30% 30% 61%
53% 52% 54% 54%
20% 20%
10% 10%
0% 2% 5% 0% 3%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=61 n=60

NRMP Program Director Survey Results, 2016 84


Orthopaedic Surgery
Figure OS-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 65% 70%
60% 60%
51%
50% 50% 44%
40% 40%
30% 30%
20% 17% 15% 20%
10% 10% 4%
1% 1% 1% 1%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=64 N=64

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.6
Passing board certification examination 4.9
Academic performance during residenc. 4.4
Personality 4.4
Ability to teach medical students 3.8
Performance in-training examination 4.1
Research and publications 3.8

0 1 2 3 4 5
n=63

NRMP Program Director Survey Results, 2016 85


Otolaryngology
(N=31)

NRMP Program Director Survey Results, 2016 86


Otolaryngology
Figure O-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=30)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 97% 4.4


Lettersofrecommendationinthespecialty 100% 4.6
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 70% 3.5
USMLEStep2CK/COMLEXLevel2CEscore 67% 4.0
Gradesinrequiredclerkships 90% 4.3
PersonalStatement 87% 4.0
Classranking/quartile 67% 4.0
AnyfailedattemptinUSMLE/COMLEX 30% 4.9
Gradesinclerkshipindesiredspecialty 83% 4.7
Evidenceofprofessionalismandethics 80% 4.4
Perceivedcommitmenttospecialty 73% 4.3
Personalpriorknowledgeoftheapplicant 77% 4.8
Leadershipqualities 70% 4.3
Auditionelective/rotationwithinyourdepartment 90% 4.3
Consistencyofgrades 57% 4.5
PassUSMLEStep2CS/COMLEXLevel2PE 27% 3.9
AlphaOmegaAlpha(AOA)membership 80% 3.9
Perceivedinterestinprogram 73% 4.0
Lackofgapsinmedicaleducation 47% 3.7
Otherlifeexperience 63% 3.8
Awardsorspecialhonorsinclinicalclerkships 77% 3.5
GraduateofhighlyregardedU.S.medicalschool 33% 3.3
Awardsorspecialhonorsinclerkshipindesiredspecialty 57% 4.2
Volunteer/extracurricularexperiences 63% 4.1
GoldHumanismHonorSociety(GHHS)membership 50% 3.5
Demonstratedinvolvementandinterestinresearch 83% 4.3
Visastatus* 30% 3.6
ApplicantwasflaggedwithMatchviolationbytheNRMP 23% 4.9
Awardsorspecialhonorsinbasicsciences 40% 3.3
Interestinacademiccareer 37% 4.1
Awayrotationinyourspecialtyatanotherinstitution 43% 3.8
Fluencyinlanguagespokenbyyourpatientpopulation 3% 2.0
USMLEStep3/COMLEXLevel3score 3% 3.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 87


Otolaryngology
Figure O-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=30)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 93% 5.0


Interpersonalskills 97% 5.0
Interactionswithhousestaffduringinterviewandvisit 97% 4.9
Feedbackfromcurrentresidents 93% 4.9
USMLEStep1/COMLEXLevel1score 69% 4.1
Lettersofrecommendationinthespecialty 86% 4.5
USMLEStep2CK/COMLEXLevel2CEscore 41% 3.8
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 41% 3.5
Evidenceofprofessionalismandethics 69% 4.6
Perceivedcommitmenttospecialty 72% 4.3
Perceivedinterestinprogram 76% 4.2
Personalpriorknowledgeoftheapplicant 66% 4.7
Classranking/quartile 38% 3.9
Leadershipqualities 66% 4.4
Gradesinrequiredclerkships 55% 4.0
PersonalStatement 55% 3.9
Auditionelective/rotationwithinyourdepartment 72% 4.8
PassingUSMLEStep2CS/COMLEXLevel2PE 14% 4.3
Gradesinclerkshipindesiredspecialty 45% 4.2
AnyfailedattemptinUSMLE/COMLEX 17% 4.5
Consistencyofgrades 34% 4.2
AlphaOmegaAlpha(AOA)membership 48% 3.7
Otherlifeexperience 34% 4.0
GraduateofhighlyregardedU.S.medicalschool 21% 3.6
Lackofgapsinmedicaleducation 21% 4.2
Volunteer/extracurricularexperiences 45% 4.2
Awardsorspecialhonorsinclinicalclerkships 34% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 34% 3.8
GoldHumanismHonorSociety(GHHS)membership 34% 3.6
Demonstratedinvolvementandinterestinresearch 66% 4.2
ApplicantwasflaggedwithMatchviolationbytheNRMP 14% 4.3
Visastatus* 7% 4.5
Interestinacademiccareer 45% 3.8
Awardsorspecialhonorsinbasicsciences 24% 3.5
Fluencyinlanguagespokenbyyourpatientpopulation 3% 3.0
Secondinterview/visit 0%
Awayrotationinyourspecialtyatanotherinstitution 31% 4.1
USMLEStep3/COMLEXLevel3score 3%
Otherpostinterviewcontact 0%
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 88


Otolaryngology
Figure O-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=30 exam on the first attempt?
90% 100% N=30
80% 90%
80%
80%
70% 70%
70%
60%
60%
50%
50%
40%
40%
30% 30% 27%
20%
20% 20%
10% 10%
0% 3%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=29
the exam on the first attempt?
N=25
100% 100%
90% 90%
80% 80%
72%
70% 70%
60% 60%
50% 50%
41%
40% 40%
31%
30% 28% 30% 28%
20% 20%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=22 N=8 N=15 N=6

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 89


Otolaryngology
Figure O-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=29 N=17 100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
52%
50% 48%
50%
40% 40%
30% 30%
20% 20%
10%
N=29 10% N=17
0% 0%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=11
100% N=11
91%
90% 90%
82%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 18% 20%
9%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=11 100% N=11
91% 91%
90% 90%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 20%
9% 9%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 90


Otolaryngology
Figure O-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
280 266 100%

90%
240
80% 75%
200 70%

60%
160
50%
120 40%

30% 25%
80
49 20%
39 35
40 10%
3 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=31* N=30 N=31 N=31 N=31* N=28 N=29

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
6% of Otolaryngology programs consider all applicant groups
100% N=31
100%
90%
90%
80%
70%
60%
50%
42%
40% 32% 32%
30% 26%
20% 13%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100% 4%
7% 7% 11% 10%
90% 21% 90% 22%
33%
80% 40% 80%
50% 55% 46% 52%
70% 50% 70%
46%
60% 62% 60% 55%

50% 97% 50% 97%

40% 79% 40% 78%


63%
30% 57% 30%
46% 45% 50% 48%
20% 43% 20% 43%
31% 34%
10% 10%
0% 3% 3% 0% 3% 3%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=30 n=30

NRMP Program Director Survey Results, 2016 91


Otolaryngology
Figure O-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
46% 48% 50% 46%
50%
40% 37%
40%
30% 30%
20% 20% 12%
10% 5% 10% 4%
0% 1% 1%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=30 N=30

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.8
Ethics 4.8
Communication skills 4.8
Passing board certification examination 4.8
Academic performance during residenc. 4.5
Personality 4.3
Ability to teach medical students 3.9
Performance in-training examination 3.9
Research and publications 4.0

0 1 2 3 4 5
n=29

NRMP Program Director Survey Results, 2016 92


Pathology
(N=58)

NRMP Program Director Survey Results, 2016 93


Pathology
Figure PA-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=52)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 98% 4.3


Lettersofrecommendationinthespecialty 98% 4.5
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 88% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 88% 4.1
Gradesinrequiredclerkships 79% 3.9
PersonalStatement 87% 4.0
Classranking/quartile 77% 3.8
AnyfailedattemptinUSMLE/COMLEX 94% 4.6
Gradesinclerkshipindesiredspecialty 75% 4.2
Evidenceofprofessionalismandethics 67% 4.6
Perceivedcommitmenttospecialty 98% 4.3
Personalpriorknowledgeoftheapplicant 69% 4.3
Leadershipqualities 56% 4.0
Auditionelective/rotationwithinyourdepartment 73% 4.1
Consistencyofgrades 58% 4.1
PassUSMLEStep2CS/COMLEXLevel2PE 73% 4.1
AlphaOmegaAlpha(AOA)membership 58% 3.9
Perceivedinterestinprogram 75% 4.2
Lackofgapsinmedicaleducation 69% 4.0
Otherlifeexperience 40% 3.9
Awardsorspecialhonorsinclinicalclerkships 62% 3.7
GraduateofhighlyregardedU.S.medicalschool 63% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 69% 3.9
Volunteer/extracurricularexperiences 37% 3.8
GoldHumanismHonorSociety(GHHS)membership 21% 3.5
Demonstratedinvolvementandinterestinresearch 54% 3.8
Visastatus* 33% 3.8
ApplicantwasflaggedwithMatchviolationbytheNRMP 56% 4.8
Awardsorspecialhonorsinbasicsciences 48% 3.8
Interestinacademiccareer 38% 3.8
Awayrotationinyourspecialtyatanotherinstitution 42% 3.8
Fluencyinlanguagespokenbyyourpatientpopulation 27% 4.2
USMLEStep3/COMLEXLevel3score 40% 3.5
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 94


Pathology
Figure PA-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=52)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 98% 4.9


Interpersonalskills 98% 4.8
Interactionswithhousestaffduringinterviewandvisit 98% 4.9
Feedbackfromcurrentresidents 86% 4.9
USMLEStep1/COMLEXLevel1score 94% 4.1
Lettersofrecommendationinthespecialty 90% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 86% 4.1
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 70% 4.1
Evidenceofprofessionalismandethics 64% 4.5
Perceivedcommitmenttospecialty 86% 4.5
Perceivedinterestinprogram 66% 4.3
Personalpriorknowledgeoftheapplicant 58% 4.5
Classranking/quartile 62% 3.9
Leadershipqualities 48% 4.1
Gradesinrequiredclerkships 52% 3.9
PersonalStatement 58% 3.9
Auditionelective/rotationwithinyourdepartment 64% 4.4
PassingUSMLEStep2CS/COMLEXLevel2PE 62% 4.0
Gradesinclerkshipindesiredspecialty 50% 4.1
AnyfailedattemptinUSMLE/COMLEX 60% 4.4
Consistencyofgrades 40% 4.2
AlphaOmegaAlpha(AOA)membership 48% 4.0
Otherlifeexperience 32% 3.8
GraduateofhighlyregardedU.S.medicalschool 46% 3.9
Lackofgapsinmedicaleducation 46% 4.0
Volunteer/extracurricularexperiences 28% 3.8
Awardsorspecialhonorsinclinicalclerkships 38% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 42% 4.0
GoldHumanismHonorSociety(GHHS)membership 16% 3.6
Demonstratedinvolvementandinterestinresearch 36% 3.8
ApplicantwasflaggedwithMatchviolationbytheNRMP 40% 4.8
Visastatus* 28% 4.0
Interestinacademiccareer 26% 4.1
Awardsorspecialhonorsinbasicsciences 32% 3.9
Fluencyinlanguagespokenbyyourpatientpopulation 12% 4.5
Secondinterview/visit 20% 3.8
Awayrotationinyourspecialtyatanotherinstitution 26% 3.8
USMLEStep3/COMLEXLevel3score 30% 3.9
Otherpostinterviewcontact 22% 3.9
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 95


Pathology
Figure PA-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=50 exam on the first attempt?
90% 100% N=51
90%
80%
72% 80%
70%
70%
60%
60% 55%
50%
50%
40%
40%
30% 26% 31%
30%
20% 20% 14%
10% 10%
2%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=49
the exam on the first attempt?
N=46
100% 100%
90% 90%
80% 80%
70% 70%
61%
60% 60%
49%
50% 50%
40% 40%
31%
30% 30% 26%
20%
20% 20% 13%
10% 10%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=30 N=18 N=30 N=18

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 96


Pathology
Figure PA-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=48 100% N=40

90% 90%
80% 80%
71%
70% 70%
63%
60% 60%
50% 50%
40% 40% 35%
29%
30% 30%
20% 20%
10%
N=48 10% N=40
3%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=44
100% N=41
90% 90%
80% 80%
70% 70%
60% 60%
50% 48% 50%
41% 41% 39%
40% 40%
30% 30%
20%
20% 20%
11%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=42 100% N=35
90% 90%
80% 80%
70% 70%
60%
60% 55% 60%
50% 50%
40% 40% 37%
30% 26% 30%
19%
20% 20%
10% 10%
3%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 97


Pathology
Figure PA-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
450 432 100%

400 90%

350 80%

70%
300
60%
250 51%
50% 44%
200
40%
150 30%

100 20%
62
50 44 36 10%

4 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=58* N=50 N=51 N=54 N=53* N=49 N=49

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
37% of Pathology programs consider all applicant groups
N=52
100% 96% 96% 94% 96%
90% 88%
80%
71%
70%
60%
50%
40% 37%
30%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 2% 100% 2%
90% 17% 90% 20%
80% 35% 80% 35%
56% 54%
70% 65% 63% 70% 65% 62%
67% 67%
60% 60%
50% 96% 50% 96%
73% 71%
40% 40%
30% 63% 30% 63%
44% 44%
20% 31% 31% 37% 20% 31% 31% 38%
10% 10%
2% 10% 2% 10%
0% 2% 4% 2% 0% 2% 4% 2% 2%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=52 n=52

NRMP Program Director Survey Results, 2016 98


Pathology
Figure PA-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
50% 47% 50%
40%
40% 40%
29%
30% 26% 30%
19% 20% 15% 16%
20%
10% 7% 10%
1% 1%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=48 N=48

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.7
Passing board certification examination 4.9
Academic performance during residenc. 4.5
Personality 4.3
Ability to teach medical students 3.7
Performance in-training examination 4.0
Research and publications 3.7

0 1 2 3 4 5
n=50

NRMP Program Director Survey Results, 2016 99


Pediatrics
(N=92)

NRMP Program Director Survey Results, 2016 100


Pediatrics
Figure P-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=80)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 94% 4.1


Lettersofrecommendationinthespecialty 70% 3.6
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 84% 4.2
USMLEStep2CK/COMLEXLevel2CEscore 89% 4.1
Gradesinrequiredclerkships 86% 4.1
PersonalStatement 64% 3.2
Classranking/quartile 83% 4.0
AnyfailedattemptinUSMLE/COMLEX 81% 4.5
Gradesinclerkshipindesiredspecialty 74% 4.2
Evidenceofprofessionalismandethics 60% 4.4
Perceivedcommitmenttospecialty 57% 3.9
Personalpriorknowledgeoftheapplicant 76% 4.2
Leadershipqualities 60% 3.9
Auditionelective/rotationwithinyourdepartment 69% 4.1
Consistencyofgrades 57% 3.9
PassUSMLEStep2CS/COMLEXLevel2PE 70% 4.2
AlphaOmegaAlpha(AOA)membership 77% 3.9
Perceivedinterestinprogram 39% 4.0
Lackofgapsinmedicaleducation 58% 3.9
Otherlifeexperience 56% 3.7
Awardsorspecialhonorsinclinicalclerkships 54% 3.5
GraduateofhighlyregardedU.S.medicalschool 60% 3.6
Awardsorspecialhonorsinclerkshipindesiredspecialty 52% 3.6
Volunteer/extracurricularexperiences 60% 3.8
GoldHumanismHonorSociety(GHHS)membership 66% 3.8
Demonstratedinvolvementandinterestinresearch 31% 3.3
Visastatus* 39% 3.9
ApplicantwasflaggedwithMatchviolationbytheNRMP 39% 4.7
Awardsorspecialhonorsinbasicsciences 26% 2.9
Interestinacademiccareer 18% 3.5
Awayrotationinyourspecialtyatanotherinstitution 13% 3.0
Fluencyinlanguagespokenbyyourpatientpopulation 22% 3.2
USMLEStep3/COMLEXLevel3score 15% 3.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 101


Pediatrics
Figure P-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=80)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 100% 4.6


Interpersonalskills 99% 4.7
Interactionswithhousestaffduringinterviewandvisit 99% 4.7
Feedbackfromcurrentresidents 96% 4.6
USMLEStep1/COMLEXLevel1score 90% 4.1
Lettersofrecommendationinthespecialty 72% 3.6
USMLEStep2CK/COMLEXLevel2CEscore 88% 4.1
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 82% 4.3
Evidenceofprofessionalismandethics 76% 4.4
Perceivedcommitmenttospecialty 58% 3.9
Perceivedinterestinprogram 51% 4.0
Personalpriorknowledgeoftheapplicant 71% 4.2
Classranking/quartile 76% 4.2
Leadershipqualities 72% 4.0
Gradesinrequiredclerkships 67% 4.1
PersonalStatement 67% 3.2
Auditionelective/rotationwithinyourdepartment 69% 4.3
PassingUSMLEStep2CS/COMLEXLevel2PE 67% 4.3
Gradesinclerkshipindesiredspecialty 58% 4.1
AnyfailedattemptinUSMLE/COMLEX 68% 4.4
Consistencyofgrades 54% 4.0
AlphaOmegaAlpha(AOA)membership 67% 4.0
Otherlifeexperience 59% 3.6
GraduateofhighlyregardedU.S.medicalschool 53% 3.8
Lackofgapsinmedicaleducation 50% 3.8
Volunteer/extracurricularexperiences 62% 3.7
Awardsorspecialhonorsinclinicalclerkships 47% 3.5
Awardsorspecialhonorsinclerkshipindesiredspecialty 47% 3.6
GoldHumanismHonorSociety(GHHS)membership 65% 3.9
Demonstratedinvolvementandinterestinresearch 32% 3.3
ApplicantwasflaggedwithMatchviolationbytheNRMP 28% 4.7
Visastatus* 25% 4.1
Interestinacademiccareer 16% 3.6
Awardsorspecialhonorsinbasicsciences 26% 3.0
Fluencyinlanguagespokenbyyourpatientpopulation 19% 3.3
Secondinterview/visit 20% 3.6
Awayrotationinyourspecialtyatanotherinstitution 12% 3.2
USMLEStep3/COMLEXLevel3score 10% 3.3
Otherpostinterviewcontact 17% 3.4
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 102


Pediatrics
Figure P-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=77 exam on the first attempt?
90% 100% N=77
90%
80%
80%
70%
70% 68%
60% 58%
60%
50%
40% 50%
40%
40%
30% 30%
21%
20% 20%
12%
10% 10%
1%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=78
the exam on the first attempt?
N=76
100% 100%
90% 90%
80% 80%
70% 70% 68%
60% 60%
51%
50% 50%
40%
40% 40%
30% 30% 25%
20% 20%
9% 7%
10% 10%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=37 N=32 N=33 N=31

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 103


Pediatrics
Figure P-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=76 100% N=40

90% 90% 88%


83%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 17% 20%
10%
N=76 10%
10% N=40
3%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=67
100% N=65
90% 90%
80% 80%
70% 70%
60% 60%
52%
50% 50% 45%
40% 36% 40% 37%
30% 30%
20% 20% 18%
12%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=64 100% N=39
90% 90%
82%
80% 80%
70% 64% 70%
60% 60%
50% 50%
40% 40%
30% 25% 30%
20% 20% 18%
11%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 104


Pediatrics
Figure P-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
1,400 100%
1,212 90%
1,200
80%
1,000 70%

60%
800 53%
50%
600 40%
40%

30%
400
20%
234
200
185 169 10%
14 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants standardized screening process
Match received invitations sent interviewed ranked
N=92* N=90 N=88 N=91 N=92* N=83 N=87

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
18% of Pediatrics programs consider all applicant groups
98% N=81
100%
90%
81%
80%
71%
70% 63%
60% 58%
50% 48%
40%
30%
21%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100% 3%
90% 18% 15% 90% 19%
25% 25% 25%
33% 35%
80% 35% 80% 35%
70% 70%
70% 69%
60% 60%
50% 97% 67% 52% 50% 97% 62% 51%
78% 68%
40% 59% 40%
56%
30% 61% 30% 62%

20% 20% 27%


28%
10% 23% 10% 19% 25%
18%
4% 8% 6% 4% 9%
0% 3% 3% 0% 3%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=79 n=78

NRMP Program Director Survey Results, 2016 105


Pediatrics
Figure P-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
52%
50% 50%
40% 40% 35% 32%
30% 27% 30%
20% 18%
20% 15% 14%
10% 5% 2% 10%
0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=79 N=79

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 5.0
Quality of patient care 4.9
Professionalism 5.0
Ethics 4.9
Communication skills 4.8
Passing board certification examination 4.6
Academic performance during residenc. 4.4
Personality 4.3
Ability to teach medical students 4.1
Performance in-training examination 3.6
Research and publications 3.0

0 1 2 3 4 5
n=75

NRMP Program Director Survey Results, 2016 106


Physical Medicine and Rehabilitation
(N=34)

NRMP Program Director Survey Results, 2016 107


Physical Medicine and Rehabilitation
Figure PMR-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=30)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 87% 4.2


Lettersofrecommendationinthespecialty 93% 4.3
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 90% 4.4
USMLEStep2CK/COMLEXLevel2CEscore 90% 3.9
Gradesinrequiredclerkships 80% 3.9
PersonalStatement 87% 3.9
Classranking/quartile 73% 3.7
AnyfailedattemptinUSMLE/COMLEX 72% 4.2
Gradesinclerkshipindesiredspecialty 77% 4.5
Evidenceofprofessionalismandethics 80% 4.6
Perceivedcommitmenttospecialty 90% 4.3
Personalpriorknowledgeoftheapplicant 73% 3.9
Leadershipqualities 60% 4.2
Auditionelective/rotationwithinyourdepartment 80% 4.2
Consistencyofgrades 77% 3.9
PassUSMLEStep2CS/COMLEXLevel2PE 82% 4.1
AlphaOmegaAlpha(AOA)membership 50% 3.9
Perceivedinterestinprogram 65% 4.0
Lackofgapsinmedicaleducation 67% 3.8
Otherlifeexperience 47% 3.7
Awardsorspecialhonorsinclinicalclerkships 60% 3.6
GraduateofhighlyregardedU.S.medicalschool 53% 3.3
Awardsorspecialhonorsinclerkshipindesiredspecialty 63% 3.9
Volunteer/extracurricularexperiences 67% 4.0
GoldHumanismHonorSociety(GHHS)membership 43% 3.5
Demonstratedinvolvementandinterestinresearch 57% 3.5
Visastatus* 47% 4.5
ApplicantwasflaggedwithMatchviolationbytheNRMP 43% 4.6
Awardsorspecialhonorsinbasicsciences 40% 3.3
Interestinacademiccareer 43% 3.3
Awayrotationinyourspecialtyatanotherinstitution 47% 3.8
Fluencyinlanguagespokenbyyourpatientpopulation 30% 4.0
USMLEStep3/COMLEXLevel3score 23% 3.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 108


Physical Medicine and Rehabilitation
Figure PMR-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=30)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 87% 4.6


Interpersonalskills 90% 4.6
Interactionswithhousestaffduringinterviewandvisit 87% 4.5
Feedbackfromcurrentresidents 83% 4.7
USMLEStep1/COMLEXLevel1score 73% 4.1
Lettersofrecommendationinthespecialty 87% 4.2
USMLEStep2CK/COMLEXLevel2CEscore 77% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 83% 4.3
Evidenceofprofessionalismandethics 63% 4.5
Perceivedcommitmenttospecialty 77% 4.6
Perceivedinterestinprogram 67% 4.2
Personalpriorknowledgeoftheapplicant 60% 4.0
Classranking/quartile 57% 3.9
Leadershipqualities 60% 4.1
Gradesinrequiredclerkships 60% 4.1
PersonalStatement 63% 3.9
Auditionelective/rotationwithinyourdepartment 70% 4.3
PassingUSMLEStep2CS/COMLEXLevel2PE 60% 4.1
Gradesinclerkshipindesiredspecialty 60% 4.1
AnyfailedattemptinUSMLE/COMLEX 62% 4.2
Consistencyofgrades 57% 3.8
AlphaOmegaAlpha(AOA)membership 53% 4.0
Otherlifeexperience 47% 3.7
GraduateofhighlyregardedU.S.medicalschool 38% 3.9
Lackofgapsinmedicaleducation 53% 3.8
Volunteer/extracurricularexperiences 50% 4.1
Awardsorspecialhonorsinclinicalclerkships 37% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 43% 4.0
GoldHumanismHonorSociety(GHHS)membership 40% 3.6
Demonstratedinvolvementandinterestinresearch 47% 3.7
ApplicantwasflaggedwithMatchviolationbytheNRMP 33% 4.2
Visastatus* 23% 4.4
Interestinacademiccareer 37% 3.4
Awardsorspecialhonorsinbasicsciences 35% 3.2
Fluencyinlanguagespokenbyyourpatientpopulation 18% 3.7
Secondinterview/visit 27% 3.6
Awayrotationinyourspecialtyatanotherinstitution 37% 3.7
USMLEStep3/COMLEXLevel3score 27% 3.4
Otherpostinterviewcontact 23% 4.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 109


Physical Medicine and Rehabilitation
Figure PMR-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=30 exam on the first attempt?
90% 100% N=30
90%
80%
80%
70% 70%
70%
60%
50% 60%
50% 47%
50%
40%
40%
30% 30%
20% 20% 17%
13%
10% 3% 10%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=30
the exam on the first attempt?
N=31
100% 100%
90% 90%
80% 80%
70% 70% 68%
60% 60%
50% 50%
40% 40%
40% 40%
30% 30%
20%
20% 20% 16% 16%
10% 10%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=12 N=10 N=11 N=9

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 110


Physical Medicine and Rehabilitation
Figure PMR-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=29 100% N=17

90% 90%
79%
80% 80%
70% 70%
59%
60% 60%
50% 50%
40% 40%
29%
30% 30%
21%
20% 20%
10%
N=29 10% N=17 12%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=28
100% N=28
90% 90%
80% 80%
70% 70%
60% 60%
50% 46% 46% 50%
43% 43%
40% 40%
30% 30%
20% 20% 14%
10% 7% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=27 100% N=17
90% 90%
80% 74% 80%
70% 70%
60% 60% 59%

50% 50%
40% 40%
29%
30% 30%
20% 15% 20%
11% 12%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 111


Physical Medicine and Rehabilitation
Figure PMR-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
350 100%
350
90%
300
80%

250 70%

60%
200 52%
49%
50%

150 40%

30%
100
79
65 20%
52
50 10%
5 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=34* N=33 N=33 N=33 N=33* N=31 N=32

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
39% of Physical Medicine and Rehabilitation programs consider all applicant groups
100% N=33
100% 94%
90% 88%
80%
70% 65%
60% 58%
48% 52%
50%
40%
30%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 100%
16% 16% 13% 16% 17%
90% 19% 90%
80% 42% 42% 80% 45% 40%
70% 70%
45% 48%
60% 60%
55% 58% 53%
94% 97% 56% 97% 97%
50% 50%
40% 40%
45% 47%
30% 58% 30% 55%
20% 39% 20% 39%
25% 29% 26% 30%
10% 10%
3% 13% 13%
0% 3% 3% 0% 3% 3%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=32 n=31

NRMP Program Director Survey Results, 2016 112


Physical Medicine and Rehabilitation
Figure PMR-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
50% 50%
41% 36%
40% 36% 40%
30% 30% 27% 26%
20% 13% 20%
7% 10% 8%
10% 2% 2%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=30 N=30

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.8
Communication skills 4.9
Passing board certification examination 4.6
Academic performance during residenc. 4.4
Personality 4.6
Ability to teach medical students 4.1
Performance in-training examination 3.8
Research and publications 3.6

0 1 2 3 4 5
n=29

NRMP Program Director Survey Results, 2016 113


Plastic Surgery
(N=28)

NRMP Program Director Survey Results, 2016 114


Plastic Surgery
Figure PS-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=27)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 93% 4.3


Lettersofrecommendationinthespecialty 96% 4.5
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 63% 3.6
USMLEStep2CK/COMLEXLevel2CEscore 74% 3.9
Gradesinrequiredclerkships 74% 4.1
PersonalStatement 74% 3.6
Classranking/quartile 44% 4.0
AnyfailedattemptinUSMLE/COMLEX 41% 4.8
Gradesinclerkshipindesiredspecialty 70% 4.5
Evidenceofprofessionalismandethics 74% 4.4
Perceivedcommitmenttospecialty 70% 4.6
Personalpriorknowledgeoftheapplicant 81% 4.3
Leadershipqualities 59% 4.4
Auditionelective/rotationwithinyourdepartment 78% 4.4
Consistencyofgrades 56% 4.0
PassUSMLEStep2CS/COMLEXLevel2PE 30% 4.0
AlphaOmegaAlpha(AOA)membership 74% 4.1
Perceivedinterestinprogram 44% 4.2
Lackofgapsinmedicaleducation 15% 3.5
Otherlifeexperience 48% 3.6
Awardsorspecialhonorsinclinicalclerkships 44% 3.5
GraduateofhighlyregardedU.S.medicalschool 67% 3.7
Awardsorspecialhonorsinclerkshipindesiredspecialty 56% 3.8
Volunteer/extracurricularexperiences 44% 3.2
GoldHumanismHonorSociety(GHHS)membership 19% 3.8
Demonstratedinvolvementandinterestinresearch 78% 3.9
Visastatus* 37% 4.4
ApplicantwasflaggedwithMatchviolationbytheNRMP 30% 5.0
Awardsorspecialhonorsinbasicsciences 26% 3.7
Interestinacademiccareer 63% 3.8
Awayrotationinyourspecialtyatanotherinstitution 44% 4.0
Fluencyinlanguagespokenbyyourpatientpopulation 0%
USMLEStep3/COMLEXLevel3score 19% 3.2
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 115


Plastic Surgery
Figure PS-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=27)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 96% 4.8


Interpersonalskills 96% 4.8
Interactionswithhousestaffduringinterviewandvisit 96% 4.8
Feedbackfromcurrentresidents 88% 4.7
USMLEStep1/COMLEXLevel1score 81% 4.2
Lettersofrecommendationinthespecialty 92% 4.5
USMLEStep2CK/COMLEXLevel2CEscore 50% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 15% 4.0
Evidenceofprofessionalismandethics 62% 4.6
Perceivedcommitmenttospecialty 62% 4.2
Perceivedinterestinprogram 50% 4.2
Personalpriorknowledgeoftheapplicant 50% 4.4
Classranking/quartile 23% 4.0
Leadershipqualities 62% 4.5
Gradesinrequiredclerkships 38% 3.9
PersonalStatement 27% 3.9
Auditionelective/rotationwithinyourdepartment 58% 4.7
PassingUSMLEStep2CS/COMLEXLevel2PE 27% 4.0
Gradesinclerkshipindesiredspecialty 31% 4.1
AnyfailedattemptinUSMLE/COMLEX 4% 4.0
Consistencyofgrades 27% 3.9
AlphaOmegaAlpha(AOA)membership 50% 3.7
Otherlifeexperience 27% 4.0
GraduateofhighlyregardedU.S.medicalschool 35% 3.5
Lackofgapsinmedicaleducation 4% 4.0
Volunteer/extracurricularexperiences 27% 3.7
Awardsorspecialhonorsinclinicalclerkships 19% 3.4
Awardsorspecialhonorsinclerkshipindesiredspecialty 19% 4.4
GoldHumanismHonorSociety(GHHS)membership 4% 4.0
Demonstratedinvolvementandinterestinresearch 46% 3.9
ApplicantwasflaggedwithMatchviolationbytheNRMP 8% 5.0
Visastatus* 15% 4.3
Interestinacademiccareer 31% 4.0
Awardsorspecialhonorsinbasicsciences 4% 5.0
Fluencyinlanguagespokenbyyourpatientpopulation 0%
Secondinterview/visit 0%
Awayrotationinyourspecialtyatanotherinstitution 35% 4.1
USMLEStep3/COMLEXLevel3score 15% 4.0
Otherpostinterviewcontact 0%
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 116


Plastic Surgery
Figure PS-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=25 exam on the first attempt?
90% 100% N=26
90%
80% 76%
80%
70%
70%
60% 62%
60%
50%
50%
40% 38%
40%
30% 24% 30%
20% 20%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=24
the exam on the first attempt?
N=23
100% 100%
90% 90%
80% 80%
70% 70% 65%
60% 60%
50% 46% 50%
40% 33% 40% 35%
30% 30%
21%
20% 20%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=19 N=12 N=10 N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 117


Plastic Surgery
Figure PS-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=23 100% N=19

90% 90%
80% 74% 80%
70% 70%
60% 60%
53%
50% 50%
40% 40%
30% 26% 30% 26%
21%
20% 20%
10%
N=23 10% N=19
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=9
100% N=9
90% 90%
80% 80%
70% 70%
60% 56% 60% 56%
50% 50%
40%
33% 40% 33%
30% 30%
20% 20%
11% 11%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=9 100% N=9
90% 90%
80% 80%
70% 70%
60% 56% 60% 56%
50% 50%
40% 33% 40% 33%
30% 30%
20% 20%
11% 11%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 118


Plastic Surgery
Figure PS-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
200 196 100%

90%

160 80%
70%
70%

120 60%

50%

80 40%
33%
30%
42 20%
40 32
26
10%
2 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=28* N=28 N=28 N=28 N=28* N=27 N=26

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
25% of Plastic Surgery programs consider all applicant groups
100% N=28
100%
90%
80%
70%
60% 57%
50% 43%
40% 32%
30% 29% 29%
25%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 4% 100% 4% 4%
8% 8% 12% 8%
90% 19% 16% 90% 17% 16%

80% 28% 80% 28%

70% 52% 70% 48%


56% 58% 48% 44% 54%
60% 48% 60%
92% 96%
50% 50%
75%
40% 77% 40%
68% 68%
30% 30%
44% 48%
20% 36% 36% 35% 20% 40% 40% 38%
10% 10%
8% 4% 4% 8%
0% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=26 n=26

NRMP Program Director Survey Results, 2016 119


Plastic Surgery
Figure PS-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
61%
60% 55% 60%
50% 50%
40% 40%
31%
30% 30%
22%
20% 14% 20%
7% 10% 8%
10% 1% 0% 0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=26 N=26

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 5.0
Quality of patient care 5.0
Professionalism 5.0
Ethics 5.0
Communication skills 4.8
Passing board certification examination 4.9
Academic performance during residenc. 4.5
Personality 4.6
Ability to teach medical students 4.1
Performance in-training examination 4.2
Research and publications 4.1

0 1 2 3 4 5
n=25

NRMP Program Director Survey Results, 2016 120


Psychiatry
(N=80)

NRMP Program Director Survey Results, 2016 121


Psychiatry
Figure PSY-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=73)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 81% 3.7


Lettersofrecommendationinthespecialty 90% 4.2
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 92% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 81% 3.9
Gradesinrequiredclerkships 78% 4.1
PersonalStatement 95% 4.2
Classranking/quartile 63% 3.6
AnyfailedattemptinUSMLE/COMLEX 73% 4.2
Gradesinclerkshipindesiredspecialty 77% 4.3
Evidenceofprofessionalismandethics 77% 4.7
Perceivedcommitmenttospecialty 89% 4.5
Personalpriorknowledgeoftheapplicant 63% 4.0
Leadershipqualities 62% 4.1
Auditionelective/rotationwithinyourdepartment 63% 3.7
Consistencyofgrades 55% 3.9
PassUSMLEStep2CS/COMLEXLevel2PE 68% 4.1
AlphaOmegaAlpha(AOA)membership 37% 3.8
Perceivedinterestinprogram 60% 4.3
Lackofgapsinmedicaleducation 73% 4.1
Otherlifeexperience 63% 3.8
Awardsorspecialhonorsinclinicalclerkships 62% 3.5
GraduateofhighlyregardedU.S.medicalschool 58% 3.6
Awardsorspecialhonorsinclerkshipindesiredspecialty 59% 3.8
Volunteer/extracurricularexperiences 55% 3.8
GoldHumanismHonorSociety(GHHS)membership 45% 3.8
Demonstratedinvolvementandinterestinresearch 33% 3.5
Visastatus* 52% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 49% 4.9
Awardsorspecialhonorsinbasicsciences 25% 3.4
Interestinacademiccareer 23% 3.9
Awayrotationinyourspecialtyatanotherinstitution 22% 3.8
Fluencyinlanguagespokenbyyourpatientpopulation 41% 4.3
USMLEStep3/COMLEXLevel3score 27% 3.4
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 122


Psychiatry
Figure PSY-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=73)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 94% 4.9


Interpersonalskills 96% 4.9
Interactionswithhousestaffduringinterviewandvisit 94% 4.9
Feedbackfromcurrentresidents 87% 4.8
USMLEStep1/COMLEXLevel1score 65% 3.8
Lettersofrecommendationinthespecialty 71% 4.2
USMLEStep2CK/COMLEXLevel2CEscore 71% 3.9
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 77% 4.2
Evidenceofprofessionalismandethics 78% 4.7
Perceivedcommitmenttospecialty 86% 4.6
Perceivedinterestinprogram 67% 4.3
Personalpriorknowledgeoftheapplicant 55% 4.2
Classranking/quartile 52% 3.8
Leadershipqualities 59% 4.3
Gradesinrequiredclerkships 57% 4.1
PersonalStatement 75% 4.2
Auditionelective/rotationwithinyourdepartment 58% 4.1
PassingUSMLEStep2CS/COMLEXLevel2PE 58% 4.3
Gradesinclerkshipindesiredspecialty 58% 4.2
AnyfailedattemptinUSMLE/COMLEX 51% 4.1
Consistencyofgrades 46% 4.1
AlphaOmegaAlpha(AOA)membership 30% 3.9
Otherlifeexperience 58% 3.8
GraduateofhighlyregardedU.S.medicalschool 39% 4.0
Lackofgapsinmedicaleducation 55% 4.2
Volunteer/extracurricularexperiences 43% 4.1
Awardsorspecialhonorsinclinicalclerkships 41% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 45% 3.7
GoldHumanismHonorSociety(GHHS)membership 35% 4.1
Demonstratedinvolvementandinterestinresearch 28% 3.9
ApplicantwasflaggedwithMatchviolationbytheNRMP 35% 4.9
Visastatus* 28% 4.3
Interestinacademiccareer 29% 4.1
Awardsorspecialhonorsinbasicsciences 23% 3.6
Fluencyinlanguagespokenbyyourpatientpopulation 43% 4.4
Secondinterview/visit 26% 4.3
Awayrotationinyourspecialtyatanotherinstitution 19% 3.5
USMLEStep3/COMLEXLevel3score 23% 3.4
Otherpostinterviewcontact 19% 4.1
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 123


Psychiatry
Figure PSY-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=68 exam on the first attempt?
90% 100% N=69
90%
80%
72% 80%
70%
70% 64%
60%
60%
50%
50%
40%
40% 35%
30% 26% 30%
20% 20%
10% 10%
1% 1%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=68
the exam on the first attempt?
N=66
100% 100%
90% 90%
80% 80%
70% 70% 67%
60% 56% 60%
50% 50%
40% 40%
32%
30% 28% 30%
20% 16% 20%
10% 10%
2%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=11 N=8 N=9 N=7

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 124


Psychiatry
Figure PSY-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=68 100% N=50

90% 90%
80% 78% 80% 74%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
22% 22%
20% 20%
10%
N=68 10% N=50
4%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=64
100% N=62
90% 90%
80% 80%
70%
70% 70%
60% 60% 55%
50% 50%
40% 40%
30% 30%
22% 23% 23%
20% 20%
10% 8% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=62 100% N=41
90% 90%
80% 80% 76%
70% 68% 70%
60% 60%
50% 50%
40% 40%
30% 27% 30%
20%
20% 20%
10% 5% 10% 5%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 125


Psychiatry
Figure PSY-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
1,000 983 100%

90%

800 80%

70%

600 60%
54%
50%

400 40%
33%
30%

20%
200
105 86 10%
71
8 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants standardized screening process
Match received invitations sent interviewed ranked
N=80* N=77 N=77 N=78 N=78* N=75 N=76

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
24% of Psychiatry programs consider all applicant groups
N=72
100% 96%
90%
81% 82%
80% 72%
70% 67%
61%
60%
50%
40%
30% 28%
20%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 100%
6% 6%
90% 22% 90% 24%
31% 33%
80% 41% 80% 44%
42% 54% 40%
70% 70% 59%
66% 68%
60% 60%
90% 94%
50% 50%
66% 63%
40% 56% 40% 53%
30% 55% 30% 51%
52% 41% 54%
37%
20% 29% 20% 28%
10% 10%
7% 12% 13% 13% 14%
3% 4% 6% 4% 6% 4% 4% 4%
0% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=72 n=71

NRMP Program Director Survey Results, 2016 126


Psychiatry
Figure PSY-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
49% 50%
50%
40% 40%
30% 30% 27%
30% 23% 30%
20% 13% 20% 12%
10%
10% 5% 10%
1%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=70 N=70

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.8
Passing board certification examination 4.7
Academic performance during residenc. 4.1
Personality 4.3
Ability to teach medical students 3.9
Performance in-training examination 3.4
Research and publications 3.1

0 1 2 3 4 5
n=68

NRMP Program Director Survey Results, 2016 127


Radiation Oncology
(N=28)

NRMP Program Director Survey Results, 2016 128


Radiation Oncology
Figure RO-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=27)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 100% 4.1


Lettersofrecommendationinthespecialty 100% 4.5
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 93% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 59% 3.3
Gradesinrequiredclerkships 93% 4.3
PersonalStatement 74% 3.5
Classranking/quartile 67% 4.2
AnyfailedattemptinUSMLE/COMLEX 22% 4.7
Gradesinclerkshipindesiredspecialty 74% 4.5
Evidenceofprofessionalismandethics 67% 4.7
Perceivedcommitmenttospecialty 89% 4.3
Personalpriorknowledgeoftheapplicant 67% 4.2
Leadershipqualities 56% 3.8
Auditionelective/rotationwithinyourdepartment 85% 4.0
Consistencyofgrades 70% 4.2
PassUSMLEStep2CS/COMLEXLevel2PE 19% 3.8
AlphaOmegaAlpha(AOA)membership 67% 3.5
Perceivedinterestinprogram 63% 4.1
Lackofgapsinmedicaleducation 26% 4.0
Otherlifeexperience 59% 3.6
Awardsorspecialhonorsinclinicalclerkships 74% 3.6
GraduateofhighlyregardedU.S.medicalschool 59% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 59% 3.9
Volunteer/extracurricularexperiences 48% 3.5
GoldHumanismHonorSociety(GHHS)membership 19% 3.2
Demonstratedinvolvementandinterestinresearch 85% 4.3
Visastatus* 26% 3.4
ApplicantwasflaggedwithMatchviolationbytheNRMP 15% 4.8
Awardsorspecialhonorsinbasicsciences 30% 3.1
Interestinacademiccareer 56% 4.1
Awayrotationinyourspecialtyatanotherinstitution 56% 4.1
Fluencyinlanguagespokenbyyourpatientpopulation 19% 3.4
USMLEStep3/COMLEXLevel3score 7% 3.5
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 129


Radiation Oncology
Figure RO-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=27)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 100% 4.9


Interpersonalskills 100% 4.9
Interactionswithhousestaffduringinterviewandvisit 93% 4.8
Feedbackfromcurrentresidents 89% 4.8
USMLEStep1/COMLEXLevel1score 59% 4.3
Lettersofrecommendationinthespecialty 85% 4.3
USMLEStep2CK/COMLEXLevel2CEscore 30% 3.8
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 70% 4.2
Evidenceofprofessionalismandethics 67% 4.8
Perceivedcommitmenttospecialty 74% 4.4
Perceivedinterestinprogram 67% 4.2
Personalpriorknowledgeoftheapplicant 48% 4.5
Classranking/quartile 56% 4.0
Leadershipqualities 41% 4.4
Gradesinrequiredclerkships 81% 4.2
PersonalStatement 52% 3.6
Auditionelective/rotationwithinyourdepartment 74% 4.5
PassingUSMLEStep2CS/COMLEXLevel2PE 0%
Gradesinclerkshipindesiredspecialty 44% 4.6
AnyfailedattemptinUSMLE/COMLEX 0%
Consistencyofgrades 52% 4.1
AlphaOmegaAlpha(AOA)membership 33% 3.7
Otherlifeexperience 41% 3.8
GraduateofhighlyregardedU.S.medicalschool 26% 4.1
Lackofgapsinmedicaleducation 19% 3.8
Volunteer/extracurricularexperiences 26% 3.3
Awardsorspecialhonorsinclinicalclerkships 37% 3.4
Awardsorspecialhonorsinclerkshipindesiredspecialty 41% 3.8
GoldHumanismHonorSociety(GHHS)membership 15% 3.0
Demonstratedinvolvementandinterestinresearch 74% 4.5
ApplicantwasflaggedwithMatchviolationbytheNRMP 4% 5.0
Visastatus* 7% 4.5
Interestinacademiccareer 52% 4.4
Awardsorspecialhonorsinbasicsciences 15% 2.8
Fluencyinlanguagespokenbyyourpatientpopulation 15% 3.8
Secondinterview/visit 11% 2.0
Awayrotationinyourspecialtyatanotherinstitution 41% 3.7
USMLEStep3/COMLEXLevel3score 4% 4.0
Otherpostinterviewcontact 11% 2.3
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 130


Radiation Oncology
Figure RO-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=28 exam on the first attempt?
89% 100% N=28
90%
90%
80%
80%
70%
70%
60%
60%
50% 50%
50% 46%
40%
40%
30% 30%
20% 20%
11%
10% 10% 4%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=24
the exam on the first attempt?
N=20
100% 100%
90% 90%
80% 80%
70% 70%
60% 60% 55%
50% 46% 50%
38% 40%
40% 40%
30% 30%
20% 17% 20%
10% 10% 5%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230 USMLE Step 2 CK


not reported
220 220
because of low
210 210 response rate
200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1


N=21 N=7 N=9

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 131


Radiation Oncology
Figure RO-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=24 100% N=21

90% 90%
80% 80%
70% 70% 67%
63%
60% 60%
50% 50%
40% 38% 40%
30% 30%
19%
20% 20% 14%
10%
N=24 10% N=21
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=9
100% N=9
90% 90%
89%

80% 80%
70% 67% 70%
60% 60%
50% 50%
40% 40%
30% 30%
22%
20% 20%
11% 11%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=9 100% N=9
89% 89%
90% 90%
80% 80%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 20%
11% 11%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 132


Radiation Oncology
Figure RO-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
180 178 100%

160 90%
81%
80%
140
70%
120
60%
100
50%
80 40%
60 30% 26%

40 33 20%
28 26
10%
20
2 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=28* N=28 N=28 N=28 N=28* N=28 N=28

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
7% of Radiation Oncology programs consider all applicant groups
N=28
100% 96%
90%
80%
70%
60% 54%
50% 46%
40% 32%
30% 25% 25%
20%
10% 7%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100% 4% 4%
7%
90% 21% 90% 16%
23%
29% 29% 30%
80% 80% 40%
48% 42%
70% 43% 70% 58%
64%
60% 60%
93% 54% 93% 60%
50% 50%
40% 68% 40% 77%
71% 67%
30% 30% 60%
50% 52% 54%
20% 20% 38%
32%
10% 25% 10% 24%
4% 4%
0% 4% 4% 0% 4% 4%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=28 n=28

NRMP Program Director Survey Results, 2016 133


Radiation Oncology
Figure RO-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
59% 60% 53%
60%
50% 50%
40% 38%
40%
29% 30%
30%
20% 20%
8% 9%
10% 5% 10%
0% 0% 0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=28 N=28

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 5.0
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.8
Communication skills 4.8
Passing board certification examination 4.8
Academic performance during residenc. 4.3
Personality 4.4
Ability to teach medical students 3.6
Performance in-training examination 3.4
Research and publications 4.0

0 1 2 3 4 5
n=26

NRMP Program Director Survey Results, 2016 134


Radiology
(N=55)

NRMP Program Director Survey Results, 2016 135


Radiology-Diagnostic
Figure RD-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=46)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 98% 4.4


Lettersofrecommendationinthespecialty 80% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 91% 4.6
USMLEStep2CK/COMLEXLevel2CEscore 72% 4.0
Gradesinrequiredclerkships 89% 4.4
PersonalStatement 80% 3.7
Classranking/quartile 72% 4.5
AnyfailedattemptinUSMLE/COMLEX 68% 4.8
Gradesinclerkshipindesiredspecialty 54% 4.3
Evidenceofprofessionalismandethics 70% 4.7
Perceivedcommitmenttospecialty 57% 4.2
Personalpriorknowledgeoftheapplicant 61% 4.2
Leadershipqualities 63% 4.2
Auditionelective/rotationwithinyourdepartment 63% 3.8
Consistencyofgrades 73% 4.4
PassUSMLEStep2CS/COMLEXLevel2PE 38% 4.2
AlphaOmegaAlpha(AOA)membership 76% 4.0
Perceivedinterestinprogram 62% 4.2
Lackofgapsinmedicaleducation 54% 4.0
Otherlifeexperience 63% 3.9
Awardsorspecialhonorsinclinicalclerkships 57% 4.3
GraduateofhighlyregardedU.S.medicalschool 61% 4.1
Awardsorspecialhonorsinclerkshipindesiredspecialty 35% 4.3
Volunteer/extracurricularexperiences 41% 4.0
GoldHumanismHonorSociety(GHHS)membership 48% 3.9
Demonstratedinvolvementandinterestinresearch 65% 3.7
Visastatus* 40% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 42% 4.8
Awardsorspecialhonorsinbasicsciences 33% 4.1
Interestinacademiccareer 30% 3.9
Awayrotationinyourspecialtyatanotherinstitution 15% 3.6
Fluencyinlanguagespokenbyyourpatientpopulation 12% 3.7
USMLEStep3/COMLEXLevel3score 11% 4.2
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 136


Radiology-Diagnostic
Figure RD-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=46)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 95% 4.9


Interpersonalskills 95% 4.9
Interactionswithhousestaffduringinterviewandvisit 91% 4.9
Feedbackfromcurrentresidents 88% 4.8
USMLEStep1/COMLEXLevel1score 80% 4.2
Lettersofrecommendationinthespecialty 51% 4.1
USMLEStep2CK/COMLEXLevel2CEscore 51% 4.2
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 86% 4.5
Evidenceofprofessionalismandethics 64% 4.7
Perceivedcommitmenttospecialty 58% 4.2
Perceivedinterestinprogram 63% 4.3
Personalpriorknowledgeoftheapplicant 63% 4.3
Classranking/quartile 69% 4.2
Leadershipqualities 56% 4.4
Gradesinrequiredclerkships 58% 4.4
PersonalStatement 57% 3.8
Auditionelective/rotationwithinyourdepartment 49% 4.4
PassingUSMLEStep2CS/COMLEXLevel2PE 28% 4.2
Gradesinclerkshipindesiredspecialty 37% 4.3
AnyfailedattemptinUSMLE/COMLEX 31% 4.8
Consistencyofgrades 56% 4.2
AlphaOmegaAlpha(AOA)membership 63% 4.3
Otherlifeexperience 41% 4.3
GraduateofhighlyregardedU.S.medicalschool 55% 4.0
Lackofgapsinmedicaleducation 33% 4.2
Volunteer/extracurricularexperiences 24% 4.2
Awardsorspecialhonorsinclinicalclerkships 42% 4.1
Awardsorspecialhonorsinclerkshipindesiredspecialty 30% 4.2
GoldHumanismHonorSociety(GHHS)membership 35% 4.3
Demonstratedinvolvementandinterestinresearch 35% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 26% 4.9
Visastatus* 19% 4.3
Interestinacademiccareer 31% 4.2
Awardsorspecialhonorsinbasicsciences 23% 4.0
Fluencyinlanguagespokenbyyourpatientpopulation 9% 4.3
Secondinterview/visit 23% 4.3
Awayrotationinyourspecialtyatanotherinstitution 5% 4.5
USMLEStep3/COMLEXLevel3score 12% 4.4
Otherpostinterviewcontact 14% 3.7
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 137


Radiology-Diagnostic
Figure RD-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=45 exam on the first attempt?
90% 100% N=43
80% 90%
80%
80%
70%
70%
60%
60%
50% 51%
50% 47%
40%
40%
30% 30%
20%
20% 20%
10% 10%
0% 2%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=42
the exam on the first attempt?
N=26
100% 100%
90% 90%
80% 80%
70% 70%
62%
60% 60%
50% 43% 50%
40% 38% 40% 35%
30% 30%
19%
20% 20%
10% 10% 4%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=29 N=16 N=25 N=15

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 138


Radiology-Diagnostic
Figure RD-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=42 100% N=32

90% 90%
80% 80% 78%

70% 70%
62%
60% 60%
50% 50%
40% 38% 40%
30% 30%
20% 20%
13%
10%
N=42 10% N=32 9%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=31
100% N=30
90% 90%
80% 80%
70% 70% 63%
60% 60%
52%
50% 50%
40% 39% 40% 33%
30% 30%
20% 20%
10%
10% 10% 3%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=28 100% N=25
92%
90% 90%
80% 80%
71%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30%
20% 14% 14% 20%
10% 10% 8%
0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 139


Radiology-Diagnostic
Figure RD-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
450
445 100%

400 90%

80%
350
70%
300
60% 57%
250
50%
43%
200 40%

150 30%
113
100 88 20%
78
10%
50
7 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=55* N=53 N=52 N=53 N=53* N=50 N=52

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
15% of Radiology-Diagnostic programs consider all applicant groups
N=48
100% 93%
90%
80%
80%
70% 66% 66%
60%
51%
50% 46%
40%
30%
20% 15%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100%
7%
90% 19% 90% 18%
24% 28%
24% 34% 23%
80% 40% 80% 43% 39%
53% 57%
70% 70%
60% 60%
91% 96%
50% 62% 50% 64%
61% 54%
40% 51% 40% 46%
47% 71% 41% 70%
30% 38% 30%
37%
20% 20%
10% 19% 15% 15% 10% 15% 18% 15% 17%
4% 9% 13%
4% 2%
2% 7%
0% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=46 n=47

NRMP Program Director Survey Results, 2016 140


Radiology-Diagnostic
Figure RD-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 55% 60%
50% 50%
40% 40%
30% 28% 31%
30% 23% 30%
20% 20%
11% 11%
10% 7% 5% 10%
0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=47 N=47

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.8
Passing board certification examination 5.0
Academic performance during residenc. 4.6
Personality 4.4
Ability to teach medical students 3.7
Performance in-training examination 3.6
Research and publications 3.5

0 1 2 3 4 5
n=43

NRMP Program Director Survey Results, 2016 141


Surgery
(N=96)

NRMP Program Director Survey Results, 2016 142


Surgery
Figure GS-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=88)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 95% 4.3


Lettersofrecommendationinthespecialty 91% 4.3
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 78% 3.9
USMLEStep2CK/COMLEXLevel2CEscore 87% 4.2
Gradesinrequiredclerkships 83% 3.9
PersonalStatement 76% 3.7
Classranking/quartile 81% 3.9
AnyfailedattemptinUSMLE/COMLEX 68% 4.8
Gradesinclerkshipindesiredspecialty 80% 4.3
Evidenceofprofessionalismandethics 61% 4.4
Perceivedcommitmenttospecialty 63% 4.1
Personalpriorknowledgeoftheapplicant 73% 4.2
Leadershipqualities 72% 4.2
Auditionelective/rotationwithinyourdepartment 57% 4.1
Consistencyofgrades 61% 3.9
PassUSMLEStep2CS/COMLEXLevel2PE 56% 4.1
AlphaOmegaAlpha(AOA)membership 63% 4.1
Perceivedinterestinprogram 66% 4.0
Lackofgapsinmedicaleducation 52% 4.1
Otherlifeexperience 60% 3.8
Awardsorspecialhonorsinclinicalclerkships 60% 3.9
GraduateofhighlyregardedU.S.medicalschool 59% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 61% 4.1
Volunteer/extracurricularexperiences 53% 3.7
GoldHumanismHonorSociety(GHHS)membership 41% 4.1
Demonstratedinvolvementandinterestinresearch 48% 3.8
Visastatus* 36% 4.2
ApplicantwasflaggedwithMatchviolationbytheNRMP 40% 4.8
Awardsorspecialhonorsinbasicsciences 35% 3.5
Interestinacademiccareer 26% 4.1
Awayrotationinyourspecialtyatanotherinstitution 20% 3.6
Fluencyinlanguagespokenbyyourpatientpopulation 15% 3.7
USMLEStep3/COMLEXLevel3score 9% 3.5
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 143


Surgery
Figure GS-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=88)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 92% 4.8


Interpersonalskills 91% 4.7
Interactionswithhousestaffduringinterviewandvisit 88% 4.7
Feedbackfromcurrentresidents 82% 4.6
USMLEStep1/COMLEXLevel1score 83% 4.2
Lettersofrecommendationinthespecialty 85% 4.1
USMLEStep2CK/COMLEXLevel2CEscore 76% 4.2
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 65% 3.9
Evidenceofprofessionalismandethics 58% 4.5
Perceivedcommitmenttospecialty 71% 4.2
Perceivedinterestinprogram 74% 4.2
Personalpriorknowledgeoftheapplicant 68% 4.3
Classranking/quartile 63% 3.9
Leadershipqualities 63% 4.2
Gradesinrequiredclerkships 63% 4.0
PersonalStatement 58% 3.6
Auditionelective/rotationwithinyourdepartment 49% 4.3
PassingUSMLEStep2CS/COMLEXLevel2PE 45% 4.2
Gradesinclerkshipindesiredspecialty 60% 4.2
AnyfailedattemptinUSMLE/COMLEX 40% 4.7
Consistencyofgrades 40% 4.1
AlphaOmegaAlpha(AOA)membership 54% 4.1
Otherlifeexperience 54% 3.8
GraduateofhighlyregardedU.S.medicalschool 40% 4.0
Lackofgapsinmedicaleducation 36% 4.1
Volunteer/extracurricularexperiences 38% 3.5
Awardsorspecialhonorsinclinicalclerkships 42% 3.9
Awardsorspecialhonorsinclerkshipindesiredspecialty 48% 4.0
GoldHumanismHonorSociety(GHHS)membership 32% 4.1
Demonstratedinvolvementandinterestinresearch 40% 3.9
ApplicantwasflaggedwithMatchviolationbytheNRMP 30% 4.8
Visastatus* 24% 4.2
Interestinacademiccareer 26% 4.0
Awardsorspecialhonorsinbasicsciences 24% 3.6
Fluencyinlanguagespokenbyyourpatientpopulation 13% 3.8
Secondinterview/visit 20% 4.2
Awayrotationinyourspecialtyatanotherinstitution 11% 3.9
USMLEStep3/COMLEXLevel3score 6% 3.8
Otherpostinterviewcontact 15% 3.8
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 144


Surgery
Figure GS-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=81 exam on the first attempt?
90% 100% N=83
90%
90%
80%
80%
70%
70%
60%
60%
50% 49% 49%
50%
40%
40%
30% 30%
20% 20%
10%
10% 10%
0% 1%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=75
the exam on the first attempt?
N=76
100% 100%
90% 90%
80% 80%
70% 67% 70% 63%
60% 60%
50% 50%
40% 40% 37%
30% 30%
20% 19% 20%
15%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=69 N=51 N=58 N=42

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 145


Surgery
Figure GS-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=74 100% N=52

90% 90%
80% 78% 80%
70% 70%
62%
60% 60%
50% 50%
40% 40%
31%
30% 30%
22%
20% 20%
10%
N=74 10% N=52 8%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=36
100% N=34
90% 90%
80% 80%
70% 70%
60% 60% 59%

50% 47% 50%


40% 40%
30% 25% 28% 30% 24%
20% 20% 18%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=36 100% N=29
90% 90%
79%
80% 80%
70% 70%
61%
60% 60%
50% 50%
40% 40%
31%
30% 30%
20% 20% 14%
10% 8% 10% 7%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 146


Surgery
Figure GS-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
800 759 100%

700 90%

80%
600
70%
500 60%
60%

400 50%

40%
300 33%
30%
200
20%

100 83 10%
63 50
5 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=96* N=92 N=93 N=94 N=94* N=91 N=91

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
10% of Surgery programs consider all applicant groups
N=89
100% 97%
90%
80%
71%
70%
60% 53%
52%
50%
38% 39%
40%
30%
20% 17%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100% 5%
11% 11%
90% 19% 90% 24% 21%
25% 29% 28%
35% 24% 32% 23%
80% 80%
70% 70%
60% 44% 60% 63% 39%
64%
50% 98% 49% 50% 99% 48%
55% 54%
40% 40%
63% 72% 66% 72%
30% 30%
20% 38% 20% 39%
25% 25% 28% 26%
10% 16% 10% 18%
0% 2% 2% 0% 1% 2%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=87 n=86

NRMP Program Director Survey Results, 2016 147


Surgery
Figure GS-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
50% 48% 50%
40% 40% 34%
30% 29%
30% 30%
16% 19% 20%
20%
10% 7%
10% 6% 10%
0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=89 N=89

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 5.0
Quality of patient care 5.0
Professionalism 4.9
Ethics 4.9
Communication skills 4.7
Passing board certification examination 4.9
Academic performance during residenc. 4.3
Personality 4.3
Ability to teach medical students 4.0
Performance in-training examination 4.0
Research and publications 3.6

0 1 2 3 4 5
n=81

NRMP Program Director Survey Results, 2016 148


Thoracic Surgery
(N=12)

NRMP Program Director Survey Results, 2016 149


Thoracic Surgery
Figure TS-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=12)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 83% 4.1


Lettersofrecommendationinthespecialty 92% 4.5
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 83% 4.0
USMLEStep2CK/COMLEXLevel2CEscore 83% 3.7
Gradesinrequiredclerkships 75% 4.2
PersonalStatement 100% 3.8
Classranking/quartile 58% 3.4
AnyfailedattemptinUSMLE/COMLEX 42% 4.4
Gradesinclerkshipindesiredspecialty 67% 4.6
Evidenceofprofessionalismandethics 83% 4.4
Perceivedcommitmenttospecialty 75% 4.6
Personalpriorknowledgeoftheapplicant 58% 3.9
Leadershipqualities 83% 4.3
Auditionelective/rotationwithinyourdepartment 75% 3.9
Consistencyofgrades 75% 4.1
PassUSMLEStep2CS/COMLEXLevel2PE 42% 4.0
AlphaOmegaAlpha(AOA)membership 58% 4.0
Perceivedinterestinprogram 58% 4.1
Lackofgapsinmedicaleducation 33% 3.3
Otherlifeexperience 75% 3.4
Awardsorspecialhonorsinclinicalclerkships 67% 4.0
GraduateofhighlyregardedU.S.medicalschool 75% 4.1
Awardsorspecialhonorsinclerkshipindesiredspecialty 42% 4.4
Volunteer/extracurricularexperiences 75% 3.9
GoldHumanismHonorSociety(GHHS)membership 33% 4.0
Demonstratedinvolvementandinterestinresearch 67% 3.8
Visastatus* 25% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 8% 3.0
Awardsorspecialhonorsinbasicsciences 42% 3.6
Interestinacademiccareer 67% 4.0
Awayrotationinyourspecialtyatanotherinstitution 33% 3.0
Fluencyinlanguagespokenbyyourpatientpopulation 8% 3.0
USMLEStep3/COMLEXLevel3score 33% 4.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 150


Thoracic Surgery
Figure TS-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=12)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 92% 4.8


Interpersonalskills 100% 4.7
Interactionswithhousestaffduringinterviewandvisit 92% 4.6
Feedbackfromcurrentresidents 92% 4.5
USMLEStep1/COMLEXLevel1score 67% 3.9
Lettersofrecommendationinthespecialty 67% 4.8
USMLEStep2CK/COMLEXLevel2CEscore 50% 3.3
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 50% 4.2
Evidenceofprofessionalismandethics 67% 4.4
Perceivedcommitmenttospecialty 75% 4.6
Perceivedinterestinprogram 50% 4.5
Personalpriorknowledgeoftheapplicant 58% 4.3
Classranking/quartile 33% 4.0
Leadershipqualities 50% 4.5
Gradesinrequiredclerkships 42% 4.2
PersonalStatement 67% 4.0
Auditionelective/rotationwithinyourdepartment 33% 4.8
PassingUSMLEStep2CS/COMLEXLevel2PE 25% 3.7
Gradesinclerkshipindesiredspecialty 25% 4.0
AnyfailedattemptinUSMLE/COMLEX 8% 5.0
Consistencyofgrades 25% 4.0
AlphaOmegaAlpha(AOA)membership 42% 4.2
Otherlifeexperience 25% 4.0
GraduateofhighlyregardedU.S.medicalschool 42% 4.4
Lackofgapsinmedicaleducation 8% 3.0
Volunteer/extracurricularexperiences 42% 4.0
Awardsorspecialhonorsinclinicalclerkships 33% 3.8
Awardsorspecialhonorsinclerkshipindesiredspecialty 17% 3.5
GoldHumanismHonorSociety(GHHS)membership 33% 4.0
Demonstratedinvolvementandinterestinresearch 58% 4.1
ApplicantwasflaggedwithMatchviolationbytheNRMP 0%
Visastatus* 17% 5.0
Interestinacademiccareer 58% 4.4
Awardsorspecialhonorsinbasicsciences 17% 3.5
Fluencyinlanguagespokenbyyourpatientpopulation 0%
Secondinterview/visit 25%
Awayrotationinyourspecialtyatanotherinstitution 17% 3.5
USMLEStep3/COMLEXLevel3score 25% 3.7
Otherpostinterviewcontact 0% 3.3
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 151


Thoracic Surgery
Figure TS-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=12 exam on the first attempt?
90% 100% N=11
90%
80%
80% 73%
70%
70%
60%
50% 50% 60%
50%
50%
40%
40%
30% 30% 27%
20% 20%
10% 10%
0% 0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=11
the exam on the first attempt?
N=10
100% 100%
90% 90%
80% 80%
70% 70%
70%
60% 55% 60%
50% 50%
40% 36% 40%
30%
30% 30%
20% 20%
9%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260

250

240

230 USMLE Step 2 CK USMLE Step 1 not USMLE Step 2 CK


not reported reported because not reported
220
because of low of low response because of low
210 response rate rate response rate
200

190

180

170

USMLE Step 1
N=4

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 152


Thoracic Surgery
Figure TS-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=12 100% N=8

90% 90%
80% 75% 80%
70% 70%
60% 60%
50%
50% 50%
40% 40% 38%
30% 25% 30%
20% 20%
13%
10%
N=12 10% N=8
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=5
100% N=5
90% 90%
80% 80%
70% 70%
60% 60%
60% 60%
50% 50%
40% 40%
30% 30%
20% 20% 20% 20%
20% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=5 100% N=5
90% 90%
80% 80%
70% 70%
60% 60%
60% 60%
50% 50%
40% 40%
30% 30%
20% 20% 20% 20%
20% 20%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 153


Thoracic Surgery
Figure TS-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
140 100%
126
90%
120
80%
100 70%

60% 56%
80
50%
60 40% 37%

30%
40
29 20%
23
19
20 10%

1 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=12* N=11 N=12 N=12 N=12* N=11 N=11

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
17% of Thoracic Surgery programs consider all applicant groups
N=12
100%
90% 83%
80%
70%
60% 58% 58% 58%
50%
50%
40% 33%
30%
20% 17%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 100%
8% 10% 10%
90% 17% 90% 18%
25% 25% 30%
33% 36%
80% 42% 25% 80% 40%
30%
70% 70%
60% 42% 60% 60%
83% 82%
25% 55%
50% 50% 20%
58%
40% 75% 40%
55% 70%
50% 67%
30% 30% 60%
20% 42% 42% 20% 40%
8% 9% 27% 30%
10% 17% 10%
8% 8% 9% 9%
0% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=12 n=12

NRMP Program Director Survey Results, 2016 154


Thoracic Surgery
Figure TS-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
60% 53%
50% 50%
40% 40% 37%
40%
30% 30%
20% 20%
10% 10% 7%
0% 0% 0% 0% 3%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=12 N=12

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 5.0
Quality of patient care 5.0
Professionalism 5.0
Ethics 5.0
Communication skills 4.8
Passing board certification examination 5.0
Academic performance during residenc. 4.3
Personality 4.5
Ability to teach medical students 4.2
Performance in-training examination 3.5
Research and publications 3.8

0 1 2 3 4 5
n=11

NRMP Program Director Survey Results, 2016 155


Transitional Year
(N=27)

NRMP Program Director Survey Results, 2016 156


Transitional Year
Figure TY-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=25)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 100% 4.4


Lettersofrecommendationinthespecialty 60% 4.0
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 88% 4.4
USMLEStep2CK/COMLEXLevel2CEscore 84% 4.5
Gradesinrequiredclerkships 64% 4.4
PersonalStatement 80% 3.9
Classranking/quartile 76% 4.0
AnyfailedattemptinUSMLE/COMLEX 60% 4.5
Gradesinclerkshipindesiredspecialty 28% 4.5
Evidenceofprofessionalismandethics 80% 4.7
Perceivedcommitmenttospecialty 20% 4.6
Personalpriorknowledgeoftheapplicant 68% 4.4
Leadershipqualities 52% 4.7
Auditionelective/rotationwithinyourdepartment 24% 3.8
Consistencyofgrades 60% 4.5
PassUSMLEStep2CS/COMLEXLevel2PE 68% 4.5
AlphaOmegaAlpha(AOA)membership 76% 4.1
Perceivedinterestinprogram 68% 4.3
Lackofgapsinmedicaleducation 60% 4.7
Otherlifeexperience 56% 4.1
Awardsorspecialhonorsinclinicalclerkships 48% 4.2
GraduateofhighlyregardedU.S.medicalschool 60% 4.3
Awardsorspecialhonorsinclerkshipindesiredspecialty 32% 4.1
Volunteer/extracurricularexperiences 48% 4.7
GoldHumanismHonorSociety(GHHS)membership 52% 4.0
Demonstratedinvolvementandinterestinresearch 40% 4.1
Visastatus* 64% 4.4
ApplicantwasflaggedwithMatchviolationbytheNRMP 36% 4.4
Awardsorspecialhonorsinbasicsciences 20% 4.2
Interestinacademiccareer 12% 3.7
Awayrotationinyourspecialtyatanotherinstitution 12% 3.7
Fluencyinlanguagespokenbyyourpatientpopulation 16% 4.8
USMLEStep3/COMLEXLevel3score 24% 4.0
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 157


Transitional Year
Figure TY-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=25)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 84% 4.9


Interpersonalskills 96% 4.8
Interactionswithhousestaffduringinterviewandvisit 76% 4.6
Feedbackfromcurrentresidents 76% 4.5
USMLEStep1/COMLEXLevel1score 52% 4.5
Lettersofrecommendationinthespecialty 44% 4.1
USMLEStep2CK/COMLEXLevel2CEscore 60% 4.5
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 60% 4.4
Evidenceofprofessionalismandethics 68% 4.8
Perceivedcommitmenttospecialty 24% 4.7
Perceivedinterestinprogram 68% 4.4
Personalpriorknowledgeoftheapplicant 56% 4.5
Classranking/quartile 52% 4.2
Leadershipqualities 48% 4.8
Gradesinrequiredclerkships 44% 4.4
PersonalStatement 60% 3.7
Auditionelective/rotationwithinyourdepartment 28% 4.4
PassingUSMLEStep2CS/COMLEXLevel2PE 52% 4.5
Gradesinclerkshipindesiredspecialty 24% 4.6
AnyfailedattemptinUSMLE/COMLEX 40% 4.8
Consistencyofgrades 44% 4.5
AlphaOmegaAlpha(AOA)membership 48% 4.3
Otherlifeexperience 32% 4.4
GraduateofhighlyregardedU.S.medicalschool 44% 4.1
Lackofgapsinmedicaleducation 40% 4.8
Volunteer/extracurricularexperiences 36% 4.4
Awardsorspecialhonorsinclinicalclerkships 32% 4.4
Awardsorspecialhonorsinclerkshipindesiredspecialty 24% 4.5
GoldHumanismHonorSociety(GHHS)membership 32% 4.5
Demonstratedinvolvementandinterestinresearch 24% 4.0
ApplicantwasflaggedwithMatchviolationbytheNRMP 24% 4.7
Visastatus* 24% 4.7
Interestinacademiccareer 8% 4.0
Awardsorspecialhonorsinbasicsciences 20% 4.2
Fluencyinlanguagespokenbyyourpatientpopulation 12% 4.3
Secondinterview/visit 32% 4.5
Awayrotationinyourspecialtyatanotherinstitution 16% 4.0
USMLEStep3/COMLEXLevel3score 20% 4.6
Otherpostinterviewcontact 8% 4.5
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 158


Transitional Year
Figure TY-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=25 exam on the first attempt?
90% 100% N=23
84%
90%
80%
80%
70%
70%
60%
60%
50% 52%
50% 43%
40%
40%
30% 30%
20% 20%
12%
10% 4% 10% 4%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=23
the exam on the first attempt?
N=19
100% 100%
90% 90%
80% 80%
70% 65% 70%
60% 60%
50% 50% 47% 47%
40% 40%
30% 30%
22%
20% 13% 20%
10% 10% 5%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=18 N=13 N=12 N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 159


Transitional Year
Figure TY-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=24 100% N=12
92%
90% 90%
80% 80% 75%
70% 70%
60% 60%
50% 50%
40% 40%
30% 30% 25%
20% 20%
10%
N=24 8% 10% N=12
0%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=18
100% N=16
90% 90%
80% 78% 80%
70% 70% 69%

60% 60%
50% 50%
40% 40%
30% 30%
20% 17% 20% 19%
13%
10% 6% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=16 100% N=10
90% 90%
80% 80%
70% 70%
60%
60% 60%
50% 50%
40% 38% 38% 40%
30%
30% 25% 30%
20% 20%
10%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 160


Transitional Year
Figure TY-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
600
100%
549
90%
500
80%

70%
400
60% 54%
300 50%
41%
40%
200 30%

103 20%
100 83 72 10%
11 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=27* N=25 N=26 N=26 N=26* N=24 N=23

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
8% of Transitional Year programs consider all applicant groups
100% N=26
100%
90%
81%
80%
70%
60%
50% 46%
40%
31%
30% 23% 23%
20%
12%
10%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 4% 100% 5%
8% 8% 12% 8% 9% 9%
17% 14%
90% 90%
80% 29% 80% 32%
29% 23%
70% 62% 70% 64%
60% 56% 60%
72% 74% 57%
50% 100% 50% 100%
92% 91%
40% 40%
67% 63% 64% 64%
30% 30%
31% 28%
20% 20%
32%
26%
10% 20% 10% 17%
8% 8%
0% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=26 n=25

NRMP Program Director Survey Results, 2016 161


Transitional Year
Figure TY-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
50% 46% 50%
40% 40% 34% 32%
30% 30% 26%
19% 20%
20% 20%
8% 7% 10% 9%
10%
0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=25 N=25

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 4.9
Quality of patient care 5.0
Professionalism 5.0
Ethics 5.0
Communication skills 4.9
Passing board certification examination 4.0
Academic performance during residenc. 4.4
Personality 4.5
Ability to teach medical students 3.7
Performance in-training examination 3.6
Research and publications 3.0

0 1 2 3 4 5
n=17

NRMP Program Director Survey Results, 2016 162


Vascular Surgery
(N=15)

NRMP Program Director Survey Results, 2016 163


Vascular Surgery
Figure VS-1 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Selecting Applicants to Interview
(N=14)
Percent Citing Factor Average Rating

USMLEStep1/COMLEXLevel1score 100% 4.2


Lettersofrecommendationinthespecialty 100% 4.6
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 71% 4.2
USMLEStep2CK/COMLEXLevel2CEscore 93% 4.0
Gradesinrequiredclerkships 79% 4.4
PersonalStatement 64% 3.7
Classranking/quartile 71% 3.7
AnyfailedattemptinUSMLE/COMLEX 50% 4.6
Gradesinclerkshipindesiredspecialty 79% 4.6
Evidenceofprofessionalismandethics 57% 4.9
Perceivedcommitmenttospecialty 93% 4.3
Personalpriorknowledgeoftheapplicant 79% 3.9
Leadershipqualities 79% 4.3
Auditionelective/rotationwithinyourdepartment 64% 3.8
Consistencyofgrades 64% 4.0
PassUSMLEStep2CS/COMLEXLevel2PE 43% 4.0
AlphaOmegaAlpha(AOA)membership 93% 3.8
Perceivedinterestinprogram 86% 4.2
Lackofgapsinmedicaleducation 36% 4.2
Otherlifeexperience 64% 3.6
Awardsorspecialhonorsinclinicalclerkships 79% 4.0
GraduateofhighlyregardedU.S.medicalschool 57% 3.6
Awardsorspecialhonorsinclerkshipindesiredspecialty 71% 4.5
Volunteer/extracurricularexperiences 50% 3.9
GoldHumanismHonorSociety(GHHS)membership 29% 3.0
Demonstratedinvolvementandinterestinresearch 71% 3.6
Visastatus* 57% 3.9
ApplicantwasflaggedwithMatchviolationbytheNRMP 21% 4.7
Awardsorspecialhonorsinbasicsciences 36% 3.4
Interestinacademiccareer 57% 4.0
Awayrotationinyourspecialtyatanotherinstitution 36% 3.2
Fluencyinlanguagespokenbyyourpatientpopulation 21% 3.7
USMLEStep3/COMLEXLevel3score 21% 3.7
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 164


Vascular Surgery
Figure VS-2 Percentage of Programs Citing Each Factor And Mean Importance Rating for Each
Factor in Ranking Applicants
(N=14)
Percent Citing Factor Average Rating

Interactionswithfacultyduringinterviewandvisit 93% 4.9


Interpersonalskills 86% 4.8
Interactionswithhousestaffduringinterviewandvisit 86% 4.6
Feedbackfromcurrentresidents 71% 4.4
USMLEStep1/COMLEXLevel1score 64% 4.1
Lettersofrecommendationinthespecialty 93% 4.5
USMLEStep2CK/COMLEXLevel2CEscore 57% 4.1
MedicalStudentPerformanceEvaluation(MSPE/Dean'sLetter) 50% 4.3
Evidenceofprofessionalismandethics 50% 4.9
Perceivedcommitmenttospecialty 86% 4.7
Perceivedinterestinprogram 79% 4.6
Personalpriorknowledgeoftheapplicant 43% 4.2
Classranking/quartile 29% 4.3
Leadershipqualities 71% 4.3
Gradesinrequiredclerkships 43% 4.5
PersonalStatement 29% 4.3
Auditionelective/rotationwithinyourdepartment 43% 4.2
PassingUSMLEStep2CS/COMLEXLevel2PE 29% 4.3
Gradesinclerkshipindesiredspecialty 57% 4.3
AnyfailedattemptinUSMLE/COMLEX 21% 4.7
Consistencyofgrades 29% 4.8
AlphaOmegaAlpha(AOA)membership 57% 4.3
Otherlifeexperience 21% 4.3
GraduateofhighlyregardedU.S.medicalschool 57% 4.0
Lackofgapsinmedicaleducation 29% 4.3
Volunteer/extracurricularexperiences 21% 4.0
Awardsorspecialhonorsinclinicalclerkships 50% 4.4
Awardsorspecialhonorsinclerkshipindesiredspecialty 50% 4.1
GoldHumanismHonorSociety(GHHS)membership 21% 4.0
Demonstratedinvolvementandinterestinresearch 43% 3.8
ApplicantwasflaggedwithMatchviolationbytheNRMP 21% 4.7
Visastatus* 29% 4.3
Interestinacademiccareer 36% 4.8
Awardsorspecialhonorsinbasicsciences 21% 4.0
Fluencyinlanguagespokenbyyourpatientpopulation 7% 5.0
Secondinterview/visit 29% 3.0
Awayrotationinyourspecialtyatanotherinstitution 29% 3.8
USMLEStep3/COMLEXLevel3score 21% 3.3
Otherpostinterviewcontact 7% 4.3
100% 50% 0% 1 2 3 4 5
Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only

NRMP Program Director Survey Results, 2016 165


Vascular Surgery
Figure VS-3 Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 1 Score
Scores required? Would your program consider applicants who fail the
100% N=14 exam on the first attempt?
90% 100% N=14
79% 90%
80%
80%
70%
70%
60%
60% 57%
50%
50%
40%
40% 36%
30% 30%
21%
20% 20%
10% 10% 7%
0%
0% 0%
Yes, pass only Yes, target score No Never Seldom Often

Percentage of Programs That Use USMLE Step 2 (CK) Score


Scores required? Would your program consider applicants who fail
N=14
the exam on the first attempt?
N=13
100% 100%
90% 90%
80% 80%
70% 70%
60% 57% 60% 54%
50% 50%
40% 40% 38%
30% 29%
30%
20% 14% 20%
10% 10% 8%
0% 0%
Yes, pass only Yes, target score No Never Seldom often

Average USMLE Step 1 and Step 2 CK Scores Programs


Consider When Granting Interviews
Scores Below Which Programs Scores Above Which Programs
Generally Do Not Grant Interviews Almost Always Grant Interviews
260 260

250 250

240 240

230 230

220 220

210 210

200 200

190 190

180 180

170 170

USMLE Step 1 USMLE Step 2 CK USMLE Step 1 USMLE Step 2 CK


N=10 N=7 N=8 N=5

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2016 166


Vascular Surgery
Figure VS-4 Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS USMLE Step 3
100% N=13 100% N=9

90% 90%
80% 80%
70% 70%
62%
60% 60% 56%
50% 50%
40% 38% 40%
33%
30% 30%
20% 20%
10%
N=13 10% N=9 11%
0% 0%
Yes No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1* COMLEX-USA Level 2-CE*
100%
N=7
100% N=7
90% 90%
80% 80%
70% 70%
60% 60% 57%
50% 50%
43% 43% 43%
40% 40%
30% 30%
20% 14% 20%
10% 10%
0%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE* COMLEX-USA Level 3*
100% N=7 100% N=7
90% 90%
80% 80%
71%
70% 70%
60% 57% 60%
50% 50%
40% 40%
30% 29% 30%
20% 14% 20% 14% 14%
10% 10%
0% 0%
Yes, pass only Yes, target score No Yes, pass only Yes, target score No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2016 167


Vascular Surgery
Figure VS-5 Program's Interview Activities

Average Number of Positions, Applications Received, Interview Average Percentage of Applicants Rejected and
Invitations Sent, and Applicants Interviewed and Ranked Reviewed
100
94 100%

90%
80 80%
72%
70%

60 60%

50%

40 40%
32%
30 30%
25
22
20%
20
10%
1 0%
0 Percentage of applications Percentage of applicants
Number of Number of Number of Number of Number of rejected based on a receiving an in-depth review
positions in the applications interview applicants applicants ranked standardized screening process
Match received invitations sent interviewed
N=15* N=15 N=15 N=15 N=15* N=15 N=15

* Data from the NRMP database. All Responding programs included

Percentage of Programs that Typically Interview and Rank Each Applicant Type
0% of Vascular Surgery programs consider all applicant groups
N=15
100% 93%
90%
80%
70% 67%
60%
60% 53%
50%
40%
40%
30% 27%
20%
10% 7%
0%
U.S. Senior U.S. Graduate Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG
Physician

Frequency of Programs Interviewing and Ranking Candidates


Interview Ranking
100% 100%
7% 7% 7%
13% 13% 13% 13%
90% 90% 20%
13%
80% 40% 80%
53%
70% 60% 70% 47%
73%
60% 67% 60%
60% 47%
93% 93%
50% 50% 73%
80%
87%
40% 40% 40% 80%
27%
30% 30%
47%
20% 40% 20%
33%
27% 27% 27%
10% 20% 10% 20%
13%
7% 7% 7%
0% 0%
US Senior Prev. Osteo Pathway Canadian US IMG Non-US US Senior Prev. Osteo Pathway Canadian US IMG Non-US
Grad IMG Grad IMG

Often Seldom Never Often Seldom Never


n=15 n=15

NRMP Program Director Survey Results, 2016 168


Vascular Surgery
Figure VS-6 Program's Interview Activities (Continued) and Program Assessment of Residents'
Success

Percentage of Program's Interviews Extended Percentage of Program's Interviews


During Each Time Period Conducted During Each Time Period
100%
100%
90%
90%
80%
80%
70% 70%
60% 60%
60%
50% 50%
40% 39% 35%
40% 40%
30% 30% 26%
20% 20%
10% 10%
0% 0% 0% 0% 0%
0% 0%
Prior to October November December January Prior to October November December January
Oct. 1 2015 2015 2015 2016 or Oct. 1 2015 2015 2015 2016 or
2015 later 2015 later
N=15 N=15

Importance of Factors in Assessing Residents' Success


Average rating on a scale of 5 (5=very important)
Clinical competency 5.0
Quality of patient care 4.9
Professionalism 4.9
Ethics 4.9
Communication skills 4.9
Passing board certification examination 4.7
Academic performance during residenc. 4.2
Personality 4.3
Ability to teach medical students 4.0
Performance in-training examination 3.7
Research and publications 3.9

0 1 2 3 4 5
n=14

NRMP Program Director Survey Results, 2016 169

Вам также может понравиться