Kappelman MM. The impact of external examinations on medical education programs and students. J Med Educ. 1983;58(4):300–8.
Wagoner NE, Gray GT. Report on a survey of program directors regarding selection factors in graduate medical education. J Med Educ. 1979;54(6):445–52.
NRMP. Results of the 2008 NRMP Program Director Survey [Internet]. Available from: https://mk0nrmp3oyqui6wqfm.kinstacdn.com/wp-content/uploads/2013/08/programresultsbyspecialty.pdf
Chen DR, Priest KC, Batten JN, Fragoso LE, Reinfeld BI, Laitman BM. Student perspectives on the “step 1 climate” in preclinical medical education. Acad Med. 2019;94(3):302–4.
Carmody JB, Rajasekaran SK. On step 1 mania, USMLE score reporting, and financial conflict of interest at the National Board of medical examiners. Acad Med. 2020;1332–7.
Chaudhry HJ, Katsufrakis PJ, Tallia AF. The USMLE step 1 decision: an opportunity for medical education and training. JAMA. 2020;323(20):2017–8.
COMLEX-USA Level 1 to Eliminate Numeric Scores [Internet]. Available from: https://www.nbome.org/news/comlex-usa-level-1-to-eliminate-numeric-scores/
Makhoul AT, Pontell ME, Kumar NG, Drolet BC. Objective measures needed-program directors’ perspectives on a pass/fail USMLE step 1. N Engl J Med. 2020;382(25):2389–92.
Rashid H, Coppola KM, Lebeau R. Three Decades Later: A Scoping Review of the Literature Related to the United States Medical Licensing Examination. Acad Med. 2020;95(11S Association of American Medical Colleges Learn Serve Lead):S114–21.
Prober CG, Kolars JC, First LR, Melnick DE. A plea to reassess the role of United States medical licensing examination step 1 scores in residency selection. Acad Med. 2016;91(1):12–5.
Andolsek KM. One small step for step 1. Acad Med. 2019;94(3):309–13.
Cortes-Penfield NW, Khazanchi R, Talmon G. Educational and Personal Opportunity Costs of Medical Student Preparation for the United States Medical Licensing Examination Step 1 Exam: A Single-Center Study. Cureus. 2020;12(10):e10938.
McDonald FS, Jurich D, Duhigg LM, Paniagua M, Chick D, Wells M, et al. Correlations between the USMLE step examinations, American College of Physicians in-Training Examination, and ABIM internal medicine certification examination. Acad Med. 2020;95(9):1388–95.
Richards BF, Cariaga-Lo L. Curriculum type and sophomore students’ preparation time for the Usmle step 1 examination. Eval Health Prof. 1994;17(3):329–43.
Kumar AD, Shah MK, Maley JH, Evron J, Gyftopoulos A, Miller C. Preparing to take the USMLE step 1: a survey on medical students ’ self-reported study habits. Postgrad Med J. 2015;91(1075):257–61.
Giordano C, Hutchinson D, Peppler R. A predictive model for USMLE step 1 scores. Cureus. 2016;8(9):1–8.
Tanenbaum EJ, Johnson JH, Jordan E, Cottral J, Tenore C, Burton WB, et al. An Effective Evidence-Based Student Run Near-Peer Support Group for the USMLE Step 1 Exam. Med Sci Educ [Internet]. 2016:691–9. https://doi.org/10.1007/s40670-016-0334-8.
Burk-Rafel J, Santen SA, Purkiss J. Study behaviors and USMLE step 1 performance: implications of a student self-directed parallel curriculum. Acad Med. 2017;92(11):S67–74.
Baños JH, Pepin ME, Van Wagoner N. Class-wide access to a commercial step 1 question Bank during preclinical organ-based modules. Acad Med [Internet]. 2017;XX(X):1 Available from: http://insights.ovid.com/crossref?an=00001888-900000000-98141.
Schwartz LF, Lineberry M, Park YS, Kamin CS, Hyderi AA. Development and evaluation of a student-initiated test preparation program for the USMLE step 1 examination. Teach Learn Med [internet]. 2017;30(2):1–9. https://doi.org/10.1080/10401334.2017.1386106.
Parry S, Pachunka J, Beck Dallaghan GL. Factors predictive of performance on USMLE step 1: do commercial study aids improve scores? Med Sci Educ. 2019;29(3):667–72.
Jackson F, Duane E, Harmon R, Kollar RA, Rainville NM, Smith RM. Resources that improve medical board licensing examination performance. Cureus. 2019;11(10):e5927.
Seal ZA, Koek W, Sharma R. Correlation of medical college admission test scores and self-assessment materials with the United States medical licensing examination step 1 performance. Cureus. 2020;12(4):1–12.
Thadani RA, Swanson DB, Galbraith RM. A preliminary analysis of different approaches to preparing for the USMLE step 1. Acad Med. 2000;75(10 Suppl):S40–2.
Werner LS, Bull BS. The effect of three commercial coaching courses on step one USMLE performance. Med Educ. 2003;37(6):527–31.
Zhang C, Rauchwarger A, Toth C. Student USMLE step 1 preparation and performance. Adv Health Sci Educ. 2005;9(4):291–7.
Alcamo AM, Davids AR, Way DP, Lynn DJ, Vandre DD. The impact of a peer-designed and -led USMLE step 1 review course: improvement in preparation and scores. Acad Med [Internet]. 2010;85(10 SUPPL):S45–8 Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-77958461852&partnerID=40&md5=5cd700f5fc8b62d3a06bc222f0ce301b.
Strowd RE, Beard HR, Gorney B, Russell GB, Lambros A. The impact of process-oriented preparation on high-stakes testing in medical school. Med Sci Educ. 2013;23(4):588–94.
Vora A, Maltezos N, Alfonzo L, Hernandez N, Calix E, Fernandez MI. Predictors of scoring at least 600 on COMLEX-USA level 1: successful preparation strategies. J Am Osteopath Assoc. 2013;113(2):164–73.
Bonasso P, Lucke-Wold B III, Reed Z, Bozek J, Cottrell S. Investigating the impact of preparation strategies on USMLE step 1 performance. MedEdPublish. 2015;4(1):5.
Deng F, Gluckstein JA, Larsen DP. Student-directed retrieval practice is a predictor of medical licensing examination performance. Perspect Med Educ. 2015;4(6):308–13.
Roscoe LJ. Wellness: a review of theory and measurement for counselors. J Couns Dev. 2009;87(2):216–26.
Liu R, Carrese J, Colbert-Getz J, Geller G, Shochet R. “Am I cut out for this?” understanding the experience of doubt among first-year medical students. Med Teach [Internet]. 2015;37(12):1083–9 Available from: http://www.tandfonline.com/doi/full/10.3109/0142159X.2014.970987.
Miller RE, Kelleher M, Duckett A, O’Rourke P, Yen M-S, Call SA, et al. Time allocation and well-being in internal medicine residents: a multi-institutional cross-sectional survey. Am J Med. 2020;133(4):515–9.
West CP, Shanafelt TD, Kolars JC. Quality of life, burnout, educational debt, and medical knowledge among internal medicine residents. JAMA. 2011;306(9):952–60.
West CP, Dyrbye LN, Satele DV, Sloan JA, Shanafelt TD. Concurrent validity of single-item measures of emotional exhaustion and depersonalization in burnout assessment. J Gen Intern Med. 2012;27(11):1445–52.
Cook AF, Arora VM, Rasinski KA, Curlin FA, Yoon JD. The prevalence of medical student mistreatment and its association with burnout. Acad Med [Internet]. 2014;89(5):749–54 Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00001888-201405000-00022.
Dyrbye LN, Schwartz A, Downing SM, Szydlo DW, Sloan JA, Shanafelt TD. Efficacy of a brief screening tool to identify medical students in distress. Acad Med. 2011;86(7):907–14.
Greenburg DL, Durning SJ, Cruess DL, Cohen DM, Jackson JL. The prevalence, causes, and consequences of experiencing a life crisis during medical school. Teach Learn Med. 2010;22(2):85–92.
LaDonna KA, Taylor T, Lingard L. Why open-ended survey questions are unlikely to support rigorous qualitative insights. Acad Med. 2018;93(3):347–9.
Brazeau CMLR, Shanafelt T, Durning SJ, Massie FS, Eacker A, Moutier C, et al. Distress among matriculating medical students relative to the general population. Acad Med [Internet]. 2014;89(11):1520–5 Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00001888-201411000-00032.
Dyrbye LN, West CP, Satele D, Boone S, Tan L, Sloan J, et al. Burnout among U.S. medical students, residents, and early career physicians relative to the general U.S. Population Acad Med [Internet]. 2014;89(3):443–51 Available from: http://content.wkhealth.com/linkback/openurl?sid=WKPTLP:landingpage&an=00001888-201403000-00025.
Shanafelt TD, West CP, Sinsky C, Trockel M, Tutty M, Satele DV, et al. Changes in burnout and satisfaction with work-life integration in physicians and the general US working population between 2011 and 2017. Mayo Clin proc [internet]. 2019;94(9):1681–94. https://doi.org/10.1016/j.mayocp.2018.10.023.
Jordan RK, Shah SS, Desai H, Tripi J, Mitchell A, Worth RG. Variation of stress levels, burnout, and resilience throughout the academic year in first-year medical students. PLoS One [Internet]. 2020;15(10 October):1–13. https://doi.org/10.1371/journal.pone.0240667.
Santen SA, Holt DB, Kemp JD. Burnout in medical Students : examining the prevalence and associated factors. South Med J. 2010;103(8):758–63.
Rotenstein LS, Ramos MA, Torre M, Segal JB, Peluso MJ, Guille C, et al. Prevalence of depression, depressive symptoms, and suicidal ideation among medical students: a systematic review and meta-analysis. JAMA. 2016;316(21):2214–36.
Dyrbye L, Shanafelt T. A narrative review on burnout experienced by medical students and residents. Med Educ. 2016;50(1):132–49.
Taking Action Against Clinician Burnout. Taking action against clinician burnout: National Academies Press; 2019.
Mazurkiewicz R, Korenstein D, Fallar R, Ripp J. The prevalence and correlations of medical student burnout in the pre-clinical years: a cross-sectional study. Psychol Health Med. 2012;17(2):188–95.
Price T, Lynn N, Coombes L, Roberts M, Gale T, de Bere SR, et al. The international landscape of medical licensing examinations: a typology derived from a systematic review. Int J Heal Policy Manag [Internet]. 2018;7(9):782–90. https://doi.org/10.15171/ijhpm.2018.32.
Hafferty FW, O’Brien BC, Tilburt JC. Beyond high-stakes testing: learner trust, educational commodification, and the loss of medical school professionalism. Acad Med. 2020;95(6):833–7.
Dyrbye LN, Sciolla AF, Dekhtyar M, Rajasekaran S, Allgood JA, Rea M, et al. Medical school strategies to address student well-being: a National Survey. Acad Med. 2019;94(6):861–8.
Dyrbye LN, Lipscomb W, Thibault G. Redesigning the learning environment to promote learner well-being and professional development. Acad Med. 2020;95(5):674–8.
Cangialosi PT, Chung BC, Thielhelm TP, Camarda ND, Eiger DS. Medical Students’ Reflections on the Recent Changes to the USMLE Step Exams. Acad Med. 2021;96(3):343–8.
Bhatnagar V, Diaz SR, Bucur PA. The cost of board examination and preparation: an overlooked factor in medical student debt. Cureus. 2019;11(3):1–28.
Dyrbye LN, Thomas MR, Massie FS, Power DV, Eacker A, Harper W, et al. Burnout and suicidal ideation among U.S. medical students. Ann Intern Med [Internet]. 2008;149(5):334–41. https://doi.org/10.7326/0003-4819-149-5-200809020-00008.
Dyrbye L, Sloan J, Shanafelt TD. Is there a connection between high educational debt and suicidal ideation among medical students? Ann Intern Med [Internet]. 2009;150(4):285. https://doi.org/10.7326/0003-4819-150-4-200902170-00023.
Rohlfing J, Navarro R, Maniya OZ, Hughes BD, Rogalsky DK. Medical student debt and major life choices other than specialty. Med Educ Online. 2014;19:1–10.
Jackson ER, Shanafelt TD, Hasan O, Satele DV, Dyrbye LN. Burnout and alcohol abuse/dependence among U.S. medical students. Acad Med. 2016;91(9):1251–6.
Dyrbye LN, Wittlin NM, Hardeman RR, Yeazel M, Herrin J, Dovidio JF, et al. A prognostic index to identify the risk of developing depression symptoms among U.S. medical students derived from a national, four-year longitudinal study. Acad Med. 2019;94(2):217–26.
Phillips JP, Wilbanks DM, Salinas DF, Doberneck DM. Educational debt in the context of career planning: a qualitative exploration of medical student perceptions. Teach Learn Med [Internet]. 2016;28(3):243–51. https://doi.org/10.1080/10401334.2016.1178116.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.