Vista en detalle del documento

  • Titulo Artículo: Straight Line Scoring by Clinical Competency Committees Using Emergency Medicine Milestones.
  • Resumen: BACKGROUND: The Family Medicine (FM) Milestones are competency-based assessments of residents in key dimensions relevant to practice in the specialty. Residency programs use the milestones in semiannual reviews of resident performance from the time of entry into the program to graduation. OBJECTIVE: Using a national sample, we investigated the relationship of FM competency-based assessments to resident progress and the complementarity of milestones with knowledge-based assessments in FM residencies. METHODS: We used midyear and end-of-year milestone ratings for all FM residents in Accreditation Council for Graduate Medical Education-accredited programs during academic years 2014-2015 and 2015-2016. The milestones contain 22 items across 6 competencies. We created a summative index across the milestones. The American Board of Family Medicine database provided resident demographics and in-training examination (ITE) scores. We linked information to the milestone data. RESULTS: The sample encompassed 6630 FM residents. The summative milestone index increased, on average, for each cohort (postgraduate year 1 [PGY-1] to PGY-2 and PGY-2 to PGY-3) at each assessment. The correlation between the milestone index that excluded the medical knowledge milestone and ITE scores was r = .195 (P < .001) for PGY-1 to PGY-2 cohort and r = .254 (P < .001) for PGY-2 to PGY-3 cohort. For both cohorts, ITE scores and composite milestone assessments were higher for residents who advanced than for those who did not. CONCLUSIONS: BACKGROUND: In 2013, milestone ratings became a reporting requirement for emergency medicine (EM) residency programs. Programs rate each resident in the fall and spring on 23 milestone subcompetencies. OBJECTIVE: This study examined the incidence of straight line scoring (SLS) for EM Milestone ratings, defined as a resident being assessed the same score across the milestone subcompetencies. METHODS: This descriptive analysis measured the frequencies of SLS for all Accreditation Council for Graduate Medical Education (ACGME)-accredited EM programs during the 2015-2016 academic year. Outcomes were the frequency of SLS in the fall and spring milestone assessments, changes in the number of SLS reports, and reporting trends. Chi-square analysis compared nominal variables. RESULTS: There were 6257 residents in the fall and 6588 in the spring. Milestone scores were reported for 6173 EM residents in the fall (99% of 6257) and spring (94% of 6588). In the fall, 93% (5753 residents) did not receive SLS ratings and 420 (7%) did, with no significant difference compared with the spring (5776 [94%] versus 397 [6%]). Subgroup analysis showed higher SLS results for residents' first ratings (183 of 2136 versus 237 of 4220, P < .0001) and for their final ratings (200 of 2019 versus 197 of 4354, P < .0001). Twenty percent of programs submitted 10% or more SLS ratings, and a small percentage submitted more than 50% of ratings as SLS. CONCLUSIONS: Most programs did not submit SLS ratings. Because of the statistical improbability of SLS, any SLS ratings reduce the validity assertions of the milestone assessments.
  • Autores: Hamstra, Stanley J, Barton, Melissa A, Yamazaki, Kenji, Counselman, Franci, hayne, Philip H, Muelleman, Robert L, Reisdorff, Earl J., Holmboe, Eric S, Beeson, Michael S, .
  • Titulo Revista: Journal of graduate medical education, .
  • Numero: 6
  • Volumen:9
  • Fecha de publicación: 2017.
  • Base de Datos Bibliográfica: Biblioteca Virtual en Salud(BVS) , .
  • Suplemento:
  • Idioma: Inglés
  • Página Inicial: 716 Página Final: 720
  • ISBN: 1949-8357