SciELO - Scientific Electronic Library Online

 
vol.6 número21Preferencias de carrera en médicos que eligen rotaciones rurales de mayor duraciónActividad física y adaptación escolar en estudiantes de medicina en un campus de la Universidad Nacional Autónoma de México índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • No hay artículos similaresSimilares en SciELO

Compartir


Investigación en educación médica

versión On-line ISSN 2007-5057

Resumen

RIVERA JIMENEZ, Jesús; FLORES HERNANDEZ, Fernando; ALPUCHE HERNANDEZ, Amilcar  y  MARTINEZ GONZALEZ, Adrián. Assessment of multiple-choice questions in medicine. Validity evidence of an instrument. Investigación educ. médica [online]. 2017, vol.6, n.21, pp.8-15. ISSN 2007-5057.  https://doi.org/10.1016/j.riem.2016.04.005.

Introduction

The appropriate preparation of test ítems of an examination constitutes validity evidence in itself. Despite there being a general consensus about item-writing guidelines, several studies report a high incidence of violations of these standards. An instrument is proposed in order to assess the quality of multiple-choice item-writing, describing the validity evidence gathering process.

Methods

The validity evidence was gathered on an instrument designed to assess multiple choice ítems features, according to the sources proposed by the Standards for Educational and Psychological Testing, and particularly those related to content, response process, and internal structure. Kappa index (following Fleiss’ model) and point-biserial correlation coefficient were used to measure concordance in the criteria assessed by the instrument. An exploratory factorial analysis was performed to identify the instrument dimensions, and Cronbach's alpha was calculated as an internal consistency statistic.

Results

Concordance between multiple judges was greater than 0.8 (almost perfect agreement) for 12 out of 21 criteria, and 0.19 for Bloom's taxonomy level. Factorial analysis defined 4 dimensions with Kaiser-Meyer-Olkin (KMO) test =0.666 (p<.01), explained variance of 49.979%, and a Cronbach's alpha of 0.627.

Conclusion

This instrument can be used to assess multiple choice ítems, since it counts with validity evidence related to content, response process and internal structure, and psychometric values appropriated for instrumentation.

Palabras llave : Test validity; Multiple choice ítems; Assessment.

        · resumen en Español     · texto en Español     · Español ( pdf )