Development and validation of an instrument to measure family physicians' clinical aptitude in metabolic syndrome in Mexico
Desarrollo y validación de un instrumento para medir la aptitud clínica de médicos familiares en síndrome metabólico en México
Carlos E Cabrera-Pivaral, MD PhDI, II; Clara Luz Gutiérrez-Ruvalcaba, MDIII; Irma Concepción Peralta-Heredia, PsyIV; Carlos Alonso-Reynoso, MDI
IUnidad de Investigación en Epidemiología Clínica, Hospital de Especialidades, Centro Médico Nacional de Occidente, Instituto Mexicano del Seguro Social, Guadalajara, México
IICentro de estudios en salud, población y desarrollo humano, Departamento de Ciencias Sociales, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara, México ]]>
IIICoordinación Delegacional de Educación en Salud. Instituto Mexicano del Seguro Social, Guadalajara, México
IVCentro de Investigación educativa y formación docente (CIEF), delegación Jalisco
ABSTRACT
OBJECTIVE: The purpose of this work was to measure family physicians' clinical aptitude for the diagnosis and treatment of metabolic syndrome in a representative sample from six Family Medicine Units (UMF) at the Mexican Institute for Social Security (IMSS), in Guadalajara, Jalisco, México.
MATERIAL AND METHODS: This is a cross-sectional study. A validated and structured instrument was used, with a confidence coefficient (Kuder-Richardson) of 0.95, that was applied to a representative sample of 90 family physicians throughout six UMFs in Guadalajara, between 2003 and 2004. Mann-Whitney's U and Kruskal-Wallis' tests were used to compare two or more groups, and the Perez-Viniegra Test was used to define aptitude development levels.
RESULTS: No statistically significant differences were found in aptitude development between the six family medicine units groups and other comparative groups.
CONCLUSIONS: The generally low level of clinical aptitude, and its indicators, reflects limitations on the part of family physicians at the IMSS in Jalisco to identify and manage metabolic syndrome.
Key words: aptitude, metabolic X syndrome, education, Mexico
OBJETIVO: El propósito de este estudio fue medir la aptitud clínica de los médicos familiares de una muestra representativa de seis Unidades de Medicina Familiar (UMF) del Instituto Mexicano del Seguro Social (IMSS), en Guadalajara, Jalisco, México, en el diagnóstico y tratamiento del síndrome metabólico.
MATERIAL Y MÉTODOS: Es un estudio observacional, prospectivo y comparativo. Se diseñó y validó un instrumento estructurado con un coeficiente de confianza (Kuder-Richardson) de 0.95, aplicado a una muestra representativa de 90 médicos familiares de seis UMF en Guadalajara, entre 2003 y 2004. Se utilizaron los tests de Mann-Whitney U y Kruskal-Wallis para comparar dos o más grupos, y el test de Pérez-Viniegra se utilizó para definir los niveles de desarrollo de aptitud.
RESULTADOS: No se observaron diferencias significativas en el desarrollo de aptitud entre las seis UMF.
CONCLUSIONES: El bajo nivel general de aptitud clínica refleja las limitaciones para identificar y manejar el síndrome metabólico por parte de los médicos familiares.
Palabras clave: aptitud, síndrome X metabólico, educación, México
Metabolic Syndrome (MS) has been called the 21st century epidemic. This is due to the fact that in the past 10 years different countries have described an increase in the incidence of this syndrome in pediatric and teenage patients.1 This syndrome has been recognized in medical literature since the last century. The combination of metabolic disorders now known as MS was first described by Kylin in the 1920s as the clustering of hypertension, hyperglycaemia, and gout. Since then, it has received different names, such as Syndrome X or insulin resistance syndrome.2
The definition of metabolic syndrome depends on which group of experts is doing the defining. All groups agree on the core components of MS: obesity, insulin resistance, dyslipidaemia, and hypertension. However, they provide different clinical criteria to identify such a cluster. Guidelines from the 2001 National Cholesterol Education Program Adult Treatment Panel (ATP III) define MS as any three of the following characteristics in the same individual:
However, the World Health Organization (WHO) has slightly different criteria for metabolic syndrome:
a) Abdominal obesity as defined by a waist to hip ratio of greater than 0.9,
b) a body mass index of at least 30 kg/m2 or
]]> c) a waist measurement over 37 inches.In Mexico, MS prevalence among adults is high (greater than that for the Caucasian population).4 If we apply the criteria given by the World Health Organization (WHO), more than six million Mexicans suffer from it, and more than 14 million if we apply the criteria from the National Cholesterol Education Program (ATP III).5
MS is a group of health problems that appear simultaneously or sequentially in the patient and lead to a larger risk of presenting type 2 diabetes mellitus and cardiovascular diseases, two of the main causes of morbidity and mortality worldwide.6
The main components of MS are abdominal obesity, arterial hypertension, glucose intolerance, and dyslipidemia (high plasma triglycerides and low HDL cholesterol). In addition, it has been proven that inadequate alimentation and the absence of physical activity favor the development of insulin resistance (a parameter for the diagnosis of MS proposed by WHO).5 It has also been proven that weight loss is the only intervention that improves all the risk factors for MS.7,8
This pathology requires the family physician's timely identification and integrative clinical management of the syndrome. Clinical aptitude is defined by the ability to know risk factors and develop diagnostic integration and management strategies.9,10
The development of clinical aptitude involves the identification of the signs and symptoms of MS, the integration and use of diagnostic and therapeutic resources, and observation of Iatrogenic effects (by commission and omission).11
Our findings on family physicians' clinical aptitude is based on a validated instrument developed from actual case reviews of Family Medicine Units charts in order to identify and evaluate the physicians' clinical practices.12
]]>Material and Methods
This is a cross-sectional study that included a total of 450 family physicians from the Family Medicine Units at the Mexican Institute of Social Security (IMSS, in Spanish) in the city of Guadalajara. The sample was obtained by performing a random sample of conglomerates. In the first stage, a random sample to select 6 of the 23 (26%) Family Medicine Units was performed using simple random sampling. In the second stage, 90 family physicians from the previously selected Units were evaluated by census. Inclusion criteria were being an attending physician or replacement physician, working the day shift, either gender, and verbally agreeing to participate in the study by answering the total number of questions. Exclusion criteria were family physicians from the emergency room, working the night shift, being on vacation, having the day off, or being a resident at the moment at which the instrument was administered. Elimination criteria were answering less than 90% of the questions.13
The main study variable was clinical aptitude for MS, defined as the group of abilities expressed by the identification of signs, indicators for the use of integrated diagnostics, and the use of resources for diagnosis and treatment. Aptitude was rated using five indicators: 1) Risk factor identification: the identification of the condition, characteristics, or attributes that relate to a major probability of presenting MS, 2) Clinical and paraclinical recognition of MS: the identification of signs as well as laboratory tests suggesting MS, 3) Integrated diagnosis: the gathering of clinical and paraclinical data that determine MS, 4) Global use of diagnostic resources: the ability to use and interpret laboratory and imaging tests that contribute to a better interpretation of MS, 5) Global use of therapeutic resources: the ability to use pharmacological and non-pharmacological means to improve a patient's condition, cure MS, or diminish the probabilities of major damage.
Other study variables were: a) sociodemographic characteristics such as age and sex, b) working conditions such as specialty, shift, years of service, contract type, and department and c) continuous education; that is, previous courses in MS.
Instruments: The instrument was developed and conceptualized by the two authors of this report using case report reviews, based on a participative education perspective that integrates theory and practice, with abilities related to the analysis, synthesis, and critique of clinical situations. The clinical case reports are real, condensed and fragmented in order to reproduce, as faithful as possible, the clinical reality. The questions had three answer options: true, false, and I don't know.
The final version was developed after a validation process by expert family medicine opinions, established by a coincidence of four or five out of five. The instrument had 158 questions distributed by their theoretic values: 27 for risk factor identification, 30 for clinical and paraclinical recognition of MS, 32 for Integrated diagnosis, 28 for global use of diagnostic resources, and 41 for global use of therapeutic resources. Questions were balanced in a 50% to 50% ratio between true or false. For qualification purposes each right answer added one point, each wrong answer reduced one point, and the "I don't know" answer had a 0 point value. The result was obtained by the arithmetical addition of right and wrong answers with a maximum theoretical qualification of 158. In order to avoid bias due to a high probability to guess the right answer (50%) in this type of instrument, the chance-corrected qualifications were calculated, then the following levels of clinical aptitude were established: chance-corrected (<24), very low (25-50), low (51-77), intermediate (78-104), high (105-131), and very high (132-158).
Statistical analysis: Kuder-Richardson was used to obtain reliability.
Descriptive statistics were used with medians, frequency, and percentages. Finally, inferential non-parametric statistics were used with Mann-Whitney's U test for two unrelated groups and Kruskal-Wallis test was applied to compare more than two unrelated groups. Data was analyzed with EPI-Info 2002 and SPSS 12.
]]> Ethical considerations: In Mexican law, according to the "Ley General de Salud en Materia de Investigación para la Salud"14 the present work is considered to be research without risk (Article 12). Verbal informed consent from each participant was requested (Article 13).
Results
The instrument's confidence coefficient (Kuder-Richardson) was 0.95. General characteristics of the sample are described in Table I, and the number of Family Medicine Units as well as distribution by sex are in Table II. Results sorted by medians for the six Family Medicine Units are also described in Table II; there are no statistically significant differences between groups (p=0.493). Table III shows the clinical aptitude level sorted by Family Medicine Unit, showing that 54.4% were due to chance and the remaining 45.6% had a very low level. Global results showed a mean of 23 points in a range of -3 to 50. Only units B and F obtained a very low level, compared with the answers obtained by chance from the other units (p=0.376). In Table IV, clinical aptitude is sorted by Family Medicine Unit. Table V shows the clinical aptitude level sorted by those who had previous courses in MS and those who did not. Comparing medians between units (A, B, C, D, E, F) and clinical aptitude indicators, no statistically significant differences were found (KW: Non significant). Using the theoretical total for each indicator, no statistically significant difference was found (p>0.05).
]]>
When we related clinical aptitude for the identification of MS with sex (U: p=0.858), years of service (KW, p=0.664 and p=0.875), family medicine specialty (U: p=0.101) and shift (U: p=0.619 and 0.897), no statistically significant differences appeared.
Discussion
MS impacts individual, familial, and institutional health. Costs associated with treatment and complications represent a serious burden on health services and patients. This is the reason why family physicians, being the first level in health care, should act with efficacy and in a timely manner. Research into the development of clinical aptitude of family physicians in MS should be mandatory.
]]> The measurement of clinical aptitude with instruments like the one we have used is generally used to identify clinical aptitude and the degree of transition between novice and expert. This is done with the objective of promoting educational processes that lead to increasing expertise as a result of intentional educational processes.15Education for family medicine specialists seeks to provide theoretical and methodological tools for physicians16 to offer health care to the population, the identification and treatment of MS being one of these tools; however, the results of our study indicate that there is no relation between the tools provided and the ability of physicians to diagnose the syndrome, given the low aptitude level found in the total sample. Results sorted by curricular differences suggest a slight advantage, but is not significant.
In addition, years of practice in family medicine should give the physician vast experience in situations and conditions in the health care of the population. Physicians with more than 20 years in practice showed a slight non-statistically significant advantage in clinical aptitude for MS, in contrast with the other groups. This fact should motivate the creation of spaces and opportunities for continuous medical education and specialist training.17,18
In the matter of working shifts, there were no significant differences in the development of aptitude, although when compared with the afternoon shift, morning shift physicians showed an advantage. This could be related to the fact that most of the continuous educational activities as well as other institutional activities take place during the morning shift, which may have influenced the results. However, this insignificant advantage is also explained by the general tendency of educational processes to follow a traditional model.9,13
From the theoretical perspective of our study it would be most convenient to restructure the family physician and general physician's curricula over the medium term.19 It would also be of interest that this be done by higher education institutions that train family medicine professionals.20
The development of clinical aptitude requires environments that foster reflection on the part of the physician; a revision of educational curriculum; and the development of personal knowledge. The results suggest that these conditions are lacking, since a very low clinical aptitude reflects a clear inability to investigate and interpret MS.
The identification of risk factors for MS shows that 20% of physicians had the capacity to investigate them by the development of a diagnostic hypothesis.
The pertinent global use of diagnostic resources was shown in 39% of family physicians, most of all in the management of clinical tests.
The ability to orientate and propose requires the capacity to judge the pertinence of decisions made in the clinical case reviews, as presented in the instrument, and propose alternative actions.20-22 The use of therapeutic resources, implying the ability to give an integrative management of MS, was achieved only by 14.5% of family physicians.
The advantage of contract type couldn't be evaluated, given that attending physicians represented 95.6% of the sample. There is a slight advantage for family physicians in a specialty working the morning shift with more than 20 years in practice. However, the global clinical aptitude results were very low for family physicians (45.6%), reflecting a limited capacity to deal with MS.
]]>References
1. Lara E, Carrillo T, Carrasco M. Nutrición en el Síndrome Metabólico. In: Annual Review del Colegio de Medicina Interna de México; Mexico: Intersistemas; 2005. [ Links ]
2. Alberti KG, Zimmet P, Shaw J. Metabolic syndrome—a new world-wide definition. A Consensus Statement from the International Diabetes Federation. Diabetic Medicine 2006;23(5):469-480. [ Links ]
3. Lorenzo C, Williams K, Hunt KJ, Haffner SM. The National Cholesterol Education Program - Adult Treatment Panel III, International Diabetes Federation, and World Health Organization definitions of the metabolic syndrome as predictors of incident cardiovascular disease and diabetes. Diabetes Care 2007;30(1):8-13. [ Links ]
4. Lerman G, Aguilar-Salinas C, Gómez-Pérez F, Reza A, Hernández J, Vázquez CC. El síndrome metabólico, posición de la sociedad Mexicana de nutrición y endocrinología, sobre la definición, fisiopatología y diagnóstico. Características del síndrome metabólico en México. Revista de Endocrinología y Nutrición 2004;12(3): 109-122. [ Links ]
5. Gonzalez C, Sánchez Z, Elizondo A, Malanco H. Inflamación y resistencia a la insulina, su papel en el desarrollo del síndrome metabólico. In: Annual Review del Colegio de Medicina Interna de México. Mexico: Intersistemas, 2005. [ Links ]
6. Skilton P, Moulin A, Sérusclat A, Nony P, Bonnet F. A comparison of the NCEP-ATPIII, IDF and AHA/NHLBI metabolic syndrome definitions with relation to early carotid atherosclerosis in subjects with hypercholesterolemia or at risk of CVD: Evidence for sex-specific differences. Atherosclerosis 2007; 190(2):416-422. [ Links ]
7. Rodríguez P, Sánchez L, Martínez V. Síndrome metabólico. Rev Cub Endocrinol 2002;13(3):238-252. [ Links ]
8. Dekker J, Girmain C, Rhodes T, Nipjels G, Stehouwer CD, Bouter LM. Metabolic Syndrome and 10 year cardiovascular disease risk in the Hoorn study. Circulation 2005;112:666-673. [ Links ]
9. Chavez V, Aguilar M. Aptitud clínica en el manejo de la familia, en residentes de Medicina Familiar. Rev Med IMSS 2002;40(6):477-481. [ Links ]
10. Garfias G, Aguilar M, Viniegra V. Cómo explorar las aptitudes de los médicos residentes de traumatología y ortopedia en traumatismo cráneoencefálico. Rev Med IMSS 1997;(35):233-237. [ Links ]
11. Cobos AH, Insfrán SMD, Pérez CP, Elizaldi LNE, Hernández DE, Barerra MJ. Aptitud clínica durante el internado de pregrado en hospitales generales. Rev Med IMSS 2004;42(6):469-476. [ Links ]
12. Sabido S, Viniegra V. Competencia y desempeño en la evaluación del médico: estudio con pacientes diabéticos en el primer nivel de atención. In: Viniegra L. La investigación en la educación: papel de la teoría y la observación. Mexico: IMSS, 2000. [ Links ]
13. Gutiérrez G, Aguilar M, Viniegra V. Validación de un instrumento para evaluar la competencia clínica del médico familiar. Rev Med IMSS 2001;37:201-210. [ Links ]
14. Secretaria de Salud: Reglamento de la Ley General de Salud en materia de investigación para la salud. Mexico DF: SSA, 1990. [ Links ]
15. Rothman A, Blackmore D, Cohen R, Reznic R. The consistency and uncertainty in examiners' definitions of pass/fail performance on OSCE stations. Ev Health Prof 1996;16:322-332. [ Links ]
16. Searle J. Defining competency-the role of standard setting. Med Educ 2000; 34:363-366. [ Links ]
17. Satir V. Psicoterapia familiar conjunta. Mexico City: Prensa Medica, 1986: 86-88. [ Links ]
18. Minuchin S. Familias y terapia familiar. Madrid: Gedisa, 1977. [ Links ]
19. Larios M, Trejo M, Cortés G. Evaluación de la competencia clínica. Rev Med IMSS 1998;(36):77-82 [ Links ]
20. Gardner W, Nutting PA, Kelleher KJ, Does the family Apgar effectively measure family functioning? Aten Primaria 1996;17:338-341. [ Links ]
21. Sánchez T, Pérez C, Navarro L, Kumazagua I, Vásquez Garibay E. Dinámica Familiar: metodología para su evaluación. Am J Dis 1994;7:48-52. [ Links ]
22. Vazquez E, Sánchez T, Navarro L, Romero V, Pérez C, Kumazagua I. Instrumento de Medición de la dinámica de la familia nuclear mexicana. Un enfoque cuantitativo. Bol Med Hosp Infant Mex 2003;60:33-52. [ Links ]
Received on: January 9, 2008
Accepted on: July 1, 2008
]]> Address reprint request to: PhD Carlos Cabrera P. San Juan Bosco 3782, Col Chapalita, Guadalajara, Jalisco, México.
