SciELO - Scientific Electronic Library Online

 
vol.48 número2Deterioro cognitivo e inseguridad alimentaria en ancianos brasileños registrados en la Atención Primaria a la Salud: un estudio transversalLa violencia de pareja: perspectiva de hombres que habitan en dos territorios del Valle del Cauca, Colombia índice de autoresíndice de assuntospesquisa de artigos
Home Pagelista alfabética de periódicos  

Serviços Personalizados

Journal

Artigo

Indicadores

Links relacionados

  • Não possue artigos similaresSimilares em SciELO

Compartilhar


Salud mental

versão impressa ISSN 0185-3325

Salud Ment vol.48 no.2 México Mar./Abr. 2025  Epub 02-Jun-2025

https://doi.org/10.17711/sm.0185-3325.2025.011 

Original articles

Adaptation and Validation of an Instrument for Measuring Stigma towards Mental Health Problems in Children among Health Professionals

Adaptación y Validación de un Instrumento de Medición del Estigma hacia los Problemas de Salud Mental en Menores entre Profesionales de la Salud

Jorge Javier Caraveo-Anduaga 1   * 
http://orcid.org/0000-0002-2914-7415

Nora Angélica Martínez-Vélez 1  
http://orcid.org/0000-0001-8907-2155

Miriam Arroyo-Belmonte 1  
http://orcid.org/0000-0002-3687-1970

Filiberto Itzcóatl Gaytán-Flores 1  
http://orcid.org/0009-0004-8029-6354

1Dirección de Investigaciones Epidemiológicas y Psicosociales, Instituto Nacional de Psiquiatría Ramón de la Fuente Muñiz, Ciudad de México, México.


Abstract

Introduction

One of the main barriers to receiving care faced by children and adolescents is stigma.

Objective

Evaluate the reliability and construct validity of the Health Personnel Questionnaire and determine the efficiency indicators of the clinical vignettes comprising it. Method. The Health Personnel Questionnaire (HPQ), a self-administered instrument with 20 clinical vignettes and 37 items, was administered to a sample of 2,477 health professionals, evaluating knowledge, prejudice and discriminatory intent as components of stigma. Efficiency values were calculated for the clinical vignettes provided, using assessments by child psychiatrists as the gold standard. An internal consistency analysis was conducted for construct validity. The sample was randomly divided into two groups, with exploratory factor analysis (EFA) being conducted with the first group (n=1250), and confirmatory factor analysis (CFA) with the second (n=1227).

Results

The efficiency of the clinical vignettes obtained an overall agreement rate among child psychiatrists of 97%. Exploratory factor analysis identified six dimensions related to prejudice and one related to discriminatory intent. In the confirmatory factor analysis, factors behaved in the same way with factor loadings for the items and similar alphas.

Discussion and conclusion

Research on stigma towards children’s mental health by health personnel is scant, partly due to the lack of valid, reliable instruments. The Health Personnel Questionnaire effectively explored attitude problems (prejudice) and discriminatory intent as aspects of stigma towards mental illness in children and adolescents. The analysis of these components among health professionals has significant implications for the mental health care of children and adolescents.

Keywords: Stigma; mental health; children and adolescents; reliability; validity; health personnel

Resumen

Introducción

Una de las principales barreras que enfrentan los niños y adolescentes para recibir atención es el estigma.

Objetivo

Evaluar la confiabilidad y validez de constructo del Cuestionario para Personal de Salud, así como determinar los indicadores de eficiencia de las viñetas clínicas que lo componen. Método. El Cuestionario para Personal de Salud (CPS), es un instrumento auto-administrado con 20 viñetas clínicas y 37 ítems, se aplicó a 2,477 profesionales de la salud, evaluando conocimiento, prejuicio e intenciones de discriminación como componentes del estigma. Se calcularon los valores de eficiencia para las viñetas clínicas presentadas, utilizando las evaluaciones de psiquiatras infantiles como estándar de oro. Se realizó un análisis de consistencia interna para determinar la validez de constructo. La muestra se dividió aleatoriamente en dos grupos. Se realizó un Análisis Factorial Exploratorio (AFE) con el primer grupo (n=1250) y un Análisis Factorial Confirmatorio (AFC) con el segundo (n=1227).

Resultados

La eficiencia de las viñetas clínicas obtuvo una tasa de acuerdo global entre los psiquiatras infantiles del 97%. El análisis factorial exploratorio identificó seis dimensiones para prejuicio y una para intenciones de discriminación. En el AFC, los factores se comportaron de la misma manera, con cargas factoriales para los ítems y alfas similares.

Discusión y conclusión

La investigación sobre el estigma hacia la salud mental infantil en personal sanitario es escasa, en parte por falta de instrumentos válidos y confiables. El CPS exploró eficazmente problemas de actitud (prejuicio) e intenciones de discriminación como aspectos del estigma hacia las enfermedades mentales en niños y adolescentes. El análisis de estos componentes en profesionales de la salud tiene implicaciones significativas en la atención de salud mental de los niños y adolescentes. 

Palabras clave: Estigma; salud mental; niños y adolescentes; confiabilidad; validez; personal de salud

INTRODUCTION

Both retrospective and prospective research has shown that most adult mental disorders begin in childhood and adolescence (Freţian et al., 2021; Radez et al., 2021; Whitney & Peterson, 2019; Medina-Mora et al., 2003). Untreated mental health problems at these stages of life are strong predictors of higher rates of low occupational attainment, difficulties in interpersonal and family relationships, as well as a reduction in life expectancy and quality of life due to associated medical conditions (Kessler et al., 1995; Singh & Winsper, 2017). Despite this evidence, research shows that between 40% and 80% of adolescents and young people worldwide fail to receive mental health care (WHO, 2006; Thornicroft, 2007; Zwaanswijk et al., 2005). In Mexico, the percentage is above 86%, which is alarming (Kohn et al., 2018).

One of the main barriers to receiving care faced by children and adolescents is stigma (Radez et al., 2021; Thornicroft et al., 2022; Hatzenbuehler et al., 2013; Gulliver et al., 2010;  Pescosolido et al., 2007). Stigma is the labeling, stereotyping, rejection, or social discrimination of people with a characteristic regarded as undesirable (Corrigan & Wassel, 2008). It has been conceptualized in terms of knowledge (ignorance or misinformation), attitude (prejudice or stereotyped beliefs that predispose people to express a certain emotional response) and behavior (discrimination or rejection and social actions involving the marginalization and/or exclusion of those with mental health problems) (Thornicroft, 2007; Graham et al., 2003; WHO, 2002).

These stereotypes have a range of adverse effects, compromising care quality and creating care gaps (Corrigan & Wassel, 2008; Henderson et al., 2014). A systematic review revealed stigmatizing beliefs, discriminatory attitudes, and behaviors among health professionals in both primary and specialized care, and in high- as well as low- and middle-income countries (Henderson et al., 2014). Even if people with mental illnesses overcome barriers and seek help, they are likely to encounter stigmatizing beliefs, negative attitudes, and discrimination, which hinder their care. Understanding stigma towards mental illness from the perspective of healthcare professionals is therefore a critical step towards reducing its impact on care gaps.

However, stigma towards mental health is poorly understood and research on stigma towards children’s mental health by health personnel is scant, partly due to the lack of valid, reliable instruments. A systematic review showed that although a number of instruments have been developed to assess mental health-related stigma among health professionals, there has been a lack of evaluation of certain measurement properties, with most studies focusing on the mental health of adults (Cardoso et al., 2020; Őri et al., 2023; Sastre-Rus et al., 2019). Likewise, although instruments have been developed and validated to measure stigma towards mental health in children, they have mainly focused on self-stigma (Kaushik et al., 2017), stigma in parents (Williams & Polaha, 2014), and peers (Nearchou et al., 2021), overlooking stigma in health personnel, with few exceptions (Davis et al., 2007).

Given the above, it is essential to have a valid, reliable instrument to identify the knowledge of doctors and health workers and their attitudes and discriminatory intent when they encounter these problems. The aim of this article is as follows:

  1. Evaluate the reliability and construct validity of the Health Personnel Questionnaire

  2. Determine the efficiency indicators of clinical vignettes of the Health Personnel Questionnaire in child psychiatrists and other groups of health professionals

METHOD

Study design and population

A cross-sectional, analytical study was conducted with purposive sampling. The sample comprised 2,477 health professionals, attached to 144 primary-level care centers in the 16 boroughs of Mexico City.

Instruments

Questions were included on demographic data such as sex, age, marital status, number of children, occupation, years of practicing the profession, education, main activity at the health center, and mental health training.

To measure stigma, the self-administered instrument developed by Berenice Pescosolido for the National Stigma Study–Children (NSS-C) was used. This study was part of an ongoing series of stigma-related modules within the 2002 General Social Survey (GSS) in the United States (Pescosolido, 2007; Pescosolido et al., 2008). The instrument was further refined, and in 2006, the GSS incorporated the Stigma in Global Context–Mental Health Study (SGC-MHS) component in a subsequent sample (Pescosolido et al., 2008).

The NSS-C is divided into three sections. The first section evaluates knowledge regarding mental illness in children and adolescents through a vignette technique originally developed in stigma research by the GSS. This technique includes vignettes depicting diagnoses such as depression and attention deficit hyperactivity disorder (ADHD), as well as control vignettes illustrating other conditions such as asthma and routine, subclinical issues (everyday discomfort). These vignettes were created by the team’s psychiatrist and subsequently reviewed by the team’s survey methodologist to ensure their suitability for survey use. The purpose of the vignettes was to determine whether respondents could identify cases of mental health disorders based on DSM-IV criteria.

The second and third sections are what we have called the Health Personnel Questionnaire. The second section examines attitudeproblems (prejudice) by exploring general opinions about children with mental health conditions, including perceptions of dangerousness, beliefs about the origins of these conditions, and views on available treatments, with particular attention being paid to the use of medication. The third section explores discrimination (discriminatory intent) by posing questions regarding the level of rejection respondents feel toward children with mental illnesses and their likely responses to hypothetical social interaction scenarios (Davis et al., 2007; Pescosolido, 2007; Pescosolido et al., 2007; 2008).

Based on a review of GSS studies and the extensive body of innovative and rigorous research derived from these findings (Pescosolido, Fettes et al., 2007; Pescosolido, Perry et al., 2007; McLeod et al., 2007; Perry et al., 2007), it was decided to adapt the vignette method and the Health Personnel Questionnaire (HPQ) for this study.

In accordance with the methodological framework of the NSS-C, 20 clinical vignettes were developed by a psychiatry professional, based on the results and experiences of a study conducted of a primary care population in Mexico City (Caraveo, 2016; Caraveo et al., 2011). Of the 20 vignettes, ten correspond to “cases” with sufficiently significant symptoms to indicate the presence of ADD, anxiety or depression and ten to “non-cases” with isolated symptoms, which were neither significant nor indicative of psychopathological problems (Caraveo, 2016).

The vignettes were subsequently reviewed by a psychiatrist and a child psychiatrist, who were asked to determine whether any elements or concepts should be added or eliminated to clarify the case presented in the vignette. The final vignettes were the result of agreement between the two specialists and a review by the research team comprising two psychologists and a psychiatrist. Finally, the vignettes underwent a blind review by seven expert child psychiatrists. Table 1 provides examples of vignettes categorized as “case” for mental health disorders and “non-case” vignettes. The full set of vignettes can be reviewed in Caraveo, (2016).    

Table 1 Example of a case and non-case vignette 

Case vignette: boy aged between three and five
A 30-year-old woman came in for an appointment, accompanied
by her four children. She had made an appointment to see a family
physician because her five-year-old son (Juan) had gastroenteritis
that had continued for four days. As part of his medical history, the
boy has a background of frequently throwing tantrums and does not
obey. Five days ago, the mother told him not to eat mangoes with
chili outside, and in response, her son reacted explosively, throwing
his toys into the street. She also reported that his siblings had noticed
he had been more irritable and short-tempered in the past month.
Both at school and at home, they have observed that he stares
into space, as though unaware of his surroundings. His classmates’
mothers often tell her that her son tells lies.
The kindergarten teachers report that Juan performs poorly com-
pared to other children, is distracted and fails to complete his work.
The mother remarked that she found this strange because when he
sits in front of the television, he is always attentive.
Non-Case vignette: girl aged between six and eight
An 8-year-old girl (María) came in for consultation due to acute gas-
troenteritis, accompanied by her mother. During the complementa-
ry history taking, the mother remarked that she had been struck by
the fact that lately her daughter had seemed worried when she had
to hand in an assignment at school. María is currently in the third
year of elementary school and has good grades, with an average
of 9 out of 10. She has a good relationship with her classmates and
several friends. However, the teacher has told the patient’s mother
that she sometimes appears rather restless and distracted.

To measure prejudice and discriminatory intent, the HPQ was translated by an expert translator and reviewed by another three subject matter experts, who were asked to rate each item regarding its applicability to health providers, making suggestions if they thought any of the questions required modification. They reviewed the instructions for administering the adapted version, making the corresponding adjustments.

Finally, a group of 15 primary care physicians with similar characteristics to the final sample evaluated the clarity and understandability of the instructions, questions, and response options of the previously revised version. The questionnaire comprised 37 Likert-type items with five response options (from 0 not at all to 4 very much), distributed in two dimensions: prejudice (32 items) and discriminatory intent (five items). Examples of items include the following: “Medication for children with behavioral problems makes them act automatically (without thinking about what they are doing),” “How much of J/M’s situation is due to their lack of discipline at home?” “How likely do you think it is that J/M would commit a violent act toward themself?” “How likely would you be to spend an afternoon socializing with J/M’s family if they were your neighbors?”

Procedure

The study was conducted from August 1 to October 30, 2009. Thirty-one interviewers were trained in the objectives, structure and contents of the instrument, as well as the way to administer it. The authors worked with professionals who agreed to participate in the study. Each professional was given a questionnaire and a vignette, with care being taken to ensure  that the 20 vignettes were uniformly distributed among the personnel surveyed. The questionnaire took 60 minutes to complete.

The research was conducted with the approval of the Research Ethics Committee of the Ramón de la Fuente Muñiz National Institute of Psychiatry, the directors of the participating primary health care centers and the informed consent of the professionals surveyed.

Statistical analysis

Frequency analyses and X2 and Mann-Whitney U tests were performed to describe the sample. Efficiency values (sensitivity, specificity, and positive and negative predictive value) were calculated for the clinical vignettes presented, with the assessment of the child psychiatrists being the gold standard.

An internal consistency analysis (Cronbach’s α) was conducted for construct validity, and the sample was randomly divided into two groups. Exploratory factor analysis (EFA) was conducted with the first group (= 1250) and confirmatory factor analysis (CFA) with the second (= 1227). The principal components method with oblique rotation method was used (Schermelleh-Engel et al., 2003) for exploratory factor analysis (EFA), showing that the Kaiser-Meyer-Olkin (KMO) sampling adequacy index was > .80 while Bartlett’s tests of sphericity had p < .05 (Hair et al., 2014).

The following indicators of goodness of fit were considered (Hu et al., 1999) for confirmatory factor analysis (CFA): 1) chi-square divided by degrees of freedom (quotients < 2 indicated good fit); 2) χ2/df: good fit is indicated by values of less than 2; 3) Comparative fit index (CFI): acceptable fit is given by values ≥ .90; 4) Root mean square error of approximation (RMSEA): acceptable fit is indicated by values ≤ .08 (90% CI ≤ .10) and good fit by values ≤ .05 (90% CI ≤ .08).

Analyses were conducted using SPSS Statistics 25 and Amos 24.0.

RESULTS

Sample characteristics

2,477 health professionals, the majority of whom were women (72.1). A total of 50.5% were ages 21 to 40 (X̄=39.8 SD=12.2), half were partnered, most were doctors or nurses (70.2%), 54.3 % had had 15 years or fewer of service, the majority had children (62.5%), and nearly a third reported having received mental health training. No significant differences were found between the groups used for EFA and CFA.    

Table 2 Demographics 

Demographic
Variables
Sample 1
(EFA)
 n = 1,250
Sample 2
(CFA)
n = 1,227
Total
n = 2,477
Statistics
N % N % N %
Sex
Male 347 27.8 345 28.1 692 27.9 X2=.035
Female 902 72.2 882 71.9 1784 72.1
Age*:
17-20 years 20 1.6 31 2.5 51 2.1 z= - .452
21-30 years 379 30.4 352 28.8 731 29.6
31-40 years 269 21.6 246 20.2 515 20.9
41-50 years 263 21.1 287 23.5 550 22.3
51-60 years 290 23.3 270 22.1 560 22.7
61 and over 25 2.0 35 2.9 60 2.4
  X̄=39.7 X̄=39.9 X̄=39.8  
  SD=12.3 SD=12.2 SD=12.2  
Marital status*
Single 507 40.6 468 38.2 975 39.4 X2 = 3.628
Married 614 49.2 648 52.9 1262 51.0
Divorced/Separated 104 8.3 89 7.2 193 7.8
Widowed 24 1.9 21 1.7 45 1.8
Occupation*
Doctor 443 35.5 431 35.1 874 35.3 X2=14.507
Medical intern 36 2.9 28 2.3 64 2.6
Nurse 450 36.0 414 33.7 864 34.9
Social worker 159 12.7 147 12.0 306 12.4
Non-medical intern 10 .8 17 1.4 27 1.1
Health promoter 2 .2 5 .4 7 .3
Psychiatrist 3 .3 3 .3 6 .2
Psychologist 24 1.9 41 3.3 65 2.6
Odontologist 94 7.5 102 8.3 196 7.9
Nutritionist 19 1.5 20 1.6 39 1.6
Other professional 1 .1 3 .3 4 .2
Administrative staff 8 .6 16 1.3 24 1.0
Years of service*
0-5 years 435 34.9 413 33.8 848 34.3 z= - .338
6-15 years 252 20.2 242 19.8 494 20.0
16-25 years 275 22.0 302 24.7 577 23.4
26-35 years 259 20.8 238 19.4 497 20.1
36-49 years 27 2.1 28 2.3 55 2.2
  X̄=14.5 X̄=14.4 X̄=14.5  
  SD=11.4 SD=11.2 SD=11.3  
Mental Health Training*
Yes 348 28.2 382 31.3 730 29.7 X2 = 2.929
No 887 71.8 837 68.7 1724 70.3
Children*
Yes 756 60.7 787 64.5 1543 62.5 X2 = 3.764
No 490 39.3 434 35.5 924 37.5

*Not all subjects provided information, EFA = Exploratory Factor Analysis, CFA = Confirmatory Factor Analysis

Efficiency of clinical vignettes

A high degree of agreement (97%) was found among child psychiatrists, who showed the highest sensitivity and the lowest rate of false negatives. All other groups of professionals were characterized by having more specificity than sensitivity. However, the highest sensitivity was found among mental health specialists, which was also the group with the highest positive predictive value (PPV). Total agreement of 34% was obtained overall (Table 3).    

Table 3 Efficiency of Clinical Vignettes 

Groups
of Health
Professionals
Sensitivity Specificity False+
Rate
False-
 Rate
PPV NPV % Total
agreement
P 1- p
Child
psychiatristsa
98% 78% 22% 2% 81% 87% 97% 50% 50%
First-contact
doctorsb
29% 39% 60% 70% 35% 32% 34% 53% 47%
First-contact
 health
professionalsc
21% 48% 51% 78% 29% 38% 35% 50% 50%
Second-
contact health
 professionals d
16% 56% 43% 83% 27% 40% 36% 49% 51%
Mental health
 specialistse
33% 48% 51% 66% 48% 33% 39% 59% 41%
Health
administratorsf
25% 25% 75% 75% 40% 14% 25% 67% 33%
General 24% 45% 54% 75% 32% 36% 34% 52% 48%

aGold standard;

bdoctors and medical interns;

cnurses, social workers, health promoters, other interns;

dnutritionists, dentists, other specialists;

epsychiatrists, psychologists;

fmanagers, epidemiologists/statisticians;

PPV: positive predictive value; NPV: Negative predictive value; P: Prevalence.

Exploratory Factor Analysis (EFA)

Five dimensions related to prejudice and one for discriminatory intent were identified. Together, all the dimensions explained 55.047% of variance.

The first factor, associated with prejudice, and reflecting subjects’ view of psychiatric medications, which were mostly adverse (seven items), was called Supply and Effect of Psychoactive Drugs (SEP).

The second factor, comprising opinions on the way children and adolescents are raised, including lack of discipline, poor education, exposure to violence in the media and games, as well as having a bad temper (five items), was called Type of Upbringing (TU).

The third factor, consisting of serious behaviors with the potential to harm, such as violence towards oneself and others (three items), was called Disruptive Behavior (DB).

Opinions on mental health problems such as social rejection and parental burden were grouped into the fourth factor (four items), called Treatment for Mental Health Problems (TMHP).

The fifth factor comprises opinions on the origin of mental illness, such as hereditary factors, chemical alterations, and their management through drugs (three items), in other words, Biological Causes (BC).

Finally, the sixth factor, consisting of statements about rejection and avoidance related to intent to discriminate (four items), was called Avoidance (A).

Alphas per factor ranged from α=.636 to α=.856 while that of the total scale was α=.783, as can be seen from Table 4.    

Table 4 Exploratory Factor Analysis, Reliability Indices and Descriptive Measures 

Items Prejudice Discriminatory
intent
SEP TU DB TMHP BC A
43. Medication for children with behavioral
problems makes them act automatically (without
thinking about what they are doing)
.709 .088 -.071 .100 .113 .108
41. Giving medication to children or adolescents
with mental health problems only masks the
underlying causes
.708 .058 -.012 .106 -.133 .069
40. Giving children or adolescents medication for
mental health problems negatively affects their
development
.692 -.003 -.044 .109 -.081 .016
47. Taking psychotropic drugs is a sign of weakness .647 .161 -.140 .039 .148 .055
46. Psychotropic drugs are addictive .603 .080 .077 -.047 -.107 .077
44. The use of medication for behavioral problems
in children causes the family not to address the
situations causing them
.594 .055 .076 .236 -.105 -.014
48. Psychotropic drugs always have undesirable
adverse effects
.488 .020 .098 .090 -.122 -.043
15. How much of J/M’s situation is due to their lack
of discipline at home?
.079 .768 .214 -.051 -.011 .128
14. How much is J/M’s situation due to external
stimuli such as watching violent shows on TV or
playing violent video games?
.024 .688 .239 .090 .015 .022
13. How much of J/M’s situation is due to how they
were raised?
-.006 .649 .116 .128 -.285 -.003
17. How likely do you think it is that J/M’s situation
could be solved by a strict upbringing?
.197 .598 -.151 -.031 .117 .040
9. To what extent do you think that J/M’s problems
could be caused by their bad temper?
.145 .563 .080 .033 .272 .090
20. How likely do you think it is that J/M would
commit a violent act toward themself?
.008 .164 .821 .067 .125 .095
19. How likely do you think J/M would commit a
violent act toward another person?
.015 .229 .760 .007 .181 .173
7. How serious do you think J/M’s problem is? .052 .082 .712 -.026 .177 .130
36. An adult could experience negative consequences
if others found out that they had received treatment
for a mental
health problem as a child
.061 .081 -.029 .747 .059 .019
37. Even though medical confidentiality exists,
most people find out when children receive mental
health treatment
.097 .023 .041 .655 .023 .042
35. A child who receives treatment for a mental
health problem will be rejected at school
.114 .008 -.064 .645 .096 .050
38. When a child receives mental health care,
parents feel they have failed
.187 .006 .124 .623 -.006 -.028
10. How much do you think J/M’s situation is due to
a chemical imbalance in the brain?
-.134 -.009 .302 .071 .762 -.015
12. To what extent do you consider J/M’s situation
to be a hereditary or genetic situation?
-.091 .116 .105 .073 .732 .037
21. How likely do you think J/M’s situation would be
improved through pharmacological treatment?
-.212 -.056 .428 .119 .539 -.025
24. Would you be willing to let your children
become friends with J/M?
.073 .104 .188 .030 .021 .856
25. Would you be willing to have J/M be your
children’s schoolmate?
.111 .105 .181 -.031 .021 .824
23. How likely would you be to spend an afternoon
socializing with J/M’s family if they were your
neighbors?
-.003 -.035 .002 .104 -.074 .816
22. Would you be willing to be J/M’s neighbor? .049 .085 .027 -.003 .067 .788
% explained variance 55.047          
Alpha by factor α=.774 α=.700 α=.784 α=.636 α=.694 α=.856
Full alpha           α=.783

SEP = Supply and Effect of Psychotropic Drugs; TU = Type of Upbringing; DB = Disruptive Behavior; MHPT = Mental Health Problem Treatment; BC = Biological Causes; A = Avoidance; EFA = Exploratory Factor Analysis. The value of the Kaiser Meyer-Olkin (KMO) sample adequacy measure for the 26 items on the scale was .817. The significance of the Barlett sphericity test was less than p < .001. The analysis yielded six dimensions, which together explained 55.0% of total variance.

Total-Element Statistics    

Table 5 Total-Element Statistics 

Items SD Corrected
total-element
correlation
Cronbach’s
alpha if element
is removed
Prejudice
43. Medication for children with behavioral problems makes them
act automatically (without thinking about what they are doing)
2.26 .991 .355 .775
41. Giving medication to children or adolescents with mental health
problems only masks the underlying causes
2.56 1.152 .295 .777
40. Giving children or adolescents medication for mental health
problems produces negative effects on their development.
2.46 1.054 .247 .779
47. Taking psychotropic drugs is a sign of weakness 1.92 .983 .302 .777
46. Psychotropic drugs are addictive 3.16 1.132 .265 .778
44. The use of medication for behavioral problems in children caus-
es the family not to address the situations causing them
2.85 1.209 .295 .777
48. Psychotropic drugs always have undesirable adverse effects 3.01 1.114 .202 .781
15. How much of J/M’s situation is due to their lack of discipline at
home?
3.41 1.449 .428 .769
14. How much is J/M’s situation due to external stimuli such as
watching violent shows on TV or playing violent video games?
3.65 1.349 .389 .772
13. How much of J/M’s situation is due to how they were raised? 4.09 1.203 .257 .779
17. How likely do you think it is that J/M’s situation could be solved
by a strict upbringing?
2.24 1.194 .261 .779
9. To what extent do you think that J/M’s problems could be caused
by their bad temper?
2.87 1.467 .383 .772
20. How likely do you think it is that J/M would commit a violent act
toward themself?
3.26 1.356 .435 .769
19. How likely do you think J/M would commit a violent act toward
another person?
3.32 1.341 .471 .767
7. How serious do you think J/M’s problem is? 3.04 1.096 .373 .773
36. An adult could experience negative consequences if others
found out that they had received treatment for a mental health
problem as a child.
2.79 1.236 .263 .778
37. Even though medical confidentiality exists, most people find out
when children receive mental health treatment
3.25 1.222 .254 .779
35. A child who receives treatment for a mental health problem will
be rejected at school
2.39 1.256 .223 .781
38. When a child receives mental health care, parents feel they
have failed.
3.07 1.240 .265 .778
10. How much do you think J/M’s situation is due to a chemical
imbalance in the brain?
2.66 1.453 .202 .783
12. To what extent do you consider J/M’s situation is hereditary or
genetic?
2.51 1.380 .211 .782
21. How likely do you think J/M’s situation could be improved
through pharmacological treatment?
2.99 1.389 .163 .783
Discriminatory Intent
24. Would you be willing to let your children become friends with
J/M?
2.88 1.243 .455 .768
25. Would you be willing to have J/M be your children’s school-
mate?
2.65 1.215 .433 .770
23. How likely would you be to spend an afternoon socializing with
J/M’s family if they were your neighbors?
2.56 1.181 .268 .778
22. Would you be willing to be J/M’s neighbor? 2.51 1.268 .338 .775

Confirmatory Factor Analysis (CFA)

CFA was conducted for the model obtained in the EFA in half the sample (= 1227). The six-factor structure identified through the EFA (one factor for discriminatory intent and five for prejudice) was corroborated by the CFA, with similar item factor loadings and alphas. No items were eliminated. Figure 1 shows the standardized factor coefficients, and the fit indices of the model with 26 items. All factor loadings were significant, ranging from .44 to .88. The model fit was adequate, with values within the recommended standards (X= 860.555, df = 284, < = .000, CFI = .919, RMSEA = .041, 90% CI =  .038-.044).    

Figure 1 Confirmatory Factor Analysis 

DISCUSSION AND CONCLUSION

This research sought to evaluate the reliability and construct validity of the health personnel questionnaire (HPQ) in a sample of primary health care professionals in Mexico City, and to determine the efficiency indicators of the clinical vignettes it contains to obtain a useful tool for examining problems of knowledge, attitude and behavior as the constituent features of stigma towards mental health problems in children and adolescents (Caraveo, 2016).

A PPV of 35% was obtained in first-contact doctors, above the rate found in other studies (WHO, 2006; Zwaanswijk et al., 2005). The efficiency of the clinical vignettes, based on the assessment of the group of child psychiatrist experts, was highly satisfactory, validating the contents presented. Assessments were more specific than sensitive for the study population in general as well as for the groups of professionals. This result is expected in diagnostic tests (Shreffler & Huecker, 2023).

The results of the validity and reliability analysis applied to the Health Personnel Questionnaire showed that the scale proved effective in exploring problems of attitude (prejudice) and discriminatory intent as elements of stigma towards mental illness in children and adolescents. The internal consistency of the global scale obtained a Cronbach’s alpha of .8 and factor/dimension values between .63 and .85, considered adequate. Regarding the dimensions obtained, attitudes towards the supply and effect of psychotropic drugs, type of upbringing, disruptive behavior, psychiatric treatment, biological causes, and discriminatory intent are all indicators commonly used in research on stigma towards mental illness in minors (Thornicroft, 2007; Graham et al., 2003; WHO, 2002). The results obtained are consistent with the stigma literature on prevailing attitudes towards mental health problems (Thornicroft et al., 2016).

Identifying these dimensions is valuable, since they have the potential to be key discriminating elements in stigma towards mental illness in children, adolescents, and adults. Significant differences exist between adults and children that probably contribute to the differing perceptions of their mental health among health personnel. These include the importance placed on child-raising styles in the configuration of mental illness in children, as well as disruptive behavior. Since mental illness stigma has not been studied as extensively in children and adolescents as it has been in adults (Cardoso et al., 2020), having a valid instrument will facilitate its evaluation.

Primary care health personnel are often the first point of contact for families seeking help with children’s mental health problems. If these professionals hold stigmatizing perceptions, they may underestimate or dismiss symptoms, potentially delaying diagnosis and access to appropriate, quality treatment (Mkubwa et al., 2024). Having this measurement tool meets the need for a clearer understanding of the stigmatization processes children and young people are subjected to by health personnel. It makes it possible to propose specific, effective interventions targeting this population, since stigma can be modified and there are reports of its reduction and management through training programs for health personnel (Vila-Badia et al., 2016; Villamil-Salcedo et al., 2017).

Scope and limitations. It was not possible to evaluate the criterion validity of the HPQ due to the lack of a gold standard to assess mental health-related stigma in this population. However, it was possible to calculate the efficiency values for the clinical vignettes presented,  through the evaluations of child psychiatrists serving as the gold standard. Nevertheless, more psychometric studies on measurement error and responsiveness parameters are still required. Another limitation of this study is that it did not include vignettes covering all the possible mental disorders children may experience, and the fact that the scale does not directly measure stigmatizing behaviors. Moreover, stigma is a complex, evolving concept, with new terms and strategies emerging for its measurement (Porfyri et al., 2022; Mora-Ríos et al., 2013; Mkubwa et al., 2024; Thornicroft et al., 2016). Nevertheless, the HPQ represents an important step towards advancing the evaluation of this construct and enhancing its administration across diverse contexts and populations.

Implications for mental health programs and actions. Stigma associated with mental health disorders in children and adolescents cannot be directly extrapolated from studies on adults, nor inferred from research on the stigma related to physical illnesses and developmental disabilities in children. Having a validated instrument to address this issue is a crucial step toward enhancing  the understanding of mental health stigma in this population, particularly in Spanish-speaking countries such as Mexico. Moreover, it enables the evaluation of the way stigma among health professionals influences the facilitation or hindrance of access to care and recovery for children with mental disorders, as well as the design of targeted actions for their care. In future work, we will present an analysis of the interrelation among the three components of perceived stigma across groups of health professionals, which will provide further insights into their perceptions of mental illness.

In conclusion, this questionnaire has the potential to assess stigma towards child and adolescent mental health among healthcare professionals, constituting a promising tool for evaluating the resulting barriers to care.

STATEMENTS

Acknowledgements

Alejandra Soriano Rodriguez participated throughout the process of the research until she retired from the Institute before the final data analysis and drafting of the present document.

Child psychiatrists Patricia Eugenia Romano Vázquez, Elizabeth Esperanza Landeros Pineda, Óscar Sánchez Guerrero, Hilda Patricia Cervera Silva, Juan Manuel Sauceda García and Sergio Ignacio Muñoz Fernández.

REFERENCES

Caraveo, J. (2016). Vigilando la salud mental infantil en atención primaria. Norderstedt, Germany: Editorial Académica Española. [ Links ]

Caraveo, J., López, J.L., Soriano, A., López, J.C., Contreras, A., & Reyes, A. (2011). Eficiencia y validez concurrente del CBTD para la vigilancia de la salud mental de niños y adolescentes en un centro de atención primaria de México. Revista de Investigación Clínica, 63(6), 590-600. [ Links ]

Cardoso, N. O., Sanvicente-Vieira, B., De Ferracini, I. M. V., & de L. Argimon, I. I. (2020). Instruments for measuring perceived and experienced Mental Illness Stigma: A systematic review. Psicologia: Teoria e Prática, 22(1), 64-88. https://doi.org/10.5935/1980-6906/psicologia.v22n1p64-88 [ Links ]

Corrigan, P. W., & Wassel, A. (2008). Understanding and influencing the stigma of mental illness. Journal of Psychosocial Nursing and Mental Health Services, 46(1), 42-48. https://doi.org/10.3928/02793695-20080101-04 [ Links ]

Davis, J. A., Smith, T. W., & Marsden, P. V. (2007). General Social Surveys, 1972-2006: cumulative codebook (pp. 805–825; 1178–1204; 1399–1402; 1451–1485). Chicago: NORC. [ Links ]

Freţian, A. M., Graf, P., Kirchhoff, S., Glinphratum, G., Bollweg, T. M., Sauzet, O., & Bauer, U. (2021). The Long-Term Effectiveness of Interventions Addressing Mental Health Literacy and Stigma of Mental Illness in Children and Adolescents: Systematic Review and Meta-Analysis. International journal of public health, 66, 1604072. https://doi.org/10.3389/ijph.2021.1604072 [ Links ]

Graham, N., Lindesay, J., Katona, C., Bertolote, J. M., Camus, V., Copeland, J. R., de Mendonça Lima, C. A., Gaillard, M., Gély Nargeot, M. C., Gray, J., Jacobsson, L., Kingma, M., Kühne, N., O’Loughlin, A., Rutz, W., Saraceno, B., Taintor, Z., Wancata, J., Old Age Psychiatry section, World Psychiatric Association, & World Health Organization (2003). Reducing stigma and discrimination against older people with mental disorders: a technical consensus statement. International Journal of Geriatric Psychiatry, 18(8), 670–678. https://doi.org/10.1002/gps.876 [ Links ]

Gulliver, A., Griffiths, K. M., & Christensen, H. (2010). Perceived barriers and facilitators to mental health help-seeking in young people: a systematic review. BMC Psychiatry, 10, 113. https://doi.org/10.1186/1471-244X-10-113 [ Links ]

Hair, J. F., Jr., Sarstedt, M., Hopkins, L., & Kuppelwieser, V. G. (2014). Partial least squares structural equation modeling (PLS-SEM): An emerging tool in business research. European Business Review, 26(2), 106-121. https://doi.org/10.1108/ebr-10-2013-0128 [ Links ]

Hatzenbuehler, M. L., Phelan, J. C., & Link, B. G. (2013). Stigma as a fundamental cause of population health inequalities. American Journal of Public Health, 103(5), 813–821. https://doi.org/10.2105/ajph.2012.301069 [ Links ]

Henderson, C., Noblett, J., Parke, H., Clement, S., Caffrey, A., Gale-Grant, O., Schulze, B., Druss, B., & Thornicroft, G. (2014). Mental health-related stigma in health care and mental health-care settings. The Lancet. Psychiatry, 1(6), 467-482. https://doi.org/10.1016/S2215-0366(14)00023-6 [ Links ]

Hu, L.-t., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1–55. https://doi.org/10.1080/10705519909540118 [ Links ]

Kaushik, A., Papachristou, E., Dima, D., Fewings, S., Kostaki, E., Ploubidis, G. B., & Kyriakopoulos, M. (2017). Measuring stigma in children receiving mental health treatment: Validation of the Paediatric Self-Stigmatization Scale (PaedS). European Psychiatry, 43, 1-8. https://doi.org/10.1016/j.eurpsy.2017.01.004 [ Links ]

Kessler, R. C., Foster, C. L., Saunders, W. B., & Stang, P. E. (1995). Social consequences of psychiatric disorders, I: Educational attainment. The American Journal of Psychiatry, 152(7), 1026-1032. https://doi.org/10.1176/ajp.152.7.1026 [ Links ]

Kohn, R., Ali, A. A., Puac-Polanco, V., Figueroa, C., López-Soto, V., Morgan, K., Saldivia, S., & Vicente, B. (2018). Mental health in the Americas: an overview of the treatment gap. Revista Panamericana de Salud Pública, 42, e165. https://doi.org/10.26633/rpsp.2018.165 [ Links ]

McLeod, J. D., Fettes, D. L., Jensen, P. S., Pescosolido, B. A., & Martin, J. K. (2007). Public knowledge, beliefs, and treatment preferences concerning attention-deficit hyperactivity disorder. Psychiatric Services (Washington, D.C.), 58(5), 626–631. https://doi.org/10.1176/ps.2007.58.5.626 [ Links ]

Medina-Mora, M. E., Borges, G., Lara, C., Benjet, C., Blanco, J., Fleiz, C., Villatoro, J., Rojas, E., Zambrano, J., Casanova, L., & Aguilar, S. (2003). Prevalencia de trastornos mentales y uso de servicios: Resultados de la Encuesta Nacional de Epidemiología Psiquiátrica en México. Salud Mental, 26(4), 1-16. [ Links ]

Mkubwa, B., Angwenyi, V., Nzioka, B., Newton, C. R., Sijbrandij, M., & Abubakar, A. (2024). Knowledge, attitudes, and practices on child and adolescent mental health among healthcare workers in sub-Saharan Africa: a scoping review. International Journal of Mental Health Systems, 18(1). https://doi.org/10.1186/s13033-024-00644-8 [ Links ]

Mora-Ríos, J., Bautista-Aguilar, N., Natera, G., & Pedersen, D. (2013). Adaptación cultural de instrumentos de medida sobre estigma y enfermedad mental en la Ciudad de México. Salud Mental, 36(1), 9-18. [ Links ]

Nearchou, F., O’Driscoll, C., McKeague, L., Heary, C., & Hennessy, E. (2021). Psychometric properties of the Peer Mental Health Stigmatization Scale-Revised in adolescents and young adults. Early Intervention in Psychiatry, 15(1), 201–205. https://doi.org/10.1111/eip.12933 [ Links ]

Őri, D., Szocsics, P., Molnár, T., Bankovska Motlova, L., Kazakova, O., Mörkl, S., Wallies, M., Abdulhakim, M., Boivin, S., Bruna, K., Cabacos, C., Carbone, E. A., Dashi, E., Grech, G., Greguras, S., Ivanovic, I., Guevara, K., Kakar, S., Kotsis, K., Klinkby, I. M. I., Maslak, J., Matheiken, S., Mirkovic, A., Nechepurenko, N., Panayi, A., Pereira, A. T., Pomarol-Clotet, E., Raaj, S., Rus Prelog, P., Soler-Vidal, J., Strumila, R., Schuster, F., Kisand, H., Hargi, A., Ahmadova, G., Vircik, M., Yilmaz Kafali, H., Grinko, N., Győrffy, Z., & Rózsa, S. (2023). Psychometric properties of the Opening Minds Stigma Scale for Health Care Providers in 32 European countries – A bifactor ESEM representation. Frontiers in Public Health, 11, 1168929. https://doi.org/10.3389/fpubh.2023.1168929 [ Links ]

Perry, B. L., Pescosolido, B. A., Martin, J. K., McLeod, J. D., & Jensen, P. S. (2007). Comparison of public attributions, attitudes, and stigma in regard to depression among children and adults. Psychiatric Services (Washington, D.C.), 58(5), 632–635. https://doi.org/10.1176/ps.2007.58.5.632 [ Links ]

Pescosolido, B. A. (2007). Culture, children, and mental health treatment: special section on the national stigma study-children. Psychiatric Services (Washington, D.C.), 58(5), 611–612. https://doi.org/10.1176/ps.2007.58.5.611 [ Links ]

Pescosolido, B. A., Fettes, D. L., Martin, J. K., Monahan, J., & McLeod, J. D. (2007). Perceived dangerousness of children with mental health problems and support for coerced treatment. Psychiatric Services (Washington, D.C.), 58(5), 619–625. https://doi.org/10.1176/ps.2007.58.5.619 [ Links ]

Pescosolido, B. A., Jensen, P. S., Martin, J. K., Perry, B. L., Olafsdottir, S., & Fettes, D. (2008). Public knowledge and assessment of child mental health problems: findings from the National Stigma Study-Children. Journal of the American Academy of Child and Adolescent Psychiatry, 47(3), 339–349. https://doi.org/10.1097/CHI.0b013e318160e3a0 [ Links ]

Pescosolido, B. A., Perry, B. L., Martin, J. K., McLeod, J. D., & Jensen, P. S. (2007). Stigmatizing attitudes and beliefs about treatment and psychiatric medications for children with mental illness. Psychiatric Services (Washington, D.C.), 58(5), 613–618. https://doi.org/10.1176/ps.2007.58.5.613 [ Links ]

Porfyri, G. N., Athanasiadou, M., Siokas, V., Giannoglou, S., Skarpari, S., Kikis, M., Myroforidou, A., Anoixa, M., Zerakis, N., Bonti, E., Konsta, A., Diakogiannis, I., Rudolf, J., & Deretzi, G. (2022). Mental health-related stigma discrimination and prejudices among Greek healthcare professionals. Frontiers in Psychiatry, 13, 1027304. https://doi.org/10.3389/fpsyt.2022.1027304 [ Links ]

Radez, J., Reardon, T., Creswell, C., Lawrence, P. J., Evdoka-Burton, G., & Waite, P. (2021). Why do children and adolescents (not) seek and access professional help for their mental health problems? A systematic review of quantitative and qualitative studies. European Child & Adolescent Psychiatry, 30, 183-211. https://doi.org/10.1007/s00787-019-01469-4 [ Links ]

Sastre-Rus, M., García-Lorenzo, A., Lluch-Canut, M. T., Tomás-Sábado, J., & Zabaleta-Del-Olmo, E. (2019). Instruments to assess mental health-related stigma among health professionals and students in health sciences: A systematic psychometric review. Journal of Advanced Nursing, 75(9), 1838–1853. https://doi.org/10.1111/jan.13960 [ Links ]

Schermelleh-Engel, K., Moosbrugger, H., & Müller, H. (2003). Evaluating the Fit of Structural Equation Models: Tests of Significance and Descriptive Goodness-of-Fit Measures. Methods of Psychological Research, 8(2), 23-74. [ Links ]

Shreffler, J., & Huecker, M. R. (2023). Diagnostic Testing Accuracy: Sensitivity, Specificity, Predictive Values and Likelihood Ratios. In: StatPearls. StatPearls Publishing. [ Links ]

Singh, S. P., & Winsper, C. (2017). Adolescent mental health: the public health response. In Cherry, A., Baltag, V., Dillon, M. (eds). International Handbook on Adolescent Health and Development (pp. 93–114). Springer. https://doi.org/10.1007/978-3-319-40743-2_6 [ Links ]

Thornicroft, G. (2007). Most people with mental illness are not treated. The Lancet, 370(9590), 807–808. https://doi.org/10.1016/s0140-6736(07)61392-0 [ Links ]

Thornicroft, G., Mehta, N., Clement, S., Evans-Lacko, S., Doherty, M., Rose, D., Koschorke, M., Shidhaye, R., O’Reilly, C., & Henderson, C. (2016). Evidence for effective interventions to reduce mental-health-related stigma and discrimination. The Lancet, 387(10023), 1123–1132. https://doi.org/10.1016/s0140-6736(15)00298-6 [ Links ]

Thornicroft, G., Sunkel, C., Alikhon Aliev, A. A., Baker, S., Brohan, E., El Chammay, R., Davies, K., Demissie, M., Duncan, J., Fekadu, W., Gronholm, P. C., Guerrero, Z., Gurung, D., Habtamu, K., Hanlon, Ch., Heim, E., Henderson, C., Hijazi, Z., Hoffman, C., Hosny, N., Huang, F., Kline, S., Kohrt, B. A., Lempp, H., Li, J., London, E., Ma, N., Mak, W. W. S., Makhmud, A., Maulik, P. K., Milenova, M., Morales Cano, G., Ouali, U., Parry, S., Rangaswamy, T., Rüsch, N., Sabri, T., Sartorius, N., Schulze, M., Stuart, H., Taylor Salisbury, T., Vera San Juan, N., Votruba, N., & Winkler, P. (2022). The Lancet Commission on ending stigma and discrimination in mental health. The Lancet, 400(10361), 1438–1480. https://doi.org/10.1016/S0140-6736(22)01470-2 [ Links ]

Vila-Badia, R., Martínez-Zambrano, F., Arenas, O., Casas-Anguera, E., García-Morales, E., Villellas, R., Martín, J. R., Pérez-Franco, M.B., Valduciel, T., Casellas, D., García-Franco, M., Miguel, J., Balsera, J., Pascual, G., Julia, E., & Ochoa, S. (2016). Effectiveness of an intervention for reducing social stigma towards mental illness in adolescents. World Journal of Psychiatry, 6(2), 239-247. https://doi.org/10.5498/wjp.v6.i2.239 [ Links ]

Villamil-Salcedo, V., Vargas-Terrez, B. E., & Díaz-Anzaldúa, A. (2017). Collaborative Care model in mental health. Scope and experiences after three years of activity in Mexico City. Primary Health Care Research & Development, 18(3), 227–234. https://doi.org/10.1017/S1463423617000032 [ Links ]

Whitney, D. G., & Peterson, M. D. (2019). US National and State-Level Prevalence of Mental Health Disorders and Disparities of Mental Health Care Use in Children. JAMA Pediatrics, 173(4), 389–391. https://doi.org/10.1001/jamapediatrics.2018.5399 [ Links ]

Williams, S. L., & Polaha, J. (2014). Rural parents’ perceived stigma of seeking mental health services for their children: Development and evaluation of a new instrument. Psychological Assessment, 26(3), 763-773. https://doi.org/10.1037/a0036571 [ Links ]

World Health Organization [WHO]. (2002). Mental health global action programme (mhGAP): close the gap, dare to care. [ Links ]

World Health Organization [WHO]. (2006). WHO child growth standards: length/height-for-age, weight-for-age, weight-for-length, weight-for-height and body mass index-for-age: Methods and development. [ Links ]

Zwaanswijk, M., Verhaak, P. F. M., van der Ende, J., Bensing, J. M., & Verhulstet, F. C. (2005). Consultation for and identification of child and adolescent psychological problems in Dutch general practice.Family Practice, 22(5), 498–506. https://doi.org/10.1093/fampra/cmi045 [ Links ]

Originality The content of this scientific article is original and has not been published in whole or in part elsewhere.

Financing Financed by the Institute of Science and Technology of the Federal District (ICyTDF). Project PICDS08-74: Epidemiological Surveillance of the Mental Health of Children and Adolescents in Health Centers.

Citation: Caraveo-Anduaga, J. J., MartínezVélez, N. A., Arroyo-Belmonte, M., Gaytán-Flores, F. I. (2025). Adaptation and Validation of an Instrument for Measuring Stigma towards Mental Health Problems in Children among Health Professionals . Salud Mental, 48(2), 99–109. https://doi.org/ 10.17711/SM.0185-3325.2025.011

Received: February 15, 2024; Accepted: September 15, 2024

Correspondence: Jorge Javier Caraveo-Anduaga. Dirección de Investigaciones Epidemiológicas y Psicosociales, Instituto Nacional de Psiquiatría Ramón de la Fuente Muñiz. Calzada MéxicoXochimilco 101, Col. San Lorenzo Huipulco, Tlalpan, 14370, Ciudad de México, México. Tel.: 55-4160-5169 Email: caraveoj@inprf.gob.mx

Conflict of interest The authors declare that they have no conflicts of interest.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License