SciELO - Scientific Electronic Library Online

 
vol.13 número2Desarrollo de Escala sobre Celos Románticos en Redes Sociales (Facebook y Whatsapp)Afrontamiento ante las Transgresiones de la Pareja: Validación de un Inventario y su Relación con el Perdón índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • No hay artículos similaresSimilares en SciELO

Compartir


Acta de investigación psicológica

versión On-line ISSN 2007-4719versión impresa ISSN 2007-4832

Acta de investigación psicol vol.13 no.2 Ciudad de México may./ago. 2023  Epub 14-Nov-2023

https://doi.org/10.22201/fpsi.20074719e.2023.2.486 

Articles

Online Training for Primary Care Staff: Skills development on the Mental Health Gap Action Programme (mhGAP) Intervention Guide1

Entrenamiento en línea para personal de atención primaria: Desarrollo de habilidades sobre la Guía de Intervención para Superar las Brechas en Salud Mental (mhGAP)

Violeta Félix Romeroa  2 

Ángel Eugenio Tovara 

Alejandra López Montoyaa 

Marco Antonio Flores Coronadoa 

Sandra Ivonne Ferrer Reyesa 

Silvia Morales Chainéa 

Miguel Malo Serranob 

a Facultad de Psicología, Universidad Nacional Autónoma de México, México.

b Department of Noncommunicable Diseases and Mental Health, Panamerican Health Organization (PAHO), México.


Abstract

Developing effective learning strategies to strengthen mental health professionals’ capacities and deliver evidence-based interventions in their communities is urgent. We developed and evaluated an online training program for the Intervention Guide for Mental, Neurological and Substance Use Disorders in Non-specialized Health Settings. Nine hundred and seventy-five health professionals in Mexico were enrolled in the training program, during the period of social distancing brought about by the COVID-19 pandemic. Participants completed a pre-post online evaluation strategy including Knowledge screening, assessment of Learning Activities, and performance in Programmed-Simulated cases to evaluate knowledge and skills for the assessment, management, and follow-up of Mental, Neurological and Substance Use Disorders. We found that participants improved their knowledge and skills from training on the mhGAP online course. Notably we observed these positive results regardless of sex, profession, institution, or social vulnerability rating of participants, suggesting that this is a relevant training program for primary care staff. These results contribute to the Mental Health Gap Action Programme and advance the use of online teaching and evaluation technologies in this field.

Keywords: Mental health; Online course development; Health professionals’ training; Simulated patients

Resumen

El desarrollo de estrategias efectivas de aprendizaje para fortalecer las competencias de los profesionales de la salud mental y brindar intervenciones basadas en evidencia en sus comunidades es necesario. El objetivo del presente trabajo fue desarrollar y evaluar un programa de entrenamiento en línea para la Guía de Intervención en Trastornos Mentales, Neurológicos y por Uso de Sustancias en nivel de atención de salud no especializada. Participaron 975 profesionales de la salud mexicanos durante el período de distanciamiento social provocado por la pandemia de COVID-19. Los participantes completaron una evaluación previa y posterior que incluyó un cuestionario de conocimientos, actividades de aprendizaje y la ejecución en casos simulados programados para evaluar el conocimiento y las habilidades para la evaluación, el manejo y el seguimiento de los trastornos mentales, neurológicos y por uso de sustancias. Los resultados indicaron que los participantes mejoraron sus conocimientos y habilidades en función de su participación en el curso en línea, independientemente del sexo, la profesión, la institución o la vulnerabilidad social de los participantes, sugiriendo que se trata de un programa de formación relevante para el personal de atención primaria. Los resultados contribuyen al Programa de Acción para la Brecha de Salud Mental y promueven el uso de tecnologías de evaluación y enseñanza en línea en este campo.

Palabras clave: Salud mental; Desarrollo de cursos en línea; Formación de profesionales de la salud; Pacientes simulados

Developing effective learning strategies to strengthen mental health professionals’ capacities and deliver evidence-based interventions in their communities is urgent (Merzel, 2023). Mental, neurological and substance use (MNS) disorders represent a significant burden of disability (from 19% to 34% in the Region of the Americas) for individuals and communities globally (Pan American Health Organization, 2018; World Health Organization, 2021). Despite the high prevalence of MNS disorders, it has been estimated that between 75% and 95% of people affected by these disorders do not get access to appropriate treatment (Pan American Health Organization, 2018), due to minimal availability of trained health professionals, among other factors. Notably, it is estimated that there are only 13 mental health workers for every 100,000 inhabitants worldwide (World Health Organization, 2021).

To tackle this challenging scenario, global efforts have been developed in recent years to train health professionals. The World Health Organization (2016) presented an updated version of the Intervention Guide for Mental, Neurological and Substance Use Disorders in Non-specialized Health Settings (mhGAP) 2.0, with the main objective of teaching the assessment, management, and follow-up of priority MNS conditions through protocols for clinical decision-making. The application of the mhGAP Intervention Guide has been flexible according to regional needs and resources. For example, some studies have reported training of professionals with the complete guide composed of eight modules (Kokota et al., 2020), while others have prioritized depression disorders, psychoses, substance use, epilepsy and suicide, adapting the learning strategy to the needs of their social context (Siriwardhana et al., 2016).

The mhGAP Intervention Guide has been used to train, in a multidisciplinary perspective, social workers, nursing professionals (Iheanacho et al., 2014), medical doctors (Robles et al., 2019), medical assistants, students, research assistants and educators (Lasisi et al., 2017). In a recent review (Keynejad et al., 2018), most of the training programs referred in 33 studies lasted from two to three days in face-to-face models, and the strategies used mainly included verbal instruction, video tutorials, role-playing (Blanco-Vieira et al., 2017), seminars and discussions, and pre-post evaluations of knowledge and attitudes (Kokota et al., 2020).

Notably, due to the current social context brought about by the COVID-19 pandemic, several activities such as education programs, clinical interventions, and staff training, have been forced to move to on-line modalities. Moreover, the current times have promoted a fast technological development to extend the regional scope of training, education and evaluation through online and distance interactions without losing reliable measures of both knowledge and practical implementations (Walker et al., 2021). Considering the urgent need for developing effective training programs for health professionals to promote the acquisition of competences in primary care settings for reducing the gap in mental health care (Keynejad et al., 2021; Raj et al., 2021), the present work describes the development and effects of a massive training program in online modality for the mhGAP Intervention Guide, focused on knowledge and skills acquisition on assessment, management and follow-up procedures in non-specialized health professionals.

Methods

Participants

975 participants, all residents of Mexico, were recruited in a convenience sample through institutional invitations, as part of the National Training Program in Primary Care for Mental Health and Addiction (Programa Nacional de Capacitación en Salud Mental y Adicciones para Primer Nivel de Atención). Inclusion criteria for data analysis were that participants 1) completed the pre-post evaluation, 2) finished all the modules of the online course, and 3) indicated their sex, profession, and geographic region of residence. They had an average age of 38.43 years (SD = 9.72), 78.15% were female and 21.84% were male, and 51.79% were psychologists, 1.12% psychiatrists, 8.82% nurses, 17.53% physicians, 12.82% social workers, 1.12% students, 0.30% teachers, and 6.35% other.

Instruments

Knowledge Screening. We used a 24-item test from the mhGAP Training of Trainers and Supervisors (ToTS) Training Manual (World Health Organization, 2017) for the screening of knowledge about assessment, management, and follow-up procedures. The items were presented through a multiple-choice format and included questions on the main MNS conditions: Depression (3), Psychoses (3), Epilepsy (3), Child and Adolescent Mental and Behavioral Disorders (5), Dementia (4), Disorders due to Substance use (2), Suicide (1), Other Significant Mental Health Complaints (1), and Essential Care and Practice (2). Items are formulated to identify effective communication skills, clusters of symptoms, recommended treatments for the main MNS conditions, emergency case management, and follow-up.

Learning Activities. We developed a set of 11 interactive learning activities to reinforce information from each module of the mhGAP Guide: Essential Care and Practice with two learning activities, and one additional learning activity for each of the main conditions including Depression, Psychoses, Epilepsy, Child and Adolescent Mental and Behavioral Disorders, Dementia, Disorders due to Substance Use, Self-Harm/Suicide, Stress, and Other Significant Mental Health Complaints. Relevance of the content and its clarity were validated by four expert clinicians.

For the Essential Care and Practice module, the two interactive learning activities consisted of a five-item true/false questionnaire. Activity 1 required participants to observe a four-minute video of a clinical care session with a physician performing essential care practices. When the video was over, participants were asked to rate each statement true or false. Activity 2 was evaluated with five true/false statements about the same video, aimed at assessing communication skills. For the other nine modules, the interactive learning activity was a questionnaire of eight to 13 multiple-choice items about the characteristics of each disorder and its management. For these nine modules, the items evaluated identification of symptoms related to each disorder, identification of the recommended psychoeducational messages for persons with those disorders, and identification of the main interventions and follow-up for each disorder.

Programmed-Simulated Cases. We designed an innovative online evaluation strategy based on branching scenarios to assess participants’ decision-making during simulated interactions with persons with depression and substance use disorder. This strategy, implemented in Moodle®, simulated clinical interactions through short video clips. Each case was displayed as follows: the first screen presented a text vignette with general information about the person, including age, sex, educational level, occupation, marital status, and the main reason for consultation. A video then showed a person describing their situation, simulating a clinical care session. After this video, the participant was asked to decide among three forced options presented in text on the screen, and then another video was presented, which depended on the participant´s choice. After each video, textual feedback scored the skill level as “correct,” “partially correct,” or “incorrect,” with a detailed explanation of what was incorrect, as well as the expected response. We designed a total of ten short clips for each programmed simulated case to follow a logical sequence based on participants’ responses.

The cases were designed by four expert clinicians and questions and possible answers were based on a review of typical cases of depression and alcohol abuse (Félix Romero et al., 2021). The cases were thus close to real primary care cases, providing ecological validity in the design of the interactions in the branching scenario. The items for both cases, including dialogue, questions, and forced choices, were validated by ten experts: three psychiatrists and seven psychologists, all with graduate degrees and with an average of 9.1 (SD = 4.2) years of experience in mental health care. They assessed the clarity and relevance of the items, and the adequacy and coherence of the response options, showing high interobserver agreement: 0.96 for the depression case and 0.92 for the substance use case.

We created this evaluation set to identify not just the general knowledge acquisition about effective communication skills, clusters of symptoms and recommended treatments for the main MNS conditions and emergency case management, but specific skills of participants to interact with persons with MNS conditions and to make decisions about the assessment, management and follow-up components of the mhGAP Intervention Guide.

Procedure

Participants were invited by their institutions as part of the National Training Program in Primary Care for Mental Health and Addiction, which aims to reduce the gap in mental health care through the training of non-specialized staff who are the first contact with the health system and have the possibility of managing MNS conditions. Participants who accepted the invitation were offered a certificate that attests the hours completed, the topic of the training and the training institutions.

Participants signed-up for the course using Google Forms® which asked for general information about their professional profile, institution, and contact information. Registration also included a written informed consent that explained the training objective, its duration, procedures, methodology and information about personal data confidentiality and management, emphasizing the voluntary nature of their participation, ensuring that quitting would not have repercussions on their jobs, and highlighting the benefits for their professional practice and skills. Once they completed the registration forms, they were enrolled in an online platform based on Moodle® for the training in the mhGAP Intervention Guide.

Each participant received a welcome letter with a personal ID and password, and the details and instructions to enter and use the platform. The welcome letter indicated the self-management nature of the course, the time availability of the course and a schedule to optimally organize study times. This letter also specified the requirements to obtain the course certificate, such as to complete all the Learning Activities (including initial and final evaluations) and to obtain a grade equal or greater than eight in the range 0-10.

At the beginning of the online course, participants completed a pre-evaluation that consisted of Knowledge Screening and the two Programmed-Simulated case activities to evaluate their baseline knowledge and skills to perform the mhGAP procedures.

Once participants completed the pre-evaluation, they moved on to the ten self-managed modules that included the 11 Learning Activities above mentioned. The modules were organized as follows: 1. Essential Care and Practice, 2. Depression, 3. Psychoses, 4. Epilepsy, 5. Child and Adolescent Mental and Behavioral Disorders, 6. Dementia, 7. Disorders due to Substance Use, 8. Self-Harm/Suicide, 9. Stress, and 10. Other Significant Mental Health Complaints. These ten modules had the same design: each topic was theoretically developed through a detailed description of the main concepts and procedures in the assessment, management, and follow-up of each MNS condition. This information was presented using text, images, and supporting modeling videos. Additional specialized documents were also available in the platform to extend information on each topic. By the end of each module, participants were required to answer one of the learning activities above-mentioned, such as the true/false questionnaires to evaluate their level of knowledge on the reviewed MNS condition.

The mhGAP Intervention Guide online course was flexible in a way that allowed participants to complete all the modules or skip some of them, although they were encouraged to finish the course and they only received a certificate when completing the entire course. The decision to skip modules was individual and it was related to the participant´s profiles, for example, those in the medical field might be more experienced in some disorders as compared to those from nursing or social work staff. Additionally, the fact that the course was part of their work activities could limit the available time to complete it and led the participants to prioritize some modules based on the perception of its usefulness in their professional practice.

At the end of the 10 learning modules, participants completed the final evaluation which comprised a set of three tests: a post-test of the Knowledge Screening and the two Programmed-Simulated cases. We gave the certificate to those who completed the Learning Activities and the pre-post evaluation and for those who did not finish the course, we offered to register them in a future edition.

Results

The main objective of this study was to determine the effect of the Mental Health Gap Action Programme Intervention Guide online course on participants’ knowledge and skills in the assessment, management, and follow-up of major mental, neurological, and substance use disorders. We divided the data analysis into two parts: 1) an evaluation of participants’ level of knowledge and skills before and after the training, and 2) an analysis of the effectiveness of Programmed Simulated cases as a strategy to improve participants´ skills, employing cluster analysis with machine learning and a logistic regression model.

Pre-Post Performance

The statistical analysis was performed with R 3.6.3 base functions (R Team, 2016), lme4 (Bates et al., 2015), and ggeffects (Lüdecke, 2018) specialized CRAN packages. We explored whether participants increased their knowledge and skills by comparing their scores before and after the mhGAP Guide online course with three variables corresponding to Knowledge Screening, a Programmed Simulated Case of Depression, and a Programmed Simulated Case of Substance Use Disorder.

To determine the degree of improvement in the Programmed Simulated Cases, two delta (Δ) variables were calculated for each participant for each case, equal to their post score minus their pre score. The scores were minmax rescaled to positive scores ranging from 0 to 1, where a score of 1 was given to the maximum performance improvement among participants and 0 to the minimum.

Because normal distributions could not be assumed for the pre and post scores due to a highly skewed pattern, we used a nonparametric Wilcoxon test to explore these differences (Figure 1). In all cases, the post scores were higher than the pre scores, indicating improvement in participants’ knowledge and skills after completing the online course. The post knowledge screening score (M = 0.95, SD = 0.06) was found to be significantly higher (W = 475800, p < 0.001) than the pre knowledge screening score (M = 0.36, SD = 0.09). Comparably, the post score for the Programmed Simulated Case of depression (M = 0.87, SD = 0.14) was significantly higher (W = 49000, p <0.001) than the pre score (M = 0.76, SD = 0.16), and the post score for the case of substance use disorder (M = 0.92, SD = 0.011) was also significantly higher (W = 67846.5, p < 0.001) than the pre score (M = 0.89, SD = 0.12).

Figure 1 Performance Analysis for Knowledge Screening and Programmed Simulated Cases of Substance Use Disorder and Depression 

Cluster Analysis of Performance on Programmed Simulated Cases

Given that our results suggested that the Programmed Simulated Cases were an effective tool for training professionals in assessment, management, and follow-up of depression and substance use disorder, we further explored how this strategy helped improve participants’ skills. We divided participants into two groups: those with greater improvements in the Programmed Simulated Cases, and those with lesser improvements. To do this, we created clusters of participants determined by their compound delta (Δ) scores from both cases. These compound Δ scores quantified the magnitude of improvement.

For this analysis, we first assumed Δ values from the Programmed Simulated Cases to be the Cartesian axes of Euclidean space. Then, we used an unsupervised machine learning algorithm (k-means) to cluster participants depending on their proximity to two major Gaussian grouping centers (i.e., centroids) of improvement (high and low). K-means randomly places as many centroids as needed within a multidimensional space. Then, the fit of the centroids is improved by so that the distance between each centroid and its surrounding data points (in this case, the compound Δ scores), is minimized. This let us draw a decision line to show which centroid group any new data point would belong to. To best identify the locations of the Gaussian centroids, we first assumed the existence of two improvement clusters: 1) greater improvement and 2) lesser improvement. We then ran 50 simulations with randomly located centroids. In each simulation, cluster centers adjusted their location to fit all our data. The simulation that best fit the actual data was used to identify participants as higher or lower performers (Figure 2).

Figure 2 Cluster Plot of Participants by Performance in Programmed Simulated Cases: Δ Depression and Δ Substance Use Disorder 

The cluster identity was then used as a dependent variable in logistic regression models to determine whether participants’ sex, profession, institutional affiliation, or social vulnerability rating were predictors of their high or low performance (Figure 3).

Figure 3 Predictive Regressions of Participants’ Performance by sex, profession, institutional affiliation and social vulnerability 

A social vulnerability rating was calculated to explore the effect of socioeconomic inequality on the effectiveness of the mhGAP Guide online course. This variable was determined by the participants’ self-reported residential postal code. Based on this information, we gave a continuous social vulnerability rating to each participant, as defined by the Mexican National Institute of Statistics and Geography (INEGI) for each region of the country. This rating captures characteristics such as economic income, discrimination experienced, geographic segregation, and access to essential services.

The first characteristic on the alphabetical list was chosen as the intercept or level of comparison: “men” for sex, “nursing” for profession, and “civil organization” for institutional affiliation. For the analysis of social vulnerability, the intercept was defined as the lowest social vulnerability rating (-1.55). In all four cases, the logistic regression was corrected through Firth correction. We found no evidence for differential improvements as a consequence of sex (men β0 = 0.34, t=10.32, p<0.001; women β1=0.08, t=2.11, p=0.03), profession (nursery β0=0.47, t=8.96, p<0.001; medicine β1=-0.05, t=-0.86 p=0.38; others β1=0.09, t=1.14, p=0.25; psychiatry β1=-0.1, t=-0.68, p=0.49; psychology β1=-0.09, t=-1.73, p=0.08; social work β1=-0.02, t=-0.33, p=0.73; student β1=-0.01, t=-0.10, p=0.91; and teacher β1=-0.47, t=-1.63, p=0.10), institutional affiliation (civil organization β0=0.3, t=1.92, p=0.05, government β1=0.08, t=0.48, p=0.62; ministry of health β1=0.12, t=0.77, p=0.43; others β1=0, t=0.0, p=1; and universities β1=-0.02, t=-0.1, p=0.91), or social vulnerability ratings (lowest social vulnerability β0=0.39, t=12.74, p<0.01; highest social vulnerability β1=-0.02, t=-0.72, p=0.47). However, we did find that as social vulnerability increased, so did the estimate variability, which suggests that participants with higher social vulnerability ratings were associated with less certainty with being part of the high-performance group.

Discussion

Non-specialized health care providers face the challenge of bringing effective treatment closer to people with mental, neurological, and substance use disorders (World Health Organization, 2021). To achieve this goal, efforts have been made to include evidence-based procedures from training staff in the best practices for mental health care (Keynejad et al., 2021). Consistent with recent reports (Amsalem & Martin, 2021), the present study shows that an online course on the Mental Health Gap Action Programme Intervention Guide increases knowledge and skills about the assessment, management, and follow-up of priority conditions in mental health care.

The lack of specialized training and continuing education programs are two of the most frequent barriers to implementation of mental health interventions, as reported by health professionals themselves (Selin et al., 2020), and could lead to lack of knowledge, negative attitudes and beliefs about evidence-based practices (Selin et al., 2020), and poor perception of institutional support from authorities (Keen et al., 2021). Typical training includes a review of topics delivered though printed material and oral presentation by a trainer in face-to-face interactions (Herchenröther et al., 2021). Among other limitations, there are a limited number of trainees and time for this training. To these limitations have been added the need for remote learning strategies as a result of the COVID-19 pandemic. Online resources during the pandemic have increased the ability of educational institutions to provide training in physical and mental health care.

In addition to the specific knowledge imparted, one of the main opportunities provided by an online course is expanding the reach of training. Our study included participants from a variety of professional areas, such as medicine, psychology, psychiatry, nursing, and social work, both men and women, and from all over Mexico, a large country. The results showed no evidence of a differential effect in participants’ performance related to sociodemographic variables, suggesting that the training strategy proposed is effective in providing knowledge and skills to health care providers, regardless of their profession, sex, institutional affiliation, or location. This is an important finding, because previous studies with face-to-face training have reported mixed results with participants of different professional profiles, frequently favoring medical staff (Kruse et al., 2020; Selin et al., 2020). The generalizability of our training course across professions contributes to the objectives of the Mental Health Gap Action Program, facilitating the dissemination and transfer of useful resources for mental health care in non-specialized health care settings.

Despite the documented advantages (Yuhanna et al., 2020) of online training resources, there are difficulties in promoting their adoption. Previous research (Patel et al., 2021) has explored participants’ perceptions of online trainings, and has found that health professionals complain about the lack of resources for participation. One common complaint was that they had to use their own resources, such as computers, and also money and personal time to respond to training demands (Dumford & Miller, 2018). Another frequent problem, especially in low-income countries (Rosário et al., 2021), has been a lack of digital access, which sometimes makes it difficult for people to use such resources. We thus included in our analysis an exploration of the effect of socioeconomic level, based on a social vulnerability rating, on the effectiveness of this training in acquiring skills. We found that, in general, social vulnerability was not a strong barrier to participants’ performance, although we did observe that participants with greater social vulnerability showed less certainty of improving their scores. This lack of socioeconomic effect suggests that this kind of strategy is useful for reaching professionals who otherwise might not participate in such training because of difficulties in scheduling, taking time off from employment, or paying for transportation. However, it is important to further consider and analyze how such socioeconomic factors may affect knowledge and skills acquisition (Keen et al., 2021).

Our online platform focused not only on providing information, but also on strategies to evaluate the acquisition of this information and basic skills for assessment, management, and follow-up procedures. While the knowledge screening and learning activities were used as evaluation resources, the Programmed Simulated Cases additionally served as a strategy requiring participants to apply their knowledge in more realistic cases. Recently, simulated cases or simulated patients have been used as a tool for the assessment of clinical competences as part of training and research in clinical settings (Kühne et al., 2021). Given that they are standardized and ecologically valid (Pheister et al., 2017), simulated cases ensure equal opportunities for students to demonstrate their skill levels in a comparable manner that is appropriate for statistical analysis (Kühne et al., 2021). They allow for practice and feedback in a controlled environment, reducing the probability that they will make mistakes with real patients (Yap et al., 2021).

Simulated cases have traditionally been implemented in face-to-face interactions, with actors or persons trained to simulate patients with a variety of health issues, such as depression, self-harm, or suicidal acts (Ay-Bryson et al., 2020; Osborn & Cash, 2021). This has been a very effective strategy, but in most cases, it is an expensive one. Our alternative of Programmed Simulated Cases uses an online branching scenario (Mashaal et al., 2020) to reduce human error and allow the screening of skills in a short time and in a standardized situation. Moreover, the branching scenario provides participants with immediate feedback on their performance after every choice they make.

Although we presented evidence of how the use of technology could facilitate delivering an education program for mental health staff, it is worth mentioning some limitations of our approach. Particularly with Programed-Simulated Cases, we use two of the most common MNS conditions: depression and substance use; because of the origin of our sample, we could suppose they had more experience in the management of substance use cases, so, their performance in both cases differed, being better at substance use case since the beginning. This makes necessary to think in a different methodology of presentation, including more MNS conditions and maybe presenting them in a random arrangement. Future studies should also consider implementing strategies to avoid participants dropping out of the course. Our strategy provided the opportunity for participants to skip modules and choose which ones to finish. This flexibility is important considering the evidence (Dobson et al., 2008) on how such protocols can be strategically adapted where resources are limited to present only major components. This could make it possible for participants to complete a shorter but equally effective course, and to prioritize topics, adapting the content to their needs.

Conclusion

Knowledge and skills for assessment, management, and follow-up of mental, neurological, and substance use disorders are essential for the implementation and adoption of evidence-based practices. This study demonstrates the usefulness of an online training to promote knowledge and skills acquisition in health care professionals, as well as the great potential of evaluation strategies in which participants can learn, practice, receive feedback, and verify their competence levels, giving them the opportunity to implement effective interventions, develop best practices, and truly reduce the care gap for people with mental health conditions.

References

Amsalem, D., & Martin, A. (2021). Reducing depression-related stigma and increasing treatment seeking among adolescents: randomized controlled trial of a brief video intervention. Journal of Child Psychology and Psychiatry and Allied Disciplines. https://doi.org/10.1111/jcpp.13427 [ Links ]

Ay-Bryson, D. S., Weck, F., & Kühne, F. (2020). Can Simulated Patient Encounters Appear Authentic? Development and Pilot Results of a Rating Instrument Based on the Portrayal of Depressive Patients. Training and Education in Professional Psychology. https://doi.org/10.1037/tep0000349 [ Links ]

Bates, D., Mächler, M., Bolker, B. M., & Walker, S. C. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1). https://doi.org/10.18637/jss.v067.i01 [ Links ]

Blanco-Vieira, T., Silva Ribeiro, W., Lauridsen-Ribeiro, E., Graça Fatori de Sá, D., Palma, S. M. M., Vieira Ribeiro, M. V., Cavalcante Caetano, S., Ramos, F. A. da C., & Conceição do Rosário, M. (2017). An evaluation of a collaborative course for child and adolescent mental health professionals. Journal of Interprofessional Care, 31(5), 664-666. https://doi.org/10.1080/13561820.2017.1322561 [ Links ]

Dobson, K. S., Hollon, S. D., Dimidjian, S., Schmaling, K. B., Kohlenberg, R. J., Gallop, R. J., Rizvi, S. L., Gollan, J. K., Dunner, D. L., & Jacobson, N. S. (2008). Randomized Trial of Behavioral Activation, Cognitive Therapy, and Antidepressant Medication in the Prevention of Relapse and Recurrence in Major Depression. Journal of Consulting and Clinical Psychology, 76(3), 468-477. https://doi.org/10.1037/0022-006X.76.3.468 [ Links ]

Dumford, A. D., & Miller, A. L. (2018). Online learning in higher education: exploring advantages and disadvantages for engagement. Journal of Computing in Higher Education, 30(3), 452-465. https://doi.org/10.1007/s12528-018-9179-z [ Links ]

Félix Romero, V., Ortiz Gómez, D. K., Morales Chainé, S., & Uriarte Rojo, C. (2021). Caso Simulado Estandarizado: Evaluación Conductual en Profesionales de la Salud en Adicciones. Acta de Investigación Psicológica, 11(3), 87-98. https://doi.org/10.22201/fpsi.20074719e.2021.3.395 [ Links ]

Herchenröther, J., Tiedemann, E., Vogel, H., & Simmenroth, A. (2021). Which teaching method is more effective in a communication course - role-playing versus simulated patients, taught by tutors or faculty staff? A randomized trial. GMS Journal for Medical Education, 38(3). https://doi.org/10.3205/zma001450 [ Links ]

Iheanacho, T., Marienfeld, C., Stefanovics, E., & Rosenheck, R. A. (2014). Attitudes toward mental illness and changes associated with a brief educational intervention for medical and nursing students in Nigeria. Academic Psychiatry, 38(3), 320-324. https://doi.org/10.1007/s40596-014-0073-3 [ Links ]

Keen, A., Thoele, K., Oruche, U., & Newhouse, R. (2021). Perceptions of the barriers, facilitators, outcomes, and helpfulness of strategies to implement screening, brief intervention, and referral to treatment in acute care. Implementation Science, 16(1). https://doi.org/10.1186/s13012-021-01116-0 [ Links ]

Keynejad, R. C., Dua, T., Barbui, C., & Thornicroft, G. (2018). WHO Mental Health Gap Action Programme (mhGAP) Intervention Guide: A systematic review of evidence from low and middleincome countries. Evidence-Based Mental Health, 21(1), 29-33. https://doi.org/10.1136/eb-2017-102750 [ Links ]

Keynejad, R., Spagnolo, J., & Thornicroft, G. (2021). WHO mental health gap action programme (mhGAP) intervention guide: Updated systematic review on evidence and impact. Evidence-Based Mental Health, 1-7. https://doi.org/10.1136/ebmental-2021-300254 [ Links ]

Kokota, D., Lund, C., Ahrens, J., Breuer, E., & Gilfillan, S. (2020). Evaluation of mhGAP training for primary healthcare workers in Mulanje, Malawi: A quasi-experimental and time series study. International Journal of Mental Health Systems, 14(1), 1-8. https://doi.org/10.1186/s13033-020-0337-0 [ Links ]

Kruse, A. B., Heil, H. K. P., Struß, N., Fabry, G., Silbernagel, W., Vach, K., Ratka-Krüger, P., & Woelber, J. P. (2020). Working experience is not a predictor of good communication: Results from a controlled trial with simulated patients. European Journal of Dental Education, 24(2), 177-185. https://doi.org/10.1111/eje.12482 [ Links ]

Kühne, F., Maaß, U., & Weck, F. (2021). Standardized Patients in Clinical Psychology: From Research to Practice. Verhaltenstherapie. https://doi.org/10.1159/000510049 [ Links ]

Lasisi, D., Ani, C., Lasebikan, V., Sheikh, L., & Omigbodun, O. (2017). Effect of attention-deficit-hyperactivity-disorder training program on the knowledge and attitudes of primary school teachers in Kaduna, North West Nigeria. Child and Adolescent Psychiatry and Mental Health, 11(1), 1-8. https://doi.org/10.1186/s13034-017-0153-8 [ Links ]

Lüdecke, D. (2018). ggeffects: Tidy Data Frames of Marginal Effects from Regression Models. Journal of Open Source Software, 3(26), 772. https://doi.org/10.21105/joss.00772 [ Links ]

Mashaal, D., Rababa, M., & Shahrour, G. (2020). Distance learning-related stress among undergraduate nursing students during the covid-19 pandemic. Journal of Nursing Education, 59(12), 666-674. https://doi.org/10.3928/01484834-20201118-03 [ Links ]

Merzel, C. R. (2023). Advancing Pedagogies to Promote Mental Health and Interprofessional Education. Pedagogy in Health Promotion, 9(1), 3-4. https://doi.org/10.1177/23733799221151181 [ Links ]

Osborn, C. L., & Cash, R. E. (2021). Effects of Interview Training with Simulated Patients on Suicide, Threat, and Abuse Assessment. ATHENS JOURNAL OF SOCIAL SCIENCES, 8(4), 245-258. https://doi.org/10.30958/ajss.8-4-3 [ Links ]

Pan American Health Organization. (2018). The Burden of Mental Disorders in the Region of the Americas, 2018. [ Links ]

Patel, M., Hui, J., Ho, C., Mak, C. K., Simpson, A., & Sockalingam, S. (2021). Tutors’ Perceptions of the Transition to Video and Simulated Patients in Pre-clinical Psychiatry Training. Academic Psychiatry, 45(5), 593-597. https://doi.org/10.1007/s40596-021-01504-0 [ Links ]

Pheister, M., Stagno, S., Cotes, R., Prabhakar, D., Mahr, F., Crowell, A., & Schwartz, A. (2017). Simulated Patients and Scenarios to Assess and Teach Psychiatry Residents. Academic Psychiatry, 41(1), 114-117. https://doi.org/10.1007/s40596-015-0477-8 [ Links ]

Raj, V., Raykar, V., Robinson, A. M., & Islam, M. R. (2021). Child and Adolescent Mental Health Training Programs for Non-specialist Mental Health Professionals in Low and Middle Income Countries: A Scoping Review of Literature. Community Mental Health Journal, 0123456789. https://doi.org/10.1007/s10597-021-00805-w [ Links ]

Robles, R., Lopez-Garcia, P., Miret, M., Cabello, M., Cisneros, E., Rizo, A., Ayuso-Mateos, J. L., & Medina-Mora, M. E. (2019). WHO-mhGAP Training in Mexico: Increasing Knowledge and Readiness for the Identification and Management of Depression and Suicide Risk in Primary Care. Archives of Medical Research, 50(8), 558-566. https://doi.org/10.1016/j.arcmed.2019.12.008 [ Links ]

Rosário, F., Santos, M. I., Angus, K., Pas, L., Ribeiro, C., & Fitzgerald, N. (2021). Factors influencing the implementation of screening and brief interventions for alcohol use in primary care practices: a systematic review using the COM-B system and Theoretical Domains Framework. Implementation Science, 16(1), 1-25. https://doi.org/10.1186/s13012-020-01073-0 [ Links ]

Selin, J., Pietilä, E., & Kesänen, M. (2020). Barriers and facilitators for the implementation of the integrated public policy for alcohol, drug, tobacco, and gambling prevention: a qualitative study. Drugs: Education, Prevention and Policy, 27(2). https://doi.org/10.1080/09687637.2019.1595527 [ Links ]

Siriwardhana, C., Adikari, A., Jayaweera, K., Abeyrathna, B., & Sumathipala, A. (2016). Integrating mental health into primary care for post-conflict populations: A pilot study. International Journal of Mental Health Systems, 10(1), 1-12. https://doi.org/10.1186/S13033-016-0046-X [ Links ]

Team, R. (2016). R: A language and environment for statistical computing. 2, 1-12. [ Links ]

Walker, E. R., Lang, D. L., Alperin, M., Vu, M., Barry, C. M., & Gaydos, L. M. (2021). Comparing Student Learning, Satisfaction, and Experiences Between Hybrid and In-Person Course Modalities: A Comprehensive, Mixed-Methods Evaluation of Five Public Health Courses. Pedagogy in Health Promotion, 7(1), 29-37. https://doi.org/10.1177/2373379920963660 [ Links ]

World Health Organization. (2017). mhGAP Training of Trainers and Supervisors (ToTS) Training Manual. [ Links ]

World Health Organization. (2021). Mental Health Atlas 2020. [ Links ]

Yap, K., Sheen, J., Nedeljkovic, M., Milne, L., Lawrence, K., & Hay, M. (2021). Assessing clinical competencies using the Objective Structured Clinical Examination (OSCE) in psychology training. Clinical Psychologist. https://doi.org/10.1080/13284207.2021.1932452 [ Links ]

Yuhanna, I., Alexander, A., & Kachik, A. (2020). Advantages and disadvantages of online training. Journal Educational Verkenning, 1(2), 13-19. doi: https://doi.org/10.48173/jev.v1i2.54 [ Links ]

1 Funding: This research was supported by the Río Arronte Foundation (Grant No. SA-345) and by PAPIIT-UNAM (Grant no. IV300121).

Funding. This research was supported by the Río Arronte Foundation (Grant No. SA-345) and by PAPIIT-UNAM (Grant no. IV300121).

Institutional Review Board Statement. Approval was obtained from the Research Ethics Committee of the Faculty of Psychology at the National Autonomous University of Mexico (Facultad de Psicología, Universidad Nacional Autónoma de México) (Approval No. FPSI/422/CEIP/157/2020). The procedures used in this study were conducted according to ethical standards for human research and the Helsinki Declaration.

Informed Consent Statement. Informed consent was obtained from all subjects involved in the study.

Received: December 08, 2022; Accepted: June 09, 2023

2 Corresponding autor: Violeta Félix-Romero, Facultad de Psicología, Universidad Nacional Autónoma de México, Av. Universidad 3000, 04510, Mexico City violeta.felix@psicologia.unam.mx.

Conflicts of Interest. The authors have no financial or non-financial interest to disclose. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License