SciELO - Scientific Electronic Library Online

 
vol.42 número2Impresión 3D en cuidado de la saludValores de umbral de dolor por presión obtenidos mediante Algómetros índice de autoresíndice de materiabúsqueda de artículos
Home Pagelista alfabética de revistas  

Servicios Personalizados

Revista

Articulo

Indicadores

Links relacionados

  • No hay artículos similaresSimilares en SciELO

Compartir


Revista mexicana de ingeniería biomédica

versión On-line ISSN 2395-9126versión impresa ISSN 0188-9532

Rev. mex. ing. bioméd vol.42 no.2 México may./ago. 2021  Epub 20-Sep-2021

https://doi.org/10.17488/rmib.42.2.8 

Review article

Efficacy of Virtual Reality in Neurorehabilitation of Spinal Cord Injury Patients: A Systematic Review

Eficacia de la Realidad Virtual en la Neurorrehabilitación de Pacientes con Lesión de Médula Espinal: una Revisión Sistemática

B. A. Orsatti-Sánchez1 

O. Diaz-Hernandez2 

1Universidad Nacional Autónoma de México, División de Ingeniería Mecánica e Industrial

2Universidad Nacional Autónoma de México, ENES Juriquilla


ABSTRACT

This systematic review (SR) analyzed the effectiveness of interventions using virtual reality (VR) technology as a neurorehabilitation therapy in people with spinal cord injury (SCI). The SR was developed under the guidelines of the PRISMA statement and the recommendations of the Cochrane Collaboration, along with the PEDro and National Institute of Health scales to assess the risk of bias and methodological quality. The Cochrane, IEEE, BVS/LILACS, MEDLINE/PubMed, and Web of Science databases were browsed to identify studies that, between 2010 and 2020, evaluated the efficacy of these therapies. Out of 353 retrieved studies, 11 were finally selected after the application of the defined inclusion and exclusion criteria. These articles presented good methodological quality as they were mostly controlled clinical trials that analyzed mixed therapies with conventional therapies. Interventions based on non-immersive or immersive VR technology that achieved functional motor, balance, and psycho-emotional health improvement with positive effects on motivation, self-confidence, commitment, and active participation were identified in a total sample of 155 SCI patients. It was concluded that such VR technology is an effective tool of neurorehabilitation complementary to conventional therapies, which promotes functional improvement in SCI patients both in the clinic and at home.

KEYWORDS: Spinal cord injury; virtual reality; neurorehabilitation; systematic review

RESUMEN

Esta revisión sistemática (RS) analizó la eficacia de las intervenciones que utilizan la tecnología de realidad virtual (RV) como terapia de neurorrehabilitación en personas con lesión de médula espinal (LME). La RS fue desarrollada bajo los lineamientos de la declaración PRISMA y las recomendaciones de la Colaboración Cochrane, junto con las escalas de PEDro y del National Institute of Health para evaluar el riego de sesgo y la calidad metodológica. Se revisaron las bases de Cochrane, IEEE, BVS/LILACS, MEDLINE/PubMed y Web of Science para identificar estudios que, entre 2010 y 2020, evaluaron la eficacia de dichas terapias. De 353 estudios recuperados, 11 fueron finalmente seleccionados tras la aplicación de los criterios de inclusión y exclusión definidos. Dichos artículos presentaron una buena calidad metodológica, al ser mayormente ensayos clínicos controlados que analizaron terapias mixtas con terapias convencionales. Se identificaron intervenciones basadas en tecnología de RV no inmersiva o inmersiva que lograron una mejora funcional motora, de equilibrio y de salud psico-emocional con efectos positivos de motivación, seguridad, compromiso y activa participación en una muestra total de 155 pacientes con LME. Se concluyó que dicha tecnología de RV es una herramienta eficaz de neurorrehabilitación complementaria a las terapias convencionales, al promover una mejora funcional en pacientes con LME tanto en la clínica como en casa.

PALABRAS CLAVE: Lesión de medula espinal; realidad virtual; rehabilitación neurológica; revisión sistemática

INTRODUCTION

Spinal cord injury (SCI) is related to damage to the spinal cord resulting from traumatic (external force) or non-traumatic (disease or degeneration) causes. As the spinal cord (SC) is the main information conduit connecting the brain to the rest of the body, an SCI can have significant physiological consequences below the level of injury, ranging from no or mild neurological deficit to a more serious loss of motor, sensory, and autonomic functions, or even death, mainly depending on the number of surviving axons [1] [2] [3].

The World Health Organization highlights that the incidence of both traumatic and non-traumatic SCI ranges from 40 to 80 cases per million inhabitants per year, with 90% of them caused by trauma [1]. Men in the 20-29 age group and over 70 are at a higher risk of suffering an SCI, whereas the risk for women appears between the ages of 15 and 19 and over 60. The maleto-female ratio is usually 2:1 [1].

The increased life expectancy in high-income countries accounts for a higher SCI prevalence of around 70% for people with quadriplegia and 88% for people with complete paraplegia as compared to low- and middle-income countries [1]. By 2020, SCI is expected to be one leading causes of disability globally [4].

SCI is often associated with various psychological and social consequences including low rates of school enrollment, difficulty with schoolwork, work barriers as reflected in an overall unemployment rate in excess of 60%, and the fact that 20% to 30% of these patients show signs of depression [1].

Injuries may be traumatic in the case of fracture, dislocation, or compression of one or more vertebrae, mainly as a result of road accidents, falls, or gunshot wounds. There are also non-traumatic injuries caused by arthritis, cancer, inflammation, infections, degenerative disc disease, or congenital conditions [1] [2] [3] [4].

The degree of paralysis caused by an SCI depends on the location of the injury, which will determine whether it is paraplegia or quadriplegia. The latter is more serious as it causes a partial or total loss of motor and/or sensory function in all four extremities, trunk, and pelvic organs when the injury is located in the C1-C7 segments. In contrast, there is paraplegia when the injury is located in the T1-S5 segments, causing functional disorders in the legs, pelvic organs, and part of the trunk [1] [2] [3] [4] [5] [6].

The neurological condition of an SCI patient is determined by the American Spinal Injury Association (ASIA) Impairment Scale, which defines 5 levels of impairment based on the absence or preservation of motor and sensory function. In a complete injury (grade A), these functions are not present below the level of injury up to the S4-S5 sacral segments. In contrast, when some signals can still be transmitted below the level of injury, then the injury is incomplete (grades B, C, and D) with some preserved motor and/or sensory function. Grade E describes normal function of all segments [3] [6] [7].

Although, so far, the consequences of an SCI are considered to be irreversible given the SC’s inability to regenerate, the development of new surgical procedures and the technological advances in the last few decades have contributed to the design of new rehabilitation programs aimed at improving patients’ prognosis and quality of life [1] [2] [8].

Comprehensive, conventional rehabilitation programs combine physical therapy with occupational therapy activities. While the former focuses on maintaining and strengthening muscle function, improving balance and coordination in both standing and seating positions, training gait and weight shifting, and learning adaptation techniques in order to perform daily tasks, the latter aims to recover fine motor skills in order to achieve greater biopsychosocial wellbeing and independence to perform personal care activities and adapt the impaired abilities to professional or academic life [1] [2] [5].

Against this backdrop, the introduction of virtual reality (VR) in rehabilitation therapies after SCI seeks to contribute to motor and cognitive relearning processes by arousing patients’ interest in rehabilitation programs. This is done through a series of gamebased exercises that also instill higher levels of self-confidence and self-improvement through the use of new stimuli to enhance the effectiveness of patients’ physical and cognitive abilities and functions in controlled virtual environments. These gamebased exercises stimulate the patient to perform a greater number of repetitions and therefore the intensity of the rehabilitation activities increases, which stimulates neuroplasticity promoting motor relearning in SCI patients. Some literature highlights the importance of using VR as a complement to traditional rehabilitation programs to improve them, since these usually involve simple and repetitive movements which causes a feeling of boredom, thus reducing the motivation of SCI patients. Moreover, the capturing patients’ movements enables therapists to plan, supervise, and adapt exercises in an individualized manner [1] [9] [10].

VR or a virtual environment is an IT-based structure that creates a simulated or artificial, three-dimensional (3D) environment that mimics the real environment where a person is located. The application of VR devices depends on the level of technological advancement, the level of platform complexity, costs, and the ability to adapt them to different VR environments [9] [10].

VR systems fall into three categories according to the sense of reality of the created virtual environment: 1) in fully-immersive VR, the user wears a headset or goggles, earphones, and other special peripherals (gloves, haptic hand controllers, etc.); 2) in semi-immersive VR, the user places himself or herself among four aligned screens on which the virtual environment is projected and uses peripherals to interact with the environment with head movements; 3) in non-immersive VR, the user needs a screen monitor, a keyboard, a mouse, or other peripherals to place himself or herself in the VR environment and interact with it [10]. There is also the so-called “augmented reality,” which requires the use of a device that enables users to visualize virtual objects overlaid in the real world; this is often mixed up with semi-immersive VR.

Since VR technology is an innovative tool that has been applied in the medical field of rehabilitation and should be followed up in terms of its most recent development over the last few years [1], it is important to compile, synthesize and analyze the evidence achieved on the advances, effects and level of acceptance of VR in the rehabilitation of motor and cognitive functions after SCI.

The objective was to conduct a systematic review (SR) with the aim of analyzing the efficacy of VR technology in the neurorehabilitation of SCI patients based on evidence gathered by the studies included in the review, with an emphasis on: 1) whether VR was integrated into conventional rehabilitation therapies and the resulting benefits; 2) whether the results of the use of VR have been compared with those of conventional rehabilitation therapies; 3) how VR was applied; 4) the types of SCI analyzed; 5) patients’ acceptability; 6) main limitations observed; and 7) future work.

MATERIALS AND METHODS

Protocol

This SR was conducted following the 27 guidelines and the flow diagram structure provided by the PRISMA statement [11] [12] [13] as well as the recommendations of the Cochrane Collaboration to perform an orderly selection of papers according to the proposed protocol [14]. All this enhanced the quality and presentation of the analysis and brought transparency to the paper selection process.

Search strategy

Between 1 May and 19 June 2020, an electronic search was carried out in the COCHRANE, IEEE, BVS/ LILACS, MEDLINE/PUBMED, and WEB OF SCIENCE databases in order to find any papers published in the January 2010-June 2020 period, when most of the development and research work around the use of VR technology applied to motor and cognitive rehabilitation [9] took place. Additionally, the search was performed in English and Spanish, without a geographic delimitation with the purpose of obtaining a global overview.

The search terms in Spanish consisted of combinations of keywords found in the Descriptores en Ciencias de la Salud (DeCS) thesaurus: lesión de médula espinal, traumatismo de médula espinal, tetraplejia, cuadriplejia, paraplejia, realidad virtual, realidad aumentada, terapia de exposición mediante realidad virtual, juego de video, rehabilitación, and rehabilitación neurológica. The search terms in English included terms found in the Medical Subject Headings (MeSH) thesaurus: spinal cord injury, spinal cord trauma, tetraplegia, quadriplegia, paraplegia, virtual reality, augmented reality, virtual reality immersion therapy, virtual reality exposure therapy, video game, rehabilitation, and neurorehabilitation. The final structure of each database search strategy was adjusted based on syntax, logical operators, tags, and relevant qualifiers [15] [16] [17] [18].

Eligibility criteria

The inclusion criteria were defined based on the PICOS model (Participants, Interventions, Comparators, Outcomes, Study Design) [13]. The review took into account both controlled and randomized controlled clinical trials [14] [19] conducted on human subjects that provided empirical evidence of the efficacy of neurorehabilitation of motor and cognitive functions through virtual reality therapies (VRT) applied as a complement or not to physical, occupational, or mixed therapies, and that allowed for a comparison of an intervention group with a control group. Quasiexperimental (before-and-after) studies were also considered. The patient population included both male and female subjects with SCI in the 18 to 85 age range, with traumatic and non-traumatic, complete and incomplete injuries, regardless of their ASIA grades or time since injury.

The studies were required to contain this information: population sample, assisted limbs and SCI characteristics, objectives, and aspects of the rehabilitation intervention; VR technology type, effects, and application method; duration, frequency, and acceptability; assessment of the effect of the intervention compared to conventional therapies; validation or development of VR software or devices; and intervention efficacy indicators.

Any systematic reviews, meta-analyses, lectures, abstracts, or studies that were duplicated or not designed to assess the clinical efficacy of motor or cognitive rehabilitation on SCI, that did not focus on VR as a therapeutic intervention, or that used electrical stimulation that could have influenced its own results of the technology under study were excluded. Similarly, studies that did not fit the defined study time period and were not written in English or Spanish were also excluded.

The selection of potentially relevant studies was performed in three stages. The first stage focused on eliminating duplicate records; the second stage centered on exclusion of papers according to their title and abstract; finally, the third stage consisted of a fulltext analysis. The last two stages were guided by inclusion and exclusion criteria [14].

Data extraction

Two electronic worksheets were created in order to obtain detailed information from the studies selected in an organized manner. The first worksheet contained demographic and clinical information about the patient population: mean age, sex, cause and level of SCI, ASIA impairment grade, type of injury, time since injury, sample distribution across study groups, and their respective dropout rates. The second worksheet summarized the characteristics of the selected studies: authors’ names, country and year of publication, study design, and characteristics of the VR technology used, information on interventions, sessions, outcome measures, and conclusions.

Risk of bias assessment

The internal validity of the controlled clinical trials was assessed using the PEDro scale criteria [20]. For before-and-after studies without a control group, the National Institute of Health Quality Assessment Tool was applied [21].

Taking the registered level of evidence as a reference, the internal validity was rated as poor, fair, good, or excellent for scores in the 0-4, 5-6, 7-8, and 9-10 ranges, respectively, for PEDro. Comparatively, for the before-and-after studies, it was rated as poor, fair, or good in the 0-4, 5-6, and 7-10 ranges, respectively. Studies rated as with good methodological quality and low risk of bias were identified with a score higher than the mean of 5, while those with scores lower than the mean of 5 were rated as with poor methodological quality and high risk of bias.

RESULTS AND DISCUSSION

Paper search and selection process

A total of 353 papers were found, 218 of which remained after eliminating duplicates. Of these, only 207 could be downloaded. During the second stage of the selection process, 179 papers were ruled out based on their title and abstract, and only 28 moved forward to the final stage for full-text analysis, where another 17 were excluded, resulting in 11 papers finally selected for the SR. Figure 1 depicts the paper selection process listing the exclusion criteria in each stage based on the PRISMA statement [12].

Figure 1 PRISMA flow diagram of the paper search strategy and selection process. 

A larger number of papers were found from India and Spain, each represented 27.27% of the studies selected, while Italy, South Korea, Switzerland, Taiwan, and Australia each represented only 9.09% of these. Over the entire search time period, no papers were found for the years 2013 and 2019. English was the main language used in 90.91% of the studies selected

Risk of bias assessment of selected papers

The results of the controlled clinical trials [22] [23] [24] [25] [26] [27] [28] [29] [30] and the before-and-after studies [31] [32] are presented in Tables 1 and 2, respectively. According to the PEDro scale, the score for the risk of bias of the controlled clinical trials was 7.22±1.30, and in the case of the before-and-after studies, the National Institute of Health score was 7.5±0.7. This indicates that the selected papers have a low risk of bias and a high methodological quality associated with the evidence they provide.

Table 1 Assessment of the risk of bias of controlled clinical trials according to the PEDro scale. 

STUDY D’Addio G, et. al. (2014) [22] Dimbwadyo Terrer I, et. al. (2016) [23] Dimbwadyo Terrer I, et. al. (2015) [24] Gil Agudo A, et. al. (2011) [25] Khurana M, et. al. (2017) [26] Lakhani A, et. al. (2020) [27] Tak S, et. al. (2015) [28] Prasad S, et. al. (2018) [29] Sengupta M, et. al. (2019) [30]
CRITERION
Randomization
Allocation concealed
Groups were similar at baseline
Blinding of all subjects
Blinding of all therapists
Blinding of all assessors
Key outcomes in 85% of the allocated subjects
Groups received planned treatment or “intention to treat”
Statistical comparisons between groups
Point and variability measures of treatment effects
Total 6 9 6 6 9 6 8 8 7
Level of evidence Fair Excellent Fair Fair Excellent Fair Good Good Good
Risk of bias Low Low Low Low Low Low Low Low Low

Note. : ✔ yes; ✘: no.

Table 2 Assessment of the risk of bias of before-and-after studies according to the National Institute of Health. 

STUDY Sung W, et. al.
(2012) [31]
Villiger M, et. al.
(2017) [32]
CRITERION
Stated study question or objective
Eligibility criteria (subjects)
Representative participants
Enrollment of all eligible participants NR
Sample size sufficiently large
Intervention clearly described and delivered
Clearly define outcome measures
Blinding of all assessors NR
More than 20% of participants followed-up after baseline.
Statistical analysis (p)
Outcome measures taken multiple times
Group level statistical analysis NA NA
Total 8 7
Level of evidence Good Good
Risk of bias Low Low

Note. ✔ : yes; ✘: no; NR: not reported; NA: not applicable.

Ethical statement

All studies reported that, before the start of the intervention, patients were asked to sign an informed consent letter after they were informed, in writing and verbally, of the experimental procedures in the study protocol. The interventions were authorized by the ethics committees of the participating hospitals [23] [24] [25], universities [27] [28], sites [26] [27] [29][30] [31] or state agency [32], with the exception of one [22], which did not report anything in this regard. Only 3 studies [23] [25] [32] adapted their protocols to the Helsinki Declaration of the World Medical Association.

Design of selected studies

Of the 11 selected papers, 9 were controlled clinical trials (8 randomized [22] [23] [24] [25] [26] [27] [28] [29] and 1 non-randomized [30]), and 2 were before-and-after studies [31] [32].

Controlled clinical trials were those in which the subjects had been allocated to a control group (CG) or an intervention group (IG) and which conducted a prospective analysis. If such allocation had been made through randomization, then the trial was considered a randomized, controlled clinical trial. Additionally, the design of before-and-after studies included subjects that received the same treatment without a control group [14].

Out of the 9 controlled clinical trials, 8 worked with parallel groups, and only 1 [27] worked with crossover groups. Only 5 of the 8 randomized controlled clinical trials were blinded and reported the randomization technique used: opaque envelopes containing sequential numbers [23], computer-generated random numbers [26], the “randbetween” function in Excel [27], Random Allocation 2.0 software [28], and an unspecified fixed randomization method [29]. In the case of the non-randomized study [30], patients were assigned to the IG and CG based on their demographic characteristics, which is not considered an adequate randomization method by PEDro [20] and the Cochrane Collaboration [14].

As far as blinding is concerned, 4 controlled clinical trials and 2 before-and-after studies had no blinding [22] [24] [25] [27] [31] [32]. Moreover, of the 5 controlled clinical trials, 2 were single-blinded to the assessors [28] [29], and 3 were double-blinded to both the subjects and the assessors [23] [30] or to the therapists and the assessors [26].

It should be noted that only 3 papers [23] [29] [32] included a long-term follow-up on the effects of VRT on subjects over time.

Population characteristics

All papers reported their inclusion and exclusion criteria for subject eligibility, and only 9 [23] [25] [26] [27] [28] [29] [30] [31] [32] indicated their recruitment sources.

The total population sample analyzed was made up of 243 patients with SCI, with 4 studies [22] [25] [26] [28] having a 1:1 distribution between the IG and the CG. Only 2 randomized controlled trials [27] [29], 1 controlled clinical trial [30], and 1 before-and-after study [32] reported 1 or 4 dropouts in both groups [27] [29] or only in the intervention group [30] [32], with a total of 15 patient dropouts. The mean age of the total population analyzed was 40.25 years for both groups, with a majority of men (78.68%) in the reported population (n=197) in 9 studies (see Table 3).

Table 3 Demographic characteristics of patients included in the studies. 

STUDY SAMPLE/DROPOUT AGE (YEARS)# SEX
AUTHORS IG CG IG CG IG CG
M F M F
D’Addio G, et. al. [22] 15/0 15/0 43±18.7
Dimbwadyo Terrer I, et. al. [23] 16/0 15/0 34.53±13.71 40.27±13.61 10 6 12 3
Dimbwadyo Terrer I, et. al. [24] 6/0 3/0 54.3±9.86 44.17±22.92 5 1 2 1
Gil Agudo A, et. al. [25] 5/0 5/0 36.20±10.41 49±6.11 1 4 3 2
Khurana M, et. al. [26] 15/0 15/0 29.47±7.48 29.8±7.32 14 1 14 1
Lakhani A, et. al. * [27] 10/4 14/4 56.20±20.74 48±16.21 10 0 6 8
Tak S, et. al. [28] 13/0 13/0 49.54±8.25 43.08±11.23 10 3 10 3
Prasad S, et. al. * [29] 12/1 10/1 23.7±5.2 33.9±7.1 11 1 10 0
Sengupta M, et. al. ** [30] 25/4 12/0 28 30.5 17 4 10 2
Sung W, et al. *** [31] 12 NA 28.5 NA 10 2 NA
Villiger M., et. al. */ *** [32] 12/1 NA 60±10.2 NA NA

Note. IG: intervention group; CG: control group; M: male; F: female; ✘: information not provided; NA: not applicable.

*Data before dropout. **Data after dropout. ***No control group. #The values are represented as mean ± standard deviation.

Traumatic injuries were found in 86% of the population analyzed (n=150) by 8 studies [23] [24] [25] [26] [27] [29] [31][32] and only 1 study [30] reported both traumatic and non-traumatic injuries without providing precise data. As to the level of injury, all studies (n=209) but one [22] observed that 50.72% of injuries were located in the cervical spine, 44.97% at the thoracic level, and 4.31% in the lumbar spine. Most studies worked with recently injured patients (< 6 months), and 4 other studies [28] [29] [31] [32] worked with patients who had had their injuries for more than one year.

Most SCI were incomplete (58.37%) in the reported population (n=209), and only 1 study [26] did not report on this. Regarding the level of impairment of all patients (n=167), according to the ASIA scale, most had grade A injuries (47.31%), followed by grade B (23.35%), grade D (15.57%), and grade C (13.77%). Two studies [22] [26] reported, with no details, that they had worked with certain ASIA grades, and one [31] did not address this issue.

The clinical characteristics of each population group nalyzed are presented in Table 4.

Table 4 Clinical characteristics of patients included in the studies. 

STUDY CAUSE OF SCI LEVEL OF SCI ASIA IMPAIRMENT SCALE TYPE OF INJURY TIME AFTER INJURY (MONTHS)Δ
AUTHORS IG CG IG CG IG CG IG CG IG CG
T NT T NT Cx Tx L Cx Tx L A B C D A B C D Co In Co In
D’Addio G, et. al. [22] 0 0 NR 0 0 N R 0 15 0 15
Dimbwadyo Terrer I, et. al. [23] 15 1 14 1 16 0 0 15 0 0 11 5 0 0 10 5 0 0 11 5 10 5 4.31 ±2.06 5.6 ±2.5
Dimbwadyo Terrer I, et. al. [24] 4 2 2 1 1 5 0 0 3 0 5 0 0 1 3 0 0 0 5 1 3 0 5.83 ±2.99 5±1
Gil Agudo A, et. al. [25] 4 1 2 3 5 0 0 5 0 0 3 2 0 0 2 3 0 0 3 2 2 3 4.2 ±0.98 5.8 ±1.17
Khurana M, et. al. [26] 15 0 15 0 0 15 0 0 15 0 NR 0 0 NR 0 0 NR 3 ±0.66 2.67 ±0.72
Lakhani A, et. al.* [27] 9 1 8 6 7 2 1 6 3 5 7 1 2 0 3 0 7 4 7 3 3 11 4.5 ±2.12 4.2 ±2.65
Tak S, et. al. [28] 4 9 0 5 8 0 10 3 0 0 10 3 0 0 10 3 10 3 21.69 ±8.66 22.38 ±9.36
Prasad S, et. al. * [29] 12 0 10 0 12 0 0 10 0 0 1 6 2 3 4 3 2 1 1 11 4 6 15.2 ±11.2 10.2 ±5.7
Sengupta M, et. al. ** [30] NR 7 14 0 4 8 0 6 5 5 5 4 3 3 2 6 15 4 8 < 6
Sung W, et. al. *** [31] 11 1 NA 3 7 2 NA NA 8 4 NA 23.2 NA
Villiger M, et. al. */ *** [32] 8 4 NA 6 5 1 NA 0 0 2 10 NA 0 12 NA 96 NA

Note. IG: intervention group; CG: control group; T: traumatic; NT: no traumatic; Cx: cervical; Tx: thoracic; L: lumbar; Co: complete; In: incomplete; ✘: information not provided; NR: not reported but was mentioned; NA: not applicable.

*Data before dropout. **Data after dropout. ***No control group. ΔThe values are represented as mean ± standard deviation.

Characteristics of virtual reality

The studies used different types of commercial VR technologies, including video game consoles, specialized VR peripherals and systems designed for rehabilitation, as well as devices developed by the research teams (see Table 5.

Table 5 Characteristics of included studies. 

STUDY DESIGN VR INTERVENTIONS FREQUENCY DURATION FOLLOW-UP OUTCOME MEASURES MAIN FINDINGS
D’Addio G, et. al. (2014) Italy [22] Randomized controlled clinical trial, nonblinded. Nintendo Wii Fit + Balance board + Games (“Table Tilt”, “Balance Bubble” and “Deep Breathing”).

IG(n:15): VRT (multidirectional balance and static postural control training) + TRT.

CG(n:15): TRT (balance training with active/passive UL and LL stretching and exercises to increase strength and improve posture).

Total period = 12 weeks.

IG: 3 VRT sessions + TRT for 60 [min] per week.

CG: 3 TRT sessions of 60[min] per week.

BBS (Berg Balance Scale), SCIM (Spinal Cord Independence Measure), COP EO and EC (Posturographic Index: Center of Pressure) and Romberg Index. An improvement in balance control was observed in both IG and CG. However, the improvement was grater in the IG, particularly in balance and self-confidence to perform tasks without external support. The Wii Fit system was potentially acceptable as an adjunct to TRT. Given its low cost and intuitive use, it could be used as a rehabilitation tool at home under supervision.
Dimbwadyo Terrer I, et. al. (2016) Spain [23] Pilot randomized controlled clinical trial, double-blinded. TOyRA wireless system (LCD monitor + inertial sensors Xsens + Virtual environment with 3D interactive objects and personalized avatar.

IG(n:16): VRT (ADL training with dominant UL) + CT.

CG(n:15): CT (OT: ADL training + PT: strengthening exercise and active/passive mobilizations of UL).

Total period = 5 weeks.

IG: 3 VRT sessions of 30 [min] + 5 CT sessions of 90 [min] per week.

CG: 5 CT sessions of 90 [min] per week.

Follow-up (n=22: 11 per group): Only CT 3 months after treatment for both groups.

SCIM III (self-care subscore), MI (Motricity Index), BI (Barthel Index), MB (Muscle Balance), FIM (Functional Independence Measure), QUEST 2.0 (Quebec User Evaluation of Satisfaction with Assistive Technology) and Satisfaction Survey (Likert scale). The effects of an intensive and repetitive VRT + CT compared to those of CT alone produced similar functional changes in the IG and CG in UL performance in patients with complete tetraplegia. A high level of patient satisfaction was observed as a result of the gaming aspects. The TOyRA system as a complement to CT can be useful to increase duration of therapy, as well as engagement and motivation during the rehabilitation process. There were no reports of vertigo, motion sickness or muscle pain.
Dimbwadyo Terrer I, et. al. (2015) Spain [24] Pilot randomized controlled clinical trial, nonblinded. CyberGlove (resistive bend-sensors and vibro-tactile feedback) + LCD Philips monitor (autostereoscopic 3D) + First-person virtual environment with 3D objects

IG(n:6): VRT (reach and release movements with UL in ADL and trunk balance control) + CT.

CG(n:3): CT (OT: ADL training and UL Functional exercises + PT: assisted/active mobilizations of UL and trunk balance exercises).

Total period = 2 weeks.

IG: 2 VRT sessions of 30 [min] + 2 CT sessions of 30 [min] per week.

CG: 2 CT sessions of 30 [min] per week.

MB, BI, SCIM (self-care subscore), NHPT (Nine Hole Peg Test) with JHFT (Jebsen Taylor Hand Function Test) + two implemented parameters: “Repeatability” and “Normalized Trajectory Length”. The results between the groups were similar, although the IG improved in dexterity, coordination and fine finger movement during reaching movements. The results showed the usefulness of VRT in ADLs rehabilitation as a complement to CT. VRT (CyberGlove) based on functional parameters, such as normalized trajectory length and repeatability, adapted the level of difficulty of the tasks to patients’ individual abilities. Prolonged repetitive movements led to functional improvement. There were no reports of vertigo, motion sickness or muscle pain.
Gil Agudo A, et. al. (2011) Spain [25] Randomized controlled clinical trial, nonblinded. TOyRA system.

IG(n:5): VRT (ADL training with UL) + CT.

CG(n:5): CT (OT: ADL training + PT: active-assisted-resistive mobilizations of UL joints).

Total period = 5 weeks.

IG: 15 VRT sessions of 30 [min] on alternated days + 7 OT sessions of 30[min] and 30[min] of PT per week.

CG: 7 OT sessions of 30[min] and 30[min] of PT per week.

ROM (Range of Motion), BI, FIM, SCIM II, NHPT, JTHFT and MI. The use of VRT + CT produced similar results in both groups with tetraplegic patients, although an improvement in UL function was observed in the IG vis-à-vis CT alone, with improved dexterity, pincer grasp, and coordination as well as a slight improved ROM for shoulder flexion-extension and forearm pronation. The TOyRA system can be used as a complementary therapeutic tool with CT.
Khurana M, et. al. (2017) India [26] Randomized controlled clinical trial, double-blinded. Sony PlayStation 2 + Eye Toy + 3 adapted games (“Birds and balls”, “Soccer” and “Snowboard”).

IG(n:15): VRT (sitting balance in ADL with UL and trunk) + CT.

CG(n:15): CT (OT: balance in ADL moving upper body over/outside support base + PT: stretching of LL, mat and range of motion exercises).

Total period = 4 weeks.

IG: 5 VRT sessions of 25 [min] + 5 PT sessions of 20 [min] per week.

CG: 5 OT sessions of 25 [min] + 5 PT sessions of 20 [min] per week.

mFRT (modified Functional Reach Test), t-shirt test and SCIM III (self-care subscore). Game-based (PlayStation 2) VRT + CT improved sitting balance and functional performance in patients with low paraplegia in the IG vis-à-vis CT alone. Increasing the level of difficulty of the activities and making them more intense contributed to motor function recovery by promoting neuroplasticity. Patients’ motivation was not measured, but participants showed interest and enthusiasm for VRT.
Lakhani A, et. al. (2020) Australia [27] Randomized controlled clinical trial, nonblinded. Oculus Go headset + 9 real natural landscapes 360 [º] videos (London's Natural History Museum and National Geographic).

IG(n:10): VRT (videos for psycho-emotional health) + CT

CG(n:14): CT (OT + PT based on each participant’s goals and level of injury + psychological leisure therapy) + VRT.

Total period = 2 weeks.

IG: Week 1: 3 VRT sessions of 20 [min]. Week 2: 7 OT sessions + 20 [min] of PT.

CG: Same as IG but in reversed per week.

PHQ-8 (Patient Health Questionnaire 8) and Feeling Intensity Evaluation (adapted Depression Intensity Scale Circles). VRT (real landscape projection) + CT promoted inpatients’ short-term psycho-emotional health as reflected in high levels of happiness, relaxation and feeling good, even when performed at the hospital. This had a positive impact on patients’ engagement with rehabilitation. VRT can have a favorable impact as a complement to CT. Signs of depression were observed in the IG after VRT, possibly given that they were the first ones to experience it during the first week and not during the second one.
Tak S, et. al. (2015) South Korea [28] Randomized controlled clinical trial, single-blinded. Nintendo Wii + Wiimote + Wii Sports and Wii Sports Resort games with avatar (tennis, ping pong, box, golf, bowling, frisbee, canoeing and swordplay).

IG(n:13): VRT (static and dynamic sitting balance training with UL and trunk) + CT.

CG(n:13): CT (OT: sitting balance training, transfer to toilet and positioning + PT: stretching and strengthening).

Total period = 6 weeks.

IG: 3 VRT sessions of 30 [min] + 5 CT sessions of 90 [min] per week.

CG: 5 CT sessions of 90 [min] per week.

mFRT, t-shirt test and the use of a forceplate for static balance ability, postural sway distance and velocity. Game-based VRT (Nintendo Wii) + CT improved static and dynamic sitting balance for IG. It helped with raising the arms out to the sides and the head, improved balance in SCI, and had a positive effect on sitting postural balance. VRT can be used as a complement to CT both in hospital or home-based programs as it is an accessible system that can arouse patients’ motivation and interest.
Prasad S, et. al. (2018) India [29] Pilot randomized controlled clinical trial, single-blinded. Nintendo Wii + Wiimote + Wii Sports Resort games (ping pong, bowling, cycling and swordplay speed slice).

IG(n:12): VRT (dominant hand movements depending on the game) + CT.

CG(n:10): CT (OT: functional tasks for handling objects + PT: strength training with active or active-assisted movements of the target UL).

Total period = 4 weeks.

IG: 3 VRT sessions of 30 [min] + 3 CT sessions of 30 [min] per week.

CG: 3 CT sessions of 30 [min] per week. Follow-up (IG=11, CG=9): 6 weeks after treatment.

Follow-up (IG=11, CG=9): 6 weeks after treatment.

CUE (Capabilities of Upper Extremity questionnaire), BBT (Box and Block Test), SCIM-SR (selft-report), WHOWOL-BREF (World Health Organization Quality of Life-BREF) and Satisfaction Evaluation based on VAS (Visual Analog Scale). An intensive and repetitive VRT + CT improved UL motor function, similar as did CT alone. However, the IG had higher scores. A high level of satisfaction and adherence to treatment was reported, along with a drive for finding new self-improvement strategies based on game scoring and level of difficulty. VRT (Nintendo Wii) was considered as an adjunct to CT that could be used to develop home-based therapies and increase therapy duration. The improvements achieved were maintained during the follow-up period. No adverse effects were reported.
Sengupta M, et. al. (2020) India [30] Controlled clinical trial, nonrandomized, double-blinded. Rhetoric system (Microsoft Kinect + Rehametrics’ neurological rehabilitation games + monitor).

IG(n:25): VRT (static and dynamic balance control training with UL and trunk, and static gait with LL) + CT.

CG(n:12): CT (based on patient needs and goals).

Total period = 3 weeks.

IG: 5 VRT sessions of 30 [min] with 5 [min] of warm-up per week. CT time was not reported.

CG: Not reported.

BBS, POMA-B (Performance-Oriented Mobility Assessment- Balance) and FRS (Functional Reach Score). The improvements produced were similar in both groups, although the IG achieved a significant improvement in all outcome measures. The completeness of motor injury did not influence the effects of intervention on balance VR training. VRT is an enjoyable adjunct to CT that can be used for rehabilitation of balance control in SCI patients. Virtual objectives promoted full-body reach movements of the joints similar to those of ADLs. Neck and back pain were reported during the initial training sessions.
Sung W, et. al. (2012) Taiwan [31] Before-and-after study, noncontrolled, nonrandomized, nonblinded. Driving simulator (5 virtual driving routes and a single-axis tilting platform) developed by the authors. IG(n:12): VRT (recovery and enhancement of driving skills with UL and LL).

Total period = 6 weeks.

IG: 2 VRT sessions of 30[min] or a bit more per week.

Total driving time, average speed, center-line violation, stop-line violation, collisions, and steering or breaking stability After five VRT sessions, improvements were observed in driving skills. The VR driving simulator had a positive effect on SCI driver training rehabilitation programs as a result of the challenges posed by the simulator’s tilt effect in sitting posture and balance.
Villiger M, et. al. (2017) Switzerland [32] Before-and-after study, noncontrolled, nonrandomized, nonblinded. YouKicker (accelerometers) + 5 virtual environments created with Unity 3D (“Footbag”, “Hamster Splash”, “Get to the Game”, “Star Kick” and “Planet Drive”) + computer monitor. IG(n:12): VRT (balance training and sitting/standing LL mobility with ADL: ankle dorsal flexion, knee extension and leg ad-/abduction).

Total period = 4 weeks.

IG: 16-20 VRT sessions of 30-45 [min] per week. (VRT with supervision by a physical therapist in the first session).

Follow-up (IG=11): 1-2 months after treatment.

LEMS (Lower Extremity Motor Score), BBS, TUG (Timed Up and Go), WISCI II (Walking Index for Spinal Cord Injury), SCIM III, 10m and 6min Walking Test, Motivation Evaluation scored by 11-point NRS (Numeric Rating Scale) and the Patients’ Global Impression of Change (PGIC). Unsupervised home-based VRT improved muscle strength, balance and LL functional mobility promoted by structural brain plasticity due to intensive and repetitive movements. In addition, high levels of motivation were reported for all participants. It was noted that having trained with specific isolated movements, there was an overall motor functional improvement. The system is a useful tool for neurorehabilitation follow-up during or after supervised therapy in home-based training programs reducing cost and time of transportation. The presence of a therapist during VRT may help with motivation. There were no reports of pain or spasticity.

Note. IG: intervention group; CG: control group; VRT: Virtual Reality Therapy; TRT: Traditional Rehabilitation Therapy; OT: Occupational Therapy; PT: Physiotherapy; CT: Conventional Therapy (OT + PT); n: number of patients; ADL: Activities of Daily Living; UL: Upper Limb; LL: Lower Limb; EO: Eyes open; EC: Eyes closed; SCI: Spinal Cord Injury.

Only one study used a commercial, fully-immersive VR system (Oculus Go VR headset) [27], while the other 10 studies used non-immersive VR systems [22] [23] [24] [25] [26] [28] [29] [30] [31] [32]. Four of them [22] [26] [28] [29] were based on Nintendo and Sony commercial consoles, with their video games (mainly sports and recreational) and compatible peripherals that, in few cases, were reported to be adapted for use in rehabilitation of certain impairment grades (for instance, only one mentioned attaching the Wiimote controller to the hand with bandages or a glove in cases of weak grip [29]). Additionally, Rhetoric system [30] only used Microsoft Kinect peripheral. Other studies used motion sensing devices for rehabilitation such as YouKicker (with four wireless accelerometers) [32], TOyRA [23] [25] (based on five wireless inertial sensors), and CyberGlove [24] (with 22 resistive bend sensing technology and vibrotactile stimulators). One study developed a driving simulator [31] using an adapted real car mounted on a one-axle tiltable platform to virtually control acceleration and braking.

Regarding those studies where their VRT used commercial consoles along with their video games, only one [26] explicitly mentioned the adaptation of their virtual environments for rehabilitation purposes without providing further details. On the other hand, those studies where commercial video games were not used as virtual environment, two of them were developed by the research teams [24] [32] and only one specified the use of Unity 3D [32] as graphic engine for its development. In the case of the Rhetoric [30] and TOyRA [23] [25] systems, their games were designed for neurorehabilitation purposes by specialized teams of Rehametrics and INDRA systems companies, respectively. It should be noted that the design of the environments for TOyRA was developed on the basis of therapeutic guidelines for SCI rehabilitation, while for another study [32] it was mentioned that the therapists participated in the design of the clinically virtual exercises. In addition, the fully-immersive VR system [27] relied mainly on the use of pre-recorded videos from National Geographic which were not properly virtual environments and without any possibility of patient interaction. Details on the orientation of the different virtual environments in rehabilitation of balance control, ADL autonomy, motor function, psycho-emotional health and driving skills are included in Table 5.

The VRT was administered using avatars in virtual environments [22] [26] [28] [29], mirroring of movements made through an avatar [23] [25] [30], limb control in a first-person virtual environment [24] [32], activities of daily living (ADL) in virtual everyday spaces [23] [24] [25] [26], projection of pre-recorded 360º real-life natural environments [27] and driving skills training [31]. It should be noted that in the TOyRA system, the avatar could be personalized based on the patient’s anthropomorphic traits which increases the patient’s sense of presence in the virtual environment.

Intervention characteristics

All studies [22] [23] [24] [25] [26] [27] [28] [29] [30] [31] [32] provided information on the baseline assessment carried out prior to the start of VRT. In controlled clinical trials, the IG was treated with a mixed therapy including VRT [22] [23] [24] [25] [26] [27] [28] [29] [30] comprising several VR technologies, along with traditional rehabilitation therapy (TRT) [22] or conventional therapy (CT) [23] [24] [25] [26] [28] [27] [29] [30], based on occupational and/or physical therapy and in certain cases, supported by other treatments [27]. Patients assigned to the CG were administered the same treatment as those in the IG but without the VR component. The before-and-after study protocols only had one group of subjects on which they experimented with VRT independently [31] [32].

Most VRT, TRT, or CT activities focused on balance control [22] [24] [26] [28] [30] [32], ADL autonomy [23] [24] [25], other functional limb movements [29] [32], psycho-emotional health [27], and driving skills [31]. Only 2 studies based their CT on each subject’s goals or needs [27] [30].

It should be highlighted that in 5 studies, VRT aimed at improving upper limb (UL) function [23] [24] [25] [28] [29]; in 1 study, VRT aimed at improving lower limb (LL) [32] function, and in 4 studies, VRT aimed at improving both UL and LL [22] [26] [30] [31] function. Some therapies also included trunk movements [22] [24] [26] [28] [30].

In most cases, VRT was supervised by an occupational therapist [23] [30], a physical therapist [22] [28] [30] [31], or several therapists [26] [32].

The number of VRT sessions varied from 3 to 80, with a frequency between 2 and 20 times per week over a total VRT period of 2 to 12 weeks, mostly with 30-minute sessions. Most of the studies were conducted at specialized centers or hospital departments [23] [24] [25] [27] [28], or rehabilitation centers [22] [26] [29] [30] [31], while only 1 study [32] reported that VRT was administered at the patient’s home and set up by a therapist.

It should be pointed out that in 7 studies [23] [24] [25] [26] [29] [30] [32], the level of difficulty of the virtual games or activities was adjusted (increasing/reducing speed or number of repetitions, changing object appearance, and interaction parameters) depending on the level of progress achieved by patients in the various VRT exercises. It is worth noting that one intervention [31], instead of including gradually increasing levels of difficulty according to the patient’s progress, created a more challenging scenario that brought together all the isolated activities done in previous scenarios. The details of the interventions analyzed are included in Table 5.

Outcome measures

The various scales, indices, or instruments used to evaluate the effects of interventions on UL and LL motor function, balance, functional independence in ADL, and pyscho-emotional health associated with depression are presented in Table 5 according to the VRT applied in each study and where at least two or more combinations were used. Only 3 studies [23] [29] [32] assessed the level of acceptance and motivation using patient satisfaction scales after the intervention.

Other studies came up with new outcome measures, such as the normalized trajectory length to measure movement trajectory precision improvement, and repeatability to measure movement precision improvement [24]. Similarly, kinematic variables [25] or the simulator’s own aspects [31] were used to evaluate the effects of VRT.

Effects of virtual reality therapy

There were 7 controlled clinical trials [23] [24] [25] [26] [27] [28] [30] that did not report significant differences between both intervention groups at baseline, which means that at the start of the studies, patients were in similar functional conditions. The effects of VRT are consolidated in Table 6. From then onwards, VRT was understood as being a mixed or as an individual therapy.

Table 6 VRT effects achieved based on rehabilitation goal. 

STUDY BALANCE CONTROL MOTOR FUNCTION PSYCHOLOGICAL ASPECTS MOTIVATION/ SATISFACTION
D’Addio G, et. al. [22] *
Dimbwadyo Terrer I, et. al. [23]
Dimbwadyo Terrer I, et. al. [24]
Gil Agudo A, et. al. [25] ✔*
Khurana M, et. al. [26] * ✔*
Lakhani A, et. al. [27] *
Tak S, et. al. [28] *
Prasad S, et. al. [29] *
Sengupta M, et. al. [30] *
Sung W, et. al. [31] *
Villiger M, et. al. [32] * *

Note. ✔: at least one relevant effect; ✘: no relevant effect achieved. *statistically significant (p< 0.05).

Only 9 papers reported a statistically significant difference in VRT (p<0.05) in balance control [22] [26] [28] [30] [32], motor function [25] [26] [29] [31] [32], and psychological aspects [27]. Furthermore, 3 studies assessed the effect size of the interventions, which was found to be between medium and large, with Cohen’s d values between 0.41 and 0.84, and an η2 between 0.21 and 0.95 [23] [26] [27]. Similarly, the level of satisfaction [23] [29] and motivation [32] were assessed, and one study [26] subjectively observed a high level of interest and enthusiasm in patients during VRT.

Side effects of virtual reality

There were no adverse or side effects reported, such as motion sickness, vertigo, muscle pain, or spasticity [23] [24] [29] [30] [32]. Only one study [27] reported significant signs of depression in its IG immediately after VRT. Another study [29] reported difficulty in holding the Wii-mote controller due to weak grip in seven patients, and another one mentioned [30] that during the intervention there were some cases of back pain and orthostatic hypotension that were controlled and subsided with medication, allowing the therapy to continue as they were not deemed serious side effects.

Limitation of the studies

Some of the controlled clinical trials indicated that their design did not include any type of blinding [22] [24] [25] [27], concealed allocation [22] [24] [25] [30], or even randomization [30]. In the before-and-after studies [31] [32], it was clear that there was no blinding as they did not include a CG in their design, which implied certain bias in the results.

Regarding subjects and protocols, it was not possible to generalize results given the limitations observed, such as small sample size [23] [24] [25] [28] [29] [30] [32], with particular SCI characteristics [23] [26] [28] [29] [32] and very few variations in demographic data [27], as well as the fact of having single selection sources [26].

As far as interventions are concerned, the identified limitations included: the short duration of intervention [23] [24] [27] [29] [31]; most studies did not follow-up on the results, except for 3 of them [23] [29] [32]; only 1 study explicitly recognized having included a small set of virtual exercises as a limitation [30]; the weight of any other health condition that could have influenced the results was not considered [27]; and the diversity of interventions did not make it possible to set guidelines on intensity, dosage, and duration of VRT [30].

As to the limitations derived from the VR technology, the need to have more sophisticated and modern software (commercial or especially designed games) and hardware (consoles, controllers, headsets, sensors, graphic cards) was identified for VRT to be more effective [26] [30]. The Wii Fit system especially stood out, because as it is a black box system, it was not possible to monitor several game parameters included in the VRT, thus limiting its contribution to improving balance control [22].

Three studies pointed out limitations in terms of interaction with VR devices, which could have affected the obtained results. Such was the case with the Nintendo Wii console [28] [29], where the patient required some prior training before using it.

Patients with acute SCI could not use it because they could not maintain balance, hold the controller, or even generate motion, especially in the case of higher cervical injuries. The third study identified predefined VR scenarios (360º recordings) as a limitation since patients could not interact with them [27].

Future development

Based on the above-mentioned limitations, the subjects’ profiles, and the intervention protocol, a suggestion was made to use a broader patient sample [23] [24] [25] [26] [27] [29] [30] [31] [32], with different SCI characteristics than the ones included in the studies [26] [29] [31] [32], involving several recruitment sites [30], and including more VRT sessions [23] [24] to better identify VRT benefits, the system’s critical characteristics, and the virtual exercises that achieved better results [24].

The before-and-after studies [31] [32] along with one controlled clinical trial [30] proposed to carry out future interventions based on a blinded, randomized, controlled clinical trial with long-term follow-up design [30] [31] [32] to reduce the risk of bias and monitor the sustainability of the intervention by means of a longitudinal study to validate the level of skill improvement achieved [31].

Regarding types of VR devices, a proposal was made to conduct studies that combine VRT (such as TOyRA) with robotic devices (Amadeo) for telerehabilitation based on VR motion capture systems [25] and develop new VR devices for rehabilitation with a focus on ADL or relevant exercises/skills designed to simulate more realistic situations with higher levels of difficulty according to different SCI levels [31].

For interventions that used mixed VRT [22] [24] [29] [30], a proposal was raised to conduct new studies to assess the impact of VRT individually, compare the results of home-based therapies with those achieved at the clinic [32], and develop methods to exercise systematized balance control with a focus on SCI level and sitting balance control [28].

Main findings, quality of evidence and potential application

This SR included a total sample of 243 subjects from the 11 papers analyzed, out of which 155 experimented with VRT (63.78%). There was a similar number of paraplegic (69) and tetraplegic (67) patients, and 14 patients did not complete the intervention. Patients treated with VRT mostly had ASIA grade A/B impairment (42.20% and 20.18%), followed by ASIA grades C/D (16.51% and 21.10%), with an absence of motor function and little or no sensory perception below the neurological level of injury, with a major focus on UL.

Three types of studies were taken into consideration: randomized controlled clinical trials [22] [23] [24] [25] [26] [27] [28] [29], one non-randomized controlled clinical trial [30], and before-and-after studies [31] [32]. Over half of the studies [23] [26] [28] [29] [30] [31] [32] had a good or excellent level of evidence with low risk of bias and achieved statistically significant results [26] [28] [29] [30] [31] [32] with regard to VRT.

The controlled clinical trials exhibited an adequate level of evidence given that they were mostly randomized [22] [23] [24] [25] [26] [27] [28] [29], with 6 of them having an adequate sample size [22] [23] [26] [27] [28] [29]. Seven [23] [24] [25] [26] [27] [28] [30] did not show any confounding bias upon observing a similar baseline functional condition among patients. Regarding blinding, half of them did not describe any blinding method [22] [24] [25] [27], while the remaining half that reported having used a double-blind [23] [26] or single-blind [28] [29] method reduced their detection bias upon including blinded assessors.

Given their methodological limitations, the beforeand-after studies and the controlled clinical trials had to be considered with caution as they had a certain selection bias for not presenting any randomization method [30] or control groups [31] [32], which could have affected the VRT evidence obtained.

Most trials aimed at a non-immersive use [22] [23] [24] [25] [26] [28] [29] [30] [31] [32] of VR, and only 1 was fully-immersive [27]. All of them showed a statistically significant improvement with VRT (p<0.05) in balance control [22] [26] [28] [30] [32], motor function [25] [26] [29] [31] [32], and psychological aspects [27]. The effect size of the interventions [23] [26] [27] was determined to be between medium and large.

Regarding the type of VRT, although in some controlled clinical trials [23] [24] [25] [29] [30] no statistically significant differences were observed between the VRT + CT intervention compared to the CT, significant improvements were found in the IG in different functional parameters (Table 6. Additionally, in the remaining 4 trials [22] [26] [27] [28], statistically significant differences were observed in the IG that were reflected in a greater improvement compared to the CG. The sum of both results suggests that VRT can be an important adjunct/complementary instrument for CT when considering the benefits derived from the different protocols, particularly in terms of balance control, motor function, and patients’ moods.

Moreover, even though the evidence was methodologically limited, it could be added that the beforeand-after studies [31] [32] also showed positive effects of VRT when applied individually to improve LL motor function and driving skills, which speaks to the convenience of using VRT along with CT.

Furthermore, the findings [23] [25] [29] [32] suggest considering VRT as a complement to CT that can be used at home and not just in a hospital setting to extend the time of therapy sessions and to monitor and/or maintain the results achieved after rehabilitation. In this regard, the need for future studies to compare the effects of VRT in both settings was highlighted.

Comparatively, 4 controlled clinical trials [22] [24] [29] [30] underlined that it was not possible to visualize the effect of VRT separately, because it was applied together with CT. Thus, a proposal was made to conduct studies with the same methodological quality focused on interventions centered on VRT alone, with a broader and more diverse sample of SCI patients.

Efficacy of virtual reality therapy

Most studies showed a good level of evidence for the use of VR technology applied to the rehabilitation of SCI patients based on a detailed description of its application, movements made, and patient interaction with the virtual environment. There was only one exception, where information was inferred from the system used [29].

Non-immersive VR was the most commonly implemented type of VR based on games with a scoring system and a set duration, whose level of difficulty was determined based on the progress recorded [22] [23] [25] [26] [28] [29] [30] [32].

Other study [32] mentioned that the type of VR used was augmented reality, which would require virtual objects to be projected onto real world surfaces. However, when the VR technological description was analyzed, it was clear that they had used a non-immersive system that displayed the virtual environment and objects on a screen.

It was interesting to see how fully-immersive VR technology [27] used to study patients’ moods only focused on projecting videos of real landscapes without any means of interaction with the virtual environment, given the technological capabilities of the device. Although an improvement was achieved in patients' psycho-emotional health, it will be necessary to gather more evidence on the effects of fully-immersive technology on VRT, related with physiotherapy and occupational therapy exercises, to analyze and determine the impact of this type of VR on the rehabilitation of SCI patients. Despite the technological differences inherent to each VR technology, such as the degree of immersivity and sensorimotor interaction, previous literature has shown different benefits of the use of the full-immersive VR and some of them points that full-immersive VR outperforms non-immersive [33] [34] [35].

Although all the interventions applied different immersive and non-immersive VR, some significant benefits were identified that can be generalized as follows: VR stimulated a wide set of functional movements similar to those of the real world; it promoted independence and self-confidence; it improved psycho- emotional health; it increased patient motivation and engagement with the rehabilitation process; and it promoted VRT with no side effects. Such evidence made it possible to confirm the potential use of VR technology as an effective tool for rehabilitation of SCI patients.

The efficacy of VR was confirmed based on a number of indicators reported by the studies. Firstly, there was positive feedback (visual and auditory) about therapeutic sessions designed around games that included a scoring system to help patients come up with new self-improvement strategies within certain timeframes and levels of difficulty established by the devices and/or adjusted by therapists, which made it possible to follow-up on the progress made.

In this regard, it was observed that the level of difficulty in each round prompted patients to make specific movements in an intensive and repetitive manner, which stimulated the subsequent recovery of motor function as a result of triggering neuroplasticity mostly in the motor cortex of the brain [23] [24] [26] [28] [29] [32].

Secondly, real-time visual feedback was another indicator of efficacy of VR environments for motor function recovery [26] [28] [29]; that is, there was visual feedback of the patient’s proper movement execution within the game’s virtual environment with the use of an avatar through activation of certain areas of the motor cortex, leading to improved recovery [32]. There was also activation of the mirror neuron system and motor cortex of the brain by enabling recovery in spatial orientation and balance [30]. Furthermore, visualizing the patient’s movements in real-time made by the avatar through mirror vision produced a feeling of control and realism with a similar positive effect on motor function [23].

Thirdly, given the importance of patients’ motivation as an indicator of efficacy, it is interesting to see that this factor was assessed only by 3 studies [23] [29] [32], with high levels of satisfaction and motivation achieved during VRT. However, even when such an evaluation was not considered, another study [26] indicated that patients showed a high level of interest and enthusiasm towards VRT, and another one [30] observed that patients were open to develop new self-improvement strategies as a result of their experience with VRT. In summary, given the limited evidence on the level of patient acceptance of VRT, it is suggested that future research should include instruments to evaluate this aspect as well.

The findings from the above-mentioned evaluations showed that patients’ satisfaction and motivation with VRT promoted a higher level of commitment, adherence, active engagement, and dedication to the rehabilitation process. Personal motivation due to VR was promoted by feelings of increased curiosity, self-confidence, self-driven exploration, and imagination which led to a greater enjoyment of the CT in addition to functional improvements [23] [29] [32]. Moreover, social motivation that led to the development of self-improvement and self-esteem were promoted through competition as a result of the social interaction of patients based on the level of difficulty and scoring of VR games [23] [29].

As it was confirmed in other studies [33] [34] [36], these key elements are not induced by CT, which limits their level of effectiveness by showing low level of attendance and adherence to the training exercises, thus limiting the level of intensity necessary to achieve patient recovery.

This increase in motivation may be related to the influence of the video games used in VRT with a scoring and reward system (positive feedback) [29] [34], and that it decreases the perception of effort [37], which boost active patient participation and therefore increases adherence and commitment to the rehabilitation therapy.

In addition, some studies [35] [38] have confirmed that VRT promotes a deep motivation in patients, which improves their subjective initiative and commitment to actively complete various rehabilitation exercises, thus creating a virtuous circle that improves their functional recovery.

Some studies included in the SR underlined that the VRT was the most effective tool for improving neuroplasticity and subsequent recovery of motor function in SCI patients through intense and repetitive task-oriented practice by increasing exercise therapy time expressed as time dedicated to practice (dosage) compared to CT [36] [38], which may enhance functional recovery [23] [26] [29] [30] [32] [34]. However, it is important to point out that other studies report that the evidence of neuroplasticity as a result of training in VR is currently modest and more research it is needed [38]. Also, it should be noted that the relation between dosage and achieving functional recovery is currently an unsolved issue in rehabilitation studies [30] [32] [36], where the need for further evidence is highlighted.

There is some additional evidence resulting from the authors’ perceptions during the interventions. For instance, when patients immersed themselves in VRT game activities, they forgot about certain fears that could have affected their performance vis-à-vis the objectives of the CT activities [26]. The projected images had a positive impact on the patients’ moods and reduced the perception of pain from the SCI [27], which reaffirmed the convenience of using VRT in conjunction with CT [28] [30].

The importance of the familiarization process between the patient and the VR technology is a key element to achieve the objectives of the rehabilitation programs as it allows the patients to be engaged with the VRT and to perform the training exercises in a more effective way, thus promoting their active participation and motivation. In this regard, some studies have highlighted [26] [28] [33] [37] the limitations of commercial VR systems to fit the needs of SCI patients, since these are designed to be used by people without motor or cognitive impairments. Additionally, previous studies [34] [38] [39] have confirmed the importance of patients perceiving a greater immersion in the virtual environment rather than in the real world, which is related to the software and hardware characteristics.

Therefore, it is necessary that research teams seek to adapt existing devices to provide better grip and manipulation of the peripherals of VR systems [29] [33], or still better to design new devices that allow an improved handling and capture of the movements made by patients according to their motor and cognitive skills, along with an appropriate calibration according to their neurological conditions [29], which will increasing their interaction with the virtual environment, thus a better immersive experience.

On the other hand, another important element that allows patient familiarization is the sense of presence, which is related to the patients' subjective experience of feeling inside the virtual environment and is able to active brain mechanisms underlying sensorimotor integration as well cerebral networks regulating focused attention promoting patients to perform rehabilitation programs and patients’ movement recovery [34] [37]. Since this also depends on the characteristics of the VR system itself [37], it is important that the games are able to imitate both in execution and visually the task-oriented activities and the virtual scenario, as well as to increase the sensory feedback through the peripherals, which allows a higher level of realism when interacting with 3D objects in real-time, for instance the realistic haptic feedback achieved by the CyberGlove compared to the simple feedback offered by most commercial consoles [24] [33]. In addition, as already pointed out by some studies included in this review, the patient's embodiment in the virtual avatar, either in one part (first person) or the whole body (third person), has a key role in developing a sense of presence in the virtual environment, as it allows the sensation that the actions performed belong to the patient [34]. In this sense the non-commercial devices achieved better results, especially TOyRA system [23] [25] by achieving an avatar based on the patients’ anthropometric data.

In addition, it would be important to include induction training programs [30] [32] that make it possible to be familiar with the VR system and interact with greater confidence within the virtual environment. Therefore, all the elements that allow familiarization increase the acceptance of the system by the patient as he/she feels that real world movements are performed within the virtual environment, which allows to obtain adequate functional improvements by providing a better transfer of skills to the real world and open the possibility of continuing rehabilitation programs at home [23] [33].

Fourthly, another efficacy indicator was the ability to gradually reduce the help required from the therapist as therapy progressed, leading to more patient independence to choose the VRT activities designed in accordance with the rehabilitation goals [23] [29]. Nevertheless, some authors reported that VRT had been more effective with the help of a therapist [32].

Fifthly, potential home-based rehabilitation and telerehabilitation were other key efficacy indicators of the use of VR technology based on commercial consoles and other devices. Having more intuitive, smaller sized, home-based systems could possibly increase the amount of time devoted to rehabilitation following therapy administered at the hospital or rehabilitation center. In this context, it should be stressed [23] that patients stated their interest in using the virtual system at home and would suggest its use to other patients with the aim of potentially creating an online gaming network to promote more socializing among patients and to extend therapy time.

Moreover, home-based VR rehabilitation could have a positive impact on reducing costs, time, effort, and travel of patients to the clinics, with systems being adapted to patients’ needs, particularly those with a high SCI level [29] [32]. Based on the aforesaid, it would be necessary to have data capture systems imbedded in the consoles or in future rehabilitation dedicated devices that are capable of sending information of the activities performed at home to the therapist for analysis [25] [32].

It is important to emphasize that some features of the VR devices posed some potential limitations to the efficacy of VRT, for instance: the virtual environment used by the TOyRA system did not represent execution of ADL in a realistic fashion [23]; the commercial consoles or peripherals used in the interventions were relatively obsolete given the ongoing technological advances seeking to make VR more efficient and easy to use in rehabilitation; and the consoles or peripherals could not be easily modified (black box), thus preventing adaptation to patients’ functional needs [22] [26] [28] [29] [30].

It should be noted that only one paper reported having used a graphic engine (Unity 3D) [32], given its relevance to the creation of virtual environments and the effect of VR on rehabilitation. Using a graphic engine implied a significant investment in terms of time and practice in order to create an appealing virtual environment where the patient can properly interact. Therapists collaborated on this design effort [23] [25] [32].

Finally, this SR identified some evidence of the impact of VRT in other neurological disorders, which confirms some of the findings for SCI, since the impaired motor function is one of its common consequences. For instance, some reviews have been identified concerning the use of VR technology applied to Stroke [38] [39] [40] [41], Parkinson’s Disease [35] [42] [43], Multiple Sclerosis [37] [44], Cerebral Palsy [45] and Traumatic Brain Injury [46], which have reported positive effects of VRT improving balance control [35] [40] [42] [43] [44] [45] [46], UL or LL motor function [37] [38] [39] [40] [41] [45], gait [35] [40] [42] [43] [44] [46] and cognitive function [37] [42] [46]. A systematic review [47] showed positive impacts in the treatment of phantom limb pain due to a greater immersive experience based on the use of the mirror therapy which induces the perception that the amputated limb is performing the tasks. However, the authors are inconclusive regarding the efficacy of VR and Augmented Reality therapy and continues to need further research with higher quality evidence.

As is the case of the interventions with SCI patients, the role of VR as rehabilitation tool in these neurological disorders is still under discussion, although some studies reported positive results when VR was used as a complementary therapy which improved ADL performance and quality of life. These studies provided evidence points toward the advantages of increased motivation, confidence, engagement, and increase the intensity of movement based in repetitive and task-oriented with multisensory feedback which is needed for promoting neuroplasticity [35] [37] [39] [40] [43] [45] [46].

These results align with the main findings on the use of TRV in patients with SCI and for future development could be important to follow research on how the VR devices had been designed to these pathologies, including the greater use of VR full immersive and multisensory feedback [33].

In this regard, an interesting feature showed in a study applied to Stroke [40] was the introduction of a specific type of rehabilitation visual feedback named “virtual teacher”, which can be displayed during every task repetition and that shows the correct execution movement of the training exercise so that the patient can imitate it allowing real-time visual comparison between a patient’s execution and the virtual teacher’s execution of a movement. The incorporation of this characteristic into the VR systems for SCI could improve the motor performance quality promoting motor adaptation via supervised learning mechanism.

Limitations and future work of the systematic review

One of the main limitations was not having a larger number of papers providing evidence on the use of augmented reality and fully-immersive VR technology as a rehabilitation tool.

Patient sample heterogeneity as well as the application of different types of VR technology and VRT protocols made it impossible to generalize the results and applied therapies, and since this SR was guided by the Cochrane recommendations [14], it was deemed advisable not to do a meta-analysis.

Moreover, no controlled clinical trials were found to focus on the use of VRT individually in the IG compared only with the CT. This could be based on the fact that there is not much research on this, and it was not possible to access a more specialized, fee-based database.

The authors of this SR consider it necessary to update this SR in the future to largely include blinded, randomized, controlled clinical trials with long-term follow-up to reduce the risk of bias and follow-up on the sustained effects of the intervention.

CONCLUSIONS

Given the evidence obtained from the papers included in the review, this SR concludes that non-immersive VR technology is an effective tool for use in neurorehabilitation as a complement to CT. It has positive effects by promoting motivation, self-confidence, commitment, and active engagement of patients, leading to improvements in motor function, and balance control, both in a clinical setting and at home, and it also increases rehabilitation time. No side effects were observed throughout the interventions.

Positive effects of VRT were identified when it was applied alone, although more evidence is needed to determine its contribution. Furthermore, there were psycho-emotional benefits reported with a decrease in depression in SCI patients when fully-immersive VR was used, although more research is needed to conclude its level of efficacy as a complementary tool to CT.

However, the high cost and the complexity of the new VR technology is a key limitation to extend the use for rehabilitation which may explain why the therapy based on video games consoles and non-immersion VR systems are playing an important role in rehabilitation programs even considering that these devices are not suitable to the needs of the SCI patients.

This SR suggest further development of VR systems customized to the motor and cognitive skills of SCI patients that achieves increased immersion with a higher level of realism of the rehabilitation activities, multisensory stimuli, and patient interaction, while trying to keep low-cost in order to increase accessibility.

REFERENCES

[1] World Health Organization. International perspectives on spinal cord injury [Internet]. Geneva: WHO; 2013. Available from: https://www.who.int/disabilities/policies/spinal_cord_injury/en/Links ]

[2] Latham R. Lesión de la médula espinal: Esperanza en la investigación [Internet]. Bethesda: National Institute of Neurological Disorders and Stroke; 2005. Spanish. Available from: https://espanol.ninds.nih.gov/trastornos/lesion_de_la_medula_espinal.htm#:~:text=Las%20personas%20con%20lesiones%20de%20la%20m%C3%A9dula%20espinal%20tienen%20un,anticoagulante%20como%20medida%20de%20 prevenci%C3%B3nLinks ]

[3] Tortora GJ, Derrickson B. Principles of Anatomy and Physiology. 13th edition. Hoboken (NJ): J. Wiley & Sons; 2012. [ Links ]

[4] Strassburguer-Lona K, Hernández-Porras Y, Barquín Santos E. Lesión Medular: guía para el manejo del paciente con LM crónica [Internet]. Madrid: Aspayam-Madrid; 2013. Spanish. Available from: https://www.codem.es/guias/lesion-medular-guia-para-manejointegral-del-paciente-con-lm-cronicaLinks ]

[5] Northwestern Medicine. Spinal Cord Injury [Internet] Chicago: Northwestern Medicine; 2020. Available from: https://www.nm.org/conditions-and-care-areas/orthopaedics/acute-spinal-cord-injuryLinks ]

[6] Huete-García A, Díaz-Velázquez E. Análisis sobre la lesión medular en España [Internet]. Madrid: Aspaym; 2012. Available from: http://riberdis.cedd.net/handle/11181/5510Links ]

[7] National Institute of Child Health and Human Development. How is SCI diagnosed? [Internet]. Bethesda: NICHD; 2016. Available from: https://www.nichd.nih.gov/health/topics/spinalinjury/conditioninfo/diagnosedLinks ]

[8] Pérez-Estudillo CA, Sánchez-Alonso D, López-Meraz ML, MorgadoValle C, et. al. Aplicaciones terapéuticas para la lesión de médula espinal. Eneurobiología. 2018; 9(21):141118. Spanish. [ Links ]

[9] Navarrete JM. La realidad virtual como arma terapéutica en rehabilitación. Rehabil Integral. 2010;5(1):40-45. Spanish. [ Links ]

[10] Navarro Araujo GMK. Realidad virtual en la terapia física [dissertation]. [Lima]: Universidad Inca Garcilaso de la Vega; 2017. Spanish. [ Links ]

[11] Urrútia G, Bonfill X. PRISMA declaration: A proposal to improve the publication of systematic reviews and meta-analyses. Med Clin [Internet]. 2010; 135(11):507-511. Available from: https://doi.org/10.1016/j.medcli.2010.01.015 [ Links ]

[12] Moher D, Liberati A, Tetzlaff J, et al. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med [Internet]. 2009; 6(7):e1000097. Available from: https://doi.org/10.1371/journal.pmed.1000097 [ Links ]

[13] Liberati A, Altman DG, Tetzlaff J, Mulrow C, et. al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ [Internet]. 2009;339:b2700. Available from: https://doi.org/10.1136/bmj.b2700 [ Links ]

[14] Centro Cochrane Iberoamericano. Manual Cochrane de Revisiones Sistemáticas de Intervenciones, versión 5.1.0 [Internet]. Barcelona: Centro Cochrane Iberoamericano; 2012. Available from: http://www.cochrane.es/?q=es/node/269Links ]

[15] Silvera Iturrioz C. Algunas orientaciones prácticas para la búsqueda de información en LILACS y PUBMED [Internet]. Montevideo: e-prints in library & information science; 2013. Available from: http://eprints.rclis.org/24012Links ]

[16] Clarivate Analytics. Web of Science Core Collection Help [Internet]. Web of Knowledge; 2020. Available from: https://images.webofknowledge.com/WOKRS533JR18/help/WOS/hp_database.htmlLinks ]

[17] National Center for Biotechnology Information. PubMed User Guide [Internet]. NCBI; 2020. Available from: https://pubmed.ncbi.nlm.nih.gov/helpLinks ]

[18] BIREME. Tutorial de búsqueda LILACS [Internet]. BIREME; 2019. Available from: https://wiki.bireme.org/es/index.php/Tutorial_de_b%C3%BAsqueda_LILACSLinks ]

[19] Zurita-Cruz JN, Márquez-González H, Miranda-Novales G, Villasís-Keever MA. Estudios experimentales: diseños de investigación para la evaluación de intervenciones en la clínica. Rev Alerg Mex [Internet]. 2018;65(2):178-186. Spanish. Available from: https://doi.org/10.29262/ram.v65i2.376 [ Links ]

[20] PEDro. PEDro scale [Internet]. Physiotherapy Evidence Database; 1999. Available from: https://pedro.org.au/english/resources/pedroscaleLinks ]

[21] National Institute of Health. Study Quality Assessment Tools [Internet]. NIH. Available from: https://www.nhlbi.nih.gov/healthtopics/study-quality-assessment-toolsLinks ]

[22] D'Addio G, Iuppariello L, Gallo F, Bifulco P, et al. Comparison between clinical and instrumental assessing using Wii Fit System on balance control. 2014 IEEE International Symposium on Medical Measurements and Applications (MeMeA) IEEE MeMeA [Internet]. Lisboa: IEEE: 2014:1-5. Available from: https://doi.org/10.1109/MeMeA.2014.6860124 [ Links ]

[23] Dimbwadyo-Terrer I, Gil-Agudo A, Segura-Fragoso A, de los ReyesGuzmán A, et. al. Effectiveness of the Virtual Reality System Toyra on Upper Limb Function in People with Tetraplegia: A pilot Randomized Clinical Trial. Biomed Res Int [Internet]. 2016;2016(6):6397828. Available from: https://doi.org/10.1155/2016/6397828 [ Links ]

[24] Dimbwadyo-Terrer I , Trincado-Alonso F, de los Reyes-Guzmán A, Aznar MA, et. al. Upper limb rehabilitation after spinal cord injury: a treatment based on a data glove and an immersive virtual reality environment. Disabil Rehabil Assist Technol [Internet]. 2016;11(6):462-467. Available from: https://doi.org/10.3109/17483107.2015.1027293 [ Links ]

[25] Gil-Agudo A , Dimbwadyo-Terrer I , Peñasco-Martin B, de los ReyesGuzmán A , et al. Experiencia clínica de la aplicación del sistema de realidad TOyRA en la neuro-rehabilitación de pacientes con lesión medular. Rehabilitación [Internet]. 2012;46(1):41-48. Spanish. Available from: https://doi.org/10.1016/j.rh.2011.10.005 [ Links ]

[26] Khurana M, Walia S, Noohu M. Study on the Effectiveness of Virtual Reality Game-Based Training on Balance and Functional Performance in Individuals with Paraplegia. Top Spinal Cord Inj Rehabil [Internet]. 2017;23(3):263-270. Available from: https://doi.org/10.1310/sci16-00003 [ Links ]

[27] Lakhani A, Martin K, Gray L, Mallison J, et. al. What is the impact of engaging with natural environments delivered via virtual reality on the psycho-emotional health of people with spinal cord injury receiving rehabilitation in hospital? Findings from a pilot randomized controlled trial. Arch Phys Med Rehabil [Internet]. 2020;101(9):1532-1540. Available from: https://doi.org/10.1016/j.apmr.2020.05.013 [ Links ]

[28] Tak S, Choi W, Lee S. Game-Based Virtual Reality Training Improves Sitting Balance after Spinal Cord Injury: A Single-Blinded, Randomized Controlled Trial. J Med Sci Technol [Internet]. 2015;56:53-59. Available from: https://doi.org/10.12659/MST.894514 [ Links ]

[29] Prasad S, Aikat R, Labani S, Khanna N. Efficacy of Virtual Reality in Upper Limb Rehabilitation in Patients with Spinal Cord Injury: A Pilot Randomized Controlled Trial. Asian Spine J [Internet]. 2018;12(5):927-934. Available from: https://doi.org/10.31616/asj.2018.12.5.927 [ Links ]

[30] Sengupta M, Gupta A, Khanna M, Krishnan UKR, et al. Role of Virtual Reality in Balance Training in Patients with Spinal Cord Injury: A Prospective Comparative Pre-Post Study. Asian Spine J [Internet]. 2019;14(1):51-58. Available from: https://doi.org/10.31616/asj.2019.0013 [ Links ]

[31] Wen-Hsu S, Ting-Ying C, Wen-Wei T, Cheng H, Jin-Jong C. The effect of virtual reality-enhanced driving protocol in patients following spinal cord injury. J Chin Med Assoc [Internet]. 2012;75(11):600-605. Available from: https://doi.org/10.1016/j.jcma.2012.08.004 [ Links ]

[32] Villiger M, Liviero J, Awai L, Stoop R, et. al. Home-Based Virtual Reality-Augmented Training Improves Lower Limb Muscle Strength, Balance, and Functional Mobility following Chronic Incomplete Spinal Cord Injury. Front Neurol [Internet]. 2017;8 :635. Available from: https://doi.org/10.3389/fneur.2017.00635 [ Links ]

[33] Massetti T, Dias-da-Silva T, Brusque Crocetta T, Guarnieri R, et. al. The Clinical Utility of Virtual Reality in Neurorehabilitation: A Systematic Review. J Cent Nerv Syst Dis [Internet]. 2018;10:1-18. Available from: https://doi.org/10.1177/1179573518813541 [ Links ]

[34] Tieri G, Morone G, Paolucci S, Iosa M. Virtual reality in cognitive and motor rehabilitation: facts, fiction and fallacies. Expert Rev Med Devices [Internet]. 2018; 15(2):107-117. Available from: https://doi.org/10.1080/17434440.2018.1425613 [ Links ]

[35] Cheng L, Kejimu S, Fengling D, Xiaoqin L, et. al. Effects of virtual reality rehabilitation training on gait and balance in patients with Parkinson’s disease: A systematic review. PLoS One [Internet]. 2019; 14(11):e0224819. Available from: https://doi.org/10.1371/journal.pone.0224819 [ Links ]

[36] Kwakkel G. Impact of intensity of practice after stroke: Issues for consideration. Disabil Rehabil. 2006;28(13-14):823-830. Available from: https://doi.org/10.1080/09638280500534861 [ Links ]

[37] Grazia Maggio M, Russo M, Foti Cuzzola M, Destro M, et. al. Virtual reality in multiple sclerosis rehabilitation: A review on cognitive and motor outcomes. J Clin Neurosci [Internet]. 2019;65:106-111. Available from: https://doi.org/10.1016/j.jocn.2019.03.017 [ Links ]

[38] Laver KE, Lange B, George S, Deutsch JE, et. al. Virtual Reality for stroke rehabilitation (Review). Cochrane Database Syst Rev [Internet]. 2017;11(11):CD008349. Available from: https://doi.org/10.1002/14651858.CD008349.pub4 [ Links ]

[39] Sin HH, Lee GC. Additional virtual reality training using Xbox Kinect in stroke survivors with hemiplegia. Am J Phys Med Rehabil [Internet]. 2013;92(10):871-880. Available from: https://doi.org/10.1097/PHM.0b013e3182a38e40 [ Links ]

[40] Kiper P, Luque-Moreno C, Pernice S, Maistrello L, et. al. Functional changes in the lower extremity after non-immersive virtual reality and physiotherapy following stroke. J Rehabil Med [Internet]. 2020;52(11):jrm00122. Available from: https://doi.org/10.2340/16501977-2763 [ Links ]

[41] Norouzi-Gheidari N, Hernandez A, Archambault PS, Higgins J, et. al. Feasibility, Safety and Efficacy of a Virtual Reality Exergame System to Supplement Upper Extremity Rehabilitation Post-Stroke: A Pilot Randomized Clinical Trial and Proof of Principle. Int J Environ Res Public Health [Internet]. 2019;17(1):113. Available from: https://doi.org/10.3390/ijerph17010113 [ Links ]

[42] Triegaardt J, Han TS, Sada C, Sharma S, et. al. The role of virtual reality on outcomes in rehabilitation of Parkinson’s disease: metaanalysis and systematic review in 1031 participants. Neurol Sci. [Internet]. 2020;41(3):529-536. Available from: https://doi.org/10.1007/s10072-019-04144-3 [ Links ]

[43] Feng H, Li C, Liu J, Wang L, et. al. Virtual Reality Rehabilitation Versus Conventional Physical Therapy for Improving Balance and Gait in Parkinson’s Disease Patients: A Randomized Controlled Trial. Med Sci Monit [Internet]. 2019;25:4186-4192. Available from: https://doi.org/10.12659/MSM.916455 [ Links ]

[44] Casuso-Holgado MJ, Martín-Valero R, Carazo AF, Medrano-Sánchez EM, et. al. Effectiveness of virtual reality training for balance and gait rehabilitation in people with multiple sclerosis: a systematic review and meta-analysis. Clin Rehabil [Internet]. 2018;32(9):1220-1234. Available from: https://doi.org/10.1177/0269215518768084 [ Links ]

[45] Ravi DK, Kumar N, Singhi P. Effectiveness of virtual reality rehabilitation for children and adolescents with cerebral palsy: an updated evidence-based systematic review. Physiotherapy [Internet]. 2017;103(3):245-258. Available from: https://doi.org/10.1016/j.physio.2016.08.004 [ Links ]

[46] Aida J, Chau B, Dunn J. Immersive virtual reality in traumatic brain injury rehabilitation: A literature review. NeuroRehabilitation [Internet]. 2018;42(4):441-448. Available from: https://doi.org/10.3233/NRE-172361 [ Links ]

[47] Dunn J, Yeo E, Moghaddampour P, et. al. Virtual and augmented reality in the treatment of phantom limb pain: A literature review. NeuroRehabilitation [Internet]. 2017;40(4):595-601. Available from: https://doi.org/10.3233/NRE-171447 [ Links ]

Received: December 21, 2020; Accepted: March 25, 2021

Corresponding author TO: Bruno Alejandro Orsatti Sánchez. INSTITUTION: Universidad Nacional Autónoma de México, División de Ingeniería Mecánica e Industrial. ADDRESS: Circuito Exterior S/N, Col. Ciudad Universitaria, C. P. 04510, Coyoacán, CDMX, México E-MAIL: orsattisba@gmail.com

AUTHOR CONTRIBUTIONS

Both authors formulate and designed the systematic review; collected, selected, and extracted the data; assessed the risk of bias and methodological quality of included papers, and summarized the results. B.A.O.S. drafted the first version of the manuscript. Both authors reviewed the manuscript in depth and wrote the final version. Both authors analyzed and included the reviewers suggested comments.

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License