The Effectiveness of Serious Games on Cognitive Processing Speed Among Older Adults With Cognitive Impairment: Systematic Review and Meta-analysis


IntroductionBackground

By 2050, the older adult population is expected to double on a global scale [] followed by a growing demand for high-quality support among this population. There is a variety of disabilities related to aging. However, a considerable percentage of people aged >65 years are affected by cognitive impairments. According to the Alzheimer’s Association, approximately 15% to 20% of people aged >65 years are affected by mild cognitive impairment (MCI) []. It is a progressive, terminal brain disorder for which the cure and cause are unknown []. Worldwide, the number of Alzheimer disease (AD) cases is rising; estimates indicate that 44 million people currently have AD or dementia. As the Baby Boomer generation passes the age of 65 years, the number of people experiencing AD is expected to reach 76 million by 2030 [,]. The consequences of these cognitive disorders include poor judgment, decreased activity, and memory loss. They are difficult to manage; thus, it would be highly beneficial to develop proper and effective interventions for the older adult population.

These disorders imply a decline in various cognitive functions such as memory [,], executive function [,], attention [], and processing speed []. Processing speed refers to the time that an individual takes from receiving a stimulus to reacting to it. Slowed processing speed is a typical characteristic of cognitive aging. It implies a slowing rate at which individuals perform decision-making as well as motor and perceptual tasks. Moreover, processing speed represents one of the critical predictors of performance related to cognitive tasks in older adults; it is the basis of a primary hypothesis for age-related cognitive decline [,]. Accordingly, aging research primarily aims to design methods for improving and maintaining cognitive functions in older adults.

Serious games are one of the interventions that have been used to improve and maintain processing speed in older adults. Serious games represent a type of video game used for training and educational purposes in different contexts [,]. Serious games have shown promising results in improving cognitive functions such as global cognition [-], processing speed [-], memory [-], executive function [-,], and attention [,,,,]. The most common types of serious games used for improving cognitive abilities are exergames (video games that require physical exercise as part of playing) and cognitive training games (video games that include cognitively stimulating activities designed to maintain or promote the users’ cognitive abilities).

Research Gap and Aim

Several studies have explored the therapeutic impact of serious games on processing speed. However, the evidence from these studies is still fragmented. Aggregating the evidence through systematic reviews is important to draw conclusions about the effectiveness of serious games in improving processing speed. A total of 5 systematic reviews have pooled findings from these studies, but they are undermined by some limitations [-]. Specifically, these reviews (1) focused on older adults without cognitive impairment [,-], (2) included quasi-experiments or pilot randomized controlled trials (RCTs) [-], (3) did not assess the quality of the meta-analyzed evidence [,,], (4) only focused on a specific type of serious game such as cognitive training games [,,] and exergames [], or (5) did not compare the effect of serious games with a specific comparator (eg, no intervention, conventional exercises, or conventional cognitive activities) [-,]. Accordingly, the aim of this review was to examine the effectiveness of serious games on the cognitive processing speed of an older adult population living with cognitive impairment. To address the aforementioned limitations, we (1) focused on older adults with cognitive impairment; (2) included only RCTs; (3) appraised the quality of the meta-analyzed evidence using the Grading of Recommendations Assessment, Development, and Evaluation (GRADE) approach; (4) included all types of serious games; and (5) compared the effect of serious games with that of a specific comparator. In this review, effectiveness refers to the degree to which serious games are successful in improving cognitive processing speed.


Methods

To conduct this systematic review, we followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines () []. The protocol for this review is registered at PROSPERO (ID: CRD42022301667).

Search StrategySearch Sources

The first author searched the following databases on November 10, 2021: MEDLINE (via Ovid), PsycINFO (via Ovid), Embase (via Ovid), CINAHL (via EBSCO), IEEE Xplore, ACM Digital Library, Scopus, and Google Scholar. Only the first 10 pages (ie, 100 hits) were considered as the databases return a large number of studies automatically ordered according to relevance []. Finally, backward reference list checking (ie, screening the reference lists of the included studies and relevant reviews) and forward reference list checking (ie, screening the studies that cited the included studies) were conducted.

Search Terms

The search query was developed in consultation with 2 experts in digital mental health. It included terms related to the target population (eg, cognitive disorder), target intervention (eg, serious games), and targeted study design (eg, RCTs). summarizes the search query that was used for each of the 8 databases.

Study Eligibility Criteria

Only RCTs that evaluated the effectiveness of serious games in improving processing speed among older adults with cognitive impairment were included in this study. To be more precise, we considered studies that included serious games available on any digital platform, such as PCs, video game consoles (eg, Xbox and PlayStation), mobile phones, tablets, handheld devices, Nintendo, or any other type of digital device. The game had to be the major component of the intervention and used solely for therapeutic purposes. Studies involving serious games in combination with other interventions were included if the control group underwent the same adjacent intervention. Games that were not based on digital technology (eg, paper-and-pencil games and board games) or that were used for monitoring, screening, diagnosis, or research were excluded.

The study population was older adults (aged ≥60 years) with any type of cognitive impairment or disorder as confirmed by checking the inclusion criteria or baseline scores against defined diagnostic criteria (eg, Mini-Mental State Examination). Older adults without cognitive impairment, health care providers, and caregivers were beyond the scope of this review. No restrictions were applied regarding gender or ethnicity.

The outcome of interest in this review was cognitive processing speed. No restrictions were applied regarding the outcome measures. This review did not consider studies that focused only on cost-effectiveness, acceptance, feasibility, satisfaction, or cognitive abilities other than processing speed. The focus of this review was on postintervention data (ie, outcome data collected just after the intervention) rather than follow-up data (ie, outcome data collected a period after the intervention).

All types of RCTs (ie, parallel, cluster, crossover, and factorial) were considered in this review, whereas pilot RCTs, quasi-experiments, observational studies, and reviews were excluded. We included journal articles, conference proceedings, and dissertations, whereas abstracts, conference posters, commentaries, proposals, and editorials were excluded. This review was restricted to only studies written in the English language and published since 2010. We did not apply restrictions on the country of publication, comparator, or study settings.

Study Selection

We identified relevant studies by using the following process. First, all the retrieved studies were imported into EndNote (Clarivate Analytics) to find duplicate publications and remove them. Second, the titles and abstracts of all the retrieved studies were checked by 2 reviewers working independently (the first and second authors). Finally, both reviewers independently read the complete texts of the studies included in the previous step. Any disagreements were resolved via discussion. Steps 2 and 3 had an interrater agreement (Cohen κ) of 0.88 and 0.96, respectively.

Data Extraction

Before extracting the data, we pilot-tested the data extraction form with 2 of the included studies. Microsoft Excel was used by 2 reviewers (the first and second authors) to independently extract data from the included studies. Any disputes in the extracted data between the reviewers were resolved through discussion. The first and corresponding authors of the included studies were contacted to retrieve outcome data (eg, mean, SD, and sample size) if they were missing from the published articles. The data extraction form is provided in .

Risk of Bias Appraisal

Two reviewers (the first and second authors) independently examined the risk of bias in the included studies using the Risk of Bias 2 tool []. This tool evaluates the risk of bias in 5 areas of RCTs: randomization process, deviations from intended interventions, missing outcome data, measurement of the outcome, and selection of the results []. The reviewers held discussions to resolve any disagreements, and the interrater agreement was 0.85.

Data Synthesis

Narrative and statistical methods were used to summarize the collected data. In our narrative synthesis, we used text and tables to describe the characteristics of the included studies (study metadata, population, interventions, comparisons, and outcome measures). The results of the experiments were compiled and classified according to the comparator: no or passive interventions, conventional exercises, and other serious games. When 2 or more studies from the same comparator submitted sufficient data (ie, mean, SD, and number of participants in each intervention group), meta-analyses were performed using Review Manager (RevMan 5.4; The Cochrane Collaboration). As the type of data for the outcome of interest (processing speed) was continuous and the instruments used to evaluate the outcome varied across the included trials, the standardized mean difference (SMD; Cohen d) was used to estimate the overall effect of each study. We also chose the random effects model for the analysis because of the high clinical heterogeneity among the meta-analyzed trials in terms of serious game characteristics (eg, type, duration, frequency, and period), population characteristics (eg, sample size, mean age, and health condition), and outcome measures (ie, tools and follow-up period).

To assess the degree and statistical significance of heterogeneity in the meta-analyzed studies, we calculated I2 and a chi-square P value, respectively. A chi-square P value of ≤.05 indicated heterogeneous meta-analyzed studies []. When I2 ranged from 0% to 40%, 30% to 60%, 50% to 90%, and 75% to 100%, the degree of heterogeneity was considered as insignificant, moderate, substantial, or considerable, respectively [].

We used the GRADE approach [] to appraise the overall quality of the evidence resulting from the meta-analyses. The GRADE approach examines the quality of evidence based on 5 domains: risk of bias, inconsistency (ie, heterogeneity), indirectness, imprecision, and publication bias []. The quality of the meta-analyzed evidence was independently assessed by 2 reviewers (the first and second authors). Any differences between the reviewers were resolved via discussion, and the interrater agreement of the reviewers was 0.94 [].


ResultsSearch Results

As shown in , a total of 548 records were found after searching 8 electronic databases. Using the EndNote software, of the 548 records, 98 (17.9%) duplicates were removed. Checking the titles and abstracts of the remaining records resulted in the exclusion of 63.1% (346/548) for several reasons shown in . Reading the full text of the remaining 104 publications resulted in the exclusion of 88 (84.6%) studies (). This review included 16 RCTs in total [-]. Of these 16 RCTs, 13 (81%) were included in the meta-analyses [-].

Figure 1. Flowchart of the study selection process. View this figureCharacteristics of the Included Studies

The included studies were published between 2012 and 2021 and came from 11 different countries (). Except for a book chapter, all the included papers (15/16, 94%) were peer-reviewed articles. Parallel RCTs were the most common type of trial used in the included studies (14/16, 88%). The sample sizes of the included studies ranged from 20 to 195, with an average of 79.9. The average age of the participants was reported in 94% (15/16) of the studies and varied between 66 and 82.9 years, with an average of 75 years. Male participants in 94% (15/16) of the studies ranged from 23.5% to 71%, with an average of 47.5%. The mean Mini-Mental State Examination score of the participants was reported in 88% (14/16) of the studies and ranged from 18.6 to 28.1, with an average of 24.4. The most common disorder among the participants in the included studies was MCI (11/16, 69%). Participants were drawn from clinical (10/16, 62%), community (4/16, 25%), and clinical and community (2/16, 12%) settings.

Table 1. Characteristics of the studies and populations (N=16).Study, yearCountryPublication typeRCTa typeSample sizeAge, mean (SD)Male participants, n (%)MMSEb scoreHealth conditionSettingFinn and McDonald [], 2015AustraliaJournal articleParallel3175.622 (71)28.1MCIcClinicalRobert et al [], 2020FranceJournal articleParallel4679.422 (47.8)21.4Neurocognitive disordersClinicalSavulich et al [], 2017United KingdomJournal articleParallel4276.125 (59.5)26.7MCIClinicalValdes et al [], 2012United StatesJournal articleParallel19577.765 (33.3)NRdMCIClinicalYang and Kwak [], 2017South KoreaJournal articleParallel207114 (70)23.1ADeClinicalThapa et al [], 2020South KoreaJournal articleParallel6872.716 (23.5)26.2MCIClinicalTarnanas et al [], 2014GreeceBook chapterParallel11470.344 (39)26.4MCIClinicalFiatarone Singh et al [], 2014AustraliaJournal articleFactorial10070.132 (32)27MCICommunityAmjad et al [], 2019PakistanJournal articleParallel44NRNR24MCIClinicalWiloth et al [], 2017GermanyJournal articleParallel9982.928 (28.3)22DementiaClinical and communityVan Santen et al [], 2020NetherlandsJournal articleCluster1127960 (53.5)18.6DementiaClinicalKarssemeijer et al [], 2019NetherlandsJournal articleParallel11579.962 (53.9)22.4DementiaClinical and communityLiao et al [], 2021TaiwanJournal articleParallel6181.520 (32.6)22.9MCICommunityFlak et al [], 2019NorwayJournal articleParallel856657 (66.7)NRMCIClinicalHyer et al [], 2016United StatesJournal articleParallel6875.232 (47.1)26MCICommunityPark and Park [], 2017South KoreaJournal articleParallel7867.342 (53.8)26.5MCICommunity

aRCT: randomized controlled trial.

bMMSE: Mini-Mental State Examination.

cMCI: mild cognitive impairment.

dNR: not reported.

eAD: Alzheimer disease.

We identified 16 distinct serious games used in the studies (). More than one game was used in 6% (1/16) of the studies. The serious games in the trials were divided into 2 categories based on the treatment modality they provided: cognitive training games (12/16, 75%) and exergames (4/16, 25%). In 88% (14/16) of the studies, the games were designed with a “serious” objective from the start (designed serious games). By contrast, games in the remaining 12% (2/16) of the studies were not planned as serious games from the start but were instead used for a serious purpose (purpose-shifted games). Serious games were played under the supervision of health care providers or caregivers in most studies (11/16, 69%). The game duration in the included studies ranged from 25 to 100 minutes. The frequency of playing the games ranged from 2 to 7 times per week, but it was <4 times per week in approximately two-thirds of the studies (11/16, 69%). The duration of the interventions ranged from 4 to 25 weeks, but it was <13 weeks in three-fourths of the studies (13/16, 81%).

Table 2. Characteristics of the interventions (N=16).StudySerious game nameSerious game typeSerious game genrePlatformSupervisionDuration (minutes)Frequency (times per week)Period (weeks)Finn and McDonald []E-PrimeCognitive training gameDesignedPCSupervisedNRa24Robert et al []MeMoCognitive training gameDesignedPC and tabletUnsupervised30412Savulich et al []Game ShowCognitive training gameDesignedTabletSupervised6024Valdes et al []SOPTCognitive training gameDesignedPCSupervised6025Yang and Kwak []Brain-CareCognitive training gameDesignedPCUnsupervised60212Thapa et al []Juice Making, Crow Shooting, Love House, and FireworksCognitive training gameDesignedVRb headset and hand controllersSupervised10038Tarnanas et al []Virtual Reality MuseumCognitive training gameDesignedVR headsetSupervised90221Fiatarone Singh et al []COGPACKCognitive training gameDesignedPCSupervised75225Amjad et al []Body and Brain ExercisesCognitive training gamePurpose-shiftedXbox console and KinectSupervised25 to 3056Wiloth et al []PhysiomatExergameDesignedBalance broad and screenSupervised90210Van Santen et al []NRExergameDesignedStationary bicycle and screenUnsupervisedNR525Karssemeijer et al []NRExergamePurpose-shiftedStationary bicycle and screenSupervised30 to 50312Liao et al []Tano and LongGoodExergameDesignedKinect and VR headsetSupervised60312Flak et al []CogmedCognitive training gameDesignedPCUnsupervised30 to 4055Hyer et al []CogmedCognitive training gameDesignedPCBoth4075 to 7Park and Park []CoTrasCognitive training gameDesignedPCSupervised30310

aNR: not reported.

bVR: virtual reality.

Half of the studies (8/16, 50%) delivered no or passive interventions to the comparison groups (eg, reading newspaper articles, surfing the internet, or watching a documentary program), whereas these groups received active interventions (eg, conventional exercises and other serious games) in 62% (10/16) of the studies (). A total of 12% (2/16) of the studies delivered both active and passive interventions as comparators. The active interventions had a duration ranging from 25 to 100 minutes. The active interventions were performed once to 7 times per week. The active comparator duration ranged from 5 to 25 weeks. The outcome of interest (ie, processing speed) was assessed using 11 different tools, with the Trail Making Test A being a frequently used tool in the included studies (7/16, 44%). The outcome of interest was measured after the intervention in all the included studies (16/16, 100%). In total, 44% (7/16) of the studies followed the participants after the interventions, and the follow-up period varied between 4 and 261 weeks. The number of participants who dropped out of the included studies ranged from 0 to 28.

Table 3. Characteristics of the comparators and outcomes (N=16).StudyComparatorDuration (minutes)Frequency (times per week)Period (weeks)Outcome measuresFollow-upAttritions, NFinn and McDonald []ControlN/AaN/AN/AD-KEFS-NSbAfter the intervention7Robert et al []ControlN/AN/AN/ATMT-Ac, SCWTd, and WAIS-R-DsyeAfter the intervention; 12-week follow-upNRfSavulich et al []ControlN/AN/AN/ACANTAB-CRTgAfter the intervention0Valdes et al []ControlN/AN/AN/AUFOVhAfter the intervention; 52-, 104-, 156-, and 261-week follow-upNRYang and Kwak []ControlN/AN/AN/AGnGi and SCWTAfter the intervention0Thapa et al []ControlN/AN/AN/ATMT-A and SDSTjAfter the intervention2Tarnanas et al []Control and conventional cognitive activities90221SCWTAfter the intervention9Fiatarone Singh et al []Control, conventional exercises+sham cognitive training, and serious games+conventional exercisesControl: 75; conventional exercises+sham cognitive training: 100; serious games+conventional exercises: 60225SDMTkAfter the intervention; 74-week follow-up14Amjad et al []Conventional exercises25 to 3056TMT-AAfter the intervention6Wiloth et al []Conventional exercises60210TMT-AAfter the intervention; 12-week follow-up26Van Santen et al []Conventional exercisesN/A525TMT-AMidintervention and after the intervention28Karssemeijer et al []Conventional exercises (aerobic exercises); conventional exercises (relaxation and flexibility exercises)30 to 50312TMT-A and SCWTMidintervention and after the intervention; 24-week follow-up23Liao et al []Conventional exercises60312SCWTAfter the intervention15Flak et al []Nonadaptive serious game30 to 4055D-KEFS-CWIT1l and D-KEFS-CWIT2mAfter the intervention; 4- and 16-week follow-up17Hyer et al []Nonadaptive serious game4075 to 7TMT-AAfter the intervention; 12-week follow-up9Park and Park []Exergames30310SCWTAfter the intervention0

aN/A: not applicable.

bD-KEFS-NS: Delis-Kaplan Executive Function System Test Battery-Number Sequencing.

cTMT-A: Trail Making Test A.

dSCWT: Stroop Color and Word Test.

eWAIS-R-Dsy: Wechsler Adult Intelligence Scale-Revised-Digit Symbol.

fNR: not reported.

gCANTAB-CRT: Cambridge Neuropsychological Test Automated Battery-Choice Reaction Time.

hUFOV: Useful Field of View test.

iGnG: go-no go.

jSDST: Symbol Digit Substitution Test.

kSDMT: Symbol Digit Modalities Test.

lD-KEFS-CWIT1: Delis-Kaplan Executive Function System Color-Word Interference Test 1.

mD-KEFS-CWIT2: Delis-Kaplan Executive Function System Color-Word Interference Test 2.

Results of Risk of Bias Appraisal

As shown in , a total of 31% (5/16) of the studies were judged to have a low risk of bias in the “randomization process” domain. With regard to the “deviations from the intended interventions” domain, there was a low risk of bias in 75% (12/16) of the studies. The risk of bias because of missing outcome data was low in 81% (13/16) of the studies. All the included studies (16/16, 100%) were judged to have a low risk of bias in the “measuring the outcome” domain. In half of the included studies (8/16, 50%), the risk of bias was rated as low in the “selection of the reported results” domain. According to these judgments, only 19% (3/16) of the studies were judged to have a low risk of bias in the last domain (ie, overall bias). Reviewers’ judgments about each “risk of bias” domain for each included study are presented in [-].

Figure 2. Review authors’ judgments about each “risk of bias” domain. View this figureResults of the StudiesSerious Games Versus No or Passive Interventions

The effect of serious games was compared with that of control (no or passive interventions) in 50% (8/16) of the studies [-]. Passive interventions are those that do not have a known effect on the measured outcome, such as reading newspaper articles, surfing the internet, and watching a documentary program. In 50% (4/8) of these studies [,,,], more than one outcome measure was used to assess processing speed. Therefore, we included the results of all these measures in the meta-analysis to form 14 comparisons. As shown in [-], there was no statistically significant difference (P=.77) in processing speed between serious games and the control groups (SMD: −0.07, 95% CI −0.54 to 0.40). The statistical heterogeneity of the evidence was considerable (P<.001; I2=89%). The quality of the evidence was very low as it was downgraded by 6 levels owing to a high risk of bias, heterogeneity, and imprecision ().

The SMDs of 2 comparisons seem to be outliers (−1.24 [] and 1.98 []), although the characteristics of the studies in these comparisons were comparable with those of other studies in this meta-analysis. For this reason, we ran a sensitivity analysis to assess whether removing these outliers influenced the overall effect size and heterogeneity level. The sensitivity analysis showed that the difference in processing speed between the groups remained insignificant (P=.32), but the heterogeneity substantially decreased from 89% to 49%.

Figure 3. Forest plot of 8 studies (14 comparisons) comparing the effect of serious games on processing speed with that of control [-]. View this figureSerious Games Versus Conventional Exercises

The effect of serious games was compared with that of conventional exercises in 38% (6/16) of the studies [-]. Of these 6 studies, 1 (17%) compared serious games with 2 different conventional exercises (aerobic exercises and relaxation and flexibility exercises) and measured processing speed using 2 different tools []. Therefore, we included the results of all these comparisons and measures in the meta-analysis to form 11 comparisons ( [-]). The meta-analysis showed no statistically significant difference (P=.58) in processing speed between the serious game and conventional exercise groups (SMD: −0.07, 95% CI −0.34 to 0.19). The statistical heterogeneity of the evidence was moderate (P<.001; I2=58%). The quality of the evidence was very low as it was downgraded by 6 levels owing to a high risk of bias, heterogeneity, and imprecision ().

Two types of serious games were used in this comparison (ie, serious games vs conventional exercises): cognitive training games and exergames. We conducted a subgroup analysis to investigate whether cognitive training games and exergames had a different effect on processing speed ( [-]). The subgroup analysis of 12% (2/16) of the studies showed no statistically significant difference (P=.26) in processing speed between the cognitive training game group and the conventional exercise group (SMD: −0.37, 95% CI −1.00 to 0.27). The statistical heterogeneity of the evidence was moderate (P=.14; I2=53%). The quality of the evidence was very low as it was downgraded by 4 levels owing to a high risk of bias, heterogeneity, and imprecision (). Furthermore, the subgroup analysis of 25% (4/16) of the studies (9 comparisons) showed no statistically significant difference (P=.88) in processing speed between the exergame group and the conventional exercise group (SMD: −0.02, 95% CI −0.31 to 0.27). The statistical heterogeneity of the evidence was substantial (P<.001; I2=72%). The quality of the evidence was very low as it was downgraded by 6 levels owing to a high risk of bias, heterogeneity, and imprecision ().

Figure 4. Forest plot of 6 studies (11 comparisons) comparing the effect of serious games on processing speed with that of conventional exercises [-]. View this figureFigure 5. Forest plot of 6 studies (11 comparisons) comparing the effect of cognitive training games and exergames on processing speed with that of conventional exercises [-]. View this figureSerious Games Versus Other Serious Games

In total, 19% (3/16) of the studies assessed the effect of serious games on processing speed in comparison with that of other serious games [-]. The first study (1/3, 33%) compared the effect of a cognitive training game with that of exergames and found no statistically significant difference (P=.76) in processing speed between the groups []. The remaining 67% (2/3) of the studies compared the effect of cognitive training games that adjust the level of difficulty of the tasks based on an individual’s mastery in each level (ie, adaptive games) with that of the same games but without adjustment of the level of difficulty of the tasks (ie, nonadaptive games) [,]. Of the 2 studies, 1 (50%) showed no statistically significant difference in processing speed between the groups as measured by the Delis-Kaplan Executive Function System Color-Word Interference Test 1 (P=.91) and Delis-Kaplan Executive Function System Color-Word Interference Test 2 (P=.51) []. The remaining study (1/2, 50%) did not report the findings related to the outcome measure Trail Making Test A []. The first author of that study was contacted to obtain these findings, but he has not replied.


DiscussionPrincipal Findings

This study compiled evidence regarding the effectiveness of serious games in improving processing speed among older adults with cognitive impairment. Our review revealed that serious games are as effective as no or passive interventions and conventional exercises in improving processing speed and that there is no difference between cognitive training games and exergames when compared with conventional exercises. The nonsuperior effect of serious games over no or passive interventions and conventional exercises may have been due to the following reasons: (1) serious games in the included studies targeted cognitive abilities in general rather than processing speed specifically and (2) the sample size in most of the included studies (10/16, 62%) was small (<100).

Our findings are consistent with findings of a previous review that showed no statistically significant difference in processing speed between the cognitive training game group and the passive or active intervention group among older adults with MCI or dementia []. However, our findings are not consistent with findings of previous reviews [,-]. Specifically, 4 reviews showed that cognitive training games [,,] and exergames [] are more effective than other interventions (passive or active) in improving processing speed among healthy older adults. This inconsistency may be attributed to the fact that (1) all these reviews focused on older adults without cognitive impairment only, whereas our review focused on older adults with cognitive impairment [,-]; (2) they included quasi-experiments and pilot RCTs [,]; and (3) they did not compare the effect of serious games with that of a specific comparator (eg, no intervention, conventional exercises, or conventional cognitive activities) [,-].

Strengths and LimitationsStrengths

This study is the only one of the aforementioned reviews [-] that compared both serious games and their types with a specific comparator (ie, no intervention and conventional exercises) and used the GRADE approach to assess the quality of the evidence that resulted from the meta-analyses, thereby enabling the reader to draw more accurate conclusions. Given that we included only RCTs, which are the most rigorous research method for studying cause-effect relationships [], our findings are more likely to be reliable than findings generated from reviews that included other study designs such as pilot RCTs and quasi-experiments.

The risk of publication bias in this review was minimal given that we sought to identify as many relevant studies as possible through (1) searching the most popular databases in the IT and health fields and gray literature databases, (2) conducting backward and forward reference list checking, and (3) using a well-developed search query. The risk of selection bias in this review was not a concern as the study selection, data extraction, risk of bias assessment, and quality of evidence appraisal were conducted by 2 reviewers independently.

Limitations

This review focused on the effectiveness of digital serious games in improving processing speed among older adults with cognitive impairment. Hence, this review cannot comment on the effectiveness (1) of nondigital serious games or those used for nontherapeutic purposes (eg, diagnosis), (2) of serious games in improving other cognitive abilities (eg, attention, learning, and memory), and (3) of serious games among other age groups or those without cognitive impairment.

The effect size estimated for each meta-analyzed study was likely overestimated or underestimated as we used postintervention data rather than the pre-post intervention change data to calculate it. We used postintervention data as most studies (12/16, 75%) did not report the mean and SD for pre-post intervention change in processing speed for each group, and the difference in processing speed between groups at baseline was not statistically significant in all studies.

This review focused only on the short-term effect of serious games by pooling only postintervention data rather than follow-up data given that the follow-up period was not consistent among the 44% (7/16) of studies that reported follow-up data. As a result, we are unable to speculate on the long-term impact of serious games on processing speed. Given that this review did not include research published before 2010, studies written in a language other than English, quasi-experiments, or pilot RCTs, it is likely that this review missed some relevant studies.

Practical and Research ImplicationsPractical Implications

The findings of this review should be cautiously interpreted for the following reasons: (1) the quality of the evidence from all meta-analyses was very low mainly because of high risk of bias, high heterogeneity, and imprecision of the estimated total effect sizes; (2) the number of studies included in some meta-analyses was small; and (3) the sample sizes in many meta-analyzed studies were small. Consequently, until more robust evidence is available, serious games should be offered or used as a supplement rather than an alternative intervention targeting processing speed.

None of the included studies used smartphones as a platform for serious games. Smartphones are more appealing than other platforms as they are less expensive, more accessible, and more pervasive than computers and gaming consoles. In 2021, the global number of mobile devices and users was estimated to be approximately 15 billion and 7.1 billion, respectively, with these statistics likely to climb dramatically by 2025 []. Thus, we recommend that gaming companies develop serious games that can be played via smartphones. None of the serious games in the included studies were designed to target processing speed. Therefore, there is an urgent need to develop serious games that specifically target processing speed.

Research Implications

Although this review addressed the research gap related to the short-term effect of serious games on processing speed among older adults with cognitive impairment, the following research gaps need further reviews to be bridged: (1) the long-term effect of serious games, (2) the effect of serious games on other cognitive abilities (eg, attention and visuospatial skills) and other disorders (eg, attention-deficit/hyperactivity disorder, autism, and motor disabilities), and (3) the effect of serious games among people from different age groups with or without cognitive impairment.

As mentioned earlier, most studies in this review did not report the mean and SD for pre-post intervention change in processing speed. Researchers should report such information in their future publications to enable reviewers to calculate a more accurate effect size for each study. According to a previous review [], there have been many studies conducted to assess the effect of exergames on processing speed among healthy older adults. However, only 25% (4/16) of the studies in this review investigated the effect of exergames on processing speed among older adults with cognitive impairment. Further trials are needed to address the aforementioned research gap.

In this review, only 6% (1/16) of the trials compared serious games with conventional cognitive training, and only 12% (2/16) compared adaptive serious games with nonadaptive serious games. We urge researchers to examine the aforementioned comparisons to reach more definitive conclusions. None of the included studies investigated the effect of serious games that specifically target processing speed rather than cognitive abilities in general. Future studies should use serious games that specifically target processing speed to examine their effect.

The overall risk of bias was low in only 19% (3/16) of the included trials as the remaining studies had issues mainly in the randomization process or selection of the reported results (ie, unpublished protocol or analysis plan). Future trials should improve their quality by minimizing such bias. To this end, they should be conducted and reported according to recommended guidelines or tools such as the Risk of Bias 2 [], and they should have a large sample size that is enough to obtain the desired statistical power. As most of the included studies (14/16, 88%) were conducted in high-income countries, the generalizability of the findings of this review to lower-income countries may be restricted owing to the diversity of their cultures and socioeconomic conditions. Thus, more trials should be conducted in lower-income countries.

Conclusions

Serious games did not have a superior effect on processing speed among older adults with cognitive impairment in comparison with no or passive interventions and conventional exercises. However, this finding should be cautiously interpreted for the following reasons: (1) the quality of the evidence from all meta-analyses was very low mainly because of high risk of bias, high heterogeneity, and imprecision of the estimated total effect sizes; (2) the number of studies included in some meta-analyses was small; and (3) the sample sizes in many meta-analyzed studies were small. Therefore, until more robust evidence is available, serious games should be offered or used as a supplement rather than as an alternative intervention targeting processing speed. Future reviews should investigate the long-term impact of serious games on other cognitive abilities and disorders among people from different age groups with or without cognitive impairment. Further trials should be undertaken to investigate the effect of serious games that specifically target processing speed rather than cognitive abilities in general.

None declared.

Edited by N Zary; submitted 29.01.22; peer-reviewed by E Al-Jafar, M Alajlani, M Khalifa; comments to author 16.03.22; revised version received 23.03.22; accepted 07.04.22; published 09.09.22

©Alaa Abd-alrazaq, Arfan Ahmed, Haitham Alali, Ahmad Mohammad Aldardour, Mowafa Househ. Originally published in JMIR Serious Games (https://games.jmir.org), 09.09.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Serious Games, is properly cited. The complete bibliographic information, a link to the original publication on https://games.jmir.org, as well as this copyright and license information must be included.

留言 (0)

沒有登入
gif