Effectiveness of eHealth Self-management Interventions in Patients With Heart Failure: Systematic Review and Meta-analysis


Introduction

Heart failure (HF), a major global public health concern, is a common clinical syndrome caused by cardiac structural or functional impairment []. The global prevalence of HF was estimated at 64.34 million cases, and the global economic burden of HF was roughly calculated at US $346.17 billion. Global expenditure related to HF is expected to increase to approximately US $400 billion by 2030 []. Since HF cannot be completely cured, it has a major impact on quality of life and requires long-term management [-]. The management of patients with HF is a complex issue. Even when the patient is clinically stable, the quality of life is reduced due to dyspnea, depression, fatigue, and cognitive impairment []. The symptom burden of patients with HF prevents them from maintaining adequate social life and roles, participating in social activities, and maintaining relationships [].

Self-management is a dynamic, iterative process in which patients need to employ multidimensional strategies to meet their self-needs for coping with chronic illness in their daily lives [,]. Self-management is an effective way to improve the outcome of chronic disease and an important part of the treatment of patients with chronic diseases []. Successful self-management requires the active participation of individuals, families, and health care providers []. Self-management has been demonstrated to improve clinical outcomes and health-related quality of life, while reducing health care utilization and costs [-].

eHealth, as broadly defined, refers to a variety of information and communication technologies used to deliver health care services [,]. The use of eHealth interventions to deliver health care services can reduce or eliminate some of the barriers to face-to-face treatment, improve access to treatment, reduce waiting times, and be more cost-effective than face-to-face interventions [-]. The World Health Organization (WHO) states that to improve health and reduce health inequities, a rigorous evaluation of eHealth is necessary to generate evidence and facilitate the appropriate integration and use of technology []. In addition, the WHO and the International Telecommunication Union launched the National eHealth Strategy Toolkit, which is a comprehensive and practical guide to help all governments, along with their ministries, departments, and agencies, to adapt to suit their own circumstances, goals, and vision in achieving eHealth [].

There is a large body of research demonstrating the effectiveness of eHealth self-management interventions for chronic diseases [,]. eHealth self-management supports patients’ empowerment to better manage HF and improve quality of life []. Furthermore, eHealth applications and systems could help to reduce the rehospitalization rate of patients with HF and lower the cost of treatment [].

However, previous research has not specifically focused on the impact of eHealth in self-management. Although eHealth self-management interventions have been used in patients with HF, the results of some systematic reviews have been inconsistent [,]. Furthermore, there is a lack of understanding of the effectiveness and influencing factors of eHealth self-management approaches.

To fill these gaps, the aim of this study was to perform a systematic review and meta-analysis of the effectiveness of eHealth self-management interventions in patients with HF. This review will provide a reference for the clinical application and better understanding of the possible benefits of eHealth self-management interventions for patients with HF. These findings will further identify gaps and inform the development of future eHealth interventions.


MethodsSearch Strategy

This systematic review and meta-analysis was performed following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines []. We searched the PubMed, EMBASE, CENTRAL (Cochrane Central Register of Controlled Trials), and CINAHL databases from January 1, 2011, to July 12, 2022, to identify randomized controlled trials (RCTs) that provide eHealth self-management interventions for HF patients. We used combined search terms such as (heart failure OR cardiac failure OR heart decompensation) AND (self-management OR self care OR self-administration OR self-medication) AND (Telemedicine OR mobile health OR eHealth OR m-health) AND (randomized controlled trial OR randomization OR randomly). Screening titles/abstracts and full-text evaluation of the articles were managed in a database created with Rayyan software []. The full protocol of this systematic review and meta-analysis has been registered in PROSPERO (CRD42021246973).

Selection Criteria

Inclusion and exclusion criteria strictly followed the Participants-Intervention-Comparison-Outcome (PICO) framework []: (1) participants were defined as adults (aged≥18 years) who had been diagnosed with HF (studies in children or adolescents were excluded); (2) interventions consisted of self-management tools including at least one eHealth component (eg, mobile apps), with traditional interventions that did not use any technical support excluded, such as face-to-face meetings; (3) the comparison was HF patients versus usual care; and the (4) outcomes included patient and process outcomes. Patient outcomes are measures directly related to the disease and were considered as the primary outcomes in our study, including all-cause readmission rate, all-cause mortality, HF readmission, and cardiovascular mortality. Process outcomes are measures related to patients’ behavior, which were considered as the secondary outcomes in our study, including quality of life, self-care behaviors, HF knowledge, and medication adherence. In addition, only RCTs or cluster RCTs reporting one or more selected outcomes were included. Reviews, editorials, protocols, and non-English papers were excluded.

Data Extraction

The following characteristics were extracted from studies that met the inclusion criteria: name of the first author, publication year, country, type of eHealth technologies, target of eHealth intervention, duration of intervention, patient demographics, number of participants, recruitment setting, outcomes, descriptions of the control, and the intervention. All outcome data used for the meta-analysis were extracted by the same two independent reviewers (J Li and DW). The synthesis of the results and data charting were performed independently by two researchers (SL and J Li). Disagreements were discussed and consulted with a third reviewer (J Liu) to reach consensus.

Risk of Bias Assessment

We used the Cochrane Risk of Bias tool (RoB 2) to assess the risk of bias for each study []. This tool assesses 5 domains to address different types of bias: randomization process, deviations from the intended interventions, missing outcome data, measurement of the outcome, and selection of the reported result. Each component includes a low risk of bias, some concerns, or high risk of bias. Risk of bias assessment was performed independently by two reviewers with consultation of the third reviewer when necessary.

Certainty of Evidence

The Grading of Recommendations, Assessment, Development, and Evaluation (GRADE) approach was used to rate the certainty of evidence for each outcome of interest []. This approach rates the risk of bias, inconsistency, indirectness, imprecision, and other considerations (eg, publication bias) as “high,” “moderate,” “low,” or “very low.” The GRADE assessment was completed with the GRADEpro Guideline Development Tool.

Statistical Analyses

We performed meta-analyses using Review Manager [] (RevMan v.5.4; Cochrane Training) and R (v.4.1.0 x64). The Mantel-Haenszel odds ratio (OR) was used as the effect size for dichotomous outcomes and the standardized mean difference (SMD) was used to calculate the intervention effect for continuous outcomes. Heterogeneity was then analyzed using the Cochran Q test and the I2 statistic. For the Q test, P<.10 was considered to indicate statistically significant heterogeneity []. According to Cochrane Handbook guidelines [], the interpretation of the I2 statistic was as follows: 0% to 40% may represent not important heterogeneity, 30% to 60% may represent moderate heterogeneity, 50% to 90% may represent substantial heterogeneity, and 75% to 100% may represent considerable heterogeneity. The fixed-effects model was used for outcomes with low heterogeneity and the random-effects model was used when the heterogeneity was significantly high. To measure the publication bias, we constructed funnel plots and performed the Egger test for all primary outcomes to determine the significance of potential asymmetry []. The threshold of a significant P value was .05. A sensitivity analysis was performed to check the robustness of the pooled results using the leave-one-out approach [].


ResultsSearch Outcomes

A total of 1884 articles were retrieved in the literature search. After eliminating duplicates, 1203 titles and abstracts were screened in relation to the inclusion/exclusion criteria. Of these, 1144 articles were excluded and a total of 59 articles were subject to full-text review. Finally, 24 articles were included in the systematic review and meta-analysis ().

Figure 1. PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flow diagram for selection and inclusion of the studies via databases. Latest search date: July 12, 2022. View this figureRisk of Bias and Quality Assessment

The results of risk of bias assessment are summarized in . The majority of studies showed a low risk of bias for the randomization process, and only 5 studies were judged to have some concerns due to lack of detailed information about randomization. The studies could not have been blinded to participants considering the nature of the intervention and 11 studies were judged to have some concerns regarding deviations from the intended interventions. One study was determined as “high risk” for the category of measurement of the outcome because all questionnaire scores were patient-reported, which may have possibly affected the outcome []. In addition, one study did not report all of the outcomes according to the trial registry record, resulting in a judgment of “high risk” regarding selection of the reported result []. For studies included in the meta-analysis, the overall bias was low in 6 studies (25%), with some concerns in 15 studies (63%) and high bias in 3 studies (13%).

Figure 2. Quality assessment. (A) Each risk of bias domain presented as a percentage across all included studies. (B) Each risk of bias domain for each included study. View this figureStudy Characteristics

A total of 9634 participants with HF were included in the 26 (22+2×2) RCTs, with 4820 patients allocated to the eHealth group and 4814 to the usual-care group. Since two studies performed a three-group parallel-randomized trial and reported their results separately [,], we divided each of the three-group trials into two RCTs. These studies were performed in 20 different countries, with the largest number of studies performed in the United States (7 studies). Most (15 studies) were multicenter studies, while the other 11 RCTs recruited patients from a single center. The proportion of male HF patients ranged from 46.8% to 83% in the eHealth groups and from 30.2% to 93% in the usual-care groups. The New York Heart Association classification, which classifies patients into one of four categories based on their limitations during physical activity and has been used clinically to determine trial eligibility, was reported in 24 studies. The basic characteristics of the included studies are presented in , whereas the characteristics of participants and details of interventions are summarized in .

Table 1. Basic characteristics of studies included in the meta-analysis.Reference (year)CountryType of eHealth technologiesTarget of eHealth interventionDuration of interventionRecruitmentSettingNegarandeh et al [] (2019)IranTelephoneEducation2 monthsSingle centerAfter dischargeSeto et al [] (2012)CanadaDesigned telemedical systemMonitoring6 monthsSingle centerAmbulatory clinicHindricks et al [] (2014)Australia, Europea, and IsraelDesigned telemedical systemMonitoring12 monthsMulticenter (36 sites)No informationGalinier et al [] (2020)FranceTelephone+designed telemedical systemMonitoring+education18 monthsMulticenter (38 sites)After discharge (26.4%), hospitalized (73.6%)Hale et al [] (2016)United StatesDesigned telemedical systemReminders3 monthsMulticenter (2 sites)No informationYanicelli et al [] (2021)ArgentinaMobile or tablet appMonitoring+education3 monthsSingle centerAmbulatory clinicChen et al [] (2019)bChinaMobile text messageEducation+reminders6 monthsSingle centerAfter dischargeChen et al [] (2019)bChinaTelephoneEducation+reminders6 monthsSingle centerAfter dischargeKoehler et al [] (2018)GermanyDesigned telemedical systemMonitoring+education365-393 daysMulticenter (200 sites)After dischargeÇavuşoğlu et al [] (2016)TurkeyTelephoneEducation6 monthsMulticenter (10 sites)After dischargeDendale et al [] (2011)BelgiumDesigned telemedical systemMonitoring6 monthsMulticenter (7 sites)After dischargeWagenaar et al [] (2019)bNetherlandsInternet websiteEducation12 monthsMulticenter (9 sites)Ambulatory clinicWagenaar et al [] (2019)bNetherlandsDesigned telemedical systemMonitoring12 monthsMulticenter (9 sites)Ambulatory clinicDang et al [] (2017)United StatesDesigned telemedical systemMonitoring3 monthsSingle centerAmbulatory clinicOliveira et al [] (2017)BrazilTelephoneEducation4 monthsSingle centerAmbulatory clinicRitchie et al [] (2016)United StatesDesigned telemedical systemMixed interventions1 monthsSingle centerAfter dischargeCichosz et al [] (2019)DenmarkDesigned telemedical systemMonitoring12 monthsMulticenter (3 sites)Ambulatory clinicBakitas et al [] (2020)United StatesTelephoneMixed interventions4 monthsMulticenter (2 sites)Ambulatory clinic, hospitalizedPedone et al [] (2015)ItalyTelephone+designed telemedical systemMonitoring6 monthsSingle centerAmbulatory clinic after dischargeJayaram et al [] (2017)United StatesDesigned telemedical systemMonitoring6 monthsMulticenter (33 sites)After dischargeMelin et al [] (2018)SwedenMobile or tablet appMonitoring+education6 monthsMulticenter (3 sites)After discharge, hospitalizedBoyne et al [] (2014)NetherlandsDesigned telemedical systemMonitoring+education12 monthsMulticenter (3 sites)Ambulatory clinicPekmezaris et al [] (2018)United StatesDesigned telemedical systemMonitoring3 monthsSingle centerAfter dischargeKoehler et al [] (2011)GermanyDesigned telemedical systemMonitoringMedian 26 months (range 12-28 months)Multicenter (165 sites)Ambulatory clinicDorsch et al [] (2021)United StatesMobile or tablet appMixed interventions3 monthsSingle centerAfter discharge, hospitalizedSahlin et al [] (2022)SwedenDesigned telemedical systemMonitoring+education8 monthsMulticenter (7 sites)Ambulatory clinic

aEurope includes only Austria, Czech Republic, Denmark, Germany, and Latvia.

bTwo types of eHealth interventions employed in a three-group parallel randomized controlled trial design.

Intervention

These studies used various types of eHealth technologies for the intervention (). Of these, 14 studies used a designed telemedical system; 5 studies used the telephone; 3 studies used a mobile phone or tablet app; 2 studies used an internet website and text messages, respectively; and 2 studies used a combination of telephone with a designed telemedical system intervention. The duration of the intervention ranged from 1 month to 28 months (17 studies had interventions lasting≥6 months). The target of the intervention was classified into three types: education, monitoring, and reminders. The mixed targets were defined as the presence of the three types in one study. Educational interventions were defined as interventions that aimed at improving the HF knowledge available through educational programs and instructions. Reminder interventions were defined as interventions that prompted patients to do something (eg, take medication on time) and could be delivered through a designed telemedical system, mobile text messages, or telephone calls. Monitoring interventions were defined as interventions that transmitted vital signs or symptoms (eg, weight, blood pressure, or heart rate) to an external telemedicine center, which may lead to lasting improvements in behaviors. The eHealth intervention varied regarding intensity and the extent of the human component, although most trials provided the eHealth intervention every day ().

Primary OutcomesEffects of eHealth Interventions on All-Cause Mortality

A total of 15 studies reported all-cause mortality data. The 15 studies included 6610 participants and showed moderate heterogeneity (P=.05; I2=40%). The analysis showed that all-cause mortality was significantly lower in the eHealth intervention group than in the control group (OR 0.83, 95% CI 0.71-0.98, P=.03; GRADE: low quality) ().

Figure 3. Forest plot of the effects of eHealth interventions on all-cause mortality. View this figureEffects of eHealth Interventions on Cardiovascular Mortality

A total of 8 studies reported cardiovascular mortality data. The 8 studies included 4787 participants and had low heterogeneity (P=.42; I2=1%). The analysis showed that cardiovascular mortality was significantly lower in the eHealth intervention group than in the control group (OR 0.74, 95% CI 0.59-0.92, P=.008; GRADE: moderate quality) ().

Figure 4. Forest plot of the effects of eHealth interventions on cardiovascular mortality. View this figureEffects of eHealth Interventions on All-Cause Readmission

A total of 16 studies reported all-cause readmission data. The 16 studies included 4310 participants and had moderate heterogeneity (P=.02; I2=48%). The analysis showed that all-cause readmission was significantly lower in the eHealth intervention group than in the control group (OR 0.82, 95% CI 0.73-0.93, P=.002; GRADE: low quality) ().

Figure 5. Forest plot of the effects of eHealth interventions on all-cause readmission. View this figureEffects of eHealth Interventions on HF-Related Readmission

A total of 11 studies reported HF-related readmission data. The 11 studies included 4268 participants and had no heterogeneity (P=.98; I2=0%). The analysis showed that HF-related readmission was significantly lower in the eHealth intervention group than in the control group (OR 0.77, 95% CI 0.66-0.90, P<.001; GRADE: moderate quality) ().

Figure 6. Forest plot of the effects of eHealth interventions on heart failure–related readmission. View this figureSecondary OutcomesEffects of eHealth Interventions on HF Knowledge

A total of 4 studies reported HF knowledge data, 3 of which used the 15-item Dutch HF Knowledge Scale (DHFKS) []. One study used a modified questionnaire containing 14 questions, which has proven to be an adequate tool to evaluate the knowledge of Brazilian HF patients []. Higher scores across both scales indicate that the patients have more knowledge of HF. The analysis demonstrated an improvement in HF knowledge among patients in the eHealth intervention group compared with that in the control group. However, there was no significant difference between the eHealth and usual-care groups (SMD 0.35, 95% CI –0.10 to 0.81, P=.13; GRADE: very low quality), with significantly high heterogeneity between studies (P=.008; I2=75%) ().

Figure 7. Forest plot of the effects of eHealth interventions on heart failure knowledge. View this figureEffects of eHealth Interventions on Quality of Life

A total of 9 studies reported general quality of life data. Three of these studies used the HF-specific 23-item Kansas City Cardiomyopathy Questionnaire (KCCQ), in which higher scores indicate better quality of life []. Five of these studies used the Minnesota Living with Heart Failure Questionnaire (MLHFQ), which consists of 21 questions using a 6-point Likert scale []. Since lower scores of the MLHFQ indicate a higher quality of life, we calculated the change using the baseline score minus the final score. The analysis demonstrated an improvement in quality of life among patients in the eHealth intervention group compared with that of the control group. However, there was no significant difference between the eHealth and usual-care groups (SMD 0.04, 95% CI –0.03 to 0.11, P=.26; GRADE: moderate quality), with low heterogeneity among the 9 studies (P=.22; I2=25%) ().

Figure 8. Forest plot of the effects of eHealth interventions on quality of life. KCCQ: Kansas City Cardiomyopathy Questionnaire; MLHFQ: Minnesota Living with Heart Failure Questionnaire. View this figureEffects of eHealth Interventions on Medication Adherence

A total of 3 studies reported medication adherence data. The analysis demonstrated a significant improvement in medication adherence among patients in the eHealth intervention group compared with the control group (OR 1.82, 95% CI 1.42-2.34, P<.001; GRADE: low quality), with no heterogeneity among 3 studies (P=.63; I2=0%) ().

Figure 9. Forest plot of the effects of eHealth interventions on medication adherence. View this figureEffects of eHealth Interventions on Self-care Behaviors

A total of 3 studies reported self-care behavior data. Four of these studies used the European Heart Failure Self-Care Behavior Scale (EHFSC) []. Two of these studies used the EHFSC revised to a 9-item scale (EHFScB-9) [], and 2 used the self-care of heart failure index (SCHFI), which comprises three subscales []. Three of the 8 studies had imperfect data and therefore were not included in this meta-analysis. The analysis demonstrated a significant improvement in self-care behaviors among patients in the eHealth intervention group compared with the control group (SMD –1.34, 95% CI –2.46 to –0.22, P=.02; GRADE: very low quality), with significantly high heterogeneity among 5 studies (P<.001; I2=95%) ().

Figure 10. Forest plot of the effects of eHealth interventions on self-care behaviors. View this figureSubgroup Analyses

Since the inclusion criteria of the trials were different, which contributed to the heterogeneity of studies, subgroup analyses of primary outcomes regarding the enrolled population setting (after discharge or ambulatory clinic) were performed and the results are summarized in . Compared with patients in an ambulatory clinic setting, the eHealth intervention showed a larger effect in patients with HF after discharge on the reduction of all-cause mortality (OR 0.73, 95% CI 0.58-0.93, P=.01), cardiovascular mortality (OR 0.71, 95% CI 0.53-0.95, P=.02), all-cause readmission (OR 0.70, 95% CI 0.56-0.87, P=.001), and HF-related readmission (OR 0.75, 95% CI 0.56-1.00, P=.05) than the usual-care group. The results showed that the effects of an eHealth intervention may vary in certain population settings.

Sensitivity Analysis and Publication Bias

Sensitivity analysis was performed for the primary outcomes of meta-analyses, including all-cause mortality, cardiovascular mortality, all-cause readmission rate, and HF-related hospitalizations, using the leave-one-out approach. The direction and magnitude of the combined estimates did not vary markedly with the exclusion of individual studies, indicating the reliability of the findings (). The results showed no publication bias in the primary outcomes. No publication bias was detected for any of the primary outcomes. The funnel plots and linear regression test results of funnel plot asymmetry are shown in .


DiscussionGeneral Findings

There is a reasonable amount of original research exploring the effects of eHealth interventions in HF. However, among the 1884 articles we identified, only 24 met the inclusion criteria for this systematic review. The pooled results suggest that eHealth self-management interventions can improve primary and secondary outcomes in patients with HF.

Implementation ChallengesOverview

Although eHealth self-management interventions have the potential to improve chronic disease management, successful implementation in routine clinical practice is rare [,]. The main challenges in implementing and utilizing eHealth include user acceptance, standards and interoperability, regulations, ensuring cost-effectiveness and sustainability, and the organization and implementation environment, as discussed in turn below.

eHealth User Acceptance

End-user acceptance of eHealth products is the key to a successful eHealth program, which is influenced by many factors, although eHealth usability and user training seem to be more important. eHealth products need to improve the understanding of the design and development process from the user’s perspective, and focus on developing detailed representations of the user’s needs and wants [-]. Furthermore, the process of eHealth interventions is complex, which requires active participation, cooperation, and familiarity with the associated processes by all involved []. Through eHealth self-management, health care providers can connect more closely with patients, identify problems earlier, provide guidance, and improve patient compliance.

Standards and Interoperability

A successful eHealth self-management implementation requires unified integration with electronic health record (EHR) and clinical workflows to enable secure and fast access to patient data and information at various locations []. This requires interoperability within EHRs, as well as interoperability between EHR and eHealth self-management systems. Ultimately, intelligent eHealth self-management could reduce phone calls and paperwork by automating data exchange. However, eHealth self-management and EHR systems often lack interoperability and standards for clinical data exchange [,].

eHealth Regulations

There is also a lack of eHealth regulations, which is a major barrier to the development of eHealth []. The most common regulations used in eHealth implementation are national data and privacy protection laws and regulations, as well as national EHR and health financing legislation []. Health financing legislation is critical to ensure the continued sustainability and support of eHealth. National health service laws also provide guidelines for the use and implementation of eHealth [].

Cost-Effectiveness and Sustainability

The cost-effectiveness and sustainability of eHealth are key factors that directly affect the successful implementation of eHealth in practice []. Many of the costs relate to the development of the eHealth product, deployment, training, product iterations, services, or ongoing maintenance costs of the technology. eHealth self-management programs should ensure cost-effectiveness and sustainability of the program.

Organization and Implementation Environment

The hospital’s management capacity, human resources, and implementation environment are key obstacles to the successful implementation of eHealth []. In addition, eHealth technologies also need to fit the organization. The information literacy of patients and easy access to high-speed internet are conducive to the implementation of eHealth [,]. eHealth applications should be implemented on top of existing organization-centric and process-controlled systems []. This will benefit the efficiency and effectiveness of eHealth solutions and health care services, as well as support the development process and change in management.

eHealth Self-management in HF

eHealth self-management is a rapidly growing area of HF management, and considerable research is still needed to promote the widespread use of eHealth self-management and enhance its clinical outcomes. Future research should investigate how to expand the content of eHealth self-management tools while adapting to different HF patients. There is a need for a cost-benefit analysis of eHealth self-management, and how to most effectively integrate eHealth self-management into workflows and deploy it in different settings. Further work is needed to understand how eHealth self-management can help with the transformation of care delivery models and how to combine eHealth self-management with a workflow-oriented quality improvement program.

Limitations

Although this systematic review and associated meta-analyses showed that eHealth self-management interventions benefit patients with HF, this study has several limitations. First, the included studies varied in participant demographics, types of HF, sample size, assessment tools, period of interventions, and type of eHealth interventions, which can lead to heterogeneity and bias. Furthermore, reliance on self-reports and the use of questionnaires to score outcomes may lead to bias in self-reported data. Therefore, the results of this systematic review should be interpreted with caution. Second, participants were recruited at a single site or concentrated in a single population in some cases; thus, the resulting sample was not representative of the entire HF patient population, which would limit the generalizability of the findings. Finally, we only searched for literature in English, excluding other languages. This may limit the retrieval of non-English but related papers.

Conclusion

In this systematic review, we performed a literature search and provided a comprehensive overview of eHealth self-management in patients with HF. We observed that eHealth self-management can support the health of HF patients in many ways. However, the effectiveness of eHealth in the self-management of patients with HF is affected by multiple aspects and more clinical studies are needed to prove its effectiveness.

J Liu and SL conceived the study. J Li, SL, J Liu, DW, RL, ZQ, and YH performed the analysis, interpreted the results, and drafted the manuscript. All authors revised the manuscript. All authors read and approved the final manuscript.

None declared.

Edited by R Kukafka; submitted 12.04.22; peer-reviewed by P Li, M Dorsch; comments to author 09.07.22; revised version received 02.08.22; accepted 06.09.22; published 26.09.22

©Siru Liu, Jili Li, Ding-yuan Wan, Runyi Li, Zhan Qu, Yundi Hu, Jialin Liu. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 26.09.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.

留言 (0)

沒有登入
gif