記住我
Psychological distress, encompassing nonspecific symptoms of stress, anxiety, and depression, has been on the rise in the United States since 1999. More specifically, a 40% increase in prevalence was found from 2000 to 2018 [-] and was exacerbated by the COVID-19 pandemic [-]. One 2020 meta-analysis found the prevalence of stress in the general population to be between 29.6% and 33.7% []. This distress correlates with personal and occupational impairment, chronic medical disorders, adverse health behaviors, and increased mortality risk from diseases such as cardiovascular disease, cancer, and liver disease [-]. Depression and anxiety symptoms also predict absenteeism (missed work days) and presenteeism (low productivity days), costing an estimated 3% to 4% of the gross national product [-].
Despite the high prevalence, a large portion of affected adults do not receive necessary mental health support. Common barriers to mental health support in the United States include a desire for autonomy in the process, fear of social stigma, and lack of access (financially and structurally) [-]. Smartphone app–based mental wellness programs offer a promising solution, and the benefits of mobile mental wellness programs include increased convenience, adherence, personalization, social support, and cost-effectiveness [-]. However, research on their effectiveness is lacking [], with only 14% showing clinically validated evidence of effectiveness [], particularly among commercially available programs.
In response to the scarcity of clinical validation among these programs, we previously evaluated the feasibility and short-term efficacy of Noom Mood [], a commercially available, smartphone-based mental wellness program that provides educational content, skills-based activities, and nonclinical coaching support to help users manage stress and symptoms of anxiety. In this study, we extend our initial findings (at 4 weeks) to the full length of the intervention (at 16 weeks) and postintervention (at 32 weeks) in a larger sample. We also aim to contribute to important gaps within the literature by increasing our understanding of the efficacy and outcome maintenance associated with mobile mental wellness programs.
Research on the maintenance of outcomes after completing mobile mental wellness programs is currently scarce and is essential to inform postintervention support and establish long-term efficacy. Economides and colleagues [] provide some evidence that a reduction in anxiety and depressive symptoms can be maintained at 6 months post intervention. However, their analysis was retrospective, and follow-up assessments were limited. High-quality, long-term postintervention data are needed to better understand the full clinical utility of mobile mental wellness programming for the general population []. In addition, there are gaps in the existing literature looking at overall mental wellness, beyond mental health-related symptoms (eg, emotion regulation, coping, or quality of life). Despite theoretical and empirical assertions that smartphone-based programs can indirectly help improve mental wellness, such outcomes have not been widely studied [,].
This 1-arm prospective study examines the efficacy and postintervention outcomes of a commercially available mental wellness program on a broad range of mental health outcomes: symptoms of anxiety, stress, and depression, as well as well-being, quality of life, coping skills, emotion regulation, sleep, and workplace presenteeism and absenteeism. In doing so, this study contributes to the empirical foundation and clinical utility of such programming for the general population.
A total of 273 adults participated in this study. All participants were recruited from social media (ie, Facebook and Instagram) between May and September 2022, with advertisements targeting a 50% (50/100) female audience. Before enrollment, an online screening questionnaire confirmed eligibility. A total of 529 participants were recruited and screened for this study.
Participants were eligible for participation in this study if they were located in the United States, English-speaking, aged older than 18 years, used an Apple operating system mobile device, and agreed to not alter current mental health treatment, if any. Given the online nature of this study, they were required to verify their identity by uploading a photo of their state-issued identification card. They were also required to complete a decisional balance exercise to ensure a thorough understanding of and willingness to participate in this study. This exercise, based on the work of Goldberg and Kiernan [], aimed to increase study retention rates by discussing the nature, design, and importance of this study and required potential participants to consider all the pros and cons of participation before deciding whether or not to participate.
Participants were excluded if they had a current or past diagnosis of psychotic disorder or bipolar disorder; if they had started, stopped, or changed doses of psychotropic medication in the past 2 months; or had started or stopped psychotherapy within the past 2 months. They were excluded if they had used the Noom Mood program previously, or were currently using the Noom Weight program.
In total, 351 participants were eligible for participation. Eligible participants were provided informed consent forms and were required to download the app within 14 days to be considered fully enrolled. The final sample included 273 participants who downloaded the program and provided consent (see ).
Figure 1. Study flow CONSORT diagram. CONSORT: Consolidated Standards of Reporting Trials. Ethical ConsiderationsThis study was approved by the Advarra Institutional Review Board (Pro00062644).
Power Analysis and Sample Size CalculationThe sample size was determined based on an estimated medium effect on postintervention scores on our primary outcome, the 7-item generalized anxiety disorder scale (GAD-7), from baseline to end of the program, 95% power, and α set at .05. The effect size is based on an ITT analysis of the GAD-7 (d=0.70) from a previous Noom Mood feasibility study []. The sample size calculation was conducted using G*Power [] matched pairs t tests (2-tailed). Our recruitment target also accounted for 48% attrition, based on a recent meta-analysis of dropout rates in clinical trials with smartphone apps []. Therefore, this study aimed to recruit at least 247 participants in total.
Recruitment and EligibilityThe eligibility criteria of this study included the ability to understand and provide informed consent, willingness to not alter current mental health treatment (ie, psychotropic medications or psychotherapy), aged at least 18 years, English speaking, located in the United States, iOS user (because certain program features were only available on iPhones at the time of study launch), and successful identity verification. The ineligibility criteria included current or past diagnosis of psychotic disorder or bipolar disorder, past use of the Noom Mood program, starting, changing dose, or stopping psychotropic medication within the past 2 months, starting or stopping psychotherapy within the last 2 months, or current use of the Noom Weight program.
ProcedureParticipants were invited to complete the baseline questionnaire after consenting to participate in this study. As part of this study, participants were required to redeem a unique code and download the Noom Mood app within 14 days of consent, however, there were no further stipulations on participants’ level of engagement with the app. As part of this study, all participants had access to the full Noom Mood program, which consists of 16 weeks of content, at no cost. Participants were surveyed 4, 8, 12, 16, and 32 weeks after baseline. All surveys were administered online via OpenClinica, a HIPAA (Health Insurance Portability and Accountability Act)-compliant electronic data capture platform [].
ProgramNoom Mood is a commercially available, mobile app–based, mobile mental wellness program that focuses on stress and anxiety management as well as improving overall mental wellness. The program is based on cognitive behavioral therapy, dialectical behavior therapy, acceptance and commitment therapy, and mindfulness-based stress reduction with an emphasis on building a toolkit of coping skills that can be applied to daily life. Participants have access to several program features, including a daily curriculum consisting of psychoeducational articles for users to read, personalized coaching offered through in-app messaging, weekly skills-based activities, and a mood-logging feature. In a previous study of feasibility, acceptability, and preliminary outcomes, significant improvements in anxiety symptoms, perceived stress, depressive feelings, emotion regulation, and optimism were found from baseline to 4-week follow-up. Additionally, learning coping skills (eg, breathing and cognitive reframing techniques), interacting with the program features, and gaining awareness of personal emotions and thought patterns were the features of the program that participants reported benefiting most from [].
MeasuresOverviewThe primary outcomes of this study were self-reported measures of symptoms of anxiety, stress, depression, perceived health and quality of life, and mental wellness, detailed below.
Anxiety Symptoms (GAD 7)The GAD-7 [] assesses the extent to which individuals experience symptoms of anxiety (eg, “feeling nervous, anxious, or on edge”) on a scale of 0 (“not at all”) to 3 (“nearly every day”). Clinical severity was determined using a normed cutoff of 10 for this measure.
Depressive Symptoms (8-Item Patient Health Questionnaire Depression Scale)The 8-item Patient Health Questionnaire depression scale [] assesses the extent to which participants experience feelings of depression (eg, “feeling down, depressed, or hopeless” or “little interest or pleasure in doing things”) on a scale of 0 (“not at all”) to 3 (“nearly every day”). Clinical severity was determined using a normed cutoff of 10 for this measure.
Perceived Stress (10-Item Perceived Stress Scale)The 10-item Perceived Stress Scale [] assesses the frequency with which individuals experience various symptoms of stress (eg, “how often have you felt that you were unable to control the important things in your life?”) on a scale of 0 (“never”) to 4 (“very often”).
Mental Wellness (14-Item Warwick Edinburgh Mental Well-Being Scale)The 14-Item Warwick Edinburgh Mental Well-Being scale [] measures mental wellness. The questions (eg, I have been feeling “optimistic, useful, relaxed”) are answered using a scale of 0 (“none of the time”) to 5 (“all of the time”).
Absenteeism, Presenteeism, and Productivity Loss (Sheehan Disability Scale, Modified)The Sheehan Disability Scale [] is a scale that measures impairment in functioning (“how many days in the last week did your symptoms cause you to miss school or work or leave you unable to carry out normal daily responsibilities?”). Further, 2 items in particular were used for this study. Absenteeism was measured with the days lost item (“on how many days in the last month did your symptoms cause you to miss school or work or leave you unable to carry out your normal daily responsibilities?”); participants provided a number from 0 to 30. Presenteeism was measured with the days unproductive item (“on how many days in the last month did you feel so impaired by your symptoms, that even though you went to school or work, your productivity was reduced?”) Participants provided a number from 0 to 30. Productivity loss was calculated as the sum of absenteeism and presenteeism, similar to previous work [,].
Quality of Life (10-Item Patient-Reported Outcomes Measurement Information System Global)The 10-item Patient-Reported Outcomes Measurement Information System Global scale [] measures general health care–related quality of life (eg, “how would you rate your physical health?”) on a scale of 1 (“poor”) to 5 (“excellent”).
Sleep (Pittsburgh Sleep Quality Index)The Pittsburgh Sleep Quality Index [] is a 9-item scale used to measure sleep quality and patterns in adults. The first 4 questions (for instance, “when have you usually gone to bed?”) are free-response questions. The following 4 questions (eg, “during the past month, how often have you taken medicine [prescribed or ‘over the counter’] to help you sleep?”) use a scale of 0 (“not during the past month”) to 3 (“three or more times per week”). The final question (“during the past month, how would you rate your sleep quality overall?”) uses a scale of 0 “very good” to 3 “very bad.”
Emotion Regulation (Difficulties in Emotion Regulation Scale)The Difficulties in Emotion Regulation Scale [] is an 18-item scale that measures emotional dysregulation (eg, “I pay attention to how I feel”) and uses a scale of 1 “almost never” to 5 “almost always.”
Statistical AnalysisAll analyses were linear mixed-effects models. Dummy codes reflecting comparisons between baseline and all other time points were included as predictors of each primary outcome. Random intercepts were specified for all models. For count data (eg, absenteeism or presenteeism), a Poisson mixed-effects model was used. For categorical outcomes (eg, clinical cutoffs), logistic mixed-effects models were used. Maximum-likelihood estimation was used to account for missing data, which was relatively low (see below).
Participant demographic characteristics are presented in . Of the 273 participants, the mean age was 40.5 (SD 11.7) years. Nearly half (124/273, 45.4%) identified as female, 53.8% (147/273) as male, and 0.7% (2/273) as other, within a predominantly White, non-Hispanic sample (85%). A substantial portion of the sample possessed a college degree (103/273, 37.7%) or graduate degree (81/273, 29.7%). Income distribution spanned a wide range, with the majority reporting annual incomes of US $25,000-$50,000 (44/273, 16.1%), US $50,000-$100,000 (98/273, 35.9%), or US $100,000-$200,000 (70/273, 25.6%). Attrition was minimal and unlikely to introduce bias, with a maximum of 7% missing data reported at all time points.
Table 1. Participant demographics (N=273).DemographicsValueAge (years), mean (SD)40.5 (11.8)Gender, n (%)aN/A: not applicable.
bGED: General Educational Development.
RetentionOf the 273 participants who on a baseline survey with retention rates at the 4-week, 8-week, 12-week, 16-week, and 32-week surveys, respectively, were 266/273 (97.4% retention rate from baseline), 255/273 (93.4% retention rate from baseline), 245/273 (89.7% retention rate from baseline), 250/273 (91.6% retention rate from baseline), and 229/273 (83.9% retention rate from baseline).
Psychological DistressStatistically significant changes in anxiety symptoms, depression symptoms, perceived stress, well-being, and quality of life were observed by week 4 and maintained through program end (16 weeks) and follow-up (32 weeks, P<.001). The largest changes occurred between baseline and 4 weeks, with only small incremental improvements afterward, as shown in . Mixed-effects regression models, using random intercepts, were used to assess the impact of time on the aforementioned variables, as depicted in and and . All comparisons between program end (16-weeks) and follow-up (32-weeks) were not statistically significant (.29≤ P values ≤.99).
Figure 2. The effects of time on anxiety symptoms, depression symptoms, perceived stress, well-being, and quality of life. Points are jittered to avoid overplotting. bl: baseline; GAD-7: 7-item Generalized Anxiety Disorder Scale; PHQ-8: 8-item Patient Health Questionnaire depression scale; PROMIS: Patient-Reported Outcomes Measurement Information System; PSS: Perceived Stress Scale; WEMWBS: Warwick Edinburgh Mental Well-Being scale. Table 2. Changes in anxiety symptoms, depression symptoms, perceived stress, well-being, and quality of life at follow-up time points versus baseline (predictors).aBL: baseline.
Table 3. Changes in anxiety symptoms, depression symptoms, perceived stress, well-being, and quality of life at follow-up time points versus baseline (random effects).aICC: intraclass correlation coefficient.
Clinical SeverityAt baseline, nearly half of all participants met clinically relevant criteria for anxiety (130/273, 47.6%) and depression (130/273, 47.6%) symptoms. A mixed-effects binomial logistic regression with a random intercept was conducted to analyze changes in clinical severity. Reductions in the probability of meeting clinically relevant criteria for anxiety or depression were significant across all time points (P<.001), as shown in and . By week 4, the model estimates that only 10% and 12% met the criteria for anxiety or depression, respectively. By week 8, these estimated percentages further decreased to 8% and 9%. The substantial reduction in participants meeting clinical criteria for anxiety or depression was maintained on average through program end (16 weeks) and follow-up (32 weeks), as illustrated in .
Table 4. Changes in anxiety symptom severity and depression symptom severity at follow-up time points versus baseline (predictors).aBL: baseline.
Table 5. Changes in anxiety symptom severity and depression symptom severity at follow-up time points versus baseline (random effects).aICC: intraclass correlation coefficient.
Figure 3. Reductions in the probability of meeting a clinically relevant cutoff score of 10 for GAD and PHQ. Error bars represent SEs. bl: baseline; GAD: Generalized Anxiety Disorder Scale; PHQ: Patient Health Questionnaire depression scale. Overall Well-BeingSecondary effects of the intervention on coping, emotion regulation, sleep, and workplace absenteeism or presenteeism were examined via separate models for each variable. Absenteeism and presenteeism days were aggregated to form a comprehensive productivity loss outcome. A 0-inflated Poisson mixed-effects model with a random intercept was used for absenteeism and presenteeism. By program end (16 weeks), participants gained 2.57 productive work days from baseline, with this number remaining relatively stable (2.23 days) at follow-up (32 weeks). Effects across all well-being variables exhibited positive and significant trends at all time points (P<.001), as summarized in and and displayed in .
Table 6. Changes to well-being at follow-up time points versus baseline (predictors).aBL: baseline.
Table 7. Changes to well-being at follow-up time points versus baseline (random effects).aICC: intraclass correlation coefficient.
Figure 4. Plots of mixed-effects models for changes to well-being over time. bl: baseline; CBT: cognitive behavioral therapy; CBTSQ: Cognitive Behavioral Therapy Skills Questionnaire; DERS: Difficulties in Emotion Regulation Scale; PSQI: Pittsburgh Sleep Quality Index. This study contributes to research on mobile mental wellness interventions by examining the efficacy and postintervention outcomes of the Noom Mood program for the general population. The investigation addresses gaps in the existing literature by examining the impact of this type of intervention on mental health and well-being outcomes both postintervention and after a 16-week maintenance period. Using a prospective 1-arm design, our study evaluated the effects of Noom Mood on an array of mental health indicators and well-being measures, spanning from baseline assessment to a follow-up assessment 32 weeks later (16 weeks after the conclusion of the intervention phase). Promising results were seen in terms of improvements in mental health, workplace productivity, and well-being outcomes.
Our study benefited from several notable strengths. First, a major strength of this study was the achievement of retention rates ranging from 85% to 98%. Low retention rates are a widely acknowledged barrier to understanding and applying the results of digital health research. Other digital studies have often found the most successful retention rates (48%-56%) to still remain suboptimal [,]. The higher retention rates observed within this study are likely related to the screening practices used, such as the decisional balance exercise, which are designed to both select for and enhance participant motivation and commitment at this study’s start []. An additional strength of this study is the generalizability of the results. Given that we did not select individuals with a certain score on mental health measures, the results support the intervention’s ability to reduce distress and enhance well-being for this quite large group of individuals. Furthermore, we did not use a certain engagement threshold for this study, meaning that participants were able to use the app as much or as little as they liked, and the results remained promising. Finally, this type of mobile app–based intervention has a large potential for scalability.
Mental HealthMobile mental wellness apps have shown promising potential in providing support and resources for individuals experiencing stress, symptoms of depression, and symptoms of anxiety [,,]. Further, a study by Economides et al [] reported substantial and sustained improvements in depression and anxiety symptoms 6 months after an 8-week therapist-led smartphone-based intervention for elevated symptoms of anxiety and depression. Likewise, a recent systematic review and meta-analysis of mobile mental wellness interventions suggested the high potential of these interventions to improve (or significantly support the improvement of) mental health challenges such as depression and anxiety []. These findings underscore the potential for a prolonged positive impact of mental wellness interventions on major mental health dimensions.
Similarly, a recent systematic review and meta-analysis of 9 randomized controlled trials (RCTs) including 1837 participants also found small to medium effect sizes of mobile mental wellness apps on anxious symptoms, though when compared with an active control only small effect sizes were found []. Similarly, a meta-analysis of 18 RCTs including 3414 participants found that depressive symptoms were reduced significantly following a digital mental health intervention when compared with a control condition; effect sizes were small, however, when compared to active control conditions [].
Our findings showed statistically significant reductions within 4 weeks of program initiation for both anxiety and depression symptoms, assessed using the GAD-7 and 8-item Patient Health Questionnaire depression scales respectively. These initial improvements are maintained throughout the program, from the intervention’s conclusion at 16 weeks to the 32-week follow-up assessment. Outside of symptom reduction, we observed a significant reduction in the proportion of participants meeting clinically relevant anxiety and depression symptom criteria at all assessment points. Our findings align with other published results, however, the outcomes of the meta-analyses highlight the need for a study comparing Noom Mood with an active control condition.
Workplace Productivity and AccessibilityPrevious studies have shown a clear connection between mental health and workplace productivity [,-]. Further, a cross-sectional study found the mean days of absenteeism and presenteeism were significantly higher among participants with moderate or high psychological distress compared to low distress [], and a recent multi-arm, pilot RCT examining the outcome of digital interventions among working adults showed promising preliminary findings indicating improved depressive symptoms, well-being, and functioning following a digital intervention [].
In parallel, this study showed the potential of a mental wellness intervention to reduce both symptoms of depression and decreased workplace absences along with improved workplace focus. The personalized nature and convenience of mobile interventions allow them to be positioned as promising tools for reaching individuals with limited access to conventional mental health services.
Furthermore, to rationalize employer investment in mobile mental wellness programs, it is necessary to demonstrate their effectiveness in not only improving employee health and well-being but also in saving money. Previous studies have indicated that digital mental wellness interventions can reduce weekly costs by US $155.82 over 8 weeks []. Given the anticipated costs to employers associated with anxiety, stress, and depressive symptoms, there is a clear indication that scalable digital interventions such as Noom Mood have the potential to demonstrate significant cost savings within the workplace.
Well-BeingSeveral studies have cited the scarcity of research looking at various dimensions of well-being within the context of self-guided mobile mental wellness interventions [,]. The literature that does exist is somewhat ambivalent, with some studies finding improvements in well-being as a result of a digital mental wellness intervention and some not. For instance, a recent systematic review and meta-analysis found that digital mental wellness apps, when compared to controls, showed small effects for reducing mental health symptoms and improving well-being, but a medium effect for emotion regulation []. Another recent RCT found that the group using a mindfulness app for 4 weeks saw small reductions in stress and depression, but students who practiced more did not experience additional improvement in well-being [].
Our study reveals enhancements in well-being dimensions including coping skills, emotion regulation, and sleep quality, and suggests that mobile mental wellness programs are not only beneficial in terms of symptom reduction but also support a variety of well-being dimensions. However, given the existing literature, and the limitations of this study’s design, more rigorous testing is needed to better understand this association.
LimitationsLimitations of this study include the absence of a control group, lack of sample diversity, reliance on self-report measures, potential selection bias from recruitment via social media ads, and the potential impact of high retention rates on outcomes’ representativeness. Importantly, results should be interpreted with caution as this study’s design did not use a control group, meaning results could in part be due to the passage of time alone. This study advances understanding of the effects of a commercially available mental wellness program on various mental health outcomes and contributes potential insights into the program’s utility for the general population; however, robust research is needed to affirm the program’s efficacy, particularly across diverse populations.
ConclusionsIn conclusion, this single-arm prospective study examined 16-week and 32-week outcomes of the Noom Mood self-guided smartphone-based mental wellness program, including a 16-week maintenance period. Our outcomes showed positive impacts on mental health and well-being dimensions, both in terms of symptom reduction and broader psychosocial aspects, though outcomes are limited in scope due to the lack of a control arm in this study’s design. The results highlight significant improvements across all mental health and well-being outcomes at program end (16 weeks), which extend to postprogram follow-up (32 weeks). Significant improvements emerge as early as the first follow-up assessment, conducted 4 weeks after program initiation. These findings contribute to the evidence base of mental wellness programs and address gaps in the literature concerning maintenance and the comprehensive effects of a digital self-guided mental wellness intervention.
Future studies must include an RCT study design and a study population spanning diverse groups, accounting for race and ethnicity, education level, and income level. Additionally, future research should aim to understand the specific mechanisms underlying the observed improvements as well as explore the program’s scalability and feasibility within real-world settings. Further research investigating the program’s potential for long-term adherence and sustained outcomes may additionally provide valuable insights for both practitioners and researchers. Lastly, a direct comparison of the effectiveness of the Noom Mood program with similar interventions may shed light on the relative advantages and disadvantages of different approaches in the field of mobile mental wellness.
MM and ESM conceived this study. MM, PT, KB, and MCA carried out study management. MB analyzed data. PT, MF, and AH wrote this paper. AM and CNM provided supervision. All authors were involved in revising this paper and had final approval of the submitted version.
Authors MM, MB, PT, KB, MCA, and AM are employees at Noom Inc in the academic research department and have received salary and stock options for their employment. Authors MF, AH, ESM, and CNM were employees at Noom at the time of this study. This study was funded by Noom, which did not (other than the specific authors listed above) play a role in this study’s design, execution, analyses, interpretation of the data, or the decision to publish the results.
Edited by L Buis; submitted 17.11.23; peer-reviewed by A Serlachius, G Jonathan; comments to author 19.01.24; revised version received 21.02.24; accepted 22.05.24; published 27.06.24.
©Meaghan McCallum, Matthew Baldwin, Paige Thompson, Kelly Blessing, Maria Frisch, Annabell Ho, Matthew Cole Ainsworth, Ellen Siobhan Mitchell, Andreas Michaelides, Christine N May. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org), 27.06.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR mHealth and uHealth, is properly cited. The complete bibliographic information, a link to the original publication on https://mhealth.jmir.org/, as well as this copyright and license information must be included.
留言 (0)