IntroductionTobacco Consumption

The World Health Organization (WHO) considers smoking an epidemic that affects >1 billion people worldwide. It is a public health issue for many countries because tobacco use is one of the leading risk factors for a significant number of deaths and disabilities worldwide, and although preventable, the economic and social costs of disease burden remain very high []. On the basis of WHO recommendations, France’s national tobacco reduction program successfully addressed tobacco consumption, as the quit rate has been decreasing significantly since implementing several tobacco control policies in 2014 (ie, the reimbursement of approximately EUR €150 [US $166] per year for nicotine replacement products, monitoring of health warnings, media restrictions, and taxation of cigarette packs) [].

Although all these policies have had some success in increasing smoking cessation, the long-term abstinence rate is still extremely low despite 60% of worldwide smokers expressing their willingness to quit. In France, at least 29.9% of daily smokers tried to stop for at least a week the previous year without long-term success []. In addition, results from double-masked clinical trials show that the willingness to quit and actual reductions in smoking behavior are limited by the content of nicotine present in cigarettes, even in participants who were not initially interested in quitting [,]. Complex factors must be considered for long-term abstinence, such as the social influence of marketing misinformation about tobacco consumption, nicotine pharmacokinetics, everyday cue conditioning, withdrawal symptoms, and a comprehensive discussion of treatment options and goals [].

Treatment for Smoking Cessation

Multiple treatment approaches have been explored because of the complexity of tobacco dependence. To date, 2 major treatment categories have been used to treat tobacco use disorder: pharmacological treatments (eg, nicotine replacement therapy, bupropion, and varenicline) and nonpharmacological approaches (eg, motivational interviewing, cognitive and behavioral therapies, and acceptance and commitment therapy) []. In addition, new treatment goals have been proposed as alternatives to total and abrupt abstinence. These include gradually reducing cigarette consumption or using methods like snus and vaping to lower the risks associated with smoking, particularly for individuals with high nicotine dependence [,].

Both WHO and the French Ministry of Health recognize the impact of mobile health (mHealth) by promoting communication on social networks and using new technologies (eg, helplines, government mobile apps, and specific websites) to facilitate access to information and, thus, health care for smoking cessation [,].

mHealth Apps for Smoking CessationOverview

mHealth refers to emerging technologies for accessing health and medical services through mobile devices []. This includes mobile eHealth apps (known as mHealth apps), which are software that provide health and wellness services, designed exclusively for mobile devices (smartphones and tablets) []. With nearly 70% of the world’s population having a smartphone and access to the internet, mHealth apps can promote access to smoking cessation treatments []. mHealth apps can facilitate access to effective treatments and therapeutic information services by (1) adapting and translating “active principles” (the term used to refer to the various strategies and practices of evidence-based behavioral and cognitive therapies) into a digital format; (2) facilitating communication with health professionals, allowing a more flexible and personalized relationship (chat and social groups); and (3) encouraging a sense of responsibility and commitment to one’s health through “nudges,” such as positive reinforcement through messages or notifications, habit tracking, regular feedback, and audiovisual support [].

Despite the many benefits of using mobile apps for smoking cessation, research is still in its infancy. It faces specific challenges: the quality of content, the range of potential uses, and engagement with mHealth apps for smoking cessation.

Content Quality of Mobile Apps for Smoking Cessation

According to a systematic review and meta-analysis, there is a relationship between the number of cognitive and behavioral techniques used in smoking cessation programs and short- and long-term effectiveness []. However, according to a recent review of the content analysis of mobile apps for smoking cessation in France, in 2020, (1) the average quality of mobile apps was 3.5 out of 5 (median 3.1; range 1-3) based on the Mobile App Rating Scale, (2) most of the apps made little use of the “active ingredients” of evidence-based therapies (between 4 and 38 out of 93 indexed cognitive behavioral therapy [CBT] techniques), and (3) there was a lack of information that delivers proper advice regarding the use of approved pharmacotherapy or the implementation of behavioral techniques specific to helping people prepare for smoking cessation[]. In contrast, only some apps have been extensively studied and made available in France []; however, they still need to be presented using a proper taxonomy of behavior change techniques to facilitate further research on their mobile app content quality.

The Range of Potential Uses of an mHealth App

Current studies primarily address smoking cessation mobile apps as self-help material used as a stand-alone treatment by their users [-], not focusing on other treatment goals of smoking cessation interventions such as facilitating risk reduction and relapse prevention [,,]. Moreover, mobile apps can also be used as a complementary tool that enables continual accompaniment of the patient throughout their treatment by health professionals. The transtheoretical change model framework developed by framework of Prochaska and Prochaska [] will be used to illustrate this purpose.

This model states that a long-term change (ie, smoking cessation) results from different stages. Each stage has specific challenges; once addressed successfully, the person can continue their change journey by following the next stage. The first stages of change (precontemplation, contemplation, and preparation) are about raising awareness of the target behavior and creating an action plan by identifying the benefits of quitting, decreasing the perceived difficulties of change, and acknowledging the pharmacological and psychological therapy. Hence, mobile apps can highlight therapeutic information on dependency and how pharmaceutical aids work. Mobile apps can also be used as an ecological momentary assessment tool through which it is possible to monitor cravings in real time to collect information that helps to formulate hypotheses on the precipitating and maintaining factors that lead to tobacco consumption []. On the basis of the previous assessment, it is possible to individualize therapeutic interventions by understanding the individual experience of craving through repeated and ecological measures [].

In the action phase, the person can change the target behavior []. Therefore, to manage cravings differently instead of smoking, a person can experiment with new methods that can be transitional and complementary, such as the use of pharmacological (ie, nicotine replacement therapy or medications) and psychological substitute strategies (ie, avoiding a specific place or person). In this phase, mobile apps can be a tool that prompts experimentation of new strategies by giving different types of feedback on behavior (ie, monitoring nicotine consumption, meditation exercises, distraction activities, etc) as well as being a motivational levier that highlights the benefits of smoking cessation or its reduction in different aspects of the user’s life (health benefits and savings).

In the maintenance phase, “relapse” is perceived as the norm and not the exception, so it can be a learning opportunity in which the goal is to anticipate and prevent high-risk situations as well as navigate through the moment of the onset of craving by creating a relapse prevention plan []. Mobile apps can be a tool that helps monitor emotional changes and track withdrawal symptoms, both very common to relapse. On the basis of previous use, the mobile app can also provide feedback indicating treatment effectiveness and the risk of relapses.

As a result of these insights, Kwit app—a French mobile app initially conceived for maintaining smoking cessation—released the Kwit’s 9-step preparation program for smoking cessation (9s-Kwit’s program) in July 2021. A new feature specifically designed for users self-identifying as being in the preparation phase of smoking cessation according to the transtheoretical model of change developed by Prochaska and Prochaska [], this program is based on cognitive and behavioral therapy for smoking cessation as well as dialectical and behavioral therapy, motivational interviewing, and self-determination theory.

Engagement With Digital Interventions Such as mHealth Apps for Smoking Cessation in Real Settings

As in any treatment protocol, “adherence to therapies is an important determinant of treatment success” []. The smoking cessation intervention attrition rate could be as high as 77% []. Conversely, mobile apps for chronic diseases face similar challenges as other mHealth apps, with attrition rates ranging from 43% (95% CI 16-63) in randomized controlled trials to 49% (95% CI 27-70) in observational studies []. To date, the dropout rate of some smoking cessation apps tested in a controlled scenario could vary from 19.3% after 28 days of use [] to 39.5% after 87.3 days []. However, it remains to be seen what the attrition rate of smoking cessation mobile apps in ecological contexts would be [-], particularly with organic users. In this study, “organic users” or “organic installs”—terms primarily used in mobile app marketing—refers to individuals who discover and install a mobile app on their own, without any influence from paid marketing. Crucially, for the purposes of our research, these organic users are characterized by their autonomy to download the app and pursue smoking cessation. This autonomy distinguishes them significantly from users who participate in studies for compensation or who are mandated to use the app by health care institutions. Therefore, it is hypothesized that organic users will exhibit different behaviors and levels of engagement in smoking cessation compared to their nonorganic counterparts.

In conclusion, even if an app includes all the therapeutic guidelines, it can only be effective if used regularly [,,]. Understanding how users engage periodically with their health treatment is challenging for mHealth apps [,,]. Therefore, it is essential to identify and assess the main factors that favor using mobile apps for smoking cessation. To this end, the various research methods should ensure ecological validity in a design of evaluation setup that matches the user’s real work context [] and ensures that the behavioral responses obtained represent the natural behaviors of people who want to quit smoking with the help of a mobile app [].

The aims of this study were, therefore, to (1) explore, in an ecological context, the engagement rate of a 9s-Kwit’s program on a mobile app and (2) estimate the impact of the program on the motivation level among users who finished the program.

We hypothesized that (1) given the ecological context of this study, we will observe a remarkably high dropout rate between 80% and 95% of the users participating in the study. In addition, we sought to examine some key factors’ role in the Kwit program’s engagement rate. Specifically, (2) we hypothesized that the attrition rate within the intervention could be explained by the version of the program (basic and premium), the lack of relevance and understandability of the program content, the primary motivation to quitting smoking (ie, “money” or “family”), the lower levels of internalization to stop smoking (external motivation), and the lower level of motivation to quit before starting the program. Finally, we hypothesized that (3) users’ perception of their willingness, ability, and readiness to stop smoking will significantly improve after finishing the 9s-Kwit’s program.

MethodsOverview

This observational study was conducted from July 4, 2021, to July 28, 2021, in an ecological context. It represents the natural behaviors of people who downloaded and used the app to prepare for smoking cessation. In detail, this ecological context includes the following (1) the participants were organic users (users that installed the app because of their search results and without having encountered paid advertisements before onboarding); (2) only information essential for the everyday use of the mobile app was collected, and only data required for the study were exported to be analyzed (ie, no demographic data were collected before onboarding); (3) no compensation was offered to the users for their participation in the study; and (4) they checked a nonpreemptive box to give their consent to the collection and analysis of data related to their use of the app for research and improvement purposes. If an organic user chooses not to allow Kwit app to use their data for research, this preference is recorded in the server. This choice does not affect the quality of the services offered by the Kwit app. All users, regardless of their data use choice, have the option to access the premium version of the app. This ensures that there is no ethical compromise in the provision of services.

Ethical Considerations

The local French Ethical Committee (South-East) validated the protocol study on March 25, 2021. The research identification number is 2020-A02733-36, and the committee’s reference is CPP 20.10.02.44945 []. This study adheres to the ethical principles outlined in the Declaration of Helsinki. This feasibility study is part of a prospective study registered on April 8, 2022 (ClinicalTrials.gov NCT05318651). It aims to identify critical determinants of smoking cessation mobile app use among smokers seeking to quit.

Participants

Participants were aged at least 18 years and had a compatible smartphone (iOS 13.3 and above) with regular internet service. In total, 2 groups of participants were followed according to the type of program version they had access to, basic or premium.

Before participating in the program, participants were required to create an account that pseudonymized their personal information, including billing information where applicable. The Kwit app offered 2 versions: premium and basic. The choice between them was influenced by whether the participant opted for a 7-day free trial.

The premium version was available to users who opted for the free trial and provided full access to all features of the program. In contrast, the basic version limited the user’s access to only 4 levels of the program (steps 0, 1, 2, and 8). It is important to note that both versions visually presented the same program dashboard screen to ensure a consistent user experience. The user journey leading to the 9s-Kwit’s program dashboard is detailed in .

In terms of pricing structure, the premium version of the Kwit app was offered through a 7-day free trial during the study period from July 4, 2021, to July 28, 2021. This trial period gave users the flexibility to discontinue the service if they wished. After the trial period, if the subscription was continued, it was considered an agreement to a monthly membership fee of EUR €9 (US $9.96). This pricing was strategically set to approximate the cost of a pack of cigarettes in France at the time, aligning the cost of the app with a tangible smoking expense and making the value proposition relatable and practical for users.

Intervention

The 9-step Kwit’s program was developed after 2 years of research and development, as part of a PhD thesis, in collaboration with the University of Paris Nanterre. The content of this program was defined and coordinated by the cognitive behavioral psychologist and PhD student to be then executed by a team composed of a user experience designer, 3 software developers with at least 10 years of experience, a researcher in public health and clinical research, and 4 interns with a psychology master’s degree. The 9s-Kwit’s program has been developed for commercialization and designed for direct delivery as a mobile app intervention on Apple and Google Stores. This program is based primarily on cognitive and behavioral therapy for smoking cessation but is also inspired by dialectical and behavioral therapy, motivational interviewing, and the self-determination theory.

The 9s-Kwit’s program comprises 9 steps from step 0 (s0) to step 8 (s8). Through different activities, each step aims to explore a specific aspect of tobacco use that has already been identified as essential to consider in treating smoking cessation [,]. A presentation of the 9s-Kwit’s program’s home screen, a summary of its contents, and an example of the activity screen per step are presented in .

The presentation of the activity starts as follows: each activity starts with an informative screen that introduces the activity’s main goals, then the activity itself, and ends with a feedback screen (). When the user finishes an activity, the next one is unblocked. Different types of feedback coexist to inform the user that an activity is completed: (1) the color of the activity title changes (ie, in s0 from gray to blue), (2) information about the date and hour is presented instead of the average duration of the activity, (3) the icon next to the title activity changes from a lock to an arrow to show that the next activity is then accessible, and (4) the activities that are already done have a summary card if you click on it. Once all activities of the same step are completed, the next step is unlocked.

The initial step (s0) consists of becoming aware of one’s motivation to engage in a change process, but to change the target behavior, motivation alone is not enough; it is crucial to get out of “self-pilot” mode and adopt an “observer attitude” to understand the association between the target behavior, its antecedents, and its consequences. Therefore, in the first step (s1), users are encouraged to monitor their behavior and create a baseline of the contexts and intensity of cravings and the inner strategies that have helped them cope. The behavioral baseline provides users with an objective measure that assists them in recognizing patterns of cravings and helpful strategies. The second step (s2) focuses on the different components of dependency, and by using the Horn scale, it is possible to explain how opposing stimuli can induce people to smoke (ie, relaxation vs stimulation). On the basis of the results, users receive advice on new behavioral strategies. The third step (s3) proposes that users categorize cravings according to their short-term benefits (pleasure or relief) and then some mindfulness exercises. The fourth step (s4) defines a goal and a road map adapted to the user’s resources. Steps 5, 6, and 7 teach new coping strategies for the 3 dependence types (s5: environmental, s7: psychical, and s7: psychological). The final step (s8) invites users to define a quit date and acknowledge the cognitive barriers to quitting. The program encourages being kind to oneself when slips and relapses occur and celebrating each small step toward the desired change. None of the program versions used in this study have the gamification layer where users earn points at the end of each activity, have their avatar, or any educational reading content or community layout that now exists in the platform. details all activities of each of the 9s-Kwit’s program according to the taxonomy on behavior change techniques developed by Michie et al [].

Table 1. Overview of the behavioral and cognitive techniques (BCTs) and goals presented by step (s) and activity (a) of the 9s-Kwit’s program based on the taxonomy developed by Michie et al [].ABSa,bType of activityBCT number and labelas0a1Identify main reason to quit: health, well-being, economy, family, and planning a pregnancy1.9 Commitments0a2Identify the level of willingness, ability, and readiness to quit smoking using a visual analog scale1.9 Commitments0a3Define a landmark that recalls reason to quit when craving arises1.9 Commitments0a4Identify the degree of internalization of abstinence motivation using the French Smoking Cessation Motivation Scale1.9 Commitments1a1Introduction of the “plus bottom”: craving arousal monitoring for 24 hours: context, intensity, and action (let it go or smoke)2.1 Self-monitoring of the behaviors1a2Mindfulness exercises (3 minutes) focus on observing automatic responses when cravings arise, encouraging an observer’s attitude8.2 Behavior substitutions2a1Horn scale: physical, psychological, and behavioral dependency assessment2.7 Feedback on outcome of behaviors2a2Identify the relationship with smoking through an open self-questionary about when the behavior installs and the reason it maintains in the time4.2 Information about antecedentss3a1Identification of the most difficult craving to overcome in the journey and it impacts on the body and cognition5.3 Monitoring of emotional consequencess3a2Classify cravings into anchored (routine) and reflex (contextual) types4.1 Instruction on how to perform a behaviors3a3Mindfulness exercises (3 minutes)8.2 Behavior substitutions4a1Assessment of current resources available to execute an action plan1.4 Action plannings4a2Three types of experiences were proposed to be completed within 24 hours based on S4a1 for craving management: (1) “Act consciously” mindfulness exercises: for those not willing to stop smoking; (2) “Choosing your cravings”: based on S3a1, users anticipated strategies to reduce “anchored” cravings; and (3) “Overcoming all cravings:” users anticipated craving management strategies for all cravings1.1 Goal setting behavior and outcomes4a2Three types of experiences were proposed to be completed within 24 hours based on S4a1 for craving management: (1) “Act consciously” mindfulness exercises: for those not willing to stop smoking; (2) “Choosing your cravings”: based on S3a1, users anticipated strategies to reduce “anchored” cravings; and (3) “Overcoming all cravings:” users anticipated craving management strategies for all cravings11.1 Regulation by pharmacological supports5a1Assess nicotine dependency with the Fagerström Test for Nicotine and give proper feedback about dependency level and offer recommendations for pharmacological therapy options that could complement the app, if necessary8.2 Behavioral substitutions6a1Introduction of new features of the “plus bottom”: tracking nicotine substitutes or the vape consumption, mindfulness exercises, drinking water, and breathing exercises. Advise on how to avoid exposure to specific social and contextual cues12.1 Restructuring the physical and social environments7a1Identify barriers to quitting, such as learned helplessness, fear of withdrawal symptoms, and automatic behaviors related to craving management13.3 Incompatible beliefss7a2Recognize a behavior as it is and not as part of user’s identity13.4 Valued self-identitys8a1Identifying barriers to quit and propose some solutions to overcome it: the fear to stop smoking (eg, weight, stress, and concentration)8. Behavior rehearsals8a2Identify the level of willingness, ability, and readiness to quit smoking using a visual analog scale of s0a1 and give proper feedback13.3 Incompatible beliefss8a3Recognize old behavior goals and consolidate experience through feedback. Define a future quit date1.11 Review behavior goals

aThis program content is created based primarily on cognitive and behavioral therapy for smoking cessation as well as dialectical and behavioral therapy, motivational interviewing, and self-determination theories.

bActivity by step=first activity of the step 0 (s0a1).

Outcome Variables and Measurements

In total, 4 different types of measurements were used: ecological momentary assessment to measure engagement rate and version of the program (“a method of data collection whereby a record is made each time a predefined event occurs” []); a visual analog scale (VAS) to measure user’s perception of their willingness, ability, and readiness to quit smoking (the VAS slider ranged from 0 to 10); a Likert-type scale to measure the internalization degree to stop smoking, which can range from none (amotivation) to completely internalized (intrinsic motivation); and a multiple-choice question to measure user’s relevance and understandability of the program content and the users’ main reason to quit. Examples can be found in .

Engagement Rate Toward the 9s-Kwit’s program

The engagement rate is the ratio of users who completed the program from the first use (step 0) to the last activity proposed in 9s-Kwit’s program (step 8).

Motives for Quitting Smoking

On the basis of previous studies on reasons for quitting smoking [-], users were asked to choose 1 of 5 reasons: health, wellness, money, family, and planning a pregnancy, using the following statement: “My main reason for quitting smoking is...” ().

Motivation Level: The Willingness, Ability, and Readiness to Quit Scale

Using a VAS, users rated their perception of their willingness, ability, and readiness to quit smoking at the beginning (S0) and the end of the program (S0). For this purpose, each question was presented on a single screen and in the following order: (1) “To what extent this change is a priority for you right now?” (willingness), (2) “To what extent are you confident in your ability to change right now?” (ability), and (3) “To what extent do you feel ready to take action?” (readiness). This way, users could move a slider from 0 (lowest) to 10 (highest) on each screen (). For statistical analysis purposes, scores <3 are defined as “low,” scores between 4 and 7 are defined as “moderate,” and scores >7 are defined as “high.”

Nature of Motivation to Quit Smoking

The French Smoking Cessation Motivation Scale (F-SCMS) is a self-reported measure based on the self-determination theory, demonstrating good internal consistency (α=.86; ωh=0.7; ωt=0.89) and content validity (common-fit index=0.905, standardized root mean square residual=0.045, and root mean square error of approximation=0.087). The 18 items are divided into 6 subscales (each composed of 3 items) corresponding to the degree of internalization that participants have toward quitting smoking. The subscales are presented from no internalization to complete internalization of a behavioral change process: (1) amotivation, (2) external, (3) introjected, (4) mixed, (5) identified, (6) integrated, and (7) intrinsic motivation. We have previously validated the scale (F-SCMS) used in this study and explained the internalization process in a separate publication [].

The scale was presented as follows within the app. Each screen was composed from top to bottom in the following order: (1) the statement “Right now,” (2) the item appearing as a card, and (3) the list with 5 Likert-type response options ranging from 1 (does not match at all) to 5 (matches exactly). Once the user answered all the items, they could receive predefined feedback corresponding to their degree of internalization [].

Perceived Content Relevance of s0

The last activity of s0 of the program was the evaluation by the users of the comprehensibility and relevance of the contents presented during this step. The question was presented as “You have completed Step X. How would you define it?” with the following 3 options: (a) understandable and relevant, (b) understandable but irrelevant, and (c) not understandable and irrelevant.

Statistical Analysis

We performed descriptive analyses to characterize the 2 groups’ baseline samples and outcomes of interest. We conducted the Mann-Whitney test and a χ2 test of association to compare differences between both groups at the beginning of the program in terms of the main reason to quit, the motivation level to quit smoking, the nature of the motivation, and the perceived content relevance at the beginning of the program. We conducted a Student t test (2-tailed) to estimate the program’s impact on the motivation levels of the program completion for each group. For each test, a P value <.05 will indicate statistical significance. Analyses were conducted using Jamovi V2.3.8.

ResultsOverview

A total of 2331 users started the preparation program. Overall, 91.89% (2142/2331) of the initial sample used the basic version of the program, and 8.1% (189/2331) used the premium version. As a reminder, the app’s premium version allowed access to each program step’s activities (from s0 to s8), whereas participants with the basic version had access only to s0, s1, s2, and s8 activities.

presents the distribution of participants of both versions of the program in terms of (1) motives for quitting smoking, (2) motivation level to quit smoking, (3) motivation nature, and (4) perceived content relevance of step 0. In general, participants’ main reason for quitting smoking was health (1173/2331, 50.32%), followed by savings (450/2331, 19.31%), well-being (428/2331, 18.36%), family (172/2331, 7.38%), and planning a pregnancy (108/2331, 4.63%). At baseline, 80.65% (1880/2331) of the total sample was moderately motivated to quit smoking according to the Willingness, Ability, and Readiness to Quit (WAR) scale mean score, and 50.45% (1176/2331) fell into the 2 highest categories of internalization level for smoking cessation—integrated motivation (687/2331, 29.47%) and intrinsic motivation (489/2331, 20.98%)—according to the F-SCMS scale. Upon completion of step 0, the content of this step was considered by 71.55% (1668/2331) of the users as understandable and relevant (option A), by 10.98% (256/2331) as understandable but irrelevant (option B), by 0.82% (19/2331) as incomprehensible and irrelevant (option C), and 16.65% (388/2331) of the initial sample did not answer the question.

Table 2. The quantity and proportion of participants engaged in each activity of step 0a (motives for quitting smoking, level of motivation to quit smoking, nature of motivation, and perceived content relevance).
Total (N=2331), n (%)Basic step 0 (n=2142), n (%)Premium step 0 (n=189), n (%)Chi square (df)P values0a1b: Motives for quitting smoking19 (4).001
Health1173 (50.3)1073 (50)100 (52.9)


Well-being428 (18.4)384 (17.9)41 (23.3)


Savings450 (19.3)434 (20.3)14 (8.5)


Family172 (7.4)157 (7.3)14 (7.9)


Planning a pregnancy108 (4.6)94 (4.4)14 (7.4)


—c000

s0a2d: Level of motivation to quit smoking6.48 (3).09
Low144 (6.2)140 (6.5)4 (2.1)


Moderate1880 (80.7)1724 (80.5)156 (82.5)


High235 (10)212 (9.9)23 (12.2)


—72 (3.1)66 (3.1)6 (3.1)

s0a4e: Nature of motivation to quit smoking14.7 (7).04
Amotivation81 (3.5)78 (3.6)3 (1.6)


External224 (9.6)205 (9.6)19 (10.1)


Introjected88 (3.8)82 (3.8)6 (3.2)


Mixed250 (10.7)228 (10.6)22 (11.6)


Identified155 (6.6)138 (6.4)17 (9)


Integrated687 (29.5)635 (29.6)52 (27.5)


Intrinsic489 (21)436 (20.4)53 (28)


—357 (15.3)340 (15.9)17 (9)

s0: perceived content relevance9.70 (3).02
Option Af1668 (71.6)1516 (70.8)152 (80.4)


Option Bg256 (11)238 (11.1)18 (9.5)


Option Ch19 (0.8)19 (0.9)0


—388 (16.6)369 (17.2)19 (10)

as0: first step of 9s-Kwit’s program.

bs0a1: first activity of step 0.

cNot applicable.

ds0a2: second activity of step 0.

es0a4: fourth activity of step 0.

fIndicates understandable and relevant.

gIndicates understandable but irrelevant.

hIndicates not understandable and irrelevant.

Motives for Quitting Smoking

According to the χ2 test of association and Cramér value (n=2331; χ24=19; P≤.001; V=0.08), users of each version of the program have reported proportionally different reasons for quitting smoking. Those who choose to get the premium version of the program were less likely to choose savings as their main reason to quit smoking (premium=8.5% vs basic=20.3%) but more likely to choose the well-being (premium=23.3% vs basic=17.9%) and planning a pregnancy (premium=7.4% vs basic=4.4%) options.

Level of Motivation to Quit Smoking

Concerning the total score of the WAR scale, 3 levels of motivation were calculated based on the average score of 3 subscales: low (0-3), medium (4-7), and high (8-10). Most users (1880/2331, 80.7%) reported a moderate motivation to quit smoking at the beginning of the preparation program (s0; 1880/2331, 80.65%; mean 5.85 out of 10, SD 1.68). There was no significant difference between basic (n=2076) and premium (n=183) users when comparing these 3 categories (n=2331; χ23=6.48; P=.09) at s0a2. Nevertheless, when the ordinal data were compared using the Mann-Whitney test, the 2 groups differed significantly but with a very slight effect within the total score and every subscale. Users who had the premium version of the app reported feeling significantly more willing (z score=56,055; P≤.001; Cohen d=0.15), capable (z score=172,905; P=.04; Cohen d=0.09), and ready (z score=166,390; P=.005; Cohen d=0.12) to stop smoking than users who had the basic version before completion of the preparation program.

Nature of Motivation to Engage With a Smoking Cessation Process

The internalization degree of motivation to quit smoking differs significantly between basic and premium users according to the χ2 test of association (n=2331; χ27=14.7; P=.04). Premium users are less likely to score in the “amotivated” profile (premium=1.6% vs basic=3.6%) and more likely to be driven by intrinsic motivation (premium=28% vs basic=20.4%) to engage in a smoking cessation process. In addition, the proportion of participants for whom no answer was received is lower in the premium group than in the basic group (premium=17/183, 9% vs basic=340/2076, 15.9%).

Perceived Content Relevance of s0

The content assessment of s0 differs between premium and basic users according to the χ2 test of association (n=2331; χ23=9.7; P≤.02), and by contrast, there are fewer premium users for whom a response is missing (–7.2%).

Engagement Rate Toward the 9s-Kwit’s program for Smoking Cessation in an Ecological ContextOverview

As shown in , the engagement rate with the program drops significantly at 3 different moments. The biggest dropout concerns both samples (basic and premium) in between activities s0a4 and s1a1 (basic=–90.3% and premium=–70.1%). The second dropout was observed in the basic user sample between s2a2 and S8a1 (–4.2%), and the third dropout was within the premium sample from S4a2 to S5a1 (–12.5%). The proportion of participants who started each program activity is detailed in .

‎Figure 1. Engagement rate of the basic and the premium sample by activity for each step of the 9s-Kwit’s program. a: activity; s: step. Table 3. Proportion of participants who completed each activity of the 9s-Kwit’s program.Activities by stepsaTotal sample started, n (%)Basic sample started, n (%)Premium sample started, n (%)Chi-square test of association and Cramér value (df)P values0a12331 (100)2142 (100)189 (100)—b—s0a22259 (96.9)2076 (96.9)183 (96.8)——s0a32238 (96)1853 (86.5)174 (92)——s0a41998 (85.7)1825 (85.2)173 (91.5)7.8 (1).005s1a1265 (11.4)209 (9.7)56 (29.9)68.1 (1)≤.001s1a2236 (10.1)181 (8.5)55 (29.1)——s2a1195 (8.4)142 (6.6)53 (28)——s2a2184 (7.9)133 (6.2)51 (26.9)——s3a146 (1.9)046 (24.3)——s3a242 (1.8)042 (22.2)——s3a339 (1.6)039 (20.6)——s4a137 (1.6)037 (19.6)——s4a235 (1.5)035 (18.5)——s5a111 (0.5)011 (5.8)——s6a19 (0.4)09 (4.7)——s7a19 (0.4)09 (4.7)——s7a29 (0.4)09 (4.7)——s8a159 (2.5)50 (2.4)9 (4.7)——s8a257 (2.4)48 (2.2)9 (4.7)——s8a354 (2.3)44 (2)9 (4.7)5.43 (1).02

aThe percentage in brackets is calculated in relation to the initial number of participants per group.

bNot applicable.

In addition, based on the χ2 test of association and Cramér value, there is a significant difference between basic and premium users in terms of the engagement rate at the end of step 0 (s0a4; n=2331; χ21=7.8; P=.005), the beginning of step 1 (s1a1; n=2331; χ21=68.1; P≤.001), and the end of the preparation program (S8a3; n=2331; χ21=5.43; P=.02). Premium users were more likely than basic users to finish the last activity of step 0 (s0a4; premium=91.5% vs basic=85.2%), start the new step (s1a1; premium=26.9% vs basic=9.7%), and complete all the program’s activity until the definition of the quit date (S8a3; premium=4.7% vs basic=2%).

The Impact of the Program Completion on Users Who Finished the Program on Motivation Levels Toward Quitting

From an initial sample of 2331 ecological users, only 57 (2.4%) completed activity s8a2, which assesses the motivation levels regarding WAR scale. presents the WAR scale and subscales scores from the beginning (s0a2) to the end of the program (s8a2) of the 2 users’ groups who finished the program (57/2331, 2.4%) as well as the Mann-Whitney score.

Table 4. Description of the Total Willingness, Ability, and Readiness To Quit (WAR) scale scores and subscales at the start (s0a2) and end (s8a2) of the 9s-Kwit’s program (n=57).WAR scaleTotal sampleBasic sample (n=48)Premium sample (n=9)Mann-Whitney testaP value
Values, mean (SD)Values, medianValues, mean (SD)Values, medianValues, mean (SD)Values, medianUCohen db
Willingness
s0a27.46 (1.89)8.007.40 (1.87)7.007.78 (2.11)8.001880.12.54
s8a27.75 (1.91)8.007.63 (1.94)8.008.44 (1.67)9.001600.26.21Ability
s0a25.33 (1.89)5.005.02 (1.71)5.007.00 (2.06)7.00940.56.007
s8a26.25 (2.14)6.005.98 (2.09)6.007.67 (1.94)7.001180.45.03Readiness
s0a26.30 (1.99)6.006.23 (1.86)6.006.67 (2.69)6.002010.06.75
s8a26.86 (2.06)7.006.77 (2.05)6.507.33 (2.12)7.001840.15.48Total
s0a26.36 (1.37)6.336.22 (1.22)6.007.15 (1.68)6.331900.12.57
s8a26.95 (1.68)6.676.79 (1.64)6.677.81 (1.73)7.601440.32.13

aP values for the Mann-Whitney test were statistically significant at P<.05.

bCohen d effect size indicating the magnitude of the effect, where a small effect is approximately d=0.2, a medium effect is d=0.5, and a large effect is d=0.8.

To estimate the program’s impact on the motivation levels of the program completion, Student t tests were conducted within each group.

At the beginning of the program, users who finished (57/2331, 2.4%) reported feeling, on average, highly willing to quit smoking (7.46/10), moderately confident in their abilities to do so (5.33/10), and moderately ready to start the quitting journey (6.30/10). A Mann-Whitney U test was performed to assess whether scores on the WAR scale and its subscales differed significantly between users of each group both at the beginning and at the end of the program. The results indicated that only subscale Ability differs significantly between both groups’ samples (basic and premium), with a moderate effect size (U=6.86; z score=118; P=.02; d=0.45) before (s0a2) and after the program completion (s8a2). Users who had the app’s premium version reported feeling significantly more capable of smoking cessation than users who had the basic version before (basic=5.02; premium=7) and after (basic=5.98; premium=7.33) the completion of the preparation program.

Premium users who finished 9s-Kwit’s program reported, with a high effect size, significantly higher scores than at the beginning of the program on the Willingness subscale (t8=2.83; P=.02; Cohen d=0.9) and the total score of the WAR scale (t8=3.16; P=.01; Cohen d=1.05). Conversely, users who completed the basic version of the program (4 steps) reported, with moderate effect size, significantly higher end-of-program scores in the Ability subscale (t47=3.17; P=.003; Cohen d=0.46) and a total score of the WAR scale (t47=2.92; P=.005; Cohen d=0.42), and with low effect size, significantly higher end-of-program scores in the Readiness subscale (t47=1.857; P=.07; Cohen d=0.26).

DiscussionOverview

This study aimed, in an ecological context, to explore the engagement rate of a 9s-Kwit’s program on a mobile app (Kwit app); to examine some moderating agents that could contribute to the engagement rate we observed; and to estimate the impact of the program on the motivation level among users who finished the program. An ecological context refers to research conducted in natural, real-world settings as opposed to controlled laboratory environments. This approach is crucial for several reasons. First, it embeds our investigation in real-life scenarios where participants