IntroductionBackground and Rationale

Alcohol and other drugs are a major contributor to morbidity and mortality each year []. Most substance use disorders (SUDs) have a pediatric origin, and substance use remains among the most prevalent of adolescent risk behaviors [-]. In addition, motor vehicle crashes remain a leading cause of death among adolescents, and alcohol- or drug-impaired driving and riding with a driver who is substance impaired play a major role [].

Pediatric primary care offices, where the majority of adolescents receive health care [], are a promising venue for early identification of problematic substance use among adolescents and for brief intervention to prevent further problems. A substantial and increasing proportion of adolescents see a primary care clinician yearly [] and have trusting, longitudinal relationships with their clinicians []. Primary care visits are opportunities for private conversations that support adolescents’ autonomy and confidentiality while placing topics such as substance use in a nonpejorative health risk context.

The American Academy of Pediatrics (AAP) recommends alcohol, tobacco, and other drug use annual screening as part of routine care starting at age 11 years [,]. However, a national survey found that only approximately half of adolescents who had a past-year visit with a physician reported being asked about alcohol use [,]. Even when substance use screenings are performed, they can be of low quality if clinicians do not use a structured, validated screening tool or if they ask questions while caregivers are present [,]. Screenings also seldom include questions about substance-impaired driving or riding with a driver who is substance impaired []. Pediatric primary care clinicians also face barriers to brief intervention based on screen responses, including insufficient time during the appointment, a lack of familiarity with validated screening tools, and a lack of experience with managing care for patients who screen positive [-].

To overcome these barriers, digital technology can be applied to support consistent, effective screening and tailored intervention for adolescent substance use using evidence-based tools and approaches [,]. Clinicians may prefer to use technological tools such as tablet computers for previsit screening and electronic medical record–embedded decision support to enable brief intervention delivery []. Accordingly, we designed the CRAFFT (Car, Relax, Alone, Forget, Family/Friends, Trouble) Interactive System (CRAFFT-IS) to increase the frequency and quality of screenings in pediatric primary care, support a personalized response to results, and efficiently address alcohol and drug use and associated riding risks []. The CRAFFT-IS comprises a computer self-administered screening for patients (using the well-validated and widely used CRAFFT screening tool [-]), followed by psychoeducational content on the health risks of substance use, which adolescents complete before the clinician encounter. Clinicians access a computerized dashboard to view their patient’s screening results and prompts for brief motivational interviewing (MI)–based counseling tailored to their patient’s screening responses (clinician report).

CRAFFT-IS development was informed by the information-motivation-behavioral skills model [], the health belief model [,], and social cognitive theory [,]. These models posit that individuals’ health risk behaviors are predicted by their attention to the behavior, knowledge about its health impacts, perceived severity of the harms that could result, perceived benefits of avoiding the behavior, and perceived self-efficacy to avoid the behavior. The CRAFFT-IS uses an MI-based approach to alert patients’ attention to the topic of alcohol use within a health context, enhance their awareness and perceived severity of the potential health harms of alcohol use, and boost their motivation and self-efficacy to avoid use.

We tested an initial version of the CRAFFT-IS among adolescent primary care patients at 9 practices in 3 New England states (Connecticut, Massachusetts, and Vermont) using a quasi-experimental design in which each office served as its own historical control (usual care [UC] phase followed by intervention phase; details reported elsewhere) [-]. Compared to UC patients, intervention patients reported double the rate of receiving clinician advice about alcohol and, among those with prior drinking at baseline, had one-third lower drinking risk in the 3-month follow-up []. We also found a 22% lower risk for heavy episodic drinking (HED) among those with prior HED at baseline and a 30% lower risk for riding with a driver who is substance impaired [].

We then enhanced the clinician advice to include brief MI strategies (eg, eliciting a patient’s own reasons for avoiding use) while keeping the counseling brief enough for delivery by busy primary care clinicians. We pilot-tested this enhanced system compared to UC among adolescent patients seen for well visits at 5 Boston-area pediatric practices in a patient-randomized controlled trial. Intervention patients reported a 21% higher rate of receiving counseling about alcohol. Those reporting prior drinking at baseline (n=192) had a 34% lower risk for reporting HED during the 12-month follow-up []. Furthermore, those with riding risk at baseline (n=99) had a 42% lower risk of reporting riding with a driver who is substance impaired at the 12-month follow-up []. The CRAFFT-IS was also highly acceptable to the clinicians in the study, with 90% of the 49 clinicians agreeing that the system was useful, and 82% reporting that it increased their confidence in providing brief counseling [].

To evaluate the replicability of these findings in a larger, more geographically diverse sample, we are now conducting a multisite effectiveness trial of the CRAFFT-IS among adolescent patients aged 14 to 17 years presenting for a well visit at practices within the national AAP Pediatric Research in Office Settings (PROS) network. This trial uses a clinician-randomized design, plans an adequately powered sample, and tests the intervention more broadly beyond New England. The CRAFFT-IS being tested in this study includes an updated version of the CRAFFT screen that includes nicotine vaping, now a leading form of substance use among adolescents []. It also includes updated psychoeducation material to reflect more current scientific knowledge and a revised brief counseling protocol to enhance alignment with MI-based counseling approaches.

Objectives

The primary objective of the Adolescent Substance Use Prevention and Intervention Research (ASPIRE) study is to test the effect of the CRAFFT-IS on past 90-day HED over 12 months’ follow-up among adolescents who report past 12-month drinking at baseline. Our secondary objective is to test the effect of the CRAFFT-IS on riding with a driver who is substance impaired or driving while substance impaired (riding or driving risk) over 12 months’ follow-up. Additional exploratory study objectives include evaluating (1) hypothesized effect mediators (eg, perceived risk of harm and refusal self-efficacy) and moderators (eg, baseline risk level and gender), (2) efficacy for reducing the use of other commonly used substances among adolescents (ie, nicotine and cannabis), and (3) efficacy for reducing the negative consequences of substance use.

MethodsStudy Team

This study is being performed in the national AAP PROS network of pediatric primary care practices. The AAP PROS network consists of 67,000 pediatrician members whose guiding mission is to foster and conduct national collaborative practice-based research for improving child health. Boston Children’s Hospital (BCH) investigators are conducting the study in collaboration with the AAP PROS team. BCH conducts patient recruitment; participant retention; and data collection, management, and analysis activities. BCH also provides training and fidelity monitoring for clinicians delivering the intervention and convenes the data safety and monitoring board (DSMB). The AAP PROS team leads practice and clinician recruitment and data collection activities and hosts 2 PROS-member pediatrician advisors who provide input on study decisions from the perspective of community-based pediatric primary care clinicians.

Ethical Considerations

The AAP Institutional Review Board (IRB) is the single IRB for the study. The AAP IRB initially approved this study on May 27, 2022, after full board review (#22 HA 01). Approval included a waiver of parental permission and a partial waiver of Health Insurance Portability and Accountability Act (HIPAA) authorization. We sought a partial waiver of HIPAA authorization because patient recruitment activities involve the exchange of patient health information from practices to the BCH study team. Furthermore, we sought a waiver of parental permission due to the minimal risk nature of the study, the developmental maturity of the target sample (adolescents aged 14-17 years), and the sensitivity of the substance-related topic. Our previous study on consent in adolescent substance use research showed that requiring parental permission resulted in a substantially higher study refusal rate (60% vs 20%) and a sample biased toward lower levels of substance use and substance-related problems []. Importantly, recruitment and assent materials state the voluntary nature of the study, emphasize that eligible adolescents do not have to have used alcohol or other substances to join the study, and encourage—but do not require—adolescents to discuss the study with their caregivers. The combination of these conditions supports parental involvement, preserves the privacy and confidentiality of adolescents who do use alcohol or other substances, and acknowledges adolescent autonomy to make an informed decision about participating.

The protocol version described in this paper was approved on June 21, 2023. Should there be modifications to the approved protocol or study materials, we will submit an amendment to the AAP IRB, and if applicable, the relying IRB at BCH. In addition, we will report scientific changes to the National Institute on Alcohol Abuse and Alcoholism (NIAAA) as needed or in the yearly progress report, at which point we will also update the trial registry on ClinicalTrials.gov.

In this trial, patient privacy and confidentiality protection is supported by executing a data transfer agreement between participating practices and BCH, assigning patients a numeric study identifier and by storing identifiable data in secure and restricted-access network locations separate from survey data. This study operates under a National Institutes of Health certificate of confidentiality. Assent materials state that only deidentified data will be shared outside of the study team (refer to the Data Access and Dissemination subsection).

Participating clinicians and practice staff members are required to provide informed consent. AAP PROS staff will send study recruitment materials to the designated contact clinician at each potentially eligible practice. Practices that are interested in participating will have a designated lead clinician submit a practice intake survey to confirm study eligibility of the practice and its clinicians. If practices are eligible, the AAP PROS staff will obtain written informed consent from all participating clinicians () as well as designated practice staff members who will handle and exchange patient data, answer patient or family questions, and otherwise support study activities at their site. Each participating practice will be offered a US $1000 honorarium after concluding patient recruitment at their practice and be able to keep all intervention-related materials, including the tablet computers provided for CRAFFT-IS implementation. Clinicians will be offered lunch accommodations (up to US $25 per person) for attending study orientation training and debriefing focus groups. In addition, clinicians in both trial arms can receive up to 12 continuing medical education credits for completing study training activities (UC clinicians will be offered CRAFFT-IS training at study completion at their practice). Board-certified pediatricians in the intervention arm may also receive optional maintenance of Certification Part 4 (up to 25 points) for a quality improvement activity spanning at least 3 quarterly feedback cycles. To complete this certification, intervention clinicians receive their participating patients’ aggregated postvisit data reporting receipt of counseling and compare their performance with a standardized benchmark. Intervention clinicians receive a US $5 electronic merchandise gift card for attending an optional office hour with the trainers by videoconference every 1 to 2 months and US $10 for completing a debriefing survey about their experience of, and views about, the CRAFFT-IS at study completion.

Adolescents must provide verbal informed assent to participate (). On a regular schedule (eg, every 2 weeks), each practice will send a BCH research assistant (RA) a list of age-eligible adolescent patients with upcoming well visits in the next 2 to 6 weeks. The BCH RA will then mail a study invitation coaddressed to adolescents and their caregivers, which includes an informational letter on the practice’s letterhead and a study flyer with a QR code that leads to the brief study eligibility survey. Recruitment materials emphasize that adolescents do not need to have used substances to join the study, just as those with riding risk do not need to have used a substance themselves. Within 2 weeks of an adolescent’s scheduled visit, the RA will attempt to contact the adolescent by telephone to invite them to complete the eligibility survey, which the RA, based on the adolescent’s preference, can administer verbally or send for self-completion using an electronic link by SMS text message or email. At any point, a caregiver or adolescent can opt out of being contacted further. Eligible patients will be directed to an electronic information sheet and a 5-minute video brochure developed in collaboration with youth advisors. During a telephone call before the adolescent patients’ visit, a BCH RA will summarize key information using a standard assent script. If willing to join the study and able to answer 6 questions assessing study understanding correctly, adolescents will have the option to discuss the study with a parent or guardian and may then provide their verbal assent to participate. Adolescents who turn 18 during the study period will be asked to consent as an adult on or near their 18th birthday.

In addition to obtaining study assent, we will ask adolescents whether they assent or decline to have their deidentified study data shared with the NIAAA Data Archive (NIAAADA), a national data repository to which NIAAA-funded investigators conducting human subjects research are expected to submit deidentified individual-level data []. This data sharing is not a condition of study participation and does not require parental permission. Adolescents can receive up to US $100 in small-value merchandise electronic gift cards for completion of study surveys (US $5, US $10, or US $15 for a survey, depending on its length).

Study Design and Randomization

The study is a cluster randomized controlled trial involving 2 arms, intervention (CRAFFT-IS) and control (UC), with prospective follow-up for 12 months. Clinician randomization occurs within practice and on a rolling basis as practices enroll into the study. Participating pediatric primary care clinicians (doctor of medicine [MD], doctor of osteopathic medicine [DO], nurse practitioner [NP], and physician assistant [PA]) are randomly assigned to 1 of the study arms in a 1:1 ratio. Randomization is performed using a computerized, adaptive biased coin minimization scheme, which minimizes imbalance on the following factors, ranked by priority: clinician type (MD or DO vs NP or PA) and years in practice (≥10 vs <10) [,]. Compared to permuted blocks, adaptive biased coin minimization randomization has superior efficiency for achieving balance across multiple factors in studies with small units of randomization.

Clinicians are assigned a unique numeric code for temporary blinding while being randomized. After randomization, clinician study arm assignments are unblinded and shared with the study team. Study arm assignments cannot be blinded because the study team needs to train clinicians according to group assignment.

Study Population, Sample Size, and Statistical PowerPractices and Clinicians

We will recruit up to 20 practices within the AAP PROS network, with up to 40 clinicians enrolled across these practices. To be eligible to participate, practices must (1) have at least 2 interested and eligible clinicians (clinician eligibility criteria are presented later in this subsection), (2) have a high-speed wireless internet connection available to ensure connectivity of study tablet computers, and (3) have an adolescent patient population that is primarily English speaking (the CRAFFT-IS has, to date, been tested only in English). Practices must not (1) be a practice or continuity clinic where residents or medical students routinely provide adolescent care (because trainees may not be available for training, implementation, and data collection for the duration of the practice’s participation in the study) or (2) have recently participated or be participating in other initiatives to improve adolescent substance use screening and brief intervention in their practice. Eligible clinicians (1) must be a clinician (MD, DO, NP, or PA) who sees patients for well visits and (2) must see ≥6 adolescents aged 14 to 17 years per week, on average, or approximately 300 adolescents per year, for well visits.

Adolescents

We aim to enroll a minimum of 1300 adolescent participants. Eligible adolescents must (1) present for an annual well visit with a participating clinician in either study arm, (2) be aged 14 to 17 years at the time of their well visit, (3) report past 12-month alcohol use or past 12-month riding risk, and (4) have a smartphone and be willing to share their mobile phone number with the study team. We chose the minimum age of 14 years because there is low prevalence of prior alcohol use among younger adolescents (<5% of adolescents aged 12-13 years in our prior studies reported past 12-month drinking [Harris SK, unpublished data, 2019]). In addition, to be considered fully enrolled, all adolescents must complete the previsit survey before seeing their clinician, as well as the CRAFFT screen for those scheduled to see a clinician in the intervention arm. Adolescents must be willing and able to complete monthly surveys for 12 months after their well visit.

Adolescent patients must not be (1) in foster care, (2) in college or trade school at the time of their well visit, (3) currently receiving counseling or treatment for a substance use concern from a specialty clinician, or (4) perceived by their clinician to be inappropriate for the study (eg, due to neurodevelopmental delays or another medical priority at the time of visit).

We calculated the adolescent patient sample size by applying recruitment and retention rates, alcohol use and riding risk prevalence rates, intervention effect sizes, a within-clinician clustering design effect (0.90), and the clinician intraclass correlation coefficient for HED (0.008) seen in our pilot study []. We estimated a 37% past 12-month drinking prevalence rate, 28% riding risk prevalence rate among adolescents with past 12-month drinking, and a 5.8% riding risk rate among those with no past 12-month drinking. The 37% past 12-month drinking prevalence rate is similar to the 36.1% prevalence rate found on the 2018 Monitoring the Future Survey []. We applied slightly more conservative rates of participation (80% vs 82%) and retention (70% vs 75%) than those found in our pilot study to ensure that we achieve a sample size with sufficient power. With α set at ≤.05 and β at ≥.80, our power calculation indicated that a minimum analysis sample size of 888 participants with 12-month follow-up data would provide 86% power to detect an effect size of ≥20% in our primary outcome measure of HED. Applying the conservative estimate of 70% retention at 12 months, we need to recruit a minimum of 1268 participants. Thus, we estimate needing approximately 4200 adolescents to complete the eligibility survey, with 1600 (40% of those screened) meeting eligibility criteria, and 1300 (80% of those eligible) enrolling. To enroll this sample, we anticipate enrolling an average of 40 patients per clinician among up to 40 clinicians completing the study.

InterventionOverview

The CRAFFT-IS was developed to leverage the power of digital technology to provide a time-efficient and feasible way for busy pediatric practices to improve both the frequency and quality of adolescent substance use screening and counseling in primary care. To this end, the CRAFFT-IS consists of the following components: (1) previsit self-administered screen (CRAFFT version with extra questions that are related to nicotine vaping and tobacco use [CRAFFT 2.1+N]), immediately followed by (2) brief interactive psychoeducational content on substance use–related health risks, and (3) clinician delivery of brief MI-based counseling during the confidential portion of the well visit, guided by a computerized point-of-care decision support tool called the clinician report. In addition, as an intervention to reduce riding and driving risk, intervention clinicians provide all participating patients and their caregivers with the Contract for Life document [,]. These components are described in greater detail in the following subsections.

Previsit Screening

To complete the previsit self-administered substance use screening, adolescents will log in to a secure website via their smartphone (before or at visit) or a tablet computer (at visit only) and complete the CRAFFT 2.1+N, which assesses past 12-month substance use frequency, substance-related riding and driving, and signs of problematic use (eg, uses when alone) []. At a cut point of ≥2 yes answers, the CRAFFT is highly sensitive (91%) and specific (90%) for detecting SUD in adolescents []. The CRAFFT 2.1+N includes an item on past 12-month days of nicotine vaping and tobacco use and, if yes, an item on past 30-day use. Endorsement of past 30-day nicotine vaping or tobacco use is followed by the Hooked on Nicotine Checklist (HONC), a well-validated 10-item screen for detecting loss of autonomy over nicotine use in adolescents []. This study will use a modified HONC that incorporates nicotine vaping.

After completing the substance use screen, adolescents will be asked to choose up to 3 personal values from a prespecified list of 14 values (eg, creativity, family, honesty, and wealth), with the option to write in their own. The selected values are presented in the clinician report to support clinician-patient rapport building and patient-centered MI-based counseling.

Previsit Psychoeducation

Next, adolescents view brief interactive psychoeducational web pages on the health risks of substance use. These web pages illustrate the unique vulnerability of adolescents to the health harms of substance use through the presentation of scientific evidence and true-life stories of adolescents. We developed this content based on input from focus groups of youth who reported that this type of information was compelling []. For this study, the content was updated to include information about the health risks of nocotine vaping.

Clinician Report and Brief Counseling Protocol

The clinician report is a web-based dashboard designed to help clinicians efficiently view their adolescent patients’ responses to the substance use screening and values items and deliver brief counseling tailored to the responses. On the basis of the screening responses, counseling guidance is tailored to 1 of three substance use profiles: (1) recent use (use of alcohol, cannabis, or another drug in the past 3 months or use of tobacco or nicotine in the past 30 days), (2) distant use (use of any substance in the past 12 months but not in the past 3 months or past 30 days for nicotine vaping and tobacco), and (3) riding risk (no past 12-month substance use but past 12-month riding in a vehicle with a driver who was substance impaired).

The brief counseling protocol is a modified form of the brief negotiated interview, a structured MI-based counseling intervention originally developed for use in emergency departments and found to be efficacious in reducing substance use in adolescents []. The counseling protocol is designed for delivery in 5 to 10 minutes, depending on the severity of risk. Counseling steps are summarized in .

Table 1. Overview of the Adolescent Substance Use Prevention Intervention Research (ASPIRE) multisite cluster randomized controlled trial’s brief counseling protocol, which is delivered by intervention clinicians to participating adolescent patients who present for a well visit and report past 12-month alcohol use, past 12-month riding risk, or both.Counseling protocol stepsRecent useaDistant usebRiding riskc1. Engage and build rapport✓✓✓2. Review screening results and assess further✓✓✓3. Consider pros and cons of substance use (decisional balance)✓

4. Discuss health risks of substance use and riding risk✓✓✓5. Evaluate readiness to change substance use (readiness ruler []) and reasons for change✓

6. Elicit next steps toward behavior change and anticipate challenges✓✓✓d7. Wrap up by summarizing discussion and affirming autonomy and self-efficacy✓d✓d✓

aPatient reports past 3-month substance use. Patient may or may not report past 12-month riding with a driver who was substance impaired.

bPatient reports past 12-month substance use but no past 3-month use. Patient may or may not report past 12-month riding with a driver who was substance impaired.

cPatient reports past 12-month riding with a driver who was substance impaired and no past 12-month substance use.

dClinician provides patient with the Contract for Life [].

Recent use counseling uses the MI style of communication to elicit the adolescent’s reasons for and problems with substance use. The clinician discusses the adolescent’s values, shares health information, explores the adolescent’s reasons for and readiness to change their substance use behavior using a readiness ruler [], and guides the adolescent through planning behavior change. The counseling concludes by summarizing the discussion and affirming the adolescent’s autonomy and self-efficacy. Distant use counseling involves affirming and supporting the adolescent’s continued nonuse, discussing health risks associated with past substance use, and anticipating and planning for challenges with maintaining abstinence. Riding risk counseling also includes affirmation and support of the adolescent’s continued nonuse, discussion of health risks associated with riding with a driver who is substance impaired, and counseling to identify and plan safe transportation at all times. Both the distant use and riding risk counseling protocols are guided in a structured step-by-step manner similar to recent use counseling.

Near the end of the brief tailored counseling, intervention clinicians provide all participating patients with a paper or electronic version of the Contract for Life. Developed by Students Against Destructive Decisions, the Contract for Life asks youth and their caregivers to develop and commit to a plan to ensure that adolescents always have a safe ride home with a sober driver [].

Intervention Training and Fidelity Monitoring

Two clinicians with expertise in MI train intervention clinicians to deliver the intervention counseling. Training was initially structured as 5 self-study modules on a web-based learning platform and 5 live sessions with expert trainers (approximately 7 total training hours). As scheduling the 5 live sessions was found to be challenging with the first practice, the study team restructured the training to include longer self-paced asynchronous modules to reduce scheduling challenges without changing the total number of training hours. The updated training schedule consists of 5 self-study modules with recorded lectures, 2 live counseling practice sessions, and 1 live technical training session to orient clinicians to the clinician report and tablet computers.

The self-study modules include video-recorded presentations on MI-based counseling principles, the counseling steps for each of the 3 risk categories, video-recorded mock counseling demonstrations with accompanying annotated transcripts, and self-assessment questions. In the 2 live sessions, the expert trainers guide clinicians through case-based practice of the counseling steps and provide feedback.

To establish baseline competency, each clinician completes the counseling steps with a standardized patient for each of the 3 risk categories in a single recorded videoconference session. The trainers and 2 research staff members review these recordings using a standardized rating form. The trainers then meet with each clinician for individualized feedback and coaching. For fidelity monitoring, clinicians complete mock counseling sessions and receive feedback quarterly. In addition, the intervention trainers host optional live videoconference sessions (office hours) every 1 to 2 months for extra coaching.

Intervention Modification or Discontinuation

No concomitant care and interventions are prohibited during the trial beyond those defined in the practice inclusion criteria. We will withdraw a participant from the study if there is evidence to suggest that continuing in the study may be inappropriate (ie, there are intervening medical, mental health, or social circumstances that preclude or disrupt participation). Data collected from withdrawn participants will still be used in the analysis.

Outcomes and MeasuresStudy Activities and Assessment Timeline

illustrates the chronology of participating clinician and adolescent study activities.

‎Figure 1. Chronological overview of clinician and adolescent milestones during the Adolescent Substance Use Prevention Intervention Research (ASPIRE) multisite cluster randomized trial. CRAFFT: Car, Relax, Alone, Forget, Family/Friends, Trouble. Outcome Measures

A detailed listing of study outcome measures, their reference sources where applicable, and time points of data collection is presented in , and thus they are only briefly described here. These measures are also reported in the ClinicalTrials.gov registry.

Our primary outcome measure is past 90-day HED, as reported by adolescents during the 12-month follow-up period, among adolescents who report past 12-month drinking at baseline. HED is defined using the age- and sex-specific cut points recommended by the NIAAA: ≥3 drinks on a single occasion for youth assigned female at birth who are aged 14 to 17 years, ≥4 drinks for youth assigned male at birth who are aged 14 to 15 years, and ≥5 drinks for youth assigned male at birth who are aged 16 to 17 years []. Our secondary outcome measure is any past 90-day riding with a driver who was substance impaired (who used alcohol, cannabis, or another drug) or driving while substance impaired. The exploratory outcomes of interest include past 90-day days of use of other commonly used substances among adolescents (ie, nicotine and cannabis) and experience of negative consequences associated with alcohol use (eg, missing school or work and getting into trouble at school, home, or work). In addition, we will explore the following intermediate outcome measures as hypothesized effect mediators: (1) report of readiness to reduce or stop alcohol use using a readiness ruler [], (2) perceived risk of harm from use, and (3) self-efficacy to refuse alcohol.

Table 2. Adolescent participant study assessment measures by data collection time point across 12 months in the Adolescent Substance Use Prevention Intervention Research (ASPIRE) multisite cluster randomized controlled trial.MeasureData collection time point
Eligibility surveyPrevisit surveyCRAFFT-ISaPostvisit surveyMonthlyb3 mo6 mo9 mo12 moPrimary outcomes
Heavy episodic drinkingc

TLFBd,e [,]
✓

✓✓✓✓✓

AUDIT-Cf,e []
✓

✓✓✓✓✓
Substance useg (CRAFFTh [,] on eligibility and TLFB all other times)✓✓

✓✓✓✓✓
Negative consequences

Negative consequences of alcohol and cannabis use scalese []
✓


✓✓✓✓

PEIi Personal Consequences Scalee [,]
✓


✓✓✓✓

NCANDAj studye []
✓


✓✓✓✓Secondary outcome
Riding and driving risk frequency

National College Alcohol Studye []
✓


✓✓✓✓

Young Adult Driving Questionnairee []
✓


✓✓✓✓

Adapted from previous cSBIk studies [,]
✓


✓✓✓✓Other measures
Hypothesized mediators

Readiness to reduce or stop use (readiness ruler [] used in previous cSBI study [])
✓
✓






Perceived risk of harm (National Monitoring the Future Surveye [])
✓
✓
✓✓✓✓

Refusal self-efficacy (DRSEQ-SRAl,e [])
✓
✓
✓✓✓✓

Receipt of health services for substance use (adapted from previous cSBI study [])




✓✓✓✓
Control variables

Substance use severity profile


CRAFFT✓
✓








TLFB
✓

✓✓✓✓✓


ASSISTm,e []
✓


✓✓✓✓

Peer substance use (PEI)
✓


✓✓✓✓

Family substance use (PEI)
✓



✓
✓

Patient-clinician relationship


Number of previous visits with clinician


✓







Youth Connectedness to Provider Scale [,]


✓





Process measures

Intervention duration (new)

✓







Visit format (new)


✓






Protocol adherence and visit quality (adapted from previous cSBI studies [,])


✓






Contract for Life [] discussion with caregivers (adapted from previous cSBI study [])




✓



Validation of modified HONCn

Nicotine use disorder risk


HONCe [,]

✓








PROMIS-Eo,e []
✓







Other exploratory variables

Quality of life and overall health


CHU9Dp []
✓


✓✓✓✓


PATHq Study []
✓


✓✓✓✓


YRBSr,e []
✓


✓✓✓✓

Sexual and gender minority status (YRBS and others [-])✓



✓✓✓✓

Social determinants of health


MSPSSs []
✓


✓✓✓✓


YRBS
✓


✓✓✓✓

aCRAFFT-IS: CRAFFT (Car, Relax, Alone, Forget, Family/Friends, Trouble) Interactive System (collected before the well visit among intervention arm patients only).

bMonthly surveys 1, 2, 4, 5, 7, 8, 10, and 11 are brief in length; monthly surveys 3, 6, 9, and 12 are extended in length.

cDefined by the National Institute on Alcohol Abuse and Alcoholism Alcohol Screening and Brief Intervention for Youth Guide [].

dTLFB: timeline followback.

eModified or adapted for purposes of this study.

fAUDIT-C: Alcohol Use Disorders Identification Test–Concise.

gIncludes alcohol, nicotine, tobacco, marijuana, inhalants, misused prescription medication, and other drugs (synthetic marijuana, stimulants, opioids, and hallucinogens).

hCRAFFT: Car, Relax, Alone, Forget, Family/Friends, Trouble.

iPEI: Personal Experience Inventory.

jNCANDA: National Consortium on Alcohol and Neurodevelopment in Adolescence.

kcSBI: computer-facilitated screening and brief intervention.

lDRSEQ-SRA: Drinking Refusal Self-Efficacy Questionnaire–Shortened Revised Adolescent version.

mASSIST: Alcohol, Smoking and Substance Involvement Screening Test.

nHONC: Hooked on Nicotine Checklist.

oPROMIS-E: Patient-Reported Outcomes Measurement Information System Nicotine Dependence Item Bank for Electronic Cigarettes.

pCHU9D: Child Health Utility–9 Dimensions.

qPATH: Population Assessment of Tobacco and Health.

rYRBS: Youth Risk Behavior Survey.

sMSPSS: Multidimensional Scale of Perceived Social Support.

Other Measures

We will explore potential intervention effect moderation by age group, sexual and gender identity and social determinants of health that enhance substance use risk for sexual and gender minority youth, baseline severity of substance use involvement, peer and family substance use, and patient-clinician relationship (number of prior visits the patient had with this clinician and perceived connectedness to their clinician).

We will also examine intervention implementation measures, including the time required to deliver the various CRAFFT-IS components and patient-reported receipt and quality of substance use counseling during their visit. Time information will be collected through computerized capture of patient clickstream times and clinician counseling start and stop times, as well as clinician report of average substance use–related counseling time and overall visit length on the clinician debriefing questionnaire completed at the end of patient recruitment at a practice. Adolescents complete an immediate postvisit questionnaire that includes items on the health topics discussed during the visit, ratings of counseling quality and the degree to which it reflected an MI-based counseling style, and whether they received the Contract for Life.

To assess the validity of the modified HONC for identifying risk for nicotine use disorder in adolescents, we will compare it to the 4-item Patient-Reported Outcomes Measurement Information System Nicotine Dependence Item Bank for Electronic Cigarettes (PROMIS-E) [] administered in the previsit assessment. While the CRAFFT screening items are well validated [], the modified HONC, which now includes nicotine vaping and is included in the CRAFFT-IS previsit screening for adolescents seeing intervention clinicians, needs validation.

Data CollectionClinicians

Enrolled clinicians are assigned a unique numeric identifier for use in data collection throughout the study. A baseline survey assesses previous experience and training and UC practices around screening, brief intervention, and referral to treatment (10 min), as well as training on study procedures and human subjects protections (up to 90 min; all clinicians). Clinicians assigned to the intervention arm additionally complete brief (5 min each) postsession evaluation surveys after each live training session and a final summative evaluation after all training components have concluded. Clinician surveys and evaluations are completed on paper or by email or SMS text message link to an online survey per clinician preference. After adolescent recruitment and intervention delivery have concluded at a practice, intervention clinicians complete a 10-minute debriefing survey assessing experience using the CRAFFT-IS and seeking suggestions for improving the system, as well as participate in a 30- to 60-minute interview or focus group (along with participating staff) to offer feedback on their study experience.

Adolescents

All adolescent participants are assigned a unique numeric identifier at the time of recruitment for use in data collection, storage, and linkage throughout their study participation. Once assented, participants indicate their contact preferences. Adolescents who agree to have their data shared with the NIAAADA are assigned a Global Unique Identifier using their first, middle, and last names; sex assigned at birth; and date and city of birth. Global Unique Identifiers are numeric codes that allow participant data to be submitted to the NIAAADA without any personally identifiable information. All participants self-administer the confidential electronic previsit survey (approximately 20 min; refer to for details on all surveys), and participants seeing an intervention clinician complete the screening and psychoeducational components of the CRAFFT-IS (5 min) before seeing their clinician. After their visit, all participants complete the immediate postvisit survey (approximately 10 min), and then, through the 12-month follow-up period, brief monthly surveys about their past 30-day substance use and longer surveys at 3, 6, 9, and 12 months (approximately 15 min each). Participants may choose to skip questions or entire surveys and still remain in the study.

All surveys can be completed electronically on smartphones and desktop or tablet computers through a link sent by SMS text message or email to participants’ personal mobile phone numbers or email addresses, as preferred. Electronic surveys are protected by a password set by the adolescent. Adolescents can also complete a survey by mobile phone with a study RA. If the adolescent does not complete a survey after electronic reminders, a study RA will call the adolescent to encourage survey completion.

Data Management

Study data, including survey responses and internal study tracking data, will be collected and stored in Research Electronic Data Capture (REDCap), a HIPAA-compliant web-based data management and survey distribution tool hosted at BCH [,]. Data transmission among BCH, AAP PROS staff, and practices will occur securely via password-protected email or fax.