NCYSUR Research fellow Dr Tianze Sun describes the potential of co-designing AI with young people to create effective, targeted and cost-effective health promotion materials in tackling the growing issue of youth vaping in Australia.
Co-designing AI with young people to create tailored vaping awareness messages
Youth vaping is one of Australia's most pressing public health challenges. Recent data from the 2022-2023 National Drug Strategy Household Survey indicate that approximately 17.9% of Australians aged 15–24 are currently vaping[1], which is a significant increase from 4.5% in 2019 [1]. While it’s true that vaping generally exposes users to fewer toxins than combustible cigarettes, recreational vaping still carries significant health risks for young people [2].
Public health has responded by implementing mass media awareness campaigns, which can effectively reduce vaping prevalence by shifting young people’s knowledge, attitudes, and social norms. Similar to the success of anti-smoking campaigns, meta-analyses show that exposure to vaping prevention messages leads to higher vaping risk perceptions, increased vaping knowledge and lower intentions to vape [3].
Despite their overall effectiveness, the messaging in campaigns doesn’t resonate equally across diverse groups of young people. This is because most campaigns adopt a "one size fits all" approach, typically only focusing on the health consequences of vaping without accounting for variations in young people’s beliefs, interests, and motivations.
So, could we achieve a greater impact by tailoring vaping awareness messages to match individual characteristics, and could artificial intelligence help us do this at scale?
Tailoring vaping prevention and cessation messages
Tailoring health communication is based on the premise that individuals pay greater attention to, and are more influenced by messaging that speaks directly to their unique circumstances, motivations, and psychological makeup [4]. For example, a systematic review found that intensity-matched culturally tailored smoking cessation interventions increased quit success compared to non-tailored interventions [5]. Likewise, personality-matched tailored interventions, such as anxiety-focused interventions for highly anxious students, demonstrated significantly greater effectiveness in reducing alcohol and tobacco use than standardised interventions [6-8].
Yet, the promise of tailoring has remained largely unfulfilled in public health messaging due to the considerable expertise, time, and resources required to develop tailored messages that appeal to specific individual characteristics [9].
Could AI overcome barriers to tailoring?
Generative artificial intelligence (AI) may offer a way to overcome this barrier because of its ability to rapidly produce large volumes of diverse vaping awareness materials. Recent studies indicate that AI-generated communications can match or even surpass human-created content in terms of perceived effectiveness, clarity, and quality [10,11].
However, due to the inherent biases in the datasets used to build AI algorithms, the generated messages can be highly variable, sometimes producing factually incorrect information or messages that fails to effectively engage certain groups [12]. This is why we must co-design with diverse youth groups and maintain human-expert oversight to ensure public health communication is accurate, relevant, and inclusive.
What are we doing?
With funding from the Medical Research Future Fund (#MRF2031246), our team has been working directly with diverse groups of young people to co-design AI-generated vaping awareness materials [13]. In a recent randomised experimental study, we compared how young people perceived the effectiveness of these co-designed materials against materials by official public health agencies. To build on these results, we will implement a randomised controlled trial to test whether exposure to tailored multi-themed materials is more effective at deterring youth vaping than one-size-fits-all materials.
By leveraging the potential of AI and youth co-design, we may overcome the limitations of traditional one-size-fits-all approaches, extensive resources associated with tailoring, and biases associated with AI systems to develop a scalable and tailored campaign with materials that target multiple themes for a sustained period to achieve maximal effects in deterring youth vaping. We also hope that this project can serve as a model for using AI effectively across a variety of public health campaigns targeting other critical health behaviours and reaching underserved groups.
Dr Tianze Sun presented the invited NDARC Webinar ‘Can we use AI to solve a problem like youth vaping?’ in October 2024.
[1] Currently vaping includes people who reported vaping daily, weekly, monthly or less than monthly.
Australian Institute of Health & Welfare. National Drug Strategy Household Survey 2022–2023. Canberra: AIHW; 2024. Available at: https://www.aihw.gov.au/reports/illicit-use-of-drugs/national-drug-strategy-household-survey
2 Royal College of Physicians. E-cigarettes and harm reduction: an evidence review; 2024. Available at: https://www.rcp.ac.uk/policy-and-campaigns/policy-documents/e-cigarettes-and-harm-reduction-an-evidence-review/
3 Ma H, Kieu TK-T, Ribisl KM, Noar SM. Do vaping prevention messages impact adolescents and young adults? A meta-analysis of experimental studies. Health Communication 2023; 38: 1709-22. https://doi.org/10.1080/10410236.2023.2185578.
4 van der Stel J. Precision in addiction care: does it make a difference? Yale Journal of Biology and Medicine 2015; 88: 415-22.
5 Leinberger-Jabari A, Golob MM, Lindson N, Hartmann-Boyce J. Effectiveness of culturally tailoring smoking cessation interventions for reducing or quitting combustible tobacco: a systematic review and meta-analyses. Addiction 2024; 119: 629-48. https://doi.org/10.1111/add.16400.
6 Debenham J, Grummitt L, Newton NC, Teesson M, Slade T, Conrod P, Kelly EV. Personality-targeted prevention for adolescent tobacco use: three-year outcomes for a randomised trial in Australia. Preventive Medicine 2021; 153: 106794. https://doi.org/10.1016/j.ypmed.2021.106794.
7 Hides L, Quinn C, Chan G, Cotton S, Pocuca N, Connor JP, Witkiewitz K, Daglish MRC, Young RM, Stoyanov S, Kavanagh DJ. Telephone-based motivational interviewing enhanced with individualised personality-specific coping skills training for young people with alcohol-related injuries and illnesses accessing emergency or rest/recovery services: a randomized controlled trial (QuikFix). Addiction 2021; 116: 474-84. https://doi.org/10.1111/add.15146.
8 Conrod PJ, O'Leary-Barrett M, Newton N, Topper L, Castellanos-Ryan N, Mackie C, Girard A. Effectiveness of a selective, personality-targeted prevention program for adolescent alcohol use and misuse: a cluster randomized controlled trial. JAMA Psychiatry 2013; 70: 334-42. https://doi.org/10.1001/jamapsychiatry.2013.651.
9 Matz SC, Beck ED, Atherton OE, White M, Rauthmann JF, Mroczek DK, Kim M, Bogg T. Personality science in the digital age: the promises and challenges of psychological targeting for personalized behavior-change interventions at scale. Perspectives on Psychological Science 2024; 19: 1031-56. https://doi.org/10.1177/17456916231191774.
10 Schmälzle R, Wilcox S. Harnessing artificial intelligence for health message generation: the folic acid message engine. Journal of Medical Internet Research 2022; 24: e28858. https://doi.org/10.2196/28858.
11 Lim S, Schmälzle R. The effect of source disclosure on evaluation of AI-generated messages. Computers in Human Behavior: Artificial Humans 2024; 2: 100058. https://doi.org/10.1016/j.chbah.2024.100058.
12 Celi LA, Cellini J, Charpignon ML, Dee EC, Dernoncourt F, Eber R, Mitchell WG, Moukheiber L, Schirmer J, Situ J, Paguio J, Park J, Wawira JG, Yao S, for MITCD. Sources of bias in artificial intelligence that perpetuate healthcare disparities-a global review. PLOS Digital Health 2022; 1. https://doi.org/10.1371/journal.pdig.0000022.
13 Sun T, Chan GCK, Stjepanović D, Yimer T, Vu G, Lim CCW, McClure-Thomas C, Connor J, Hall WD, Hides L, Hammond D, Dietrich T, Erku D, Johnson B, Leung J. Co-designing AI-generated vaping awareness materials with adolescents and young adults: a qualitative study. PsyArViv Preprints 2024 (version 1). https://doi.org/10.31234/osf.io/u5fz2.