Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
157 tokens/sec
GPT-4o
8 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Identifying Self-Disclosures of Use, Misuse and Addiction in Community-based Social Media Posts (2311.09066v3)

Published 15 Nov 2023 in cs.CL

Abstract: In the last decade, the United States has lost more than 500,000 people from an overdose involving prescription and illicit opioids making it a national public health emergency (USDHHS, 2017). Medical practitioners require robust and timely tools that can effectively identify at-risk patients. Community-based social media platforms such as Reddit allow self-disclosure for users to discuss otherwise sensitive drug-related behaviors. We present a moderate size corpus of 2500 opioid-related posts from various subreddits labeled with six different phases of opioid use: Medical Use, Misuse, Addiction, Recovery, Relapse, Not Using. For every post, we annotate span-level extractive explanations and crucially study their role both in annotation quality and model development. We evaluate several state-of-the-art models in a supervised, few-shot, or zero-shot setting. Experimental results and error analysis show that identifying the phases of opioid use disorder is highly contextual and challenging. However, we find that using explanations during modeling leads to a significant boost in classification accuracy demonstrating their beneficial role in a high-stakes domain such as studying the opioid use disorder continuum.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (47)
  1. The neurobiology of substance use, misuse, and addiction. In Facing Addiction in America: The Surgeon General’s Report on Alcohol, Drugs, and Health [Internet]. US Department of Health and Human Services.
  2. Use of a machine learning framework to predict substance use disorder treatment success. PloS one, 12(4):e0175383.
  3. Natural language processing and machine learning to identify alcohol misuse from the electronic health record in trauma patients: development and internal validation. Journal of the American Medical Informatics Association, 26(3):254–261.
  4. Using social listening data to monitor misuse and nonmedical use of bupropion: a content analysis. JMIR public health and surveillance, 3(1):e6174.
  5. Big data and predictive modelling for the opioid crisis: existing research and future potential. The Lancet Digital Health, 3(6):e397–e407.
  6. Exploring the landscape of drug communities on reddit: A network study. In Proceedings of the International Conference on Advances in Social Networks Analysis and Mining, pages 558–565.
  7. Language models are few-shot learners. In Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual.
  8. Socially-supportive norms and mutual aid of people who use opioids: An analysis of reddit during the initial covid-19 pandemic. Drug and alcohol dependence, page 108672.
  9. What to learn, and how: Toward effective learning from rationales. In Findings of the Association for Computational Linguistics: ACL 2022, pages 1075–1088, Dublin, Ireland. Association for Computational Linguistics.
  10. The canary in the coal mine tweets: social media reveals public perceptions of non-medical use of opioids. PloS one, 10(8):e0135072.
  11. Munmun De Choudhury and Sushovan De. 2014. Mental health discourse on reddit: Self-disclosure, social support, and anonymity. In ICWSM.
  12. Jacob Cohen. 1960. A coefficient of agreement for nominal scales. Educational and psychological measurement, 20(1):37–46.
  13. Global patterns of opioid use and dependence: harms to populations, interventions, and future action. The Lancet, 394(10208):1560–1579.
  14. Harnessing the power of social media to understand the impact of covid-19 on people who use drugs during lockdown and social distancing. Journal of addiction medicine, 16(2):e123.
  15. Joseph L Fleiss. 1971. Measuring nominal scale agreement among many raters. Psychological bulletin, 76(5):378.
  16. Development and validation of machine models using natural language processing to classify substances involved in overdose deaths. JAMA network open, 5(8):e2225593–e2225593.
  17. Machine learning for predicting risk of early dropout in a recovery program for opioid use disorder. In Healthcare, volume 10, page 223. MDPI.
  18. Tweaking and tweeting: exploring twitter for nonmedical use of a psychostimulant drug (adderall) among college students. Journal of medical Internet research, 15(4):e2503.
  19. An exploration of social circles and prescription drug abuse through twitter. Journal of medical Internet research, 15(9):e2741.
  20. A machine learning based two-stage clinical decision support system for predicting patients’ discontinuation from opioid use disorder treatment: Retrospective observational study. BMC Medical Informatics and Decision Making, 21(1):1–21.
  21. Debertav3: Improving deberta using electra-style pre-training with gradient-disentangled embedding sharing. arXiv preprint arXiv:2111.09543.
  22. An ensemble deep learning model for drug abuse detection in sparse twitter-sphere. In MedInfo, pages 163–167.
  23. Exploring distantly-labeled rationales in neural network models. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 5571–5582, Online. Association for Computational Linguistics.
  24. George F Koob and Nora D Volkow. 2010. Neurocircuitry of addiction. Neuropsychopharmacology, 35(1):217–238.
  25. The opioid overdose crisis as a global health challenge. Current Opinion in Psychiatry, 34(4):405–412.
  26. Can language models learn from explanations in context? arXiv preprint arXiv:2204.02329.
  27. Ilya Loshchilov and Frank Hutter. 2018. Fixing weight decay regularization in adam.
  28. Forum77: An analysis of an online health forum dedicated to addiction recovery. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, pages 1511–1526.
  29. NIDA. 2007. Drugs, brains, and behavior: The science of addiction. National Institute on Drug Abuse, National Institutes of Health, US.
  30. OpenAI. 2023. Gpt-4 technical report. ArXiv, abs/2303.08774.
  31. Social media based analysis of opioid epidemic using reddit. In AMIA Annual Symposium Proceedings, volume 2018, page 867. American Medical Informatics Association.
  32. Albert Park and Mike Conway. 2017. Tracking health related discussions on reddit for public health applications. In AMIA annual symposium proceedings, volume 2017, page 1362. American Medical Informatics Association.
  33. Situating the continuum of overdose risk in the social determinants of health: a new conceptual framework. The Milbank Quarterly, 98(3):700–746.
  34. Enabling real-time drug abuse detection in tweets. In 2017 IEEE 33rd international conference on data engineering (ICDE), pages 1510–1514. IEEE.
  35. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21:1–67.
  36. Deepspeed: System optimizations enable training deep learning models with over 100 billion parameters. In KDD ’20: The 26th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Virtual Event, CA, USA, August 23-27, 2020, pages 3505–3506. ACM.
  37. Tyne A Riddick and Esther K Choo. 2022. Natural language processing to identify substance misuse in the electronic health record. The Lancet Digital Health, 4(6):e401–e402.
  38. Multitask prompted training enables zero-shot task generalization. In The Tenth International Conference on Learning Representations.
  39. Classification and definition of misuse, abuse, and related events in clinical trials: Acttion systematic review and recommendations. Pain®, 154(11):2287–2296.
  40. Temporal and geographic patterns of social media posts about an emerging suicide game. The Journal of adolescent health : official publication of the Society for Adolescent Medicine, 65 1:94–100.
  41. Investigating the benefits of free-form rationales. arXiv preprint arXiv:2206.11083.
  42. USDHHS. 2017. Hhs acting secretary declares public health emergency to address national opioid crisis. Washington, DC: USDHHS.
  43. ND Volkow. 2007. How science has revolutionized the understanding of drug addiction. Drugs, Brains and Behavior: The Science of Addiction.
  44. Neurobiologic advances from the brain disease model of addiction. New England Journal of Medicine, 374(4):363–371.
  45. Measuring association between labels and free-text rationales. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 10266–10284.
  46. The opioid-overdose reduction continuum of care approach (orcca): evidence-based practices in the healing communities study. Drug and alcohol dependence, 217:108325.
  47. Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 38–45, Online. Association for Computational Linguistics.
Citations (1)

Summary

We haven't generated a summary for this paper yet.