open access

Vol 55, No 5 (2021)
Research Paper
Submitted: 2021-06-30
Accepted: 2021-09-24
Published online: 2021-10-15
Get Citation

YouTube as a source of patient information on brain aneurysms: a content-quality and audience engagement analysis

Tomasz Szmuda1, Shan Ali2, Alexandra Kamieniecki2, Daniel Ręcławowicz1, Hanna Karin Lou Olofsson2, Paweł Słoniewski1
·
Pubmed: 34651668
·
Neurol Neurochir Pol 2021;55(5):485-493.
Affiliations
  1. Neurosurgery Department, Medical University of Gdansk, Poland
  2. Scientific Circle of Neurology and Neurosurgery, Neurosurgery Department, Medical University of Gdansk, Poland

open access

Vol 55, No 5 (2021)
Research papers
Submitted: 2021-06-30
Accepted: 2021-09-24
Published online: 2021-10-15

Abstract

Introduction: The internet allows patients to access a vast amount of health information. We aimed to evaluate the credibility of YouTube videos that members of the public are accessing on brain aneurysms, and to evaluate what characteristics drive audience engagement. Material and methods: The first 50 videos for each of the following search terms were taken for analysis: ‘brain aneurysm’, ‘cerebral aneurysm’ and ‘intracranial aneurysm’. The quality of each video was evaluated by two neurosurgeons and two medical students independently using the Journal of the American Medical Association (JAMA) and the DISCERN instruments. Qualitative and quantitative video data was analysed for quality and audience engagement. Inter-rater agreement was ascertained. Results: Out of a total of 150 videos, 70 met the inclusion criteria. The mean total DISCERN score was 36.5 ± 8.4 (out of 75 points), indicating that the videos were of poor quality. The mean JAMA score was 2.7 ± 0.7 (out of 4 points). Inter-rater agreement between the four raters was excellent (intraclass correlation coefficient 0.90 for DISCERN and 0.93 for JAMA). Most videos were uploaded by hospitals (50%) or educational health channels (30%). Videos had a higher number of average daily views when they included animation (P = 0.0093) and diagrams (P = 0.0422). Conclusions: YouTube is a poor source of patient information on brain aneurysms. Our quality and audience engagement analysis may help content creators (i.e. hospital staff and physicians) to create more holistic, educational and engaging medical videos concerning brain aneurysms. Physicians could usefully refer their patients to the highest quality videos that we have found.

Abstract

Introduction: The internet allows patients to access a vast amount of health information. We aimed to evaluate the credibility of YouTube videos that members of the public are accessing on brain aneurysms, and to evaluate what characteristics drive audience engagement. Material and methods: The first 50 videos for each of the following search terms were taken for analysis: ‘brain aneurysm’, ‘cerebral aneurysm’ and ‘intracranial aneurysm’. The quality of each video was evaluated by two neurosurgeons and two medical students independently using the Journal of the American Medical Association (JAMA) and the DISCERN instruments. Qualitative and quantitative video data was analysed for quality and audience engagement. Inter-rater agreement was ascertained. Results: Out of a total of 150 videos, 70 met the inclusion criteria. The mean total DISCERN score was 36.5 ± 8.4 (out of 75 points), indicating that the videos were of poor quality. The mean JAMA score was 2.7 ± 0.7 (out of 4 points). Inter-rater agreement between the four raters was excellent (intraclass correlation coefficient 0.90 for DISCERN and 0.93 for JAMA). Most videos were uploaded by hospitals (50%) or educational health channels (30%). Videos had a higher number of average daily views when they included animation (P = 0.0093) and diagrams (P = 0.0422). Conclusions: YouTube is a poor source of patient information on brain aneurysms. Our quality and audience engagement analysis may help content creators (i.e. hospital staff and physicians) to create more holistic, educational and engaging medical videos concerning brain aneurysms. Physicians could usefully refer their patients to the highest quality videos that we have found.

Get Citation

Keywords

aneurysm, brain aneurysm, cerebral aneurysm, intracranial aneurysm, YouTube, internet, quality

About this article
Title

YouTube as a source of patient information on brain aneurysms: a content-quality and audience engagement analysis

Journal

Neurologia i Neurochirurgia Polska

Issue

Vol 55, No 5 (2021)

Article type

Research Paper

Pages

485-493

Published online

2021-10-15

Page views

6756

Article views/downloads

741

DOI

10.5603/PJNNS.a2021.0073

Pubmed

34651668

Bibliographic record

Neurol Neurochir Pol 2021;55(5):485-493.

Keywords

aneurysm
brain aneurysm
cerebral aneurysm
intracranial aneurysm
YouTube
internet
quality

Authors

Tomasz Szmuda
Shan Ali
Alexandra Kamieniecki
Daniel Ręcławowicz
Hanna Karin Lou Olofsson
Paweł Słoniewski

References (47)
  1. Diaz JA, Griffith RA, Ng JJ, et al. Patients' use of the Internet for medical information. J Gen Intern Med. 2002; 17(3): 180–185.
  2. World Internet Users Statistics and 2020 World Population Stats n.d. https://www.internetworldstats.com/stats.htm (March 4, 2020).
  3. Website Ranking: Top Websites Rank In The World - SimilarWeb n.d. https://www.similarweb.com/top-websites (March 4, 2020).
  4. Garcia M, Daugherty C, Ben Khallouq B, et al. Critical assessment of pediatric neurosurgery patient/parent educational information obtained via the Internet. J Neurosurg Pediatr. 2018; 21(5): 535–541.
  5. Madathil KC, Rivera-Rodriguez AJ, Greenstein JS, et al. Healthcare information on YouTube: A systematic review. Health Informatics J. 2015; 21(3): 173–194.
  6. Smailhodzic E, Hooijsma W, Boonstra A, et al. Social media use in healthcare: A systematic review of effects on patients and on their relationship with healthcare professionals. BMC Health Serv Res. 2016; 16: 442.
  7. De Martino I, D'Apolito R, McLawhorn AS, et al. Social media for patients: benefits and drawbacks. Curr Rev Musculoskelet Med. 2017; 10(1): 141–145.
  8. Ventola LC. Social media and health care professionals: benefits, risks, and best practices. P T. 2014; 39(7): 491–520.
  9. Ward M, Ward B, Abraham M, et al. The educational quality of neurosurgical resources on YouTube. World Neurosurg. 2019; 130: e660–e665.
  10. ReFaey K, Tripathi S, Bohnen AM, et al. The reliability of YouTube videos describing stereotactic radiosurgery: A call for action. World Neurosurg. 2019; 125: e398–e402.
  11. Alotaibi NM, Samuel N, Wang J, et al. The use of social media communications in brain aneurysms and subarachnoid hemorrhage: A mixed-method analysis. World Neurosurg. 2017; 98: 456–462.
  12. Feler J, Tan A, Sammann A, et al. Decision making among patients with unruptured aneurysms: a qualitative analysis of online patient forum discussions. World Neurosurg. 2019; 131: e371–e378.
  13. Szmuda T, Ali S, Słoniewski P. Letter to the Editor regarding "A quality analysis of disk herniation videos on YouTube". World Neurosurg. 2019; 130: 570–572.
  14. Szmuda T, Rosvall P, Hetzger TV, et al. YouTube as a source of patient information for hydrocephalus: A content-quality and optimization analysis. World Neurosurg. 2020; 138: e469–e477.
  15. Gokcen HB, Gumussuyu G. A Quality Analysis of disc herniation videos on YouTube. World Neurosurg. 2019 [Epub ahead of print].
  16. Szmuda T, Özdemir C, Fedorow K, et al. YouTube as a source of information for narcolepsy: A content-quality and optimization analysis. J Sleep Res. 2021; 30(2): e13053.
  17. Szmuda T, Syed MT, Singh A, et al. YouTube as a source of patient information for Coronavirus Disease (COVID-19): A content-quality and audience engagement analysis. Rev Med Virol. 2020; 30(5): e2132.
  18. King JT, Horowitz MB, Kassam AB, et al. The short form-12 and the measurement of health status in patients with cerebral aneurysms: performance, validity, and reliability. J Neurosurg. 2005; 102(3): 489–494.
  19. Korja M, Kaprio J. Controversies in epidemiology of intracranial aneurysms and SAH. Nat Rev Neurol. 2016; 12(1): 50–55.
  20. Prestigiacomo CJ, He W, Catrambone J, et al. Predicting aneurysm rupture probabilities through the application of a computed tomography angiography-derived binary logistic regression model. J Neurosurg. 2009; 110(1): 1–6.
  21. iProspect Search Engine User Behaviour Study. 2006.
  22. Silberg WM, Lundberg GD, Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor--Let the reader and viewer beware. JAMA. 1997; 277(15): 1244–1245.
  23. Charnock D, Shepperd S, Needham G, et al. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999; 53(2): 105–111.
  24. Rees CE, Ford JE, Sheard CE. Evaluating the reliability of DISCERN: a tool for assessing the quality of written patient information on treatment choices. Patient Educ Couns. 2002; 47(3): 273–275.
  25. Cassidy JT, Baker JF. Orthopaedic patient information on the World Wide Web: an essential review. J Bone Joint Surg Am. 2016; 98(4): 325–338.
  26. Data for: YouTube as a Source of Patient Information for Brain Aneurysms: A Content-Quality an Auience Engagement Analysis.
  27. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016; 15(2): 155–163.
  28. Desai T, Shariff A, Dhingra V, et al. Is content really king? An objective analysis of the public's response to medical videos on YouTube. PLoS One. 2013; 8(12): e82469.
  29. ReFaey K, Tripathi S, Yoon JW, et al. The reliability of YouTube videos in patients education for Glioblastoma Treatment. J Clin Neurosci. 2018; 55: 1–4.
  30. Ayyaswami V, Padmanabhan D, Patel M, et al. A readability analysis of online cardiovascular disease-related health education materials. Health Lit Res Pract. 2019; 3(2): e74–e80.
  31. Ren SY, Gao RD, Chen YL. Fear can be more harmful than the severe acute respiratory syndrome coronavirus 2 in controlling the corona virus disease 2019 epidemic. World J Clin Cases. 2020; 8(4): 652–657.
  32. Pluviano S, Watt C, Della Sala S. Misinformation lingers in memory: Failure of three pro-vaccination strategies. PLoS One. 2017; 12(7): e0181640.
  33. Ernst E. How the public is being misled about complementary/alternative medicine. J R Soc Med. 2008; 101(11): 528–530.
  34. Merckelbach H, Jelicic M, Pieters M. Misinformation increases symptom reporting: a test - retest study. JRSM Short Rep. 2011; 2(10): 75.
  35. De Freitas J, Falls BA, Haque OS, et al. Vulnerabilities to misinformation in online pharmaceutical marketing. J R Soc Med. 2013; 106(5): 184–189.
  36. Wang Y, McKee M, Torbica A, et al. Systematic literature review on the spread of health-related misinformation on social media. Soc Sci Med. 2019; 240: 112552.
  37. Szmuda T, Özdemir C, Ali S, et al. Readability of online patient education material for the novel coronavirus disease (COVID-19): a cross-sectional health literacy study. Public Health. 2020; 185: 21–25.
  38. Benetoli A, Chen TF, Aslani P. Consumer health-related activities on social media: exploratory study. J Med Internet Res. 2017; 19(10): e352.
  39. Fat MJ, Doja A, Barrowman N, et al. YouTube videos as a teaching tool and patient resource for infantile spasms. J Child Neurol. 2011; 26(7): 804–809.
  40. Erdem MN, Karaca S. Evaluating the accuracy and quality of the information in kyphosis videos shared on YouTube. Spine (Phila Pa 1976). 2018; 43(22): E1334–E1339.
  41. Radonjic A, Fat Hing NNg, Harlock J, et al. YouTube as a source of patient information for abdominal aortic aneurysms. J Vasc Surg. 2020; 71(2): 637–644.
  42. Drozd B, Couvillon E, Suarez A. Medical YouTube Videos and methods of evaluation: literature review. JMIR Med Educ. 2018; 4(1): e3.
  43. Ku JC, Alotaibi NM, Wang J, et al. Internet search volumes in brain aneurysms and subarachnoid hemorrhage: Is there evidence of seasonality? Clin Neurol Neurosurg. 2017; 158: 1–4.
  44. Szmuda T, Ali S, Słoniewski P, et al. Telemedicine in neurosurgery during the novel coronavirus (COVID-19) pandemic. Neurol Neurochir Pol. 2020; 54(2): 207–208.
  45. Perrin A. Social Networking Usage: 2005-2015. 2015.
  46. Ullrich PF, Vaccaro AR. Patient education on the internet: opportunities and pitfalls. Spine (Phila Pa 1976). 2002; 27(7): E185–E188.
  47. Tang PC, Newcomb C. Informing patients: a guide for providing patient health information. J Am Med Inform Assoc. 1998; 5(6): 563–570.

Regulations

Important: This website uses cookies. More >>

The cookies allow us to identify your computer and find out details about your last visit. They remembering whether you've visited the site before, so that you remain logged in - or to help us work out how many new website visitors we get each month. Most internet browsers accept cookies automatically, but you can change the settings of your browser to erase cookies or prevent automatic acceptance if you prefer.

By VM Media Group sp. z o.o., ul. Świętokrzyska 73, 80–180 Gdańsk, Poland
tel.:+48 58 320 94 94, fax:+48 58 320 94 60, e-mail: viamedica@viamedica.pl