Even experts struggle to tell which social media posts are evidence-based. So what do we do?

Examples of fake X posts communicating mental health research where the evidence-basis of the information is not clearly communicated in the post. Credit: Erin Madden et al.

The debate on how to combat social media misinformation is as relevant as ever. In recent years, we’ve seen medical misinformation spreading alongside COVID, and political misinformation impacting the outcome of elections and national referendums.

Experts have largely placed the impetus to stop misinformation on three groups: social media users, government regulators, and social media platforms themselves.

Tips for social media users include educating themselves on the subject, and being aware of the tactics used to spread misinformation. Government bodies are urged to work together with social media platforms to regulate and prevent the spread of misinformation.

But all of these approaches depend on social media content we can easily recognize as “reliable”. Unfortunately, our new study just published in the Journal of Health Communication shows reliable content is not easy to find. Even we—researchers and subject matter experts—struggled to identify the evidence base of the social media posts we analyzed.

Based on our findings, we have developed new guidelines to help experts create engaging content that also clearly communicates the evidence behind the post.

What did our study find?

We collected and analyzed 300 mental health research-related X (formerly Twitter) posts from two large Australian mental health research organizations, posted between September 2018 and September 2019. We chose this timeframe to avoid the influence of recent major events like the Australian bushfires (starting November 2019) or the COVID-19 pandemic (starting March 2020) on our findings.

We assessed the written content within each individual post, whether the post contained hashtags, mentions, hyperlinks and multimedia, and whether the post featured an evidence-based source, such as a peer-reviewed journal article, conference presentation, or clinical treatment guidelines.

Even experts struggle to tell which social media posts are evidence-based. So what do we do?
Additional examples of fake X posts on mental health research where the evidence-basis of the information is not clearly communicated in the post. Credit: Erin Madden et al.

We found it was challenging to reliably establish the evidence behind the posts. Our team agreed on whether a post contained evidence-based information only 56% of the time. These chances are not much better than a coin flip.

When people with years of relevant training can’t reliably identify evidence-based content, how can we expect everyone else to?

Although some posts appeared to be evidence-informed (for example, a researcher commenting on their area of expertise), the source of their statement was unclear in the majority of posts.

This raises further questions about the distinction between misinformation or disinformation, and “poor quality information”. We would argue the latter happens when the level of evidence supporting a post is not recognizable even to those trained in the field.

While some posts contained links to evidence-based sources, such as peer-reviewed papers, most contained expert opinions only, such as news articles. To judge how reliable this content is, a user would need to put in significant extra work—reading resources thoroughly and following up on sources.

It’s not realistic to ask social media users to do this, especially when peer-reviewed sources use complex, technical language and often require payment to access.

How can researchers communicate evidence-based content?

Academics are encouraged to translate their research for the public, but there is limited guidance on how to balance audience engagement with evidence-based information.

Even experts struggle to tell which social media posts are evidence-based. So what do we do?
A ‘before and after’ post, taking into account the guidelines on best practice for sharing evidence-based information. Credit: Erin Madden et al., CC BY-ND

As part of our study, we aimed to create simple, evidence-based guidelines for researchers, on how to effectively disseminate mental health research via X. For example, we found that researchers can boost engagement by emphasizing the specific population group the research relates to (for example LBGTIQA+ or culturally diverse communities) and by using images and videos.

Our guidelines encourage experts to create engaging content that also clearly communicates “what” the information is, “where” the information is from, and “who” the information is for.

We outlined five main points:

  • Tell the audience what the information is, and where it came from.
  • Tell your audience who you’re speaking to.
  • Use media that adds to the post, expanding on what the information is and where it came from.
  • Use hyperlinks to verify research information in the post.
  • Minimize over-use of hashtags.

We also created mock “before and after” posts inspired by the posts from the study dataset, which outline the use of the guidelines in practice.

The recent increased focus on tackling online misinformation points to a hopeful future for information quality on social media platforms. But we still have a long way to go to promote evidence-based research in an accessible manner.

Research organizations and experts have a unique opportunity to show leadership in this area. Academics can add their voices to the public discourse as trusted and reliable sources of content people want to engage with—all while maintaining research integrity.

Additionally, in today’s world where health information is often promoted, shared and re-shared by everyone, these guidelines also provide useful tips to help anyone share clear and reliable information, and empower people to effectively navigate health information on social media.

More information:
Erin Madden et al, “What Do I Say? How Do I Say it?” Twitter as a Knowledge Dissemination Tool for Mental Health Research, Journal of Health Communication (2023). DOI: 10.1080/10810730.2023.2278617

Provided by
The Conversation

This article is republished from The Conversation under a Creative Commons license. Read the original article.The Conversation

Even experts struggle to tell which social media posts are evidence-based. So what do we do? (2023, November 15)
retrieved 16 November 2023
from https://techxplore.com/news/2023-11-experts-struggle-social-media-evidence-based.html

This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no
part may be reproduced without the written permission. The content is provided for information purposes only.

Leave a Reply

Your email address will not be published. Required fields are marked *