Skip to main content
☕️ Hallucinated whispers
To:Brew Readers
Healthcare Brew // Morning Brew // Update
OpenAI’s Whisper transcription hallucinations are increasingly worrisome as the tool becomes more widely used in healthcare.
November 20, 2024

Healthcare Brew

MGMA

It’s Wednesday again. Q3 earnings season is wrapping up, and pharma companies saw mixed results. Johnson & Johnson and AstraZeneca beat analyst expectations, while Eli Lilly reported sales of its GLP-1s that were well below what analysts had projected. J&J, Eli Lilly, and Merck all lowered their full-year earnings guidance, while AbbVie and AstraZeneca raised theirs. It’s a good time to be a drug company that begins with the letter “A,” apparently.

In today’s edition:

Whisper’s hallucinations

GoodRx’s legal woes

Lack of transparency

—Charlotte Hu, Maia Anderson, Caroline Catherman

ARTIFICIAL INTELLIGENCE

False whispers

Glitched stethoscope and audio recording Illustration: Anna Kim, Photos: Adobe Stock

AI scribes were supposed to make doctors’ lives easier, but many researchers are finding inaccuracies in their transcriptions.

A popular transcription tool used in medical centers, OpenAI’s Whisper model, is embellishing transcripts with dialogue that doesn’t appear in audio recordings, according to a study presented at the 2024 ACM Conference on Fairness, Accountability, and Transparency.

Whisper is used by around 30,000 clinicians and 40 health systems to document interactions with patients, according to the Associated Press. But multiple studies have shown that Whisper produced fabricated or inaccurate transcriptions when it was tested on real-world audio like town hall recordings.

“We take this issue seriously and are continually working to improve the accuracy of our models, including how we can reduce hallucinations,” OpenAI spokesperson Taya Christianson told Healthcare Brew in an emailed statement.

Allison Koenecke, an assistant professor of information science at Cornell University and an author on the study, told Healthcare Brew that this analysis, along with other research projects she has conducted, highlight how AI transcription tools underperform when tested on speech data from people with accents, broken speech, or language disorders. In particular, Whisper inserted made-up statements that “include explicit harms such as perpetuating violence, making up inaccurate associations, or implying false authority,” she and her colleagues wrote in their study. In healthcare settings, such errors could misrepresent patients with speech irregularities and result in inaccurate assessment records.

Keep reading here.—CH

   

Presented By MGMA

Make yourself known

MGMA

LEGAL

Taking (legal) action

A sign is posted in front of GoodRX headquarters. Getty Images

It’s not all good news for GoodRx.

The drug discount company is facing at least three separate class-action lawsuits from independent pharmacies accusing it of “conspiring” with pharmacy benefit managers (PBMs) to fix reimbursement rates in a way that boosts the PBMs’ profits. Also named in two of the three suits are four PBMs: Caremark, Express Scripts (owned by Cigna), Medimpact Healthcare Systems, and Navitus Health Solutions.

PBMs are companies that negotiate between drugmakers, insurers, and pharmacies to decide which drugs insurers cover and how much pharmacies are reimbursed for dispensing those drugs.

The lawsuits come as PBMs face increasing scrutiny, with the Federal Trade Commission bringing a lawsuit against the country’s top three PBMs in September for allegedly boosting profits by inflating the price of insulin.

Keep reading here.—MA

   

HOSPITALS

Price transparency turmoil

Stethoscope attached to money Juan Moyano/Getty Images

Remember that hospital price transparency rule from three years ago that said starting January 1, 2021, every US hospital had to start posting prices for all its items and services in a way consumers could understand and in a machine-readable file format?

Well, good news, it’s totally working! Except when hospitals don’t follow it. Which, it turns out, has reportedly happened quite frequently.

In a random sampling of 100 hospitals nationwide, 34 didn’t publish comprehensive, machine-readable files with their pricing, and 14 didn’t follow all the steps necessary to display their prices in a way that the average patient could understand, according to a November 8 report from the US Department of Health and Human Services (HHS) Office of Inspector General. Both are required to be considered compliant.

The report estimates that 46% of the 5,879 hospitals with Medicare inpatient claims between January 2021 and June 2022 didn’t comply with one or more of the rule’s requirements.

Keep reading here.—CC

   

Together With Guild

Guild

VITAL SIGNS

A laptop tracking vital signs is placed on rolling medical equipment. Francis Scialabba

Today’s top healthcare reads.

Stat: 46%. That’s how much the GLP-1 tirzepatide was shown to lower patients’ risk of heart failure in a study published last week. (Becker’s Hospital Review)

Quote: “Coverage is here right now. So if you need to go to the doctor, if you’ve been putting off care that you need, if you’ve never had the opportunity to get your preventive care, you can do that right now,” Jessica Altman, executive director of health insurance marketplace Covered California, on the state’s new law allowing DACA recipients to receive healthcare coverage through the ACA marketplace (CalMatters)

Read: Why the rise in pancreatic cancer cases may not be as alarming as it sounds. (the New York Times)

JOBS

Stop waiting for your dream job to find you. CollabWORK puts you in front of the right opportunities in the online spaces you frequent. Get discovered by top companies and take control of your career path.

SHARE THE BREW

Share Healthcare Brew with your coworkers, acquire free Brew swag, and then make new friends as a result of your fresh Brew swag.

We're saying we'll give you free stuff and more friends if you share a link. One link.

Your referral count: 2

Click to Share

Or copy & paste your referral link to others:
https://www.healthcare-brew.com/r?kid=9ec4d467

         
ADVERTISE // CAREERS // SHOP // FAQ

Update your email preferences or unsubscribe here.
View our privacy policy here.

Copyright © 2024 Morning Brew. All rights reserved.
22 W 19th St, 4th Floor, New York, NY 10011
Navigate the healthcare industry

Healthcare Brew covers pharmaceutical developments, health startups, the latest tech, and how it impacts hospitals and providers to keep administrators and providers informed.