New Token Poised for Breakout as "Defi 2.0" Takes Off

Revealed: The #1 DeFi Coin Driving Financial Revolution. Experts hail this as the cornerstone of the new decentralized finance era. While Bitcoin dominates headlines, this governance token is quietly reshaping lending markets. Experts suggest accumulating before institutional money flows in.

Researchers say an AI-powered transcription tool used in hospitals invents things no one ever said

GARANCE BURKE and HILKE SCHELLMANN
October 26, 2024

SAN FRANCISCO (AP) -- Tech behemoth OpenAI has touted its artificial intelligence-powered transcription tool Whisper as having near "human level robustness and accuracy."

But Whisper has a major flaw: It is prone to making up chunks of text or even entire sentences, according to interviews with more than a dozen software engineers, developers and academic researchers. Those experts said some of the invented text -- known in the industry as hallucinations -- can include racial commentary, violent rhetoric and even imagined medical treatments.

Experts said that such fabrications are problematic because Whisper is being used in a slew of industries worldwide to translate and transcribe interviews, generate text in popular consumer technologies and create subtitles for videos.

More concerning, they said, is a rush by medical centers to utilize Whisper-based tools to transcribe patients' consultations with doctors, despite OpenAI' s warnings that the tool should not be used in "high-risk domains."

The full extent of the problem is difficult to discern, but researchers and engineers said they frequently have come across Whisper's hallucinations in their work. A University of Michigan researcher conducting a study of public meetings, for example, said he found hallucinations in eight out of every 10 audio transcriptions he inspected, before he started trying to improve the model.

A machine learning engineer said he initially discovered hallucinations in about half of the over 100 hours of Whisper transcriptions he analyzed. A third developer said he found hallucinations in nearly every one of the 26,000 transcripts he created with Whisper.

The problems persist even in well-recorded, short audio samples. A recent study by computer scientists uncovered 187 hallucinations in over 13,000 clear audio snippets they examined.

That trend would lead to tens of thousands of faulty transcriptions over millions of recordings, researchers said.

Such mistakes could have "really grave consequences," particularly in hospital settings, said Alondra Nelson, who led the White House Office of Science and Technology Policy for the Biden administration until last year.

"Nobody wants a misdiagnosis," said Nelson, a professor at the Institute for Advanced Study in Princeton, New Jersey. "There should be a higher bar."

Whisper also is used to create closed captioning for the Deaf and hard of hearing -- a population at particular risk for faulty transcriptions. That's because the Deaf and hard of hearing have no way of identifying fabrications are "hidden amongst all this other text," said Christian Vogler, who is deaf and directs Gallaudet University's Technology Access Program.

OpenAI urged to address problem

The prevalence of such hallucinations has led experts, advocates and former OpenAI employees to call for the federal government to consider AI regulations. At minimum, they said, OpenAI needs to address the flaw.

"This seems solvable if the company is willing to prioritize it," said William Saunders, a San Francisco-based research engineer who quit OpenAI in February over concerns with the company's direction. "It's problematic if you put this out there and people are overconfident about what it can do and integrate it into all these other systems."

An OpenAI spokesperson said the company continually studies how to reduce hallucinations and appreciated the researchers' findings, adding that OpenAI incorporates feedback in model updates.

While most developers assume that transcription tools misspell words or make other errors, engineers and researchers said they had never seen another AI-powered transcription tool hallucinate as much as Whisper.

Whisper hallucinations

The tool is integrated into some versions of OpenAI's flagship chatbot ChatGPT, and is a built-in offering in Oracle and Microsoft's cloud computing platforms, which service thousands of companies worldwide. It is also used to transcribe and translate text into multiple languages.

In the last month alone, one recent version of Whisper was downloaded over 4.2 million times from open-source AI platform HuggingFace. Sanchit Gandhi, a machine-learning engineer there, said Whisper is the most popular open-source speech recognition model and is built into everything from call centers to voice assistants.

Professors Allison Koenecke of Cornell University and Mona Sloane of the University of Virginia examined thousands of short snippets they obtained from TalkBank, a research repository hosted at Carnegie Mellon University. They determined that nearly 40% of the hallucinations were harmful or concerning because the speaker could be misinterpreted or misrepresented.

In an example they uncovered, a speaker said, "He, the boy, was going to, I'm not sure exactly, take the umbrella."

But the transcription software added: "He took a big piece of a cross, a teeny, small piece ... I'm sure he didn't have a terror knife so he killed a number of people."

A speaker in another recording described "two other girls and one lady." Whisper invented extra commentary on race, adding "two other girls and one lady, um, which were Black."

In a third transcription, Whisper invented a non-existent medication called "hyperactivated antibiotics."

Researchers aren't certain why Whisper and similar tools hallucinate, but software developers said the fabrications tend to occur amid pauses, background sounds or music playing.

OpenAI recommended in its online disclosures against using Whisper in "decision-making contexts, where flaws in accuracy can lead to pronounced flaws in outcomes."

Transcribing doctor appointments

That warning hasn't stopped hospitals or medical centers from using speech-to-text models, including Whisper, to transcribe what's said during doctor's visits to free up medical providers to spend less time on note-taking or report writing.

Over 30,000 clinicians and 40 health systems, including the Mankato Clinic in Minnesota and Children's Hospital Los Angeles, have started using a Whisper-based tool built by Nabla, which has offices in France and the U.S.

That tool was fine tuned on medical language to transcribe and summarize patients' interactions, said Nabla's chief technology officer Martin Raison.

Company officials said they are aware that Whisper can hallucinate and are mitigating the problem.

It's impossible to compare Nabla's AI-generated transcript to the original recording because Nabla's tool erases the original audio for "data safety reasons," Raison said.

Nabla said the tool has been used to transcribe an estimated 7 million medical visits.

Saunders, the former OpenAI engineer, said erasing the original audio could be worrisome if transcripts aren't double checked or clinicians can't access the recording to verify they are correct.

"You can't catch errors if you take away the ground truth," he said.

Nabla said that no model is perfect, and that theirs currently requires medical providers to quickly edit and approve transcribed notes, but that could change.

Privacy concerns

Because patient meetings with their doctors are confidential, it is hard to know how AI-generated transcripts are affecting them.

A California state lawmaker, Rebecca Bauer-Kahan, said she took one of her children to the doctor earlier this year, and refused to sign a form the health network provided that sought her permission to share the consultation audio with vendors that included Microsoft Azure, the cloud computing system run by OpenAI's largest investor. Bauer-Kahan didn't want such intimate medical conversations being shared with tech companies, she said.

"The release was very specific that for-profit companies would have the right to have this," said Bauer-Kahan, a Democrat who represents part of the San Francisco suburbs in the state Assembly. "I was like 'absolutely not.'"

John Muir Health spokesman Ben Drew said the health system complies with state and federal privacy laws.

___

Schellmann reported from New York.

___

This story was produced in partnership with the Pulitzer Center's AI Accountability Network, which also partially supported the academic Whisper study.

___

The Associated Press receives financial assistance from the Omidyar Network to support coverage of artificial intelligence and its impact on society. AP is solely responsible for all content. Find AP's standards for working with philanthropies, a list of supporters and funded coverage areas at AP.org.

___

The Associated Press and OpenAI have a licensing and technology agreement allowing OpenAI access to part of the AP's text archives.

Continue Reading...

Popular

Many retailers offer 'returnless refunds.' Just don't expect them to talk much about it

It's one of the most under-publicized policies of some of the biggest U.S. retailers: sometimes they give customers full refunds and let them keep unwanted items too.

Tesla Investors Confuse 'Valuation And Stock Price,' Says Gary Black As Investor Sees Recovery In Stock

Gary Black, managing partner at The Future Fund, shared his outlook on Tesla Inc., stressing that "many TSLA investors still conflate valuation and stock price."

Trump & Kamala's Dark End Game Exposed - Ad

The election will forever divide America... but not in the way you think it will. As the polls close, an unstoppable chain reaction could cleave the markets in two... whether you are enriched or impoverished by it depends on what you do with your money before November 5th.

A failed mic leaves Donald Trump pacing the stage in silence for nearly 20 minutes

DETROIT (AP) — paced his rally stage in silence for nearly 20 minutes Friday night in Detroit after his microphone cut out.

$2 Trillion Disappears Because of Fed's Secretive New Move - Ad

$2 trillion has disappeared from the US government's books. The reason why is a new, secretive move being carried out by the Fed that has nothing to do with lowering or raising interest rates. According to Dan Ferris, you should consider moving money to a unique "escape" investment right away.

Edmunds: These are the best lightly used hybrid cars, SUVs and trucks

What if you can’t afford to buy a new car? Consider buying a used one. A lightly used hybrid can save you thousands of dollars compared to an equivalent new one and be a trustworthy vehicle for many years to come.

Bill Gates Had A 'Very Bad Habit' That Could Have Derailed His Career

While at Harvard, Bill Gates had a bad habit he liked to show off. The habit was later fixed as it wasn't something in the business world appreciated.

What the Election Means for AI Stocks - Ad

If you think AI stocks are hot right now, just wait until after the election. I believe the next president's first move could launch a second wave of AI winners.

Will people leave Florida after devastating hurricanes? History suggests not

ORLANDO, Fla. (AP) — The news rippled through Treasure Island, Florida, almost like a third storm: The mayor planned to move off the barrier island a month after flooded tens of thousands of homes along the Gulf Coast and two weeks after also ravaged the state.

Planning to Vote? This Election Is Rigged! - Ad

If you are planning to vote in November (and even if you are not), then what we've dug up will impact you and your money... Make no mistake: Congress and the Biden Administration have already rigged this election. The next President will be chosen by a select group of powerful people in the U.S. government.

Brazil reaches $23 billion settlement with mining firms over 2015 environmental disaster

SAO PAULO (AP) — federal government on Friday reached a multibillion-dollar settlement with the mining companies responsible for a 2015 dam collapse that the government said was the country's

Trump Turns Up To Serve Fries At McDonald's: 'I Could Do This All Day, I Wouldn't Mind This Job"

Former President Donald Trump was seen serving customers at a McDonald’s Corp. (NYSE:MCD) drive-thru in Pennsylvania on Sunday, while continuing to ridicule Vice President Kamala Harris’s past work experience at the fast-food chain.

Exposed: Democrats' Secret Plan to Keep Trump Out of the White House - Ad

Former advisor to the CIA, the Pentagon and the White House Jim Rickards just released this shocking new video exposing Democrats' secret plan to keep Trump out of the White House... Even if he wins the election. See the details and learn how to prepare... Because this could trigger the biggest constitutional crisis in our nation's history.

Super Micro Computer's shares plunge after accounting firm resigns

NEW YORK (AP) — Shares of Super Micro Computer plunged more than 30% Wednesday morning, after the server maker disclosed that Ernst & Young had resigned as its public accounting firm.

McDonald's agreed to Trump event but insists it isn't endorsing a presidential candidate

McDonald’s Corp. agreed to at a Pennsylvania store over the weekend but stressed that it isn’t endorsing a candidate in the U.S. presidential race.

Single Stock Blueprint Available Now - Ad

Market Wizard Larry Benedict is one of the most successful traders you'll ever meet...But he doesn't make money the traditional way. In short: It's a way to trade just one stock...And potentially make all the money you need to fast-track your retirement -- no matter what happens in the stock market.

Iranian Hackers Leak Stolen Emails From Trump's 2024 Campaign Ahead Of Nov. 5 Election: Report

The hacking group, identified as Mint Sandstorm or APT42, was previously indicted by the U.S. Justice Department for alleged election interference.

Jobs report on eve of election will be among the most distorted in years

WASHINGTON (AP) — Four days before Election Day, the government will issue its final snapshot of in the United States after a presidential race in which voter perceptions of the economy have played a central role.

Forget Nvidia, Apple, Tesla, and Google - Ad

Market Wizard Larry Benedict: "Forget 99% of stocks: It's possible to make all the money you need for a happy retirement with just this one."

What to stream: 'Yellowstone' starts its end, Eddie Redmayne as a sniper and Aubrey Plaza gets high

Eddie Redmayne starring as a sniper for hire in the new limited series “The Day of the Jackal" and “Yellowstone” riding off into the sunset with the launch of its final episodes are some of the new television, films, music and games near you.

Wavebot: The Automated Trading Tool for This Bull Market - Ad

October through December are historically among the most bullish months for crypto. WaveBot -- an automated trading tool that takes all the guesswork out of profiting in crypto. It trades key levels, buying dips and selling at the perfect time, 24/7. All you need to do is set it up. After that, WaveBot takes care of everything.

$2.5 Million From Meme Coins? One Trader Seems To Have Cracked The Code

A whale made $2.5 million trading meme coins with potential for high profitability. Solonchain highlights effective risk management and upcoming conference on memecoins.

Jamie Dimon Reportedly Supports Kamala Harris Behind Closed Doors, But Maintains Silence In The Public

Jamie Dimon, CEO of JPMorgan Chase, has reportedly privately expressed support for Kamala Harris while avoiding public endorsement due to fears of retaliation from Donald Trump.

Elon: Tesla Is a Robotics Company Now - Ad

Elon Musk's new plan for Tesla's future has nothing to do with electric cars... TechRadar reports it "will blow your mind..." & McKinsey says it "will shape the coming decade." We recently got our hands on a video clip detailing this breakthrough.

Which Industries Have The Highest Cannabis Consumption At Work? New Data Has Answers

Explore the latest CDC analysis on workplace cannabis use across industries. Discover which sectors are driving this trend!

Financial Nightmare Coming After Election - Ad

In 2018, one independent research predicted Kamala Harris was on her way to becoming the president of the United States. "Frankly, she scares us to death... and she should scare you," they wrote. Which is why you need to check out their newest Kamala prediction immediately.

Stock Of The Day: Oil Climbs — And Chevron Follows Suit

Shares of Chevron (CVX) are trading higher because oil is as well. But they have hit resistance at a former support level.

A Gold Storm Is Coming - Ad

Stansberry Research just released a brand-new warning for what they believe will happen to gold in 2025. Even the most prepared Americans - including many retirees - could be blindsided by what's about to happen.

US Steel Reports Better-Than-Expected Q3 Results, Aims To Close Nippon Steel Deal By Year End

U.S. Steel reported its third-quarter results after Thursday's closing bell. Here's a look at the details from the report.

DeSantis Faces Backlash For Using Opioid Settlement Funds On Anti-Cannabis Campaign

State law stipulates the opioid settlement trust fund is meant to "abate the opioid epidemic" and provide resources for affected communities.

U.S. Government Report Alert Tuesday - Ad

Every time the government releases jobs, inflation, GDP and other economic reports... Use the zero day loophole to target up to 253%... 327%... Even 383% overnight profits!

Erykah Badu celebrated as fashion icon at CFDA Awards after years of pushing boundaries

NEW YORK (AP) — Erykah Badu was bestowed the icon award by the Council of Fashion Designers of America, playfully saying it was an honor she’d been hoping to get most of her life.

Report: Washington Post loses more than 200,000 subscriptions following non-endorsement

NEW YORK (AP) — More than 200,000 people have canceled subscriptions to The Washington Post since the newspaper last week not to endorse a candidate for president, a published report said Monday.

Tesla Execs Are Freaking Out - Ad

You might not believe what you're about to see is real, but I assure you the video has been left unedited. It's so revolutionary that tech giants like Microsoft, Amazon, and NVIDIA are all lining up to get their hands on it. And Elon Musk has completely restructured Tesla to chase this opportunity.

Russia amplified hurricane disinformation to drive Americans apart, researchers find

WASHINGTON (AP) — Russia has helped amplify and spread in the United States and the federal government's response, part of a wider effort by the Kremlin to manipulate America's political discourse before the presidential election, .

Trending Now

Information, charts or examples are for illustration and educational purposes only and not for individualized investment management This message contains commercial elements, such as advertising. We only send these offers to those who have opted in to our newsletter. Past performance is not indicative of future results. For these reasons we strongly suggest trading in a DEMO/Simulated account. The information provided by us is for educational and informational purposes only. We make no representations or warranties concerning the products, practices or procedures of any company or entity mentioned or recommended and have not determined if the statements and opinions of the advertiser are accurate, correct or truthful. If you use, act upon or make decisions in reliance on information contained or any external source linked within it, you do so at your own peril and agree to hold us, our officers, directors, shareholders, affiliates and agents without fault.

Copyright systemtrading.ca
Privacy Policy | Terms of Service