By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
Make Financial CenterMake Financial CenterMake Financial Center
  • Home
  • Investing
  • Banking
  • Credit Cards
  • Mortgages
  • Money Management
  • Marketing
  • Retirement
Reading: ChatGPT Search Shows 76.5% Error Rate In Attribution Study
Notification Show More
Make Financial CenterMake Financial Center
Search
  • Home
  • Investing
  • Banking
  • Credit Cards
  • Mortgages
  • Money Management
  • Marketing
  • Retirement
© 2024 All Rights Reserved | Powered By Make Financial Center
Marketing

ChatGPT Search Shows 76.5% Error Rate In Attribution Study

Make Financial Center November 30, 2024
Share
4 Min Read
ChatGPT Search Shows 76.5% Error Rate In Attribution Study
SHARE

OpenAI’s ChatGPT Search is struggling to precisely cite information publishers, based on a examine by Columbia College’s Tow Middle for Digital Journalism.

Contents
Background On ChatGPT SearchAccuracy PointsCiting Copied & Syndicated Content materialOpenAI’s ResponseTrying Forward

The report discovered frequent misquotes and incorrect attributions, elevating issues amongst publishers about model visibility and management over their content material.

Moreover, the findings problem OpenAI’s dedication to accountable AI improvement in journalism.

Background On ChatGPT Search

OpenAI launched ChatGPT Search final month, claiming it collaborated extensively with the information trade and integrated writer suggestions.

This contrasts with the unique 2022 rollout of ChatGPT, the place publishers found their content material had been used to coach the AI fashions with out discover or consent.

Now, OpenAI permits publishers to specify through the robots.txt file whether or not they need to be included in ChatGPT Search outcomes.

Nevertheless, the Tow Middle’s findings recommend publishers face the danger of misattribution and misrepresentation no matter their participation alternative.

Accuracy Points

The Tow Middle evaluated ChatGPT Search’s potential to establish sources of quotes from 20 publications.

Key findings embrace:

  • Of 200 queries, 153 responses had been incorrect.
  • The AI hardly ever acknowledged its errors.
  • Phrases like “probably” had been utilized in solely seven responses.

ChatGPT typically prioritized pleasing customers over accuracy, which may mislead readers and hurt writer reputations.

Moreover, researchers discovered ChatGPT Search is inconsistent when requested the identical query a number of occasions, possible because of the randomness baked into its language mannequin.

Citing Copied & Syndicated Content material

Researchers discover ChatGPT Search generally cites copied or syndicated articles as a substitute of unique sources.

That is possible as a result of writer restrictions or system limitations.

For instance, when requested for a quote from a New York Occasions article (at the moment concerned in a lawsuit in opposition to OpenAI and blocking its crawlers), ChatGPT linked to an unauthorized model on one other web site.

Even with MIT Know-how Evaluate, which permits OpenAI’s crawlers, the chatbot cited a syndicated copy quite than the unique.

The Tow Middle discovered that each one publishers threat misrepresentation by ChatGPT Search:

  • Enabling crawlers doesn’t assure visibility.
  • Blocking crawlers doesn’t stop content material from exhibiting up.

These points elevate issues about OpenAI’s content material filtering and its strategy to journalism, which can push individuals away from unique publishers.

OpenAI’s Response

OpenAI responded to the Tow Middle’s findings by stating that it helps publishers by means of clear attribution and helps customers uncover content material with summaries, quotes, and hyperlinks.

An OpenAI spokesperson acknowledged:

“We help publishers and creators by serving to 250M weekly ChatGPT customers uncover high quality content material by means of summaries, quotes, clear hyperlinks, and attribution. We’ve collaborated with companions to enhance in-line quotation accuracy and respect writer preferences, together with enabling how they seem in search by managing OAI-SearchBot of their robots.txt. We’ll maintain enhancing search outcomes.”

Whereas the corporate has labored to enhance quotation accuracy, OpenAI says it’s tough to deal with particular misattribution points.

OpenAI stays dedicated to bettering its search product.

Trying Forward

If OpenAI desires to collaborate with the information trade, it ought to guarantee writer content material is represented precisely in ChatGPT Search.

Publishers at the moment have restricted energy and are intently watching authorized circumstances in opposition to OpenAI. Outcomes may influence content material utilization rights and provides publishers extra management.

As generative search merchandise like ChatGPT change how individuals interact with information, OpenAI should display a dedication to accountable journalism to earn consumer belief.


Featured Picture: Robert Manner/Shutterstock

You Might Also Like

6 Keys Your Business Needs To Win With Your Marketing Agency

Expert Social Media Marketing Predictions For 2023

Why CMOs Should Rethink ROAS As A North Star Metric

Google AI Mode Adds Agentic Booking, Expands To More Countries

A Strategic Approach To Boost SEO

TAGGED: Generative AI, Marketing, News
Make Financial Center November 30, 2024 November 30, 2024
Share This Article
Facebook Twitter Copy Link
Previous Article Aged 40? Here's how skipping the daily coffee could build a £2.4m ISA! Aged 40? Here’s how skipping the daily coffee could build a £2.4m ISA!
Next Article Bitcoin Mining: What Is It And How Does It Work? Bitcoin Mining: What Is It And How Does It Work?
Leave a comment Leave a comment

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Latest News

6 Keys Your Business Needs To Win With Your Marketing Agency
6 Keys Your Business Needs To Win With Your Marketing Agency
Marketing August 29, 2025
Senior woman potting plant in garden at home
Start putting £700 each month into a SIPP to try and retire as a millionaire!
Retirement August 28, 2025
Growth ETF Vs. Value ETF: What's The Difference?
Growth ETF Vs. Value ETF: What’s The Difference?
Investing August 28, 2025
Expert Social Media Marketing Predictions For 2023
Expert Social Media Marketing Predictions For 2023
Marketing August 27, 2025
Young mixed-race woman jumping for joy in a park with confetti falling around her
Here’s how a 39-year-old could aim for a million by retirement, by spending £900 a month on UK shares
Retirement August 26, 2025
What Is A Covered Call Options Strategy?
What Is A Covered Call Options Strategy?
Investing August 26, 2025

You Might also Like

6 Keys Your Business Needs To Win With Your Marketing Agency
Marketing

6 Keys Your Business Needs To Win With Your Marketing Agency

August 29, 2025
Expert Social Media Marketing Predictions For 2023
Marketing

Expert Social Media Marketing Predictions For 2023

August 27, 2025
Why CMOs Should Rethink ROAS As A North Star Metric
Marketing

Why CMOs Should Rethink ROAS As A North Star Metric

August 25, 2025
Google AI Mode Adds Agentic Booking, Expands To More Countries
Marketing

Google AI Mode Adds Agentic Booking, Expands To More Countries

August 23, 2025

About Us

Welcome to MakeFinancialCenter, your go-to resource for all things finance. We are dedicated to providing insightful and practical information to help you make informed financial decisions.

Quick Links

  • Investing
  • Banking
  • Credit Cards
  • Mortgages
  • Money Management
  • Marketing
  • Retirement
  • Investing
  • Banking
  • Credit Cards
  • Mortgages
  • Money Management
  • Marketing
  • Retirement

Trending News

6 Keys Your Business Needs To Win With Your Marketing Agency

6 Keys Your Business Needs To Win With Your Marketing Agency

Average Money Market Account Rates for April 2024

Average Money Market Account Rates for April 2024

7 Of The Weirdest, Wildest, Oddball ETFs

7 Of The Weirdest, Wildest, Oddball ETFs

6 Keys Your Business Needs To Win With Your Marketing Agency
6 Keys Your Business Needs To Win With Your Marketing Agency
August 29, 2025
Average Money Market Account Rates for April 2024
Average Money Market Account Rates for April 2024
April 10, 2024
7 Of The Weirdest, Wildest, Oddball ETFs
7 Of The Weirdest, Wildest, Oddball ETFs
April 10, 2024
Teaching My Two Young Daughters About Money
Teaching My Two Young Daughters About Money
April 10, 2024
  • About Us
  • Contact Us
  • Disclaimer
  • Privacy Policy
  • Terms of Service
© 2024 All Rights Reserved | Powered By Make Financial Center
Welcome Back!

Sign in to your account

Lost your password?