Home

OpenAI Reportedly Hesitant to Release ChatGPT Detection Tool That Might Piss Off Cheaters

ChatGPT maker OpenAI has new search and voice features on the way, but it also has a tool at its disposal that’s reportedly pretty good at catching all those AI-generated fake articles you see on the internet nowadays. The company has been sitting on it for nearly two years, and all it would have to do is turn it on. All the same, the Sam Altman-led company is still contemplating whether to release it as doing so might anger OpenAI’s biggest fans.

This isn’t that defunct AI detection algorithm the company released in 2023, but something much more accurate. OpenAI is hesitant to release this AI-detection tool, according to a report from the Wall Street Journal on Sunday based on some anonymous sources from inside the company. The program is effectively an AI watermarking system that imprints AI-generated text with certain patterns its tool can detect. Like other AI detectors, OpenAI’s system would score a document with a percentage of how likely it was created with ChatGPT. 

The supposed program is reportedly 99.9% effective based on internal documents, according to the WSJ. This would be far better than the stated effectiveness of other AI detection software developed over the past two years. That’s likely because OpenAI has access to its own secret sauce. Internal proponents of the program say it will do a lot to help teachers figure out when their students have handed in AI-generated homework.

The company reportedly sat on this program for years over concerns that close to a third of its user base wouldn’t like it. Gizmodo reached out to OpenAI for comment, but we did not immediately hear back. The company told WSJ that the tech has “important risks we’re weighing while we research alternatives.”

The other problem for OpenAI is the concern that if it releases its tool broadly enough, somebody could decipher OpenAI’s watermarking technique. There is also an issue that it might be biased against non-native English speakers.

Google also developed similar watermarking techniques for AI-generated images and text called SynthID. That program isn’t available to most consumers, but at the very least the company is open about its existence.

As fast as big tech is developing new ways to spit out AI-generated text and images onto the internet, the tools to detect fakes aren’t nearly as capable. Teachers and professors and especially hard-pressed to discover if their students are handing in ChatGPT-written assignments. Current AI detection tools like Turnitin have a failure rate as high as 15%. The company said it does this to avoid false positives.

AiAI DetectionChatGPTOpenAISam AltmanWatermarks

You May Also Like

Google Says AI Olympics Ad ‘Tested Well’ Before Inspiring Outrage

Google tried turning Olympics fans into Gemini users. Instead, it made AI look like a weak substitute for parenting.

Developer Says the ‘Friend’ AI Amulet Ripped Off His Project, Releases Diss Track

Another piece of AI hardware, that looks nearly identical, and is also called "Friend," was launched long before this week's product.

Google Gemini Might Soon Question Your Taste in Music

A Spotify extension for Google Gemini has been spotted in a teardown, hinting on being able to play music via AI.

5 Ways That AI Is Actually Useful Right Now

Are you unsure on you can use AI help you in your day-to-day? Here are some great use cases.

Rabbit Says Former Employee Handed Hacking Collective the Keys to the R1’s Backend

The Rabbit had an outside firm perform a security audit on Rabbit’s AI device and “large action model,” though the hacking group says the report misses the point.

America’s Cyber Security Agency Picks Its First Head of AI

The pick comes at a time when CISA’s head has compared the new technology to nuclear weapons.

We may earn a commission when you buy through links on our sites.©2024 GIZMODO USA LLC. All rights reserved.

Mode

Follow us

Mode

Follow us

Source: Gizmodo

Previous

Next