Tech News
AI search engines are confidently wrong more than half the time when they cite sources, study finds

- AI search engines are confidently wrong over 60% of the time when citing news, a recent study says. Despite their errors, these bots rarely admitted uncertainty, raising concerns as artificial intelligence-powered search becomes more dominant.
AI search engines have an accuracy issue when it comes to citing news articles.
That’s according to a study from The Tow Center for Digital Journalism at Columbia University, which tested AI products like OpenAI’s ChatGPT Search and Google’s Gemini to assess their ability to accurately cite news articles. The analysis probed eight AI systems and found that, collectively, the bots provided incorrect answers to more than 60% of queries.
The researchers tested the bots with various news articles, manually selecting direct excerpts and asking the chatbots to identify the “corresponding article’s headline, original publisher, publication date, and URL.”
The study found the AI chatbots failed to retrieve the correct articles more than half the time and were generally bad at declining to answer questions they couldn’t answer accurately.
Accuracy varied across platforms, with Perplexity answering 37% of the queries incorrectly, while Grok 3 had a significantly higher error rate, answering 94% of the queries incorrectly.
The researchers said that despite the poor results, the AI bots answered queries with “alarming confidence.” They noted that the bots rarely used any qualifying phrases, such as “it appears,” “it’s possible,” or “might.”
The bots also rarely refused to answer; for example, ChatGPT incorrectly identified 134 articles but signaled a lack of confidence just fifteen times out of two hundred responses, and never declined to provide an answer.
Except for Microsoft’s Copilot—which declined more questions than it answered—all of the tools were consistently more likely to provide an incorrect answer than to acknowledge limitations.
That AI bots are capable of spreading confident misinformation is not a new revelation. In the AI industry, that practice is known as “hallucinating” and happens to varying degrees across all large language models (LLMs). However, the authors note that the recent acceleration of AI search engines such as Google’s AI Overviews makes the issue more pressing.
“While traditional search engines typically operate as an intermediary, guiding users to news websites and other quality content, generative search tools parse and repackage information themselves, cutting off traffic flow to original sources,” the authors wrote. “These chatbots’ conversational outputs often obfuscate serious underlying issues with information quality.”
The study also noted that generative search tools fabricated links and cited syndicated and copied versions of articles.
Representatives for xAI, OpenAI, Google, and Perplexity did not immediately respond to a request for comment from Fortune, made outside normal U.S. working hours.
The rise of AI-powered search
Ever since OpenAI first launched ChatGPT, AI’s significance for the search business has been looming over Big Tech companies.
Microsoft has had an AI-powered version of Bing since early 2023, and late last year, OpenAI rolled out ChatGPT search, in a move seen as the company’s biggest challenge to Google yet.
Not to be outdone, Google is also going all in on AI-powered search.
The company has been pitching AI as the future of search for some time, envisioning a future where Google does the “Googling for you” and spares users the need to visit many websites themselves to answer queries.
Earlier this month, Google announced it was expanding its AI overviews to more people, including teen users, and had begun testing an AI-only search, called AI Mode. Early testers of the experimental product have given it generally favorable reviews.
Some tech companies have tried to establish formal relationships with news publishers to allow their models to cite articles. In February, OpenAI finalized its sixteenth and seventeenth content licensing agreements with the Schibsted and Guardian media groups, respectively. Meanwhile, last year, Perplexity launched its Publishers Program, aimed at fostering collective success, which features a revenue-sharing model for participating publishers.
However, the study found that these content licensing deals did not guarantee accurate citation in chatbot responses.
This story was originally featured on Fortune.com
Tech News
Cathie Wood says most memecoins will end up ‘worthless’

Most of the so-called memecoins that are flooding the $2.6 trillion cryptocurrency space will probably end up “worthless,” according to Cathie Wood.
The combination of blockchain technology and artificial intelligence is creating “millions” of meme cryptocurrencies that “are not going to be worth very much,” the ARK Investment Managment LLC founder and CEO told Bloomberg Television on Tuesday, adding that her private funds are not putting money into these coins.
Memecoins are a type of digital asset often inspired by jokes, current events or trends in popular culture. In February, the US Securities and Exchange Commission said memecoins are not considered securities so they will remain unregulated.
“If I have one message for those listening who are buying memecoins: buyer beware,” said Wood. “There’s nothing like losing money for people to learn, and they’ll learn that the SEC and regulators are not taking responsibility for these memecoins.”
This story was originally featured on Fortune.com
Tech News
The Pentagon is slashing up to 60,000 civilian jobs amid Elon Musk’s DOGE cost-cutting push, prompting national security fears

Roughly 50,000 to 60,000 civilian jobs will be cut in the Defense Department, but fewer than 21,000 workers who took a voluntary resignation plan are leaving in the coming months, a senior defense official told reporters Tuesday.
To reach the goal of a 5% to 8% cut in a civilian workforce of more than 900,000, the official said, the department aims to slash about 6,000 positions a month by simply not replacing workers who routinely leave.
A key concern is that service members may then be tapped to fill those civilian jobs. But the official, who spoke on the condition of anonymity to provide personnel details, said Defense Secretary Pete Hegseth wants to ensure the cuts don’t hurt military readiness.
The cuts are part of the broader effort by the Department of Government Efficiency Service, including billionaire Trump adviser Elon Musk, to slash the federal workforce and dismantle U.S. agencies.
Acknowledging that “some” military veterans will be among the civilians let go, the official would not estimate how many but agreed it could be thousands.
The department is using three ways to accomplish the workforce cuts: voluntary resignations, firing probationary workers and cutting jobs as employees routinely leave. The official said the military services and Pentagon officials are going over the personnel on a case-by-case basis to ensure cuts don’t affect critical national security jobs.
Plans to cut probationary workers — which the Pentagon said targeted about 5,400 of the roughly 54,000 in the department — are already on hold due to court challenges.
The official added that Hegseth is confident the staffing cuts can be done without negatively affecting military readiness.
This story was originally featured on Fortune.com
Tech News
Proposed Trump policy could force thousands of citizens applying for social security benefits to verify their identities in person

Trump’s Social Security Administration proposed a major change that could force thousands of people every week to show up at a shrinking list of field offices before they can receive benefits.
In an effort to combat fraud, the SSA has suggested that citizens applying for social security or disability benefits over the phone would also need to, for the first time, verify their identities using an online program called “internet ID proofing,” according to an internal memo viewed by the Washington Post.
If they can’t verify their identity online, they will have to file paperwork at their nearest field office, according to the memo sent last week by Acting Deputy Commissioner for Operations Doris Diaz to Acting Social Security Commissioner Leland Dudek.
The memo acknowledged the potential change could force an estimated 75,000 to 85,000 people per week to seek out field offices to confirm their identities and could lead to “increased challenges for vulnerable populations,” “longer wait times and processing time,” and “increased demand for office appointments,” the memo read, according to the Post.
The change would disproportionately affect older populations who may not be internet savvy, and those with disabilities. Claimants seeking a field office will also have fewer to choose from, as more than 40 of 1,200 are estimated to close, the New York Times reported, citing advocacy group Social Security Works. The list of offices slated to close is based on an unreliable list released by DOGE, according to Social Security Works. Elon Musk’s DOGE has also said it will cut 7,000 of the SSA’s 57,000 employees.
The White House and the Social Security Administration did not immediately respond to Fortune‘s request for comment.
The SSA previously considered scrapping telephone service for claims, the Post reported, but backtracked after a report by the outlet. Regardless, the SSA said claimants looking to change their bank account information will now need to do so either online or in-person and could no longer do so over the phone.
Almost every transaction at a field office requires an appointment that already takes months to realize, according to the Post.
The White House has repeatedly said it will not cut Social Security, Medicare, or Medicare benefits, and has said any changes are to cut back on fraud. A July 2024 report from the Social Security Administration’s inspector general estimated that between fiscal 2015 and fiscal 2022, the SSA sent out $8.6 trillion in disbursements. Fewer than 1% of the disbursements, or $71.8 billion worth were improper payments, according to the report.
Acting Social Security Commissioner Dudek said for phone calls, the agency is “exploring ways to implement AI — in a safe, governed manner in accordance with” guidance from the Office of Management and Budget “to streamline and improve call resolution,” according to a Tuesday memo obtained by NBC News.
Dudek mentioned in the memo that the agency has been frequently mentioned in the media, which has been stressing out employees.
“Over the past month, this agency has seen an unprecedented level of media coverage, some of it true and deserved, while some has not been factual and painted the agency in a very negative light,” he wrote. “I know this has been stressful for you and has caused disruption in your life. Personally, I have made some mistakes, which makes me human like you. I promise you this, I will continue to make mistakes, but I will learn from them. My decisions will always be with the best intentions for this agency, the people we serve, and you.”
This story was originally featured on Fortune.com
-
Tech News3 months ago
How Costco’s formula for reaching uncertain consumers is pushing shares past $1,000 to all-time highs
-
Tech News3 months ago
Luigi Mangione hires top lawyer—whose husband is representing Sean ‘Diddy’ Combs
-
Tech News3 months ago
Lego bricks have won over adults, growing its $10 billion toy market foothold—and there’s more to come
-
Tech News3 months ago
Quentin Tarantino thinks movies are still better than TV shows like Yellowstone
-
Tech News3 months ago
Inside the FOMC: Boston Fed President Susan Collins on changing her mind, teamwork, and the alchemy behind the base rate
-
Tech News3 months ago
Nancy Pelosi has hip replacement surgery at a US military hospital in Germany after falling at Battle of the Bulge ceremony
-
Tech News3 months ago
Trump and members of Congress want drones shot down while more are spotted near military facilities
-
Tech News3 months ago
Hundreds of OpenAI’s current and ex-employees are about to get a huge payday by cashing out up to $10 million each in a private stock sale