AI is 'absolutely useless' at forecasting inflation. This proven model is 12 times more accurate.

By Mark Hulbert

A 'low-tech' Cleveland Fed tool consistently outperforms generative AI, which has struggled to provide reliable forecasts

Don't bother asking AI for an inflation forecast.

A new study provides yet more evidence that investors exaggerate the forecasting ability of artificial intelligence. The study's authors found that ChatGPT doesn't even come close to matching the predictive accuracy of a low-tech model that has been around for years.

Its record is so bad, in fact, that Joachim Klement, head of strategy at Panmure Liberum, a U.K. investment bank, has concluded that ChatGPT is "absolutely useless" when it comes to macroeconomic forecasting.

That's a strong claim coming from someone who holds degrees in mathematics, economics and finance. But the new study, titled "ChatMacro: Evaluating Inflation Forecasts of Generative AI," certainly supports it. The study's authors compared the inflation predictions of ChatGPT with those of the Federal Reserve Bank of Cleveland's inflation nowcasting model and found that ChatGPT's error rate was as much as 12 times greater than that of the Cleveland model.

Not all past studies of AI's macroeconomic forecasting record have painted such a dismal picture. But the authors of this new study point out that great care must be taken when measuring the accuracy of AI's predictions to ensure that the AI models haven't been "trained" on material that includes the eventual answers. In that event, of course, AI's track record will be artificially inflated by what statisticians refer to as "hindsight bias."

Furthermore, according to the study's authors, AI track records may still be distorted by hindsight bias even when you instruct an AI model to make macroeconomic predictions only using publicly available data that were available prior to a certain date. They found evidence that ChatGPT appeared to be "using forwarding looking information despite being asked not to." This underscores the importance of a true out-of-sample test when calculating AI's track record. The researchers believe that some past analyses of AI track records that claim to be out-of-sample were not in fact out-of-sample.

The bottom line? Don't bother asking AI for an inflation forecast. Odds are good that the Cleveland Fed model will be more accurate. Currently the model predicts that the CPI's 12-month rate of change for May will be 4.2%.

Mark Hulbert is a regular contributor to MarketWatch. His Hulbert Ratings tracks investment newsletters that pay a flat fee to be audited. He can be reached at mark@hulbertratings.com.

More: The AI bubble isn't bursting: Why the capital-spending boom has room to run

Also read: U.S. economy adds 115,000 jobs in April, as labor market appears on the mend

-Mark Hulbert

This content was created by MarketWatch, which is operated by Dow Jones & Co. MarketWatch is published independently from Dow Jones Newswires and The Wall Street Journal.

 

(END) Dow Jones Newswires

05-12-26 1420ET

Copyright (c) 2026 Dow Jones & Company, Inc.

The articles, information, and content displayed on this webpage may include materials prepared and provided by third parties. Such third-party content is offered for informational purposes only and is not endorsed, reviewed, or verified by Morningstar.

Morningstar makes no representations or warranties regarding the accuracy, completeness, timeliness, or reliability of any third-party content displayed on this site. The views and opinions expressed in third-party content are those of the respective authors and do not necessarily reflect the views of Morningstar, its affiliates, or employees.

Morningstar is not responsible for any errors, omissions, or delays in this content, nor for any actions taken in reliance thereon. Users are advised to exercise their own judgment and seek independent financial advice before making any decisions based on such content. The third-party providers of this content are not affiliated with Morningstar, and their inclusion on this site does not imply any form of partnership, agency, or endorsement.

Popular

Sponsor Center