Skip to content
Finance

Deloitte Under Scrutiny: Ai-Generated Inaccuracies Found In Aud 440,000 Australian Welfare Report

By Sarah Chen
2 min read
Deloitte
Deloitte
In this article (7)

A report commissioned by Australia’s Department of Employment and Workplace Relations, which was paid AUD 440,000 (around 231,200 Swiss francs), looked into an IT system intended to automate sanctions in the country’s welfare framework. The original report was published in July and was quietly updated on the ministry’s website last week. The updated version featured over a dozen deletions of non-existent references and footnotes, a refreshed reference list, and various typographical corrections.

Report Inaccuracies

Christopher Rudge, a researcher at the University of Sydney, discovered several inaccuracies in the report. He hypothesized that these inaccuracies could be due to instances of AI hallucinations, which occur when generative models fabricate information that appears to be factual.

Findings Deemed Unreliable

While the report now includes a disclaimer that generative AI was utilized to address “gaps in traceability and documentation”, the trust in the report’s findings has been undermined as a result of the reported inaccuracies. “The firm acknowledged the use of generative AI for a significant analytical task but did not initially disclose it,” said Rudge. He expressed concern that the recommendations made in the report could not be fully trusted.

Nonetheless, the ministry maintained that “the essence of the independent review remains unchanged and there will be no alterations to the recommendations”. There are also reports that Deloitte forfeited the final payment for the report, although the amount was not specified.

Impact on Deloitte

This incident does more than just create a financial dent; it also represents a significant blow to Deloitte’s reputation. The firm, which advises corporations, governments, and institutions worldwide on the proper utilization of AI, is now facing scrutiny for the responsible use of these technologies.

Questions & Answers

Q.

What inaccuracies were found in the report?

A.

Christopher Rudge from the University of Sydney found several inaccuracies in the report, suggesting they could be the result of AI hallucinations – when generative models create information that appears factual.

Q.

What was the initial reaction to these inaccuracies?

A.

While Deloitte admitted to using generative AI and added a disclaimer in the updated version of the report, there has been a decline in trust regarding the report’s findings. The ministry, however, maintained that the core of the review and its recommendations remain unaltered.

Q.

What impact has this had on Deloitte?

A.

Beyond the financial implications, this incident represents a significant reputational setback for Deloitte, a firm that advises on the responsible use of AI worldwide.

Reader pulse

Deloitte's AI use was:

22,162 votes so far

Background from the Retail Academy

Background guides from the Retail Academy, free to read.

  • Unit economics

    Unit economics

    Four-wall margin, occupancy cost ratio, payback period and contribution per square metre, the small set of numbers that decides whether a store network can s…

    Retail Leadership · 10 min read

  • General

    AI in retail

    A practical map of where AI already pays off in retail, from demand forecasting and pricing to search, customer service and store operations, and where the h…

    Retail Operations · 11 min read

  • General

    Loyalty and membership design

    Points, tiers or paid membership: which mechanic fits which business, what a loyalty programme actually costs, and how to measure incremental effect instead…

    Retail Leadership · 11 min read

  • General

    E-commerce launch checklist

    Payments, address handling, delivery promise, tax display, returns and analytics: the launch checklist for selling online in an Asian market.

    Retail Toolkit · 9 min read

Weekly Briefing

Asia's retail intelligence, in your inbox

Monday, Wednesday and a Friday Weekly Wrap: the retail stories, numbers and moves that mattered across Asia. Nothing else, and you can unsubscribe in one click.

  • Top industry moves and market shifts
  • Weekly data-driven analysis from across Asia
  • Monday, Wednesday and the Friday Weekly Wrap

Read by retail operators, investors and brand teams across Asia.

Protected by a quick human check. No spam, ever. Unsubscribe in one click.

SecureGDPR ready