agentrecount
Recount every claim in an AI agent's report against your own data: formula, denominator, period, four verdicts.
Cite this software
Description
agentrecount is a dependency-free Python tool for auditing the reports that AI agents write. Each claim of the report is entered with its formula, denominator and period; the tool recomputes it from the user's own tables (CSV or JSON) under the stated definition and under every alternative way of counting listed, and sorts it into one of four verdicts: holds as stated; holds only under one way of counting; partly false or misleading; not reproduced or not testable. It also lists the claims that arrived without a denominator or a period.
The verdict scale and the procedure come from the case report AI Call Center Supervisor in a Live Company (payrollburn, part 1 of the series AI managers in a live company, DOI 10.5281/zenodo.23926850), in which only one of nine checkable claims of the agent's own weekly report held exactly as written. The example data are synthetic. Python 3.10+, standard library only, no network calls. Part of the free Digital employees catalog at arsentev.ai/employees.