[AI Test Toolkit] Export full eval run results (cost, time, dataset)#8442
[AI Test Toolkit] Export full eval run results (cost, time, dataset)#8442onbuyuka wants to merge 2 commits into
Conversation
…dataset) Report 149030 "AIT Test Summary" (the "Export Results" / "Download Test Summary" action on the AI Eval log pages) only emitted a subset of the AIT Log Entry data: codeunit/test name, status, accuracy, turns, input, output and error. It omitted the cost and timing data the user needs to analyse a run - tokens consumed, duration, start/end time - as well as the version, tag and dataset identity (test input group/code/description) that are shown on screen. Add those columns to the report dataset so the exported workbook contains the full per-entry results. Because a modern Excel-layout report writes every dataset column into the workbook's Data sheet, the new fields are exported without needing to change the formatted layout. Fixes AB#633442 Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
onbuyuka
force-pushed
the
bugs/633442-ait-export-full-results
branch
from
0e67942 to
06027af
Compare
CI note: the Clean build failure is a known BCApps incremental-build infra issue — not this changeThe Evidence it is infrastructure, not this change:
No code change is appropriate (a |
Per PR review feedback: agent tests do not log tokens, and the token count is internal information that should not be exported. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
|
4 participants
Summary
The Export Results / Download Test Summary action on the AI Eval log pages (report
149030 "AIT Test Summary") did not export the full run results. It only emitted: codeunit/test name, status, accuracy, turns, input, output, and error. The reporter needs the cost and timing data to analyse a run.Root cause
The export passes the complete filtered
AIT Log Entryview to the report (no row/marked-row limiting) — so the limitation is purely the report's column set. The dataset omitted fields that already exist on the table and are shown on screen:Tokens Consumed,Duration (ms),Start Time,End TimeVersion,Tag,Test Input Group Code,Test Input Code,Test Input Description,Run ID,Entry No.Fix
Add those columns to the
dataitem(Results; "AIT Log Entry")dataset. A modern Excel-layout report writes every dataset column into the workbook's Data sheet, so the new fields are exported in the raw data without changing the formatted.xlsxlayout.Follow-up (optional, not in this PR)
If the formatted/pretty sheet of
AITestSummary.xlsxshould also display the new columns, the layout file can be regenerated from the updated report (Report → Run → Edit layout). The raw Data sheet already carries them.Impact / risk
Additive only — no codeunit/page changes; the export already passed the full filtered view. Field names verified against
AITLogEntry.Table.al.Verification
AIT Log Entry(fields 1, 4, 5, 9, 13, 15, 18, 24, 25, 26, 50).Linked work item: AB#633442
🤖 Generated with Claude Code