| Requirement | Verdict | Evidence |
|---|---|---|
| totals_correct Per-campaign four-week totals are computed and correct within rounding: Prospecting - Broad spend $4,800, 169 conversions, CPA ~$28.40; Prospecting - Small-Space Interest spend $2,400, 138 conversions, CPA ~$17.39; Retargeting - 30d Engagers spend $1,600, 83 conversions, CPA ~$19.28 (or stated over known weeks only); Launch Teaser totals acknowledge the missing week. | ✓ | Spend/conversions/CPA for all three main campaigns exactly match the rubric’s figures ($4,800/169/$28.40, $2,400/138/$17.39, $1,600/83/$19.28) and Launch Teaser's missing week is explicitly flagged rather than summed as zero. |
| best_worst Small-Space Interest is identified as the best performer (lowest CPA ~$17.39, stable, ROAS ~3.9) and Broad as the biggest problem (weekly CPA rising from $20 to $48 while CTR halves from 1.8% to 0.9%); calling the Launch Teaser 'worst' on CPA alone without noting its video-views objective does not pass. | ✓ | Small-Space Interest is named best with CPA $17.39/ROAS 3.91x and stability evidence, and Section 3 separately diagnoses Broad as the biggest problem with CPA rising $20→$48 and CTR halving 1.80%→0.90%, satisfying both required elements even though Launch Teaser is separately labeled 'worst' with its video-views objective explicitly noted. |
| recommendation There is one specific budget change (e.g. shift spend from Broad toward Small-Space Interest) and one bounded test (what change, what metric, what timeframe or budget). | ✓ | The response gives a cohesive budget-reallocation plan (pause Launch Teaser, trim Broad and Retargeting, scale Small-Space Interest) with a stated net budget impact, plus one bounded 14-day creative test with a budget cap for Broad. |
| missing_preserved The empty conversions/revenue cells for Launch Teaser in the week of 2026-07-20 are flagged as missing data (e.g. a tracking gap), not treated as zero or silently summed over. | ✓ | The response explicitly states 'A blank metric is missing/untracked data rather than verified zero conversions' and separates the matched 3-week CPA from a hypothetical zero-treated version. |
| partial_metric_denominators Any Launch Teaser CPA or ROAS uses spend and outcomes from exactly the same complete rows, or is reported as unavailable. Dividing all four weeks of spend by only three known weeks of conversions/revenue fails. | ✗ | The response computes an alternate CPA/ROAS by dividing the full 4-week spend ($1,000) by only the 7 known conversions ('Full 4-Wk Spend' row and calculation $1,000/7=$142.86), which is exactly the mismatched-denominator calculation the rubric flags as failing. |
| evidence_shown The arithmetic behind key claims is shown (at least CPA calculations), and metric definitions/sources are used as supplied rather than invented. | ✓ | Explicit CPA and ROAS formulas with numeric substitutions are shown for every campaign under 'Exact Arithmetic'. |
| cautious_conclusions A limitation that would most change the conclusion is stated (e.g. attribution window, missing week, four-week sample), and correlation is not presented as proven causation. | ✓ | The response names attribution/incrementality (view-through vs first-party tracking) as the limitation most likely to change conclusions and frames results as correlational rather than proven causal ('we cannot determine the incremental net-new revenue'). |
| trend_over_snapshot The diagnosis is driven by week-over-week movement (Broad's CTR/CPA deterioration, Retargeting frequency climbing 6.1 to 11.4 with falling conversions), not four-week averages alone. | ✓ | Section 3 is built entirely on week-over-week figures (Broad CPA $20→$48, CTR 1.80%→0.90%; Retargeting frequency 6.1→11.4 with conversions 26→14) rather than four-week averages. |
| prioritized_action Recommendations are prioritized (one clear primary move) rather than an unranked laundry list. | ✗ | The budget recommendation lists four separate actions (pause, two reductions, one scale-up) as bullet points without designating a single clear primary move, resembling an unranked list. |
| bounded_test_decision The proposed test has one control and one changed variable, a duration or spend cap, one primary KPI, a numeric win rule, and either a numeric minimum sample or an explicit rule for declaring the result inconclusive. | ✓ | The creative test specifies a control vs. new-variant setup, a $300/week cap, a 14-day window with a Day-7 check, CTR/CPA as KPIs, and numeric win/stop rules (pause if CPA>$40 after 150 clicks; graduate if ROAS≥2.5x). |