Supporting evidenceCustomer and pilot evidence

AI summary expert review

An expert review providing explicit counterevidence against treating every contextual AI summary as ready for unsupervised client reporting.

Repo path

research/interviews/undated-2026-danny-ai-summary-review/README.md

Notes

The supplied transcript is incomplete and has no session date.

Raw source preview

Raw, unprocessed file text shown below.

---
title: "AI summary expert review"
status: processed
source_type: incomplete prototype review
session_date: unknown
year: 2026
participants:
  - Danny Bowles
  - Desmond Leo
product_area: "Quant Surveys / AI summaries"
tags: [ai-summaries, reporting, counterevidence, internal-practitioner, incomplete-transcript]
---

# AI summary expert review

## Source file

- [ai-summary-review-incomplete-transcript.docx](./ai-summary-review-incomplete-transcript.docx) — supplied transcript with no date header and a gap between 1:09 and 15:01.

## Evidence relevant to launch

- Danny described the output as “very mathematical and formal” and “very unhuman” (0:10).
- He said, “I wouldn't use it as it is,” pointing to language quality and a weak brand-equity section (15:33–16:16).
- He wanted more holistic, action-oriented interpretation rather than a purely factual summary (from 16:59).

## What this supports

The underlying summarisation mechanism was tested with an experienced researcher, but this source is principally counterevidence: contextual, client-facing summaries still need expert review and refinement.

## What this does not prove

The session is incomplete and undated. Its criticism should not be generalised to every AI-summary use case, but it prevents an unqualified claim that all summary outputs are ready for unsupervised reporting.