Step 18 / 20 · Deliver · human in the loop

Human review

An expert approves or edits.

For business

What it is

An expert checks, edits and approves the result before it goes out.

Why it matters

Accountability stays with people where it matters, and every edit teaches the system what “good” looks like.

Risk without it

Fully automatic output in regulated work is a liability, and without capturing edits the system never improves.

For engineers

How it works

A review screen shows the draft next to its cited sources; reviewers approve, edit or reject. Edits and ratings are stored as structured feedback and feed the evaluation sets and the knowledge base.

Typical stack

  • review UI (React)
  • audit log
  • feedback store
  • evaluation datasets

Pitfalls & trade-offs

  • Keep sources one click away, or review becomes rubber-stamping.
  • Track edit distance over time: it shows real quality.
  • Route only uncertain cases to people as confidence grows.

In this example

In
report v1
Out
approved by adviser
2 edits · rated 5/5

Fictional sample · not a client system

Contact

Questions about this?

Book a call Write to hello@paxcode.it