From Reuse the work. Verify the result.Issue published Sep 4, 2026

Let AI propose the change. Make code apply it precisely.

Published August 31, 2026

What it saysIn a study of editing server configuration files, apparently successful edits could change the wrong thing. The proposed approach separates deciding what to change from applying the exact edit.

Why it mattersA correct request can still fail during execution.

Try thisChoose one action where the assistant changes a saved record.

How to use it

Suggested steps

  1. Choose one action where the assistant changes a saved record.
  2. Have it specify the record, field, and new value.
  3. Use code to validate and apply that change; stop if the target is unclear.
Two jobs, two checksConceptual explanation · Evals Weekly
CheckWhat to look for
Decide what should changeReview the proposed action
Apply the changeCheck the exact saved result

Keep in mind The study concerns a specific file-editing task. The proposed change still needs to be appropriate.

A quick check for yourself

What is the practical lesson?

Show answer

A correct request can still fail during execution.

Source & why it’s here

Don’t Let the Model Write the YAML (opens in a new tab)

Original issue reading order, preserved from the archive.