Do not begin with every possible log line. Begin with the moment the operator says yes, no, revise, or escalate. Rehearsal telemetry exists to make that moment faster and more trustworthy. It should summarize why the agent believes the next action is ready and show exactly what evidence would change the answer.
Define an action-readiness packet.
The first object is a packet, not a dashboard. It should contain the proposed action, source evidence, freshness window, approval boundary, security flags, recovery path, and receipt plan. For a text-message agent, that packet includes the latest thread and draft. For a browser agent, it includes the observed page state. For a publishing agent, it includes local path, planned live URL, backlinks, and deploy status.
Keep run logs separate.
Telemetry for operators should not expose every trace. Keep engineering observability available, but translate it into readiness language.
Use freshness windows.
Set maximum ages for browser state, user consent, and message context. Anything stale should require recheck or escalation.
Classify corrections.
Every operator edit should become a signal: tone, fact, timing, target, permission, evidence, or recovery.
Store useful receipts.
The receipt should explain what happened in human terms, not merely preserve machine logs.
Map the first surface.
Start with a narrow workflow such as text-message AI assistants or AI agent website building. A smaller scope makes the telemetry easier to inspect and improve.
Anchor the risk model.
Use the NIST AI Risk Management Framework as a practical reminder: risk controls should be measurable, governable, and tied to actual behavior.