Innovation Engine — insight

Eval Contradiction Ledger

August 23, 2026

Ethan runs five-plus daily/hourly evaluator agents (director-mode, claude-efforts, client-next-steps, inbox-consolidator, meeting-intake) that each emit recommendations in isolation — nobody checks whether today's director-mode verdict contradicts yesterday's client-next-steps advice. This nightly job diffs the latest verdicts across evaluators, uses a cheap local gemma call to flag semantic contradictions or duplicated asks, and delivers a single 'your advisors disagree about X' card. It turns a fleet of blind advisors into a board meeting with minutes.

director-mode-evaluatorclaude-efforts-evalclient-next-steps-evaluatorgemma-taskmorning-tablet-briefTCL Note tablet sync

Create ~/.local/bin/eval-contradiction-ledger (bash, ~90 lines). Harvest the newest output artifact from each evaluator cycle (director-mode-eval-run, claude-efforts-eval-cycle, client-next-steps-eval-cycle, daily-inbox-consolidator-cycle, daily-meeting-intake-cycle) — resolve their state/log dirs via `director-mode-state` and the existing *-freshness-check scripts, defaulting to ~/.local/state//latest.md. Extract the top 3 recommendations per evaluator (grep for bullet/numbered lines), concatenate into a labeled block, and pipe to `gemma-task` with a prompt: 'Return JSON list of pairs that contradict or duplicate each other, with a one-line reconciliation.' Append results to ~/.claude/state/eval-contradictions.jsonl (dedupe by sorted pair hash so the same disagreement doesn't renag). If any new contradictions, render a markdown card and ship it two ways: `morning-tablet-brief` append for ~/Tablet/ e-ink review, and `send-formatted-email` only when severity is high. Wire with `cron-capped` at 05:45 America/Detroit so it lands before the 06:00 efforts eval, plus a matching eval-contradiction-ledger-freshness-check following the existing *-freshness-check pattern.

Needs Review
Build timed out after 5 minutes
Active Projects
innovation-engine, joyos-labs-monitor, joyos-lab-staging, jekelinspections, bys-website
Category
insight