Harness Insights · Codex HTML

harness-expert

The project already provides clear architecture routing, project-level agent instructions, a broad validation command surface, and multi-host installation guidance. The main current risks are that two reusable workflows do not cover their declared host or failure boundaries, and plugin installation lacks a project-owned recovery path. Recent behavior evidence covers only one short session with no edits or delivery, while the independent Session Evidence lane contains no eligible Task Episode; this report therefore makes no claims about repeated work, actual Skill use, or longitudinal effectiveness.

agent-work-loop-v4Evidence-bound
5reviewed dimensions
Codex Evidence Score (Loop Effectiveness) 58 / 100 Changes after later task outcomes
Asset Health / Repair Progress 0 / 100 0 verified · 0 partial · 3 pending
Sessions analyzed 1 / 1
Findings 3 0 High · 2 Medium
01 · Readiness

Five-dimension fluency

Scores and states come from the reviewed source.

Task UnderstandingReviewed
78/ 100

The root rules, architecture documentation, and current installation spec provide clear scope, ownership, and acceptance entry points; adoption and correction outcomes in a real Task Episode were not observed.

Controlled ExecutionReviewed
56/ 100

The project has discoverable commands and Skill routes, but Codex Skill forward validation and the terminal state for an unavailable reviewer still lack supported execution paths.

Change ValidationReviewed
72/ 100

A broad set of focused tests and machine validators covers the main artifact boundaries; this run did not execute tests, preview, CI, or host-runtime validation against the current worktree.

Reliable DeliveryReviewed
48/ 100

Installation and discovery boundaries are documented, but current delivery acceptance evidence is absent and persistent marketplace/plugin state lacks a project-owned recovery path.

Learning CaptureReviewed
35/ 100

The current window is insufficient to identify two comparable Task Episodes or validate a longitudinal improvement; asset presence and counts are not treated as evidence of use or effectiveness.

02 · Signals

Project usage

Volume is context, not an outcome claim.

2026-07-272026-07-27
Sessions reviewed 1 / 1 all-eligible usage census
Long-session leads 0 longest 0 min

Model usage

No attributed rows were retained.

Skill usage

No attributed rows were retained.

03 · Action

Findings and recommendations

3 findings · 0 suggestions

01 Codex Skills can be delivered without a Codex forward testControlled Execution Medium
Why it matters

The Skill creator explicitly targets Qoder and Codex, but every provided forward-test and plugin-validation command invokes qodercli. A Codex-targeted Skill that passes the current flow proves only the Qoder path, so users may encounter compatibility failures only during Codex discovery, triggering, or execution. The smallest owner is the validation section in .agents/skills/harness-skill-creator; no host test was run in this review, so this finding does not claim that current Codex behavior already fails.

Expected output
  • A Codex-targeted Skill is described as usable only after Codex itself passes discovery, triggering, and output-contract validation.
AI fix

Add a Codex forward-validation path to harness-skill-creator that matches its stated Codex scope. First inspect local Codex help for the supported non-interactive entry point; do not hard-code unverified flags. Keep the existing quick_validate.py and qodercli gates, and record discovery, triggering, the output contract, and failure boundaries separately for Qoder and Codex.

Acceptance checks
  • Run quick_validate.py for the target Skill
  • Run the existing qodercli forward test and plugin validation
  • Run the Codex forward test with the same fixture and output assertions
  • Confirm that an unavailable host produces an explicit unavailable or blocked result, not success
02 One unavailable reviewer leaves Spec Review without a completable stateControlled Execution Medium
Why it matters

triangulate-spec-review requires every required reviewer to return p1_p2_clear before it stops. The script treats a missing command, timeout, or unparseable output as a non-pass and exits with code 2, but the Skill and review-loop define only an all-clear result or a manual user stop; they provide no acceptance or handoff state for unavailable or blocked reviewers. External reviewer failure and real P1/P2 findings are therefore collapsed into the same result, leaving the agent unable to decide whether to amend the spec, retry the tool, or escalate the blocker.

Expected output
  • When a reviewer fails, Spec Review returns a bounded, handoff-ready blocked result instead of presenting a tool failure as an unresolved design finding.
AI fix

Add consistent reviewer unavailable and blocked states across the triangulate-spec-review Skill, the review-loop contract, and run-triad-review output. Distinguish real P1/P2 findings from a missing reviewer command, timeout, and unparseable output. Define bounded stop, retry, and user-handoff behavior for each state without weakening the normal requirement for at least two independent reviewers.

Acceptance checks
  • Run the script with one missing reviewer command and confirm the output distinguishes unavailable from P1/P2
  • Use a timeout fixture to confirm bounded retries and a final blocked state
  • Use two successful reviewers to confirm the existing p1_p2_clear acceptance path still passes
  • Verify consistent argv and exit-code behavior on Windows, macOS, and Linux
03 Failed plugin installation has no project-owned recovery stepsReliable Delivery Low
Why it matters

The current installation guide covers marketplace add, plugin install, task refresh, and discovery, but it does not explain how to identify and clean up persistent host state introduced by this project after a failed installation, mirror switch, or version conflict, nor does it define a recovery postcondition. The hosts may provide uninstall capabilities, but the project owners opened in this review expose no discoverable route; after installation failure, users must leave the project documentation to determine what state remains.

Expected output
  • After a failed installation or source switch, users can identify residual state from the project documentation and safely restore the host inventory to its pre-installation state.
AI fix

Add the smallest recovery boundary beside each host installation path in the README. First inspect current host help for supported list, remove, or uninstall operations; do not invent commands. Explain how to identify marketplace/plugin state created by this project after a failed installation, mirror switch, or version conflict, when user confirmation is required, and how to verify the recovered inventory. Any real uninstall requires separate user authorization.

Acceptance checks
  • Confirm the current CLI or UI recovery entry point for every documented host
  • Rehearse one failed installation or version conflict in an isolated configuration directory without changing the user's real configuration
  • Confirm that the recovered inventory contains no state left by this project's installation
  • Run the Markdown link check and the relevant host-plugin documentation tests
04 · Capability

Agent Customize

Inspected project and authorized host surfaces.

R

Rules

Project · 1

S

Skills

Project · 4

W

Workflows

Project · 2

C

Custom Agents

Project · 0

05 · Boundary

Evidence and methodology

Reader-safe evidence only.

Evidence modesession-rich
Task episodes0
Edited episodes0
Sampling1 / 1
ConfidenceHigh
Learning stateN/A

Activity totals describe volume, not quality or savings. Fluency conclusions come from the reviewed task sample and remain bounded by the retained evidence.