Eval Harness
| [WHAT] Bias-aware evaluation harness — orchestrate fixture runs across 19 agents + detect 4 bias types (sycophancy, anchoring, verbosity, pattern-bias, position) + cross-LLM judge methodology. [AUDIENCE] Maintainer (offline — sole runner; Evan agent reverted in v3.3); Patrick (retro consumer); Stan (cross-team calibration). [WHEN] Pre-major-release (v3→v4 prompt refactor); Phase 4 Triage (PEV loop, per-bd) ถ้า disputerate 20% per agent (per drift M3); ก่อน promote prompt change to default. [TRIGGER] /shode-house:eval-harness, "eval", "bias detection", "agent regression", "sycophancy test", "no-bias evaluation", "harness".
Works with: Claude Code (native) · Cursor, Codex CLI (manual)
native: this artifact type is that client's own format
Install (Claude Code):
cp -r eval-harness ~/.claude/skills/- tashan score: 45.0
- Adoption: 2 repos
- Upkeep: 80.0
- Freshness: 95.0
- Evidence coverage: 84% of the inputs this score can use — the rest are unknown, and the score is discounted for it
- Health: active
- Contributors: 2
Security audit
Not scanned yet. We audit npm-published capabilities for known advisories, install-time scripts and permission surface; this one has no npm package we can resolve, or has not reached the queue.
Its own instructions
Its SKILL.md says when not to and shows worked examples.
Read from the capability’s own SKILL.md. This is not a grade and does not compare to the instruction-depth verdict on an MCP server — a skill has no tools to document, so that rubric does not apply to it.
You searched for one. Check the rest of your stack:
npx tashan-cli doctorReads the config already on your machine and names what is dead, deprecated or running code at install time. No account, nothing uploaded.
Eval Harness scores 45 today. Pro keeps the series, so you can see whether that is a project getting better or one on its way down — and tells you the day it moves.
- Every score since we started measuring, for any capability
- The named replacement when something you run is dying — not just that it is
tashan doctorover the config you already have, on your machine
Start a 7-day trial › Everything measured on this page stays free.
Show your score
source ↗ · skill:shode666/eval-harness
Everything on this page is public evidence and free. What it cannot know is whether you run this — npx tashan-cli doctor reads your own config and names what is wrong in it, also free. tashan Pro tells you the day any of it changes.
Already running this? npx tashan-cli doctor checks your whole config against the Index — how it works ›
Measured 2026-08-14 · scorer s5 · how · something wrong here?