# LLM Eval Harness

> Test/evaluate any LLM behind an OpenAI- or Anthropic-compatible endpoint: availability (maxtokens-aware), request fidelity (does system prompt/tools/history REACH the model, or does the gateway silently drop it), speed (TTFT+tok/s), concurrency (before a workshop), Anthropic protocol compliance, quality regression, vendor bug reports, deployment gates, resident canaries. Reach for this BEFORE hand-rolling a curl loop against any LLM endpoint — that instinct is the trap: it skips the N=10 sampli

## Facts
- Page: https://tashan.sh/capability/plugin-daymade-claude-code-skills-llm-eval-harness
- tashan id: plugin:daymade/claude-code-skills/llm-eval-harness
- Source: https://github.com/daymade/claude-code-skills
- Type: plugin
- Category: other
- tashan score: 45.0 / 100
- Adoption: 7.0
- Upkeep: 100.0
- Freshness: 100.0
- Evidence coverage: 84% of the inputs this score can use
- Health: active
- Instruction depth: not yet graded
- License: MIT
- Official: no

## Install

```sh
/plugin marketplace add daymade/claude-code-skills
/plugin install llm-eval-harness@daymade-skills
```

## Security audit
Not scanned. We audit npm-published capabilities; this one has no npm package we can resolve, or has not reached the queue. This is not a clean bill of health.

---
Measured 2026-08-23 by tashan (https://tashan.sh) from public evidence. Scorer s5.