Is LLM Eval Harness safe and trustworthy?

tashan scores LLM Eval Harness on public evidence — tashan score 45.0/100, it is currently active. Audit scope: OSV advisories, install-time scripts, build provenance and declared permission surface. We do not review source code or execute the capability.

How do I install LLM Eval Harness?

Configure it from its source repository — it is a remote / registry server.

Who maintains LLM Eval Harness?

11 GitHub contributors, source: daymade/claude-code-skills.

‹ The Index

LLM Eval Harness

plugin

Test/evaluate any LLM behind an OpenAI- or Anthropic-compatible endpoint: availability (maxtokens-aware), request fidelity (does system prompt/tools/history REACH the model, or does the gateway silently drop it), speed (TTFT+tok/s), concurrency (before a workshop), Anthropic protocol compliance, quality regression, vendor bug reports, deployment gates, resident canaries. Reach for this BEFORE hand-rolling a curl loop against any LLM endpoint — that instinct is the trap: it skips the N=10 sampli

Works with: Claude Code (native)
native: this artifact type is that client's own format

Install (Claude Code):

/plugin marketplace add daymade/claude-code-skills
/plugin install llm-eval-harness@daymade-skills

tashan score: 45.0
Adoption: 1 repos
Upkeep: 100.0
Freshness: 100.0
Evidence coverage: 84% of the inputs this score can use — the rest are unknown, and the score is discounted for it
Health: active
Contributors: 11
License: MIT

Security audit

Not scanned yet. We audit npm-published capabilities for known advisories, install-time scripts and permission surface; this one has no npm package we can resolve, or has not reached the queue.

You searched for one. Check the rest of your stack:

npx tashan-cli doctor

Reads the config already on your machine and names what is dead, deprecated or running code at install time. No account, nothing uploaded.

tashan Pro$6/mo

LLM Eval Harness scores 45 today. Pro keeps the series, so you can see whether that is a project getting better or one on its way down.

Every score since we started measuring, for any capability
The named replacement when something you run is dying — not just that it is
tashan doctor over the config you already have, on your machine

Start a 7-day trial › Everything measured on this page stays free.

Show your score

Measured this well? Put the live badge in your README — it updates as the score does.

[![tashan](https://tashan.sh/badge/plugin-daymade-claude-code-skills-llm-eval-harness.svg)](https://tashan.sh/capability/plugin-daymade-claude-code-skills-llm-eval-harness.html)

source ↗ · plugin:daymade/claude-code-skills/llm-eval-harness

Everything on this page is public evidence and free. What it cannot know is whether you run this — check your whole config, free, in the browser. tashan Pro adds the series behind each row and names a replacement for anything dying.

Already running this? Check your whole config — free, in your browser, nothing installed. Or npx tashan-cli doctor locally, which sends nothing at all.

Measured 2026-08-23 · scorer s5 · how · something wrong here?