The Index · Model evaluation
Model evaluation
'Evals' — scoring model output and catching regressions. tashan measures 28 capabilities for this work. Ranked on upkeep, freshness and real adoption, every input public. How we measure ›
| # | Capability | tashan | Evidence | Health |
|---|---|---|---|---|
| 1 | 77 | 17k ★ | active | |
| 2 | 62 | 23 ★ | active | |
| 3 | 62 | 124 ★ | active | |
| 4 | 61 | 37 ★ | active | |
| 5 | 61 | 61 ★ | active | |
| 6 | 57 | 74 ★ | active | |
| 7 | 45 | 8 ★ | active | |
| 8 | 42 | 9 ★ | active | |
| 9 | 40 | 12 ★ | active | |
| 10 | 77 | 11k ★ | active | |
| 11 | 76 | 24k ★ | active | |
| 12 | 48 | 5 ★ | active | |
| 13 | 39 | 1 ★ | active | |
| 14 | 39 | 3k/wk | abandoned | |
| 15 | 38 | 1 ★ | active | |
| 16 | 34 | 1 ★ | active | |
| · | not scored yet | 11 repos | active | |
| · | not scored yet | 7 repos | active | |
| 19 | 70 | 218 ★ | active | |
| 20 | 53 | 16 ★ | active | |
| 21 | 54 | 158/wk | active | |
| 22 | 62 | 216/wk | active | |
| 23 | 53 | 224/wk | active | |
| 24 | 52 | 300/wk | active | |
| 25 | 48 | 59/wk | active | |
| 26 | 40 | 0 ★ | active | |
| 27 | 31 | 1 ★ | active | |
| 28 | 51 | 326/wk | active |
Who does this work
O*NET has no process step for this yet — its software occupations were surveyed before agentic tooling existed. We list it because the corpus plainly shows people doing it, and we say so rather than forcing it onto an unrelated step.
Recently changed in Model evaluation
14 changes recorded here in the last 45 days, newest and most serious first.
- 2026-08-12 Trustmodel — @trustmodel/mcp-server now reaches network
- 2026-08-12 Trustmodel — @trustmodel/mcp-server now runs a script when it installs
- 2026-08-16 Langsmith — langsmith-mcp-server now reads as abandoned, was active
- 2026-08-05 Setup — the tashan score for setup rose to 59.0, from 45.0
Other work
Occupational data from the O*NET 30.3 Database by the U.S. Department of Labor, Employment and Training Administration, used under CC BY 4.0. tashan consolidated its process steps into the terms practitioners use; O*NET does not endorse this site.
14 changes across Model evaluation in the last 45 days. A new advisory, an install script appearing, a maintainer leaving. All listed free above. Pro keeps the series behind each row, so a number today comes with a direction.
- The whole series behind any row, back to the first day we measured it
- The replacement, named — not just the news that something died
tashan doctorover your own config, on your own machine
Start a 7-day trial › Everything measured on this page stays free.