The Index · Web scraping
Web scraping
'Scraping' / 'extraction' — structured data out of pages. tashan measures 88 capabilities for this work. Ranked on upkeep, freshness and real adoption, every input public. How we measure ›
| # | Capability | tashan | Evidence | Health |
|---|---|---|---|---|
| 1 | 83 | 20k/wk | active | |
| 2 | 68 | 542 ★ | active | |
| 3 | 52 | 35 ★ | active | |
| 4 | 48 | 6 ★ | active | |
| 5 | 65 | 433 ★ | active | |
| 6 | 64 | 50 ★ | active | |
| 7 | 64 | 174 ★ | active | |
| 8 | 59 | 27 ★ | active | |
| 9 | 57 | 62 ★ | active | |
| 10 | 52 | 13 ★ | active | |
| 11 | 48 | 7 ★ | active | |
| 12 | 42 | 15 ★ | active | |
| 13 | 70 | 2k/wk | active | |
| 14 | 50 | 4 marketplaces | — | |
| 15 | 44 | 2 ★ | active | |
| 16 | 39 | 1 marketplaces | active | |
| 17 | 36 | 1 marketplaces | active | |
| 18 | 36 | 1 marketplaces | active | |
| 19 | 70 | 2k ★ | active | |
| 20 | 55 | 14 ★ | active | |
| 21 | 49 | 101 ★ | active | |
| 22 | 46 | 21 ★ | active | |
| 23 | 60 | 255/wk | active | |
| 24 | 59 | 2k/wk | active | |
| 25 | 59 | 347/wk | active | |
| 26 | 58 | 212/wk | active | |
| 27 | 57 | 285/wk | active | |
| 28 | 57 | 234/wk | active | |
| 29 | 54 | 355/wk | active | |
| 30 | 54 | 133/wk | active | |
| 31 | 53 | 189/wk | active | |
| 32 | 50 | 294/wk | active | |
| 33 | 47 | 75/wk | active | |
| 34 | 45 | 61/wk | active | |
| 35 | 44 | 68/wk | active | |
| 36 | 81 | 17k/wk | active | |
| 37 | 65 | 518/wk | active | |
| 38 | 61 | 394/wk | active | |
| 39 | 59 | 436/wk | active | |
| 40 | 59 | 351/wk | active | |
| 41 | 59 | 253/wk | active | |
| 42 | 54 | 164/wk | active | |
| 43 | 54 | 158/wk | active | |
| 44 | 53 | 234/wk | active | |
| 45 | 51 | 219/wk | active | |
| 46 | 51 | 205/wk | active | |
| 47 | 50 | 280/wk | active | |
| 48 | 48 | 5k/wk | abandoned | |
| 49 | 48 | 130/wk | active | |
| 50 | 46 | 114/wk | active | |
| 51 | 43 | 348/wk | active | |
| 52 | 42 | 51/wk | active | |
| 53 | 40 | 71/wk | active | |
| 54 | 39 | 66/wk | active | |
| 55 | 36 | 31/wk | active | |
| 56 | 65 | 407/wk | active | |
| 57 | 64 | 598/wk | active | |
| 58 | 63 | 849/wk | active | |
| 59 | 63 | 651/wk | active | |
| 60 | 62 | 297/wk | active | |
| 61 | 60 | 574/wk | active | |
| 62 | 59 | 594/wk | active | |
| 63 | 58 | 529/wk | active | |
| 64 | 58 | 437/wk | active | |
| 65 | 58 | 381/wk | active | |
| 66 | 57 | 335/wk | active | |
| 67 | 56 | 250/wk | active | |
| 68 | 53 | 188/wk | active | |
| 69 | 52 | 71/wk | active | |
| 70 | 51 | 87/wk | active | |
| 71 | 49 | 138/wk | active | |
| 72 | 49 | 86/wk | active | |
| 73 | 46 | 69/wk | active | |
| 74 | 46 | 52/wk | active | |
| 75 | 44 | 43/wk | active | |
| 76 | 43 | 311/wk | active | |
| 77 | 43 | 75/wk | active | |
| 78 | 41 | 4k/wk | abandoned | |
| 79 | 39 | 155/wk | active | |
| 80 | 38 | 32/wk | active | |
| 81 | 35 | 46/wk | active | |
| · | not scored yet | 73/wk | abandoned | |
| 83 | 53 | 347/wk | active | |
| 84 | 45 | 51/wk | active | |
| 85 | 44 | 52/wk | active | |
| 86 | 43 | 65/wk | active | |
| 87 | 42 | 59/wk | active | |
| 88 | 40 | 35/wk | active |
Who does this work
O*NET has no process step for this yet — its software occupations were surveyed before agentic tooling existed. We list it because the corpus plainly shows people doing it, and we say so rather than forcing it onto an unrelated step.
Recently changed in Web scraping
87 changes recorded here in the last 45 days, newest and most serious first.
- 2026-08-05 One Search — one-search-mcp now reaches browser
- 2026-08-05 Search1api — search1api now reaches credentials
- 2026-08-05 Obscura — obscura-mcp was marked deprecated on npm
- 2026-08-10 Crawlforge — crawlforge-mcp-server now reaches browser, credentials, network
Other work
Occupational data from the O*NET 30.3 Database by the U.S. Department of Labor, Employment and Training Administration, used under CC BY 4.0. tashan consolidated its process steps into the terms practitioners use; O*NET does not endorse this site.
87 changes across Web scraping in the last 45 days. A new advisory, an install script appearing, a maintainer leaving. All listed free above. Pro keeps the series behind each row, so a number today comes with a direction.
- The whole series behind any row, back to the first day we measured it
- The replacement, named — not just the news that something died
tashan doctorover your own config, on your own machine
Start a 7-day trial › Everything measured on this page stays free.