‹ The Index

Spark Engineer

skill

Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.

Works with: Claude Code, Cursor, Codex CLI

Category: Dev Tools & CI — see all ranked ›

Security audit

Not scanned yet. We audit npm-published capabilities for known advisories, install-time scripts and permission surface; this one has no npm package we can resolve, or has not reached the queue.

source ↗  ·  skill:Jeffallan/spark-engineer

Already running this? npx tashan-cli doctor checks your whole config against the Index — how it works ›