spark-optimization

Features and purpose

Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.

Quick start

Follow the repository instructions for this skill and your agent. Review the files and dependencies before adding it to your workflow.