Apache Spark Developer
Core
Design, build, validate, and support data solutions for enterprise operations, analytics, and decision-making, focusing on data integration, modeling, quality, performance, and governance.
Role type
Senior Apache Spark Data Engineer
Builds
Data pipelines, transformations, reports, models, and platform components
Domain
Data Engineering / Big Data Processing
Deliverable
production ML models
Required skills
Apache Spark, PySpark/Scala, Spark SQL, distributed processing, partitioning, tuning, batch/streaming pipelines, SQL, data modeling, ETL/ELT, data validation, data quality, security, access controls
Preferred skills
Cloud services, automation, modern delivery practices, secure development, accessibility, governance, regulatory requirements
Technologies
Apache Spark, PySpark, Scala, Spark SQL
Responsibilities
Develop and maintain data pipelines, transformations, reports, models, or platform components; Translate source-to-target and business requirements into validated technical data solutions; Implement data quality checks, access controls, monitoring, and failure-recovery procedures; Tune SQL, processing jobs, models, dashboards, or platform resources for performance and cost; Document data definitions, lineage, operational procedures, and technical decisions
Seniority
Senior, hands-on IC