Lead Software Engineer - Big Data
Core
Lead technical development and optimization for the Airbus Skywise Big Data ecosystem (Apache Spark-based) serving European customers.
Role type
Senior IC Lead Software Engineer (Big Data)
Builds
Scalable, reliable end-to-end data processing solutions and performance optimization for the Skywise platform.
Domain
Aerospace / Big Data Engineering
Deliverable
production ML models | product features
Required skills
Apache Spark, PySpark, Python, JavaScript/TypeScript, Java, Scala, SQL, Git, CI/CD
Preferred skills
Polars, DuckDB, SAP/ERP platforms, Pandas
Technologies
Apache Spark, PySpark, Spark SQL, Polars, DuckDB, Workshop, Slate, Object Explorer, Foundry Ontology
Responsibilities
Define and enforce technical standards and best practices; lead E2E performance optimization and root cause analysis; mentor team members; design server-side processing architectures; engage with European customers to gather requirements and present technical deliveries.
Seniority
Senior, hands-on IC with leadership responsibilities
