Senior Data Software Engineer
Core
Design and build scalable, reliable data solutions and pipelines to support critical business decisions.
Role type
Senior Data Software Engineer
Builds
Data pipelines, ingestion processes, and data workflows
Domain
Data Engineering / Big Data
Required skills
PySpark, Spark SQL, Delta Lake, Unity Catalog, Data ingestion (Auto Loader, JDBC/CDC), Data quality assurance, Unit testing (pytest), Git, Lakeflow
Preferred skills
DataStage migration, Dynamics 365/Dataverse extraction, Databricks certification
Technologies
PySpark, Spark SQL, Delta Lake, Unity Catalog, Lakeflow, Auto Loader, pytest, Git, DB2, SQL Server
Responsibilities
Design and maintain scalable data pipelines; Build and manage data ingestion processes; Write clean, efficient, and well-tested code; Monitor pipeline performance and resolve issues; Troubleshoot data quality issues; Document technical processes and workflows.
Seniority
Senior, hands-on IC
