Senior Data Engineer (ETL)
Core
Design, develop, and maintain ETL/ELT and data integration solutions, migrating legacy systems to modern cloud-based platforms.
Role type
Senior IC data engineer (ETL)
Builds
Unified and reusable datasets, databases, and optimized data pipelines
Domain
Data engineering, cloud data platforms, legacy system modernization
Deliverable
production ML models
Required skills
Python, SQL, relational databases, data validation, data transformation, data migration, database design, version control (Git)
Preferred skills
PySpark, Apache Spark, Databricks, Azure data services, SAS programming, CI/CD pipelines, DevOps practices
Technologies
Python, SQL, Git, PySpark, Apache Spark, Databricks, Azure, SAS
Responsibilities
Migrate legacy data collection and database systems to modern cloud-based platforms; Design and optimize database structures for analytical and operational workloads; Develop and optimize Python-based scripts for data extraction, validation, transformation, and migration; Integrate and consolidate data from multiple sources into unified datasets; Conduct testing and quality assurance activities for data solutions; Support deployment, maintenance, and lifecycle management of data pipelines
Seniority
Senior, hands-on IC