Senior Data Engineer (Python)
Core
Architect and scale data foundations for high-growth client products by building automated ELT/ETL pipelines and ensuring data integrity.
Role type
Senior Data Engineer (Python)
Builds
Scalable, automated ELT/ETL pipelines and data models for client products
Domain
Cloud data engineering and analytics
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python (Pandas, PySpark, Dask), Advanced SQL, dbt, Apache Airflow/Prefect/Dagster, Snowflake/BigQuery/AWS Redshift, Dimensional Modeling, Git, Docker, CI/CD
Preferred skills
Real-time Pipelines (Kafka, Flink), Data Quality frameworks, Vector Databases, Infrastructure as Code (Terraform)
Responsibilities
Build and maintain scalable, automated ELT/ETL pipelines; Implement rigorous automated testing and monitoring; Optimize warehouse storage and compute costs; Partner with Data Scientists and Product Managers to translate business requirements into technical data models; Promote a 'DataOps' culture within the team, conducting code reviews and sharing best practices
Seniority
Senior, hands-on IC