Senior Data Engineer - Remote (USA)
Core
Design, develop, and maintain scalable data pipelines and infrastructure for data extraction, transformation, and loading (ETL) to support business requirements.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, data processing workflows, API services, and interactive data visualizations
Domain
Cloud data engineering, ETL, data governance
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
Python, Java, Spark, Hive, AWS, SQL, CI/CD, IaC, unit testing, code reviews
Preferred skills
Databricks, AWS Glue, Athena, QuickSight, Terraform, Github Actions, NoSQL databases, Scala, C++, Airflow, Luigi, Azkaban, Storm
Technologies
Spark, Hive, Airflow, Databricks, AWS (S3, Redshift, RDS, EMR, Glue, Athena, QuickSight), SQL, Cassandra, Postgres, Terraform, Github Actions
Responsibilities
Design and maintain scalable data pipelines; develop and deploy data processing workflows; create API services for data access; build data infrastructure for ETL; monitor and optimize data infrastructure performance; develop data quality and validation jobs; assemble complex data sets; write unit and integration tests; perform code reviews; improve data availability and timeliness; maintain security and privacy for data
Seniority
Senior, hands-on IC
