Data Engineer
Core
Building and maintaining scalable, resilient data infrastructure and ETL/ELT pipelines to establish a ground truth data source for analytics and science teams.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, data warehouses, and monitoring systems
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, Cloud Platforms (AWS/GCP/Azure), Big Data Technologies (Spark, Hadoop, Kafka), Data Warehousing (Snowflake, Redshift, BigQuery)
Preferred skills
Data orchestration (Airflow, Prefect), Containerization (Docker, Kubernetes), Data modeling principles
Technologies
Python, Java, Scala, SQL, AWS, GCP, Azure, Apache Spark, Hadoop, Kafka, Snowflake, Redshift, BigQuery, Airflow, Prefect, Docker, Kubernetes
Responsibilities
Audit existing data infrastructure for efficiency and scalability; Design and build robust ETL/ELT processes; Establish and maintain a centralized source of truth with data quality checks; Implement monitoring and alerting systems; Collaborate with data scientists and analysts to support data requirements.
Seniority
Mid-Senior, hands-on IC
