Data Engineer
Core
Building, optimizing, and maintaining scalable data pipelines and infrastructure to support data processing, storage, and access for analytics and machine learning applications.
Role type
Data Engineer
Builds
ETL pipelines, data warehouses, data lakes, and storage solutions
Domain
Cloud data infrastructure and analytics
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Java (Spring Boot), ETL processes, Databricks, Spark, AWS, data architecture design, production monitoring
Preferred skills
Scala, NoSQL databases, object storage, relational databases
Technologies
Python, Java, Spring Boot, Databricks, Spark, AWS, Amazon Redshift, AWS S3
Responsibilities
Design and build ETL pipelines to ingest, transform, and load data; Design and manage storage solutions including data warehouses and lakes; Ensure production reliability through monitoring and alerting; Collaborate with data scientists and product teams to define data structures and requirements; Experiment with emerging data technologies to enhance infrastructure efficiency
Seniority
Mid-level, hands-on IC
