Data Engineer Pleno
Core
Design and build scalable data ingestion, storage, and processing architectures for batch and streaming pipelines to support analytics and machine learning.
Role type
Senior Data Engineer (Data Platform)
Builds
Production-grade data analytics platforms, data warehouses, and ML feature stores
Domain
Transportation industry IoT, cloud data infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, AWS services (EC2, Lambda, S3, RDS, EKS, IoT), streaming technologies (Kinesis, Kafka), dimensional data modeling, ETL/ELT pipeline design, CI/CD, Infrastructure as Code (Terraform), containerization (Docker/Kubernetes)
Preferred skills
dbt, Snowflake, Airflow, Feature Store architectures (Feast, Tecton), serverless data pipelines, database migration (AWS DMS)
Technologies
Python, SQL, AWS, Snowflake, dbt, Kafka, Kinesis, Docker, Kubernetes, Terraform, Jenkins, GitLab, Airflow, Feast, Tecton
Responsibilities
Define technical direction and standards for data ingestion and storage; design scalable data architectures for batch and streaming; build and productionize ML pipelines and feature stores; manage data warehouse cost optimization and modeling; establish data quality standards; mentor team members on system design and best practices
Seniority
Senior, hands-on IC with mentorship responsibilities