Lead Engineer, Data Platforms
Core
Lead Engineer responsible for modernizing, integrating, and optimizing foundational data ecosystems to power analytics, machine learning, and AI-driven workflows.
Role type
Senior IC Data Platform Engineer
Builds
Scalable and resilient data cloud platforms, production-grade data solutions, and automated CI/CD pipelines.
Domain
Retail / Coffee / Data Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Snowflake administration, Airflow, AWS services (IAM, VPC, Glue, S3, Lambda), Gitlab CI/CD, DataDog, Kafka, Workato, ADF, Matillion, DBT, Infrastructure as Code, Data Modeling, ETL/ELT, Big Data pipelines
Preferred skills
RAG architecture design, vector databases, LLM integration, Data Governance, Data Quality, Metadata management, Data Security, Data Archive
Technologies
Snowflake, Databricks, Kafka, Fivetran, Matillion, PySpark, AWS, Gitlab, DataDog
Responsibilities
Design and deploy production-grade data solutions on Snowflake or Databricks; Design and enhance ETL/ELT pipelines for real-time data processing; Implement dimensional data models and data products; Develop data engineering frameworks supporting machine learning workflows.
Seniority
Senior, hands-on IC
