Data Engineer
Core
Design, develop, and scale robust data pipelines and transformation processes to support critical business operations and strategic initiatives.
Role type
Senior Data Engineer
Builds
High-performance data pipelines, transformation processes, and scalable data infrastructure
Domain
Data Engineering / Cloud Computing
Deliverable
production ML models
Required skills
Python, SQL, Databricks, PySpark, dbt, Apache Airflow, Dagster, CI/CD, Infrastructure-as-code, Containerization, LLMs, RAG, Vector Databases
Preferred skills
Machine Learning concepts, Feature Engineering, Knowledge Graphs
Technologies
Python, SQL, Databricks, PySpark, dbt, Apache Airflow, Dagster
Responsibilities
Design, build, scale, and maintain robust data engineering solutions; Develop and optimize high-performance data pipelines covering extraction, loading, transformation, and orchestration; Implement modern software engineering practices including CI/CD and infrastructure-as-code; Collaborate with stakeholders to translate requirements into production-ready data services; Establish testing, validation, and monitoring frameworks for data quality; Explore and apply emerging technologies like LLMs and vector databases.
Seniority
Senior, hands-on IC