Senior Ops Data Engineer
Core
Design, build, and maintain scalable cloud-based data pipelines and AI agents to integrate, process, and analyze large datasets for business intelligence and data-driven decision-making.
Role type
Senior IC data engineer (AI agents & pipelines)
Builds
Production data pipelines, AI agents, and data models
Domain
Internet analytics / Big Data
Deliverable
production ML models | product features
Required skills
Python, SQL, ETL development, data modeling, AWS services (S3, Redshift, Glue, Lambda), Airflow, Databricks, Spark, DBT, Docker, Terraform, Kubernetes
Preferred skills
LangGraph, LangChain, LLMs, prompt engineering, JavaScript, React, Node.js
Technologies
AWS, Airflow, Databricks, Spark, DBT, LangGraph, LangChain, Docker, Terraform, Kubernetes
Responsibilities
Develop and maintain ETL processes integrating data from APIs, databases, and external platforms; Design and maintain logical and physical data models; Optimize runtime performance for large-scale data workloads; Monitor pipelines and resolve issues to ensure data integrity; Collaborate with BI analysts and stakeholders to define data requirements.
Seniority
Senior, hands-on IC
