Data Engineer
Core
Build and maintain scalable batch and streaming data pipelines, data warehousing, and integration for analytics and AI use cases.
Role type
Senior Data Engineer (Cloud & AI)
Builds
Scalable ETL/ELT pipelines, lakehouse architectures, and data solutions for clients
Domain
Cloud Data Engineering, AI/ML Data Infrastructure
Deliverable
production ML models
Required skills
Python, SQL, PySpark, Apache Spark, Databricks, Delta Lake, Airflow, dbt, AWS/Azure/GCP, CI/CD, Terraform
Preferred skills
Vector databases, GenAI data pipelines, Apache Kafka, MLflow, NoSQL databases, Power BI/Tableau
Technologies
Databricks, Delta Lake, Apache Iceberg, Airflow, dbt, AWS, Azure, GCP, Snowflake, BigQuery, Redshift, Kafka, MLflow, Unity Catalog
Responsibilities
Build and maintain scalable batch and streaming pipelines; Ingest data from OLTP databases, files, SaaS apps, and APIs; Prepare data for ML and GenAI use cases; Translate client data requirements into tailored solutions; Ensure data quality, security, and governance; Optimize cloud storage and compute for performance and cost; Monitor, troubleshoot, and improve pipeline reliability.
Seniority
Mid-Senior, hands-on IC