Big Data Engineer
Core
Design, build, and maintain data pipelines and models serving AI workflows and applications for internal and client-facing use.
Role type
Big Data Engineer
Builds
Data pipelines, dbt models, and infrastructure for AI and data applications
Domain
Data & AI, Fintech, Airlines, FMCG, Retail, Manufacturing, FSI
Deliverable
production ML models | product features | infrastructure
Required skills
SQL, Python, Apache Spark/PySpark, ETL/ELT pipeline development, relational database modeling, data quality implementation
Preferred skills
Python backend API frameworks (FastAPI, Flask, Django), orchestration endpoints, platform integrations
Technologies
dbt, Apache Spark, PySpark, PostgreSQL, Hive, AWS, Microsoft, Salesforce, Databricks
Responsibilities
Design and maintain data pipelines for AI workflows; model and store data across relational, vector, and graph databases; write dbt transformation logic and tests; instrument pipelines with logging and metrics; contribute to CI/CD and infrastructure-as-code; participate in code reviews and design discussions
Seniority
Mid-level (3–8 years experience), hands-on IC
