Senior Data Engineer
Core
Designing and managing high-scale data lakes, warehouses, and streaming pipelines for clients using Medallion Architecture.
Role type
Senior Data Engineer (Big Data & Streaming)
Builds
Data pipelines, data models, and scalable big data architectures
Domain
Big Data, Streaming Data, Complex Event Processing (CEP)
Deliverable
production ML models
Required skills
Python, Java/Scala, DBT, SQL, Data Modeling, NoSQL, Cloud Platforms (AWS/GCP), Streaming (Spark/Flink/Kafka)
Preferred skills
AI-assisted development, Autonomous AI agents (Cursor/Copilot/Devin)
Technologies
DBT, Parquet, Avro, ORC, Kafka, RabbitMQ, Spark Streaming, Flink, Kafka Streams, Beam, Elastic, Redis, MongoDB, CouchBase, BigQuery, Snowflake, Databricks
Responsibilities
Develop data pipelines to ingest and transform data; Manage and enhance orchestrated pipelines; Develop data models for efficient storage and retrieval; Ensure big data architecture scalability; Implement data security measures; Establish data governance policies
Seniority
Senior, hands-on IC
