Sr. Data Engineer 4B
Core
Develop and optimize complex data pipelines, integration frameworks, and perform advanced data transformation and reconciliation.
Role type
Senior Data Engineer
Builds
Data pipelines, integration frameworks, and data warehousing solutions
Domain
Data Engineering / Cloud Platforms
Deliverable
production ML models
Required skills
Apache Kafka, Apache Spark, Databricks, Python, Snowflake, Kubernetes, Docker, CI/CD, Data Quality, Performance Tuning
Preferred skills
Cloud cost optimization, Process Orchestration, System Performance Monitoring
Technologies
Azure, Databricks, Snowflake, Kafka, Spark, Kubernetes, Docker, Git
Responsibilities
Develop and optimize complex data pipelines and integration frameworks; Perform data reconciliation, advanced transformation development, and performance tuning; Design and execute unit, integration, and system testing activities; Implement CI/CD processes and engineering automation standards; Build monitoring, observability, and alerting capabilities; Troubleshoot complex production and performance issues; Mentor junior engineers and contribute reusable engineering assets.
