Sr. Data Engineer 4B
Core
Develop and optimize complex data pipelines, integration frameworks, and data quality within a cloud environment.
Role type
Senior Data Engineer
Builds
Data pipelines, integration frameworks, and observability capabilities
Domain
Cloud Data Engineering
Deliverable
production ML models
Required skills
Apache Kafka, Apache Spark, Databricks, Python, Snowflake, Kubernetes, Docker, CI/CD, Data Warehousing, Data ETL, Data Integration, Performance Tuning, System Monitoring
Preferred skills
Azure Solutions Architect Expert, Databricks Certified Data Engineer Professional
Technologies
Azure, Databricks, Snowflake, Kafka, Spark, Kubernetes, Docker, Git
Responsibilities
Develop and optimize complex data pipelines and integration frameworks; Perform data reconciliation, advanced transformation development, and performance tuning; Design and execute unit, integration, and system testing activities; Implement CI/CD processes and engineering automation standards; Build monitoring, observability, and alerting capabilities; Optimize platform usage through cloud cost-aware engineering practices; Troubleshoot complex production and performance issues; Mentor junior engineers and contribute reusable engineering assets.