Expert Data Engineer
Core
Design, build, maintain, and optimize core enterprise data platform capabilities for scalable data ingestion, processing, storage, and access to support BI, advanced analytics, AI/ML, and enterprise data products.
Role type
Senior IC data platform engineer
Builds
Reusable data pipelines, engineering frameworks, platform services, templates, automation scripts, and standard patterns
Domain
Cloud data platforms (Azure, Databricks, Snowflake) and enterprise data infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Distributed data systems design, SQL, Python/Scala/Java, data lakehouse architecture, batch/streaming processing, CI/CD, Infrastructure-as-Code, data governance, performance optimization
Preferred skills
Snowflake optimization, medallion/lakehouse architectures, orchestration tools (Airflow, dbt, Azure Data Factory), Terraform, MLOps enablement, data observability
Technologies
Azure Datalake, Databricks, Snowflake, Azure Synapse, Spark, SQL, Python, Scala, Java, Airflow, dbt, Azure Data Factory, Terraform, Git
Responsibilities
Architect high-throughput batch, streaming, and near-real-time data processing capabilities; optimize platform components for performance, reliability, and cost efficiency; embed governance, security, and compliance into platform patterns; build and maintain CI/CD, IaC, and automated testing practices; troubleshoot complex pipeline and platform issues; create documentation and enablement materials
Seniority
Senior, hands-on IC
