Manager, Cloud Data Engineer
Core
Lead the design and delivery of scalable technical solutions for client engagements in data engineering and distributed data platforms.
Role type
Senior IC manager / Lead Data Engineer
Builds
Integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure
Domain
Enterprise data engineering, cloud platforms (Azure, AWS, GCP), AI/ML
Deliverable
production ML models
Required skills
Architecting enterprise-scale Big Data platforms, Databricks Lakehouse expertise (Delta Lake, Delta Live Tables, Unity Catalog, PySpark), Cloud data engineering (AWS Glue, EMR, EKS, S3, Lambda), Leading distributed cross-functional teams, Data governance and quality controls
Preferred skills
MLflow, Batch and streaming data pipelines, Data governance, Platform security controls, Client presentations and proposals
Technologies
Databricks, Delta Lake, Delta Live Tables, Unity Catalog, PySpark, Spark SQL, AWS Glue, EMR, EKS, S3, Lambda, RDS, OpenSearch, CloudWatch, Azure, GCP
Responsibilities
Lead small engagements or key workstreams within larger technology transformation programs, Manage cross-functional distributed delivery teams and client relationships, Oversee quality of team deliverables and recommendations, Contribute to proposal and business development efforts
Seniority
Senior, hands-on IC with management responsibilities