Senior Data Platform and Automation Engineer
Core
Design and build secure, scalable data platforms and governance automation for complex enterprise environments, enabling AI-enabled applications.
Role type
Senior IC data platform and automation engineer (via careerplan.io/jobs/a12900c4-dfd3-4178-85e8-8285192273e0-senior-data-platform-and-automation-engineer-at-jobgether)
Builds
Reusable platform capabilities for data governance, metadata, lineage, data quality, access controls, and production operations
Domain
Enterprise data engineering and cloud platform
Required skills
Python, SQL, distributed processing, data modeling, cloud data platforms, data governance, Databricks, Unity Catalog, Apache Spark, CI/CD pipelines, API development, enterprise security (RBAC, identity management), observability, GitLab CI/CD, policy-as-code, infrastructure-as-code
Preferred skills
Data marketplaces, internal developer platforms, privacy/security/regulatory/AI governance controls
Technologies
Databricks, Unity Catalog, Apache Spark, GitLab CI/CD
Responsibilities
Architect and develop secure, scalable data platform and governance automation capabilities; Build automated controls covering metadata, data ownership, lineage, data quality, access management, and policy enforcement; Implement enterprise security capabilities including identity management, authorization, role-based access control, least-privilege principles, auditability, service accounts, and credential management; Develop secure APIs, MCP tools, and integrations supporting enterprise and AI-enabled applications; Design and maintain automated validation, testing, deployment, and monitoring processes across development and production environments; Establish strong observability for platform health, data quality, governance policies, system failures, and operational performance; Mentor other engineers and provide technical guidance to help strengthen engineering practices and delivery quality; Support production environments and troubleshoot issues across architecture, development, deployment, and ongoing operations
Seniority
Senior, hands-on IC