Senior Software Engineer II
Core
Technical owner and steward of Nielsen's Databricks Lakehouse for Corporate, driving strategy, architecture, and operational maturity of the Databricks ecosystem while building an AI-driven data platform.
Role type
Senior IC data platform lead (Databricks)
Builds
Production-grade Databricks Lakehouse, AI-native capabilities (feature stores, vector search, GenAI pipelines), and governed data governance models.
Domain
Data Platform Engineering / Cloud Infrastructure / AI Infrastructure
Deliverable
production ML models | infrastructure
Required skills
Databricks ecosystem architecture, Unity Catalog design, Delta Lake & Delta Live Tables, Apache Spark optimization, Python, SQL, Terraform, CI/CD automation, FinOps, RBAC/ABAC security
Preferred skills
Databricks Certified Data Engineer Professional, Databricks Certified Platform Architect
Technologies
Databricks, Unity Catalog, Delta Lake, Delta Live Tables, Apache Spark, Python, SQL, dbt, Terraform, Databricks Asset Bundles
Responsibilities
Define global data governance models and access controls via Unity Catalog; Architect AI-native platform capabilities including feature stores and GenAI pipelines; Enforce data engineering standards for Delta Lake and medallion architecture; Industrialize platform provisioning and pipelines using Infrastructure-as-Code and CI/CD; Optimize cloud spend and manage cost transparency across the Databricks estate; Lead a community of practice for Databricks developers and publish standards.
Seniority
Senior, hands-on IC with mentorship responsibilities