Senior Architect Data Engineering and Lakehouse Platforms - Houston Hybrid
Core
Design, develop, and govern enterprise-scale data platforms using Databricks Lakehouse architecture to serve analytics, reporting, AI/ML, and business applications.
Role type
Senior Architect/Data Engineering Lead (IC + Team Leadership)
Builds
Scalable, secure, and governed data products and platforms
Domain
Enterprise Data Engineering / Cloud Data Platforms
Deliverable
production ML models | product features
Required skills
Databricks, Apache Spark/PySpark, Delta Lake, Unity Catalog, SQL, Python, Cloud Platforms (Azure/AWS/GCP), Data Governance, CI/CD, Infrastructure as Code
Preferred skills
Azure Data Factory, Kafka, Event Hubs, Airflow, Collibra, Purview, Alation, Data Mesh, Terraform, Azure DevOps, GitHub Actions, Power BI
Technologies
Databricks, Spark, Delta Lake, Unity Catalog, Azure, AWS, GCP, Kafka, Airflow, Collibra, Purview, Alation, Terraform, Power BI
Responsibilities
Lead design and implementation of enterprise data platforms; Architect and develop batch, streaming, and real-time data pipelines; Lead and mentor a team of Data Engineers; Establish engineering standards, best practices, and operating models; Drive data governance controls, metadata management, and data lineage; Oversee data integration across ERP, trading, and third-party systems.
Seniority
Senior, hands-on IC with team leadership