Data/Information Architect
Core
Designing and implementing end-to-end unified data platform architectures on Azure Databricks, covering data ingestion, transformation, operations, and consumption for large enterprise environments.
Role type
Senior Data/Information Architect (Cloud & Big Data)
Builds
Mission-critical cloud-centric data solutions, unified data platforms, and complex batch/streaming data pipelines.
Domain
Cloud Data Engineering, Big Data, Azure Databricks, Data Warehousing
Deliverable
production ML models | product features | infrastructure
Required skills
Azure Databricks, Spark Architecture (Core, SQL, Streaming, MLib), Delta Lake, Unity Catalog, Data Modeling, Cloud Infrastructure (IaaS/PaaS/SaaS), CI/CD, Data Security, Performance Optimization, Batch and Streaming Pipeline Design
Preferred skills
Python, Scala, SQL, REST API, DBT, Docker, Kubernetes, Azure Data Factory, Tableau, Power BI, Machine Learning tools (mlFlow, Azure ML, SageMaker)
Technologies
Azure Databricks, Azure Data Lake, Ansible, Terraform, Kafka, Azure CLI, Databricks CLI, PowerShell, Bash, Spark, Hive, Delta Lake, Unity Catalog, mlFlow, Azure ML, AWS SageMaker
Responsibilities
Design E2E architecture for unified data platforms; mentor architecture talent; deliver architecture roadmaps and delivery blueprints; build and support mission-critical technology components with DR capabilities; optimize cluster performance and reduce costs; coordinate complex system dependencies; set best practices for Databricks CI/CD.
Seniority
Senior, hands-on IC with strategy & mentorship
