Senior Data Engineer
Core
Build scalable data architecture and ETL pipelines on Databricks to support Adobe's Pro Design products, enabling AI/ML features, analytics, and conversational insights.
Role type
Senior IC data engineer (AI/ML infrastructure)
Builds
Production data pipelines, telemetry systems, and AI-driven reporting stacks for creative design tools
Domain
Creative software industry + Data engineering & AI/ML
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, PySpark, Airflow, Databricks workflows, high-volume event/telemetry data processing, AI tool integration, multi-agent AI systems, AI/ML data pipelines (feature stores, embeddings, retrieval), BI/reporting tools
Preferred skills
Unity Catalog, Azure cloud platforms, Retrieval Augmented Generation (RAG), data privacy and compliance (GDPR, CCPA)
Technologies
Databricks, Unity Catalog, Azure, PySpark, Airflow
Responsibilities
Build and optimize data architecture and ETL pipelines; Partner with Product, Engineering, and Data Science to implement data logging and instrumentation; Set and evolve governance standards for data quality, privacy, security, and lineage; Build automated reporting and data foundations for AI-driven insights; Maintain production pipelines for performance, cost, and latency optimization
Seniority
Senior, hands-on IC