Senior Data Engineer
Core
Design, build, and operationalize complex data solutions and ML/AI applications for customers to support business intelligence and AI/ML workflows.
Role type
Senior IC data engineer (customer-facing)
Builds
Scalable data engineering pipelines, data consumption layers, and ML/AI applications
Domain
Data engineering, Machine Learning, Business Intelligence
Deliverable
production ML models | product features
Required skills
Data engineering, Spark, Hadoop, Kafka, Databricks, SQL, data warehousing, end-to-end data analytics workflow, data governance, data security, data quality, debugging, system analysis
Preferred skills
Databricks platform expertise, ML ops, pandas, scikit-learn, HPO, public cloud platforms (AWS, Azure, GCP), Databricks Certification
Technologies
Spark, Hadoop, Kafka, Databricks, pandas, scikit-learn, HPO, SQL, AWS, Azure, GCP
Responsibilities
Design and build complex data solutions; guide customers on technical decisions; track and report progress across multiple customer accounts; analyze data sources to recommend inclusion in analytical processes; incorporate data governance, security, and quality practices; collaborate with teams to support delivery and educate end users; perform data and system analysis to resolve defects and incidents; test data movement, transformation code, and data components
Seniority
Senior, hands-on IC with intermediate leadership
