Software Engineer III - Data Engineer
Core
Design, develop, and support scalable Databricks feature engineering solutions for risk analytics, fraud detection, machine learning, and enterprise data products.
Role type
Senior IC Data Engineer (Feature Engineering & Platform Modernization)
Builds
Reusable batch and real-time feature pipelines, cloud-native AWS solutions, and modernized Databricks-native architectures.
Domain
Financial Services / Data Engineering / Machine Learning Infrastructure
Deliverable
production ML models
Required skills
Databricks, Apache Spark, PySpark, Delta Lake, Python, SQL, AWS (S3, Glue, Lambda, ECS/EKS), Terraform, CI/CD, Data Governance, Data Quality, PCI compliance
Preferred skills
Databricks Feature Engineering, Feature Store, Kafka, Infrastructure-as-Code, Snowflake, Declarative pipeline frameworks
Technologies
Databricks, Apache Spark, PySpark, Delta Lake, Lakeflow, AWS, Terraform, Kafka, Snowflake
Responsibilities
Design and maintain feature pipelines; migrate legacy workloads to cloud-native architectures; implement data quality and security controls; participate in architecture reviews; mentor junior engineers.
Seniority
Senior, hands-on IC