Sr. Data Engineer
Core
Build, optimize, and maintain robust data pipelines powering real-time analytics, AI/ML initiatives, and enterprise reporting for an automotive SaaS platform.
Role type
Senior IC data engineer (cloud data stack)
Builds
Scalable data ecosystems, real-time streaming pipelines, ML-ready datasets, and feature stores
Domain
Automotive services / Cloud data engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PySpark, SQL, AWS ecosystem, Snowflake or Databricks, Kafka or Kinesis, automated data validation, Medallion Architecture, Dimensional Modeling
Preferred skills
AWS Glue, Step Functions, Debezium, Fivetran, Snowflake Cortex, Databricks AI, AWS Bedrock
Technologies
AWS, Snowflake, Databricks, Kafka, Kinesis, S3, Delta, Iceberg, Parquet, SNS, SQS
Responsibilities
Build and maintain complex data pipelines using AWS Glue, Step Functions, or Databricks Workflows; Develop and deploy real-time ingestion pipelines using AWS Kinesis or Kafka; Own end-to-end data validation and QA by building automated data quality checks; Engineer ML-ready datasets and manage Feature Stores; Mentor junior engineers in coding best practices, SQL optimization, and Python development
Seniority
Senior, hands-on IC
