Sr. Data Engineer
Core
Design, develop, and optimize enterprise-scale data pipelines and platforms to enable data insights for executives, analysts, and end users.
Role type
Senior Data Engineer
Builds
Next-generation AI-ready data platform, automated data processing systems, and workflow orchestration pipelines.
Domain
Automotive auction industry + Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, Java, Scala, Apache Airflow, DBT, Kafka, AWS, Google Cloud Platform, Azure, BigQuery, Redshift, Snowflake, Tableau, Looker, Power BI
Preferred skills
Real-time data pipeline architecture, MPP database architecture, ETL/ELT tooling, workflow orchestration platforms (Prefect, Dagster, Cloud Composer)
Technologies
Python, SQL, Java, Scala, Apache Airflow, DBT, Kafka, AWS, Google Cloud Platform, Azure, BigQuery, Redshift, Snowflake, Tableau, Pentaho, Looker, Power BI, Thoughtspot
Responsibilities
Design and build next-generation AI-ready data platform; Develop and automate data processing systems leveraging DBT; Design and implement workflow orchestration using Airflow/Cloud Composer; Develop logging, metrics, and alerts for active monitoring; Collaborate with Product Managers and Application teams to create data models and schemas; Maintain data integrity in production systems.
Seniority
Senior, hands-on IC
