Data Engineer
Core
Designing and developing a data platform to fulfill business needs, including building new data pipelines, maintaining platforms for batch-loading and real-time visualizations, and ensuring data quality.
Role type
Senior Data Engineer (Cloud & Data Warehousing)
Builds
Data pipelines, data platforms, real-time visualizations, and data warehouse solutions
Domain
Cloud data infrastructure and data warehousing
Deliverable
production ML models | product features | dashboards & analysis
Required skills
AWS services (S3, Lambda, Glue, DMS, RDS), Snowflake or Redshift, SQL query optimization, data pipeline orchestration (Airflow), data modeling (Inmon, Kimball, Data Vault), object-oriented programming
Preferred skills
Kafka, Git, Terraform, data monitoring/visualization tools, PowerShell, Unix scripting
Technologies
AWS, Snowflake, Redshift, Airflow, Kafka, Terraform, Git, PowerShell, Unix
Responsibilities
Design and develop data pipelines; maintain platforms for batch-loading and real-time visualizations; ensure data quality and consistency; mentor engineers on data modeling standards; troubleshoot incidents; document processes and share knowledge
Seniority
Senior, hands-on IC
