Data Engineering Specialist III
Core
Design, develop, and maintain data pipelines and large-scale processing systems to ensure accessible, reliable, and efficient data for analysis and reporting.
Role type
Senior IC data engineering specialist
Builds
Automated data pipelines, data warehousing solutions, and reporting systems
Domain
Infrastructure consulting, big data, cloud data platforms
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, Scala, Java, SQL, data pipeline design (batch/streaming), cloud platforms (Azure/AWS/GCP), big data technologies (Spark/Hadoop/Kafka), data warehousing (Snowflake/Redshift/BigQuery/Synapse), orchestration tools (Airflow/Prefect/Dagster)
Preferred skills
real-time streaming architectures, data modeling (Kimball/Data Vault), containerization (Docker/Kubernetes), DevOps (Terraform/ARM/CloudFormation), ML pipelines and feature engineering
Technologies
Apache Spark, Hadoop, Kafka, Snowflake, Redshift, BigQuery, Synapse, Airflow, Prefect, Dagster, Docker, Kubernetes, Terraform, ARM, CloudFormation
Responsibilities
Develop, construct, test, and maintain databases and large-scale processing systems; combine, optimize, and manage multiple big data sources; create automated reporting systems; implement data frameworks and architectures; design and maintain data pipelines for analysis and reporting; escalate unsolvable problems to senior level employees
Seniority
Senior, hands-on IC
