Data Engineer
Core
Design and build scalable data pipelines, warehouses, and lakes on AWS to ingest, process, and deliver data for clients across multiple sectors.
Role type
Senior Data Engineer (Cloud/Big Data)
Builds
Production data pipelines, data warehouses, and data lakes on AWS
Domain
Cloud Data Engineering / Big Data
Deliverable
production ML models | product features | dashboards & analysis
Required skills
AWS cloud technologies, ETL pipeline design, data warehouse design, data lake design, Java, Python, Scala, Spark, SQL, API integration, data ingestion, data curation
Preferred skills
Experience with AWS native services (EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB)
Technologies
AWS, EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB, Java, Python, Scala, Spark, SQL
Responsibilities
Design and deploy production data pipelines from ingestion to consumption within big data architecture; Write scripts to extract data using APIs; Write SQL queries; Process large amounts of structured and unstructured data; Integrate data from multiple sources on AWS cloud
Seniority
Mid-to-Senior, hands-on IC
