Data Engineer
Core
Design, build, and maintain scalable, secure, high-performance data platforms and integration solutions using native AWS services to power analytics, reporting, and AI/ML initiatives.
Role type
Senior IC AWS Data Engineer
Builds
Modern data pipelines, cloud-based data lakes, and enterprise-scale data processing solutions
Domain
Cloud data engineering (AWS)
Deliverable
production ML models | product features
Required skills
AWS native services (S3, Glue, Lambda, Redshift, Athena, Lake Formation), Python, SQL, Apache Spark (PySpark), ETL/ELT development, data modeling, data quality, data governance, Git, CI/CD, Infrastructure as Code
Preferred skills
Real-time data processing, event-driven architectures, AI/ML data engineering workloads
Technologies
AWS, Python, SQL, Apache Spark, Git
Responsibilities
Design and develop scalable data pipelines; Build and optimise cloud-based data lakes and data processing solutions; Develop ETL/ELT processes to ingest, transform, and curate data; Implement data quality, monitoring, and error-handling processes; Optimise data solutions for performance, scalability, security, and cost efficiency; Collaborate with architects, analysts, and business stakeholders to deliver data solutions aligned with business requirements
Seniority
Senior, hands-on IC