Senior Data Engineer
Core
Design, build, and maintain scalable cloud-native data platforms and processing pipelines to enable data-driven decision-making.
Role type
Senior hands-on IC data engineer
Builds
Large-scale data lakes, modern data platforms, batch and near real-time processing solutions
Domain
Cloud-native big data engineering on AWS
Deliverable
production ML models
Required skills
Python, PySpark, AWS (EMR, Glue, Lambda, S3, Athena, Redshift, ECS/EKS, Step Functions, EventBridge, IAM, CloudWatch, SNS/SQS), SQL, DynamoDB, OpenSearch/Elasticsearch, ETL/ELT frameworks, data modeling, distributed data processing
Preferred skills
Kafka/Kinesis, Airflow, Docker, Kubernetes, Terraform, Databricks, Delta Lake, Snowflake, CI/CD pipelines
Technologies
AWS, PySpark, Python, Java, DynamoDB, OpenSearch, EMR, Glue, Lambda, S3, Athena, Redshift, ECS, EKS, Step Functions, EventBridge, Kafka, Airflow, Docker, Kubernetes, Terraform, Databricks, Delta Lake, Snowflake
Responsibilities
Design and develop large-scale data pipelines; Build and optimize batch and near real-time data processing solutions; Design scalable data architectures on AWS; Develop ETL/ELT workflows; Design and maintain NoSQL database solutions; Implement search and analytics solutions; Optimize data processing jobs for performance and cost; Monitor and troubleshoot data platform issues; Implement data quality, governance, and security best practices; Mentor junior engineers
Seniority
Senior, hands-on IC
