Data Engineer
Core
Design, develop, and maintain scalable data pipelines and platform solutions across AWS cloud and hybrid/on-premises environments.
Role type
Senior IC data engineer (AWS, data lakes, AI platforms)
Builds
Data lakes, lakehouse architectures, metadata management, search platforms, and AI-enabled services
Domain
Cloud infrastructure, data engineering, AI/ML platforms
Deliverable
production ML models
Required skills
Python, SQL, PySpark, AWS services, Linux/Unix administration, shell scripting, CI/CD, Infrastructure as Code, distributed data processing
Preferred skills
Data lake/lakehouse platform experience, streaming pipelines, OpenSearch administration, monitoring and observability tools, data governance and security
Technologies
AWS Glue, EMR, S3, Redshift, Lambda, Amazon Bedrock, Apache Airflow, dbt, Kafka/MSK, Apache Iceberg, Hive, Trino, Presto, OpenSearch, AgentCore, MCP, CloudWatch, Datadog, Grafana, Prometheus
