Data Engineer - Manager/Specialist
Core
Lead a team to design, implement, and maintain scalable data pipelines, ETL/ELT processes, and data storage solutions while creating technology products for optimal customer experience.
Role type
Manager/Specialist Data Engineer
Builds
Scalable, reliable, high-performance data pipelines and data platforms
Domain
Data Engineering / Big Data / Cloud
Deliverable
production ML models | infrastructure
Required skills
ETL/ELT design and implementation, Big data ecosystems (Spark, Hadoop, Kafka, Flink), Cloud platforms (Azure, AWS, GCP), Python, Java, SQL, Data modeling and schema design, Workflow orchestration (Airflow, Data Factory), DevOps practices (IaC, containers), Version control (Git), CI/CD
Preferred skills
AI and agentic platforms, Cloud providers' managed AI services, Agile development methodologies
Technologies
Spark, Hadoop, Kafka, Flink, Azure, AWS, GCP, Databricks, Snowflake, BigQuery, Synapse, Airflow, Data Factory, Azure AI Foundry, AWS Bedrock, Vertex AI, Git
Responsibilities
Design and implement data pipelines and ETL/ELT processes, Build scalable data storage solutions, Collaborate with data scientists and architects on data flows, Automate provisioning and environment management, Create and support data APIs and services, Ensure data quality, scalability, and governance
Seniority
Manager/Specialist, hands-on IC with team leadership
