Data engineer
Core
Design and develop large-scale data pipelines for cutting-edge AI projects, ingesting and analyzing data in collaboration with Data Scientists.
Role type
Data Engineer (via careerplan.io/jobs/15-007-D9-D64-data-engineer-at-abra)
Builds
Large-scale data pipelines across Cloud and On-Premises environments
Domain
AI, Big Data, Cloud Infrastructure
Deliverable
production ML models
Required skills
Python, Apache Spark, Docker, Kubernetes, Airflow, Kubeflow, Parquet, Avro, Delta Lake, Linux, CI/CD tools
Preferred skills
Machine Learning concepts and workflows
Responsibilities
Ingest large volumes of new data, design and develop critical data pipelines, optimize complex high-volume data systems, collaborate with Data Scientists on data analysis
Seniority
Mid-level, hands-on IC
