Senior Data Engineer
Core
Design, develop, and maintain data pipelines and systems to enable data analysis and machine learning for clients.
Role type
Senior Data Engineer
Builds
Data pipelines, data models, schemas, and storage solutions
Domain
Data Engineering, Cloud Computing, Big Data
Deliverable
production ML models | infrastructure
Required skills
Python, SQL, relational databases, cloud infrastructure (Azure/AWS), ETL pipelines, big data technologies (Spark/Hadoop/Kafka), data modeling, data quality management, SLA definition
Preferred skills
NoSQL, Airflow/Argo/Luigi, Docker, Flask/Tornado/Django, Tableau/PowerBI/Qlik, GDPR compliance, Agile methodology
Technologies
Python, SQL, Azure, AWS, GCP, PostgreSQL, MS SQL, Luigi, Airflow, Argo, Apache Spark, Hadoop, Kafka, Docker, Flask, Tornado, Django, Tableau, PowerBI, Qlik
Responsibilities
Develop Data Engineering solutions for clients; Design and build data models and schemas; Develop and maintain data ingestion and processing systems; Implement data storage solutions; Collaborate with cross-functional teams to address data issues; Ensure data quality across projects; Define and manage SLAs for data sets and processes; Lead the design, build, and launch of new data models and pipelines
Seniority
Senior, hands-on IC with leadership experience
