Senior Data Engineer with Python @ Link Group
Core
Design, build, and maintain scalable data pipelines for processing large-scale datasets, enabling efficient data flow across systems.
Role type
Senior Data Engineer (Python)
Builds
Scalable data processing solutions and modern data platforms
Domain
Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features | infrastructure
Required skills
Python, ETL workflows, data ingestion, data transformation, cloud environments (AWS/GCP/Azure), large-scale dataset processing, data pipeline optimization, data quality validation, containerization (Docker/Kubernetes)
Preferred skills
Financial or market data experience, columnar storage formats (Parquet), modern data lake concepts, timeseries data processing, low-latency data processing
Technologies
Python, AWS, GCP, Azure, Docker, Kubernetes, Parquet
Responsibilities
Design and build data pipelines for processing large-scale datasets, Develop solutions for data ingestion, transformation, and storage, Work with structured and unstructured data from various sources, Optimize data workflows for performance and scalability, Collaborate with engineering and business teams to understand data needs, Ensure data quality through validation and monitoring
