Senior Data Engineer @ DCG sp. z o.o.
Core
Develop and maintain data pipelines supporting regulatory reporting and design distributed data processing solutions.
Role type
Senior Data Engineer
Builds
Data pipelines for regulatory reporting and distributed data processing solutions
Domain
Financial services / Regulatory compliance
Deliverable
production ML models | product features | dashboards & analysis | infrastructure
Required skills
SQL, Apache Hadoop, Apache Spark, Apache Airflow, Apache Kafka, CI/CD pipelines, L3 production support, workflow orchestration, event-driven architectures
Preferred skills
Kubernetes, Apache Flink
Technologies
Hadoop, Kafka, Spark, SQL, Flink, Oozie, Airflow, Jenkins, Git
Responsibilities
Develop and maintain data pipelines supporting regulatory reporting, Design and implement distributed data processing solutions using Hadoop and Spark, Translate complex business requirements into efficient and executable SQL transformations, Build and maintain SQL-based data transformations for regulatory data processing, Manage and monitor workflow orchestration using Oozie and Airflow, Provide L3 support for production systems including incident analysis and resolution
Seniority
Senior, hands-on IC
