Senior Data Engineer
Core
Designing and developing high-performance, cloud-native data pipelines and data quality frameworks to improve trust and reliability of enterprise data assets.
Role type
Senior IC data engineer (data quality & pipelines)
Builds
Scalable data pipelines, data quality frameworks, and cloud-native data solutions for enterprise analytics platforms.
Domain
Payments industry, big data, cloud infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Spark, Scala, Python, Java, Databricks, AWS services, SQL, data warehousing, ETL/ELT, Nifi, distributed data processing, data quality controls, validation frameworks, observability, monitoring, incident resolution
Preferred skills
AI/ML techniques, anomaly detection, predictive analytics, statistical modeling, Deep Learning, TensorFlow, Pytorch, Generative AI, AI-assisted development tools
Technologies
Spark, Scala, Python, Java, Databricks, Hadoop, AWS, SQL, Oracle, PostgreSQL, Iceberg, Ozone, Nifi, TensorFlow, Pytorch
Responsibilities
Design and maintain scalable data pipelines; implement data quality frameworks and automated remediation; develop optimized data processing solutions on AWS; apply AI/ML for anomaly detection and root cause analysis; perform production support and troubleshoot complex data issues; contribute to architecture and engineering standards.
Seniority
Senior, hands-on IC
