Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Core
Lead Data Engineer designing and developing scalable, high-performance data solutions and distributed data processing for Target's enterprise financial operations.
Role type
Lead Data Engineer (Finance Technology)
Builds
Scalable data pipelines, real-time and batch data processing solutions, APIs, and data services for financial reporting and decision-making.
Domain
Retail / Finance Technology / Big Data
Required skills
Hadoop, PySpark, Scala, Java, Cloud platforms (AWS/GCP/Azure), API development (REST/GraphQL/gRPC), Real-time streaming (Kafka/Flink/Kinesis), Data modeling, ETL, Data governance
Preferred skills
BS or MS in Computer Science, Machine Learning, or related field
Technologies
Hadoop, Spark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, Kafka, Flink, Kinesis
Responsibilities
Architect scalable data pipelines; Design real-time and batch processing solutions; Develop low-latency data APIs; Optimize data models and workflows; Drive data governance and security; Collaborate with stakeholders; Mentor engineers.
Seniority
Lead, technical leadership & mentorship
