Lead Data Engineer - Finance Technology (Hadoop, PySpark, Scala/Java)
Core
Lead Data Engineer designing and developing scalable, high-performance data solutions and distributed data processing systems for Target's enterprise financial operations.
Role type
Lead Data Engineer (Finance Technology)
Builds
Scalable data pipelines, real-time and batch processing solutions, and data services for Accounts Payable, Accounts Receivable, Treasury, and Financial Planning.
Domain
Retail Finance Technology / Big Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Hadoop, PySpark, Scala, Java, Cloud platforms (AWS/GCP/Azure), API development (REST/GraphQL/gRPC), Real-time streaming (Kafka/Flink/Kinesis), Data modeling, ETL pipeline design, Data governance
Preferred skills
BS or MS in Computer Science, Machine Learning, or Applied Mathematics
Technologies
Hadoop, Spark, Scala, Java, AWS, GCP, Azure, S3, BigQuery, Databricks, EMR, Snowflake, Kafka, Flink, Kinesis
Responsibilities
Architect scalable data pipelines and distributed processing solutions; Design real-time and batch data processing solutions; Develop low-latency data APIs and services; Optimize data models and processing frameworks; Drive data governance and security best practices; Provide technical leadership and mentor engineers.
Seniority
Lead, hands-on IC with mentorship