Data Engineer 4 (Python, AWS, Kafka, Spark, SQL, Snowflake, Databricks, GenAI)
Core
Design, build, and deliver scalable cloud data solutions and pipelines to support hyper-personalized marketing messages and experiences for millions of customers.
Role type
Senior IC Data Engineer (Cloud & GenAI)
Builds
Scalable cloud data platforms, data pipelines, and applications for marketing and messaging channels.
Domain
Financial Services / Data Engineering / Cloud Infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, Spark, AWS, Snowflake, Databricks, Kafka, distributed data systems, data pipeline design, data modeling, cloud data warehousing, data security, encryption, access control.
Preferred skills
Real-time/streaming data pipelines, data observability, data orchestration, NoSQL databases, unstructured/semi-structured data handling, Agile development, reusable data products.
Technologies
AWS, Kafka, Spark, Snowflake, Databricks, EMR, Glue, Airflow, Dagster, Monte Carlo, Splunk, MongoDB, Cassandra, DynamoDB, Redshift.
Responsibilities
Design and build data pipelines and platforms focusing on scalability and resilience; Architect and enforce common data engineering design patterns; Collaborate with product managers and software engineers to deliver cloud-first solutions; Mentor team members and share knowledge on emerging technologies; Implement data security standards and compliance measures.
Seniority
Senior, hands-on IC
