Software Engineer, Data Platform
Core
Building a multitenant data platform for data ingestion, consumption, and cataloguing on AWS, serving internal and external data sources.
Role type
Lead Python Data Engineer
Builds
Data ingestion pipelines, data lake components, operational data warehouses, and API access layers on AWS/Databricks.
Domain
Financial services / Cloud Data Engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, Databricks (Spark, Delta Lake, Streaming), AWS Cloud, Data Architecture, Microservices, Kubernetes, Git, CI/CD
Preferred skills
Event-driven architectures, MongoDB, Airflow, dbt
Technologies
AWS, Databricks, Spark, Delta Lake, Kubernetes, MongoDB, Airflow, dbt
Responsibilities
Planning and delivering projects with the team, building data ingestion pipelines in the cloud, improving team processes and practices, working with customers towards project success.
Seniority
Senior, hands-on IC with leadership responsibilities