Senior Data Engineer
Core
Design, develop, and maintain high-quality data pipelines and storage systems to drive platform delivery and solve complex business problems.
Role type
Senior Data Engineer
Builds
Data pipelines, logic, storage systems, and analytics platforms
Domain
Financial services, cloud data infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, SQL, Java, Scala, PySpark, Apache Spark, Shell scripting, AWS Redshift, Snowflake, Kafka, Kinesis, Airflow, Tableau, Power BI, DevOps automation, SDLC, relational/NoSQL/Graph DBs, data warehousing, IaC (Ansible, CloudFormation), unit/integration testing
Preferred skills
AWS Glue, AWS Lambda, AWS Step Functions, serverless data pipeline development
Technologies
AWS (Redshift, Snowflake, Glue, Lambda, Step Functions, Kinesis, Kafka, Airflow, CloudFormation, CloudWatch), Spark, Kafka, Tableau, Power BI, Ansible
Responsibilities
Build and optimize data pipelines and storage systems; develop efficient, documented code; conduct complex data analysis and prepare data for modeling; collaborate on data acquisition and transformation processes; write unit, integration, and functional automation tests; coach others and embed learning in day-to-day work
Seniority
Senior, hands-on IC
