Data Engineer
Core
Design, build, and optimize scalable data pipelines and data architectures to support advanced analytics, data warehousing, and business intelligence.
Role type
Senior Data Engineer
Builds
Scalable data pipelines, ETL/ELT processes, and data warehousing solutions
Domain
Financial Services / Banking
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, PySpark, Databricks, DBT, Apache Airflow, AWS S3, AWS Lambda, Delta Lake, PostgreSQL, data warehousing concepts, ETL principles
Preferred skills
None stated
Technologies
PySpark, Databricks, DBT, Apache Airflow, Delta Lake, AWS Redshift, PostgreSQL, AWS S3, AWS Lambda
Responsibilities
Design and maintain robust, scalable data pipelines and workflows; Develop and manage ETL/ELT processes to transform and ingest data from multiple sources; Work with large-scale data processing frameworks such as PySpark and Databricks; Implement and maintain data models using DBT; Orchestrate workflows using tools like Apache Airflow; Design and optimize data warehousing solutions; Ensure data quality, consistency, and governance across the ecosystem; Optimize query performance and ensure efficient data storage and retrieval; Build and maintain integration with AWS data services such as S3 and Lambda; Troubleshoot and resolve performance, scalability, and availability issues
Seniority
Senior, hands-on IC