Senior Data Engineer
Core
Design and deliver automated analytical solutions and high-quality datasets to power the Ignite AI Advisor Application.
Role type
Senior Data Engineer
Builds
Automated data pipelines and datasets for the Ignite AI Advisor Application
Domain
Financial services / Big Data
Deliverable
production ML models | product features
Required skills
SQL, Python, Apache Airflow (DAGs), ETL/ELT, data pipeline design, data quality checks, AI tool usage (Gemini, ChatGPT, Claude, Co-Pilot), Git/CI-CD
Preferred skills
Master's degree, credit risk/finance background, Google Cloud Platform (GCP), AWS, Snowflake, Hadoop, large dataset management
Technologies
SQL, Python, Apache Airflow, Google Cloud Platform, AWS, Snowflake, Hadoop, Git
Responsibilities
Integrate, consolidate, cleanse, and structure data for analysts; Create optimized, efficient, repeatable, and scalable SQL and Python pipelines; Develop and implement data quality checks and troubleshoot anomalies; Utilize AI to accelerate development and create processing documentation; Design and interpret large, complex datasets; Stay up-to-date with GCP trends and propose new solutions
Seniority
Senior, hands-on IC