Database Analysis - Advisor II
Core
Design, develop, and maintain data ingestion and transformation pipelines using StreamSets and Snowflake, ensuring scalable data movement and compliance.
Role type
Senior IC data engineering specialist (data pipelines & transformation)
Builds
Production data pipelines, metadata-driven ingestion systems, and monitoring applications
Domain
Fintech, payments, enterprise data architecture
Deliverable
production ML models | product features | dashboards & analysis
Required skills
StreamSets Control Hub, Snowflake (tables, views, streams, Task Graphs), SQL, Python scripting, CI/CD, data lineage, PCI compliance, Groovy scripting
Preferred skills
Streamlit, Snowflake Cortex AI, dbt, Harness, SonarQube
Technologies
StreamSets, Snowflake, Python, Groovy, Streamlit, dbt, Harness, SonarQube
Responsibilities
Design and implement Snowflake objects and orchestrate automated DAGs; Build metadata-driven pipelines for Raw JSON ingestion; Classify PCI data and apply encryption/tokenization; Monitor, validate, and optimize pipelines for performance; Build Streamlit-based monitoring and reporting applications; Maintain documentation for audit readiness.
Seniority
Senior, hands-on IC
