Sr Engineer Data Engineering
Core
Architect and oversee SQL/Spark SQL, Unix commands, and data operations-based data analysis solutions; lead ETL strategy and ensure robust data pipelines.
Role type
Senior IC data engineering lead (ETL & data warehousing)
Builds
Scalable data pipelines, data warehousing solutions, and analytical frameworks
Domain
Financial services data infrastructure
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Spark SQL, Unix shell scripting, ETL strategy, data pipeline management, cloud infrastructure management (AWS/GCP), data governance, performance troubleshooting (Java logs), team leadership
Preferred skills
Industry-specific experience (e-commerce, finance, healthcare), open-source contributions, AWS/GCP certifications
Technologies
SQL, Spark SQL, Unix/Linux, AWS, GCP, Java
Responsibilities
Architect and oversee SQL/Spark SQL and data operations solutions; Lead ETL strategy and ensure robust data pipelines; Utilize Linux commands for system operations and deployment; Work within cloud environments to manage infrastructure and data workflows; Partner with business leaders to define KPIs and analytical frameworks; Drive data governance and quality initiatives; Lead and mentor a team of delivery; Analyze Java logs to identify and resolve performance bottlenecks.
Seniority
Senior, hands-on IC with leadership responsibilities