Senior Staff Data Engineer (Data & AI solutions)
Core
Lead the design and implementation of scalable Data Lakehouse and Data Warehouse architectures while orchestrating complex data workflows and Gen-AI development processes.
Role type
Senior Staff Data Engineer (Data & AI solutions)
Builds
Data Lakehouse processes, core product domain models, and optimized data ingestion pipelines
Domain
Cybersecurity, Cloud Data Engineering, Generative AI
Deliverable
production ML models | product features | infrastructure
Required skills
Data modeling (Facts, Dimensions, Partitions), ETL/ELT pipeline design, SQL, Python, PySpark, Cloud orchestration (AWS/GCP), Gen-AI workflow orchestration, Technical project leadership
Preferred skills
AWS ecosystem expertise (Glue, Athena, SageMaker, EMR), Apache Iceberg or BigQuery, Mentorship experience, Cybersecurity domain knowledge
Technologies
SQL, Python, PySpark, DBT, Airflow, CloudCode, Cursor, AWS, GCP, Apache Iceberg, BigQuery
Responsibilities
Design and optimize scalable Data Lakehouse and Data Warehouse architectures across cloud ecosystems; Develop robust ETL/ELT pipelines and data ingestion processes; Apply advanced data modeling techniques to structure complex data assets; Partner with cross-functional teams to identify requirements and improve workflows; Orchestrate complex data workflows combining Airflow/DBT with Gen-AI development workflows; Define and popularize data engineering best practices and data quality standards; Provide technical direction and hands-on guidance for pipeline delivery and problem-solving