Principal Data Engineer - II
Core
Design, develop, and maintain scalable ETL/ELT pipelines, real-time streaming, and batch processing solutions to ingest, transform, and integrate data from various sources for analytics and machine learning.
Role type
Principal Data Engineer
Builds
Scalable data pipelines, data lakes, data warehouses, and databases
Domain
Data Engineering / Big Data
Deliverable
production ML models
Required skills
SQL, Python, Java, Scala, Apache Spark, Apache Kafka, data orchestration (Airflow, dbt, Prefect), relational and NoSQL databases, data quality validation
Preferred skills
Data governance, cloud platforms, data integration techniques
Responsibilities
Design and maintain scalable ETL/ELT pipelines; Implement real-time data streaming and batch processing; Build and optimize data storage solutions; Monitor performance and reliability of data systems; Collaborate with Data Scientists and Analysts to define data requirements; Provide technical expertise and guidance on data engineering best practices
Seniority
Principal, hands-on IC
