Principal Data Engineer
Core
Design, develop, and lead scalable data ingestion and transformation pipelines to power data platforms, products, and automation initiatives.
Role type
Principal Data Engineer (hands-on IC with management duties)
Builds
Scalable data ingestion and transformation pipelines, data infrastructure, and automation workflows
Domain
Financial services / Credit intelligence / Cloud data engineering
Deliverable
production ML models | product features | infrastructure
Required skills
Python, SQL, AWS services (MWAA/Airflow, Lambda, ECS, SQS, Glue, S3, Redshift), Terraform, data warehousing/lakehouse technologies, data modeling, ETL/ELT, CI/CD, Docker
Preferred skills
Streaming data technologies (Kafka, Kinesis, Flink), data quality/observability tools (Great Expectations, Monte Carlo), web scraping frameworks (Scrapy, BeautifulSoup)
Technologies
AWS, Terraform, Airflow, Lambda, ECS, SQS, Glue, S3, Redshift, Snowflake, Databricks, Docker, Kafka, Kinesis, Flink
Responsibilities
Lead technical strategy for the data platform; design and develop scalable data pipelines; mentor senior engineers; architect and manage orchestration workflows; implement infrastructure as code; partner with data teams for consistency and reliability; ensure data quality through testing and monitoring.
Seniority
Principal, hands-on IC with leadership responsibilities
