Principal Software Engineer
Core
Architect and lead end-to-end data engineering solutions, migrating on-prem applications to cloud-based PaaS and building scalable data pipelines for batch and real-time processing.
Role type
Principal Software Engineer (Data Engineering & Architecture)
Builds
Cloud-native data warehouses, big data solutions, and data-intensive applications with streaming pipelines.
Domain
Data Engineering, Cloud Infrastructure, Big Data
Deliverable
production ML models | product features | infrastructure
Required skills
Data architecture design, data modeling (dimensional/relational/NoSQL), ETL/ELT design, cloud migration strategy, big data technologies, data orchestration, GenAI integration, database optimization
Preferred skills
Technical leadership, mentoring, API design, microservices architecture
Technologies
Python, SQL, Java/Scala, Apache Spark, Hadoop, Kafka, Trino, Hive, Iceberg, Airflow, dbt, AWS (S3, EC2, RDS, Lambda, DynamoDB, Glue), Azure (Data Factory, Synapse, Databricks), GCP (Big Query, Dataflow, Dataproc), Snowflake, Redshift, PostgreSQL, MySQL, Oracle, MongoDB, Cassandra, Docker, Kubernetes, Jenkins, GitHub Actions
Responsibilities
Drive innovation in emerging cloud technologies, architect end-to-end data solutions including collection, storage, and modeling, guide multi-terabyte database migrations, design data-intensive applications with APIs and streaming pipelines, establish coding standards and best practices, mentor junior engineers, optimize data models for performance, implement data quality controls, deploy cloud-based solutions, and ensure data security and governance.
Seniority
Principal, hands-on IC with strategic leadership