Principal Data Engineer - AI
Core
Lead data architecture, design, and deployment of scalable Big Data systems and AI infrastructure.
Role type
Principal Data Engineer (AI)
Builds
Scalable data platforms, vector/NoSQL databases, ETL/ELT pipelines, and real-time streaming architectures.
Domain
Big Data, AI Infrastructure, Cloud Data Warehousing
Deliverable
production ML models
Required skills
Vector databases, NoSQL, Apache Spark, Apache Flink, Apache Kafka, Apache Airflow, Snowflake, Python, Advanced SQL, CI/CD, Infrastructure as Code
Preferred skills
Cloud-native infrastructure (AWS/GCP/Azure), Data observability, Anaplan
Technologies
Apache Spark, Apache Flink, Apache Kafka, Apache Airflow, Dagster, Snowflake, BigQuery, Redshift, Databricks, Delta Lake, Apache Iceberg, Anaplan
Responsibilities
Lead data architecture and design of scalable Big Data systems; Architect and manage vector, NoSQL, and document database systems; Develop end-to-end ETL/ELT pipelines and API services; Design storage layers for data lakes and real-time streaming; Optimize distributed queries and data transformations; Implement data quality frameworks; Collaborate on data models for customer metrics; Evaluate modern data-stack tools; Lead technical projects and mentor teams.
Seniority
Principal, hands-on IC with mentorship
