Data Engineer
Core
Design, build, and maintain scalable, secure data platforms supporting analytics, reporting, and AI/ML initiatives.
Role type
Senior Data Engineer
Builds
Modern data architectures, ETL/ELT pipelines, data lakes, data warehouses, and real-time streaming platforms.
Domain
Enterprise data engineering, cloud platforms, AI/ML data support
Deliverable
production ML models | product features | infrastructure
Required skills
ETL/ELT pipeline design, SQL, Python, Scala, relational and NoSQL databases, data lakes/warehouses, Apache Spark/Hadoop, cloud platforms (Azure/AWS/GCP), real-time streaming, data governance, CI/CD, distributed computing
Preferred skills
MLOps, feature engineering, Azure Data Factory/Databricks/AWS Glue, Apache Kafka, Airflow, Snowflake/BigQuery, monitoring solutions (Azure Monitor/Grafana)
Technologies
Apache Spark, Hadoop, Azure, AWS, GCP, Kafka, Airflow, Databricks, Snowflake, BigQuery, PostgreSQL, SQL Server, MySQL
Responsibilities
Design and maintain scalable ETL/ELT pipelines; build modern data architectures including data lakes and warehouses; ingest and process data from internal and external sources; design data models for analytics and AI/ML; collaborate with Data Scientists for feature engineering; develop batch and real-time processing solutions; implement data governance and security controls; optimize pipelines for performance and cost; implement monitoring and observability solutions; support data migration and cloud transformation; automate deployment via CI/CD.
Seniority
Senior, hands-on IC
