Data Engineer
Core
Design, develop, and maintain scalable data pipelines and architectures to support business insights and analytics.
Role type
Data Engineer
Builds
Scalable data pipelines, ETL/ELT processes, and centralized data systems
Domain
Cloud data engineering and big data
Deliverable
production ML models | product features
Required skills
Python, Java, or Scala; ETL/ELT tools (Apache Airflow, Talend, Informatica); Cloud platforms (AWS, Azure, Google Cloud); Data warehousing (Snowflake, Databricks); SQL; Relational and NoSQL databases (PostgreSQL, MySQL, MongoDB, Cassandra); Git and CI/CD pipelines
Preferred skills
Apache Spark, Hadoop, or Kafka; Data visualization tools (Tableau, Power BI)
Technologies
Apache Airflow, Talend, Informatica, AWS Glue, AWS Redshift, AWS S3, Azure Data Factory, Azure Synapse, Google BigQuery, Google Dataflow, Snowflake, Databricks, PostgreSQL, MySQL, MongoDB, Cassandra, Apache Spark, Hadoop, Kafka, Git, Tableau, Power BI
Responsibilities
Design and maintain scalable data pipelines; Build and optimize data architectures; Implement and manage ETL/ELT processes; Ensure data security, quality, and governance; Troubleshoot and resolve data-related issues
Seniority
Individual Contributor