Associate Data Engineer
Core
Design, build, maintain, and analyze data pipelines and solutions to generate actionable insights and support business decisions.
Role type
Associate Data Engineer
Builds
Scalable data pipelines, ETL/ELT processes, and data integration solutions
Domain
Big Data, Cloud Data Engineering
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Python, PySpark, Scala, SQL, Databricks, Apache Spark, Apache Kafka, PostgreSQL, MySQL
Preferred skills
AWS data services (EKS, EC2, S3, EMR, RDS, Redshift, Lambda, Glue, Athena), data modeling, data warehousing, machine learning pipelines
Technologies
Databricks, AWS, Apache Hadoop, Apache Spark, Apache Kafka, PostgreSQL, MySQL, PySpark, Scala
Responsibilities
Design and develop data solutions for data generation, collection, and processing; Create and maintain data pipelines ensuring data quality via ETL processes; Take ownership of data pipeline projects from inception to deployment; Develop and maintain data models, data dictionaries, and documentation; Implement data security and privacy measures; Collaborate with cross-functional teams to understand data requirements and design solutions; Identify and resolve complex data-related challenges; Explore new tools to improve ETL platform performance.
Seniority
Mid-level, hands-on IC
