Data Engineer
Core
Designing and maintaining data pipelines, ETL/ELT processes, and analytical data warehouses to support business analytics and cross-functional requirements.
Role type
Data Engineer
Builds
Data pipelines, data warehouses, large-scale data processing systems, and data lakes
Domain
Cloud data infrastructure and analytics
Deliverable
production ML models | product features | dashboards & analysis
Required skills
Data pipeline development, ETL/ELT, data modeling, database optimization, schema design, stored procedure development, batch job management, data quality improvement, data cataloging, PL/SQL tuning, SQL optimization, Kubernetes orchestration, CI/CD pipelines, microservices deployment, AWS cloud solutions (EC2, S3, EMR, Redshift, Athena, Kinesis), Python, R, SQL, Java, Hadoop, HDFS, Apache Airflow, Apache Spark, Scala, Hive, Pig, data crawling, data cleaning, data aggregation
Preferred skills
Machine learning model deployment, statistical modeling
Technologies
Kubernetes, AWS (EC2, S3, EMR, Redshift, Athena, Kinesis), Python, R, SQL, Java, Hadoop, HDFS, Apache Airflow, Apache Spark, Scala, Hive, Pig, Oracle SQL/PLSQL
Responsibilities
Develop and maintain data architectures including databases and data warehouses; Design and develop data pipelines for data modeling and production; Ensure data architecture supports routine and ad-hoc analytics requirements; Leverage programming languages and tools to clean and prepare raw data; Recommend and implement improvements to data quality, reliability, and efficiency; Organize and store data assets and catalogs for efficient access; Tune and optimize PL/SQL and SQL applications; Provide support for urgent incidents or system failures outside core business hours
Seniority
Mid-level, hands-on IC
