Sr Data Engineer
Core
Designing, developing, testing, and implementing data engineering processes to generate analytical and reporting solutions and prepare data for data science outcomes.
Role type
Senior Data Engineer
Builds
Automated ETL jobs, logical and physical data models, data quality rules, and metadata structures
Domain
Data Engineering / Big Data
Deliverable
production ML models
Required skills
ETL development, data modeling (OLTP/OLAP), SQL (Oracle, MySQL, PostgreSQL, HiveQL), Python, Java, Scala, data profiling, data quality rule design, data lineage tools
Preferred skills
Master Data Management (MDM) tools, data catalog tools (Alation, Collibra), Big Data engines (Hadoop, Spark, Hive, Cassandra, HBase), unstructured data handling (XML, JSON), data visualization
Technologies
Informatica, Talend, ERWin, ER Studio, HiveQL, Hadoop, Spark, Cassandra, HBase, Oracle, MySQL, PostgreSQL
Responsibilities
Build automated ETL jobs based on data mapping specifications; Design and build Data Quality (DQ) rules; Perform data profiling and analysis for source and target systems; Build logical and physical data models for OLTP and OLAP solutions; Maintain metadata structures for reusable ETL components; Analyze reference datasets and familiarize with MDM tools.
Seniority
Senior, hands-on IC
