Senior Data Engineer
Core
Design, build, and maintain data pipeline architecture and infrastructure for analyzing large datasets, ensuring alignment with business goals.
Role type
Senior Data Engineer (Contractor/Private Entrepreneur)
Builds
Data pipelines, data warehouses, and scalable data infrastructure
Domain
Financial technology / Big Data
Required skills
Data pipeline design, ETL processes, Data warehousing, Big data technologies, AWS services, Data orchestration, SQL, Python, Scala
Preferred skills
Vertica or Redshift, Machine learning, Data governance, Spark internals
Technologies
Hadoop, Spark, NoSQL, AWS (EC2, S3, Athena, Kinesis/Firehose, Lambda, EMR), Airflow, Scala, Python
Responsibilities
Design and maintain optimal data pipeline architecture for extraction, transformation, and loading; Monitor and optimize data infrastructure performance and reliability; Implement data privacy and security requirements; Enhance team dev-ops capabilities.
Seniority
Senior, hands-on IC
