Data Engineer
Core
Design, build, and maintain scalable batch and real-time ETL/ELT data pipelines and data warehouses for enterprise clients.
Role type
Senior Data Engineer
Builds
Central data warehouse, data models, and transformation workflows for business intelligence and reporting.
Domain
Cloud data infrastructure and data warehousing
Deliverable
production ML models | product features | dashboards & analysis
Required skills
SQL, Python, ETL/ELT pipeline design, data warehousing, dimensional modeling, cloud platforms (GCP/AWS/Azure), distributed version control, containerization, data quality monitoring
Preferred skills
Apache Spark, real-time streaming architectures, AI-driven platforms, enterprise-scale data platforms
Technologies
GCP Dataflow, Cloud Functions, Pub/Sub, Cloud Composer, Google BigQuery, Databricks, Airflow, Hadoop, Docker, MongoDB, Elasticsearch, Looker, Kafka, Druid
Responsibilities
Architect and implement robust data infrastructure for high-volume data ingestion; Design and manage central data warehouse in Google BigQuery; Write efficient SQL and Python code to transform raw data; Monitor and optimize data infrastructure for performance and cost efficiency; Implement automated data quality checks and governance processes; Collaborate with data scientists and analysts to provide necessary data products; Lead client and stakeholder communication to translate business needs into technical solutions.
Seniority
Senior, hands-on IC
