D

AWS Glue Data Engineer

DeepLight AI

Posted 1 month ago

Employment Type

Full Time

Location

Dubai

Job Listing No Longer Available

This job posting is no longer accepting applications. It may be more than 30 days old or the position has been filled.

Requirements

AWS Glue, PySpark, ETL Pipelines, Lakehouse Architecture, Medallion Design, CDC & Delta, S3, Athena, Lambda, Git, Terraform, Data Quality, Soda Core, CI/CD, Jira, Agile, Performance tuning, 5+ years experience, Financial services

Required Skills

AWS Glue PySpark ETL Lakehouse Medallion CDC Delta Lake S3 Athena Lambda Git Terraform Soda Core Jira CI/CD Performance Optimization Data Engineering

Job Description

Responsibilities

  • Build and maintain AWS Glue jobs for Bronze-layer ingestion following company standards and templates.
  • Implement loading strategies (CDC, full load, delta, snapshot) and historical data loads into the Lakehouse.
  • Optimise Glue jobs for performance (DPU sizing, parallelisation, partitioning) and collaborate with platform engineers on tooling.
  • Version-control ingestion code and automate production deployments using Git and Terraform.
  • Ensure connectivity and ingestion compliance with data contracts; implement monitoring and alerting for jobs.
  • Prepare documentation and handover packages for operational support teams.
  • Work closely with Data Architects and Data Assurance to apply ingestion patterns and data quality checks.

Requirements

  • AWS Glue
  • PySpark
  • ETL Pipelines
  • Lakehouse Architecture
  • Medallion Design
  • CDC & Delta
  • S3
  • Athena
  • Lambda
  • Git
  • Terraform
  • Data Quality
  • Soda Core
  • CI/CD
  • Jira
  • Agile
  • Performance tuning
  • 5+ years experience

Preferred Qualifications

  • Experience in financial services or banking data environments
  • Prior work in AI/ML or data consultancy projects
  • Strong stakeholder communication and presentation skills
  • Proven ability to automate repetitive tasks and accelerate migrations
  • Experience working in hybrid cloud and enterprise-scale ingestion programmes

Benefits

  • Competitive salary and performance bonuses
  • Comprehensive health insurance
  • Professional development and certification support
  • Flexible working arrangements (hybrid)
  • Career advancement opportunities

About the Company

DeepLight AI is a specialist AI and data consultancy focused on delivering intelligent enterprise systems across industries, with deep experience in financial services. The team blends data science, AI/ML, workflow automation and systems integration to deliver practical, business-focused solutions. This role sits in the Data Factory Squad and contributes to large-scale Lakehouse ingestion and migration programmes based in the UAE (Dubai/Abu Dhabi). DeepLight AI values technical excellence, clear communication, and inclusive teamwork.

How to Apply

Similar Jobs You Might Be Interested In

Join Dubai's Remote Work Revolution.

Stay ahead in your career with Dubai's first platform dedicated to remote and hybrid job opportunities. Subscribe for weekly insights and job alerts directly to your inbox.

Thank you for subscribing! Check your inbox for confirmation.
Weekly Job Alerts
Subscribe to receive curated lists of the best remote and hybrid job opportunities in Dubai, tailored to your skills and interests.
Weekly Blog Newsletter
Get the latest insights, trends, and advice on remote work every week to help you thrive in the evolving work environment.