AWS Glue Data Engineer

Responsibilities

• Build and maintain AWS Glue jobs for Bronze-layer ingestion following company standards and templates.
• Implement loading strategies (CDC, full load, delta, snapshot) and historical data loads into the Lakehouse.
• Optimise Glue jobs for performance (DPU sizing, parallelisation, partitioning) and collaborate with platform engineers on tooling.
• Version-control ingestion code and automate production deployments using Git and Terraform.
• Ensure connectivity and ingestion compliance with data contracts; implement monitoring and alerting for jobs.
• Prepare documentation and handover packages for operational support teams.
• Work closely with Data Architects and Data Assurance to apply ingestion patterns and data quality checks.

Requirements

• AWS Glue
• PySpark
• ETL Pipelines
• Lakehouse Architecture
• Medallion Design
• CDC & Delta
• S3
• Athena
• Lambda
• Git
• Terraform
• Data Quality
• Soda Core
• CI/CD
• Jira
• Agile
• Performance tuning
• 5+ years experience

Preferred Qualifications

• Experience in financial services or banking data environments
• Prior work in AI/ML or data consultancy projects
• Strong stakeholder communication and presentation skills
• Proven ability to automate repetitive tasks and accelerate migrations
• Experience working in hybrid cloud and enterprise-scale ingestion programmes

Benefits

• Competitive salary and performance bonuses
• Comprehensive health insurance
• Professional development and certification support
• Flexible working arrangements (hybrid)
• Career advancement opportunities

About the Company

DeepLight AI is a specialist AI and data consultancy focused on delivering intelligent enterprise systems across industries, with deep experience in financial services. The team blends data science, AI/ML, workflow automation and systems integration to deliver practical, business-focused solutions. This role sits in the Data Factory Squad and contributes to large-scale Lakehouse ingestion and migration programmes based in the UAE (Dubai/Abu Dhabi). DeepLight AI values technical excellence, clear communication, and inclusive teamwork.