D
AWS Glue Data Engineer
DeepLight AI
Posted 10 hours ago
Employment Type
Full Time
Location
Dubai
Requirements
AWS Glue, PySpark, ETL Pipelines, Lakehouse Architecture, Medallion Design, CDC & Delta, S3, Athena, Lambda, Git, Terraform, Data Quality, Soda Core, CI/CD, Jira, Agile, Performance tuning, 5+ years experience, Financial services
Required Skills
Job Description
Responsibilities
- Build and maintain AWS Glue jobs for Bronze-layer ingestion following company standards and templates.
- Implement loading strategies (CDC, full load, delta, snapshot) and historical data loads into the Lakehouse.
- Optimise Glue jobs for performance (DPU sizing, parallelisation, partitioning) and collaborate with platform engineers on tooling.
- Version-control ingestion code and automate production deployments using Git and Terraform.
- Ensure connectivity and ingestion compliance with data contracts; implement monitoring and alerting for jobs.
- Prepare documentation and handover packages for operational support teams.
- Work closely with Data Architects and Data Assurance to apply ingestion patterns and data quality checks.
Requirements
- AWS Glue
- PySpark
- ETL Pipelines
- Lakehouse Architecture
- Medallion Design
- CDC & Delta
- S3
- Athena
- Lambda
- Git
- Terraform
- Data Quality
- Soda Core
- CI/CD
- Jira
- Agile
- Performance tuning
- 5+ years experience
Preferred Qualifications
- Experience in financial services or banking data environments
- Prior work in AI/ML or data consultancy projects
- Strong stakeholder communication and presentation skills
- Proven ability to automate repetitive tasks and accelerate migrations
- Experience working in hybrid cloud and enterprise-scale ingestion programmes
Benefits
- Competitive salary and performance bonuses
- Comprehensive health insurance
- Professional development and certification support
- Flexible working arrangements (hybrid)
- Career advancement opportunities
About the Company
DeepLight AI is a specialist AI and data consultancy focused on delivering intelligent enterprise systems across industries, with deep experience in financial services. The team blends data science, AI/ML, workflow automation and systems integration to deliver practical, business-focused solutions. This role sits in the Data Factory Squad and contributes to large-scale Lakehouse ingestion and migration programmes based in the UAE (Dubai/Abu Dhabi). DeepLight AI values technical excellence, clear communication, and inclusive teamwork.