AWS Glue Data Engineer

Responsibilities

• Build and implement AWS Glue jobs for Bronze layer ingestion using defined standards
• Implement loading methods including CDC, full load, delta, and snapshot
• Design and execute historical loading mechanisms for legacy data migration
• Optimize Glue job performance via DPU allocation, parallelization, and partitioning
• Automate production deployments using Git and Terraform
• Ensure jobs comply with data contracts and implement monitoring
• Collaborate with Data Architects and Platform Engineers on ingestion patterns and tooling

Requirements

• 5+ years of experience in data engineering roles
• Hands-on experience with AWS Glue and PySpark
• Substantial knowledge of Lakehouse architecture and Medallion design principles
• Familiarity with CDC, delta loads, and historical data ingestion
• Proficiency with AWS services including S3, Athena, and Lambda
• Experience with Git and Terraform for CI/CD automation
• Knowledge of data quality frameworks such as Soda Core
• Experience working in Agile environments using Jira

About the Company

DeepLight AI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, with particular depth in financial services and banking.