D

Data Assurance Lead

DeepLight AI

Posted 9 hours ago

Employment Type

Full Time

Location

Abu Dhabi

Requirements

Soda Core, Data quality, Lakehouse expertise, Medallion design, AWS Glue, Amazon S3, Athena, OpenMetadata, Data contracts, Reconciliation checks, Incident management, Agile delivery, Jira, Stakeholder leadership, 8+ years, Banking domain

Required Skills

Soda Core OpenMetadata AWS Glue Amazon S3 Athena Lakehouse Medallion Architecture Data Contracts Data Quality reconciliation incident management Azure Data Factory Agile Jira AWS

Job Description

Responsibilities

  • Design and operationalize a Data Assurance Framework across Lakehouse (Bronze, Silver, Gold)
  • Implement Soda Core checks, data quality rules, SLAs, and reconciliation across pipelines
  • Automate data contracts, validations, and regression test suites; integrate scorecards in OpenMetadata
  • Configure alerts and thresholds, manage incidents, define escalation and runbooks
  • QA and governance for AWS Glue jobs; embed best practices with Data Factory squads
  • Analyze data issues, implement countermeasures, optimize check performance, and train teams

Requirements

  • 8+ years in data engineering or data quality; 3+ years in data assurance leadership
  • Strong experience with Soda Core or similar data quality frameworks
  • Lakehouse and Medallion architecture expertise
  • Proficiency with AWS S3, Glue, Athena, and data validation techniques
  • Experience with data contracts, metadata, and lineage tools (OpenMetadata preferred)
  • Proven automation mindset, building validation and reconciliation pipelines
  • Excellent communication, stakeholder management, and Agile delivery (Jira)

Preferred Qualifications

  • Financial Services or Banking sector experience
  • Hands-on with AWS Glue and Azure Data Factory workflows
  • Experience defining freshness and timeliness SLAs
  • Building data quality scorecards and automated regression tests
  • Incident management processes and cross-functional leadership
  • Documentation, training, and enablement across squads

Benefits

  • Competitive salary and performance bonuses
  • Comprehensive health insurance
  • Professional development and certification support
  • Flexible working arrangements
  • Opportunity to work on cutting-edge AI projects
  • Career advancement in a rapidly growing AI company

About the Company

DeepLight AI is a specialist AI and data consultancy with expertise in data science, statistical modeling, AI/ML, workflow automation, and systems integration. We partner with enterprises—particularly in financial services and banking—to implement intelligent, reliable data platforms. Our culture values technical mastery, clear communication, and measurable business outcomes, with a strong focus on data reliability and quality.

How to Apply

Similar Jobs You Might Be Interested In

Join Dubai's Remote Work Revolution.

Stay ahead in your career with Dubai's first platform dedicated to remote and hybrid job opportunities. Subscribe for weekly insights and job alerts directly to your inbox.

Thank you for subscribing! Check your inbox for confirmation.
Weekly Job Alerts
Subscribe to receive curated lists of the best remote and hybrid job opportunities in Dubai, tailored to your skills and interests.
Weekly Blog Newsletter
Get the latest insights, trends, and advice on remote work every week to help you thrive in the evolving work environment.