D

DataOps Engineer - Lakehouse Operations

DeepLight AI

Posted 1 month ago

Employment Type

Full Time

Location

Abu Dhabi

Job Listing No Longer Available

This job posting is no longer accepting applications. It may be more than 30 days old or the position has been filled.

Requirements

5+ years, AWS Glue, dbt, Kafka, DMS, Monitoring & Alerting, Incident Management, Root-cause Analysis, JIRA, Data Freshness, Data Quality, Automation

Required Skills

AWS Glue DBT Kafka DMS DataOps Monitoring Jira Python SQL AWS

Job Description

Responsibilities

  • Monitor and act on incidents for AWS Glue jobs, DMS/dbt pipelines, and Kafka streaming (lag, health).
  • Perform L1 triage and route incidents to L2/L3 as required; maintain incident context.
  • Own incident lifecycle: triage, severity assessment, coordinate fixes, create and track JIRA tickets, and close incidents.
  • Lead post-incident root-cause analysis and maintain post-mortem documentation and incident logs.
  • Implement and collaborate on preventive automation to reduce recurring operational issues.
  • Maintain operational dashboards (TV status) and deliver daily 10–15 minute operational reviews and summary communications.
  • Ensure proactive communication on risks, delays, and remediation progress to stakeholders.

Requirements

  • 5+ years in DataOps, DevOps, or data engineering roles.
  • Hands-on experience with AWS Glue.
  • Experience with DMS and dbt pipeline operations.
  • Experience operating Kafka streaming and monitoring lag.
  • Strong monitoring and alerting skills for data platforms.
  • Proven incident management and triage experience (JIRA preferred).
  • Solid root-cause analysis and preventive action planning skills.
  • Familiarity with data freshness SLAs and data quality frameworks.
  • Ability to automate repetitive operational tasks and build reliable runbooks.
  • Excellent communication and coordination under pressure.

Preferred Qualifications

  • Experience with AWS ecosystem (CloudWatch, S3, IAM).
  • Scripting and automation experience (Python, Bash).
  • Familiarity with observability tools (Grafana, Prometheus, Datadog or similar).
  • Prior experience in consultancy or financial services environments.
  • Certifications in AWS or data engineering tooling.
  • Experience managing on-site operational schedules and cross-team incident rituals.

Benefits

  • Competitive salary and performance bonuses.
  • Comprehensive health insurance.
  • Professional development and certification support.
  • Opportunity to work on cutting-edge AI projects.
  • Flexible working arrangements; role is hybrid (4 days on-site in Abu Dhabi, 1 day remote).
  • Career advancement opportunities within a growing AI consultancy.

About the Company

DeepLight AI is a specialist AI and data consultancy based in the UAE, delivering intelligent enterprise systems with strong expertise in financial services and banking. Our team blends data science, statistical modeling, AI/ML, workflow automation, and systems integration to solve complex business problems. We prioritise operational excellence, clear stakeholder communication, and a collaborative culture that supports professional growth and inclusivity. The successful candidate will join a high-visibility platform team responsible for ensuring data freshness and platform integrity across client deployments in Abu Dhabi.

How to Apply

Similar Jobs You Might Be Interested In

Join Dubai's Remote Work Revolution.

Stay ahead in your career with Dubai's first platform dedicated to remote and hybrid job opportunities. Subscribe for weekly insights and job alerts directly to your inbox.

Thank you for subscribing! Check your inbox for confirmation.
Weekly Job Alerts
Subscribe to receive curated lists of the best remote and hybrid job opportunities in Dubai, tailored to your skills and interests.
Weekly Blog Newsletter
Get the latest insights, trends, and advice on remote work every week to help you thrive in the evolving work environment.