DataOps Engineer - Lakehouse Operations

Responsibilities

• Monitor and act on incidents for AWS Glue jobs, DMS/dbt pipelines, and Kafka streaming (lag, health).
• Perform L1 triage and route incidents to L2/L3 as required; maintain incident context.
• Own incident lifecycle: triage, severity assessment, coordinate fixes, create and track JIRA tickets, and close incidents.
• Lead post-incident root-cause analysis and maintain post-mortem documentation and incident logs.
• Implement and collaborate on preventive automation to reduce recurring operational issues.
• Maintain operational dashboards (TV status) and deliver daily 10–15 minute operational reviews and summary communications.
• Ensure proactive communication on risks, delays, and remediation progress to stakeholders.

Requirements

• 5+ years in DataOps, DevOps, or data engineering roles.
• Hands-on experience with AWS Glue.
• Experience with DMS and dbt pipeline operations.
• Experience operating Kafka streaming and monitoring lag.
• Strong monitoring and alerting skills for data platforms.
• Proven incident management and triage experience (JIRA preferred).
• Solid root-cause analysis and preventive action planning skills.
• Familiarity with data freshness SLAs and data quality frameworks.
• Ability to automate repetitive operational tasks and build reliable runbooks.
• Excellent communication and coordination under pressure.

Preferred Qualifications

• Experience with AWS ecosystem (CloudWatch, S3, IAM).
• Scripting and automation experience (Python, Bash).
• Familiarity with observability tools (Grafana, Prometheus, Datadog or similar).
• Prior experience in consultancy or financial services environments.
• Certifications in AWS or data engineering tooling.
• Experience managing on-site operational schedules and cross-team incident rituals.

Benefits

• Competitive salary and performance bonuses.
• Comprehensive health insurance.
• Professional development and certification support.
• Opportunity to work on cutting-edge AI projects.
• Flexible working arrangements; role is hybrid (4 days on-site in Abu Dhabi, 1 day remote).
• Career advancement opportunities within a growing AI consultancy.

About the Company

DeepLight AI is a specialist AI and data consultancy based in the UAE, delivering intelligent enterprise systems with strong expertise in financial services and banking. Our team blends data science, statistical modeling, AI/ML, workflow automation, and systems integration to solve complex business problems. We prioritise operational excellence, clear stakeholder communication, and a collaborative culture that supports professional growth and inclusivity. The successful candidate will join a high-visibility platform team responsible for ensuring data freshness and platform integrity across client deployments in Abu Dhabi.