D

Platform SRE and Reliability Engineer

DeepLight AI

Posted 2 days ago

Employment Type

Contract

Location

Abu Dhabi

Requirements

Bachelor's degree, 5+ years QA, AI/ML QA experience, Python, Cloud testing, Docker/Kubernetes

Required Skills

Python Selenium Playwright Pytest Jmeter Locust LLM Azure AWS Docker Kubernetes

Job Description

Responsibilities

  • Building reusable automation frameworks to test the accuracy, stability, latency, and safety of Conversational AI platforms (voice and chat) and LLM-based agents.
  • Validating multi-agent orchestration, human-in-the-loop escalation logic, and the integrity of RAG pipelines and vector search results.
  • Testing AI/ML platform components for scaling behavior, failover resilience, high availability, and disaster recovery.
  • Integrating automated test pipelines into CI/CD workflows for MLOps, focusing on drift detection, retraining validation, and model registry integrity.
  • Verifying AI/ML pipelines on Azure AI Foundry and AWS SageMaker, ensuring data integrity across storage services (S3/Blobs) and serverless functions.
  • Conducting load testing for AI services and ensure engineering guardrails for fairness, explainability, and regulatory compliance are enforced.
  • Acting as a bridge between engineering and business, translating complex technical reliability requirements into actionable quality narratives.

Requirements

  • A Bachelor’s degree in Computer Science, AI, Software Engineering, or a related quantitative field. A Master’s degree in AI/ML is highly preferred.
  • 5+ years in QA, Application Testing, or Reliability Engineering, ideally for a large-scale brand or digital-only bank.
  • Proven track record in deploying AI/ML QA solutions at an enterprise scale within the financial services sector.
  • Experience testing distributed architectures, microservices, and large-scale data platforms (Vector DBs, Data Lakes).
  • Expertise in Python-based automation frameworks and tools such as Selenium, Playwright, PyTest, JMeter, and Locust.
  • A deep understanding of LLM evaluation frameworks, prompt stability testing, and hallucination avoidance validation.
  • Hands-on experience testing and validating services across both Azure and AWS cloud environments.
  • Strong SQL/NoSQL validation skills (Postgres, MongoDB) and experience testing REST, GraphQL, and FastAPI integrations.
  • Be proficient in testing within Docker and Kubernetes (EKS/AKS) environments.

Preferred Qualifications

  • An ability to evaluate and adopt emerging QA tools for AI frameworks like LangChain, CrewAI, and Bedrock.
  • An understanding of cutting-edge quality trends, including multimodal QA and RLHF (Reinforcement Learning from Human Feedback) output evaluation.
  • A proactive approach to identifying edge cases in AI agents that could impact banking compliance or customer experience.
  • A strong ability to coordinate with different functional teams to implement models and monitor outcomes.

Benefits

  • Competitive salary.
  • Visa Sponsorship for the successful individual.
  • Comprehensive health insurance for the successful individual.
  • Professional development and certification support.
  • Opportunity to work on cutting-edge AI projects.
  • Career advancement opportunities in a rapidly growing AI company.

About the Company

DeepLight AI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, with particular depth in financial services and banking. Our team combines deep expertise in data science, statistical modeling, AI/ML technologies, workflow automation, and systems integration with a practical understanding of complex business operations.

How to Apply

Similar Jobs You Might Be Interested In

Join Dubai's Remote Work Revolution.

Stay ahead in your career with Dubai's first platform dedicated to remote and hybrid job opportunities. Subscribe for weekly insights and job alerts directly to your inbox.

Thank you for subscribing! Check your inbox for confirmation.
Weekly Job Alerts
Subscribe to receive curated lists of the best remote and hybrid job opportunities in Dubai, tailored to your skills and interests.
Weekly Blog Newsletter
Get the latest insights, trends, and advice on remote work every week to help you thrive in the evolving work environment.