D

QA & Application Testing & Automation Engineer

DeepLight AI

Posted 2 days ago

Employment Type

Full Time

Location

Abu Dhabi

Requirements

Bachelor's Degree, QA and Automation, AI/ML, Python, Selenium, Playwright, Postman, Testing, MLOps, CI/CD, Security, Regulatory

Required Skills

Python Selenium Playwright Postman MLOps CI/CD Security Regulatory AI ML testing Automation Azure AWS Jmeter Locust SQL NoSQL

Job Description

Responsibilities

  • Validate next-gen AI platforms (voice and chat) for accuracy, stability, latency, and safety; ensure AI-driven enterprise search avoids hallucinations.
  • Build and maintain reusable automation frameworks for web, mobile, and API integrations using Python, Selenium, or Playwright.
  • Validate RAG (Retrieval-Augmented Generation) pipelines, vector search quality, and grounding accuracy to ensure data retrieval performance.
  • Implement automated quality checks for MLOps, including drift detection, retraining validation, and model registry integrity.
  • Conduct scenario-based testing for operational AI agents (KYC, Risk, Compliance) and validate high availability and disaster recovery protocols.
  • Integrate automated quality gates into CI/CD pipelines to ensure continuous validation within containerized (Docker/Kubernetes) environments.
  • Verify that all AI engineering aligns with guardrails for fairness, security, explainability, and regulatory requirements.

Requirements

  • A Bachelor’s degree in Computer Science, AI, Software Engineering, or a related quantitative field. A Master’s degree in AI/ML is highly preferred.
  • A minimum 5+ years in QA and Automation, preferably within a large-scale digital bank or a major digital transformation project.
  • Proven experience deploying AI/ML QA solutions at an enterprise scale, specifically in banking or financial services.
  • Deep knowledge of software testing methodologies (Functional, Regression, Security, and Non-functional).
  • Proficiency in Python for test automation and expertise with tools like PyTest, Selenium, Playwright, and Postman.
  • Hands-on experience testing LLM response quality, prompt stability, and agentic orchestration workflows.
  • Strong experience validating pipelines and storage services across Azure (AI Foundry) and AWS (SageMaker).
  • Proficiency in load and stress testing using tools like JMeter or Locust.
  • Expertise in SQL and NoSQL test validation (Postgres, MongoDB, Cassandra) and data platform integrity.

Preferred Qualifications

  • The ability to evaluate and integrate emerging AI testing tools such as LangChain, CrewAI, or Bedrock.
  • Experience at acting as an "analytics translator" between technical teams and business stakeholders regarding quality risks.
  • An understanding of cybersecurity principles in the context of AI safety and prompt injection prevention.
  • A proven ability to work within fast-paced squads to remove blockers and manage dependencies.

Benefits

  • Competitive salary.
  • Visa Sponsorship for the successful individual.
  • Comprehensive health insurance for the successful individual.
  • Professional development and certification support.
  • Opportunity to work on cutting-edge AI projects.
  • Career advancement opportunities in a rapidly growing AI company.

About the Company

DeepLight AI is a specialist AI and data consultancy with extensive experience implementing intelligent enterprise systems across multiple industries, with particular depth in financial services and banking. Our team combines deep expertise in data science, statistical modeling, AI/ML technologies, workflow automation, and systems integration with a practical understanding of complex business operations.

How to Apply

Similar Jobs You Might Be Interested In

Join Dubai's Remote Work Revolution.

Stay ahead in your career with Dubai's first platform dedicated to remote and hybrid job opportunities. Subscribe for weekly insights and job alerts directly to your inbox.

Thank you for subscribing! Check your inbox for confirmation.
Weekly Job Alerts
Subscribe to receive curated lists of the best remote and hybrid job opportunities in Dubai, tailored to your skills and interests.
Weekly Blog Newsletter
Get the latest insights, trends, and advice on remote work every week to help you thrive in the evolving work environment.