AI Tester

Responsibilities

• Design, build, and maintain scalable end-to-end automation frameworks using Playwright
• Author and execute API testing suites for distributed microservices
• Design validation strategies for asynchronous, event-driven data architectures using Kafka
• Establish testing methodologies for Generative AI and LLM outputs to assess hallucination, bias, and accuracy
• Manage and curate prompt validation datasets and ground-truth test collections
• Partner with AI research engineers and DevOps to integrate automated testing into CI/CD pipelines

Requirements

• Advanced capability in Playwright and testing RESTful/gRPC APIs
• Knowledge of AI quality tools like Ragas, LangSmith, or TruLens
• Proficiency in TypeScript, JavaScript, or Python
• Experience with event streaming platforms like Kafka or Azure Event Hubs
• Minimum 6 years of experience in software quality engineering or SDET roles
• Experience with Docker and Kubernetes
• Experience integrating automated tests into GitHub Actions or Azure DevOps

Preferred Qualifications

• Familiarity with banking application regulatory and security compliance
• Experience with performance testing tools like k6, JMeter, or Locust
• Understanding of the Machine Learning Lifecycle and dataset versioning (e.g., DVC)

Benefits

• Competitive salary
• Comprehensive personal health insurance
• Visa Sponsorship
• Professional development and certification support
• Subscription reimbursement
• Monthly Employee Incentive program

About the Company

DeepLight AI is a specialist AI and data consultancy implementing intelligent enterprise systems across multiple industries, with particular depth in financial services and banking.