AI Tester

Responsibilities

• Design, build, and maintain scalable end-to-end automation frameworks using Playwright.
• Author and execute comprehensive API testing suites for RESTful and gRPC microservices.
• Develop validation strategies for asynchronous, event-driven architectures using Kafka-based streaming pipelines.
• Establish specialized testing methodologies to evaluate Generative AI and LLM outputs for hallucination, bias, and semantic accuracy.
• Manage and version baseline prompt validation datasets and ground-truth test collections.
• Partner with AI research engineers and DevOps to integrate automated testing gates into CI/CD pipelines.

Requirements

• 6+ years of experience in software quality engineering, test automation, or SDET roles.
• Advanced capability in Playwright automation and testing RESTful/gRPC APIs.
• Proficiency in TypeScript, JavaScript, or Python.
• Practical knowledge of AI quality tools such as Ragas, LangSmith, or TruLens.
• Experience with event streaming platforms like Kafka or Azure Event Hubs.
• Hands-on experience with Docker, Kubernetes, and CI/CD integration (e.g., GitHub Actions, Azure DevOps).
• Proven track record of validating complex enterprise workflows and distributed backend architectures.

Preferred Qualifications

• Familiarity with data privacy and regulatory security compliance in banking applications.
• Experience with performance testing utilities such as k6, JMeter, or Locust.
• Understanding of the Machine Learning Lifecycle, model registry operations, and dataset versioning (e.g., DVC).

Benefits

• Competitive salary and monthly employee incentive program.
• Comprehensive personal health insurance.
• Visa sponsorship for the successful candidate.
• Professional development, certification support, and subscription reimbursement.
• Opportunity to work on cutting-edge AI projects within a rapidly growing company.

About the Company

Deeplight is a specialist AI and data consultancy that implements intelligent enterprise systems across multiple industries, with a deep focus on financial services and banking. We deliver tailored AI solutions designed to integrate seamlessly into existing architectures, ensuring innovation is both scalable and secure.