Quality Engineer (Automation & AI)

Responsibilities

• Design risk-based test strategies and convert them into automated coverage using AI-assisted workflows
• Use AI coding agents like Claude Code as a primary development partner for generating and maintaining automation code
• Build and maintain automated test suites using Playwright integrated within GitHub CI/CD pipelines
• Design and implement agentic testing workflows using AI models and APIs
• Build reusable frameworks, utilities, and AI-powered tools to increase test authoring velocity
• Partner with engineers, product managers, and designers to shift quality left
• Improve test suite health by reducing flakiness and increasing execution speed
• Own quality metrics including automated coverage, escaped defects, and release confidence

Requirements

• Strong software engineering fundamentals and ability to debug code in modern languages
• Extensive experience with modern test automation frameworks, preferably Playwright
• Demonstrated ability to use AI coding agents as a primary development partner
• Experience building and maintaining scalable automation frameworks
• Experience integrating automated test suites into CI/CD pipelines using GitHub Actions
• Experience with agentic testing frameworks, AI-powered testing tools, or LLM API integrations
• Strong understanding of quality engineering principles, test strategy, and risk analysis
• Ability to work as an embedded engineer within cross-functional product squads

Preferred Qualifications

• Experience testing AI-powered products, agents, or LLM-based applications
• Experience designing evaluation frameworks for AI-generated outputs
• Familiarity with prompt engineering, AI quality assessment, and AI observability
• Experience with performance, load, or resilience testing
• Experience with test management platforms integrated with Jira
• Experience building internal developer platforms or engineering productivity solutions

About the Company

Zyte is an automation-first, AI-native company focused on improving software delivery through advanced engineering disciplines.