Senior Quality Assurance Analyst

Responsibilities

• Lead quality efforts for complex features including AI powered call routing, inbound and outbound calling, and third party telephony integrations
• Design and execute comprehensive test strategies covering end-to-end workflows, integrations, and event driven systems
• Validate inbound call capture, recording, transcription, summarization, and downstream event notifications
• Test phone registration workflows, including business registration, A2P compliance, and SHAKEN/STIR related processesEnsure accuracy and reliability of AI generated conversations, call summaries, and data capture across varied scenarios
• Validate management applications used to configure call flows, routing logic, permissions, and reporting
• Identify edge cases related to dropped calls, transcription errors, AI confidence thresholds, and third party provider failures
• Contribute to and maintain QA documentation, standards, and the organizational knowledge base
• Partner with Product and Engineering to influence requirements, design decisions, and release readiness
• Drive continuous improvement by identifying gaps in processes, tooling, and test coverage

Requirements

• Advanced expertise in manual testing methodologies and test case design for complex systems
• Strong experience testing APIs, webhooks, and third party integrations
• Solid understanding of telephony concepts such as call flows, call routing, IVR behavior, and voicemail
• Experience validating AI or ML assisted features, including non deterministic outputs and regression risks
• Ability to assess transcription accuracy, conversational intent recognition, and AI response quality
• Experience testing event driven architectures and downstream data delivery
• Familiarity with compliance driven workflows, auditability, and data traceability
• Strong analytical and problem solving skills with attention to detail
• Excellent written and verbal communication skills, including clear defect documentation
• Ability to influence development teams and advocate effectively for quality initiatives

Preferred Qualifications

Benefits

• Medical, Dental, & Vision Insurance (for full-time employees)
• Competitive & Fair Pay
• Maternity & paternity leave (for full-time employees)
• Short & long-term disability
• Opportunity to learn from a dedicated leadership team
• Centrally located open office building in Sugar House (onsite employees)
• Top-of-the-line company swag

About the Company

Filevine is forging the future of legal work with cloud-based workflow tools. We have a reputation for intuitive, streamlined technology that helps professionals manage their organization and serve their clients better. We’re also known for our team of extraordinary and passionate professionals who love working together to help organizations thrive. Our success has catapulted Filevine to the forefront of our field—we are ranked as one of the most innovative and fastest-growing technology companies in the country by both Deloitte and Inc.