Senior/Staff Data Scientist, Applied AI

Responsibilities

• Own the reliability and quality bar for an AI copilot embedded in a trading platform used by sophisticated investors
• Design and build evaluation systems that measure correctness, safety, latency, and regression risk
• Develop and maintain benchmarks, including curated golden sets and scenario suites
• Build automated quality gates and regression workflows
• Partner with engineering and product to define safe tool/action contracts
• Own model improvement loops tied to evals, including data collection and fine-tuning
• Design and operate monitoring and incident response for AI
• Develop a deep understanding of trading concepts to express them accurately to users

Requirements

• At least eight (8) years of experience shipping production software
• Strong proficiency with any programming language
• Strong knowledge of computer science fundamentals, testing methodology, and systems design
• Experience building evaluation frameworks, test harnesses, and benchmark suites for complex systems
• Experience running model improvement cycles: dataset curation, labeling/QA, and offline experimentation
• Ability to define metrics and build measurement pipelines
• Comfort working across the stack, including debugging model/tooling failures
• High degree of self-motivation

Preferred Qualifications

• Experience with fine-tuning, preference optimization, or distillation
• Experience creating domain-specific benchmarks and adversarial suites
• Deep experience with trading across asset classes
• Experience with Rust and performance-sensitive services
• Experience designing incident response and SLOs for ML/AI systems

About the Company

Clear Street is a diversified financial services firm modernizing the brokerage ecosystem by building a cloud-native clearing and custody system designed for today's complex, global market.