Senior/Staff AI Model Engineer

Responsibilities

• Own the reliability and quality bar for an AI copilot embedded in a trading platform used by sophisticated investors
• Design and build evaluation systems to measure correctness, safety, latency, and regression risk across market analysis and trading workflows
• Develop and maintain benchmarks, including curated "golden sets," scenario suites, and adversarial test cases
• Build automated quality gates and regression workflows to ensure model stability during releases
• Partner with engineering and product teams to define safe tool/action contracts and ensure predictable assistant behavior
• Manage model improvement loops through data collection, labeling strategies, error taxonomy, and fine-tuning
• Design and operate monitoring, telemetry, and incident response processes for AI systems

Requirements

• At least 8 years of experience shipping production software with strong proficiency in programming
• Strong knowledge of computer science fundamentals, testing methodology, and systems design
• Experience building evaluation frameworks and benchmark suites for complex systems (LLMs, agents, or retrieval systems)
• Experience running model improvement cycles, including dataset curation and offline experimentation
• Ability to define metrics and drive engineering decisions based on data-driven measurement pipelines
• Comfort working across the stack to debug model failures and instrument services

Preferred Qualifications

• Experience with fine-tuning, preference optimization, or distillation techniques
• Experience creating domain-specific benchmarks for high-stakes applications
• Deep experience in trading across various asset classes and margin types
• Proficiency with Rust and performance-sensitive services
• Experience designing incident response and SLOs for ML/AI systems

Benefits

• Competitive compensation packages and company equity
• 401k matching
• Gender-neutral parental leave
• Full medical, dental, and vision insurance

About the Company

Clear Street is a diversified financial services firm modernizing the brokerage ecosystem. Founded in 2018, we are replacing legacy infrastructure with a completely cloud-native clearing and custody system designed for today's complex, global markets.