AI Product Manager

Responsibilities

• Lead the planning and evolution of the AI model relay station and Multi-LLM aggregation platform.
• Manage multi-model aggregation and standardization for models like OpenAI, Anthropic, and DeepSeek.
• Design and iterate on intelligent traffic routing strategies, including load balancing, rate limiting, and circuit breaking.
• Build enterprise-level AI permission systems, multi-tenant account systems, and fine-grained Token metering and billing.
• Coordinate with R&D, QA, and DevOps teams to drive version iterations and optimize throughput and cost structures.
• Track global AI industry trends to transform customer pain points into standardized platform capabilities.

Requirements

• 2-3 years of experience in AI products, LLM platforms, API middle-end, or high-performance SaaS platforms.
• Deep understanding of LLM calling chains, API forwarding logic, network protocols, and concurrency control.
• Familiarity with mainstream LLM capabilities, fine-tuning, RAG, context management, and Prompt engineering.
• Strong logical abstraction and architectural design skills with ability to produce high-quality PRDs and sequence diagrams.
• Strong ownership, data sensitivity, and project management skills.

Preferred Qualifications

• Experience building AI relay platforms, API distribution platforms, or computing power scheduling centers from 0 to 1.
• Familiarity with LLM adaptation layers, chat interfaces, and Embedding vector interface logic.
• Experience in B2B high-concurrency SaaS commercial billing and multi-level permission systems.
• Proficiency with modern full-stack development tools like Cursor or Claude Code.