AI Researcher — Inference Optimization

Responsibilities

• Research and develop techniques to optimize inference performance for large neural networks
• Improve latency, throughput, memory efficiency, and cost per inference
• Design and evaluate model-level optimizations such as quantization, pruning, and KV-cache optimization
• Implement systems-level optimizations including dynamic batching, kernel fusion, and multi-GPU inference
• Benchmark inference workloads across hardware accelerators
• Collaborate with engineering teams to deploy optimized inference pipelines
• Translate research insights into production-ready improvements

Requirements

• Strong background in machine learning, deep learning, or AI systems
• Hands-on experience optimizing inference for large-scale models
• Proficiency in Python and modern ML frameworks like PyTorch
• Experience with inference tooling such as Triton, TensorRT, vLLM, or ONNX Runtime
• Ability to design experiments and communicate results clearly

Preferred Qualifications

• Experience deploying production inference systems at scale
• Familiarity with distributed and multi-GPU inference
• Experience contributing to open-source ML or inference frameworks
• Authorship or co-authorship of peer-reviewed research papers
• Experience working close to hardware using CUDA, ROCm, or profiling tools