Member of Technical Staff (GPU Performance Engineer)

Responsibilities

• Design and implement improvements to training infrastructure
• Contribute to technical decisions to optimize model performance
• Work on post-training processes including reinforcement learning and fine-tuning
• Improve the efficiency and scalability of model serving infrastructure

Requirements

• Strong engineering skills with fluency in Python and PyTorch
• Proven experience implementing and training large deep learning models
• Experience writing and debugging low-level GPU code (CUDA, C++)
• Experience scaling GPU jobs using large-scale compute clusters (Slurm or Kubernetes)
• Ability to analyze and optimize GPU-accelerated workloads through profiling and bottleneck identification

Benefits

• Five weeks of paid leave
• Comprehensive healthcare benefits including vision and dental
• Visa assistance including H1B and OPT transfers

About the Company

Reka is a globally distributed foundation model startup building useful multimodal artificial intelligence to empower organizations and businesses.