ML Platform Engineer, Distributed Training
Egen
WorldwideFully remoteFull TimeSeniorInformation Technology
Posted 3 hours ago3h agoApply link checked 30 minutes ago
Why we think you can apply
- Hiring model
- Open worldwide · the employer states no country restriction
- Work from
- Anywhere, the UAE included
Posted 3 hours ago · apply link checked 30 minutes ago
About the role
Responsibilities
- Work with the client's infrastructure team on the GKE training platform (GPU node pools, job queueing, quota and capacity)
- Diagnose and fix platform failures at the root cause
- Tune multi-node GPU networking (RDMA/GPUDirect, NCCL) for training throughput
- Run, scale and debug multi-node distributed training with PyTorch and Ray Train
- Profile jobs and remove bottlenecks across compute, memory, input pipelines and interconnect
- Design and run performance benchmarks and model evaluation harnesses
- Instrument training and the platform with telemetry and monitoring
Requirements
- 5+ years of engineering experience with recent GPU training infrastructure work
- Strong Python software engineering with tests and code review
- Kubernetes on Google Cloud with GPU node pools and job queueing
- Distributed PyTorch and Ray Train experience
- RDMA and GPU networking, GPUDirect, NCCL tuning
- Benchmarking and evaluation design
Preferred Qualifications
- Healthcare or life-sciences data experience, including HIPAA
- Observability and telemetry for training platforms
Benefits
- Comprehensive health insurance, paid leave, paid holidays, sick and parental leave
- 401(k) employer match and employee referral bonuses
About the Company
Egen is a fast-growing, data-first engineering company working with Google Cloud and Salesforce to help clients drive impact through data and insights.
What we look for
- 5+ years of engineering experience with recent GPU training infrastructure work
- Strong Python software engineering with tests and code review
- Kubernetes on Google Cloud with GPU node pools and job queueing
- Distributed PyTorch and Ray Train experience
- RDMA and GPU networking, GPUDirect, NCCL tuning
- Benchmarking and evaluation design
- Healthcare or life-sciences data experience, including HIPAA
- Observability and telemetry for training platforms
PythonKubernetesGoogle CloudPyTorchGPUVertex AILangChainRayBenchmarkingNCCL
SponsorWake up to a shortlist, not a search results page.
NeverApply scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.
Get your daily matchesSimilar jobsbased on title, category and scope
SponsorWake up to a shortlist, not a search results page.
NeverApply scores every new listing against your CV, salary floor and visa. A handful of real matches by morning.
Get your daily matchesML Platform Engineer, Distributed TrainingEgen · free account, 30 seconds