TPU Performance Engineer

• Have significant experience optimizing ML systems for TPUs, GPUs, or other accelerators
• Are results-oriented, with a bias towards flexibility and impact
• Pick up slack, even if it goes outside your job description
• Enjoy pair programming (we love to pair!)
• Want to learn more about machine learning research
• Care about the societal impacts of your work

Nice to have

• High performance, large-scale ML systems
• Designing and implementing kernels for TPUs or other ML accelerators
• Understanding accelerators at a deep level, e.g. a background in computer architecture
• ML framework internals
• Language modeling with transformers

• Implement low-latency, high-throughput sampling for large language models
• Adapt existing models for low-precision inference
• Build quantitative models of system performance
• Design and implement custom collective communication algorithms
• Debug kernel performance at the assembly level