Staff Machine Learning Engineer, Inference

The ML Platform team at Waymo provides a set of tools to support and automate the lifecycle of the machine learning workflow, including feature and experiment management, model development, debugging and evaluation, deployment, and monitoring. These efforts have resulted in making machine learning more accessible to teams at Waymo, ensuring greater degrees of consistency and repeatability. We work with machine learning experts in all parts of the company and our collaborators across Alphabet. You will focus on developing large-scale and efficient inference solutions for Waymo. This is crucial to the development of Waymo Foundation Models for driving including evaluation, auto-labeling and distillation.

In this hybrid role, you will report to the Senior Manager of Machine Learning.

You have:

• B.S. in Computer Science, Math, or equivalent real-world experience
• 2+ years of experience as a technical lead
• 5+ years working with high-scale distributed or ML inference systems for real-time and batch processing
• Understanding of machine learning fundamentals and experience with popular ML frameworks such as JAX, PyTorch, or TensorFlow

We prefer:

• MS in Computer Science, Math, or equivalent real-world experience
• Experience with multi-threaded and stream-based programming models
• Prior experience on ML compiler optimization such as TVM or XLA
• Previous experience deploying machine learning models for computer vision, natural language processing, or recommendation systems

#LI-Hybrid