Research Scientist, Gemini, UI Control

We concentrate on the following three key areas related to UI understanding and control:

• Data Enhancement: Adding new data to post-training mixtures in Gemini
• Self-Improvement: Exploring methods such as online exploration and reinforcement learning
• Evaluation Contributions: Developing and contributing new evaluation methodologies

The objective is to continuously improve quality while tackling tasks of increasing complexity and ambiguity across a wider range of surfaces.

Key responsibilities:

This role involves making core contributions to post-training in Gemini that advances the frontier of what digital agents can do and is deployable into production. The employee will identify model areas of improvement and own work related to training and evaluating UI Control agents across various digital environments. Multi-step reinforcement learning in multimodal, digital environments is a focus.  Research that improves the ability of the agent to handle more complex tasks or incorporate more user interaction is a plus.

• PhD or relevant experience in computer science related field.
• Experience with multi-step reinforcement learning
• Experience with post-training generative models

• Understanding of model training, evaluation metrics
• Experience with designing and analyzing machine learning experiments
• Ability to design and build evaluations
• Adaptability: The field is evolving rapidly, requiring a willingness to learn new technologies and approaches.

The US base salary range for this full-time position is between $166,000 - $244,000 + bonus + equity + benefits. Your recruiter can share more about the specific salary range for your targeted location during the hiring process.