Russia
Role Overview:
You will evaluate a new personalization feature for an AI model by assessing how well it uses your past conversations, emails, search, and activity data to generate more relevant and helpful responses.
Key Responsibilities:
• Design creative, multi-turn prompts based on personal context to thoroughly test the model’s personalization capabilities.
• Evaluate model responses for accuracy in grounding, integration, and helpfulness using your primary personal Google account.
• Identify incorrect personalization, poor inferences, and forced connections in AI-generated outputs.
• Review side-by-side comparisons of model responses to spot subtle discrepancies and inconsistencies.
• Provide detailed, evidence-based feedback to improve AI personalization quality.
Required Skills & Qualifications:
• Fluency in Russian with high comprehension and writing ability.
• Experience in creative prompt engineering to test AI models effectively.
• Strong analytical thinking to assess nuanced and ambiguous AI responses.
• Meticulous attention to detail for evaluating subtle differences in model outputs.
• Understanding of personalization concepts, including grounding and inference accuracy.
• Willingness to use your primary personal Google account and enable personal data sources for genuine assessment.
• Full-time availability in your local time zone to support a global, 24-hour operations team.
More About the Opportunity:
This role offers the chance to contribute to the development of advanced AI systems that drive measurable impact and lasting results for a leading research accelerator in the technology industry.
Equal Opportunity Employer:
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!