Philippines
Role: Quality Assurance Specialist (Remote)
Location: Remote (Work from Anywhere)
Payout: Competitive
Role Overview:
We are hiring for one of our clients, seeking an AI Quality Analyst (Personalization) - Japanese to work on a full-time basis. This role is focused on evaluating a new personalization feature for an advanced AI system, requiring a blend of creativity and analytical rigor. You will assess how effectively the model integrates user data from past interactions, including conversations, emails, search activity, and video content, to generate more relevant and helpful responses. Your work will directly contribute to improving the reliability and performance of an industry-leading AI platform. Japanese proficiency is essential to ensure accurate evaluation of localized outputs.
Key Responsibilities:
• Design and refine prompts based on personal user perspectives to test the AI’s personalization capabilities.
• Evaluate the quality of AI-generated responses using defined metrics such as grounding, integration of user context, and overall helpfulness.
• Analyze model outputs to identify patterns in performance, inconsistencies, or areas for improvement in personalization logic.
• Collaborate with AI researchers and engineers to provide data-driven feedback on model behavior and response relevance.
• Document findings systematically to support iterative improvements in the AI system’s personalization features.
Required Skills & Qualifications:
• Native-level or near-native fluency in Japanese (both written and spoken), with strong comprehension of cultural nuances relevant to personalization.
• Prior experience in quality assurance, data analysis, or AI evaluation, particularly in the context of language models or conversational AI.
• Demonstrated ability to assess response quality through structured evaluation frameworks (e.g., relevance, coherence, contextual grounding).
• Familiarity with AI systems that process multimodal data (e.g., text, email, search, video) and understanding of how user context is integrated.
• Strong analytical skills and attention to detail, with the ability to interpret model outputs and provide actionable feedback.
• Experience working in a remote environment with asynchronous collaboration tools and clear documentation practices.
More About the Opportunity:
This role offers a unique opportunity to contribute to the development of a cutting-edge AI system used by global enterprises. You will work within a team of experts in AI research and engineering, gaining exposure to advanced training pipelines and high-quality data systems. The position provides global collaboration opportunities and the chance to influence the evolution of AI personalization technologies that drive measurable business impact.
Equal Opportunity Employer:
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!