- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- 1 hour ago
- Work mode
- Work from home
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Summary
We are looking for a dedicated Quality Analyst to evaluate and refine a new AI personalization feature. This full-time remote position involves assessing how effectively an AI model incorporates information from prior interactions such as conversations, emails, search history, and activity to generate pertinent responses. The job blends creative prompt formulation with rigorous analysis of AI outputs.
Core Responsibilities
- Assess personalized AI-generated replies by applying your own experiences as contextual reference.
- Develop inventive multi-turn prompts to challenge the AI’s ability to merge personal data sources correctly.
- Evaluate AI responses for accuracy, grounding, integration, and relevance, pinpointing instances of incorrect personalization or contrived links.
- Conduct side-by-side comparisons of AI answers to uncover subtle differences in their suitability and correctness.
- Provide comprehensive feedback aimed at enhancing the AI's personalization capabilities.
Essential Qualifications
- Fluent English proficiency with excellent reading and writing skills.
- Experience with prompt engineering or crafting test scenarios for AI models.
- Strong analytical skills to interpret nuanced and ambiguously generated AI responses.
- Understanding of personalization methods and metrics used in AI evaluation.
- Detail-oriented mindset to spot discreet inconsistencies in AI outputs.
- Willingness to use a personal primary Google account and enable relevant data sources to support assessment.
- Availability to work full-time in your local time zone to assist a 24/7 global operations team.
Opportunity Highlights
This position provides a chance to engage in pioneering AI development with a global technology leader, influencing AI systems that drive significant business outcomes.
Workplace Diversity
The company values skill-based hiring, welcoming applications from all backgrounds without bias regarding history or experience. Selection is strictly based on demonstrated technical expertise and qualifications.