Data Annotator – AI Quality Analyst (Italian) – Remote

About the role

We are looking for a detail‑oriented Data Annotator to join our AI Quality team. In this remote position you will evaluate large‑language‑model (LLM) responses in Italian, ensuring personalization, relevance, and factual accuracy.

Key responsibilities

• Assess AI model outputs for personalization quality, grounding, integration, and helpfulness.
• Design and execute multi‑turn prompts that reflect personal context to test model capabilities.
• Identify hallucinations, incorrect personalization, and flawed inferences in model responses.
• Conduct side‑by‑side comparisons of model outputs to determine relative quality.
• Write clear rationales and rankings for each evaluation.
• Provide detailed feedback and annotations to improve model performance.
• Maintain strict data hygiene and accurate documentation of all evaluations.

Required profile

• Strong proficiency in Italian with excellent reading and writing skills.
• Experience in data annotation, AI evaluation, content moderation, or similar analytical roles.
• Analytical mindset capable of evaluating nuanced AI responses.
• Ability to design creative multi‑turn prompts based on personal context.
• Full‑time availability with flexibility to overlap with PST working hours.
• Bachelor’s degree or equivalent experience in a relevant analytical field.

Required skills

• Italian language proficiency (reading & writing).

What we offer

• Competitive hourly rate ranging from $11 to $15 USD.
• Fully remote work with flexible scheduling.
• Opportunity to contribute to cutting‑edge AI personalization research.