LLM Language Evaluation Specialist

LLM Language Evaluation Specialist – Spain

Project-based | Spain | Remote

We are looking for Catalan language specialists to participate in a long-term LLM Language Evaluation Project focused on evaluating the quality and accuracy of AI-generated content.

The project is expected to continue for 3+ months , with selected candidates first completing a trial evaluation before joining the production stage.

What You Will Do

• Evaluate AI/LLM-generated content in Catalan according to detailed project guidelines.
• Assess whether the content is accurate, natural, and linguistically appropriate.
• Identify and classify language-related issues, including:
• Mistranslation or inaccurate translation
• Missing or omitted content
• Incorrect terminology or word usage
• Spelling, grammar, punctuation, and spacing errors
• Word- or phrase-level issues
• Other issues affecting the quality and readability of the content
• Identify abnormal cases, such as non-Slovak content, language identification errors, duplicate content, or content requiring rejection.
• Apply evaluation criteria consistently and provide structured evaluation results.
• Maintain high accuracy and attention to detail throughout the project.

Requirements

• High proficiency in Catalan.
• Previous experience with Large Language Model (LLM), AI evaluation, AI training, data annotation, localization, translation, or related projects is required.
• Strong understanding of Slovak grammar, vocabulary, terminology, and natural language usage.
• Strong ability to identify subtle language errors and distinguish between acceptable and incorrect expressions.
• Ability to understand and follow detailed evaluation guidelines.
• Strong attention to detail and execution ability.
• Comfortable working with structured digital documents and online tools.

Relevant professional or industry experience is a plus, but not mandatory.

Project Information

• Project: LLM Language Evaluation
• Target Language: Catalan
• Duration: 3+ months
• Work Mode: Remote / Project-based
• Start: September 24, 2026.

Before starting project work, all selected candidates will go through a 1–5 day trial and training period to familiarize themselves with the project guidelines and evaluation process.

The trial and training period is paid at the normal project rate , so candidates will be compensated for their time and completed work during this period.

Recruitment Notice

We never charge candidates any fees at any stage of the recruitment or onboarding process.