Search Engine Evaluation Specialist - Freelance AI Trainer Project
$20/hr as listed
- Listed pay
- $20/hr as listed
- Field
- Languages
- Languages
- English
- Where
- United States
- Type
- Contract, remote
- Posted on Meridial
- First seen here
- 9 October 2026
Summary
We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly interpret search intent, analyze...
From the Meridial listing
Project Overview
We are sourcing independent Search Engine Evaluation Specialists to provide their expertise for an AI benchmark evaluation project. As AI models increasingly interpret search intent, analyze indexing protocols, and evaluate search rank responses, their accuracy relies entirely on robust, expert-crafted training data. The objective of this project is to autonomously produce high-quality evaluation tasks, strong prompts, and clear, well-structured rubrics that generate clean, reliable data for model training.
Project Deliverables & Scope
Operate autonomously to design complex evaluation frameworks and provide structured training data. Expected deliverables include:
- Task & Prompt Creation: Generating realistic, high-quality prompts that compel the AI model to produce complex, professional-grade deliverables specific to search rank response analysis, indexing logic, and query relevance.
- Benchmark Evaluation Data Generation: Producing clean, reliable training data that directly aids in the evaluation and refinement of AI models handling complex SEO and search engine ranking tasks.
- Quality Assurance & Fact-Checking: Ensuring all generated tasks and scoring criteria reflect strict, real-world search quality rating standards, technical indexing mechanics, and user intent accuracy.
Required Expertise
To successfully fulfill the deliverables of this project, Contractors must possess deep industry knowledge to craft realistic professional scenarios.
Core skillset includes:
- Demonstrable professional expertise within the Search Engine Optimization (SEO), search quality rating, or digital marketing sectors, with a deep understanding of indexing, ranking factors, and search response evaluation.
- Strong writing and prompt generation skills, with the ability to design highly realistic, complex search evaluation task scenarios for AI training.
- Proficiency in rubric generation, specifically the ability to create objective, non-ambiguous scoring criteria that leave no room for subjective interpretation.
- A meticulous, detail-oriented approach to fact-checking search rankings, evaluating content quality against official rating guidelines, and generating reliable data for system benchmarking.
We offer a pay rate of $20 per hour, with the exact rate determined after evaluating your experience, expertise, and geographic location. Final offer amounts may vary from the pay range listed above. As a contractor you’ll supply a secure computer and high‑speed internet; company‑sponsored benefits such as health insurance and PTO do not apply.
Engagement Type: Freelance / Independent Contractor
Workplace Type: Remote
Text above is the platform's own listing, shown as published. Check the details on Meridial before applying.
Prepare for the assessment
Practice questions and what each platform says about its screening for this kind of role:
Terms in this listing
- Benchmark
- A fixed set of test tasks used to compare models or track progress over time.
- Prompt
- The input given to a model: a question, an instruction or a conversation so far.
- Rubric
- A written list of criteria and scores used to judge a response, for example accuracy, instruction following and tone, each with clear pass or fail descriptions.
- Relevance
- How well a result or answer matches what the user was looking for.
- Fact-checking
- Checking each claim in a model's answer against reliable sources and marking what is wrong or unsupported.
Related roles
Language Alignment & Resource Partner - Freelance AI Trainer Project
$10-65/hr as listed
- Languages
- English
- United States
Swedish Language Specialist - Freelance AI Trainer Project
$8-65/hr as listed
- Languages
- Swedish
- 3 countries
Video Production Specialist (US) - Freelance AI Trainer Project
$8-65/hr as listed
- Languages
- English
- United States
Korean-Japanese Bilingual Specialist - Freelance AI Trainer Project
$8-65/hr as listed
- Languages
- Korean, Japanese
- Worldwide
Korean-Chinese Bilingual Specialist - Freelance AI Trainer Project
$8-65/hr as listed
- Languages
- Korean, Chinese
- Worldwide