Project Overview

Join a growing community of professionals advancing the next wave of AI. As an AI Trainer, you’ll play a hands-on role by analyzing and providing feedback on data to improve LLM performance, helping ensure that the next generation of AI technology is accurate and trustworthy.

We are seeking skilled Retail Trade experts to work as a project consultant in our AI Labor Marketplace. This is not a full-time employment position — you will be engaged as an expert project consultant on a contract basis.

Location: U.S.-based experts only

Engagement: Part-time, project-based expert evaluation work

Work Type: Remote

Project Summary

Consultants will create realistic, challenging professional tasks and prompt-specific evaluation rubrics for the Real Estate and Rental and Leasing industry. The resulting materials will be used to train and evaluate large language models.

Tasks must reflect work that experienced professionals actually perform. Consultants will design credible workplace scenarios, define the expected deliverable, and create detailed checklists that reviewers can use to assess the quality of a model-generated response. The project is intended to expose meaningful model limitations through authentic professional judgment and complexity, rather than academic exercises or artificial trick questions.

Each consultant will be assigned to one industry and may develop tasks representing several occupations within that industry.

Consultant Engagement Terms

This is a project-based consultant role. Consultants will be paid on a per-project basis; hourly rates are estimates based on anticipated completion time. Consultants control their own schedule, provide their own tools, and may simultaneously provide services to other vendors or employers (subject to those vendors’ allowances).

Responsibilities

Contributors will:

• Create original, real-world professional tasks for the Retail Trade industry
• Develop clear prompts with realistic requirements, constraints, and expected work products
• Create prompt-specific scoring rubrics or evaluation checklists
• Define essential success criteria and material response failures
• Apply professional judgment to make tasks challenging and representative of industry practice
• Cover multiple relevant occupations within the assigned industry
• Review model responses where required and document substantive deficiencies
• Revise submissions in response to structured quality-review feedback
• Ensure that submissions exclude confidential, proprietary, privileged, or personally identifiable information

Expected Outcomes

• Complete professional task and rubric packages that meet the project’s acceptance criteria
• Tasks representative of authentic workflows within the assigned industry
• Specific and consistently applicable evaluation criteria
• Original content suitable for authorized AI training and evaluation use
• Timely revisions when reviewer feedback identifies correctable issues

Qualifications

• Currently based in the United States
• Substantial professional experience in Retail Trade.
• Experience in one or more relevant roles, such as General and Operations Managers, First-Line Supervisors of Retail Sales Workers, Pharmacists, Private Detectives and Investigators.
• Knowledge of industry terminology, workflows, documentation, and quality standards
• Ability to create tasks spanning multiple occupations within the assigned industry
• Strong analytical and professional writing skills
• Ability to translate professional judgment into explicit evaluation criteria
• Experience reviewing, supervising, auditing, approving, or evaluating professional work preferred

LinkedIn Data Security and Privacy Notice

https://legal.linkedin.com/content/dam/legal/Global-Data-Privacy-Notice_LI_TalentCommunity.pdf