Operations Research Model Prompt Evaluator Job at SaidGig, Remote

ZUVFMFVhdGpRbGdmYlZuZ1NmTHFiYUsyRFE9PQ==
  • SaidGig
  • Remote

Job Description

Role Overview

As an expert in operations research, you will play a crucial role in crafting and verifying high-quality open-ended prompts for AI model evaluation. Your work will involve creating and reviewing complex optimization and decision-science problems, assessing AI reasoning quality, and helping to establish rigorous evaluation standards for advanced language models.

You will be assigned one of two task types:

  • Authoring Task — Create 5 original, open-ended prompts from your assigned subdomain at varying difficulty levels (undergraduate, advanced undergraduate, or graduate/professional). Prompts should require human judgment to evaluate the quality of the AI''s response, such as optimization modeling, algorithmic analysis, or stochastic reasoning.
  • Verification Task — Review 5 authored prompts for clarity, scope alignment, difficulty accuracy, and uniqueness. Edit prompts and difficulty ratings where needed.
Operations Research Subdomains Covered

Linear & Integer Programming, Network Optimization & Graph Theory, Stochastic Models & Queuing Theory, Game Theory & Decision Analysis, Supply Chain & Logistics Optimization, Simulation & Metaheuristics.

Key Responsibilities
  • Author clear, unambiguous, open-ended operations research prompts that elicit evaluable AI responses.
  • Verify prompts are within the scope of the assigned subdomain and correctly rated for difficulty.
  • Ensure all 5 prompts in a task are sufficiently distinct from one another with varying difficulty levels.
  • Apply expert judgment to assess the depth and quality of quantitative reasoning required.
  • Edit prompts and difficulty assignments where standards are not met.
Ideal Qualifications
  • Master''s degree or higher in Operations Research, Industrial Engineering, Applied Mathematics, or a closely related field.
  • 2–6 years of professional or research experience in optimization, logistics, or decision science.
  • Strong command of mathematical programming, probabilistic modeling, and algorithmic methods.
  • Experience with solvers (Gurobi, CPLEX) or simulation tools is a strong plus.
  • Excellent written English and ability to craft precise, well-scoped technical questions.
More About the Opportunity

Expected commitment: 10+ hours/week. This position offers asynchronous, fully remote work.

Job Tags

Remote job

Similar Jobs

Visiting Angels - Milford

Live in Caregiver Job at Visiting Angels - Milford

Part time Live In Caregiver needed for Sturbridge MA Must be experienced ,have good work referencesPlease call Keith or Jill at (***) ***-****. Thank you

StretchLab Little Italy

Stretching professional - Health/Wellness/Fitness (Kinesiology) Job at StretchLab Little Italy

 ...opportunity to gain experience in a new modality that is taking the fitness industry by storm. StretchLab is the industry leader in...  ...Instructor* Dance Instructor* Experience working in a fitness/health environment where you were providing hands-on training with... 

THE VA GROUP

Quickbooks Bookkeeper Job at THE VA GROUP

 ...Are you an exceptional Bookkeeper looking for a new opportunity? We're hiring immediately, and we want YOU to join our growing team!*...  ...* Ensure all entries follow proper accounting standards and QuickBooks Pro guidelines.* Conduct routine audits to verify accuracy,... 

FUJIFILM Biotechnologies

Marketing Assistant- Intern Job at FUJIFILM Biotechnologies

Position OverviewPosition Description We are hiring a Marketing Assistant- Intern. The Marketing Assistant- Intern will support the Marketing team with activities including market research and execution of campaign/promotional activities, across channels, with different... 

WorldWise

Event Sales & Marketing Coordinator Job at WorldWise

 ...Are you passionate about marketing, sales, and live events? Do you thrive in fast-paced environments where every day is different? We are hiring...  ...on behalf of our client for an Event Sales & Marketing Coordinator to represent their campaigns inside major retail locations...