Domain Advisor Consultant (Subject Matter Expert)
AgencyWorld Wide - RemotePosted 27 February 2026
Tech Stack
Job Description
<p><strong>Engagement Type:</strong> Business-to-Business (B2B) / Independent Contractor </p>
<p><strong>Location:</strong> Remote</p>
<p><strong>The Opportunity: Define the "Ground Truth" for Generative AI</strong></p>
<p>We are looking to engage elite Subject Matter Experts (SMEs) to partner with us on high-impact AI evaluation and training projects. We are not looking for generalists; we are seeking established authorities—the top 1% in their respective fields—who are eager to apply their deep domain knowledge to shape the reasoning, accuracy, and safety of next-generation Large Language Models (LLMs).</p>
<p>This is a consulting engagement for independent professionals who want to help define what "perfection" looks like in their industry. You will not just be grading AI; you will be architecting the <strong>"Gold Standard"</strong> rubrics that teach models how to think like an expert.</p>
<h3><strong>Scope of Services Deliverables</strong></h3>
<p>This engagement focuses on high-level advisory and specialized analysis. Consultants will operate under a Statement of Work (SOW) to provide the following deliverables:</p>
<ul>
<li><strong>Rubric Architecture:</strong> Review and advise on the quality criteria used to evaluate AI outputs. You will determine if the AI’s logic holds up to professional scrutiny in your field.</li>
<li><strong>"Golden" Data Curation:</strong> Create, edit, or certify "Golden Tasks"—benchmark examples of perfect prompts and responses that serve as the ground truth for model training.</li>
<li><strong>Expert Gap Analysis:</strong> Analyze model failures (hallucinations, logical fallacies) and provide technical breakdowns of <em>why</em> the model failed and how a human expert would have approached the problem.</li>
<li><strong>Advisory on Complexity:</strong> Consult on the difficulty and nuance of specific prompts to ensure the AI is being tested against sufficiently rigorous scenarios.</li>
</ul>
<h3><strong>Consultant Profile: Who We Are Looking To Partner With</strong></h3>
<p>We are seeking independent business owners, freelancers, and academic leaders who possess:</p>
<ul>
<li><strong>Elite Domain Mastery:</strong> Advanced degrees (PhD, MD, JD) or equivalent industry-recognized status (e.g., Senior Principal Engineer, Published Author, Award-Winning Creative).</li>
<li><strong>Professional Autonomy:</strong> You currently operate as an independent consultant or freelancer and have your own workflows, equipment, and professional methodology.</li>
<li><strong>Interest in Shaping Technology:</strong> While prior experience in AI evaluation is a bonus, it is absolutely not required. We want industry veterans who are eager to set the "gold standard" for how AI should operate within their specific profession.</li>
<li><strong>Articulate Reasoning:</strong> The ability to not just know the right answer, but to articulate the <em>reasoning process</em> clearly in writing.</li>
</ul>
<h3><strong>Engagement Structure Compliance</strong></h3>
<p>This is a strictly non-employee, independent contractor opportunity designed for professionals who manage their own business operations.</p>
<ul>
<li>Engagements are <strong>project-based and non-exclusive</strong>, allowing you to continue working with other clients</li>
<li>You have flexibility in <strong>how you complete deliverables</strong>, in alignment with project requirements</li>
<li>Scope, timelines, and compensation are <strong>defined in advance</strong> for each assignment</li>
<li><strong>Remote Independent:</strong> You provide your own workspace and equipment.</li>
<li><strong>Global Compliance:</strong> Candidates must be properly registered to operate as independent contractors in their country of residence.</li>
</ul>
<h3><strong>Why Top-Tier Consultants Partner With Us</strong></h3>
<ul>
<li><strong>Intellectual Challenge:</strong> This is rare, cerebral work that challenges you to deconstruct your own expertise to train a machine.</li>
<li> ... (truncated, view full listing at source)
Apply Now
Direct link to company career page