This is a remote, project-based role for experienced practitioners across any professional domain who can apply their real-world expertise to data annotation tasks. You will review, label, and evaluate data samples — including text, documents, model outputs, and domain-specific content — providing expert judgment, structured annotations, and reasoned assessments that require genuine hands-on professional experience. This position offers exceptional pay, exposure to cutting-edge AI development workflows, and a strong addition to your professional portfolio.
Why Apply
Flexible Time Commitment – Work on your schedule while contributing meaningful domain expertise
Exceptional Pay
Portfolio Building – Gain experience contributing expert knowledge to real-world AI and data projects
Professional Growth – Apply your domain expertise in a novel, high-impact context at the frontier of AI development
Responsibilities
Review and annotate data samples — including text, documents, and model-generated outputs — using structured labeling frameworks and annotation guidelines
Apply domain-specific expertise to evaluate the accuracy, quality, and appropriateness of content requiring professional judgment
Provide detailed reasoning, justifications, and source citations to support annotation decisions
Flag ambiguous, inconsistent, or out-of-scope samples and escalate with clear written explanations
Document annotation decisions consistently and reproducibly in line with project-specific guidelines
Required Qualifications
3+ years of professional experience in any domain requiring specialized expertise (e.g., law, medicine, engineering, finance, science, or similar)
Strong analytical and critical thinking skills with the ability to apply professional judgment to complex, nuanced content
Excellent written communication skills and ability to produce clear, structured, citation-supported annotations
Ability to work independently, follow detailed guidelines, and maintain high accuracy across large volumes of review tasks
Preferred Qualifications
Prior experience with data annotation, content review, or AI model evaluation workflows
Familiarity with annotation platforms and structured labeling tools
Advanced degree or professional certification in a relevant domain
Experience producing structured written analyses, legal memos, research reports, or technical documentation in a professional setting
Company Description
AfterQuery is a research lab investigating the boundaries of artificial intelligence through novel datasets and experimentation. We're backed by top investors, including Y Combinator and Box Group, and support all leading AI labs.