Job Details

This role is for one of our clients

Compensation: $80-$90 per hour

We are looking for experienced professionals in law, investment banking, consulting, or medicine to help enhance the performance of advanced language models. This role involves applying your domain expertise to evaluate and refine AI-generated outputs, ensuring clarity, accuracy, and consistency in professional contexts. You will contribute to shaping cutting-edge AI systems by crafting relevant prompts and reviewing responses.

Requirements

Key Responsibilities

• Develop domain-specific prompts that reflect real-world scenarios and use cases.
• Assess AI-generated responses for accuracy, clarity, professional tone, and formatting.
• Create expert-level reference “golden responses” to serve as benchmarks for model performance.
• Identify errors, inconsistencies, or stylistic deviations in AI outputs.
• Collaborate asynchronously with research teams to refine evaluation protocols and guidelines.

Ideal Qualifications

• 2+ years of professional experience in law, investment banking, consulting, or medicine.
• Strong familiarity with domain-specific writing standards, formatting, and communication norms.
• Excellent analytical and written communication skills.
• Detail-oriented with a commitment to high-quality outputs.
• Experience with prompt engineering or AI tools is a plus, but not mandatory.

Additional Details

• Remote and asynchronous role — work flexibly on your own schedule.
• Expected commitment: 10+ hours per week.
• Project duration: approximately 4 weeks, with potential for extension.