Generalist - English
Job Description
Generalist - English ($45/hour)
Location: Geography restricted to US, UK, Canada
Type: Full-time or Part-time Contract Work
Fluent Language Skills Required: English
Role Responsibilities
- Evaluate LLM-generated responses on their ability to effectively answer user queries
- Conduct fact-checking using trusted public sources and external tools
- Generate high-quality human evaluation data by annotating response strengths, areas for improvement, and factual inaccuracies
- Assess reasoning quality, clarity, tone, and completeness of responses
- Ensure model responses align with expected conversational behavior and system guidelines
- Apply consistent annotations by following clear taxonomies, benchmarks, and detailed evaluation guidelines
Good Candidature
- Bachelor’s degree holder
- Significant experience using large language models (LLMs) and understand how and why people use them
- Excellent writing skills and can clearly articulate nuanced feedback
- Strong attention to detail and consistently notice subtle issues others may overlook
- Adaptable and comfortable moving across topics, domains, and customer requirements
- Background or experience in domains requiring structured analytical thinking (e.g., research, policy, analytics, linguistics, engineering)
- Excellent college-level mathematics skills
Nice-to-Have Specialties
- Prior experience with RLHF, model evaluation, or data annotation work
- Experience writing or editing high-quality written content
- Experience comparing multiple outputs and making fine-grained qualitative judgments
- Familiarity with evaluation rubrics, benchmarks, or quality scoring systems
How to Apply
Ready to start your career as a Generalist - English at Great Value Hiring?
- Click the "Apply Now" button below.
- Review the safety warning in the modal.
- You will be redirected to the employer's official portal to complete your application.
- Ensure your resume and cover letter are tailored to the job description using our AI tools.
Frequently Asked Questions
Who is hiring?▼
This role is with Great Value Hiring in Calgary.
Is this a remote position?▼
This appears to be an on-site role in Calgary.
What is the hiring process?▼
After you click "Apply Now", you will be redirected to the employer's official site to submit your resume. You can typically expect to hear back within 1-2 weeks if shortlisted.
How can I improve my application?▼
Tailor your resume to the specific job description. You can use our free Resume Analyzer to see how well you match the requirements.
What skills are needed?▼
Refer to the "Job Description" section above for a detailed list of required and preferred qualifications.