R Programmer for AI Evaluation
Location: Remote
Compensation: Piece Work
Reviewed: Wed, Apr 09, 2025
This job expires in: 18 days
Job Summary
A company is looking for an R Programmer for AI Chatbot Response Evaluations.
Key Responsibilities
- Audit annotator evaluations of AI-generated R code and data analysis tasks
- Verify correct application of rating rubrics for instruction-following and factual accuracy
- Test annotator-submitted R code to confirm functionality, reproducibility, and statistical correctness
Required Qualifications
- 7+ years of experience in R programming, statistical analysis, or data science QA
- Proficient in core R syntax, data manipulation (dplyr, tidyverse), visualization (ggplot2), and modeling
- Experience validating code logic, reproducibility, and statistical integrity
- Ability to assess instructional adherence and provide constructive written feedback
- English proficiency at C1 or C2
COMPLETE JOB DESCRIPTION
The job description is available to subscribers. Subscribe today to get the full benefits of a premium membership with Virtual Vocations. We offer the largest remote database online...
BECOME A PREMIUM MEMBER TO
UNLOCK FULL JOB DETAILS & APPLY
- ACCESS TO FULL JOB DETAILS AND APPLICATION INFORMATION
- HUMAN-SCREENED REMOTE JOBS AND EMPLOYERS
- COURSES, GROUP CAREER COACHING AND RESOURCE DOWNLOADS
- DISCOUNTED CAREER SERVICES, RESUME WRITING, 1:1 COACHING AND MORE
- EXCELLENT CUSTOMER SUPPORT FOR YOUR JOB SEARCH