Remote AI jobs Canada on Rex.zone focus on practical AI/ML training workflows—data labeling, RLHF, prompt evaluation, and QA evaluation used to improve large language models and multimodal systems. You will help turn raw text, images, audio, and conversations into high-quality training data and structured evaluations for real production pipelines.

What You’ll Work On

1. Training data quality checks for text, image, and multimodal datasets
2. RLHF: ranking model outputs, preference labeling, rubric-based evaluation
3. Prompt evaluation and response grading for helpfulness, correctness, and safety
4. Named entity recognition (NER) and span-level annotation for NLP pipelines
5. Computer vision annotation (bounding boxes, polygons, keypoints) plus QA review
6. Content safety labeling for policy compliance and risk reduction
7. Error analysis and reporting to improve guidelines and reduce rework
8. 
   

Responsibilities

1. Follow annotation guidelines and document edge cases clearly
2. Perform QA evaluation, resolve disagreements, and calibrate with reviewers
3. Track labeling accuracy, throughput, and rework rates to protect data integrity
4. Provide structured feedback on prompts, rubrics, and evaluation metrics
5. Maintain privacy and security standards when handling sensitive content
6. Contribute to continuous improvement for LLM training pipelines and evaluation sets
7. 
   

Required Qualifications

1. 3+ years in AI data operations, data labeling, QA, or model evaluation
2. Experience with RLHF-style preference data or prompt evaluation workflows
3. Strong attention to detail and ability to apply rubrics consistently
4. Comfort with ambiguous language tasks and iterative guideline updates
5. Familiarity with NLP concepts (tokenization, entities, intent) or CV concepts (boxes, segmentation)
6. Clear communication of findings to engineering and project leads
7. 
   

Nice to Have

1. Experience with content safety labeling and policy-based evaluations
2. Experience measuring inter-annotator agreement and improving calibration
3. Exposure to production QA systems, audit sampling, and escalation workflows
4. 
   

Compensation

Competitive hourly rate: $30–$50/hour (USD), based on experience and project fit.

Desired Skills and Experience

RLHF, Data Labeling, QA Evaluation, Prompt Evaluation, Named Entity Recognition, Computer Vision Annotation, Content Safety Labeling, LLM Training Pipelines, Annotation Guidelines, Error Analysis

Are you looking for remote jobs near your area? At Yulys, thousands of employers are looking for exceptional talent like yours. Find a perfect job now.