AI Voice Evaluation Specialist - 3 month contract
💰 $20 – $25/hr
At a glance
- Who can apply
- Canada, United States
- Work arrangement
- Remote · Remote - Canada
- Employment type
- Contract
- Salary
- $20 – $25/hr · published by the employer
Checked against the employer's source on November 20, 2026. Details come from the employer's posting; confirm them on the application page.
Advertisement
Put your brand in front of 300,000+ monthly visitors worldwide
Job Description
Innodata is a global data engineering company supplying data, AI evaluation frameworks and human expertise for AI builders. This 3-month remote contract role has the candidate evaluate and compare two AI voice models through live spoken conversations.
- Role-play a natural voice conversation with an assigned scenario across two different AI models.
- Hold comparable conversations with Model A and Model B, keeping scenario and approach as consistent as possible.
- Keep the number of conversational turns roughly equal for each model to support a fair comparison.
- Record your voice during each interaction and closely watch the quality and behavior of model responses.
- Score each model across five defined evaluation dimensions.
- Identify and categorize error clusters that may appear in the audio or conversation.
- Choose the model with stronger overall performance under the evaluation framework.
- Write a detailed rationale for your preference, citing specific examples from both conversations.
- Apply the evaluation guidelines consistently across scenarios and model interactions.
Summary of Innodata Inc.'s posting by JobsRemoteList. Read the full details and apply on the employer's site.
Requirements
- Bachelor's degree.
- Strong attention to detail and ability to notice subtle differences in conversational quality.
- Excellent listening and comprehension skills.
- Strong written communication, explaining observations clearly and objectively.
- Ability to consistently follow detailed evaluation guidelines.
- Comfortable speaking naturally and role-playing varied conversational scenarios.
- Able to compare two interactions fairly without personal preferences influencing judgment.
- Strong critical-thinking and analytical skills.
- Reliability and consistency on structured evaluation tasks.
- Familiarity with AI assistants, voice-based AI, or conversational systems is preferred.
Benefits
- Hourly pay of $20-$25 CAD per hour, based on experience, skills, and qualifications.
- Contract is 3 months, W2, full-time at 40 hours per week.
Advertisement
Put your brand in front of 300,000+ monthly visitors worldwide
Related Jobs
Find more than a single listing
Discover more jobs
Join now and find your dream job or a higher-paying opportunity with better employer visibility, stronger internal discovery and easier access to worldwide hiring signals.
Discover hidden jobs
Surface roles you may miss on noisier boards and move through cleaner employer links and better intent pages.
Head start against the competition
See fresh roles, related pages, salary context and company signals faster so you can apply earlier and better.
10,000+ more jobs than narrower job boards
Explore remote, hybrid and location-based opportunities across worldwide markets instead of relying on one narrow inventory.
Worldwide opportunity coverage
Use region pages, country-eligibility pages and skill pages built for global job seekers, not just one market.
Social proof
Trusted by professionals
“There are good vacancies, but availability varies depending on the region.”
Giulia Romano
Recruiter · 🇮🇹 Italy
“I found an international opportunity that closely matched my experience.”
Tunde Adeyemi
Data Engineer · 🇳🇬 Nigeria
“I found several relevant roles and the vacancy pages were easy to understand.”
Nur Aisyah
MEAL Coordinator · 🇲🇾 Malaysia