AI Voice Evaluation Specialist

Innodata (Nasdaq: INOD) is a global data engineering company. We believe that data and Artificial Intelligence (AI) are inextricably linked. Our mission is to enable the responsible advancement of artificial intelligence by providing the data, evaluation frameworks, and human expertise required to build AI systems that can be trusted at scale. We provide a range of transferable solutions, platforms, and services for Generative AI / AI builders and adopters. In every relationship, we honor our 36+ year legacy delivering the highest quality data and outstanding outcomes for our customers. We are looking for detail-oriented Voice Specialists to evaluate the performance of AI models through real-time, voice-based conversations. In this role, you will interact with two different AI models using the same assigned scenario, carefully compare their responses, and provide structured evaluations based on defined quality criteria.
Review an assigned scenario and roleplay a natural conversation with two different AI models .
Record your voice during each interaction and pay close attention to the quality and behavior of the model's responses.
Identify and categorize relevant error clusters that may occur in the audio or conversation.
Compare the performance of Model A and Model B based on the evaluation criteria and your observations.
Select the model that demonstrated the stronger overall performance according to the defined evaluation framework.
Bachelors Degree
Strong attention to detail and ability to notice subtle differences in conversational quality.
Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation.
Reliability and consistency when completing structured evaluation tasks.
Familiarity with AI assistants, voice-based AI, or conversational systems
The expected hourly salary range for this position is $20-$25 p/hour, based on experience, skills, and qualifications.
Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. com and consider reporting it to the FTC at ReportFraud.ftc.gov .