AI Trainer (Contractor), Voice and Speech Evaluation - USA
This is contributor work, not a staff role. Inworld AI engages this by the task, shift or project. It is on this board because domain-expert AI training and evaluation is part of this discipline, and it is marked because pay, hours and security of the engagement are not comparable with the staff listings alongside it. Read the employer's own terms before applying.
The role
About Inworld
Inworld is a research lab and inference provider focused on realtime AI for consumer-facing applications. We build first-party speech models, serve LLMs, and run the inference behind modular APIs designed for high-volume, realtime workloads.
Hundreds of millions of users interact with Inworld powered apps every day and we serve over 10 trillion LLM tokens per month. Our models and infrastructure support consumer applications across companions, healthcare, fitness, education, media, and more. Our work spans model research, realtime inference, large-scale serving infrastructure, and the APIs developers use to bring these capabilities into production.
We’ve raised more than $125M from Lightspeed Venture Partners, Section 32, Kleiner Perkins, Microsoft’s M12 venture fund, Founders Fund, Meta, Stanford, and others. Our technology has powered experiences from companies including NVIDIA, Microsoft Xbox, Niantic, Logitech Streamlabs, Wishroll, Little Umbrella, and Bible Chat. Inworld has also been recognized by CB Insights as one of the 100 most promising AI companies globally and named one of LinkedIn’s Top 10 Startups in the USA.
What you'll do
Listen to paired or grouped speech samples and judge which sounds more natural, expressive, or faithful to instructions
Score voices against rubrics for naturalness, clarity, emotion, pacing, and delivery style
Label voice attributes such as perceived gender, age, accent or dialect, and tone, and flag mismatches with existing metadata
Judge how closely cloned voices match their source speaker
Review batches of new voices for audio quality and suitability before public release
Test new speech features in pre-release environments and report bugs, edge cases, and usability issues
Write clear, structured findings that engineers can act on
For multilingual roles: evaluate pronunciation, dialect accuracy, and naturalness in your native language
What we're looking for
A trained ear. Background in audio production, broadcast, voice acting, music, linguistics, phonetics, or similar
Ability to hear and describe subtle differences in prosody, timing, pronunciation, and audio quality
Consistent, careful judgment across large batches of similar samples
Comfort with beta web tools, VPN access, and spreadsheets, and willingness to troubleshoot minor access issues
Strong written English for reporting findings
Ability to turn tasks around within a day when needed, including occasional weekend availability
Nice to have
Native or near-native fluency in Hindi, Tamil, Telugu, Bengali, Marathi, Brazilian Portuguese, or a regional Spanish dialect
Experience with TTS, voice AI, dubbing, or localization QA
Familiarity with A/B evaluation or annotation work
Location: Remote within the United States.
Compensation: $20-$55 per hour. Rate depends on region and language specialty.
Published by Inworld AI on their own careers page and reproduced here unedited. Read it at Inworld AI.
Apply at Inworld AI → Applications go directly to Inworld AI. This board does not sit in between, take a fee from you, or see your application.
What this listing does not tell you
Listed 14 days, which is recent for this board. Of the 213 evals and benchmarks roles this board has watched from listing to removal, 16% were gone from their employer's careers page by day 14, and the median came down after 66 days. That is a description of other listings that have already ended, not a prediction about this one: this board records when a listing disappears, never why, and a posting still up is not on a clock it can see.
Inworld AI has 6 roles open on this board, 6 of them in evals and benchmarks.
Free. One email on Thursdays.