US, WA, Seattle
Sr Scientist, Agentic AI, AWS Governance
Source verified: this exact posting was present on Amazon’s careers feed on . View employer source →
What the posting asks for
- Names
- Python
- Doctorate
- Mentioned, without saying whether it is needed
Read out of the employer's own description. Absence means the posting does not say, not that the answer is no.
The role
Are you passionate about transforming complex technical challenges into elegant, automated solutions that empower customers to leverage innovative technology? Do you thrive on building highly scalable systems that process massive amounts of data and deliver actionable insights through advanced analytics, machine learning, and AI assisted learning?
Our mission: Every action - human or agent is recorded, assessed, and provably governed. Continuously and anywhere. Automatically. At any scale.
We are looking for a strong Applied Scientist for new features and services that will allow our customers to fine-tune Natural Language Inference (NLI) model, framework decomposition, and evidence auto-linking that produce every customer-visible compliance verdict.
About the team
Our team is leading AI/ML research and development in the security and governance space. We use state-of-the-art science and engineering practices to provide continuous compliance and risk analysis, and we move fast to implement solutions and refine them based on customer feedback. Our team is adding additional focus on next-generation capabilities including AI-assisted development workflows, observability/governance for AI agents, and advanced analytics. This role will allow you to drive executive alignment and technical innovation.
- Experience programming in Java, C++, Python or related language
- 5+ years of building machine learning models for business application experience
- Demonstrated experience with generative AI and LLMs — fine-tuning, prompting, retrieval, or post-training.
- Experience designing evaluation frameworks for open-ended or subjective tasks where ground truth is expensive or unavailable, including synthetic data generation.
- Experience with agentic and multi-turn systems, including RL-based post-training (RLHF/RLAIF/GRPO or similar), environment simulation, or agent harness evaluation.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
USA, WA, Seattle - 167,100.00 - 226,100.00 USD annually
Our mission: Every action - human or agent is recorded, assessed, and provably governed. Continuously and anywhere. Automatically. At any scale.
We are looking for a strong Applied Scientist for new features and services that will allow our customers to fine-tune Natural Language Inference (NLI) model, framework decomposition, and evidence auto-linking that produce every customer-visible compliance verdict.
About the team
Our team is leading AI/ML research and development in the security and governance space. We use state-of-the-art science and engineering practices to provide continuous compliance and risk analysis, and we move fast to implement solutions and refine them based on customer feedback. Our team is adding additional focus on next-generation capabilities including AI-assisted development workflows, observability/governance for AI agents, and advanced analytics. This role will allow you to drive executive alignment and technical innovation.
Basic qualifications
- PhD, or Master's degree and 6+ years of applied research experience- Experience programming in Java, C++, Python or related language
- 5+ years of building machine learning models for business application experience
Preferred qualifications
- Experience in automation or monitoring frameworks, deployment or development- Demonstrated experience with generative AI and LLMs — fine-tuning, prompting, retrieval, or post-training.
- Experience designing evaluation frameworks for open-ended or subjective tasks where ground truth is expensive or unavailable, including synthetic data generation.
- Experience with agentic and multi-turn systems, including RL-based post-training (RLHF/RLAIF/GRPO or similar), environment simulation, or agent harness evaluation.
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.
USA, WA, Seattle - 167,100.00 - 226,100.00 USD annually
Published by Amazon on their own careers page and reproduced here unedited. Read it at Amazon.
Apply at Amazon → Applications go directly to Amazon. This board does not sit in between, take a fee from you, or see your application.
What this listing does not tell you
Listed 18 days. Of the 213 evals and benchmarks roles this board has watched from listing to removal, 20% were gone from their employer's careers page by day 18, and the median came down after 66 days. That is a description of other listings that have already ended, not a prediction about this one: this board records when a listing disappears, never why, and a posting still up is not on a clock it can see.
Pay is not confirmed for this role. Check the employer’s posting for current compensation. Explore published bands from other roles →
Amazon has 35 roles open on this board, 12 of them in evals and benchmarks. 1 of those does publish a band, which you can compare; pay can differ by role and location.
Get the weekly AI Evals Jobs briefNew roles and board updates, with published pay where available. This is the general weekly brief. Or browse them all now.
Free. One email on Thursdays.
More roles like this
Matched by discipline, title, listed location and work arrangement.
Same discipline: Evals & Benchmarks · Both have senior titles · Shared listed location
US, WA, Seattle
Same discipline: Evals & Benchmarks · Shared listed location
Tel Aviv, Israel
Same discipline: Evals & Benchmarks · Both have senior titles
Cupertino, CA
Same discipline: Evals & Benchmarks · Both have senior titles
San Francisco · New York City$180k – $500k+ equity
Same discipline: Evals & Benchmarks · Both have senior titles