Seattle, WA
Senior Data Scientist, Data Quality and AI Evaluation
What the posting asks for
- Names
- SQL, Python
- Doctorate
- Not mentioned
- Experience
- 12+ years asked for
Read out of the employer's own description. Absence means the posting does not say, not that the answer is no.
The role
At NVIDIA, we are building the next generation AI-native autonomous driving architecture — combining classical safety stacks, foundation models, and scalable AI systems into a unified production platform. Autonomous driving is entering a new era. Future AV systems will not be purely classical robotics stacks, nor purely end-to-end neural networks. The future lies in the deep integration of classical safety architectures and large-scale AI-driven systems. If you want to work on problems that build the future of autonomous systems over the next decade, this is the place.
What You’ll Be Doing
- Define quality metrics and evaluation methods that reveal where auto-labeling pipelines succeed, fail, or regress.
- Build and maintain human-verified golden datasets covering representative driving conditions, critical corner cases, historical failures, and new requirements.
- Analyze large-scale sensor, camera and annotation data to identify root causes, discover systematic errors, and prioritize improvements with perception and auto-labeling engineers.
- Develop automated approaches for failure clustering, similar-case discovery, and targeted selection of data for human correction.
- Build statistically sound audits and experiments, establish release acceptance criteria, and communicate findings through clear dashboards and recommendations.
- Partner with labeling operations to improve annotation guidelines, reviewer consistency, and the balance between quality, efficiency, and cost.
What We Need To See
- Great foundations in statistics, experimental design, sampling, hypothesis testing, and uncertainty estimation, with practical experience evaluating machine learning systems and data quality.
- Experience working on AI/LLM evaluation with proficiency in Python and SQL, including analyzing large datasets and building reproducible analytical workflows. Understanding of precision, recall, class imbalance, selection bias, data leakage, and evaluation across significant scenario groups.
- Ability to distinguish reference-label defects from model errors and translate ambiguous quality concerns into measurable questions and actionable recommendations.
- Strong communication and teamwork skills, with experience working across engineering, research, product, or operations teams.
- 12+ years of industry experience with Bachelor degree or proven track record for Master in statistics, mathematics, computer science, engineering, or a related quantitative field, or equivalent experience in practice.
Ways To Stand Out from the Crowd:
- Background with autonomous driving, robotics, or computer vision, particularly camera and LiDAR data, 2D/3D annotations, multi-object tracking, occupancy, or temporal and cross-sensor consistency.
- Experience designing human-in-the-loop labeling and audit workflows, measuring annotator agreement, or maintaining versioned benchmarks with protected evaluation sets.
#AutonomousVehicles
Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are:224,000 USD – 356,500 USD for Level 5; and 272,000 USD – 431,250 USD for Level 6.
You will also be eligible for equity and benefits.
Applications for this job will be accepted at least until November 3, 2026.This posting is for an existing vacancy.
NVIDIA uses AI tools in its recruiting processes.
NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.Published by NVIDIA on their own careers page and reproduced here unedited. Read it at NVIDIA.
Apply at NVIDIA → Applications go directly to NVIDIA. This board does not sit in between, take a fee from you, or see your application.
What this listing does not tell you
Listed 11 days, which is recent for this board. Of the 213 evals and benchmarks roles this board has watched from listing to removal, 14% were gone from their employer's careers page by day 11, and the median came down after 66 days. That is a description of other listings that have already ended, not a prediction about this one: this board records when a listing disappears, never why, and a posting still up is not on a clock it can see.
Pay is not confirmed for this role. Check the employer’s posting for current compensation. Explore published bands from other roles →
NVIDIA has 33 roles open on this board, 12 of them in evals and benchmarks. 1 of those does publish a band, which you can compare; pay can differ by role and location.
Free. One email on Thursdays.
More roles like this
Matched by discipline, title, listed location and work arrangement.
Same discipline: Evals & Benchmarks · Both have senior titles
London
Same discipline: Evals & Benchmarks · Both have senior titles
US, CA, Santa Clara
Same discipline: Evals & Benchmarks · Shared listed location
United States$250k – $350k on-target+ equity
Same discipline: Evals & Benchmarks · Both have senior titles
Cupertino, CA
Same discipline: Evals & Benchmarks · Both have senior titles