AI EvalsJobs
Hiring?
All roles / Physical Intelligence / Software Engineer, Data Quality

Software Engineer, Data Quality

Human Data & Annotation6w ago
Source verified: this exact posting was present on Physical Intelligence’s careers feed on . View employer source →

What the posting asks for

Experience
5+ years asked for

Read out of the employer's own description. Absence means the posting does not say, not that the answer is no.

The role

Physical Intelligence is bringing general-purpose AI into the physical world. We are a group of engineers, scientists, roboticists, and company builders developing learning algorithms to create a model that will control any robot to do any task.

The Team

Training robot foundation models takes enormous amounts of multimodal data. The Data Operations team makes sure that data is high quality, well understood, and safe to train on. This role owns quality assurance and audit for data, working closely with the researchers who consume it and the teams who create it.

In This Role You Will

  • Own external data QA & audit: Build and run the end-to-end QA process for multimodal data ingested from third-party vendors and partners — sampling strategy, review workflows, pass/fail decisions, and audit trails — so data is verified before it reaches training.

  • Define quality standards: Partner with researchers to translate what "good data" means into concrete, measurable rubrics and acceptance criteria; keep them versioned and current as research needs evolve.

  • Build the system: Build the software interfaces, tooling, and infrastructure scale the system in an automated way - correctly sampling the right data for QA, internal QA checks, tracking dips in data quality from vendors and exposing those insights back to the vendors.

  • Manage vendor quality loops: Deliver structured, actionable feedback to vendors; coach them on standing up QA checks on their own side; iterate until vendor-side and internal QA agree; enforce standards through review and acceptance processes.

What you'll bring

  • ~5 years of experience across building customer facing software.

  • Vendor management experience: working directly with third-party data providers, delivering actionable feedback, and measurably improving the quality of their output.

  • Strong ops acumen and drive — a bias to instrument, measure, and iterate quickly rather than crank hours at a broken process.

  • Comfort being hands-on in the data: reviewing samples yourself, writing and refining rubrics, and spot-checking your own program's output.

  • Clear written and verbal communication across researchers, operations teams, and external partners.

Nice to have

  • Experience with robotics, egocentric video, or other multimodal sensor data.

  • Experience defining requirements for QA/validation tooling or working with engineers on automated data quality checks.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

Published by Physical Intelligence on their own careers page and reproduced here unedited. Read it at Physical Intelligence.

Apply at Physical Intelligence → Applications go directly to Physical Intelligence. This board does not sit in between, take a fee from you, or see your application.

What this listing does not tell you

Listed 45 days. Of the 111 human data roles this board has watched from listing to removal, 37% were gone from their employer's careers page by day 45, and the median came down after 84 days. That is a description of other listings that have already ended, not a prediction about this one: this board records when a listing disappears, never why, and a posting still up is not on a clock it can see.

Pay is not confirmed for this role. Check the employer’s posting for current compensation. Explore published bands from other roles →

Physical Intelligence has 2 roles open on this board, 2 of them in human data.

Get the weekly AI Evals Jobs briefNew roles and board updates, with published pay where available. This is the general weekly brief. Or browse them all now.

More roles like this

Matched by discipline, title, listed location and work arrangement.

Same discipline: Human Data & Annotation · Shared listed location

Same discipline: Human Data & Annotation · Shared listed location

Same discipline: Human Data & Annotation · Shared listed location

Same discipline: Human Data & Annotation · Shared listed location

Same discipline: Human Data & Annotation · Shared listed location

Privacy · Terms