Head of Delivery
Morpheus Talent Solutions · New York, New York, United States
FULL TIMEpermanent
Job Description
Head of Delivery, Human Data & Creative AI EvaluationSalary: $200k - $250k + bonusLocation: New York or SF - HybridFull-time
Scroll down for a complete overview of what this job will require Are you the right candidate for this opportunity
Morpheus are partnered with a frontier human data and evaluation lab for creative AI, backed by top-tier VCs. They draw on a network of over a million independent creatives to run expert evaluation, preference data, benchmarking and RL environment work across design and creative domains, where expert judgment is the product. They work with leading AI labs and creative-tool companies.
The roleAs Head of Delivery, you will own delivery across every client project and lead a team of Strategic Project Leads. You will set how projects are scoped, staffed, reported and measured, and you will be the person clients rely on when delivery needs attention.
This is a player-coach seat. Early on, you will also run one or two of the most complex accounts yourself, with direct access to the Head of the Lab.
What you’ll doLead, hire and coach the Strategic Project Lead team, and decide how they are staffed across accountsOwn on-time, high-quality delivery across expert evaluation, annotation and benchmarking projectsBuild and run a consistent operating cadence, including weekly delivery reports and monthly forecasts for every clientReview handling-time estimates and cost models before they go into proposalsWrite and maintain SOPs for expert onboarding, calibration, quality review and paymentsTrack and improve portfolio metrics: quality and rater agreement, on-time delivery, handling time against estimate, and marginAct as the escalation point for client delivery issuesPartner with research on methodology and with engineering on tooling
What you bring5+ years in operationally intensive roles, including time at a human data or AI training data company (think Scale AI, Surge AI, Mercor, Handshake AI, Turing xzbcwsv or Snorkel)2+ years managing peopleExperience running multiple client projects at once, not only a single projectWorking knowledge of annotation quality: rubric design, calibration and inter-rater agreementAbility to build a cost model from handling times and ratesComfort working directly with research teams at AI labs
Nice to haveCreative or design domain experience, or experience with subjective and taste-based evaluationA background in consulting, banking or marketplace operationsExperience building operating processes from scratch in an early-stage team
Scroll down for a complete overview of what this job will require Are you the right candidate for this opportunity
Morpheus are partnered with a frontier human data and evaluation lab for creative AI, backed by top-tier VCs. They draw on a network of over a million independent creatives to run expert evaluation, preference data, benchmarking and RL environment work across design and creative domains, where expert judgment is the product. They work with leading AI labs and creative-tool companies.
The roleAs Head of Delivery, you will own delivery across every client project and lead a team of Strategic Project Leads. You will set how projects are scoped, staffed, reported and measured, and you will be the person clients rely on when delivery needs attention.
This is a player-coach seat. Early on, you will also run one or two of the most complex accounts yourself, with direct access to the Head of the Lab.
What you’ll doLead, hire and coach the Strategic Project Lead team, and decide how they are staffed across accountsOwn on-time, high-quality delivery across expert evaluation, annotation and benchmarking projectsBuild and run a consistent operating cadence, including weekly delivery reports and monthly forecasts for every clientReview handling-time estimates and cost models before they go into proposalsWrite and maintain SOPs for expert onboarding, calibration, quality review and paymentsTrack and improve portfolio metrics: quality and rater agreement, on-time delivery, handling time against estimate, and marginAct as the escalation point for client delivery issuesPartner with research on methodology and with engineering on tooling
What you bring5+ years in operationally intensive roles, including time at a human data or AI training data company (think Scale AI, Surge AI, Mercor, Handshake AI, Turing xzbcwsv or Snorkel)2+ years managing peopleExperience running multiple client projects at once, not only a single projectWorking knowledge of annotation quality: rubric design, calibration and inter-rater agreementAbility to build a cost model from handling times and ratesComfort working directly with research teams at AI labs
Nice to haveCreative or design domain experience, or experience with subjective and taste-based evaluationA background in consulting, banking or marketplace operationsExperience building operating processes from scratch in an early-stage team
Details
| Company | Morpheus Talent Solutions |
| Location | New York, New York, United States |
| Type | FULL TIME |
| Niche | hr |
| Experience | permanent |