Interview Studio

Requirements found

Onboarding Negotiation Training (must) Sales (must) Recruiting

What this posting asks for

Level: Manager — The title says "Manager".

Main responsibilities

• Own the external evaluator program end to end, including our relationships with evaluator organizations and the pipeline of future partners
• Take each evaluator from first conversation through scoping, contracting, onboarding, access, and review to a published report
• Define the stages and tiers of working with evaluators, and develop information access policies that meet evaluators' needs while protecting security and con…
• Drive evaluators' access and information requests to fast, well-documented decisions in partnership with Research, Security, Legal, and IT
• Drive the technical design of evaluator access with Security, IT, and infrastructure teams, including permissions, environments, and monitoring, and close ga…
• Run the review process for evaluator reports against agreed timelines and redaction criteria, while protecting evaluators' ability to publish their own concl…
• Scope evaluations with researchers and engineers, turning evaluators' questions about training, monitoring, and alignment into concrete requirements for mode…
• Turn evaluators' technical findings into research and engineering work with owners and dates, and drive accountability for how Anthropic responds
• Keep the company informed with regular updates on how the program is going, and clear guidance on how to work with evaluators
• Collect feedback from evaluators and internal teams, run retrospectives, and iterate on policies and practices

Competencies an interviewer will look for

• Technical skill Core
  In the posting: “Turn evaluators' technical findings into research and engineering work with owners and dates, and drive accountability for how Anthropic responds” · “Use Claude and work with engineering teams to build the tooling the program runs on, such as access provisioning, request tracking, and report review” · “Experience leading complex technical programs with engineering or research teams, from ambiguous goals through delivery”
  Show it by: Names the tools, languages or systems used and how; Explains a technical choice and its trade-off.
• Communication Core
  In the posting: “You'll evolve our current time-intensive manual processes into a system that can support many evaluators at once, working with teams across Safety, Research,…” · “If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings.” · “As such, we greatly value communication skills.”
  Show it by: Adapts the message to the listener; Gives an example of explaining something clearly in writing or speech.
• Teamwork and collaboration Core
  In the posting: “You'll evolve our current time-intensive manual processes into a system that can support many evaluators at once, working with teams across Safety, Research,…” · “In some cases, we may partner with vetted recruiting agencies who will identify themselves as working on behalf of Anthropic.” · “We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time.”
  Show it by: Says what they did inside a team, not only what 'we' did; Shows how a disagreement was handled.
• Ownership and accountability Core
  In the posting: “Anthropic gives independent external evaluators access to our models, our people, and our safety practices so that they can assess risks, processes, and poli…” · “You'll be the main point of contact for our existing partners, deepening our support so that they can work effectively and produce high-quality, rigorous, in…” · “Own the external evaluator program end to end, including our relationships with evaluator organizations and the pipeline of future partners”
  Show it by: Takes a task from start to finish without being chased; Owns a mistake and what was changed after it.
• Planning and organisation Core
  In the posting: “You'll separately broaden the portfolio of organizations we are working with, managing the funnel from first conversation through contracting, onboarding, an…” · “Own the external evaluator program end to end, including our relationships with evaluator organizations and the pipeline of future partners” · “Scope evaluations with researchers and engineers, turning evaluators' questions about training, monitoring, and alignment into concrete requirements for mode…”
  Show it by: Shows how priorities were set when everything was urgent; Mentions deadlines met and how.
• Attention to detail and quality Core
  In the posting: “Anthropic gives independent external evaluators access to our models, our people, and our safety practices so that they can assess risks, processes, and poli…” · “You'll be the main point of contact for our existing partners, deepening our support so that they can work effectively and produce high-quality, rigorous, in…” · “You'll evolve our current time-intensive manual processes into a system that can support many evaluators at once, working with teams across Safety, Research,…”
  Show it by: Gives an example of an error caught before it caused harm; Names the check or standard they used.
• Stakeholder management Core
  In the posting: “You'll be the main point of contact for our existing partners, deepening our support so that they can work effectively and produce high-quality, rigorous, in…” · “Within six months, you should be able to take a new evaluator from contract negotiation to first published report with minimal involvement from senior leaders.” · “Own the external evaluator program end to end, including our relationships with evaluator organizations and the pipeline of future partners”
  Show it by: Shows how they aligned people with different goals; Explains how they handled a 'no' from someone senior.
• Problem solving Core
  In the posting: “You'll need the technical depth to work out with researchers and engineers what access, tooling, and evidence an evaluation requires, and the judgment to res…” · “Experience managing relationships with external organizations, including scoping work, navigating contracting, setting expectations, and resolving disagreements”
  Show it by: Describes a real problem, the options considered and the one chosen; Shows how the cause was found, not just the fix.
• Adaptability and learning Core
  In the posting: “Experience leading complex technical programs with engineering or research teams, from ambiguous goals through delivery” · “We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely…”
  Show it by: Describes learning something new quickly and using it; Shows a change of plan and how they adjusted.
• Customer focus Supporting
  In the posting: “You'll need the technical depth to work out with researchers and engineers what access, tooling, and evidence an evaluation requires, and the judgment to res…”
  Show it by: Puts the customer's need in their own words; Shows a result for the customer, not only for the company.
• Data and analysis Supporting
  In the posting: “Scope evaluations with researchers and engineers, turning evaluators' questions about training, monitoring, and alignment into concrete requirements for mode…”
  Show it by: Uses a number to describe the situation or the result; Explains what the data showed and what was done with it.

Read from the posting's own words by fixed rules — no AI service. Nothing you paste is sent anywhere or stored.