Director, Research - AI Evals

Figma is on a mission to make design accessible to all. Its platform helps teams bring ideas to life, from brainstorming to prototyping to code, with AI capabilities.

Figma's Research team is hiring a Director, Research - AI Evals to own how Figma measures the quality of its AI-powered experiences. This role defines what 'good' means for AI features, builds evaluation frameworks and quality bars, and turns results into trusted signal for product teams.

• Own AI evaluation methods and operations for Figma's AI-powered experiences.
• Build and maintain evaluation frameworks, rubrics, golden datasets, and quality bars, combining human evaluation with automated/model-based approaches (e.g., LLM-as-judge).
• Partner with engineering to stand up repeatable evaluation pipelines and regression testing.
• Produce clear readouts and dashboards for go/no-go and prioritization decisions.
• Socialize a shared definition of quality and advocate for evaluation as a strategic partner.
• Manage a small team to execute AI evals in partnership with contractors, internal staff, and/or LLMs.

• 10+ years of experience in product, research, applied research, or related field, including 2+ years of management.
• Direct, hands-on experience owning evaluation of AI/LLM-powered products.
• Expertise in designing and running AI evaluation, including human evaluation programs, rubric and benchmark construction, inter-rater reliability, and judgment on automated/model-based approaches.
• Strength in qualitative and quantitative methods, comfort with data and metrics, and ability to reason about model behavior.
• Proven track record of gaining buy-in from executive and cross-disciplinary stakeholders.
• Bonus: experience building automated evaluation pipelines, familiarity with eval tooling (e.g., Braintrust, LangSmith, DeepEval), experience standing up a new function, 2+ years in product design, user-centric product management, data science, product development, or front-end engineering, and familiarity with Figma's products.

Annual base salary range: $258,000—$348,000 USD. Figma offers equity and a competitive benefits package.

Health, dental, and vision coverage; retirement benefits with company contributions; parental leave and reproductive/family planning support; mental health and wellness benefits; paid time off, including flexible PTO for exempt employees; paid sick leave and holidays; annual bonus plan for eligible non-sales roles.