Skip to main content

Distinguished Architect, AI

Datadog
Hybrid - New York, NY or San Francisco, CAUpdated 2d ago
Compensation
$330k–$440k
Published range · Top quartile for Engineering (451 listings)
Location
Hybrid - New York, NY or San Francisco, CA
Remote eligibility
Employment
Full-time
Staff / Principal
Role family
Engineering
Developer tools
Role skills
Apply on careers.datadoghq.com
Job actionsApply now
Job actionsApply now

About the job

Datadog is expanding the Technical Solutions (TS) organization by seeking a customer-focused, deeply technical Distinguished Architect to join our Product Solutions Architecture (PSA) team. In this role, you will act as a technical multiplier for the world's leading AI labs and AI-native companies, bridging the gap between their infrastructure aspirations and Datadog's technology roadmap. You will ensure our platform natively solves the unique observability challenges of training and deploying foundational models at scale.

What You'll Do

  • Demonstrate thought leadership in the AI/LLM space, influencing key decision makers.
  • Strategically partner with technical founders, heads of infrastructure, and research leads.
  • Lead deep-dive architecture reviews and design engagements with customer teams.
  • Identify emerging AI-native technology shifts and feed them back to Product Management.
  • Collaborate with PSA, Sales, Sales Engineering, and Marketing.
  • Assist in recruiting and hiring top talent.

Who You Are

  • 10+ years of experience with at-scale distributed systems, high-performance computing, or large-scale infrastructure.
  • Deep familiarity with the AI/LLM ecosystem, accelerator hardware (GPUs/TPUs), and modern orchestration frameworks.
  • Strategic thinker with strong stakeholder management skills.
  • Close-to-the-metal technologist with hands-on credibility.
  • Excellent presentation and communication skills.
  • Able to travel up to 50% of the time.
  • Bachelor's degree in engineering or related field, Master's preferred.

Benefits and Growth

  • Best-in-breed onboarding, generous global benefits, mentor and buddy program.
  • New hire stock equity (RSUs) and employee stock purchase plan (ESPP).
  • Continuous professional development, product training, and career pathing.
  • Inclusive company culture.

Datadog offers a competitive salary and equity package, including healthcare, dental, parental planning, mental health benefits, 401(k) plan and match, paid time off, fitness reimbursements, and discounted employee stock purchase plan. The reasonably estimated yearly salary for this role is $330,000—$440,000 USD.

Skills & tags

What you can verify before applying

Compare the essentials before you leave: pay, remote scope, employment type, source, and the employer apply destination.