Software Engineer

Baseten powers mission-critical inference for AI companies like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. The company recently raised a $1.5B Series F led by Altimeter Capital, Conviction Partners, and Spark Capital.

We're looking for a customer-obsessed software engineer to ship features like multi-node training and serverless reinforcement learning (RL) from conception to MVP and GA. You'll work through the stack, architecting solutions from API and UI down to the infrastructure layer, and fine-tune models yourself to understand user workflows.

• Checkpointing Pipeline: Automated checkpointing that backs up model versions to the cloud and enables point-and-click deployment into inference servers like vLLM.
• Multinode Training: Run training jobs across multiple compute nodes for large models like GLM 4.7 and DeepSeek, built deeply at the Kubernetes layer.
• Training DX: Enhanced metrics from pod-level GPU summaries to per-GPU and per-Node, plus CLI and UI experiences for managing training jobs.

• Design ergonomic APIs and abstractions for complex resources and lifecycles.
• Work throughout the stack (API, backend, database, infra; frontend is a plus).
• Fine-tune and deploy models to develop intuition around training workflows.
• Partner with model developers and research engineers on post-training workflows.
• Drive long-term reliability and velocity improvements; fix bugs and resolve customer issues.

• 5+ years experience building software applications.
• Deep knowledge of the web stack, databases, and distributed systems.
• Experience developing developer tooling or infrastructure products.
• Good taste in product, particularly developer-oriented tools.
• Interest in ML/AI infrastructure and willingness to learn.
• High agency, ownership, and strong communication skills.

• Experience with release cycles (MVP, Beta, GA).
• Model development methods: Supervised Fine-Tuning, Reinforcement Learning, Synthetic Data Generation, LoRA, Full Finetunes.
• Familiarity with open source training stack: NCCL, PyTorch, Megatron, NemoRL, VeRL, Axolotl, HF Trainer; distributed training: FSDP, DeepSpeed.
• Experience developing AI products, tooling, or agents; frontend fluency.

Salary range: $165K – $330K USD, plus equity. Benefits include 100% coverage of medical, dental, and vision insurance for employee and dependents, flexible PTO with company-wide Winter Break, paid parental leave, fertility and family-building stipend (U.S. only), company-facilitated 401(k), and exposure to ML startups.

Apply via the Ashby application link.