Machine Learning Engineer II, Visual AI

Pinterest is a visual discovery platform where millions of people find creative ideas. The Pinterest Labs group focuses on applied machine learning, including computer vision, multimodal LLMs, and generative modeling. The visual modeling team is seeking a Machine Learning Engineer II to work on vision-centric LLMs, building VLMs for multimodal search and text-to-image models.

• Prototype new model architectures for Pinterest VLMs, including fine-tuning open-source LLMs to improve visual perception and tool use.
• Develop evaluation benchmarks for vision-centric capabilities like fashion style recommendations.
• Read research papers, participate in group discussions, and contribute to the visual generative strategy.
• Help collect visual training data for Pinterest Canvas, including RLHF and targeted fine-tuning.
• Publish work via conferences, papers, and blog posts.

• Experience with generative computer vision models, visual encoders, and LLMs.
• 2+ years of industry computer vision experience.
• M.S. or PhD in Machine Learning, Computer Science, or related fields.
• Nice to have: publications at top ML conferences, experience with AI coding assistants, and familiarity with LLM-powered productivity tools.

Base salary range: $138,905—$285,982 USD, plus equity.

Hybrid - US, with in-office collaboration 1-2 times/quarter. US-based applicants only.