JobsRemoteList
Baseten logo

Product Manager, Inference Platform

Baseten·November 18, 2026·
🌍 Hybrid · RemoteOpen to: United StatesFull-timeProduct Management

💰 $130,000 – $190,000/yrMarket estimate · not provided by the employer

At a glance

Who can apply
United States
Work arrangement
Hybrid · Remote
Employment type
Full-time
Salary
$130,000 – $190,000/yr · market estimate

Checked against the employer's source on November 20, 2026. Details come from the employer's posting; confirm them on the application page.

Advertisement

Put your brand in front of 300,000+ monthly visitors worldwide

Advertise here →

Job Description

Baseten provides inference infrastructure for AI companies and is building a cloud combining inference, training, and agent execution. This role makes inference faster and cheaper, turning runtime optimizations into customer-ready product capabilities.

  • Work with inference engineering and research teams to bring new performance capabilities to customers.
  • Turn advances in batching, caching, quantization, speculative decoding, and serving architectures into product features.
  • Define benchmarks and evaluations that show gains in latency, throughput, quality, and cost.
  • Understand customer workloads and help prioritize the optimizations with the greatest impact.
  • Make performance features easier to configure, evaluate, and adopt in production.
  • Help customers understand tradeoffs across hardware, model configurations, autoscaling, and routing.
  • Partner with engineering on release readiness, compatibility, and regression testing.

Summary of Baseten's posting by JobsRemoteList. Read the full details and apply on the employer's site.

Requirements

  • Experience building and shipping AI/ML products or infrastructure where performance, scalability, or production behavior mattered.
  • Technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
  • Strong understanding of model serving architectures, GPU economics, and latency, throughput, quality, and cost tradeoffs.
  • Experience working closely with researchers or infrastructure engineers to bring complex capabilities into production.
  • Rigorous approach to benchmarking, experimentation, and performance measurement.
  • Strong product judgment and ability to translate deep technical work into clear customer value.
  • Nice to have: hands-on experience with PyTorch, vLLM, TensorRT-LLM, SGLang, NVIDIA Dynamo, or similar technologies.
  • Nice to have: experience with open-source inference projects, model optimization, or ML systems research.

Benefits

  • Competitive compensation, including meaningful equity (U.S. only).
  • 100% coverage of medical, dental, and vision insurance for employee and dependents.
  • Flexible PTO policy, including company-wide Winter Break with offices closed from Christmas Eve to New Year's Day.
  • Paid parental leave.
  • Fertility and family-building stipend through Carrot (U.S. only).
  • Company-facilitated 401(k).

Advertisement

Put your brand in front of 300,000+ monthly visitors worldwide

Advertise here →

More openings for this role: 473 remote Product Manager jobs · vagas de Gerente de Produto para o Brasil

Find more than a single listing

Discover more jobs

Join now and find your dream job or a higher-paying opportunity with better employer visibility, stronger internal discovery and easier access to worldwide hiring signals.

🔎

Discover hidden jobs

Surface roles you may miss on noisier boards and move through cleaner employer links and better intent pages.

🚀

Head start against the competition

See fresh roles, related pages, salary context and company signals faster so you can apply earlier and better.

📈

10,000+ more jobs than narrower job boards

Explore remote, hybrid and location-based opportunities across worldwide markets instead of relying on one narrow inventory.

🌍

Worldwide opportunity coverage

Use region pages, country-eligibility pages and skill pages built for global job seekers, not just one market.

Social proof

Trusted by professionals

Read more reviews →
★★★★★

“I would like more frequent updates and more junior-level vacancies.”

Elsa Lindberg

Product Manager · 🇸🇪 Sweden

★★★★★

“A simple and practical platform for finding quality remote vacancies.”

Neema Mushi

QA Engineer · 🇹🇿 Tanzania

★★★★★

“JobsRemoteList made it easy to discover relevant remote roles and apply directly.”

Nusrat Jahan

Recruiter · 🇧🇩 Bangladesh