Product Manager, Inference Platform
💰 $130,000 – $190,000/yrMarket estimate · not provided by the employer
At a glance
- Who can apply
- United States
- Work arrangement
- Hybrid · Remote
- Employment type
- Full-time
- Salary
- $130,000 – $190,000/yr · market estimate
Checked against the employer's source on November 20, 2026. Details come from the employer's posting; confirm them on the application page.
Advertisement
Put your brand in front of 300,000+ monthly visitors worldwide
Job Description
Baseten provides inference infrastructure for AI companies and is building a cloud combining inference, training, and agent execution. This role makes inference faster and cheaper, turning runtime optimizations into customer-ready product capabilities.
- Work with inference engineering and research teams to bring new performance capabilities to customers.
- Turn advances in batching, caching, quantization, speculative decoding, and serving architectures into product features.
- Define benchmarks and evaluations that show gains in latency, throughput, quality, and cost.
- Understand customer workloads and help prioritize the optimizations with the greatest impact.
- Make performance features easier to configure, evaluate, and adopt in production.
- Help customers understand tradeoffs across hardware, model configurations, autoscaling, and routing.
- Partner with engineering on release readiness, compatibility, and regression testing.
Summary of Baseten's posting by JobsRemoteList. Read the full details and apply on the employer's site.
Requirements
- Experience building and shipping AI/ML products or infrastructure where performance, scalability, or production behavior mattered.
- Technical background in software engineering, ML engineering, research, or equivalent hands-on experience.
- Strong understanding of model serving architectures, GPU economics, and latency, throughput, quality, and cost tradeoffs.
- Experience working closely with researchers or infrastructure engineers to bring complex capabilities into production.
- Rigorous approach to benchmarking, experimentation, and performance measurement.
- Strong product judgment and ability to translate deep technical work into clear customer value.
- Nice to have: hands-on experience with PyTorch, vLLM, TensorRT-LLM, SGLang, NVIDIA Dynamo, or similar technologies.
- Nice to have: experience with open-source inference projects, model optimization, or ML systems research.
Benefits
- Competitive compensation, including meaningful equity (U.S. only).
- 100% coverage of medical, dental, and vision insurance for employee and dependents.
- Flexible PTO policy, including company-wide Winter Break with offices closed from Christmas Eve to New Year's Day.
- Paid parental leave.
- Fertility and family-building stipend through Carrot (U.S. only).
- Company-facilitated 401(k).
Advertisement
Put your brand in front of 300,000+ monthly visitors worldwide
Related Jobs
More openings for this role: 473 remote Product Manager jobs · vagas de Gerente de Produto para o Brasil
Find more than a single listing
Discover more jobs
Join now and find your dream job or a higher-paying opportunity with better employer visibility, stronger internal discovery and easier access to worldwide hiring signals.
Discover hidden jobs
Surface roles you may miss on noisier boards and move through cleaner employer links and better intent pages.
Head start against the competition
See fresh roles, related pages, salary context and company signals faster so you can apply earlier and better.
10,000+ more jobs than narrower job boards
Explore remote, hybrid and location-based opportunities across worldwide markets instead of relying on one narrow inventory.
Worldwide opportunity coverage
Use region pages, country-eligibility pages and skill pages built for global job seekers, not just one market.
Social proof
Trusted by professionals
“I would like more frequent updates and more junior-level vacancies.”
Elsa Lindberg
Product Manager · 🇸🇪 Sweden
“A simple and practical platform for finding quality remote vacancies.”
Neema Mushi
QA Engineer · 🇹🇿 Tanzania
“JobsRemoteList made it easy to discover relevant remote roles and apply directly.”
Nusrat Jahan
Recruiter · 🇧🇩 Bangladesh