Senior Staff Machine Learning Engineer, Data & Eval
💰 $150,000 – $220,000/yrMarket estimate · not provided by the employer
At a glance
- Who can apply
- United States
- Work arrangement
- On-site · United States
- Employment type
- Full-time
- Seniority
- Staff / Principal
- Salary
- $150,000 – $220,000/yr · market estimate
Checked against the employer's source on November 20, 2026. Details come from the employer's posting; confirm them on the application page.
Advertisement
Put your brand in front of 300,000+ monthly visitors worldwide
Job Description
Airbnb is a global lodging marketplace where hosts offer unique stays and experiences. This Senior Staff ML Engineer role leads technical direction for ML evaluation and the data flywheel behind Airbnb Assistance Engineering, including GenAI assistive agents.
- Set technical direction and lead execution for ML evaluation and the end-to-end data flywheel for Airbnb Assistance Engineering
- Define evaluation strategy and success metrics for GenAI systems, aligning offline evaluation with online business and customer outcomes
- Build and scale evaluation frameworks such as golden sets, synthetic data, automated regressions, rubric-based grading, and LLM-as-judge
- Design the data flywheel covering instrumentation, feedback collection, data quality checks, labeling strategy, dataset versioning, and governance
- Lead cross-functional quality initiatives with product, ops, and engineering to define what good looks like and act on evaluation results
- Develop and productionize pipelines for dataset creation, model monitoring, evaluation at scale, and pre- and post-deploy testing
- Drive architecture decisions for evaluation and data infrastructure, balancing speed, rigor, cost, and safety
Summary of Airbnb's posting by JobsRemoteList. Read the full details and apply on the employer's site.
Requirements
- PhD in Computer Science, Mathematics, Statistics, or related technical field, or equivalent practical experience
- 10+ years building, testing, and shipping ML/AI systems end-to-end, including 2+ years with GenAI/LLM systems in production
- 5+ years leading large, ambiguous technical initiatives as a senior IC, influencing roadmap and direction across teams
- Deep expertise in evaluation methodology, including offline/online alignment, metric design, human-in-the-loop evaluation, A/B testing, power analysis, and regression testing
- Hands-on experience with GenAI systems covering orchestration, retrieval, tool calling, and memory
- Experience building data pipelines and quality systems for labeling, dataset curation, versioning, monitoring, and governance
- Solid ML fundamentals including model selection, training/serving, monitoring, reliability, and lifecycle management
- Preferred: experience applying ML/AI to customer support workflows such as agent assist, routing, resolution recommendation, or QA
- Preferred: experience building evaluation platforms for agent behavior, safety/guardrails, and continuous improvement
- Location: US, remote eligible; must live in a state where Airbnb, Inc. has a registered entity, and occasional office or offsite attendance may be required
Benefits
- Base pay range of $244,000 to $305,000 USD, dependent on factors such as experience and market demands
- May be eligible for bonus, equity, benefits, and Employee Travel Credits
Advertisement
Put your brand in front of 300,000+ monthly visitors worldwide
Related Jobs
More openings for this role: 88 remote Machine Learning Engineer jobs · vagas de Engenheiro de Machine Learning para o Brasil
Find more than a single listing
Discover more jobs
Join now and find your dream job or a higher-paying opportunity with better employer visibility, stronger internal discovery and easier access to worldwide hiring signals.
Discover hidden jobs
Surface roles you may miss on noisier boards and move through cleaner employer links and better intent pages.
Head start against the competition
See fresh roles, related pages, salary context and company signals faster so you can apply earlier and better.
10,000+ more jobs than narrower job boards
Explore remote, hybrid and location-based opportunities across worldwide markets instead of relying on one narrow inventory.
Worldwide opportunity coverage
Use region pages, country-eligibility pages and skill pages built for global job seekers, not just one market.
Social proof
Trusted by professionals
“The alerts helped me keep track of new remote opportunities.”
Yui Tanaka
Operations Analyst · 🇯🇵 Japan
“The job details were clear and the application links worked smoothly.”
Yassine Benali
MEAL Coordinator · 🇲🇦 Morocco
“I discovered several remote-friendly companies that I had not seen elsewhere.”
Tariro Moyo
Recruiter · 🇿🇼 Zimbabwe