Member of Technical Staff, Evals & Data Quality
💰 $80,000 – $130,000/yrMarket estimate · not provided by the employer
At a glance
- Who can apply
- United States, Canada
- Work arrangement
- Hybrid · Remote
- Employment type
- Full-time
- Salary
- $80,000 – $130,000/yr · market estimate
Checked against the employer's source on November 21, 2026. Details come from the employer's posting; confirm them on the application page.
Advertisement
Put your brand in front of 300,000+ monthly visitors worldwide
Job Description
Mecka AI builds global data infrastructure for robotics and embodied AI, covering data capture, labeling and hardware-enabled workflows for AI labs and robotics companies. This remote role defines the benchmarks, audits and quality standards that decide whether training data is ready to ship.
- Own the benchmark methodology, including which evaluation sets exist, how they are sampled, which metrics apply, and how versions are frozen and compared.
- Write customer quality specifications and audit rubrics, keeping them aligned with what customers actually reject.
- Run human audits and work with annotation and operations teams on sampling, agreement, throughput and cost.
- Build automated checks and graders that cut manual review costs and are hard to game.
- Track where recorded hours are lost and report quality results regularly.
- Make the ship or no-ship decision on data deliveries.
- Work across Computer Vision, annotation, operations and delivery teams.
- Challenge research teams' numbers and back the challenge with evidence.
Summary of Mecka's posting by JobsRemoteList. Read the full details and apply on the employer's site.
Requirements
- Experience in evaluation, measurement or data quality for machine learning systems, or in data operations at scale.
- Machine learning and data science background with strong Python skills.
- Working knowledge of statistics, including sampling, precision and recall, agreement and confidence intervals.
- Experience designing evaluation protocols and ground-truth pipelines from scratch.
- Ability to spot how a metric can be gamed and close those gaps.
- Nice to have: experience with 3D pose, trajectory and reconstruction metrics such as MPJPE and ATE.
- Nice to have: experience with sampling design, inter-annotator agreement, loss accounting, or managing annotators or vendors.
- Nice to have: experience with verifiers, learned scoring, active learning or human-in-the-loop evaluation.
- Nice to have: experience with quality scoring, filtering and composition of large datasets.
Advertisement
Put your brand in front of 300,000+ monthly visitors worldwide
Related Jobs
Find more than a single listing
Discover more jobs
Join now and find your dream job or a higher-paying opportunity with better employer visibility, stronger internal discovery and easier access to worldwide hiring signals.
Discover hidden jobs
Surface roles you may miss on noisier boards and move through cleaner employer links and better intent pages.
Head start against the competition
See fresh roles, related pages, salary context and company signals faster so you can apply earlier and better.
10,000+ more jobs than narrower job boards
Explore remote, hybrid and location-based opportunities across worldwide markets instead of relying on one narrow inventory.
Worldwide opportunity coverage
Use region pages, country-eligibility pages and skill pages built for global job seekers, not just one market.
Social proof
Trusted by professionals
“The filters are clear, the listings are useful, and I saved a lot of search time.”
Sofía Hernández
GIS Specialist · 🇲🇽 Mexico
“A simple and practical platform for finding quality remote vacancies.”
Sipho Dlamini
SEO Specialist · 🇿🇦 South Africa
“A simple and practical platform for finding quality remote vacancies.”
Benjamín Muñoz
Project Manager · 🇨🇱 Chile