JobsRemoteList
Mecka logo

Member of Technical Staff, Evals & Data Quality

Mecka·November 20, 2026·
🌍 Hybrid · RemoteOpen to: United States, CanadaFull-timeSoftware Engineering

💰 $80,000 – $130,000/yrMarket estimate · not provided by the employer

At a glance

Who can apply
United States, Canada
Work arrangement
Hybrid · Remote
Employment type
Full-time
Salary
$80,000 – $130,000/yr · market estimate

Checked against the employer's source on November 21, 2026. Details come from the employer's posting; confirm them on the application page.

Advertisement

Put your brand in front of 300,000+ monthly visitors worldwide

Advertise here →

Job Description

Mecka AI builds global data infrastructure for robotics and embodied AI, covering data capture, labeling and hardware-enabled workflows for AI labs and robotics companies. This remote role defines the benchmarks, audits and quality standards that decide whether training data is ready to ship.

  • Own the benchmark methodology, including which evaluation sets exist, how they are sampled, which metrics apply, and how versions are frozen and compared.
  • Write customer quality specifications and audit rubrics, keeping them aligned with what customers actually reject.
  • Run human audits and work with annotation and operations teams on sampling, agreement, throughput and cost.
  • Build automated checks and graders that cut manual review costs and are hard to game.
  • Track where recorded hours are lost and report quality results regularly.
  • Make the ship or no-ship decision on data deliveries.
  • Work across Computer Vision, annotation, operations and delivery teams.
  • Challenge research teams' numbers and back the challenge with evidence.

Summary of Mecka's posting by JobsRemoteList. Read the full details and apply on the employer's site.

Requirements

  • Experience in evaluation, measurement or data quality for machine learning systems, or in data operations at scale.
  • Machine learning and data science background with strong Python skills.
  • Working knowledge of statistics, including sampling, precision and recall, agreement and confidence intervals.
  • Experience designing evaluation protocols and ground-truth pipelines from scratch.
  • Ability to spot how a metric can be gamed and close those gaps.
  • Nice to have: experience with 3D pose, trajectory and reconstruction metrics such as MPJPE and ATE.
  • Nice to have: experience with sampling design, inter-annotator agreement, loss accounting, or managing annotators or vendors.
  • Nice to have: experience with verifiers, learned scoring, active learning or human-in-the-loop evaluation.
  • Nice to have: experience with quality scoring, filtering and composition of large datasets.

Advertisement

Put your brand in front of 300,000+ monthly visitors worldwide

Advertise here →

Find more than a single listing

Discover more jobs

Join now and find your dream job or a higher-paying opportunity with better employer visibility, stronger internal discovery and easier access to worldwide hiring signals.

🔎

Discover hidden jobs

Surface roles you may miss on noisier boards and move through cleaner employer links and better intent pages.

🚀

Head start against the competition

See fresh roles, related pages, salary context and company signals faster so you can apply earlier and better.

📈

10,000+ more jobs than narrower job boards

Explore remote, hybrid and location-based opportunities across worldwide markets instead of relying on one narrow inventory.

🌍

Worldwide opportunity coverage

Use region pages, country-eligibility pages and skill pages built for global job seekers, not just one market.

Social proof

Trusted by professionals

Read more reviews →
★★★★★

“The filters are clear, the listings are useful, and I saved a lot of search time.”

Sofía Hernández

GIS Specialist · 🇲🇽 Mexico

★★★★★

“A simple and practical platform for finding quality remote vacancies.”

Sipho Dlamini

SEO Specialist · 🇿🇦 South Africa

★★★★★

“A simple and practical platform for finding quality remote vacancies.”

Benjamín Muñoz

Project Manager · 🇨🇱 Chile