Joblet-AI logo for Software Benchmark Engineer (Remote) job on DevsUnite

Software Benchmark Engineer (Remote)

Joblet-AI

Actively HiringFull-time
Apply
Location

Ireland

Experience

2-4 years

Role

Software Benchmark Engineer (Remote)

Salary

Competitive

Share this job

Know someone who'd be a great fit?

Job Description

Role Overview

We build coding tasks used to train and evaluate frontier AI coding agents. We're looking for experienced software engineers to design them. The apps are TypeScript (React, Node, SQLite, Playwright). Use AI tools as much as you like to write code and tests.

Responsibilities

  • Writing realistic engineering tasks on full-stack web apps: the kind of problem a real team has in its backlog, on codebases that grow as each task builds on the last.
  • Writing the tests that decide whether a solution is correct.
  • Going beyond the UI: new services and APIs, a backend in another language (Go, Rust, Java), gRPC, rate limiting — drawing on systems you've actually built.
  • Sharing what you've seen work in other projects and flagging what should change in ours.

Requirements

  • Solid professional software engineering experience, backend and frontend.
  • You've built and debugged real systems, and you care about testing them well.
  • Clear written communication, and comfort working independently from written docs.
  • 10–20+ hours a week, starting soon.

Required Skills

TypeScriptReact.jsNode.jsGoPlaywright

Ready to apply for Software Benchmark Engineer (Remote)?

See how you stack up at Joblet-AI before you apply, or go straight to the application.

Apply Anyway