Senior Software Engineer

• Title:
  Senior Software Engineer (Remote)
• Engagement:
  Hourly contract (independent contractor)
• Location:
  Remote – candidates based in the United States, United Kingdom, Canada, Europe, Singapore, Dubai, or Australia who are legally able to work as independent contractors in their jurisdiction.

We are hiring for one of our clients a Senior Software Engineer to support large language model (LLM) evaluation and dataset development. This role focuses on evaluating, refining, and validating AI-generated code across multiple programming languages to improve model performance, reliability, and scalability.

Role Overview

As a Software Engineering Evaluator, you will work closely with researchers and cross-functional teams to design high-quality datasets, review and correct code, and assess AI model capabilities across the software development lifecycle. This is a remote, contract-based engagement with flexible weekly hours.

Key Responsibilities

• Curate high-quality code examples and develop accurate reference solutions in languages such as Python, JavaScript (including React), C/C++, Java, Rust, and Go.
• Evaluate and refine AI-generated code for efficiency, scalability, maintainability, and correctness.
• Identify error patterns and build automated mechanisms to verify code quality.
• Design validation strategies to assess AI model performance across different stages of the software engineering lifecycle, including architecture design, API development, implementation, testing, deployment, and maintenance.
• Collaborate with researchers and engineering stakeholders to improve AI-driven coding systems and benchmarks.

Required Qualifications

• Demonstrated professional experience in software engineering, typically gained over multiple years in production environments.
• Strong experience building and deploying full-stack or backend systems using modern programming languages and frameworks.
• Solid understanding of software architecture, system design, debugging, testing, and code review best practices.
• Ability to clearly document evaluation decisions and communicate technical reasoning.
• Experience working with large-scale or production-grade systems is preferred.

Engagement Details

• Work type:
  Remote
• Engagement model:
  Independent contractor
• Time commitment:
  Flexible, approximately 10–40 hours per week
• Availability:
  Ability to overlap a portion of working hours with Pacific Time
• Contract duration:
  Initial term of approximately 1 month, with potential extensions based on performance and project needs

Compensation

• Compensation is competitive and provided on an hourly or project basis, commensurate with experience, skills, and scope of work. Details will be discussed during the interview process.

Evaluation Process

• Completion of an initial application form
• Participation in an automated AI-led interview
• Completion of a coding-based assessment as part of the evaluation process