- Experience
- Any
- Salary
- —
- Openings
- 1
- Posted
- vor 4 Stunden
- Work mode
- Work from home
- Eligibility
- Open to all qualified candidates regardless of background, experience, or employment history; selection based purely on demonstrated technical skills and qualifications.
- Resume
- Required to apply
Sign in to tell us what does and doesn't work for you here — it sharpens every match we show you.
Job description
Role Overview
We are seeking a Software Quality Engineer to join our client’s team full-time in a remote capacity. The position involves working extensively with agentic coding tasks, evaluating and annotating model outputs with high precision. Candidates will engage in code reading, debugging, and rigorous validation of software behavior following established evaluation protocols.
Key Responsibilities
- Perform advanced coding activities within an agentic coding framework while maintaining unbiased and session-independent evaluations.
- Consistently adhere to instructions, milestones, interaction plans, and evaluation guardrails during model assessments.
- Verify outputs by analyzing code, executing commands, reviewing logs, and inspecting generated files.
- Develop multi-phase, realistic coding tasks that incorporate user intent and structured milestones for offline testing.
- Document clear, detailed, and evidence-supported rationales for ranking and assessing model trajectories.
Required Skills and Qualifications
- Strong command of one or more programming languages including Python, JavaScript, Java, C++, or SQL, especially for code analysis and debugging purposes.
- Experience solving realistic, non-trivial software challenges beyond superficial code reviews or simple exercises.
- Capability to formulate specific rubrics and binary criteria to evaluate model outputs effectively.
- Exceptional attention to detail ensuring high annotation quality and grading consistency.
- Comfortable with debugging processes, validating tests, and verifying software functionality manually.
Opportunity Details
This position is an excellent chance to work with a top-tier global technology and information services company, contributing to the development and deployment of impactful AI-driven agentic coding systems used in critical applications.
Equal Employment Opportunity
The employer values skills and expertise above all and welcomes qualified applicants from diverse backgrounds with no discrimination based on experience or employment history. Selection focuses entirely on technical competence and aptitude.