Software Engineer Annotator (Remote)

About the role

We are looking for a Software Engineer Annotator to work remotely, focusing on evaluating and labeling software engineering datasets that train AI and large language models. The role blends strong programming expertise with meticulous data annotation to improve model performance.

Key responsibilities

• Annotate and review software engineering datasets used for AI training.
• Assess AI‑generated code for correctness, efficiency, readability, and security.
• Label tasks such as code completion, debugging, refactoring, and optimization.
• Provide structured feedback to enhance model outputs.
• Ensure compliance with annotation guidelines and quality standards.
• Collaborate with AI trainers, reviewers, and data teams.

Required profile

• Bachelor’s degree in Computer Science, Software Engineering or a related field.
• 3–5 years of professional software engineering experience.
• Prior experience in data annotation, AI training, or code review.
• Strong understanding of software engineering principles, data structures and algorithms.
• Familiarity with the software development lifecycle, APIs, backend and web technologies.
• Basic knowledge of AI/ML or LLMs is a plus.

Required skills

• Programming languages: Python, Java, JavaScript, C++, Go.
• Experience with annotation or labeling tools.
• Ability to compare and rank multiple AI‑generated code responses.