Coders - AI Training (Freelance, Remote)

As an AI Tutor - Coding, you'll play a critical role in shaping the future of AI. You'll leverage your subject-matter expertise to train and evaluate AI models, ensuring the information they generate is reliable and relevant across various domains. This position offers a unique path for professional growth, allowing you to hone your AI skills while expanding your knowledge base.

About You

At least 7 years of professional work experience in software development.

Fluency in English with the ability to articulate code and abstract concepts clearly. (Required)

Bachelor's degree in computer science or equivalent.

Proficiency with one or more of the following programming languages is preferred: Python, Java, JavaScript/TypeScript, SQL, and C++

Proficiency working with any of the the following (in addition to the languages above): Swift, Ruby, Rust, Go, NET, Matlab, PHP, HTML, DART, R, Apex, and Shell

Interest in AI and machine learning concepts

Task Overview

This task involves evaluating AI chatbot responses to coding-related prompts. Each evaluation will compare two responses to the same prompt, which may vary in content, length, quality, and consistency. Your role is to identify any issues, rate, and rank the responses accordingly.

Task Evaluation Process

As part of the Project, you will be evaluating AI chatbot responses to coding-related prompts. Each evaluation involves comparing two responses to the same prompt.

Evaluation Steps:

1?? Read the prompt and both responses carefully.

2?? Assess each response for adherence to the prompt?s instructions (goals, format, style, and type of information) and assign a rating (No Issues, Minor Issues, or Major Issues).

3?? Verify the correctness and factuality of explanations and code. Test code snippets for functionality (using the in-platform or local coding environments) and include proof of work.

4?? Document your evaluation with a brief explanation of any issues and your reasoning.

5?? Rank the two responses based on overall quality and provide a concise side-by-side explanation of your ranking decision.

Apply Job!