AI Chatbot Coding Response Evaluator (Javascript)
Budget: $8 – $15 USD
AI - Coder (Multiple langauges) + Must have 6+ years of experience
This task involves evaluating AI chatbot responses to coding-related prompts. Each evaluation will compare two responses to the same prompt, which may vary in content, length, quality, and consistency. Your role is to identify any issues, rate, and rank the responses accordingly.
Task Evaluation Process
As part of the Project, you will be evaluating AI chatbot responses to coding-related prompts. Each evaluation involves comparing two responses to the same prompt.
Evaluation Steps:
1️⃣ Read the prompt and both responses carefully.
2️⃣ Assess each response for adherence to the prompt’s instructions (goals, format, style, and type of information) and assign a rating (No Issues, Minor Issues, or Major Issues).
3️⃣ Verify the correctness and factuality of explanations and code. Test code snippets for functionality (using the in-platform or local coding environments) and include proof of work.
4️⃣ Document your evaluation with a brief explanation of any issues and your reasoning.
5️⃣ Rank the two responses based on overall quality and provide a concise side-by-side explanation of your ranking decision
This task involves evaluating AI chatbot responses to coding-related prompts. Each evaluation will compare two responses to the same prompt, which may vary in content, length, quality, and consistency. Your role is to identify any issues, rate, and rank the responses accordingly.
Task Evaluation Process
As part of the Project, you will be evaluating AI chatbot responses to coding-related prompts. Each evaluation involves comparing two responses to the same prompt.
Evaluation Steps:
1️⃣ Read the prompt and both responses carefully.
2️⃣ Assess each response for adherence to the prompt’s instructions (goals, format, style, and type of information) and assign a rating (No Issues, Minor Issues, or Major Issues).
3️⃣ Verify the correctness and factuality of explanations and code. Test code snippets for functionality (using the in-platform or local coding environments) and include proof of work.
4️⃣ Document your evaluation with a brief explanation of any issues and your reasoning.
5️⃣ Rank the two responses based on overall quality and provide a concise side-by-side explanation of your ranking decision
Related categories:
Business, Accounting, Human Resources & Legal
JavaScript
Python
SQL
C++ Programming