AI Model Coding Evaluation
Budget / SalaryHourly project
TypeFreelance project
LocationRemote
Posted1 hour ago
I need you to pit two anonymised AI coding assistants against each other on the exact same task, watch them work in real time, and decide which one performs better. The task you will give each model is to draft technical documentation that explains how an API or developer tool works.
Your job is to:
• Stream both sessions side-by-side, logging every prompt and full response.
• Note any behavioural issues—hallucinations, security lapses, policy breaks—quoting the transcript and grading the severity.
• Rate each model on accuracy, clarity, code quality and overall usefulness.
• Declare a winner and justify the decision in a short summary.
What I expect back:
1. The complete, timestamped transcripts for both models.
2. An issue log with severity ratings.
3. A comparative scorecard.
4. Your written verdict.
You’ll need strong coding experience, daily familiarity with AI coding tools, keen attention to detail and clear written English. A reliable dev machine and stable internet are a must because the work happens live.
This is an hourly contract. Please copy the form below into your proposal and answer every line; incomplete forms will be ignored.
Form
1. Do you use AI in your daily coding? If yes, which AI tools and which model do you mainly use?
2. Your development device specs (OS, CPU, RAM, storage, internet speed). Attach performance screenshots.
3. Are you comfortable working in the PT timezone? Can you work at any time?
4. Your weekly commitment (hours):
Your job is to:
• Stream both sessions side-by-side, logging every prompt and full response.
• Note any behavioural issues—hallucinations, security lapses, policy breaks—quoting the transcript and grading the severity.
• Rate each model on accuracy, clarity, code quality and overall usefulness.
• Declare a winner and justify the decision in a short summary.
What I expect back:
1. The complete, timestamped transcripts for both models.
2. An issue log with severity ratings.
3. A comparative scorecard.
4. Your written verdict.
You’ll need strong coding experience, daily familiarity with AI coding tools, keen attention to detail and clear written English. A reliable dev machine and stable internet are a must because the work happens live.
This is an hourly contract. Please copy the form below into your proposal and answer every line; incomplete forms will be ignored.
Form
1. Do you use AI in your daily coding? If yes, which AI tools and which model do you mainly use?
2. Your development device specs (OS, CPU, RAM, storage, internet speed). Attach performance screenshots.
3. Are you comfortable working in the PT timezone? Can you work at any time?
4. Your weekly commitment (hours):
Apply on Freelancer →
Project sourced from Freelancer.com. Applications happen directly on the original platform — we never collect your data.