Subject-Matter Expert for AI Training Dataset Creation
Budget: $10 – $30 USD
Project Overview
We are building a high-quality, expert-level question-answering dataset to evaluate and train cutting-edge AI systems. Our project requires domain experts to author and review advanced-level questions in their fields.
We're looking for experts in STEM to create challenging, original multiple-choice, along with detailed solutions and rationales.
Challenges
- Questions must be challenging for current AI models, requiring expert-level knowledge and reasoning.
- Questions should be "Google-proof", meaning they cannot be easily answered through simple web searches.
- Answers must be unambiguous and verifiable to ensure consistency in AI evaluation.
Responsibilities
- Create high-difficulty questions (~graduate-level or upper undergraduate level) in your area of expertise.
- Write a detailed explanation and/or solution for each question.
- Ensure questions are original and not copied from textbooks or previous tests.
- Must be able to provide concise, informative hints designed to help advanced AI models reason through and answer the question correctly.
Qualifications
We are seeking individuals with the following qualifications:
- Education: An advanced degree (Master’s or Ph.D.) in your field of expertise.
- Expertise: Deep knowledge in at least one academic discipline, such as mathematics, physics, chemistry, biology.
- Communication Skills: Excellent written communication skills in English to create clear and precise questions.
- Critical Thinking: Ability to design questions that test advanced understanding and reasoning, beyond what current AI models can easily handle.
- Attention to Detail: Meticulous approach to ensure questions are unambiguous and answers are verifiable.
- Familiarity with AI (Optional): Understanding of current AI capabilities and limitations is advantageous, as it will help in creating questions that are challenging for AI models.
Compensation
- Competitive rates based on the number and quality of questions submitted.
- Opportunity for ongoing collaboration as we expand the dataset and undertake future projects.
Why Join Us
- Be part of a groundbreaking project that advances AI through high-quality, expert-curated data.
- Work with a team dedicated to pushing the frontiers of AI research and development.
- Enjoy flexible working arrangements as a freelance opportunity.
Application Instructions
To apply, please submit the following through UpWork:
- Your resume, highlighting your educational background and expertise in your field.
- Samples of any relevant work, such as previously created educational content, questions, or assessments, if available.
Additional Notes
- This is a remote position, and you will work independently with occasional collaboration with our team for quality assurance.
- The project requires a commitment to producing high-quality work within agreed-upon timelines.
- Questions will undergo a review process to ensure they meet the dataset’s standards
We are building a high-quality, expert-level question-answering dataset to evaluate and train cutting-edge AI systems. Our project requires domain experts to author and review advanced-level questions in their fields.
We're looking for experts in STEM to create challenging, original multiple-choice, along with detailed solutions and rationales.
Challenges
- Questions must be challenging for current AI models, requiring expert-level knowledge and reasoning.
- Questions should be "Google-proof", meaning they cannot be easily answered through simple web searches.
- Answers must be unambiguous and verifiable to ensure consistency in AI evaluation.
Responsibilities
- Create high-difficulty questions (~graduate-level or upper undergraduate level) in your area of expertise.
- Write a detailed explanation and/or solution for each question.
- Ensure questions are original and not copied from textbooks or previous tests.
- Must be able to provide concise, informative hints designed to help advanced AI models reason through and answer the question correctly.
Qualifications
We are seeking individuals with the following qualifications:
- Education: An advanced degree (Master’s or Ph.D.) in your field of expertise.
- Expertise: Deep knowledge in at least one academic discipline, such as mathematics, physics, chemistry, biology.
- Communication Skills: Excellent written communication skills in English to create clear and precise questions.
- Critical Thinking: Ability to design questions that test advanced understanding and reasoning, beyond what current AI models can easily handle.
- Attention to Detail: Meticulous approach to ensure questions are unambiguous and answers are verifiable.
- Familiarity with AI (Optional): Understanding of current AI capabilities and limitations is advantageous, as it will help in creating questions that are challenging for AI models.
Compensation
- Competitive rates based on the number and quality of questions submitted.
- Opportunity for ongoing collaboration as we expand the dataset and undertake future projects.
Why Join Us
- Be part of a groundbreaking project that advances AI through high-quality, expert-curated data.
- Work with a team dedicated to pushing the frontiers of AI research and development.
- Enjoy flexible working arrangements as a freelance opportunity.
Application Instructions
To apply, please submit the following through UpWork:
- Your resume, highlighting your educational background and expertise in your field.
- Samples of any relevant work, such as previously created educational content, questions, or assessments, if available.
Additional Notes
- This is a remote position, and you will work independently with occasional collaboration with our team for quality assurance.
- The project requires a commitment to producing high-quality work within agreed-upon timelines.
- Questions will undergo a review process to ensure they meet the dataset’s standards