Japanese Linguistic Expert for AI Evaluation
Budget: ₹250,000 – ₹500,000 INR
I'm in need of a seasoned Japanese native professional [only Japanese citizens] with at least 5 years of experience in linguistic services. The primary task will be to evaluate and assist in training AI models, specifically focusing on Natural Language Processing (NLP). It is a remote job.
Key Responsibilities:
---------------------------------
-Collaborate closely with researchers to understand, predict, and design tasks and quality rubrics to collect great human data.
-Analyse input data for completeness, consistency, and correctness before model evaluation and identify/flag potential issues.
-Evaluate and fine tune the performance of AI model based on established metrics such as fluency, grammatical correctness, style, accuracy, safety, pertinence, suitability, summarisation, clarity, completeness, consistency and alignment.
-Identify pattern of errors.
-Create evaluation report, present result to stakeholders and identify reasons for model underperformance and work with the data science team to troubleshoot and improve models.
-Follow project-specific guidelines to assess and compare responses given by AI model for questions.
-Conduct regular audits/QA check of model predictions to ensure they meet predefined standards.
-Propose strategies for improving model accuracy, such as better model inputs, data preprocessing, or model tuning.
-Generate golden datasets and evaluation techniques.
-Work on multiple projects with tight timelines.
Qualifications:
-----------------------
-Bachelor’s degree in Japanese language
-A higher degree or certification in Japanese teaching is desirable.
Basic Requirement:
-------------------------------
Should have 5+ years of experience as a linguistic.
Should be very proficient in listening, reading, writing, and speaking Japanese.
Should be a native speaker for the desired language.
Should have done schooling with Japanese subjects.
Proficiency in linguistics, grammar, syntax, punctuation, spelling, and formatting in Japanese.
Familiarity with translation tools with ability to translate English to Japanese and vice versa.
Understanding of natural language processing (NLP) and LLMs.
Excellent problem-solving skills and a creative approach to challenge AI systems.
Strong analytical and collaboration skills, with the ability to present complex findings clearly and interpret data patterns.
Be a subject matter expert for the use case for which the AI model is being evaluated.
Proficiency in programming languages such as Python with experience in AI/ML frameworks and tools (desirable but not mandatory)
2 years of experience in AI model evaluation role with experience working with large datasets (desirable but not mandatory)
Your role would be crucial in enhancing the AI's understanding and processing of the Japanese language. Looking forward to your bids.
Key Responsibilities:
---------------------------------
-Collaborate closely with researchers to understand, predict, and design tasks and quality rubrics to collect great human data.
-Analyse input data for completeness, consistency, and correctness before model evaluation and identify/flag potential issues.
-Evaluate and fine tune the performance of AI model based on established metrics such as fluency, grammatical correctness, style, accuracy, safety, pertinence, suitability, summarisation, clarity, completeness, consistency and alignment.
-Identify pattern of errors.
-Create evaluation report, present result to stakeholders and identify reasons for model underperformance and work with the data science team to troubleshoot and improve models.
-Follow project-specific guidelines to assess and compare responses given by AI model for questions.
-Conduct regular audits/QA check of model predictions to ensure they meet predefined standards.
-Propose strategies for improving model accuracy, such as better model inputs, data preprocessing, or model tuning.
-Generate golden datasets and evaluation techniques.
-Work on multiple projects with tight timelines.
Qualifications:
-----------------------
-Bachelor’s degree in Japanese language
-A higher degree or certification in Japanese teaching is desirable.
Basic Requirement:
-------------------------------
Should have 5+ years of experience as a linguistic.
Should be very proficient in listening, reading, writing, and speaking Japanese.
Should be a native speaker for the desired language.
Should have done schooling with Japanese subjects.
Proficiency in linguistics, grammar, syntax, punctuation, spelling, and formatting in Japanese.
Familiarity with translation tools with ability to translate English to Japanese and vice versa.
Understanding of natural language processing (NLP) and LLMs.
Excellent problem-solving skills and a creative approach to challenge AI systems.
Strong analytical and collaboration skills, with the ability to present complex findings clearly and interpret data patterns.
Be a subject matter expert for the use case for which the AI model is being evaluated.
Proficiency in programming languages such as Python with experience in AI/ML frameworks and tools (desirable but not mandatory)
2 years of experience in AI model evaluation role with experience working with large datasets (desirable but not mandatory)
Your role would be crucial in enhancing the AI's understanding and processing of the Japanese language. Looking forward to your bids.