Build QA generative model

Job ID: 36088536

Budget: ₹12,500 – ₹37,500 INR

Goal: Build a closed-book QA generative model to answer astrology questions. It should be built so that it only answers from the data it was fine-tuned and not any previous knowledge(like from Wikipedia).

Dataset Available: About 70 pdfs (some contain Sanskrit which needs to be filtered out). Transcripts of about 1000 videos from an astrology channel(can skip these if pdfs are sufficient). We can either use GPT-3 models(provided it isn't too costly) or any open-source alternative like GPT-J or Flan-t5.
It'll be good if it can be integrated with RLHF(Reinforcement Learning with Human Feedback) to get improvements over time.

Timeline: 1-2 weeks.