LLM Models Fine-Tuning for QA Generation (Low budget. Study purpose) -- 3
Budget: $10 – $30 USD
Total budget 20$.
Milestone 1: (5$)
Select One LLM model - can be small LLM (CPU based - like TinyLlama or DistilBert etc) :
- able to run locally
- fine tunable on local or Colab.
Diverse types of Question Answer generation from a generic passage eg Python textbook.
(True/False, Multiple Choice Questions, Match the following, Fill in the blanks etc)
Prompt Engineering - 0 shot, 1 shot, few shot
Milestone 2 (5$)
Prepare dataset for Fine Tuning.
Fine tuning (graphs of loss - training, evaluation, test) & other details
(Also provide links to official pages where this details are mentioned)
Evaluation of Question/Answers generated before and after the Fine tuning. There should be noticable difference between the two (before and after FT).
The final result should be good enough, consistent & usable, saved to db (any db).
Milestone 3 (5$)
Prepare technical project report in detail -25 pages (can be using AI)
Milestone 4 (5$)
show the questions as quiz using gradio or streamlit or flask, marks obtianed etc & store it. Show progress.
Please note, this is a low-budget project intended for study purposes.
Milestone 1: (5$)
Select One LLM model - can be small LLM (CPU based - like TinyLlama or DistilBert etc) :
- able to run locally
- fine tunable on local or Colab.
Diverse types of Question Answer generation from a generic passage eg Python textbook.
(True/False, Multiple Choice Questions, Match the following, Fill in the blanks etc)
Prompt Engineering - 0 shot, 1 shot, few shot
Milestone 2 (5$)
Prepare dataset for Fine Tuning.
Fine tuning (graphs of loss - training, evaluation, test) & other details
(Also provide links to official pages where this details are mentioned)
Evaluation of Question/Answers generated before and after the Fine tuning. There should be noticable difference between the two (before and after FT).
The final result should be good enough, consistent & usable, saved to db (any db).
Milestone 3 (5$)
Prepare technical project report in detail -25 pages (can be using AI)
Milestone 4 (5$)
show the questions as quiz using gradio or streamlit or flask, marks obtianed etc & store it. Show progress.
Please note, this is a low-budget project intended for study purposes.