Create AI bot with PDF content as knowledgebase in c##
Budget: ₹1,500 – ₹12,500 INR
We are looking for a developer to build a local chatbot application that interacts with users based on content extracted from PDF documents. The project should run entirely on a CPU (no GPU support required) and includes PDF ingestion, integration with a local GPT model, and a minimal chat interface. The machine learning components should be developed using Microsoft's ML.NET in C# (no Python). The system can be developed on our VM system (including GIT repository to submit code directly).
You can also refer to examples of open-source projects like:
- **ML.NET Sentiment Analysis Demo** for simple machine learning integration in C#.
- **PDFMiner with Simple Chatbot** for processing PDFs and integrating them into a chatbot.
- **GPT-2 Simple Chatbot** for running a GPT model locally on a CPU.
*** Key Requirements ***:
PDF Ingestion and Processing:
* Read and extract text from PDF files.
* Process and store text data in a format suitable for use with a machine learning model.
Local GPT Model Integration:
* Integrate a local GPT model that uses the processed PDF content.
* Ensure the model can be trained and updated efficiently on a CPU-only system (no GPU).
Training and Learning without GPU:
* Implement a training process using ML.NET in C# that works smoothly on a CPU, enabling the model to learn from new data.
Minimal Chat Interface:
* Develop a basic interface for user interaction where users can ask questions related to the content of the PDFs.
Integration with ML Demo:
* Integrate the solution into a simple ML.NET demo to showcase its functionality.
** Use Case: The system scans a directory with subfolders containing PDFs, processes only new PDFs, and updates a database for machine learning. Users can ask questions about the content of the PDFs via the chat interface, receiving answers with links to the relevant documents.
You can also refer to examples of open-source projects like:
- **ML.NET Sentiment Analysis Demo** for simple machine learning integration in C#.
- **PDFMiner with Simple Chatbot** for processing PDFs and integrating them into a chatbot.
- **GPT-2 Simple Chatbot** for running a GPT model locally on a CPU.
*** Key Requirements ***:
PDF Ingestion and Processing:
* Read and extract text from PDF files.
* Process and store text data in a format suitable for use with a machine learning model.
Local GPT Model Integration:
* Integrate a local GPT model that uses the processed PDF content.
* Ensure the model can be trained and updated efficiently on a CPU-only system (no GPU).
Training and Learning without GPU:
* Implement a training process using ML.NET in C# that works smoothly on a CPU, enabling the model to learn from new data.
Minimal Chat Interface:
* Develop a basic interface for user interaction where users can ask questions related to the content of the PDFs.
Integration with ML Demo:
* Integrate the solution into a simple ML.NET demo to showcase its functionality.
** Use Case: The system scans a directory with subfolders containing PDFs, processes only new PDFs, and updates a database for machine learning. Users can ask questions about the content of the PDFs via the chat interface, receiving answers with links to the relevant documents.