Python - LLM engine to parse forum posts and query them as a chat engine
Budget: £18 – £36 GBP
I am looking for a Python expert to create a Local LLM engine that can parse forum posts and query them as a chat engine.
The idea being that posts are scraped from a forum with all replies, then the LLM would ingest all of the posts and be queried on their contents. The model would need to be able to look at all of the posts and replies, return answers relating to the query and also be able to differentiate between the threads so it would know which threads are which. The model would also need to be able to query specific threads based on URL, title, ID, author etc.
Scraping the forum isn't part of the request, any data can be used for this and I will adapt the scraped content to match.
Specifics:
- Built in Python.
- Local large language model.
- Chat query engine on all threads and posts to answer questions on the entire context and return relevant information about the threads such as a summary of the original thread that's being referenced, it's URL, author etc.
- Chat query engine on specific threads to answer questions about the specific context.
Skills and experience required:
- Expert level experience with Python.
- Experience with large language models, AI, training data etc.
The idea being that posts are scraped from a forum with all replies, then the LLM would ingest all of the posts and be queried on their contents. The model would need to be able to look at all of the posts and replies, return answers relating to the query and also be able to differentiate between the threads so it would know which threads are which. The model would also need to be able to query specific threads based on URL, title, ID, author etc.
Scraping the forum isn't part of the request, any data can be used for this and I will adapt the scraped content to match.
Specifics:
- Built in Python.
- Local large language model.
- Chat query engine on all threads and posts to answer questions on the entire context and return relevant information about the threads such as a summary of the original thread that's being referenced, it's URL, author etc.
- Chat query engine on specific threads to answer questions about the specific context.
Skills and experience required:
- Expert level experience with Python.
- Experience with large language models, AI, training data etc.