Freelance LLM (Large Language Model) Setup and Customization Expert

Job ID: 38681664

Budget: $30 – $250 USD

We are looking for an experienced freelancer to help and teach us how to setup a Large Language Model (LLM)

The freelancer will be responsible for the following tasks:
1. Guide us through the Setup and Installation process. This will include the Installation and configuration of the necessary tools and libraries to run the LLM, including LangChain, GPT4All, LlamaCpp, Chroma, and SentenceTransformers.
2. Currently our plan is to use the LLM for our HR policy. But we want to build our own capabilities through this exercise and be able to build an LLM for other policies - exmaple legal policies etc
3. Data ingestion: Implement the functionality to ingest documents from our source_documents directory. The supported file extensions include CSV, Word Document (both .docx and .doc), EverNote (.enex), Email (.eml), EPub (.epub), HTML File (.html), Markdown (.md), Outlook Message (.msg), Open Document Text (.odt), Portable Document Format (PDF), PowerPoint Document (.pptx and .ppt), and Text file (UTF-8) (.txt).
3. Code support: Extend the LLM to handle code, specifically Python, JavaScript, and .NET C#. This will allow us to train the model on our code base, enabling code-related queries and assistance.
4. Server setup: Coordinate with our team to determine the server requirements and ensure that the necessary infrastructure is in place to support the LLM's training and execution.
5. We want to create a powerful LLM that can be trained on our own data, allowing us to ask questions and perform queries without an internet connection.

Requirements:
- Proficiency in setting up and configuring Large Language Models (LLMs)
- Strong knowledge and experience with the open-source package provided (https://github.com/imartinez/privateGPT)
- Familiarity with LangChain, GPT4All, LlamaCpp, Chroma, and SentenceTransformers
- Experience with data ingestion and processing, especially with various document formats and code files
- Expertise in Python, JavaScript, and basic understanding of .NET C#
- Ability to work independently and deliver high-quality results within specified timelines
- Good communication skills to collaborate effectively with our team

Please Note:
- This is a freelance position.
- The work can be performed remotely, but availability for coordination and communication during the project is required.
- The project duration and compensation will be discussed and agreed upon with the selected freelancer.

If you have the skills and experience required to set up a customized Large Language Model and are interested in this opportunity, please submit your proposal, including relevant work samples or references.
Related categories: Python Linux Open Source OpenAI ChatGPT