Flask App Integration with H2O GPT

Job ID: 38425148

Budget: $250 – $750 USD

I'm looking for a skilled developer to help me integrate an offline/private Large Language Model (LLM) on our server with an existing Flask application. This task involves integrating the H2O GPT model with a pre-trained model (e.g. mixtral) to enhance two specific use cases.

Key Project Details:
1. Querying data (using the chatbot) from tables (around 20) using a pre-trained model.
2. Extracting data from uploaded documents (csv, excel, pdf, word) based on predefined queries.
- Extending the frontend with an icon for the chatbot that opens a modal for interacting with the chatbot (for use case 1) / in alignment to the current UI design
- Extending the frontend with an icon for uploading documents that opens a modal where you can upload documents and where you can see the results of the data extraction, that then can be saved to the database (for use case 2) / in alignment to the current UI design
- Short documentation what we need to do to make h2o gpt running in flask on our own server

Ideal Skills and Experience:
- Proficiency in Python and Flask for web development
- Previous experience in integrating machine learning models into web applications
- Understanding of NLP and the capabilities of H2O GPT models would be an advantage
- Ability to work with limited access, follow guidance and produce reliable results.

If you're confident in your ability to integrate the H2O GPT model with our Flask application and enhance its usability, I'm excited to discuss this opportunity further with you.