Implement a document base retrieval chian using Reranking Integration with Weaviate
Budget: €8 – €30 EUR
I'm seeking a developer with experience in Langchain and LLM integration to enhance my Weaviate database retrieval process. My existing database is already set up with a defined schema.
Key Tasks:
- Configure a retrieval chain using Langchain and OpenAI's GPT-4 to rerank retrieved chunks based on their relevance to a predefined query format.
- Implement a document grouping system that clusters chunks according to their source document, identifying the top-k most pertinent documents.
- Develop a final aggregation process that compiles all chunks from these top documents to generate a comprehensive answer.
Ideal Skills:
- Proven experience with Langchain and OpenAI's GPT-3.
- Familiarity with Weaviate databases and schema.
- Strong ability in document grouping and retrieval systems.
- Excellent understanding of LLMs and their application in data retrieval and relevance ranking.
Key Tasks:
- Configure a retrieval chain using Langchain and OpenAI's GPT-4 to rerank retrieved chunks based on their relevance to a predefined query format.
- Implement a document grouping system that clusters chunks according to their source document, identifying the top-k most pertinent documents.
- Develop a final aggregation process that compiles all chunks from these top documents to generate a comprehensive answer.
Ideal Skills:
- Proven experience with Langchain and OpenAI's GPT-3.
- Familiarity with Weaviate databases and schema.
- Strong ability in document grouping and retrieval systems.
- Excellent understanding of LLMs and their application in data retrieval and relevance ranking.