Custom GPT Transformer Model Development
Budget: ₹12,500 – ₹37,500 INR
I'm looking for a skilled NLP expert to develop a custom transformer model based on the GPT architecture using the Hugging Face library.
The project will involve:
- Developing a custom transformer model with:
- Positional encoding using RoPE
- Adjacency matrix implementation
- Custom vocabulary and tokenizers
- Providing scripts for:
- Tokenizer creation
- Model training
- Model testing
- Inference
Ideal Skills and Experience:
- Expertise in NLP and transformer models
- Proficiency in Hugging Face library
- Strong Python coding skills
- Experience with model training and evaluation
You should have very strong fundamentals as the model would need a lot of customisation based on our discussions and the more detailed requirements I would share later.
The training data will be a proprietary dataset, ranging from 1GB to 10GB in size.
The project will involve:
- Developing a custom transformer model with:
- Positional encoding using RoPE
- Adjacency matrix implementation
- Custom vocabulary and tokenizers
- Providing scripts for:
- Tokenizer creation
- Model training
- Model testing
- Inference
Ideal Skills and Experience:
- Expertise in NLP and transformer models
- Proficiency in Hugging Face library
- Strong Python coding skills
- Experience with model training and evaluation
You should have very strong fundamentals as the model would need a lot of customisation based on our discussions and the more detailed requirements I would share later.
The training data will be a proprietary dataset, ranging from 1GB to 10GB in size.