Need help with transformers
Budget: €30 – €250 EUR
Hello,
I would like to have a sequence(s) to sequence generation. The vocabulary size is small (around 50).
The model will be used as follow:
Given N past sequences (order is very important), I would like the model to generate the next sequence.
The dataset contains about 2200 entries.
Currently, I am using LSTMs / GRU and the performance is not great (20% accuracy)
I need help creating a transformer architecture for my dataset and having at least 50% accuracy.
Thank you
I would like to have a sequence(s) to sequence generation. The vocabulary size is small (around 50).
The model will be used as follow:
Given N past sequences (order is very important), I would like the model to generate the next sequence.
The dataset contains about 2200 entries.
Currently, I am using LSTMs / GRU and the performance is not great (20% accuracy)
I need help creating a transformer architecture for my dataset and having at least 50% accuracy.
Thank you