Adjust Scripts To Train Transformer Models Using FP8
Budget: $10 – $30 USD
Need someone adjust the scripts in order to work with FP8 on Nvidia Ada Lovelace and later GPUs with minimal changes.
- I will not give any compute resource to do the job;
- After you give me minimal evidences that the work was done (prints of the training process using FP8), we will proceed with our tests using a workstation with 2 GPUs (2 x RTX 4000 SFF Ada).
- Use Huggin Face tools/libraries or another approved by us.
- I will not give any compute resource to do the job;
- After you give me minimal evidences that the work was done (prints of the training process using FP8), we will proceed with our tests using a workstation with 2 GPUs (2 x RTX 4000 SFF Ada).
- Use Huggin Face tools/libraries or another approved by us.