Create a Step-by-Step Tutorial for Setting Up Multiple AMD 6900xt GPUs on Ubuntu for the Petals Project
Budget: $250 – $750 USD
## Overview:
I am looking for an experienced developer to craft a comprehensive, step-by-step tutorial focused on setting up multiple AMD 6900xt GPUs on a single computer running Ubuntu. The tutorial should enable the GPUs to work simultaneously with the Petals Project - https://github.com/bigscience-workshop/petals. A key requirement is that the multiple GPUs must be visibly contributing to the Petals network and be tracked on the petals website - https://health.petals.dev.
## Requirements:
1. Hands-on experience configuring and optimizing AMD GPUs in a Linux environment, specifically Ubuntu.
2. Proficiency in Python and Low-Level Machine Learning (LLM) tools such as PyTorch and ROCm.
3. Prior experience in AI projects.
4. Deep understanding of Ubuntu.
5. Ideally, familiarity with the Petals project or similar self-hosted LLMs.
### Reference:
The Petals team has successfully executed this setup for a single GPU as documented here: https://github.com/bigscience-workshop/petals/wiki/Running-on-AMD-GPU under the heading "AMD 6900 XT tested April 18th, 2023 on bare metal Ubuntu 22.04."
## Scope of Work:
1. The tutorial must be CLI (Command-Line Interface) focused, as it will be executed in a headless environment.
2. The tutorial should be clearly articulated, making it accessible and easily replicable for individuals lacking Linux experience.
3. After the initial setup tutorial is complete, it will be tested by multiple public users who are not proficient in Linux. They should be able to successfully replicate the multi-GPU functionality using your tutorial.
4. All code and documentation will be contributed back to the Petals project as this is an open-source initiative.
## Offer:
- I will provide remote access to several computers, each installed with two or more AMD 6900XT GPUs, for testing purposes. Remote access will be provided via SSH or a similar secure method.
## Payment:
Full payment will be released only upon the successful execution of the following deliverables:
1. Verified operation of multiple AMD GPUs contributing to the Petals network, as confirmed on health.petals.dev.
2. A well-structured and detailed tutorial that enables individuals with no Linux experience to replicate the setup.
## Additional Information:
For more insight into the current progress and community discussions, join our Discord group (https://discord.gg/Te9uXfbe). Feel free to collaborate with anyone including the Petals team to get this working.
I am looking for an experienced developer to craft a comprehensive, step-by-step tutorial focused on setting up multiple AMD 6900xt GPUs on a single computer running Ubuntu. The tutorial should enable the GPUs to work simultaneously with the Petals Project - https://github.com/bigscience-workshop/petals. A key requirement is that the multiple GPUs must be visibly contributing to the Petals network and be tracked on the petals website - https://health.petals.dev.
## Requirements:
1. Hands-on experience configuring and optimizing AMD GPUs in a Linux environment, specifically Ubuntu.
2. Proficiency in Python and Low-Level Machine Learning (LLM) tools such as PyTorch and ROCm.
3. Prior experience in AI projects.
4. Deep understanding of Ubuntu.
5. Ideally, familiarity with the Petals project or similar self-hosted LLMs.
### Reference:
The Petals team has successfully executed this setup for a single GPU as documented here: https://github.com/bigscience-workshop/petals/wiki/Running-on-AMD-GPU under the heading "AMD 6900 XT tested April 18th, 2023 on bare metal Ubuntu 22.04."
## Scope of Work:
1. The tutorial must be CLI (Command-Line Interface) focused, as it will be executed in a headless environment.
2. The tutorial should be clearly articulated, making it accessible and easily replicable for individuals lacking Linux experience.
3. After the initial setup tutorial is complete, it will be tested by multiple public users who are not proficient in Linux. They should be able to successfully replicate the multi-GPU functionality using your tutorial.
4. All code and documentation will be contributed back to the Petals project as this is an open-source initiative.
## Offer:
- I will provide remote access to several computers, each installed with two or more AMD 6900XT GPUs, for testing purposes. Remote access will be provided via SSH or a similar secure method.
## Payment:
Full payment will be released only upon the successful execution of the following deliverables:
1. Verified operation of multiple AMD GPUs contributing to the Petals network, as confirmed on health.petals.dev.
2. A well-structured and detailed tutorial that enables individuals with no Linux experience to replicate the setup.
## Additional Information:
For more insight into the current progress and community discussions, join our Discord group (https://discord.gg/Te9uXfbe). Feel free to collaborate with anyone including the Petals team to get this working.