Interactive Audio-Visual Installation Using TouchDesigner and AI - 03/05/2024 09:13 EDT
Budget: €250 – €750 EUR
Project Description:
We are seeking a talented freelancer with expertise in TouchDesigner, audio analysis, and machine learning to create an engaging interactive audio-visual installation. This project involves working with around 20 audio tracks to extract musical elements, crafting dynamic visual interpretations of these elements, and integrating them into a web-based platform that allows audience interaction and display.
Objectives:
Frequency and Rhythm Analysis: Utilize AI tools like Spleeter by Deezer to separate and examine specific audio track components such as vocals and bass.
Pattern Recognition: Use machine learning models to detect and analyze repetitive patterns in the rhythms and melodies typical of the tarantella dance.
TouchDesigner Setup:
Establish a TouchDesigner project that will serve as the platform for displaying audio data.
Python Scripting in TouchDesigner:
Write Python scripts within TouchDesigner to import and utilize data extracted from the AI analysis.
Creation of Custom Operators:
Employ CHOP (Channel Operators) to manipulate audio data in real time and TOP (Texture Operators) to display associated visual elements.
Deliverables:
A fully functional TouchDesigner project incorporating both audio-visual and interactive elements.
Complete Python code for developing AI models and processing audio.
A fully operational web-based platform to display the interactive audio-visual content.
The project should be completed within 3/4 weeks
We are seeking a talented freelancer with expertise in TouchDesigner, audio analysis, and machine learning to create an engaging interactive audio-visual installation. This project involves working with around 20 audio tracks to extract musical elements, crafting dynamic visual interpretations of these elements, and integrating them into a web-based platform that allows audience interaction and display.
Objectives:
Frequency and Rhythm Analysis: Utilize AI tools like Spleeter by Deezer to separate and examine specific audio track components such as vocals and bass.
Pattern Recognition: Use machine learning models to detect and analyze repetitive patterns in the rhythms and melodies typical of the tarantella dance.
TouchDesigner Setup:
Establish a TouchDesigner project that will serve as the platform for displaying audio data.
Python Scripting in TouchDesigner:
Write Python scripts within TouchDesigner to import and utilize data extracted from the AI analysis.
Creation of Custom Operators:
Employ CHOP (Channel Operators) to manipulate audio data in real time and TOP (Texture Operators) to display associated visual elements.
Deliverables:
A fully functional TouchDesigner project incorporating both audio-visual and interactive elements.
Complete Python code for developing AI models and processing audio.
A fully operational web-based platform to display the interactive audio-visual content.
The project should be completed within 3/4 weeks