Mobile App Video Module (Variable speed playback)

Job ID: 33701656

Budget: €750 – €1,500 EUR

Project's purpose is to create a module for both iOS and Android (which can be inserted into an existing framework application), which must perform do 3+1 functions simultaneously, in real-time, all of them at once -

1) Recording audio from Mic
2) Attempting to detect musical rhythm (BPM) of the recorded sound in real-time
3) Playing back a pre-recorded, already downloaded video vith its frame-rate varying according to the actually detected BPM of the Mic input (in real-time)

The +1 function (after succeding with these 3) will be the option to also add playback of Pre-recorded Audio, in sync with the Recording (like in a Karaoke app, preferably the Mic input spearated by the user wearing headphones).

The Mic Recording and the BPM detection is already operational / functional in the Framework Application, which is mostly written in React Native, but if this task requires lower-level access to the Multimedia functionaliy of both Android & iOS, the module can use the lowest level approach which is required for the task for each platform. However, even if using device-specific multimedia functions, the modul will still have to be able connect & communicate with the framework App - in real-time - which already exists.

API is provided by our own server which serves pre-recorded video, (later) the pre-recorded audio, etc. in JSON, but most of it is taken care of by the already existing Framework App.

Again, the job is not to create the Framework App, because it already exists - only to realize such a variable-speed video playback module, but letting the BPM detection & Mic recording to run simultaneously. The Pre-recorded video is usually available in high framerates (ie 120-240 FPS), so that slowing down still looks reasonable. Alternatively, the pre-recorded video is also available in several "speed" or FPS versions, in case it is easier to switch between these versions, but without glitches & they must remain in the same phase. Either solution is acceptable.

Attached is the remarks of the developer of the Framework App, who will work together & communicate with the selected Freelanceer (using this account as the master communication channel).

Awaiting offers, or in case of any doubt, questions are also welcome.
Please only bid if You are confident about realizing the module with the functionality described above.