Build an iOS/Android App to connect textbook to audio companion files

Job ID: 35768144

Budget: $5,000 – $10,000 USD

Need to build an app that uses the phone camera images or text recognition to play the corresponding audio file from a 12 Unit language textbook

(Approximately 50 pages of language (with 79 audio tracks).

Similar to below:
https://play.google.com/store/apps/details?id=com.MHA.lakotamediaplayer&hl=en_US&gl=US

https://apps.apple.com/us/app/lakota-media-player/id1293850541

The Lakota Media Player is a companion to the Lakota Language Consortium's textbooks and children's books. Just point your phone at the page and tap to hear native speakers pronounce the words. The audio guide section gives you complete access to the textbook vocabulary with an easy tap and swipe interface.

-More than 600 words and phrases!
-Each children’s book has the full text audio so you can read along.
-Augmented reality (AR) places audio players right on the page in every unit!
-Audio guide reveals the English with a tap.


Instructions:
The Lakota Media Player is easy to use. You’ll start out in Books, where you can select and download the content for your Lakota books. The Camera mode lets you use your phone’s camera to put audio content right on the page. The Audio Guide mode has the Lakota spellings, images, English translations and audio, all in one easy tap and swipe interface.


Books
- Tap download to receive the content for your Lakota book.
- Tap the image of the book’s cover to enter Camera mode.
- Select a book and tap Audio Guide to go directly to the Audio Guide.
- New books will automatically pop up in the books list when they become available.
- Occasionally, new content will be added to existing books. Just tap Update Now when it appears below one of your books.

Camera Mode
- Tap the Camera to enter Camera mode
- Look at the page through your iPhone or iPad's camera.
- Looking at the first page of each unit will set the current section; or you can select it from the list by tapping Llist.
- Explore the page and play buttons will pop up right on the page!
- Tap the buttons to hear the Lakota words.

*Image recognition performance may vary depending on device. Try the Audio Guide if you are having trouble getting all the play buttons to appear.

Audio Guide Mode
- Tap Audio Guide to enter Audio Guide mode.
- Select the section of the book from the list.
- Tap anywhere on the entry to hear the Lakota audio.
- Swipe down to scroll through the content for that section.
- If you aren’t sure from the image, tap Show English to make the English translation appear.
- Use the Next and Previous buttons
Related categories: Mobile App Development iPhone Android iPad