Expo: Get audio data realtime and send via Socket.IO

2k views Asked by At

App I want to make

I would like to make audio recognition mobile app like Shazam with

I want to send recording data to machine learning based recognition server via Socket.IO every second or every sample (Maybe it is too much to send data sample-rate times per second), and then mobile app receives and shows predicted result.

Problem

How to get data while recording from recordingInstance ? I read Expo audio document, but I couldn't figure out how to do it.

So far

I ran two example:

Now I want to mix two examples. Thank you for reading. If I could console.log recording data, it would help much.

Related questions

1

There are 1 answers

0
Oguz Akkas On

I think I found a good solution to this problem.

await recordingInstance.prepareToRecordAsync(recordingOptions);
recordingInstance.setOnRecordingStatusUpdate(checkStatus);
recordingInstance.setProgressUpdateInterval(10000);
await recordingInstance.startAsync();
setRecording(recordingInstance);

Above after creating and preparing for recording, I added a callback function that runs every 10 seconds.

const duration = status.durationMillis / 1000;
const info = await FileSystem.getInfoAsync(recording.getURI());
const uri = info.uri;
console.log(`Recording Status: ${status.isRecording}, Duration: ${duration}, Meterring: ${status.metering}, Uri: ${uri}`)
if(duration >10 && duration - prevDuration > 0){
            sendBlob(uri);
        }
 setPrevDuration(duration);

The callback function checks if the duration is greater than 10 seconds and the difference between last duration is greater than 0, then sends the data through WebSocket.

Currently only problem, it doesn't run the callback the first time but runs the second time.