Flutter(IOS) Developer needed to integrate ASR, VAD , and TTS for a Proof of Concept
Budget: $100
Timeline: 1-2 weeks
Payment: Full payment on delivery after successful test on your and our physical iPhone
Why $100?
This is a focused, proof-of-concept task. We're not expecting production-level polish, therefore you can use any coding assistant to successfully complete the project by giving it the attached guide file.
Apply only if: You have a physical iPhone(simulator is not enough), know Platform Channels, and aren't afraid to experiment with background modes.
Project: ASR that runs in background in an iPhone
We’re building a Flutter app that receives audio from our hardware device via BLE and transcribes it locally on iOS while the app is in background. The audio session lasts ~45-60 seconds. We need someone to make this work reliably on an iPhone even when it's locked.
The core challenge: We know very well, that the iPhone is too restrictive on apps that run in background. We want to perform ASR even when our app is in background. So it's a challange. But we also have a hack. We think playing a low-frequency audio tone on the connected our hardware device through n ormal classic Bluetooth might keep the session alive, but we’re open to your approach.
What We Need
1. Use 'flutter_blue_plus' plugin, find our hardware through BLE discovery on the iPhone.
2. Listen to BLE notification channel to receive Opus Audio data from our hardware to the iPhone in background.
3. Transcribe it on-device using Whisper Tiny (or built-in Speech Recognizer or similiar), but **no cloud ASR at all**.
4. Keep it alive for atleast 45 seconds while iPhone is locked.
5. Our hardware will be also connected to the iPhone over normal Classic Bluetooth (just like a headphone) so just Play TTS response back through Bluetooth glasses
Success = App survives 45-60 seconds in background 5/5 times on your iPhone (iOS 16+).
Your Freedom to Choose
We're not tied to a specific architecture. Whether you use:
- Silent/sub-audible audio trick
- Or something we haven't thought of
We don't care as long as ASR, VAD functionality works on real iPhone(IOS 18+) devices while our app is in background and phone is locked.
What We'll Provide
- BLE data format spec
- Guide on how to implement
What You Need
- Flutter
- Native IOS
- "make it work" mindset
- If you live in 'Hyderabad' or 'Surat' then you are the greatest fit, because we can deliver my hardware to you for testing.
Is it impossible?
- Not at all, because we have used some application which does this, even app is in App store.
Apply tot his job
Apply To this Job