Skip to content

Fix Speech to Text streaming mode #741

@IgorSwat

Description

@IgorSwat

Problem description

There is some underlying issue with Speech To Text streaming mode, which causes it to not work properly in some use cases and/or on some devices. The issue is most likely caused by the native implementation, but problems with Whisper model cannot be ruled out.

What should be done

  1. Test the Speech To Text streaming mode and identify the issue conditions
  2. Find the issue cause in native code and/or exported model
  3. Fix the issue if possible

Benefits to React Native ExecuTorch

The issue is a potential blocker for many future tasks and projects involving real-time speech to text processing, such as #553 or many demo apps.

Metadata

Metadata

Assignees

Labels

important ❗This issue has high priorityimprovementPRs or issues focused on improvements in the current codebasemodelIssues related to exporting, improving, fixing ML models

Type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions