Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transcribe audio execution takes too long and causes failure. #151

Open
aef5748 opened this issue Nov 5, 2024 · 6 comments
Open

Transcribe audio execution takes too long and causes failure. #151

aef5748 opened this issue Nov 5, 2024 · 6 comments
Labels
bug Something isn't working

Comments

@aef5748
Copy link

aef5748 commented Nov 5, 2024

Which version of assistant are you using?

2.1.1

Which version of Nextcloud are you using?

30.0.1

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Chrome 130.0.6723.60

Describe the Bug

Upload a voice file of about 25m (voice length is about 1 hour) and send it to localai for conversion. It will show failure after about 5 minutes, but localai is still running, and the results will not be available until about 10 minutes. Can we modify the waiting time?

Expected Behavior

Wait until the task is completed and return the results

To Reproduce

  1. Upload a large voice file (about 25M or 1 hour of voice content)
  2. Use "Transcribe audio" and select this file to send
  3. waiting for localai response
@aef5748 aef5748 added the bug Something isn't working label Nov 5, 2024
@julien-nc
Copy link
Member

Have you tried changing the "Request timeout" admin setting? Even if it is in the "Text generation" section, it applies to transcription as well.

@aef5748
Copy link
Author

aef5748 commented Nov 7, 2024

I tried modifying it, but it didn't work
It still takes about 5 minutes to reply and shows failure.
When I set it to 600s, it will end in about 5 minutes
Image

@julien-nc
Copy link
Member

The worker needs to be restarted after changing the request timeout value. Are you sure it restarted at least once after you changed the timeout value and before you launched a new transcription task?

@aef5748
Copy link
Author

aef5748 commented Nov 8, 2024

Yes, I restarted the worker and nextcloud after the settings were completed.
I have tried the following situations:

  1. After restarting the worker, send multiple tasks and repeat them several times.
  2. Restart nextcloud and start the worker transfer task
  3. Change different options (Is there any difference between these two?)
    Image
  4. After modifying the parameter settings, repeat the above actions
    Image

No matter how the above is tested, the timeout is usually 5 minutes.
nextcloud_audio2text_timeout_20241108.log

@julien-nc
Copy link
Member

julien-nc commented Nov 8, 2024

  1. "LocalAI's Whisper Speech-To-Text" is the provider for the old transcription API that will be removed in the next release. Both providers are doing the same thing.

The error in your logs shows the timeout of the HTTP client (in integration_openai) is not reached but the peer (the server it reaches) ends the connection. So it looks like there is a timeout on the receiving end.

Are you using a proxy to reach LocalAI?
If so, there might be a timeout there.
If not, have you looked for processing time limits in LocalAI?

@aef5748
Copy link
Author

aef5748 commented Nov 12, 2024

After removing the proxy settings, it looks normal.
But if I still need proxy settings, how should I set them up?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants