AI response very slow

Bonjour, :waving_hand:

  • Nextcloud Server version (e.g., 29.x.x):
    • 34.0.1
  • Operating system and version (e.g., Ubuntu 24.04):
    • Ubuntu 24.04
  • Web server and version (e.g, Apache 2.4.25):
    • AIO instance
  • Reverse proxy and version _(e.g. nginx 1.27.2)
    • Traefik
  • PHP version (e.g, 8.3):
    • AIO instance
  • Is this the first time you’ve seen this error? (Yes / No):
    • No
  • When did this problem seem to first start?
    • Since install AIO in version 31
  • Installation method (e.g. AlO, NCP, Bare Metal/Archive, etc.)
    • AIO instance
  • Are you using CloudfIare, mod_security, or similar? (Yes / No)
    • No

Summary of the issue you are facing:

When I try to interact with AI Assistant, it’s very very very slow… Just for LLM average of 5 minutes to answer to, for exemple: “Hi, how are you today?”

My VPS:

CPU: AMD EPYC Processor (with IBPB) (6 cores)

RAM: 11.68 GB

45% average use CPU and 7Go use on memory.

I use Mistral API endpoints

On OpenWebUI, no problem, instant answer.

What I can do for solve it ?

Nothing reveals in log.

Thanks

What version of AIO?

In AIO >=v13 AFAIK the task processing worker is used.

Hi,

Thanks.

I have `Nextcloud AIO v13.3.1`

What do you mean by `worker is used` ?

Thanks

Are there other ways to use the endpoint? And then I’d check the speed of the API. I have seen some models slowing down, depending on the model, the API/endpoint and licensing.

same endpoint?

Same endpoint.

https://api.mistral.ai/v1

Whatever model used, 3 minutes to answer, it’s little bit long.

Thanks

What do you mean by `worker is used` ?

Obviously, this is to be set up inside the NC container.

Are you able to reproduce the same problem with a different provider?

@TheWojtek Thanks!

This is the solution for my NextCloud AIO. Now, instant response.

set -e; while true; do docker exec -it nextcloud-aio-nextcloud sudo -E -u www-data php occ taskprocessing:worker -v -t 60; done

Maybe I will put in systemd service.

No plan to intergrate it to Nextcloud AIO ?

Thanks @jtr & @tflidd

Well in theory it already is, but it was relatively recently added. Perhaps there is a problem. Not in environment to test at the moment.

OK. I created a systemd service and it’s works.

Thanks