Problem with OpenAI for Nextcloud Assistant in Nexcloud 30

dfirmans · October 31, 2024, 8:18am

Nextcloud version (eg, 29.0.5): 30.0.1
Operating system and version (eg, Ubuntu 24.04): Ubuntu 24.04
Apache or nginx version (eg, Apache 2.4.25): `Nginx
PHP version (eg, 8.3): 8.1

The issue you are facing:
After upgrading to NC 30.0.1 the Nextcloud Assistant stop working, all parameters are the same like in Nextcloud Hub 8 (NC29). When i type something Chat with AI, it didnt reply anything. I don’t check what’s the error, but I have tried 3 times to uninstall the OpenAI and LocalAI App and repeat the process, it remains the same.

Is this the first time you’ve seen this error? (Y/N): Y

Steps to replicate it:

Upgrading from Nextcloud Hub 8 to 9
Running OCC after the upgrade as part of the instructed process after upgrade.
Testing all apps installed in new upgrade version, all works fine.
Testing Nextcloud Assistant, not working, no response from OpenAI

XueSheng-NC · October 31, 2024, 1:39pm

NC30 needs a worker service, otherwise your request is only processed after the next cron run.

github.com/nextcloud/assistant

[Bug]: No answer from KI in Assistent

opened 07:32AM - 04 Oct 24 UTC

cheesynator

bug

### ⚠️ This issue respects the following points: ⚠️ - [x] This is a **bug**, no…t a question or a configuration/webserver/proxy issue. - [x] This issue is **not** already reported on [Github](https://github.com/nextcloud/server/issues?q=is%3Aopen+is%3Aissue+label%3Abug) OR [Nextcloud Community Forum](https://help.nextcloud.com/) _(I've searched it)_. - [x] Nextcloud Server **is** up to date. See [Maintenance and Release Schedule](https://github.com/nextcloud/server/wiki/Maintenance-and-Release-Schedule) for supported versions. - [x] I agree to follow Nextcloud's [Code of Conduct](https://nextcloud.com/contribute/code-of-conduct/). ### Bug description Here is the translation: "I'm running Nextcloud on my Unraid server, which I have set up in a Docker container using the Linuxserver Image. Additionally, I've installed a local AI (Ollama and LocalAI) as well. When I enter the IP address of the AI (Ollama or LocalAI) into the App LocalAI under Nextcloud, the AI is found and displays the installed LLMs. The LLMs are running smoothly and I can chat with the KI using OpenWebUI or through the chat in (LocalAI). However, when I start a chat in the Nextcloud Assistant, I don't receive an answer. However, my question goes into Ollama and LocalAI (which can be seen in their logs) but is not processed. But if I set up a prompt using the Nextcloud App on my iPhone under "More / Assistant", I immediately get a response from the KI. After long searching, I was able to pinpoint the error. Under Nextcloud 29.0.7 (Docker Nextcloud:29.0.7) the response works fine. But with Nextcloud 30, I don't receive any answer. "I followed your test environment. 1. I installed the two Nextcloud Docker images: docker pull nextcloud:latest` and `nextcloud:29.0.7` (the official images) 2. I created an admin account on the welcome screen, using SQLite as the database. 3. I then installed the Assistent and LocalAI apps under Nextcloud 29.0.7 and 30 in the "Apps" section. 4. Under Settings > Artificial Intelligence > Admin area, I entered the IP address of the local AI (LocalAI and then Ollama). 5. The LLMs were displayed. I tested with llama3.2 and gpt4. 6. I opened the Assistent and started a chat with the KI. 7. Under 29.0.7, I received an immediate answer. Under 30, no answer was returned. 8. However, the KI responds to both 29.0.7 and 30 when using the Nextcloud iPhone app. Note: I didn't make any changes or configurations during these tests. The first start only created the admin user, and both tests were run with minimal system setups." I hope you can help me find a solution to this problem." Greetings Thomas ### Steps to reproduce 1. 2. 3. ### Expected behavior . ### Nextcloud Server version 30 ### Operating system Debian/Ubuntu ### PHP engine version PHP 8.3 ### Web server Apache (supported) ### Database engine version MariaDB ### Is this bug present after an update or on a fresh install? Fresh Nextcloud Server install ### Are you using the Nextcloud Server Encryption module? Encryption is Disabled ### What user-backends are you using? - [x] Default user-backend _(database)_ - [ ] LDAP/ Active Directory - [ ] SSO - SAML - [ ] Other ### Configuration report _No response_ ### List of activated Apps _No response_ ### Nextcloud Signing status _No response_ ### Nextcloud Logs _No response_ ### Additional info _No response_

dfirmans · October 31, 2024, 2:19pm

I take a a look that conversations in Github, it seems the issue still ongoing , do you have issue like I do? or it’s trully working just by activating workers?

XueSheng-NC · October 31, 2024, 2:32pm

I’m using LocalAI. Running the worker solves the issue that assistant does not respond.

MarslMarcello · November 24, 2024, 1:20pm

I commented the GH issue with the same error + I can see the request is sending /v1/v1 in the Post to my ollama server etc. Not sure if this has really something to do with the “workers topic” in NC 30.x.x version