Hey,
So I’m trying to set up local ai and Nextcloud assistant for, I guess at this point for years, without very little succses. The furthest I ever managed to get is to get the stable-diffusion model to generate some pictures, but I could never get gpt4-j-all model ever to generate any texts, there was always some server error. So once again I’m here, to try to solve this issue, since the context chat seems very promising feature.
My current state with the issue is:
Nothing works I have the same local-ai container as before, with gpt4-j-all and stable diffusion, some whisper model etc. I’ve just tried to download llama by adding it to the yaml file and restart the container, but it didn’t work. (id not dowlaod) I don’t even care at this point, I only want to see some results with the gpt4-j-all modle at the very least.
So when I try to get something from the Nextcloud assistant theese are the error logs I get back:
[integration_openai] Warning: API request error : Server error: `POST http://nextcloud-aio-local-ai:8080/completions` resulted in a `500 Internal Server Error` response:
{"error":{"code":500,"message":"failed to load model with internal loader: backend not found: /tmp/localai/backend_data/ (truncated...)
[no app in context] Error: Unknown error while processing TaskProcessing task
[no app in context] Warning: A TaskProcessing core:text2text task with id 7 failed with the following message: OpenAI/LocalAI request failed: API request error: failed to load model with internal loader: backend not found: /tmp/localai/backend_data/backend-assets/grpc/gpt4all-j
[integration_openai] Warning: API request error : Server error: `POST http://nextcloud-aio-local-ai:8080/chat/completions` resulted in a `500 Internal Server Error` response:
{"error":{"code":500,"message":"failed to load model with internal loader: backend not found: /tmp/localai/backend_data/ (truncated...)
[integration_openai] Warning: OpenAI/LocalAI's text to image generation failed with: API request error: Resource not found
[integration_openai] Warning: API request error : Server error: `POST http://nextcloud-aio-local-ai:8080/completions` resulted in a `500 Internal Server Error` response:
{"error":{"code":500,"message":"failed to load model with internal loader: backend not found: /tmp/localai/backend_data/ (truncated...)
[no app in context] Error: Unknown error while processing TaskProcessing task