A bit confused Hub 6 where is my local AI?

–env AIO_COMMUNITY_CONTAINERS=" "

I try with “” and without but it make no differents

the last line : [24-May-2024 06:11:17] NOTICE: ready to handle connections

–init
–sig-proxy=false
–name nextcloud-aio-mastercontainer
–restart always
–publish 80:80
–publish 8080:8080
–publish 8443:8443
–volume nextcloud_aio_mastercontainer:/mnt/docker-aio-config
–volume /var/run/docker.sock:/var/run/docker.sock:ro
–env nextcloud_memory_limit=4096M --env PHP_MEMORY_LIMIT=4096M
–env AIO_COMMUNITY_CONTAINERS=“local-ai”
nextcloud/all-in-one:latest
“docker run” requires at least 1 argument.
See ‘docker run --help’.

Usage: docker run [OPTIONS] IMAGE [COMMAND] [ARG…]

Create and run a new container from an image
-bash: nextcloud/all-in-one:latest: No such file or directory

Oke it works …well…

ServerException
Server error: POST http://nextcloud-aio-local-ai:8080/v1/completions resulted in a 500 Internal Server Error response: {“error”:{“code”:500,“message”:"could not load model - all backends returned error: could not load model: rpc error: cod (truncated…)
API request error : Server error: POST http://nextcloud-aio-local-ai:8080/v1/completions resulted in a 500 Internal Server Error response: {“error”:{“code”:500,“message”:"could not load model - all backends returned error: could not load model: rpc error: cod (truncated…)

Hi, I am trying since yesterday to install the AI container and noticed the container does not have ports published, either external, nor internal. Since in settings/admin/connected-accounts the container is mentioned with port ánd the nextcloud container can´t reach the AI container over this port, I fear something goes wrong in the container definition.

Since I don´t know the internal port (since yesterday getting myself familiar with this) I don´t know how to fix this.

I dugged a little deeper and noticed https://github.com/nextcloud/all-in-one/blob/main/community-containers/local-ai/local-ai.json does contain an internal port but not an external port (though I am not an expert on this). Last edit is 5 month ago, so if this is the cause, it is failing for a long time on new deployments).

Exception
API request error: rpc error: code = Unavailable desc = error reading from server: EOF
OpenAI/LocalAI’s text to image generation failed with: API request error: rpc error: code = Unavailable desc = error reading from server: EOF

It looks like you need to do way more.
On the Github page there is only metion of filling the YAML file in the admin folder.

This is not even the beginning so you need to the admin manual.
Start here (Nextcloud Assistant — Nextcloud latest Administration Manual latest documentation), keep following the pages (hit next) and you may be able to understand the part about exapp what I can not follow.

Maybe you can help me on this part :slight_smile: