Nextcloud AIO container takes over 30 minutes to start

Support intro

Sorry to hear you’re facing problems :slightly_frowning_face:

help.nextcloud.com is for home/non-enterprise users. If you’re running a business, paid support can be accessed via portal.nextcloud.com where we can ensure your business keeps running smoothly.

In order to help you as quickly as possible, before clicking Create Topic please provide as much of the below as you can. Feel free to use a pastebin service for logs, otherwise either indent short log examples with four spaces:

example

Or for longer, use three backticks above and below the code snippet:

longer
example
here

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can :heart:

Nextcloud version: 29.0.4 - 29.0.4.1
Operating system: Debian 12.6 - Linux 6.1.0-23-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.1.99-1 (2024-07-15) x86_64
Webserver: Apache/2.4.62 (Unix) (fpm-fcgi)
PHP version: 8.2.21

The issue you are facing:

Nextcloud AIO container takes 30 minutes or more to start.

Is this the first time you’ve seen this error? (Y/N): Yes

Steps to replicate it:

  1. Restart the system or stop the containers

The output of your Nextcloud log in Admin > Logging:

cURL error 35: OpenSSL/3.3.1: error:0A000438:SSL routines::tlsv1 alert internal error (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://secret.supersecurenc.org/hosting/discovery
Failed to fetch discovery: cURL error 35: OpenSSL/3.3.1: error:0A000438:SSL routines::tlsv1 alert internal error (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://secret.supersecurenc.org/hosting/discovery

cURL error 35: OpenSSL/3.3.1: error:0A000438:SSL routines::tlsv1 alert internal error (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://secret.supersecurenc.org/hosting/capabilities
Failed to fetch capabilities: cURL error 35: OpenSSL/3.3.1: error:0A000438:SSL routines::tlsv1 alert internal error (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://secret.supersecurenc.org/hosting/capabilities

The output of your config.php file in /path/to/nextcloud (make sure you remove any identifiable information!):

{
    "one-click-instance": true,
    "one-click-instance.user-limit": 100,
    "memcache.local": "\\OC\\Memcache\\APCu",
    "apps_paths": [
        {
            "path": "\/var\/www\/html\/apps",
            "url": "\/apps",
            "writable": false
        },
        {
            "path": "\/var\/www\/html\/custom_apps",
            "url": "\/custom_apps",
            "writable": true
        }
    ],
    "appsallowlist": false,
    "check_data_directory_permissions": false,
    "memcache.distributed": "\\OC\\Memcache\\Redis",
    "memcache.locking": "\\OC\\Memcache\\Redis",
    "redis": {
        "host": "***REMOVED SENSITIVE VALUE***",
        "password": "***REMOVED SENSITIVE VALUE***",
        "port": 6379
    },
    "overwritehost": "secret.supersecurenc.org",
    "overwriteprotocol": "https",
    "passwordsalt": "***REMOVED SENSITIVE VALUE***",
    "secret": "***REMOVED SENSITIVE VALUE***",
    "trusted_domains": [
        "localhost",
        "secret.supersecurenc.org"
    ],
    "datadirectory": "***REMOVED SENSITIVE VALUE***",
    "dbtype": "pgsql",
    "version": "29.0.4.1",
    "overwrite.cli.url": "https:\/\/secret.supersecurenc.org\/",
    "dbname": "***REMOVED SENSITIVE VALUE***",
    "dbhost": "***REMOVED SENSITIVE VALUE***",
    "dbport": "",
    "dbtableprefix": "oc_",
    "dbuser": "***REMOVED SENSITIVE VALUE***",
    "dbpassword": "***REMOVED SENSITIVE VALUE***",
    "installed": true,
    "instanceid": "***REMOVED SENSITIVE VALUE***",
    "maintenance": false,
    "loglevel": "2",
    "log_type": "file",
    "logfile": "\/var\/www\/html\/data\/nextcloud.log",
    "log_rotate_size": "10485760",
    "log.condition": {
        "apps": [
            "admin_audit"
        ]
    },
    "preview_max_x": 2048,
    "preview_max_y": 2048,
    "jpeg_quality": 60,
    "enabledPreviewProviders": {
        "1": "OC\\Preview\\Image",
        "2": "OC\\Preview\\MarkDown",
        "3": "OC\\Preview\\MP3",
        "4": "OC\\Preview\\TXT",
        "5": "OC\\Preview\\OpenDocument",
        "6": "OC\\Preview\\Movie",
        "7": "OC\\Preview\\Krita",
        "0": "OC\\Preview\\Imaginary"
    },
    "enable_previews": true,
    "upgrade.disable-web": true,
    "mail_smtpmode": "smtp",
    "trashbin_retention_obligation": "auto, 30",
    "versions_retention_obligation": "auto, 30",
    "activity_expire_days": "30",
    "simpleSignUpLink.shown": false,
    "share_folder": "\/Shared",
    "one-click-instance.link": "https:\/\/nextcloud.com\/all-in-one\/",
    "upgrade.cli-upgrade-link": "https:\/\/github.com\/nextcloud\/all-in-one\/discussions\/2726",
    "updatedirectory": "\/nc-updater",
    "maintenance_window_start": 100,
    "allow_local_remote_servers": true,
    "davstorage.request_timeout": 3600,
    "htaccess.RewriteBase": "\/",
    "dbpersistent": false,
    "files_external_allow_create_new_local": false,
    "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
    "preview_imaginary_url": "***REMOVED SENSITIVE VALUE***",
    "preview_imaginary_key": "***REMOVED SENSITIVE VALUE***",
    "default_phone_region": "US",
    "mail_smtpsecure": "ssl",
    "mail_sendmailmode": "smtp",
    "mail_from_address": "***REMOVED SENSITIVE VALUE***",
    "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
    "mail_domain": "***REMOVED SENSITIVE VALUE***",
    "mail_smtpport": "465",
    "mail_smtpauth": 1,
    "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
    "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
    "memories.db.triggers.fcu": true,
    "memories.exiftool": "\/var\/www\/html\/custom_apps\/memories\/bin-ext\/exiftool-amd64-musl",
    "memories.vod.path": "\/var\/www\/html\/custom_apps\/memories\/bin-ext\/go-vod-amd64",
    "memories.vod.ffmpeg": "\/usr\/bin\/ffmpeg",
    "memories.vod.ffprobe": "\/usr\/bin\/ffprobe",
    "auth.bruteforce.protection.enabled": true,
    "ratelimit.protection.enabled": true,
    "data-fingerprint": "e3f6bc40924ce32b6ddd4e5c7b69bff5"
}

The output of your Apache/nginx/system log in /var/log/____:

How can I copy this?

Output errors in nextcloud.log in /var/www/ or as admin user in top right menu, filtering for errors. Use a pastebin service if necessary.

I don't  know if this is what you need.

cURL error 35: OpenSSL/3.3.1: error:0A000438:SSL routines::tlsv1 alert internal error (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://secret.supersecurenc.org/hosting/discovery
Failed to fetch discovery: cURL error 35: OpenSSL/3.3.1: error:0A000438:SSL routines::tlsv1 alert internal error (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://secret.supersecurenc.org/hosting/discovery

cURL error 35: OpenSSL/3.3.1: error:0A000438:SSL routines::tlsv1 alert internal error (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://secret.supersecurenc.org/hosting/capabilities
Failed to fetch capabilities: cURL error 35: OpenSSL/3.3.1: error:0A000438:SSL routines::tlsv1 alert internal error (see https://curl.haxx.se/libcurl/c/libcurl-errors.html) for https://secret.supersecurenc.org/hosting/capabilities

Here is also the output of https://internal.ip:8080/api/docker/logs?id=nextcloud-aio-nextcloud:

2024-08-21T06:11:25.802572397Z Connection to nextcloud-aio-database (172.18.0.4) 5432 port [tcp/postgresql] succeeded!
2024-08-21T06:11:27.911201994Z               now              
2024-08-21T06:11:27.911232275Z -------------------------------
2024-08-21T06:11:27.911237910Z  2024-08-21 02:11:27.901489-04
2024-08-21T06:11:27.911242686Z (1 row)
2024-08-21T06:11:27.911247059Z 
2024-08-21T06:11:27.920003511Z + '[' -f /dev-dri-group-was-added ']'
2024-08-21T06:11:27.926150856Z ++ find /dev -maxdepth 1 -mindepth 1 -name dri
2024-08-21T06:11:27.927488642Z + '[' -n '' ']'
2024-08-21T06:11:27.927495484Z + set +x
2024-08-21T06:11:27.938766234Z Enabling Imagick...
2024-08-21T06:11:30.362578388Z WARNING: opening from cache https://dl-cdn.alpinelinux.org/alpine/v3.20/main: No such file or directory
2024-08-21T06:11:30.362595324Z WARNING: opening from cache https://dl-cdn.alpinelinux.org/alpine/v3.20/community: No such file or directory
2024-08-21T06:11:30.383115023Z Connection to nextcloud-aio-redis (172.18.0.5) 6379 port [tcp/redis] succeeded!
2024-08-21T06:12:32.560944304Z Applying one-click-instance settings...
2024-08-21T06:13:03.040519389Z System config value one-click-instance set to boolean true
2024-08-21T06:13:33.550515972Z System config value one-click-instance.user-limit set to integer 100
2024-08-21T06:14:04.046576962Z System config value one-click-instance.link set to string https://nextcloud.com/all-in-one/
2024-08-21T06:14:34.536861521Z support already enabled
2024-08-21T06:14:34.555313635Z Adjusting log files...
2024-08-21T06:15:05.026678115Z System config value upgrade.cli-upgrade-link set to string https://github.com/nextcloud/all-in-one/discussions/2726
2024-08-21T06:15:35.517704170Z System config value logfile set to string /var/www/html/data/nextcloud.log
2024-08-21T06:16:06.004744211Z Config value were not updated
2024-08-21T06:16:36.490065855Z System config value updatedirectory set to string /nc-updater
2024-08-21T06:17:06.976586266Z System config value maintenance_window_start set to integer 100
2024-08-21T06:17:06.994904560Z Applying network settings...
2024-08-21T06:17:37.468206744Z System config value allow_local_remote_servers set to boolean true
2024-08-21T06:18:07.961462388Z System config value davstorage.request_timeout set to integer 3600
2024-08-21T06:18:38.450908595Z System config value trusted_domains => 1 set to string secret.supersecurenc.org
2024-08-21T06:19:08.940834317Z System config value overwrite.cli.url set to string https://secret.supersecurenc.org/
2024-08-21T06:19:39.432478307Z System config value htaccess.RewriteBase set to string /
2024-08-21T06:20:09.924929441Z .htaccess has been updated
2024-08-21T06:20:40.419781795Z System config value dbpersistent set to boolean false
2024-08-21T06:21:10.920543764Z System config value auth.bruteforce.protection.enabled set to boolean true
2024-08-21T06:21:41.415552516Z System config value ratelimit.protection.enabled set to boolean true
2024-08-21T06:22:11.921517506Z System config value files_external_allow_create_new_local set to boolean false
2024-08-21T06:23:54.663492496Z Waiting for database to start...
2024-08-21T06:23:59.695491635Z Connection to nextcloud-aio-database (172.18.0.9) 5432 port [tcp/postgresql] succeeded!
2024-08-21T06:24:01.813384451Z               now              
2024-08-21T06:24:01.813413072Z -------------------------------
2024-08-21T06:24:01.813418468Z  2024-08-21 02:24:01.772097-04
2024-08-21T06:24:01.813422826Z (1 row)
2024-08-21T06:24:01.813427035Z 
2024-08-21T06:24:01.840434504Z + '[' -f /dev-dri-group-was-added ']'
2024-08-21T06:24:01.843776526Z ++ find /dev -maxdepth 1 -mindepth 1 -name dri
2024-08-21T06:24:01.846072315Z + '[' -n '' ']'
2024-08-21T06:24:01.846089481Z + set +x
2024-08-21T06:24:01.897535760Z Connection to nextcloud-aio-redis (172.18.0.5) 6379 port [tcp/redis] succeeded!
2024-08-21T06:25:05.034680513Z Applying one-click-instance settings...
2024-08-21T06:25:35.532778741Z System config value one-click-instance set to boolean true
2024-08-21T06:26:06.047743422Z System config value one-click-instance.user-limit set to integer 100
2024-08-21T06:26:36.533619791Z System config value one-click-instance.link set to string https://nextcloud.com/all-in-one/
2024-08-21T06:27:07.029622616Z support already enabled
2024-08-21T06:27:07.048795324Z Adjusting log files...
2024-08-21T06:27:37.533208921Z System config value upgrade.cli-upgrade-link set to string https://github.com/nextcloud/all-in-one/discussions/2726
2024-08-21T06:28:08.034936299Z System config value logfile set to string /var/www/html/data/nextcloud.log
2024-08-21T06:28:38.519501259Z Config value were not updated
2024-08-21T06:29:09.008855363Z System config value updatedirectory set to string /nc-updater
2024-08-21T06:29:39.495138995Z System config value maintenance_window_start set to integer 100
2024-08-21T06:29:39.513586139Z Applying network settings...
2024-08-21T06:30:10.001431499Z System config value allow_local_remote_servers set to boolean true
2024-08-21T06:30:40.488614623Z System config value davstorage.request_timeout set to integer 3600
2024-08-21T06:31:10.978325920Z System config value trusted_domains => 1 set to string secret.supersecurenc.org
2024-08-21T06:31:41.463943410Z System config value overwrite.cli.url set to string https://secret.supersecurenc.org/
2024-08-21T06:32:11.955742726Z System config value htaccess.RewriteBase set to string /
2024-08-21T06:32:42.445560709Z .htaccess has been updated
2024-08-21T06:33:12.934066368Z System config value dbpersistent set to boolean false
2024-08-21T06:33:43.422892678Z System config value auth.bruteforce.protection.enabled set to boolean true
2024-08-21T06:34:13.910014624Z System config value ratelimit.protection.enabled set to boolean true
2024-08-21T06:34:44.399274165Z System config value files_external_allow_create_new_local set to boolean false
2024-08-21T06:36:18.024066296Z notify_push is up-to-date or no updates could be found
2024-08-21T06:36:48.515103080Z System config value trusted_proxies => 0 set to string 127.0.0.1
2024-08-21T06:37:19.008330682Z System config value trusted_proxies => 1 set to string ::1
2024-08-21T06:37:49.543722586Z System config value trusted_proxies => 10 set to string 172.18.0.0/16
2024-08-21T06:38:20.038221452Z Config value were not updated
2024-08-21T06:38:20.057032069Z + echo nextcloud-aio-collabora
2024-08-21T06:38:20.057075328Z + grep -q 'nextcloud-.*-collabora'
2024-08-21T06:38:20.058184646Z + COLLABORA_HOST=secret.supersecurenc.org
2024-08-21T06:38:20.058202519Z + set +x
2024-08-21T06:39:21.091357804Z richdocuments is up-to-date or no updates could be found
2024-08-21T06:39:51.579466529Z Config value were not updated
2024-08-21T06:40:22.204252019Z No ipv6-address found for secret.supersecurenc.org.
2024-08-21T06:40:52.681598432Z Config value were not updated
2024-08-21T06:40:52.699046711Z + '[' -z '' ']'
2024-08-21T06:40:52.699071447Z + TALK_HOST=secret.supersecurenc.org
2024-08-21T06:40:52.699076843Z + HPB_PATH=/standalone-signaling/
2024-08-21T06:40:52.699081447Z + '[' -z '' ']'
2024-08-21T06:40:52.699085435Z + TURN_DOMAIN=secret.supersecurenc.org
2024-08-21T06:40:52.699089653Z + set +x
2024-08-21T06:41:53.723157900Z spreed is up-to-date or no updates could be found
2024-08-21T06:43:25.203967244Z Connection to nextcloud-aio-talk-recording (172.18.0.12) 1234 port [tcp/*] succeeded!
2024-08-21T06:43:55.686270052Z Config value were not updated
2024-08-21T06:43:55.704310076Z Connection to nextcloud-aio-clamav (172.18.0.3) 3310 port [tcp/*] succeeded!
2024-08-21T06:44:56.739368163Z files_antivirus is up-to-date or no updates could be found
2024-08-21T06:45:27.229316241Z Config value were not updated
2024-08-21T06:45:57.718924375Z Config value were not updated
2024-08-21T06:46:28.224517813Z Config value were not updated
2024-08-21T06:46:58.708724478Z Config value were not updated
2024-08-21T06:47:29.198988885Z Config value were not updated
2024-08-21T06:47:59.684157410Z Config value were not updated
2024-08-21T06:48:30.202856310Z System config value enabledPreviewProviders => 0 set to string OC\Preview\Imaginary
2024-08-21T06:49:00.700608702Z System config value preview_imaginary_url set to string http://nextcloud-aio-imaginary:9000
2024-08-21T06:49:31.205852045Z System config value preview_imaginary_key set to string 30f4306aaf9c9dc6384aa691bd6c5529c3a1761f17a7e319
2024-08-21T06:49:31.225677659Z Connection to nextcloud-aio-fulltextsearch (172.18.0.13) 9200 port [tcp/*] succeeded!
2024-08-21T06:50:32.265050196Z fulltextsearch is up-to-date or no updates could be found
2024-08-21T06:51:33.294951649Z fulltextsearch_elasticsearch is up-to-date or no updates could be found
2024-08-21T06:52:34.337952721Z files_fulltextsearch is up-to-date or no updates could be found
2024-08-21T06:53:04.826006152Z {
2024-08-21T06:53:04.826037459Z     "search_platform": "OCA\\FullTextSearch_Elasticsearch\\Platform\\ElasticSearchPlatform",
2024-08-21T06:53:04.826043750Z     "app_navigation": "0",
2024-08-21T06:53:04.826054391Z     "provider_indexed": "",
2024-08-21T06:53:04.826059977Z     "cron_err_reset": "1723705422",
2024-08-21T06:53:04.826064338Z     "tick_ttl": "1800",
2024-08-21T06:53:04.826068609Z     "collection_indexing_list": "50",
2024-08-21T06:53:04.826072884Z     "migration_24": "1",
2024-08-21T06:53:04.826077175Z     "collection_internal": "local"
2024-08-21T06:53:04.826081544Z }
2024-08-21T06:53:35.310472165Z {
2024-08-21T06:53:35.310498914Z     "elastic_host": "http:\/\/elastic:5ac051ae571eefff62e791d2999596b4bf1b48c1253b4f3f@nextcloud-aio-fulltextsearch:9200",
2024-08-21T06:53:35.310504887Z     "elastic_index": "nextcloud-aio",
2024-08-21T06:53:35.310509537Z     "fields_limit": "10000",
2024-08-21T06:53:35.310513930Z     "es_ver_below66": "0",
2024-08-21T06:53:35.310518190Z     "elastic_logger_enabled": "true",
2024-08-21T06:53:35.310522405Z     "analyzer_tokenizer": "standard",
2024-08-21T06:53:35.310526652Z     "allow_self_signed_cert": "false"
2024-08-21T06:53:35.310530879Z }
2024-08-21T06:54:05.797824276Z {
2024-08-21T06:54:05.797854692Z     "files_local": "1",
2024-08-21T06:54:05.797860409Z     "files_external": "0",
2024-08-21T06:54:05.797864927Z     "files_group_folders": "0",
2024-08-21T06:54:05.797869250Z     "files_encrypted": "0",
2024-08-21T06:54:05.797873533Z     "files_federated": "0",
2024-08-21T06:54:05.797877712Z     "files_size": "20",
2024-08-21T06:54:05.797882022Z     "files_pdf": "1",
2024-08-21T06:54:05.797886215Z     "files_office": "1",
2024-08-21T06:54:05.797890378Z     "files_image": "0",
2024-08-21T06:54:05.797894544Z     "files_audio": "0",
2024-08-21T06:54:05.797898727Z     "files_chunk_size": "2"
2024-08-21T06:54:05.797902998Z }
2024-08-21T06:55:06.881733168Z app_api is up-to-date or no updates could be found
2024-08-21T06:55:06.923100948Z + '[' true = true ']'
2024-08-21T06:55:06.923140739Z + '[' 443 = 443 ']'
2024-08-21T06:55:06.923762849Z ++ dig nextcloud-aio-apache A +short +search
2024-08-21T06:55:06.924404138Z ++ grep '^[0-9.]\+$'
2024-08-21T06:55:06.924419533Z ++ sort
2024-08-21T06:55:06.924424823Z ++ head -n1
2024-08-21T06:55:06.945301020Z + IPv4_ADDRESS_APACHE=172.18.0.10
2024-08-21T06:55:06.945921475Z ++ dig nextcloud-aio-apache AAAA +short +search
2024-08-21T06:55:06.945933770Z ++ grep '^[0-9a-f:]\+$'
2024-08-21T06:55:06.946166072Z ++ sort
2024-08-21T06:55:06.946296800Z ++ head -n1
2024-08-21T06:55:06.967149448Z + IPv6_ADDRESS_APACHE=
2024-08-21T06:55:06.967749238Z ++ dig nextcloud-aio-mastercontainer A +short +search
2024-08-21T06:55:06.967841498Z ++ grep '^[0-9.]\+$'
2024-08-21T06:55:06.968075960Z ++ sort
2024-08-21T06:55:06.968229595Z ++ head -n1
2024-08-21T06:55:06.989601977Z + IPv4_ADDRESS_MASTERCONTAINER=172.18.0.14
2024-08-21T06:55:06.990205956Z ++ dig nextcloud-aio-mastercontainer AAAA +short +search
2024-08-21T06:55:06.990248204Z ++ grep '^[0-9a-f:]\+$'
2024-08-21T06:55:06.990553012Z ++ sort
2024-08-21T06:55:06.990565528Z ++ head -n1
2024-08-21T06:55:07.011406601Z + IPv6_ADDRESS_MASTERCONTAINER=
2024-08-21T06:55:07.011478117Z + sed -i 's|^;listen.allowed_clients|listen.allowed_clients|' /usr/local/etc/php-fpm.d/www.conf
2024-08-21T06:55:07.014177478Z + sed -i 's|listen.allowed_clients.*|listen.allowed_clients = 127.0.0.1,::1,172.18.0.10,,172.18.0.14,|' /usr/local/etc/php-fpm.d/www.conf
2024-08-21T06:55:07.016173164Z + sed -i '/^listen.allowed_clients/s/,,/,/g' /usr/local/etc/php-fpm.d/www.conf
2024-08-21T06:55:07.018858876Z + sed -i '/^listen.allowed_clients/s/,$//' /usr/local/etc/php-fpm.d/www.conf
2024-08-21T06:55:07.020488005Z + grep listen.allowed_clients /usr/local/etc/php-fpm.d/www.conf
2024-08-21T06:55:07.021829701Z listen.allowed_clients = 127.0.0.1,::1,172.18.0.10,172.18.0.14
2024-08-21T06:55:07.022431297Z + set +x
2024-08-21T06:55:08.614404220Z [21-Aug-2024 02:55:08] NOTICE: fpm is running, pid 1197
2024-08-21T06:55:08.614429098Z [21-Aug-2024 02:55:08] NOTICE: ready to handle connections
2024-08-21T06:55:23.457596392Z Activating Collabora config...
2024-08-21T06:55:24.039797038Z ✓ Reset callback url autodetect
2024-08-21T06:55:24.039826829Z Checking configuration
2024-08-21T06:55:24.039832616Z 🛈 Configured WOPI URL: https://secret.supersecurenc.org
2024-08-21T06:55:24.039837490Z 🛈 Configured public WOPI URL: https://secret.supersecurenc.org
2024-08-21T06:55:24.039842003Z 🛈 Configured callback URL: 
2024-08-21T06:55:24.039907772Z 
2024-08-21T06:55:24.215629735Z ✓ Fetched /hosting/discovery endpoint
2024-08-21T06:55:24.219244762Z ✓ Valid mimetype response
2024-08-21T06:55:24.221365034Z ✓ Valid capabilities entry
2024-08-21T06:55:24.327960904Z ✓ Fetched /hosting/capabilities endpoint
2024-08-21T06:55:24.328119959Z ✓ Detected WOPI server: Collabora Online Development Edition 24.04.5.2
2024-08-21T06:55:24.330281951Z 
2024-08-21T06:55:24.330335619Z Collabora URL (used for Nextcloud to contact the Collabora server):
2024-08-21T06:55:24.330344004Z   https://secret.supersecurenc.org
2024-08-21T06:55:24.330348529Z Collabora public URL (used in the browser to open Collabora):
2024-08-21T06:55:24.330352658Z   https://secret.supersecurenc.org
2024-08-21T06:55:24.330356760Z Callback URL (used by Collabora to connect back to Nextcloud):
2024-08-21T06:55:24.330360938Z   autodetected (will use the same URL as your user for browsing Nextcloud)

I think I added everything that was asked in the support template except the Apache log because I don’t know how to get it.

1 Like

Definitely unusual.

Couple questions:

  • Has it always behaved this way for you?
  • Do you have any sense of the resource usage (CPU, memory, disk I/O) on your underlying host when the containers are starting up?
  • What is your underlying host/Docker environment?

Hello there!
Thank you for taking the time of checking my post.

Has it always behaved this way for you?

No. I’ve been using Nextcloud for about a year and it was always fast to start. It used to take like 3 minutes to be up and running. I don’t know what happened. I didn’t have any hardware change or anything like that. Yesterday I reinstalled the base OS and and tested a new AIO instance and the new one runs fine. It starts as it should: 3 minutes. So I removed the new one and restored mine and it got slow again.

Do you have any sense of the resource usage (CPU, memory, disk I/O) on your underlying host when the containers are starting up? What is your underlying host/Docker environment?

I’m hosting Nextcloud on my Proxmox Server. I have a VM exclusively for Nextcloud, nothing else is running in that VM so it’s not using up a lot of resources as you can see here.

On this VM I just installed Debian 12 and then I just followed the instructions to install Nextcloud AIO. The Proxmox Server itself has an Intel i5-9500 with 64GB DDR4 RAM.

The Nextcloud VM has 16GB of RAM assigned to it with the first virtual drive being a 50GB SSD as boot drive and a second virtual drive which is really a ZPool on Proxmox of six 1TB drives.
The VM itself sees it as one drive. I store Nextcloud data and backups on that second drive.

If there’s anything else you need to know, let me know.

I also noticed that there’s about a 30 second delay on 95% of the lines shown on the output of https://internal.ip:8080/api/docker/logs?id=nextcloud-aio-nextcloud

Nobody is able to help me?

So I removed the new one and restored mine and it got slow again.

Anything different about the underlying storage or network config between the test and the live (slow) deployment?

No. I didn’t change anything.

Hi, this sounds like Nextcloud AIO pausing for 30 seconds between every step, takes 30+ mins to start · nextcloud/all-in-one · Discussion #5123 · GitHub

Hello there @szaimen
Thank you very much for taking the time of reading my post.

Yeah, I saw that while I was searching online and it’s basically the same thing that is happening to me but in my case, I’m not using Caddy. I’m not using a reverse proxy at all.

I also followed the instructions you provided on #5051 and when typing sudo docker ps, all my containers are showing as healthy.

When typing sudo docker inspect nextcloud-aio-apache, I tried to find errors but didn’t find any. For the sake of testing I also disabled ufw since the user from #5051 said that disabling it solved the issue so I did the same and then restarted the VM and Proxmox with no change at all. That was the last update in #5051 so I got stuck.

Here is the output for sudo docker ps

CONTAINER ID   IMAGE                                      COMMAND                  CREATED        STATUS                  PORTS                                                                                              NAMES
b0123a45678c   nextcloud/aio-apache:latest                "/start.sh /usr/bin/…"   14 hours ago   Up 14 hours (healthy)   80/tcp, 0.0.0.0:443->443/tcp, 0.0.0.0:443->443/udp, :::443->443/tcp, :::443->443/udp               nextcloud-aio-apache
1f23456ab790   nextcloud/aio-notify-push:latest           "/start.sh"              14 hours ago   Up 14 hours (healthy)                                                                                                      nextcloud-aio-notify-push
1e2c3b456b78   nextcloud/aio-nextcloud:latest             "/start.sh /usr/bin/…"   14 hours ago   Up 14 hours (healthy)   9000/tcp                                                                                           nextcloud-aio-nextcloud
1d23b4567890   nextcloud/aio-docker-socket-proxy:latest   "/start.sh"              14 hours ago   Up 14 hours (healthy)                                                                                                      nextcloud-aio-docker-socket-proxy
c123a4af56a7   nextcloud/aio-imaginary:latest             "/start.sh"              14 hours ago   Up 14 hours (healthy)                                                                                                      nextcloud-aio-imaginary
1c234f5678ef   nextcloud/aio-talk-recording:latest        "/start.sh python -m…"   14 hours ago   Up 14 hours (healthy)                                                                                                      nextcloud-aio-talk-recording
a1afa234567a   nextcloud/aio-fulltextsearch:latest        "/bin/tini -- /usr/l…"   14 hours ago   Up 14 hours (healthy)   9200/tcp, 9300/tcp                                                                                 nextcloud-aio-fulltextsearch
1a2c3d4d5e67   nextcloud/aio-clamav:latest                "/init-unprivileged"     14 hours ago   Up 14 hours (healthy)   3310/tcp, 7357/tcp                                                                                 nextcloud-aio-clamav
f1a23df45dd6   nextcloud/aio-redis:latest                 "/start.sh"              14 hours ago   Up 14 hours (healthy)   6379/tcp                                                                                           nextcloud-aio-redis
b1e234db5a67   nextcloud/aio-postgresql:latest            "/start.sh"              14 hours ago   Up 14 hours (healthy)   5432/tcp                                                                                           nextcloud-aio-database
ae12a34ef5f6   nextcloud/aio-talk:latest                  "/start.sh superviso…"   14 hours ago   Up 14 hours (healthy)   0.0.0.0:3478->3478/tcp, 0.0.0.0:3478->3478/udp, :::3478->3478/tcp, :::3478->3478/udp               nextcloud-aio-talk
1f2f3a456eda   nextcloud/aio-collabora:latest             "/start-collabora-on…"   14 hours ago   Up 14 hours (healthy)   9980/tcp                                                                                           nextcloud-aio-collabora
1ac2f3bce45e   nextcloud/all-in-one:latest                "/start.sh"              7 days ago     Up 5 days (healthy)     0.0.0.0:80->80/tcp, :::80->80/tcp, 8443/tcp, 0.0.0.0:8080->8080/tcp, :::8080->8080/tcp, 9000/tcp   nextcloud-aio-mastercontainer

Here is the output for sudo docker inspect nextcloud-aio-apache
I tried to remove all sensitive information.
Hopefully I didn’t leave anything out nor removed something useful.

[
    {
        "Id": "ThisIsAnIdThatIDontKnowIfItsSensitiveOrNot",
        "Created": "2024-08-27T06:02:11.404462157Z",
        "Path": "/start.sh",
        "Args": [
            "/usr/bin/supervisord",
            "-c",
            "/supervisord.conf"
        ],
        "State": {
            "Status": "running",
            "Running": true,
            "Paused": false,
            "Restarting": false,
            "OOMKilled": false,
            "Dead": false,
            "Pid": 1467557,
            "ExitCode": 0,
            "Error": "",
            "StartedAt": "2024-08-27T06:02:11.666609971Z",
            "FinishedAt": "0001-01-01T00:00:00Z",
            "Health": {
                "Status": "healthy",
                "FailingStreak": 0,
                "Log": [
                    {
                        "Start": "2024-08-27T15:51:12.774439905-04:00",
                        "End": "2024-08-27T15:51:12.886853941-04:00",
                        "ExitCode": 0,
                        "Output": "Connection to nextcloud-aio-nextcloud (172.18.0.11) 9000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 8000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 443 port [tcp/https] succeeded!\nConnection to secret.supersecurenc.org (Hiding.IP.For.Privacy) 443 port [tcp/https] succeeded!\n"
                    },
                    {
                        "Start": "2024-08-27T15:51:42.88767283-04:00",
                        "End": "2024-08-27T15:51:43.006925414-04:00",
                        "ExitCode": 0,
                        "Output": "Connection to nextcloud-aio-nextcloud (172.18.0.11) 9000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 8000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 443 port [tcp/https] succeeded!\nConnection to secret.supersecurenc.org (Hiding.IP.For.Privacy) 443 port [tcp/https] succeeded!\n"
                    },
                    {
                        "Start": "2024-08-27T15:52:13.007670969-04:00",
                        "End": "2024-08-27T15:52:13.117625013-04:00",
                        "ExitCode": 0,
                        "Output": "Connection to nextcloud-aio-nextcloud (172.18.0.11) 9000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 8000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 443 port [tcp/https] succeeded!\nConnection to secret.supersecurenc.org (Hiding.IP.For.Privacy) 443 port [tcp/https] succeeded!\n"
                    },
                    {
                        "Start": "2024-08-27T15:52:43.118395391-04:00",
                        "End": "2024-08-27T15:52:43.235369171-04:00",
                        "ExitCode": 0,
                        "Output": "Connection to nextcloud-aio-nextcloud (172.18.0.11) 9000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 8000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 443 port [tcp/https] succeeded!\nConnection to secret.supersecurenc.org (Hiding.IP.For.Privacy) 443 port [tcp/https] succeeded!\n"
                    },
                    {
                        "Start": "2024-08-27T15:53:13.23635652-04:00",
                        "End": "2024-08-27T15:53:13.354267943-04:00",
                        "ExitCode": 0,
                        "Output": "Connection to nextcloud-aio-nextcloud (172.18.0.11) 9000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 8000 port [tcp/*] succeeded!\nConnection to 127.0.0.1 443 port [tcp/https] succeeded!\nConnection to secret.supersecurenc.org (Hiding.IP.For.Privacy) 443 port [tcp/https] succeeded!\n"
                    }
                ]
            }
        },
        "Image": "sha256:HidingThisCuzMightBeSensitive",
        "ResolvConfPath": "/var/lib/docker/containers/ThisIsAnIdThatIDontKnowIfItsSensitiveOrNot/resolv.conf",
        "HostnamePath": "/var/lib/docker/containers/ThisIsAnIdThatIDontKnowIfItsSensitiveOrNot/hostname",
        "HostsPath": "/var/lib/docker/containers/ThisIsAnIdThatIDontKnowIfItsSensitiveOrNot/hosts",
        "LogPath": "/var/lib/docker/containers/ThisIsAnIdThatIDontKnowIfItsSensitiveOrNot/ThisIsAnIdThatIDontKnowIfItsSensitiveOrNot-json.log",
        "Name": "/nextcloud-aio-apache",
        "RestartCount": 0,
        "Driver": "overlay2",
        "Platform": "linux",
        "MountLabel": "",
        "ProcessLabel": "",
        "AppArmorProfile": "docker-default",
        "ExecIDs": null,
        "HostConfig": {
            "Binds": [
                "nextcloud_aio_nextcloud:/var/www/html:ro",
                "nextcloud_aio_apache:/mnt/data:rw"
            ],
            "ContainerIDFile": "",
            "LogConfig": {
                "Type": "json-file",
                "Config": {}
            },
            "NetworkMode": "nextcloud-aio",
            "PortBindings": {
                "443/tcp": [
                    {
                        "HostIp": "",
                        "HostPort": "443"
                    }
                ],
                "443/udp": [
                    {
                        "HostIp": "",
                        "HostPort": "443"
                    }
                ]
            },
            "RestartPolicy": {
                "Name": "unless-stopped",
                "MaximumRetryCount": 0
            },
            "AutoRemove": false,
            "VolumeDriver": "",
            "VolumesFrom": null,
            "ConsoleSize": [
                0,
                0
            ],
            "CapAdd": null,
            "CapDrop": [
                "NET_RAW"
            ],
            "CgroupnsMode": "private",
            "Dns": null,
            "DnsOptions": null,
            "DnsSearch": null,
            "ExtraHosts": null,
            "GroupAdd": null,
            "IpcMode": "private",
            "Cgroup": "",
            "Links": null,
            "OomScoreAdj": 0,
            "PidMode": "",
            "Privileged": false,
            "PublishAllPorts": false,
            "ReadonlyRootfs": true,
            "SecurityOpt": [
                "label:disable"
            ],
            "Tmpfs": {
                "/home/www-data": "",
                "/tmp": "",
                "/usr/local/apache2/logs": "",
                "/var/log/supervisord": "",
                "/var/run/supervisord": ""
            },
            "UTSMode": "",
            "UsernsMode": "",
            "ShmSize": 67108864,
            "Runtime": "runc",
            "Isolation": "",
            "CpuShares": 0,
            "Memory": 0,
            "NanoCpus": 0,
            "CgroupParent": "",
            "BlkioWeight": 0,
            "BlkioWeightDevice": null,
            "BlkioDeviceReadBps": null,
            "BlkioDeviceWriteBps": null,
            "BlkioDeviceReadIOps": null,
            "BlkioDeviceWriteIOps": null,
            "CpuPeriod": 0,
            "CpuQuota": 0,
            "CpuRealtimePeriod": 0,
            "CpuRealtimeRuntime": 0,
            "CpusetCpus": "",
            "CpusetMems": "",
            "Devices": null,
            "DeviceCgroupRules": null,
            "DeviceRequests": null,
            "MemoryReservation": 0,
            "MemorySwap": 0,
            "MemorySwappiness": null,
            "OomKillDisable": null,
            "PidsLimit": null,
            "Ulimits": null,
            "CpuCount": 0,
            "CpuPercent": 0,
            "IOMaximumIOps": 0,
            "IOMaximumBandwidth": 0,
            "MaskedPaths": [
                "/proc/asound",
                "/proc/acpi",
                "/proc/kcore",
                "/proc/keys",
                "/proc/latency_stats",
                "/proc/timer_list",
                "/proc/timer_stats",
                "/proc/sched_debug",
                "/proc/scsi",
                "/sys/firmware",
                "/sys/devices/virtual/powercap"
            ],
            "ReadonlyPaths": [
                "/proc/bus",
                "/proc/fs",
                "/proc/irq",
                "/proc/sys",
                "/proc/sysrq-trigger"
            ],
            "Init": true
        },
        "GraphDriver": {
            "Data": {
                "LowerDir": "/var/lib/docker/overlay2/RemovedBecauseItMightBeSensitive?-init/diff:/var/lib/docker/overlay2/Removed1/diff:/var/lib/docker/overlay2/Removed2/diff:/var/lib/docker/overlay2/Removed3/diff:/var/lib/docker/overlay2/Removed4/diff:/var/lib/docker/overlay2/Removed5/diff:/var/lib/docker/overlay2/Removed6/diff:/var/lib/docker/overlay2/Removed7/diff:/var/lib/docker/overlay2/Removed8/diff:/var/lib/docker/overlay2/Removed9/diff:/var/lib/docker/overlay2/Removed10/diff:/var/lib/docker/overlay2/Removed11/diff:/var/lib/docker/overlay2/Removed12/diff:/var/lib/docker/overlay2/Removed13/diff:/var/lib/docker/overlay2/Removed14/diff",
                "MergedDir": "/var/lib/docker/overlay2/RemovedBecauseItMightBeSensitive?/merged",
                "UpperDir": "/var/lib/docker/overlay2/RemovedBecauseItMightBeSensitive?/diff",
                "WorkDir": "/var/lib/docker/overlay2/RemovedBecauseItMightBeSensitive?/work"
            },
            "Name": "overlay2"
        },
        "Mounts": [
            {
                "Type": "volume",
                "Name": "nextcloud_aio_nextcloud",
                "Source": "/var/lib/docker/volumes/nextcloud_aio_nextcloud/_data",
                "Destination": "/var/www/html",
                "Driver": "local",
                "Mode": "ro",
                "RW": false,
                "Propagation": ""
            },
            {
                "Type": "volume",
                "Name": "nextcloud_aio_apache",
                "Source": "/var/lib/docker/volumes/nextcloud_aio_apache/_data",
                "Destination": "/mnt/data",
                "Driver": "local",
                "Mode": "rw",
                "RW": true,
                "Propagation": ""
            }
        ],
        "Config": {
            "Hostname": "b0123a45678c",
            "Domainname": "",
            "User": "www-data",
            "AttachStdin": false,
            "AttachStdout": false,
            "AttachStderr": false,
            "ExposedPorts": {
                "443/tcp": {},
                "443/udp": {},
                "80/tcp": {}
            },
            "Tty": false,
            "OpenStdin": false,
            "StdinOnce": false,
            "Env": [
                "NC_DOMAIN=secret.supersecurenc.org",
                "NEXTCLOUD_HOST=nextcloud-aio-nextcloud",
                "APACHE_HOST=nextcloud-aio-apache",
                "COLLABORA_HOST=nextcloud-aio-collabora",
                "TALK_HOST=nextcloud-aio-talk",
                "APACHE_PORT=443",
                "ONLYOFFICE_HOST=nextcloud-aio-onlyoffice",
                "TZ=America/New_York",
                "APACHE_MAX_SIZE=10737418240",
                "APACHE_MAX_TIME=3600",
                "NOTIFY_PUSH_HOST=nextcloud-aio-notify-push",
                "PATH=/usr/local/apache2/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                "HTTPD_PREFIX=/usr/local/apache2",
                "HTTPD_VERSION=2.4.62",
                "HTTPD_SHA256=RemovedBecauseItMightBeSensitive?",
                "HTTPD_PATCHES="
            ],
            "Cmd": [
                "/usr/bin/supervisord",
                "-c",
                "/supervisord.conf"
            ],
            "Healthcheck": {
                "Test": [
                    "CMD-SHELL",
                    "/healthcheck.sh"
                ]
            },
            "Image": "nextcloud/aio-apache:latest",
            "Volumes": {
                "/mnt/data": {}
            },
            "WorkingDir": "/usr/local/apache2",
            "Entrypoint": [
                "/start.sh"
            ],
            "OnBuild": null,
            "Labels": {
                "com.centurylinklabs.watchtower.enable": "false"
            },
            "StopSignal": "SIGWINCH"
        },
        "NetworkSettings": {
            "Bridge": "",
            "SandboxID": "RemovedInCaseItIsSensitive",
            "SandboxKey": "/var/run/docker/netns/12d3b4ef5a6e",
            "Ports": {
                "443/tcp": [
                    {
                        "HostIp": "0.0.0.0",
                        "HostPort": "443"
                    },
                    {
                        "HostIp": "::",
                        "HostPort": "443"
                    }
                ],
                "443/udp": [
                    {
                        "HostIp": "0.0.0.0",
                        "HostPort": "443"
                    },
                    {
                        "HostIp": "::",
                        "HostPort": "443"
                    }
                ],
                "80/tcp": null
            },
            "HairpinMode": false,
            "LinkLocalIPv6Address": "",
            "LinkLocalIPv6PrefixLen": 0,
            "SecondaryIPAddresses": null,
            "SecondaryIPv6Addresses": null,
            "EndpointID": "",
            "Gateway": "",
            "GlobalIPv6Address": "",
            "GlobalIPv6PrefixLen": 0,
            "IPAddress": "",
            "IPPrefixLen": 0,
            "IPv6Gateway": "",
            "MacAddress": "",
            "Networks": {
                "nextcloud-aio": {
                    "IPAMConfig": null,
                    "Links": null,
                    "Aliases": null,
                    "MacAddress": "my:secret:mac:address:00:00",
                    "DriverOpts": null,
                    "NetworkID": "SensitiveNetworkID?",
                    "EndpointID": "Sensitive?",
                    "Gateway": "172.18.0.1",
                    "IPAddress": "172.18.0.13",
                    "IPPrefixLen": 16,
                    "IPv6Gateway": "",
                    "GlobalIPv6Address": "",
                    "GlobalIPv6PrefixLen": 0,
                    "DNSNames": [
                        "nextcloud-aio-apache",
                        "b0123a45678c"
                    ]
                }
            }
        }
    }
]


Today I tried again. Backed up with borg, formatted the drive, reinstalled the OS, reinstalled Nextcloud AIO and restored the borg back up. Same thing. Takes 30 seconds for each step, which makes it take over 30 minutes to start. This is so frustrating.

@szaimen Is there anything you can do to help me?

Hi, I fear I am a bit out of ideas here. Only one thing comes to my mind: adjusting the MTU of your docker driver:
See e.g. first Installation stops by "Enabling Imagick..." in nextcloud-aio-nextcloud container · nextcloud/all-in-one · Discussion #4512 · GitHub

How can I do that?

I googled it: docker adjust mtu - Google Suche

Done. Same thing still happening.
Not surprising because it always work fine before I restoring the backup.

Is there a way to see in more detail why is it taking ~ 30 seconds for each step?
Like a more detailed log?

Are you using the Docker Engine in Ubuntu, the one officially from Docker, or the Snap?

My OS is Debian. Not Ubuntu.
I’m using the official Docker Engine, the one that was instructed here:

curl -fsSL https://get.docker.com | sudo sh