Podman AIO: php-fpm locks system after some moments

Nextcloud version (eg, 20.0.5): 28 AIO 7.11.2
Operating system and version (eg, Ubuntu 20.04): Gentoo, Podman, 6.7.4-v8-16k+ aarch64 (raspberry pi 5)
Apache or nginx version (eg, Apache 2.4.25): AIO 7.11.2
PHP version (eg, 7.4): AIO 7.11.2

The issue you are facing:

Some moments after starting the containers from the AIO interface, but never longer than 5-10 minutes, the entire system becomes unresponsive. btop shows >20 php-fpm: pool www processes, which never terminate.

Is this the first time you’ve seen this error? (Y/N): Y

Steps to replicate it:

  1. I’ve installed Gentoo (btw) on a Raspberry Pi 5, and configured the kernel according to both the Docker and Podman gentoo wiki articles. I then installed podman and set up a Quadlet service to run Nextcloud AIO. SELinux is not enabled.
  2. Start the mastercontainer
  3. wait for a few hours - no change observed
  4. Start the containers from the AIO web interface
  5. wait for a few minutes
  6. Observe that the system has locked at 100% CPU / RAM use

The output of your Nextcloud log in Admin > Logging:

Logs inaccessible, system locked
The log from the mastercontainer:
Feb 12 08:26:10 gentoo systemd[434]: Starting Nextcloud AIO Master Container...
Feb 12 08:26:13 gentoo nextcloud-aio-mastercontainer[558]: Trying to pull docker.io/nextcloud/all-in-one:latest...
Feb 12 08:26:13 gentoo nextcloud-aio-mastercontainer[558]: Pulling image //nextcloud/all-in-one:latest inside systemd: setting pull timeout to 5m0s
Feb 12 08:26:13 gentoo nextcloud-aio-mastercontainer[558]: Error: initializing source docker://nextcloud/all-in-one:latest: pinging container registry registry-1.docker.io: Get "https://registry-1.docker.io/v2/": dial tcp: lookup registry-1.docker.io: Temporary failure in name resolution
Feb 12 08:26:14 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Main process exited, code=exited, status=125/n/a
Feb 12 08:26:14 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Failed with result 'exit-code'.
Feb 12 08:26:14 gentoo systemd[434]: Failed to start Nextcloud AIO Master Container.
Feb 12 08:26:14 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Scheduled restart job, restart counter is at 1.
Feb 12 08:26:14 gentoo systemd[434]: Starting Nextcloud AIO Master Container...
Feb 12 08:26:15 gentoo nextcloud-aio-mastercontainer[649]: Trying to pull docker.io/nextcloud/all-in-one:latest...
Feb 12 08:26:15 gentoo nextcloud-aio-mastercontainer[649]: Pulling image //nextcloud/all-in-one:latest inside systemd: setting pull timeout to 5m0s
Feb 12 08:26:15 gentoo nextcloud-aio-mastercontainer[649]: Error: initializing source docker://nextcloud/all-in-one:latest: pinging container registry registry-1.docker.io: Get "https://registry-1.docker.io/v2/": dial tcp: lookup registry-1.docker.io: Temporary failure in name resolution
Feb 12 08:26:15 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Main process exited, code=exited, status=125/n/a
Feb 12 08:26:15 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Failed with result 'exit-code'.
Feb 12 08:26:15 gentoo systemd[434]: Failed to start Nextcloud AIO Master Container.
Feb 12 08:26:15 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Scheduled restart job, restart counter is at 2.
Feb 12 08:26:15 gentoo systemd[434]: Starting Nextcloud AIO Master Container...
Feb 12 08:26:15 gentoo nextcloud-aio-mastercontainer[759]: Trying to pull docker.io/nextcloud/all-in-one:latest...
Feb 12 08:26:15 gentoo nextcloud-aio-mastercontainer[759]: Pulling image //nextcloud/all-in-one:latest inside systemd: setting pull timeout to 5m0s
Feb 12 08:26:15 gentoo nextcloud-aio-mastercontainer[759]: Error: initializing source docker://nextcloud/all-in-one:latest: pinging container registry registry-1.docker.io: Get "https://registry-1.docker.io/v2/": dial tcp: lookup registry-1.docker.io: Temporary failure in name resolution
Feb 12 08:26:15 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Main process exited, code=exited, status=125/n/a
Feb 12 08:26:16 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Failed with result 'exit-code'.
Feb 12 08:26:16 gentoo systemd[434]: Failed to start Nextcloud AIO Master Container.
Feb 12 08:26:16 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Scheduled restart job, restart counter is at 3.
Feb 12 08:26:16 gentoo systemd[434]: Starting Nextcloud AIO Master Container...
Feb 12 08:26:16 gentoo nextcloud-aio-mastercontainer[859]: Trying to pull docker.io/nextcloud/all-in-one:latest...
Feb 12 08:26:16 gentoo nextcloud-aio-mastercontainer[859]: Pulling image //nextcloud/all-in-one:latest inside systemd: setting pull timeout to 5m0s
Feb 12 08:26:16 gentoo nextcloud-aio-mastercontainer[859]: Error: initializing source docker://nextcloud/all-in-one:latest: pinging container registry registry-1.docker.io: Get "https://registry-1.docker.io/v2/": dial tcp: lookup registry-1.docker.io: Temporary failure in name resolution
Feb 12 08:26:16 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Main process exited, code=exited, status=125/n/a
Feb 12 08:26:16 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Failed with result 'exit-code'.
Feb 12 08:26:16 gentoo systemd[434]: Failed to start Nextcloud AIO Master Container.
Feb 12 08:26:17 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Scheduled restart job, restart counter is at 4.
Feb 12 08:26:17 gentoo systemd[434]: Starting Nextcloud AIO Master Container...
Feb 12 08:26:17 gentoo nextcloud-aio-mastercontainer[970]: Trying to pull docker.io/nextcloud/all-in-one:latest...
Feb 12 08:26:17 gentoo nextcloud-aio-mastercontainer[970]: Pulling image //nextcloud/all-in-one:latest inside systemd: setting pull timeout to 5m0s
Feb 12 08:26:17 gentoo nextcloud-aio-mastercontainer[970]: Error: initializing source docker://nextcloud/all-in-one:latest: pinging container registry registry-1.docker.io: Get "https://registry-1.docker.io/v2/": dial tcp: lookup registry-1.docker.io: Temporary failure in name resolution
Feb 12 08:26:17 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Main process exited, code=exited, status=125/n/a
Feb 12 08:26:17 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Failed with result 'exit-code'.
Feb 12 08:26:17 gentoo systemd[434]: Failed to start Nextcloud AIO Master Container.
Feb 12 08:26:17 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Scheduled restart job, restart counter is at 5.
Feb 12 08:26:17 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Start request repeated too quickly.
Feb 12 08:26:17 gentoo systemd[434]: nextcloud-aio-mastercontainer.service: Failed with result 'exit-code'.
Feb 12 08:26:17 gentoo systemd[434]: Failed to start Nextcloud AIO Master Container.
Feb 12 08:47:14 gentoo systemd[434]: Starting Nextcloud AIO Master Container...
Feb 12 08:47:14 gentoo nextcloud-aio-mastercontainer[46296]: Trying to pull docker.io/nextcloud/all-in-one:latest...
Feb 12 08:47:14 gentoo nextcloud-aio-mastercontainer[46296]: Pulling image //nextcloud/all-in-one:latest inside systemd: setting pull timeout to 5m0s
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Getting image source signatures
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:8352cd48d6f5128d38ac5cbc0c30c63dec181d4b6e82e8729a06d0e4da6aac07
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:8dbe855ad31e7cd79a1f706abb3a6b77f7e1457b5fb9b89c943ad0e8eb99d6a0
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:668e1297a24eb8494667895e01ee28dd6cc44e981089460ea0e662c9462aab42
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:dd4eb03fe552f5c8aa36cd79b78aa545592812821d1c3169cfeab7c2a2d2dfdc
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:c6b39de5b33961661dc939b997cc1d30cda01e38005a6c6625fd9c7e748bab44
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:1ecb7467a02f797b3b358a87cd793e73d849cb2dee4668faafaea6ac9037dc7b
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:93b34edf664727029f0e28359adadc17c1e374090cbac579e5d6c3b120124063
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:a410e0dcbdd51891d07a6f1e38b29551c9713d35cdfc5a03aedda38e5ecb4caa
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:a849110782c82d3af560a8dd1a21dcf236ae3c7ae6eb9c712ac006bc07e5f276
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:d2b560a4e1c6ec75a53d47e21254444d2f66c9be35d320411dadf7b78666c30d
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:42931bdc49a45e00981c2e2429dd24a43fa54f475ffaabefc86ff37d198210c3
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:1eb6ec6497cf80c1b6df930801d2cf6d2847e62575bfaae5970f615d458776f0
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:461c9271732d41aadf8470db4a0c2f13170c856efce991ecce531f2d234994f5
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:f39b6819f0058ca69b3578e5df8c8c6da607a61180607f97ec422a4c14295511
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:070659c6d3616c651187e90accec619962df17c8cf5b1df46f5dbce991369fa0
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:ef19b3bd31442e7732580ee1a2628b44b3ff6d90ec38d75b58b54d7ff63a342b
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:60c628dafdb720383a61cac70d1c51680c2673a646cc80473d4617865e409bda
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying blob sha256:d26d475282366dbb1f85e7f89526d07bee9d4a6f9aceb80ad6898dcc7d9760e7
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Copying config sha256:de8ab1049901a74690aadc860970c6b175bc33dd97e76f96528b6357d68071c3
Feb 12 08:47:17 gentoo nextcloud-aio-mastercontainer[46296]: Writing manifest to image destination
Feb 12 08:47:17 gentoo podman[46296]: 2024-02-12 08:47:17.964321667 +0200 IST m=+3.634812091 image pull de8ab1049901a74690aadc860970c6b175bc33dd97e76f96528b6357d68071c3 docker.io/nextcloud/all-in-one:latest
Feb 12 08:47:18 gentoo podman[46296]: 2024-02-12 08:47:18.059944445 +0200 IST m=+3.730434813 container create 6bd933d8ec6f64251dd64c197af9e7d5599cb5875c31def857e6fc880b06ce72 (image=docker.io/nextcloud/all-in-one:latest, name=nextcloud-aio-mastercontainer, PODMAN_SYSTEMD_UNIT=nextcloud-aio-mastercontainer.service, io.containers.autoupdate=registry)
Feb 12 08:47:18 gentoo conmon[46400]: conmon 6bd933d8ec6f64251dd6 <nwarn>: Failed to add inotify watch for /sys/fs/cgroup/user.slice/user-1000.slice/user@1000.service/app.slice/nextcloud-aio-mastercontainer.service/libpod-payload-6bd933d8ec6f64251dd64c197af9e7d5599cb5875c31def857e6fc880b06ce72/memory.events
Feb 12 08:47:18 gentoo podman[46296]: 2024-02-12 08:47:18.283398722 +0200 IST m=+3.953889109 container init 6bd933d8ec6f64251dd64c197af9e7d5599cb5875c31def857e6fc880b06ce72 (image=docker.io/nextcloud/all-in-one:latest, name=nextcloud-aio-mastercontainer, io.containers.autoupdate=registry, PODMAN_SYSTEMD_UNIT=nextcloud-aio-mastercontainer.service)
Feb 12 08:47:18 gentoo systemd[434]: Started Nextcloud AIO Master Container.
Feb 12 08:47:18 gentoo podman[46296]: 2024-02-12 08:47:18.322969056 +0200 IST m=+3.993459424 container start 6bd933d8ec6f64251dd64c197af9e7d5599cb5875c31def857e6fc880b06ce72 (image=docker.io/nextcloud/all-in-one:latest, name=nextcloud-aio-mastercontainer, io.containers.autoupdate=registry, PODMAN_SYSTEMD_UNIT=nextcloud-aio-mastercontainer.service)
Feb 12 08:47:18 gentoo nextcloud-aio-mastercontainer[46296]: 6bd933d8ec6f64251dd64c197af9e7d5599cb5875c31def857e6fc880b06ce72
Feb 12 08:47:18 gentoo nextcloud-aio-mastercontainer[46400]: Trying to fix docker.sock permissions internally...
Feb 12 08:47:18 gentoo nextcloud-aio-mastercontainer[46400]: Adding internal www-data to group root
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: WARNING: No memory limit support
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: WARNING: No swap limit support
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: WARNING: No cpu cfs quota support
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: WARNING: No cpu cfs period support
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: WARNING: No cpu shares support
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: WARNING: No cpuset support
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: WARNING: IPv4 forwarding is disabled
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: Initial startup of Nextcloud All-in-One complete!
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: You should be able to open the Nextcloud AIO Interface now on port 8080 of this server!
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: E.g. https://internal.ip.of.this.server:8080
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]:
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: If your server has port 80 and 8443 open and you point a domain to your server, you can get a valid certificate automatically by opening the Nextcloud AIO Interface via:
Feb 12 08:47:22 gentoo nextcloud-aio-mastercontainer[46400]: https://your-domain-that-points-to-this-server.tld:8443
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: ++ head -1 /mnt/docker-aio-config/data/daily_backup_time
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + BACKUP_TIME=04:00
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + export BACKUP_TIME
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + export DAILY_BACKUP=1
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + DAILY_BACKUP=1
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: ++ sed -n 2p /mnt/docker-aio-config/data/daily_backup_time
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + '[' '' '!=' automaticUpdatesAreNotEnabled ']'
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + export AUTOMATIC_UPDATES=1
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + AUTOMATIC_UPDATES=1
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: ++ sed -n 3p /mnt/docker-aio-config/data/daily_backup_time
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + '[' '' '!=' successNotificationsAreNotEnabled ']'
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + export SEND_SUCCESS_NOTIFICATIONS=1
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + SEND_SUCCESS_NOTIFICATIONS=1
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: + set +x
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: {"level":"info","ts":1707720445.2967346,"msg":"using provided configuration","config_file":"/Caddyfile","config_adapter":""}
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: [12-Feb-2024 06:47:25] NOTICE: fpm is running, pid 132
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: [12-Feb-2024 06:47:25] NOTICE: ready to handle connections
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: [Mon Feb 12 06:47:25.631842 2024] [mpm_event:notice] [pid 119:tid 140736022175840] AH00489: Apache/2.4.58 (Unix) OpenSSL/3.1.4 configured -- resuming normal operations
Feb 12 08:47:25 gentoo nextcloud-aio-mastercontainer[46400]: [Mon Feb 12 06:47:25.631994 2024] [core:notice] [pid 119:tid 140736022175840] AH00094: Command line: 'httpd -D FOREGROUND'
config.php (redacted):
<?php
$CONFIG = array (
  'one-click-instance' => true,
  'one-click-instance.user-limit' => 100,
  'memcache.local' => '\\OC\\Memcache\\APCu',
  'apps_paths' =>
  array (
    0 =>
    array (
      'path' => '/var/www/html/apps',
      'url' => '/apps',
      'writable' => false,
    ),
    1 =>
    array (
      'path' => '/var/www/html/custom_apps',
      'url' => '/custom_apps',
      'writable' => true,
    ),
  ),
  'appsallowlist' =>
  array (
  ),
  'check_data_directory_permissions' => false,
  'memcache.distributed' => '\\OC\\Memcache\\Redis',
  'memcache.locking' => '\\OC\\Memcache\\Redis',
  'redis' =>
  array (
    'host' => 'nextcloud-aio-redis',
    'password' => 'hmmm',
    'port' => 6379,
  ),
  'overwritehost' => 'hmmm',
  'overwriteprotocol' => 'https',
  'passwordsalt' => 'hmmm',
  'secret' => 'hmmm',
  'trusted_domains' =>
  array (
    0 => 'localhost',
    1 => 'hmmm',
  ),
  'datadirectory' => '/mnt/ncdata',
  'dbtype' => 'pgsql',
  'version' => '27.1.5.1',
  'overwrite.cli.url' => 'hmmm',
  'dbname' => 'nextcloud_database',
  'dbhost' => 'nextcloud-aio-database',
  'dbport' => '',
  'dbtableprefix' => 'oc_',
  'dbuser' => 'oc_nextcloud',
  'dbpassword' => 'hmmm',
  'installed' => true,
  'instanceid' => 'hmmm',
  'maintenance' => false,
  'loglevel' => '2',
  'log_type' => 'file',
  'logfile' => '/var/www/html/data/nextcloud.log',
  'log_rotate_size' => '10485760',
  'log.condition' =>
  array (
    'apps' =>
    array (
      0 => 'admin_audit',
    ),
  ),
  'preview_max_x' => '2048',
  'preview_max_y' => '2048',
  'jpeg_quality' => '60',
  'enabledPreviewProviders' =>
  array (
    1 => 'OC\\Preview\\Image',
    2 => 'OC\\Preview\\MarkDown',
    3 => 'OC\\Preview\\MP3',
    4 => 'OC\\Preview\\TXT',
    5 => 'OC\\Preview\\OpenDocument',
    6 => 'OC\\Preview\\Movie',
    7 => 'OC\\Preview\\Krita',
    0 => 'OC\\Preview\\Imaginary',
  ),
  'enable_previews' => true,
  'upgrade.disable-web' => true,
  'mail_smtpmode' => 'smtp',
  'trashbin_retention_obligation' => 'auto, 30',
  'versions_retention_obligation' => 'auto, 30',
  'activity_expire_days' => '30',
  'simpleSignUpLink.shown' => false,
  'share_folder' => '/Shared',
  'one-click-instance.link' => 'https://nextcloud.com/all-in-one/',
  'upgrade.cli-upgrade-link' => 'https://github.com/nextcloud/all-in-one/discussions/2726',
  'updatedirectory' => '/nc-updater',
  'allow_local_remote_servers' => true,
  'davstorage.request_timeout' => 3600,
  'htaccess.RewriteBase' => '/',
  'dbpersistent' => false,
  'files_external_allow_create_new_local' => false,
  'trusted_proxies' =>
  array (
    0 => '127.0.0.1',
    1 => '::1',
    2 => 'hmmm',
    3 => 'hmmm',
    4 => 'hmmm',
    5 => 'hmmm',
  ),
  'preview_imaginary_url' => 'http://nextcloud-aio-imaginary:9000',
  'default_phone_region' => 'IL',
  'mail_domain' => 'hmmm',
  'mail_from_address' => 'nextcloud',
  'mail_smtpauth' => 1,
  'mail_smtpauthtype' => 'LOGIN',
  'mail_smtphost' => 'hmmm',
  'mail_smtpname' => 'hmmm',
  'mail_smtppassword' => 'hmmm',
  'mail_smtpport' => 000,
  'mail_smtpsecure' => '',
  'app_install_overwrite' =>
  array (
    0 => 'podcast',
  ),
  'memories.exiftool' => '/var/www/html/custom_apps/memories/bin-ext/exiftool-aarch64-musl',
  'memories.vod.path' => '/var/www/html/custom_apps/memories/bin-ext/go-vod-aarch64',
  'memories.vod.ffmpeg' => '/usr/bin/ffmpeg',
  'memories.vod.ffprobe' => '/usr/bin/ffprobe',
  'data-fingerprint' => 'hmm',
);
nextcloud-aio-apache container log (redacted)
[Tue Feb 13 08:32:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (X11; Linux x86_64) (compatible; NewsFlash/3.1.0; RSS reader; +https://apps.gnome.org/NewsFlash/)]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (X11; Linux x86_64) (compatible; NewsFlash/3.1.0; RSS reader; +https://apps.gnome.org/NewsFlash/)]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (Android) Nextcloud-android/3.27.0]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (Android) Nextcloud-android/3.27.0]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [gnome-online-accounts/3.48.0 libsoup/3.4.4]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [gnome-online-accounts/3.48.0 libsoup/3.4.4]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [COOLWSD HTTP Agent 23.05.7.5]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (X11; Linux x86_64; rv:122.0) Gecko/20100101 Firefox/122.0]
[Tue Feb 13 08:34:46 2024] [error] [client: 999.999.999.999, 1.2.3.4] [AH01067: Failed to read FastCGI header] [Mozilla/5.0 (Android) Nextcloud-android/3.27.0]
[Tue Feb 13 08:34:46 2024] [error] [(104)Connection reset by peer] [client: 999.999.999.999, 1.2.3.4] [AH01075: Error dispatching request to : ] [Mozilla/5.0 (Android) Nextcloud-android/3.27.0]

Output errors in nextcloud.log in /var/www/ or as admin user in top right menu, filtering for errors. Use a pastebin service if necessary.
Hundreds of these:

{"Exception":"RedisException","Message":"MISCONF Redis is configured to save RDB snapshots, but it's currently unable to persist to disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.","Code":0,"Trace":[{"function":"session_start","args":[["Lax"]]},
{"file":"/var/www/html/lib/private/Session/Internal.php","line":222,"function":"call_user_func_array","args":["session_start",[["Lax"]]]},
{"file":"/var/www/html/lib/private/Session/Internal.php","line":234,"function":"invoke","class":"OC\\Session\\Internal","type":"->","args":["session_start",[["Lax"]],false]},
{"file":"/var/www/html/lib/private/Session/Internal.php","line":182,"function":"startSession","class":"OC\\Session\\Internal","type":"->","args":[false,false]},
{"file":"/var/www/html/lib/private/Session/CryptoSessionData.php","line":169,"function":"reopen","class":"OC\\Session\\Internal","type":"->","args":[]},
{"file":"/var/www/html/lib/private/Session/CryptoSessionData.php","line":105,"function":"reopen","class":"OC\\Session\\CryptoSessionData","type":"->","args":[]},
{"file":"/var/www/html/lib/private/Security/CSRF/TokenStorage/SessionStorage.php","line":76,"function":"set","class":"OC\\Session\\CryptoSessionData","type":"->","args":["requesttoken","4WsiinfqgnhNrFTQH8ryRK3p5jssNnuP"]},
{"file":"/var/www/html/lib/private/Security/CSRF/CsrfTokenManager.php","line":68,"function":"setToken","class":"OC\\Security\\CSRF\\TokenStorage\\SessionStorage","type":"->","args":["4WsiinfqgnhNrFTQH8ryRK3p5jssNnuP"]},
{"file":"/var/www/html/lib/private/Security/CSP/ContentSecurityPolicyNonceManager.php","line":66,"function":"getToken","class":"OC\\Security\\CSRF\\CsrfTokenManager","type":"->","args":["*** sensitive parameters replaced ***"]},
{"file":"/var/www/html/lib/private/legacy/OC_Response.php","line":84,"function":"getNonce","class":"OC\\Security\\CSP\\ContentSecurityPolicyNonceManager","type":"->","args":[]},
{"file":"/var/www/html/lib/base.php","line":711,"function":"addSecurityHeaders","class":"OC_Response","type":"::","args":[]},
{"file":"/var/www/html/lib/base.php","line":1196,"function":"init","class":"OC","type":"::","args":[]},
{"file":"/var/www/html/index.php","line":36,"args":["/var/www/html/lib/base.php"],"function":"require_once"}],"File":"/var/www/html/lib/private/Session/Internal.php","Line":222,

I took two steps which together appear to have solved the problem:

I first stopped the systemd service then stopped and removed all containers

systemctl --user stop nextcloud-aio-mastercontainer
podman ps --format json | jq .[].Names.[] | grep nextcloud | xargs podman rm -f

Then I pulled latest version of the container images

podman images --format json | jq .[].Names.[] | xargs podman pull

Then I deleted the redis container volume, which was apparently in a corrupted state

podman volume rm nextcloud_aio_redis

Finally, before starting the containers again, I set vm.overcommit_memory=1

sudo mkdir -p /etc/sysctl.d
echo "vm.overcommit_memory = 1" | sudo tee /etc/sysctl.d/nextcloud-aio-memory-overcommit.conf
sudo sysctl vm.overcommit_memory=1

and so far so good. We’ll see if this survives a reboot.

This topic was automatically closed 8 days after the last reply. New replies are no longer allowed.