Severe server load average when the Desktop app is syncing

Nextcloud version (eg, 20.0.5): Hub 7 28.0.0
Operating system and version (eg, Ubuntu 20.04): Ubuntu 22.04.3 LTS
Apache or nginx version (eg, Apache 2.4.25): nginx/1.18.0 (Ubuntu)
PHP version (eg, 7.4): v8.1.2-1ubuntu2.14

The issue you are facing:

Is this the first time you’ve seen this error? (Y/N): Yes

Steps to replicate it:

After the last update of the NC Desktop app, when it started syncing, the server load average increased, and I had to stop syncing due to a severely high load average.

The output of your Nextcloud log in Admin > Logging:

2023/12/14 12:47:34 [error] 3776502#3776502: *33 FastCGI sent in stderr: "PHP message: {"reqId":"btw6PhoVMdqjhXMnvIGQ","level":0,"time":"2023-12-14T12:47:34+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"encryption","method":"GET","url":"/apps/logreader/api/poll?lastReqId=","message":"/appinfo/app.php is deprecated, use \\OCP\\AppFramework\\Bootstrap\\IBootstrap on the application class instead.","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:120.0) Gecko/20100101 Firefox/120.0","version":"28.0.0.11","data":{"app":"encryption"}}" while reading response header from upstream, client: 2.36.45.36, server: cloud.domain.com, request: "GET /apps/logreader/api/poll?lastReqId= HTTP/2.0", upstream: "fastcgi://unix:/var/run/php/php8.1-fpm.sock:", host: "cloud.domain.com"
2023/12/14 12:47:45 [error] 3776502#3776502: *33 FastCGI sent in stderr: "PHP message: {"reqId":"NcR6bNgvfPENAlZXA0mn","level":0,"time":"2023-12-14T12:47:45+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"encryption","method":"GET","url":"/apps/logreader/api/poll?lastReqId=","message":"/appinfo/app.php is deprecated, use \\OCP\\AppFramework\\Bootstrap\\IBootstrap on the application class instead.","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:120.0) Gecko/20100101 Firefox/120.0","version":"28.0.0.11","data":{"app":"encryption"}}" while reading response header from upstream, client: 2.36.45.36, server: cloud.domain.com, request: "GET /apps/logreader/api/poll?lastReqId= HTTP/2.0", upstream: "fastcgi://unix:/var/run/php/php8.1-fpm.sock:", host: "cloud.domain.com"
2023/12/14 12:47:51 [error] 3776502#3776502: *7 FastCGI sent in stderr: "PHP message: {"reqId":"dN3RmCyPJscmLmsQFE2Q","level":0,"time":"2023-12-14T12:47:50+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"encryption","method":"PROPFIND","url":"/remote.php/dav/files/nicfab/","message":"/appinfo/app.php is deprecated, use \\OCP\\AppFramework\\Bootstrap\\IBootstrap on the application class instead.","userAgent":"Mozilla/5.0 (Macintosh) mirall/3.11.0git (build 19195) (Nextcloud, osx-23.2.0 ClientArchitecture: arm64 OsArchitecture: arm64)","version":"28.0.0.11","data":{"app":"encryption"}}PHP message: {"reqId":"dN3RmCyPJscmLmsQFE2Q","level":0,"time":"2023-12-14T12:47:50+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"user_oidc","method":"PROPFIND","url":"/remote.php/dav/files/nicfab/","message":"no OIDC providers","userAgent":"Mozilla/5.0 (Macintosh) mirall/3.11.0git (build 19195) (Nextcloud, osx-23.2.0 ClientArchitecture: arm64 OsArchitecture: arm64)","version":"28.0.0.11","data":{"app":"user_oidc"}}PHP message: {"reqId":"dN3RmCyPJscmLmsQFE2Q","level":1,"time":"2023-12-14T12:47:51+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"no app in context","method":"PROPFIND","url":"/remote.php/dav/files/nicfab/","message":"exception while retrieving webdav endpoint","userAgent":"Mozilla/5.0 (Macintosh) mirall/3.11.0git (build 19195) (Nextcloud, osx-23.2.0 ClientArchitecture: arm64 OsArchitecture: arm64)","version":"28.0.0.11","exception":{"Exception":"OCP\\OCM\\Exceptions\\OCMProviderException","Message":"data returned by remote seems invalid - <!DOCTYPE html>\n<html class=\"ng-csp\" data-placeholder-focus=\"false\" lang=\"en\" data-locale=\"en\" >\n\t<head\n data-requesttoken=\"ho3bayjTXH5SdfCJtnlG7FoffSAeI6OayWnjr4rAoDk=:4NuIM0r8Cit9BJvx/yESv2NnDFFMV9Ptoyio/LmD+Gg=\">\n\t\t<meta charset=\"utf-8\">\n\t\t<title>\n\t\tLegShare\t\t</title>\n\t\t<meta name=\"viewport\" content=\"width=device-width, initial-scale=1.0, minimum-scale=1.0\">\n\t\t\t\t<meta name=\"apple-itunes-app\" content=\"app-id=1...PHP me

The output of your config.php file in /path/to/nextcloud (make sure you remove any identifiable information!):

<?php
$CONFIG = array (
  'memcache.local' => '\\OC\\Memcache\\APCu',
  'memcache.distributed' => '\\OC\\Memcache\\Memcached',
  'memcache.locking' => '\\OC\\Memcache\\Memcached',
  'memcached_servers' =>
  array (
    0 =>
    array (
      0 => 'localhost',
      1 => 11211,
    ),
  ),
  'instanceid' => 'octiapf9spg6',
  'passwordsalt' => '<mypasswordsalt>',
  'secret' => '<mysecret>',
  'trusted_domains' =>
  array (
    0 => 'cloud.domain.com',
  ),
  'datadirectory' => '/storage',
  'dbtype' => 'mysql',
  'version' => '28.0.0.11',
  'overwrite.cli.url' => 'https://cloud.domain.com',
  'dbname' => 'nextcloud',
  'dbhost' => 'localhost',
  'dbport' => '',
  'dbtableprefix' => 'oc_',
  'mysql.utf8mb4' => true,
  'dbuser' => 'user',
  'dbpassword' => '<password_db>',
  'installed' => true,
  'logtimezone' => 'Europe/Berlin',
  'default_phone_region' => 'IT',
  'mail_smtpmode' => 'smtp',
  'mail_sendmailmode' => 'smtp',
  'mail_from_address' => 'system',
  'mail_domain' => 'domain.com',
  'mail_smtpauthtype' => 'LOGIN',
  'mail_smtpauth' => 1,
  'mail_smtphost' => 'mail.domain.com',
  'mail_smtpport' => '465',
  'mail_smtpname' => 'system@domain.com',
  'mail_smtppassword' => '<password>',
  'maintenance' => false,
  'theme' => '',
  'updater.release.channel' => 'stable',
  'loglevel' => 0,
  'logfile' => '/var/log/nextcloud.log',
  'updater.secret' => '<data>',
);

The output of your Apache/nginx/system log in /var/log/____:

2023/12/14 12:36:00 [error] 3776502#3776502: *33 FastCGI sent in stderr: "PHP message: {"reqId":"GjmJ2oi1IlbBDwW8hAq9","level":0,"time":"2023-12-14T12:36:00+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"encryption","method":"GET","url":"/apps/logreader/api/poll?lastReqId=","message":"/appinfo/app.php is deprecated, use \\OCP\\AppFramework\\Bootstrap\\IBootstrap on the application class instead.","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:120.0) Gecko/20100101 Firefox/120.0","version":"28.0.0.11","data":{"app":"encryption"}}" while reading response header from upstream, client: 2.36.45.36, server: cloud.domain.com, request: "GET /apps/logreader/api/poll?lastReqId= HTTP/2.0", upstream: "fastcgi://unix:/var/run/php/php8.1-fpm.sock:", host: "cloud.domain.com"
2023/12/14 12:36:05 [error] 3776502#3776502: *7 FastCGI sent in stderr: "PHP message: {"reqId":"XKRfojvzlkWqIgMa092u","level":0,"time":"2023-12-14T12:36:04+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"encryption","method":"GET","url":"/ocs/v2.php/apps/user_status/api/v1/user_status?format=json","message":"/appinfo/app.php is deprecated, use \\OCP\\AppFramework\\Bootstrap\\IBootstrap on the application class instead.","userAgent":"Mozilla/5.0 (Macintosh) mirall/3.11.0git (build 19195) (Nextcloud, osx-23.2.0 ClientArchitecture: arm64 OsArchitecture: arm64)","version":"28.0.0.11","data":{"app":"encryption"}}" while reading response header from upstream, client: 2.36.45.36, server: cloud.domain.com, request: "GET /ocs/v2.php/apps/user_status/api/v1/user_status?format=json HTTP/1.1", upstream: "fastcgi://unix:/var/run/php/php8.1-fpm.sock:", host: "cloud.domain.com"
2023/12/14 12:36:05 [error] 3776502#3776502: *6 FastCGI sent in stderr: "PHP message: {"reqId":"Jgb6XAI6JVDg6vhuxeEH","level":0,"time":"2023-12-14T12:36:04+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"encryption","method":"GET","url":"/ocs/v2.php/apps/notifications/api/v2/notifications?format=json","message":"/appinfo/app.php is deprecated, use \\OCP\\AppFramework\\Bootstrap\\IBootstrap on the application class instead.","userAgent":"Mozilla/5.0 (Macintosh) mirall/3.11.0git (build 19195) (Nextcloud, osx-23.2.0 ClientArchitecture: arm64 OsArchitecture: arm64)","version":"28.0.0.11","data":{"app":"encryption"}}" while reading response header from upstream, client: 2.36.45.36, server: cloud.domain.com, request: "GET /ocs/v2.php/apps/notifications/api/v2/notifications?format=json HTTP/1.1", upstream: "fastcgi://unix:/var/run/php/php8.1-fpm.sock:", host: "cloud.domain.com"

PASTE HERE


Output errors in nextcloud.log in /var/www/ or as admin user in top right menu, filtering for errors. Use a pastebin service if necessary.

2023/12/14 12:33:44 [error] 3776502#3776502: *33 FastCGI sent in stderr: "PHP message: {"reqId":"WCIuPLF7WHcm1KN7slVM","level":0,"time":"2023-12-14T12:33:44+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"encryption","method":"GET","url":"/ocs/v2.php/apps/notifications/api/v2/notifications","message":"/appinfo/app.php is deprecated, use \\OCP\\AppFramework\\Bootstrap\\IBootstrap on the application class instead.","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:120.0) Gecko/20100101 Firefox/120.0","version":"28.0.0.11","data":{"app":"encryption"}}" while reading response header from upstream, client: 2.36.45.36, server: cloud.domain.com, request: "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/2.0", upstream: "fastcgi://unix:/var/run/php/php8.1-fpm.sock:", host: "cloud.domain.com"
2023/12/14 12:33:47 [error] 3776502#3776502: *33 FastCGI sent in stderr: "PHP message: {"reqId":"FiZNzipNv64waN0hhVBf","level":0,"time":"2023-12-14T12:33:47+01:00","remoteAddr":"2.36.45.36","user":"nicfab","app":"encryption","method":"GET","url":"/apps/logreader/api/poll?lastReqId=","message":"/appinfo/app.php is deprecated, use \\OCP\\AppFramework\\Bootstrap\\IBootstrap on the application class instead.","userAgent":"Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:120.0) Gecko/20100101 Firefox/120.0","version":"28.0.0.11","data":{"app":"encryption"}}" while reading response header from upstream, client: 2.36.45.36, server: cloud.domain.com, request: "GET /apps/logreader/api/poll?lastReqId= HTTP/2.0", upstream: "fastcgi://unix:/var/run/php/php8.1-fpm.sock:", host: "cloud.domain.com"

Do you use the OICD identity provider? It says app not found, were you using it?

For the file-locking, you can use the redis cache, if you don’t use it, it will be handled by your normal database which is much less efficient. This can have an impact on performance, not sure why it should change drastically with the new client version.

Are you using server side encryption?

You are sure it is the client version, from 3.10 to 3.11? If you upload via webdav directly or webinterface you don’t see the same effect?

No, I don’t use it.

Indeed, I already updated my config.php by adding redis.

No, I disabled server side encryption to verify if it was the issue.