Nextcloud client synchronization speed

Hello! Tell me, is it possible to increase the file synchronization speed for the Nextcloud client, since synchronization takes a very long time, provided that - client version 3.15.2, web server - Nginx 1.20.1, Nextcloud - 30.0.4, MariaDB - 10.6.20, operating system - CentOS 9 Stream, data volume 6 TB, number of files - 2502699. Thank you.

Please:

  • fill out the support template
  • clarify a bit more specifically what aspect of sync performance is below expectations (are you referring to the initial sync? Or ongoing performance after the initial sync?
  • quantify what you can a bit with numbers so we have some context (i.e. maybe give a specific example of where you’re seeing unexpected performance)
  • if it’s a transfer (uploading/downloading) throughput matter, have you compared performance utilizing the Web UI? That will further provide a baseline to compare for your Nextcloud instance and help isolate whether a Desktop client matter or something elsewhere

data volume 6 TB, number of files - 2502699

If you’re use case truly involves syncing all of these files constantly, please share some context about the typical file size, frequency of changes, apps involved, etc.

Hello! I am more interested in the issue of primary synchronization, after a long count of files on the server, the client creates virtual files one by one, which is not very convenient with a large number of files. For example, synchronization of file 658508 using virtual files took more than 24 hours (I did not count exactly).

PHP-fpm version 8.3.13, pm.max_children = 960
MariaDB - deployed on a separate Hyper-V VM with resources of 24 CPU, 16 RAM
VM deployed on Hyper-V with resources of 32 CPU, 32 RAM
Nginx is preceded by HAproxy version 2.4.22-f8e3218

Below are the server configuration parameters for Nextcloud:

=====================================================================
sudo -u nginx php /var/www/nextcloud/occ config:list system
{
“system”: {
“instanceid”: “REMOVED SENSITIVE VALUE”,
“passwordsalt”: “REMOVED SENSITIVE VALUE”,
“secret”: “REMOVED SENSITIVE VALUE”,
“trusted_domains”: [
“============”,
“10.240.60.11”,
“10.240.51.2”,
“===========”
],
“datadirectory”: “REMOVED SENSITIVE VALUE”,
“dbtype”: “mysql”,
“version”: “30.0.4.1”,
“overwrite.cli.url”: “http://files.decs.kz”,
“dbname”: “REMOVED SENSITIVE VALUE”,
“dbhost”: “REMOVED SENSITIVE VALUE”,
“dbport”: “”,
“dbtableprefix”: “oc_”,
“mysql.utf8mb4”: true,
“dbuser”: “REMOVED SENSITIVE VALUE”,
“dbpassword”: “REMOVED SENSITIVE VALUE”,
“installed”: true,
“chunkSize”: “5120MB”,
“memcache.local”: “\OC\Memcache\APCu”,
“memcache.distributed”: “\OC\Memcache\Redis”,
“memcache.locking”: “\OC\Memcache\Redis”,
“redis”: {
“host”: “REMOVED SENSITIVE VALUE”,
“port”: 6379
},
“filelocking.enabled”: true,
“default_phone_region”: “==”,
“maintenance_window_start”: 1,
“log_type”: “file”,
“loglevel”: 3,
“logtimezone”: “Asia/Almaty”,
“ldapProviderFactory”: “OCA\User_LDAP\LDAPProviderFactory”,
“skeletondirectory”: “/var/www/nextcloud/core/userskeleton”,
“maintenance”: false,
“theme”: “”,
“htaccess.RewriteBase”: “/”,
“defaultapp”: “”,
“trashbin_retention_obligation”: “auto”,
“twofactor_enforced”: “false”,
“onlyoffice”: {
“verify_peer_off”: true,
“jwt_secret”: “REMOVED SENSITIVE VALUE”,
“jwt_header”: “AuthorizationJwt”
},
“upload_max_filesize”: “512M”,
“enable_previews”: true,
“enabledPreviewProviders”: [
“OC\Preview\PNG”,
“OC\Preview\JPEG”,
“OC\Preview\GIF”,
“OC\Preview\BMP”,
“OC\Preview\XBitmap”,
“OC\Preview\MP3”,
“OC\Preview\TXT”,
“OC\Preview\MarkDown”,
“OC\Preview\OpenDocument”,
“OC\Preview\Krita”,
“OC\Preview\PDF”
]
}
}

sudo -u nginx php /var/www/nextcloud/occ app:list
Enabled:

  • admin_audit: 1.20.0
  • bruteforcesettings: 3.0.0
  • cloud_federation_api: 1.13.0
  • comments: 1.20.1
  • contactsinteraction: 1.11.0
  • dav: 1.31.1
  • federatedfilesharing: 1.20.0
  • federation: 1.20.0
  • files: 2.2.0
  • files_downloadactivity: 1.17.0
  • files_pdfviewer: 3.0.0
  • files_reminders: 1.3.0
  • files_sharing: 1.22.0
  • files_trashbin: 1.20.1
  • files_versions: 1.23.0
  • group_default_quota: 0.1.10
  • groupfolders: 18.0.8
  • logreader: 3.0.0
  • lookup_server_connector: 1.18.0
  • nextcloud_announcements: 2.0.0
  • notifications: 3.0.0
  • oauth2: 1.18.1
  • onlyoffice: 9.5.0
  • password_policy: 2.0.0
  • photos: 3.0.2
  • previewgenerator: 5.7.0
  • privacy: 2.0.0
  • provisioning_api: 1.20.0
  • recommendations: 3.0.0
  • related_resources: 1.5.0
  • serverinfo: 2.0.0
  • settings: 1.13.0
  • sharebymail: 1.20.0
  • support: 2.0.0
  • survey_client: 2.0.0
  • systemtags: 1.20.0
  • text: 4.1.0
  • theming: 2.5.0
  • twofactor_backupcodes: 1.19.0
  • twofactor_totp: 12.0.0-dev
  • updatenotification: 1.20.0
  • user_ldap: 1.21.0
  • viewer: 3.0.0
  • workflowengine: 2.12.0
    Disabled:
  • activity: 3.0.0 (installed 3.0.0)
  • app_api: 4.0.3 (installed 4.0.3)
  • calendar: 5.0.8 (installed 5.0.8)
  • circles: 30.0.0 (installed 30.0.0)
  • contacts: 6.1.2 (installed 6.1.2)
  • dashboard: 7.10.0 (installed 7.9.0)
  • encryption: 2.18.0
  • files_downloadlimit: 3.0.0 (installed 3.0.0)
  • files_external: 1.22.0 (installed 1.21.0)
  • files_photospheres: 1.30.0 (installed 1.30.0)
  • firstrunwizard: 3.0.0 (installed 2.18.0)
  • geoblocker: 0.5.15 (installed 0.5.15)
  • suspicious_login: 8.0.0
  • twofactor_nextcloud_notification: 4.0.0
  • user_status: 1.10.0 (installed 1.9.0)
  • weather_status: 1.10.0 (installed 1.9.0)
  • webhook_listeners: 1.1.0-dev (installed 1.1.0-dev)