NCP Backup is slow, but does not use all resources

Support intro

Sorry to hear you’re facing problems. :slightly_frowning_face:

The community help forum (help.nextcloud.com) is for home and non-enterprise users. Support is provided by other community members on a best effort / “as available” basis. All of those responding are volunteering their time to help you.

If you’re using Nextcloud in a business/critical setting, paid and SLA-based support services can be accessed via portal.nextcloud.com where Nextcloud engineers can help ensure your business keeps running smoothly.

Getting help

In order to help you as efficiently (and quickly!) as possible, please fill in as much of the below requested information as you can.

Before clicking submit: Please check if your query is already addressed via the following resources:

(Utilizing these existing resources is typically faster. It also helps reduce the load on our generous volunteers while elevating the signal to noise ratio of the forums otherwise arising from the same queries being posted repeatedly).

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can. :heart:

The Basics

  • Nextcloud Server version (e.g., 29.x.x):
    • ncp 1.55.4
  • Operating system and version (e.g., Ubuntu 24.04):
    • Nextcloud Pi (Debian Bookworm)
  • Web server and version (e.g, Apache 2.4.25):
    • Apache/2.4.62 (Debian)
  • PHP version (e.g, 8.3):
    • 8.1.32
  • Is this the first time you’ve seen this error? (Yes / No):
    • No
  • When did this problem seem to first start?
    • most times
  • Installation method (e.g. AlO, NCP, Bare Metal/Archive, etc.)
    • NCP
  • Are you using CloudfIare, mod_security, or similar? (Yes / No)
    • No

Summary of the issue you are facing:

I do a backup including data via the backup functionality of NCP. This backup takes between 18-24h currently, increasing with data. When I look with htop I see that all cores and RAM are roughly at ~20% usage.

How can I increase the workload and thus speed up the backup?

Configuration

Nextcloud

The output of occ config:list system or similar is best, but, if not possible, the contents of your config.php file from /path/to/nextcloud is fine (make sure to remove any identifiable information!):

config

{
“system”: {
“passwordsalt”: “REMOVED SENSITIVE VALUE”,
“secret”: “REMOVED SENSITIVE VALUE”,
“trusted_domains”: {
“0”: “localhost”,
“7”: “nextcloudpi”,
“5”: “nextcloudpi.local”,
“8”: “nextcloudpi.lan”,
“3”: “nextcloudpi”,
“11”: “2a04:4540:6e05:3500:5fb3:9be6:4d21:442e”,
“1”: “192.168.178.47”,
“14”: “nextcloudpi”,
“20”: “stex.spdns.de”
},
“datadirectory”: “REMOVED SENSITIVE VALUE”,
“dbtype”: “mysql”,
“version”: “28.0.14.1”,
“overwrite.cli.url”: “https://nextcloudpi/”,
“dbname”: “REMOVED SENSITIVE VALUE”,
“dbhost”: “REMOVED SENSITIVE VALUE”,
“dbport”: “”,
“dbtableprefix”: “oc_”,
“mysql.utf8mb4”: true,
“dbuser”: “REMOVED SENSITIVE VALUE”,
“dbpassword”: “REMOVED SENSITIVE VALUE”,
“installed”: true,
“instanceid”: “REMOVED SENSITIVE VALUE”,
“memcache.local”: “\OC\Memcache\Redis”,
“memcache.locking”: “\OC\Memcache\Redis”,
“redis”: {
“host”: “REMOVED SENSITIVE VALUE”,
“port”: 0,
“timeout”: 0,
“password”: “REMOVED SENSITIVE VALUE”
},
“tempdirectory”: “/media/cloud/ncdata/data/tmp”,
“mail_smtpmode”: “smtp”,
“mail_smtpauthtype”: “LOGIN”,
“mail_from_address”: “REMOVED SENSITIVE VALUE”,
“mail_domain”: “REMOVED SENSITIVE VALUE”,
“preview_max_x”: “2048”,
“preview_max_y”: “2048”,
“jpeg_quality”: “60”,
“overwriteprotocol”: “https”,
“maintenance”: true,
“logfile”: “/media/cloud/ncdata/data/nextcloud.log”,
“trusted_proxies”: “REMOVED SENSITIVE VALUE”,
“loglevel”: “2”,
“log_type”: “file”,
“mail_sendmailmode”: “smtp”,
“mail_smtphost”: “REMOVED SENSITIVE VALUE”,
“mail_smtpport”: “465”,
“mail_smtpauth”: 1,
“mail_smtpname”: “REMOVED SENSITIVE VALUE”,
“mail_smtppassword”: “REMOVED SENSITIVE VALUE”,
“mail_smtpsecure”: “ssl”,
“theme”: “”,
“data-fingerprint”: “a3babd8f415dede62ba3d60f960dc7dd”,
“maintenance_window_start”: 22,
“default_phone_region”: “+49”
},
“apps”: {
“activity”: {
“enabled”: “no”,
“installed_version”: “2.18.0”,
“types”: “filesystem”
},
“backgroundjob”: {
“lastjob”: “4280”
},
“calendar”: {
“enabled”: “yes”,
“installed_version”: “4.7.18”,
“types”: “”
},
“circles”: {
“enabled”: “no”,
“installed_version”: “26.0.0”,
“loopback_tmp_path”: “/”,
“loopback_tmp_scheme”: “https”,
“maintenance_run”: “0”,
“maintenance_update”: “{"3":1694071497,"2":1694073003,"1":1694073302}”,
“types”: “filesystem,dav”
},
“cloud_federation_api”: {
“enabled”: “yes”,
“installed_version”: “1.11.0”,
“types”: “filesystem”
},
“comments”: {
“enabled”: “no”,
“installed_version”: “1.16.0”,
“types”: “logging”
},
“contacts”: {
“allowSocialSync”: “no”,
“enabled”: “yes”,
“installed_version”: “5.5.3”,
“types”: “dav”
},
“contactsinteraction”: {
“enabled”: “yes”,
“installed_version”: “1.9.0”,
“types”: “dav”
},
“core”: {
“backgroundjobs_mode”: “cron”,
“emailTestSuccessful”: “1”,
“files_metadata”: “{"files-live-photo":{"value":null,"type":"string","indexed":false,"editPermission":1}}”,
“files_metadata_installed”: “1”,
“installedat”: “1682950233.2354”,
“lastcron”: “1752406502”,
“lastupdatedat”: “0”,
“metadataGenerationDone”: “true”,
“moveavatarsdone”: “yes”,
“oc.integritycheck.checker”: “”,
“previewsCleanedUp”: “1”,
“public_files”: “files_sharing/public.php”,
“public_webdav”: “dav/appinfo/v1/publicwebdav.php”,
“shareapi_default_expire_date”: “yes”,
“shareapi_default_internal_expire_date”: “yes”,
“shareapi_default_remote_expire_date”: “yes”,
“shareapi_expire_after_n_days”: “365”,
“vendor”: “nextcloud”
},
“dashboard”: {
“enabled”: “no”,
“installed_version”: “7.6.0”,
“types”: “”
},
“dav”: {
“buildCalendarReminderIndex”: “yes”,
“buildCalendarSearchIndex”: “yes”,
“chunks_migrated”: “1”,
“enabled”: “yes”,
“installed_version”: “1.29.2”,
“regeneratedBirthdayCalendarsForYearFix”: “yes”,
“sendEventRemindersPush”: “yes”,
“types”: “filesystem”
},
“federatedfilesharing”: {
“enabled”: “yes”,
“installed_version”: “1.18.0”,
“types”: “”
},
“federation”: {
“enabled”: “no”,
“installed_version”: “1.16.0”,
“types”: “authentication”
},
“files”: {
“enabled”: “yes”,
“installed_version”: “2.0.0”,
“max_chunk_size”: “1.048.576.000”,
“mimetype_version”: “28.0.14.1”,
“types”: “filesystem”
},
“files_pdfviewer”: {
“enabled”: “yes”,
“installed_version”: “2.9.0”,
“types”: “”
},
“files_reminders”: {
“enabled”: “yes”,
“installed_version”: “1.1.0”,
“types”: “dav”
},
“files_rightclick”: {
“enabled”: “no”,
“installed_version”: “1.6.0”,
“types”: “”
},
“files_sharing”: {
“enabled”: “yes”,
“incoming_server2server_share_enabled”: “no”,
“installed_version”: “1.20.0”,
“lookupServerEnabled”: “no”,
“lookupServerUploadEnabled”: “no”,
“outgoing_server2server_share_enabled”: “no”,
“types”: “filesystem”
},
“files_trashbin”: {
“enabled”: “yes”,
“installed_version”: “1.18.0”,
“types”: “filesystem,dav”
},
“files_versions”: {
“enabled”: “yes”,
“installed_version”: “1.21.0”,
“types”: “filesystem,dav”
},
“firstrunwizard”: {
“enabled”: “yes”,
“installed_version”: “2.17.0”,
“types”: “logging”
},
“logreader”: {
“enabled”: “yes”,
“installed_version”: “2.13.0”,
“types”: “logging”
},
“lookup_server_connector”: {
“enabled”: “yes”,
“installed_version”: “1.16.0”,
“types”: “authentication”
},
“news”: {
“enabled”: “no”,
“installed_version”: “24.0.0”,
“types”: “”
},
“nextcloud_announcements”: {
“enabled”: “yes”,
“installed_version”: “1.17.0”,
“pub_date”: “Thu, 24 Oct 2019 00:00:00 +0200”,
“types”: “logging”
},
“nextcloudpi”: {
“enabled”: “yes”,
“installed_version”: “0.0.2”,
“types”: “”
},
“notes”: {
“enabled”: “no”,
“installed_version”: “4.8.1”,
“types”: “”
},
“notifications”: {
“enabled”: “yes”,
“installed_version”: “2.16.0”,
“types”: “logging”
},
“notify_push”: {
“base_endpoint”: “https://nextcloudpi/push”,
“cookie”: “REMOVED SENSITIVE VALUE”,
“enabled”: “yes”,
“installed_version”: “1.1.0”,
“types”: “filesystem”
},
“oauth2”: {
“enabled”: “yes”,
“installed_version”: “1.16.4”,
“types”: “authentication”
},
“password_policy”: {
“enabled”: “yes”,
“installed_version”: “1.18.0”,
“types”: “authentication”
},
“photos”: {
“enabled”: “no”,
“installed_version”: “2.2.0”,
“lastPlaceMappedUser”: “ncp”,
“lastPlaceMappingDone”: “true”,
“types”: “dav,authentication”
},
“preview”: {
“jpeg_quality”: “60”
},
“previewgenerator”: {
“enabled”: “yes”,
“heightSizes”: “256”,
“installed_version”: “99.99.99”,
“squareSizes”: “32 256”,
“types”: “filesystem”,
“widthSizes”: “256 384”
},
“privacy”: {
“enabled”: “yes”,
“installed_version”: “1.12.0”,
“readableLocation”: “de”,
“types”: “”
},
“provisioning_api”: {
“enabled”: “yes”,
“installed_version”: “1.18.0”,
“types”: “prevent_group_restriction”
},
“recommendations”: {
“enabled”: “no”,
“installed_version”: “1.5.0”,
“types”: “”
},
“related_resources”: {
“enabled”: “no”,
“installed_version”: “1.1.0-alpha1”,
“types”: “”
},
“serverinfo”: {
“cached_count_filecache”: “1439578”,
“cached_count_storages”: “8”,
“enabled”: “yes”,
“installed_version”: “1.18.0”,
“types”: “”
},
“settings”: {
“enabled”: “yes”,
“installed_version”: “1.10.1”,
“types”: “”
},
“sharebymail”: {
“enabled”: “yes”,
“installed_version”: “1.18.0”,
“types”: “filesystem”
},
“support”: {
“enabled”: “no”,
“installed_version”: “1.9.0”,
“types”: “session”
},
“survey_client”: {
“enabled”: “no”,
“installed_version”: “1.14.0”,
“types”: “”
},
“systemtags”: {
“enabled”: “no”,
“installed_version”: “1.16.0”,
“types”: “logging”
},
“tasks”: {
“enabled”: “yes”,
“installed_version”: “0.16.1”,
“types”: “”
},
“text”: {
“enabled”: “yes”,
“installed_version”: “3.9.2”,
“types”: “dav”
},
“theming”: {
“backgroundMime”: “image/png”,
“cachebuster”: “4”,
“enabled”: “yes”,
“installed_version”: “2.3.0”,
“logoDimensions”: “500x500”,
“logoMime”: “image/svg+xml”,
“name”: “Stex Cloud”,
“slogan”: “REMOVED SENSITIVE VALUE”,
“types”: “logging”,
“url”: “REMOVED SENSITIVE VALUE”
},
“twofactor_backupcodes”: {
“enabled”: “yes”,
“installed_version”: “1.17.0”,
“types”: “”
},
“updatenotification”: {
“enabled”: “no”,
“installed_version”: “1.16.0”,
“types”: “”
},
“user_status”: {
“enabled”: “no”,
“installed_version”: “1.6.0”,
“types”: “”
},
“viewer”: {
“enabled”: “yes”,
“installed_version”: “2.2.0”,
“types”: “”
},
“weather_status”: {
“enabled”: “no”,
“installed_version”: “1.6.0”,
“types”: “”
},
“workflowengine”: {
“enabled”: “yes”,
“installed_version”: “2.10.0”,
“types”: “filesystem”
}
}
}

Apps

The output of occ app:list (if possible).

app list

Enabled:

  • calendar: 4.7.18
  • cloud_federation_api: 1.11.0
  • contacts: 5.5.3
  • contactsinteraction: 1.9.0
  • dav: 1.29.2
  • federatedfilesharing: 1.18.0
  • files: 2.0.0
  • files_pdfviewer: 2.9.0
  • files_reminders: 1.1.0
  • files_sharing: 1.20.0
  • files_trashbin: 1.18.0
  • files_versions: 1.21.0
  • firstrunwizard: 2.17.0
  • logreader: 2.13.0
  • lookup_server_connector: 1.16.0
  • nextcloud_announcements: 1.17.0
  • nextcloudpi: 0.0.2
  • notifications: 2.16.0
  • notify_push: 1.1.0
  • oauth2: 1.16.4
  • password_policy: 1.18.0
  • previewgenerator: 99.99.99
  • privacy: 1.12.0
  • provisioning_api: 1.18.0
  • serverinfo: 1.18.0
  • settings: 1.10.1
  • sharebymail: 1.18.0
  • tasks: 0.16.1
  • text: 3.9.2
  • theming: 2.3.0
  • twofactor_backupcodes: 1.17.0
  • viewer: 2.2.0
  • workflowengine: 2.10.0
    Disabled:
  • activity: 2.20.0 (installed 2.18.0)
  • admin_audit: 1.18.0
  • bruteforcesettings: 2.8.0
  • circles: 28.0.0 (installed 26.0.0)
  • comments: 1.18.0 (installed 1.16.0)
  • dashboard: 7.8.0 (installed 7.6.0)
  • encryption: 2.16.0
  • federation: 1.18.0 (installed 1.16.0)
  • files_external: 1.20.0
  • photos: 2.4.0 (installed 2.2.0)
  • recommendations: 2.0.0 (installed 1.5.0)
  • related_resources: 1.3.0 (installed 1.1.0-alpha1)
  • support: 1.11.1 (installed 1.9.0)
  • survey_client: 1.16.0 (installed 1.14.0)
  • suspicious_login: 6.0.0
  • systemtags: 1.18.0 (installed 1.16.0)
  • twofactor_totp: 10.0.0-beta.2
  • updatenotification: 1.18.0 (installed 1.16.0)
  • user_ldap: 1.19.0
  • user_status: 1.8.1 (installed 1.6.0)
  • weather_status: 1.8.0 (installed 1.6.0)

What do your I/O stats look like for your backup destination?

Read/Write is at around 200 MB/sec from target and to destination. So that should be no issue.

The last backup had a zipped size of 170gb and took 20 hours. Copying the zipped backup to a third location manually toke 30 minutes.

This topic was automatically closed after 90 days. New replies are no longer allowed.