Backup files in NCP seem too small

ℹ️ Support 📦 Appliances (Docker, Snappy, VM, NCP, AIO)
, ,
1
Support intro

Sorry to hear you’re facing problems :slightly_frowning_face:

help.nextcloud.com is for home/non-enterprise users. If you’re running a business, paid support can be accessed via portal.nextcloud.com where we can ensure your business keeps running smoothly.

In order to help you as quickly as possible, before clicking Create Topic please provide as much of the below as you can. Feel free to use a pastebin service for logs, otherwise either indent short log examples with four spaces:

example

Or for longer, use three backticks above and below the code snippet:

longer
example
here

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can :heart:

Nextcloud version (eg, 12.0.2): 14.0.4.2
Operating system and version (eg, Ubuntu 17.04): Debian, Nextcloud Plus
Apache or nginx version (eg, Apache 2.4.25): Apache
PHP version (eg, 7.1): PHP 7.2

The issue you are facing:

Is this the first time you’ve seen this error? (Y/N): Y

I have installed Nextcloud via NextCloudPlus, where you have a special admin panel. In this admin panel, I configured automatic backups. The thing is tha the backup data seems very small:
ls /media/Backup_4TB/ncp-backups -lh
insgesamt 2,2G
-rw-r–r-- 1 root root 543M Nov 15 03:06 nextcloud-bkp_20181115_1542250810.tar
-rw-r–r-- 1 root root 549M Nov 22 03:08 nextcloud-bkp_20181122_1542855608.tar
-rw-r–r-- 1 root root 553M Nov 29 03:03 nextcloud-bkp_20181129_1543460409.tar
-rw-r–r-- 1 root root 554M Dez 1 03:03 nextcloud-bkp_20181201_1543633208.tar

The data disk usage is 393G/932G according to NCP.

The output of your Nextcloud log in Admin > Logging:

|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/theming/35c3-0516-theming.css): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-12-11T03:24:07+0100|
|---|---|---|---|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/systemtags/1bf6-0516-systemtagsfilelist.css.gzip): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-12-11T03:24:07+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/files_trashbin/1e6d-0516-trash.css.deps): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-12-11T03:24:06+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/files_texteditor/783c-0516-merged.css.deps): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-12-11T03:24:06+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/files_texteditor/783c-0516-merged.css): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-12-11T03:24:06+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/core/4f30-0516-css-variables.css.gzip): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-12-11T03:24:05+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/core/4f30-0516-css-variables.css.deps): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-12-11T03:24:05+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/comments/1bf6-0516-autocomplete.css): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-12-11T03:24:05+0100|
|Error|core|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:58+0100|
|Error|core|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:58+0100|
|Error|index|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:58+0100|
|Error|PHP|Error while sending QUERY packet. PID=1815 at /var/www/nextcloud/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php#104|2018-12-06T12:12:58+0100|
|Error|core|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:52+0100|
|Error|core|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:52+0100|
|Error|core|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:52+0100|
|Error|core|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:52+0100|
|Error|core|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:52+0100|
|Error|core|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:52+0100|
|Error|index|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:51+0100|
|Error|index|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:51+0100|
|Error|index|Doctrine\DBAL\DBALException: Failed to connect to the database: An exception occured in driver: SQLSTATE[HY000] [2002] Connection refused|2018-12-06T12:12:51+0100|
|Error|PHP|Error while sending QUERY packet. PID=1816 at /var/www/nextcloud/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php#104|2018-12-06T12:12:49+0100|
|Error|PHP|Error while sending QUERY packet. PID=1818 at /var/www/nextcloud/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php#104|2018-12-06T12:12:49+0100|
|Error|PHP|Error while sending QUERY packet. PID=1814 at /var/www/nextcloud/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Driver/PDOConnection.php#104|2018-12-06T12:12:49+0100|
|Warning|core|Login failed: 'pi' (Remote IP: '95.89.99.227')|2018-12-06T11:40:41+0100|
|Warning|core|Login failed: 'pi' (Remote IP: '95.89.99.227')|2018-12-06T11:40:34+0100|
|Warning|core|Login failed: 'pi' (Remote IP: '95.89.99.227')|2018-12-06T11:40:28+0100|
|Warning|core|Login failed: 'pi' (Remote IP: '95.89.99.227')|2018-12-06T11:40:02+0100|
|Warning|core|Login failed: 'pi' (Remote IP: '95.118.39.181')|2018-12-04T21:38:57+0100|
|Fatal|webdav|Sabre\DAV\Exception\BadRequest: expected filesize 457795 got 73728|2018-12-01T21:17:29+0100|
|Fatal|webdav|Sabre\DAV\Exception\BadRequest: expected filesize 1024000 got 106496|2018-12-01T21:10:35+0100|
|Error|cron|Error: Call to undefined method OCP\AppFramework\Http\DataResponse::succeeded()|2018-11-30T13:15:07+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/theming/35c3-0516-theming.css.deps): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-11-27T14:30:08+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/systemtags/1bf6-0516-systemtagsfilelist.css.gzip): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-11-27T14:30:08+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/systemtags/1bf6-0516-systemtagsfilelist.css.deps): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-11-27T14:30:08+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/icons/icons-vars.css): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-11-27T14:30:08+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/firstrunwizard/70e2-0516-firstrunwizard.css.gzip): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-11-27T14:30:08+0100|
|Error|PHP|unlink(/media/Touro1TB/NCP/appdata_occj3yhi2nf9/css/files_trashbin/1e6d-0516-trash.css.deps): No such file or directory at /var/www/nextcloud/lib/private/Files/Storage/Local.php#227|2018-11-27T14:30:07+0100|
|Info|updater|\OC\Updater::resetLogLevel: Reset log level to Warning(2)|2018-11-26T07:47:29+0100|
|Info|updater|\OC\Updater::maintenanceDisabled: Turned off maintenance mode|2018-11-26T07:47:29+0100|
|Info|updater|\OC\Updater::updateEnd: Update successful|2018-11-26T07:47:29+0100|
|Info|updater|\OC\Updater::finishedCheckCodeIntegrity: Finished code integrity check|2018-11-26T07:47:29+0100|
|Info|updater|\OC\Updater::startCheckCodeIntegrity: Starting code integrity check...|2018-11-26T07:46:32+0100|
|Info|updater|\OC\Repair::info: Repair info: No need to repair pending cron jobs.|2018-11-26T07:46:32+0100|
|Info|updater|\OC\Repair::step: Repair step: Repair pending cron jobs|2018-11-26T07:46:32+0100|
|Info|updater|\OC\Repair::step: Repair step: Queue a one-time job to cleanup old backups of the updater|2018-11-26T07:46:32+0100|
|Info|updater|\OC\Repair::step: Repair step: Add preview background cleanup job|2018-11-26T07:46:32+0100|
|Info|updater|\OC\Repair::info: Repair info: JS cache cleared|2018-11-26T07:46:32+0100|
|Info|updater|\OC\Repair::info: Repair info: SCSS cache cleared|2018-11-26T07:46:18+0100|

The output of your config.php file in /path/to/nextcloud (make sure you remove any identifiable information!):

<?php
$CONFIG = array (
  'passwordsalt' => 'censored',
  'secret' => 'censored',
  'trusted_domains' =>
  array (
    0 => 'localhost',
    1 => '192.168.178.29',
    2 => 'censored',
    5 => 'nextcloudpi.local',
    7 => 'nextcloudpi',
    8 => 'nextcloudpi.lan',
    4 => 'censored',
  ),
  'datadirectory' => '/media/Touro1TB/NCP',
  'overwrite.cli.url' => 'https://censored.de/',
  'dbtype' => 'mysql',
  'version' => '14.0.4.2',
  'dbname' => 'nextcloud',
  'dbhost' => 'localhost',
  'dbport' => '',
  'dbtableprefix' => 'oc_',
  'mysql.utf8mb4' => true,
  'dbuser' => 'ncadmin',
  'dbpassword' => 'censored',
  'installed' => true,
  'instanceid' => 'occj3yhi2nf9',
  'memcache.local' => '\\OC\\Memcache\\Redis',
  'memcache.locking' => '\\OC\\Memcache\\Redis',
  'redis' =>
  array (
    'host' => '/var/run/redis/redis.sock',
    'port' => 0,
    'timeout' => 0.0,
    'password' => 'censored',
  ),
  'mail_smtpmode' => 'smtp',
  'mail_smtpauthtype' => 'PLAIN',
  'mail_from_address' => 'notmyham',
  'mail_domain' => 'XXX.de',
  'overwriteprotocol' => 'https',
  'maintenance' => false,
  'logfile' => '/media/Touro1TB/NCP/nextcloud.log',
  'mail_smtpauth' => 1,

 'dbuser' => 'ncadmin',
  'dbpassword' => 'zcensoreddPBM=',
  'installed' => true,
  'instanceid' => 'occj3yhi2nf9',
  'memcache.local' => '\\OC\\Memcache\\Redis',
  'memcache.locking' => '\\OC\\Memcache\\Redis',
  'redis' =>
  array (
    'host' => '/var/run/redis/redis.sock',
    'port' => 0,
    'timeout' => 0.0,
    'password' => 'HcensoredImo=',
  ),
  'mail_smtpmode' => 'smtp',
  'mail_smtpauthtype' => 'PLAIN',
  'mail_from_address' => 'censored',
  'mail_domain' => 'anpa.de',
  'overwriteprotocol' => 'https',
  'maintenance' => false,
  'logfile' => '/media/Touro1TB/NCP/nextcloud.log',
  'mail_smtpauth' => 1,
  'mail_smtphost' => 'www.anpa.de',
  'mail_smtpport' => '25',
  'mail_smtpname' => 'censored',
  'mail_smtppassword' => 'censored',
  'loglevel' => 2,
);

The output of your Apache/nginx/system log in /var/log/____:

PASTE HERE
2

You can include or exclude data from your backups. Excluding data will create much smaller backups.

The latest version of NCP uses PHP7.2 (How come you are using PHP7.1?)
What installation method did you use? What is the NCP version are you are on?
You did not provide/paste any system info, required to assist!

3

You can include or exclude data from your backups. Excluding data will create much smaller backups.

Thank you, but how? I used the standards from NextcloudPlus

The latest version of NCP uses PHP7.2 (How come you are using PHP7.1?)

Was a mistake, is corrected

What installation method did you use? What is the NCP version are you are on?

I used nextcloudplus on a raspberry pi. Auto-updates activated with version named above

You did not provide/paste any system info, required to assist!
Thank you, I did now, hope it helps.

4

Making backups excluding data

Making backups including data

BackUpsWithOrWithoutDataScreenshot2018-12-12_22-39-41
BackUpsWithOrWithoutDataScreenshot2018-12-12_22-39-411224×595 30.6 KB

Screenshot is from ncp-config not ncp-web, but same function. Enter yes in the includedata field to include data in your backup.

FYI NCP was re-named back to NextCloudPi several months ago (NC devs didnt like the Plus), sorry for confusion that may have caused.

Please provide output of ncp-report, if you have any issues, you need help with.

5

Enter yes in the includedata field to include data in your backup.

This is entered, but data seems still to small.

NextCloudPi%20yes%20backup
NextCloudPi%20yes%20backup1174×663 12.4 KB

<–! Paste this in GitHub report →

NextCloudPi diagnostics 

^[[B^[[BNextCloudPi version  v0.67.6
distribution         Raspbian GNU/Linux 9 \n \l
automount            yes
USB devices          sda sdb
datadir              /media/Touro1TB/NCP
data in SD           no
data filesystem      btrfs
data disk usage      412G/932G
rootfs usage         6,9G/118G
swapfile             /var/swap
dbdir                /var/lib/mysql
Nextcloud check      ok
Nextcloud version    14.0.4.2
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
Postfix service      up
internet check       ok
port check 80        open
port check 443       open
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               14days
Nextcloud configuration 

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "1": "192.168.178.29",
            "2": "bardhome.de",
            "5": "nextcloudpi.local",
            "7": "nextcloudpi",
            "8": "nextcloudpi.lan",
            "4": "bardhome.de"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "overwrite.cli.url": "https:\/\/bardhome.de\/",
        "dbtype": "mysql",
        "version": "14.0.4.2",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "mail_smtpmode": "smtp",
        "mail_smtpauthtype": "PLAIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "overwriteprotocol": "https",
        "maintenance": false,
        "logfile": "\/media\/Touro1TB\/NCP\/nextcloud.log",
        "mail_smtpauth": 1,
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpport": "25",
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***",
        "loglevel": 2
    }
}
HTTPd logs 

[Wed Dec 12 06:25:03.874419 2018] [ssl:warn] [pid 819:tid 1996034416] AH01909: l                             ocalhost:4443:0 server certificate does NOT include an ID which matches the serv                             er name
[Wed Dec 12 06:25:04.000311 2018] [mpm_event:notice] [pid 819:tid 1996034416] AH                             00489: Apache/2.4.25 (Raspbian) OpenSSL/1.0.2l configured -- resuming normal ope                             rations
[Wed Dec 12 06:25:04.000388 2018] [core:notice] [pid 819:tid 1996034416] AH00094                             : Command line: '/usr/sbin/apache2'
[Wed Dec 12 19:00:14.935050 2018] [authz_core:error] [pid 18845:tid 1935537184]                              [client 192.168.178.20:59998] AH01631: user pi: authorization failure for "/":
[Wed Dec 12 19:00:21.281014 2018] [authnz_external:error] [pid 18844:tid 1809572                             896] [client 192.168.178.20:60003] AuthExtern pwauth [/usr/sbin/pwauth]: Failed                              (1) for user ncp-web
[Wed Dec 12 19:00:21.281195 2018] [auth_basic:error] [pid 18844:tid 1809572896]                              [client 192.168.178.20:60003] AH01617: user ncp-web: authentication failure for                              "/": Password Mismatch
[Wed Dec 12 19:00:25.957993 2018] [authnz_external:error] [pid 18844:tid 1809572                             896] [client 192.168.178.20:60006] AuthExtern pwauth [/usr/sbin/pwauth]: Failed                              (1) for user ncp-web
[Wed Dec 12 19:00:25.958153 2018] [auth_basic:error] [pid 18844:tid 1809572896]                              [client 192.168.178.20:60006] AH01617: user ncp-web: authentication failure for                              "/": Password Mismatch
[Wed Dec 12 19:00:32.694283 2018] [authnz_external:error] [pid 18844:tid 1809572                             896] [client 192.168.178.20:60008] AuthExtern pwauth [/usr/sbin/pwauth]: Failed                              (1) for user ncp-web
[Wed Dec 12 19:00:32.694483 2018] [auth_basic:error] [pid 18844:tid 1809572896]                              [client 192.168.178.20:60008] AH01617: user ncp-web: authentication failure for                              "/": Password Mismatch
[Wed Dec 12 19:00:38.795957 2018] [proxy_fcgi:error] [pid 18845:tid 1935537184]                              [client 192.168.178.20:60010] AH01071: Got error 'PHP message: PHP Warning:  ini                             _set(): A session is active. You cannot change the session module's ini settings                              at this time in /var/www/ncp-web/index.php on line 41\nPHP message: PHP Warning                             :  ini_set(): A session is active. You cannot change the session module's ini se                             ttings at this time in /var/www/ncp-web/index.php on line 43\nPHP message: NACHO                              auto\n - [_auto_,en,de,es,zh]\n\nPHP message: NACHO en\n - [_auto_,en,de,es,zh]                             \n\nPHP message: NACHO de\n - [_auto_,en,de,es,zh]\n\nPHP message: NACHO es\n -                              [_auto_,en,de,es,zh]\n\nPHP message: NACHO zh\n - [_auto_,en,de,es,zh]\n\n'
[Wed Dec 12 19:01:02.101932 2018] [proxy_fcgi:error] [pid 18844:tid 1750766624]                              [client 192.168.178.20:60022] AH01071: Got error 'PHP message: PHP Warning:  tou                             ch(): Utime failed: Permission denied in /var/www/ncp-web/ncp-output.php on line                              81\n'
[Wed Dec 12 19:03:35.637584 2018] [proxy_fcgi:error] [pid 18844:tid 1750766624]                              [client 192.168.178.20:60320] AH01071: Got error 'PHP message: PHP Warning:  tou                             ch(): Utime failed: Permission denied in /var/www/ncp-web/ncp-output.php on line                              81\n'
Database logs
6

I could not add the rest as I reached the maximum limit of characters in the forum.

Here is a pastebin link. Unfortunately, its messed up and not formatted correctly.

https://pastebin.com/ELjki47Z

7

You can use pastbin for longer reports and just share a link here.
The screenshot you are sharing is not showing yes in nc-backup. It does not help in any way, or am I missing something?
My German is not good enough to assist you in that language, there is a German channel if your English is like my German. :wink:

8

Sorry for the mistake with the picture and German language. Both corrected.

9

From your pastbin
You’re using btrfs
You should try to use nc-snapshot and nc-snapshot-auto for backups, it is specifically for btrfs.
nc-backup and nc-backup-auto are really for ext4.
@nachoparker published couple articles on btrfs
among other things learn you can check btrfs disk usage with:

btrfs-du /path/

And why results differ from using

du -sh and ls -lh

He will let us know, when he reads this, if using nc-backup on btrfs is oke or not. You have bunch of errors in your httpd log, but they look unrelated to me.