Blank page after Debian Stretch --> Buster update. Nothing works ! Helpless!

Aircan · November 10, 2019, 10:54am

Support intro

Sorry to hear you’re facing problems

help.nextcloud.com is for home/non-enterprise users. If you’re running a business, paid support can be accessed via portal.nextcloud.com where we can ensure your business keeps running smoothly.

In order to help you as quickly as possible, before clicking Create Topic please provide as much of the below as you can. Feel free to use a pastebin service for logs, otherwise either indent short log examples with four spaces:

example

Or for longer, use three backticks above and below the code snippet:

longer
example
here

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can

Nextcloud version (16.0.6):
Operating system and version (Debian 10):
Apache or nginx version (Apache 2.4.38):
PHP version (7.3):

The issue you are facing:
First NC update to 16.0.6. Then via ‘sudo apt-get update’, ‘sudo apt-get upgrade’ and ‘sudo apt-get dist-upgrade’ I made a upgrade from Stretch to Buster. After that I could not log in to NC. Blue page with hint, that php curl is not installed. Tried to intall curl --> Already latest verion installed. Tried to install php7.3-curl --> Already latest version installed.
Now the big bang: I followed an instruction and obiously pasted ‘sudo apt-get autoremove’. After that, I can only see a blank white screen when trying to connect to NC. (cloud.example.com) Tried it internally and via externally. Only white screen, no error code, nothing.
‘mysql -v’ delivers: -bash: mysql: Command not found.
Did I delete my Database?
Data in the /var/nextcloud/data folder is there. I checked.

Is this the first time you’ve seen this error? Y

Steps to replicate it:

The output of your Nextcloud log in Admin > Logging:

GUI can not be accessed

The output of your config.php file in /path/to/nextcloud (make sure you remove any identifiable information!):

<?php
$CONFIG = array (
  'instanceid' => 'Not_sure_if_useful_to_anonymize',
  'passwordsalt' => 'Not_sure_if_useful_to_anonymize',
  'secret' => 'Not_sure_if_useful_to_anonymize',
  'trusted_domains' =>
  array (
    0 => '192.168.0.50',
    1 => 'example.com',
    2 => 'anotherpage.com',
    3 => 'cloud.example.com',
    4 => 'www.example.com',
  ),
  'datadirectory' => '/var/nextcloud/data',
  'overwrite.cli.url' => 'http://192.168.0.50/nextcloud',
  'dbtype' => 'mysql',
  'version' => '16.0.6.1',
  'installed' => true,
  'memcache.local' => '\\OC\\Memcache\\APCu',
  'mail_smtpmode' => 'smtp',
  'mail_smtpauthtype' => 'LOGIN',
  'mail_from_address' => 'myname',
  'mail_domain' => 'exampleprovider.com',
  'mail_smtpauth' => 1,
  'mail_smtphost' => 'mail.exampleprovider.com',
  'mail_smtpport' => '465',
  'mail_smtpname' => 'ab@cd.ef',
  'mail_smtppassword' => 'password123',
  'mail_smtpsecure' => 'ssl',
  'maintenance' => false,
  'theme' => '',
  'loglevel' => 2,
  'dbname' => 'nc_database',
  'dbhost' => '127.0.0.1',
  'dbuser' => 'root',
  'dbpassword' => 'anotherpasswort123',
  'updater.secret' => 'Not_sure_if_useful_to_anonymize',
  'app_install_overwrite' =>
  array (
    0 => 'calendar',
  ),
);

The output of your Apache/nginx/system log in /var/log/apache2/error.log: I hope that is the right one. Ohterwise please give me a hint.

PHP Warning:  PHP Startup: Unable to load dynamic library 'redis.so' (tried: /usr/lib/php/20170718/redis.so (/usr/lib/php/20170718/redis.so: undefined s$PHP Warning:  Module 'sqlite3' already loaded in Unknown on line 0
[Sun Nov 10 00:00:03.387700 2019] [mpm_prefork:notice] [pid 2481] AH00163: Apache/2.4.38 (Debian) OpenSSL/1.1.1d configured -- resuming normal operations[Sun Nov 10 00:00:03.387774 2019] [core:notice] [pid 2481] AH00094: Command line: '/usr/sbin/apache2'
[Sun Nov 10 00:34:15.070758 2019] [php7:error] [pid 3156] [client 192.168.0.1:55471] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 00:34:15.073353 2019] [php7:error] [pid 3156] [client 192.168.0.1:55471] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:27:17.442883 2019] [php7:error] [pid 3160] [client 192.168.0.1:41603] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:27:17.446365 2019] [php7:error] [pid 3160] [client 192.168.0.1:41603] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:27:17.449505 2019] [php7:error] [pid 3434] [client 192.168.0.1:36770] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:27:17.452190 2019] [php7:error] [pid 3434] [client 192.168.0.1:36770] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:27:17.473293 2019] [php7:error] [pid 3159] [client 192.168.0.1:56544] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:27:17.476025 2019] [php7:error] [pid 3159] [client 192.168.0.1:56544] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:27:17.481304 2019] [php7:error] [pid 3755] [client 192.168.0.1:33348] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:27:17.483853 2019] [php7:error] [pid 3755] [client 192.168.0.1:33348] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:34:37.438869 2019] [php7:error] [pid 3156] [client 192.168.0.1:43913] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:34:37.443338 2019] [php7:error] [pid 3156] [client 192.168.0.1:43913] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:49:08.898157 2019] [php7:error] [pid 3157] [client 192.168.0.1:55486] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 01:49:08.900877 2019] [php7:error] [pid 3157] [client 192.168.0.1:55486] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 02:33:25.174814 2019] [php7:error] [pid 3757] [client 192.168.0.1:55492] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 02:33:25.179353 2019] [php7:error] [pid 3757] [client 192.168.0.1:55492] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 03:49:09.275126 2019] [php7:error] [pid 3159] [client 192.168.0.1:55509] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 03:49:09.279894 2019] [php7:error] [pid 3159] [client 192.168.0.1:55509] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 04:44:10.092824 2019] [php7:error] [pid 3157] [client 192.168.0.1:55514] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 04:44:10.097281 2019] [php7:error] [pid 3157] [client 192.168.0.1:55514] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:16:29.975253 2019] [php7:error] [pid 3755] [client 192.168.0.1:48672] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:16:29.979713 2019] [php7:error] [pid 3755] [client 192.168.0.1:48672] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:16:30.104823 2019] [php7:error] [pid 3156] [client 192.168.0.1:57679] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:16:30.107244 2019] [php7:error] [pid 3156] [client 192.168.0.1:57679] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:16:30.183069 2019] [php7:error] [pid 3756] [client 192.168.0.1:56231] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:16:30.186099 2019] [php7:error] [pid 3756] [client 192.168.0.1:56231] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:16:30.210856 2019] [php7:error] [pid 3158] [client 192.168.0.1:39125] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:16:30.213460 2019] [php7:error] [pid 3158] [client 192.168.0.1:39125] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:44:11.158426 2019] [php7:error] [pid 3160] [client 192.168.0.1:55526] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 05:44:11.163112 2019] [php7:error] [pid 3160] [client 192.168.0.1:55526] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 06:44:11.041370 2019] [php7:error] [pid 3156] [client 192.168.0.1:55534] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 06:44:11.045738 2019] [php7:error] [pid 3156] [client 192.168.0.1:55534] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:33:26.113918 2019] [php7:error] [pid 3158] [client 192.168.0.1:55540] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:33:26.118195 2019] [php7:error] [pid 3158] [client 192.168.0.1:55540] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:42:36.862883 2019] [php7:error] [pid 3157] [client 192.168.0.1:44976] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:42:36.868024 2019] [php7:error] [pid 3157] [client 192.168.0.1:44976] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:42:36.875622 2019] [php7:error] [pid 3434] [client 192.168.0.1:47095] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:42:36.879950 2019] [php7:error] [pid 3434] [client 192.168.0.1:47095] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:42:36.892900 2019] [php7:error] [pid 3159] [client 192.168.0.1:43184] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:42:36.897696 2019] [php7:error] [pid 3159] [client 192.168.0.1:43184] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:42:36.913026 2019] [php7:error] [pid 3755] [client 192.168.0.1:43326] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:42:36.917262 2019] [php7:error] [pid 3755] [client 192.168.0.1:43326] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:45:32.541398 2019] [php7:error] [pid 3156] [client 192.168.0.1:40227] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:45:32.545740 2019] [php7:error] [pid 3156] [client 192.168.0.1:40227] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$[Sun Nov 10 07:45:33.411229 2019] [php7:error] [pid 3756] [client 192.168.0.1:40230] PHP Fatal error:  Uncaught Doctrine\\DBAL\\DBALException: Failed to$

Reiner_Nippes · November 10, 2019, 11:29am

did you check if your apache config “points” to the new php version?

debian 9 has “normally” php7.0 installed. debian 10 moved to php7.3. afaik.

google knows about this problem. e.g.

mysql: which mysql or locate mysql will tell you if and where to find file named mysql. apt-cache policy mysql-server and/or apt-cache policy mariadb-server will tell you if and which version of mariadb/mysql is installed.

if you removed mysql normally the database is not removed and should be in /var/lib/mysql.

make a backup of all this files in this folder. plus /etc/mysql plus /var/nextcloud.

Aircan · November 10, 2019, 11:50am

Hello Reiner,

as far as I can remember I already switched to php7.3 at an earlier point of time. Nonetheless I tried out some of the thins you posted an got following results.

sudo a2enmod php7.3
Considering dependency mpm_prefork for php7.3:
Considering conflict mpm_event for mpm_prefork:
Considering conflict mpm_worker for mpm_prefork:
Module mpm_prefork already enabled
Considering conflict php5 for php7.3:
Enabling module php7.3.
To activate the new configuration, you need to run:
   systemctl restart apache2

After restart: Still blank white page.
Next step:

which mysql

→ no result in cli

Next step:

locate mysql

→ no result in cli

Next step:

apt-cache policy mysql-server

result:

mysql-server:
   Installiert:           (keine)
   Installationskandidat: (keine)
   Versionstabelle:

Next step:

apt-cache policy mariadb-server

result:

mariadb-server:
 Installiert:           (keine)
 Installationskandidat: 1:10.3.17-0+deb10u1
 Versionstabelle:
    1:10.3.17-0+deb10u1 500
       500 http://ftp.de.debian.org/debian buster/main armhf Packages
       500 http://deb.debian.org/debian buster/main armhf Packages

Next step:

cd /var/lib/mysql
-bash: cd: /var/lib/mysql: Keine Berechtigung

make a backup of all this files in this folder. plus /etc/mysql plus /var/nextcloud.

How to?

Is my assumtion right, that I do not have mysql and mariadb anymore? Sor reinstall and than paste the backuped files back to the folders?

Thank you in advance.

Reiner_Nippes · November 10, 2019, 12:27pm

sudo ls -l /var/lib/mysql to check if your database files are still there.

depends on your setup. if you have enough free disc space make a backup (rsync, tar) to e.g. /var/backups/nextcloud otherwise attache an usb stick/drive to your server and copy the files there.

assuming your nextcloud installation is in /var/www/nextcloud and you have enough place in /var/backups :

## check your disc space

sudo df -h /var/backups 
sudo du -h --max-depth=0 /var/lib/mysql
sudo du -h --max-depth=0 /var/nextcloud/data
sudo du -h --max-depth=0 /var/www/nextcloud

# make a backup
sudo mkdir -p /var/backups/nextcloud
sudo tar cvzf /var/backups/nextcloud/backup-2019-11-10.tgz /var/lib/mysql /var/nextcloud/data /var/www/nextcloud

check every command twice before copy&paste.

of course. your db is gone.

to check your php installation: put the following line phpinfo(); in the nextcloud’s index.php file and reload. you should a php config page. remove the line after successful testing.

<?php
phpinfo();

.....

?>

there is a mariadb candidate that can be installed. (either there is no mysql because debian doesn’t support or the package has a different name.)

which db was installed? do you know? look in /etc/mysql if there are file like mariadb.conf

best case: just reinstall. the installer finds a database in place and won’t touch any of your config files.

backup is only for wimps or this plan fails for any reason.

Aircan · November 10, 2019, 12:32pm

sudo ls -l /var/lib/mysql
insgesamt 182340
drwx------ 2 mysql mysql     4096 Okt 16  2016 agendav
-rw-rw---- 1 mysql mysql    16384 Nov  9 22:35 aria_log.00000001
-rw-rw---- 1 mysql mysql       52 Nov  9 22:35 aria_log_control
drwx------ 2 mysql mysql     4096 Okt 20  2016 baikal
-rw-r--r-- 1 root  root         0 Nov  9 22:04 debian-10.3.flag
-rw-rw---- 1 mysql mysql     4403 Nov  9 22:35 ib_buffer_pool
-rw-rw---- 1 mysql mysql 85983232 Nov  9 22:35 ibdata1
-rw-rw---- 1 mysql mysql 50331648 Nov  9 22:35 ib_logfile0
-rw-rw---- 1 mysql mysql 50331648 Nov  9 22:04 ib_logfile1
drwx------ 2 mysql mysql     4096 Okt 14  2016 lighttpd
-rw-rw---- 1 mysql mysql        0 Dez  2  2018 multi-master.info
drwx------ 2 mysql mysql     4096 Nov  9 22:04 mysql
-rw------- 1 mysql mysql       16 Nov  9 22:04 mysql_upgrade_info
drwx------ 2 mysql mysql    12288 Nov  9 21:24 nc_database
drwx------ 2 mysql mysql     4096 Nov  9 22:04 performance_schema

sudo df -h /var/backups
Dateisystem    Größe Benutzt Verf. Verw% Eingehängt auf
/dev/root       118G     98G   15G   88% /


sudo du -h --max-depth=0 /var/lib/mysql
285M    /var/lib/mysql


sudo du -h --max-depth=0 /var/nextcloud/data
91G     /var/nextcloud/data


sudo du -h --max-depth=0 /var/www/html/nextcloud
295M    /var/www/html/nextcloud

Seems pretty crowded. ;-(
The plan was to update all and then mount a 128 GB USB Stick to have add. storage.

After having added phpinfo(); and reload I get:

PHP Version 7.2.13-1+0~20181207100540.13+stretch~1.gbpf57305

So I also sudo a2dismod php7.2 retested and now running 7.3. Hope that was a good proactive move ;-).

which db was installed? do you know? look in /etc/mysql if there are file like mariadb.conf

Yes, there is a mariadb.conf and also:

conf.d  debian.cnf  debian-start  mariadb.cnf  mariadb.conf.d  my.cnf  my.cnf.fallback

Reiner_Nippes · November 10, 2019, 1:07pm

at least you can backup the database and nextcloud app files. if you sync to a desktop client you should have a copy of your file anyway. the database “only” holds meta and app data like shares, contacts, calendar, and so on.

btw: make also a backup of /etc/mysql

you should change the order: first backup, second change something.

say your favorite prayers and run apt install mariadb-server php72-mysql
(or check if the php mysql module is still installed first.)

Aircan · November 10, 2019, 1:17pm

Contacts and calendar are very important to me. So contacts have already been saved with Thunderbird. Calendar is not synced with desktop. No backup possible. Is it then backed up when doing as suggested by you?

Backup is now running inkl. /etc/mysql /var/www/html/nextcloud /var/lib/mysql

Just to double check. Is php72-mysql right? Or php73-mysql?

edit: Backup is done

Reiner_Nippes · November 10, 2019, 1:35pm

should be php72. double check: apt-cache policy php72 ; apt-cache policy php73

if you want to be save do a restore on another server. do you have virtual box somewhere installed? → install debian. copy /etc/mysql and /var/lib/mysql to this server. install mariadb. check your database.

Aircan · November 10, 2019, 1:40pm

sudo apt-get install php7.3-mysql is already installed

apt-cache policy php72 or apt-cache policy php32 or php72-mysql or php73-mysql

Delivers everytime: Package not found!

Wow, that would be a giant leap for me.

Shall I run the install command now for MariaDB? Even if package is not found in dry run?
I always install with apt-get. Should I use only apt?

Edit: So I brought Krishna a bottle of beer. Installed MariaDB and everything work fine again.

Thank you very much, Reiner. I appreciate your time very much.
Now it gets definately time for a proper backup strategy.
I was thinking about an add. 128 GB USB Stick to mount and do a backup of the whole Raspberry image.

Reiner_Nippes · November 10, 2019, 2:11pm

backup: you may find some ideas here: Nextcloud Backup and Restore - #6 by Reiner_Nippes