Internal server error after updating to Jammy Jelly

ℹ️ Support
1

I have a linux machine in my living room that I use to watch media. It is also serves as my home Nextcloud Server.

Ubuntu gave me an alert saying I needed to update to Jammy Jellly so I did. Afterwards I got the white screen of death.

I had a similar problem a couple of years ago but I have already ruled out this being a repeat:

Here is my ngniix error log:

2022/09/10 06:55:45 [error] 79776#79776: *88928 open() "/usr/share/nginx/html/404/index.html" failed (2: No such file or directory), client: 222.186.19.235, server: localhost, request: "GET http://fuwu.sogou.com/404/index.html HTTP/1.1", host: "fuwu.sogou.com"
2022/09/10 06:55:45 [error] 79777#79777: *88929 open() "/usr/share/nginx/html/404/index.html" failed (2: No such file or directory), client: 222.186.19.235, server: localhost, request: "GET http://fuwu.sogou.com/404/index.html HTTP/1.1", host: "fuwu.sogou.com"
2022/09/10 07:47:09 [error] 79776#79776: *89652 open() "/usr/share/nginx/html/favicon.ico" failed (2: No such file or directory), client: 64.62.197.6, server: localhost, request: "GET /favicon.ico HTTP/1.1", host: "136.49.246.64"
2022/09/10 11:05:36 [error] 79776#79776: *92311 open() "/usr/share/nginx/html/favicon.ico" failed (2: No such file or directory), client: 45.83.67.225, server: localhost, request: "GET /favicon.ico HTTP/1.1", host: "136.49.246.64"
2022/09/10 12:02:28 [error] 79776#79776: *93312 open() "/usr/share/nginx/html/.env" failed (2: No such file or directory), client: 20.117.122.229, server: localhost, request: "GET /.env HTTP/1.1", host: "136.49.246.64"
2022/09/10 12:44:48 [error] 79776#79776: *93806 open() "/usr/share/nginx/html/fuN3" failed (2: No such file or directory), client: 172.104.138.223, server: localhost, request: "GET /fuN3 HTTP/1.0"
2022/09/10 12:47:16 [error] 79776#79776: *93808 open() "/usr/share/nginx/html/robots.txt" failed (2: No such file or directory), client: 94.102.49.193, server: localhost, request: "GET /robots.txt HTTP/1.1", host: "136.49.246.64"
2022/09/10 12:47:17 [error] 79776#79776: *93809 open() "/usr/share/nginx/html/sitemap.xml" failed (2: No such file or directory), client: 94.102.49.193, server: localhost, request: "GET /sitemap.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 12:47:18 [error] 79776#79776: *93810 open() "/usr/share/nginx/html/.well-known/security.txt" failed (2: No such file or directory), client: 94.102.49.193, server: localhost, request: "GET /.well-known/security.txt HTTP/1.1", host: "136.49.246.64"
2022/09/10 12:47:18 [error] 79776#79776: *93811 open() "/usr/share/nginx/html/favicon.ico" failed (2: No such file or directory), client: 94.102.49.193, server: localhost, request: "GET /favicon.ico HTTP/1.1", host: "136.49.246.64"
2022/09/10 13:53:48 [error] 79776#79776: *95021 open() "/usr/share/nginx/html/Autodiscover/Autodiscover.xml" failed (2: No such file or directory), client: 152.89.196.211, server: localhost, request: "POST /Autodiscover/Autodiscover.xml HTTP/1.1", host: "136.49.246.64:80"
2022/09/10 13:54:33 [error] 79776#79776: *95022 open() "/usr/share/nginx/html/boaform/admin/formLogin" failed (2: No such file or directory), client: 117.223.85.1, server: localhost, request: "GET /boaform/admin/formLogin?username=admin&psd=admin HTTP/1.0"
2022/09/10 14:00:37 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:37 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/xmlrpc.php" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /xmlrpc.php?rsd HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:38 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/blog/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /blog/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:38 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/web/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /web/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:38 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/wordpress/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /wordpress/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:39 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/website/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /website/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:39 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/wp/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /wp/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:39 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/news/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /news/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:40 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/2018/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /2018/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:40 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/2019/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /2019/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:40 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/shop/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /shop/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:41 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/wp1/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /wp1/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:41 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/test/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /test/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:41 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/media/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /media/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:42 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/wp2/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /wp2/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:42 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/site/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /site/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:42 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/cms/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /cms/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 14:00:43 [error] 79776#79776: *95027 open() "/usr/share/nginx/html/sito/wp-includes/wlwmanifest.xml" failed (2: No such file or directory), client: 156.96.154.202, server: localhost, request: "GET /sito/wp-includes/wlwmanifest.xml HTTP/1.1", host: "136.49.246.64"
2022/09/10 15:56:13 [error] 79776#79776: *96506 open() "/usr/share/nginx/html/hudson" failed (2: No such file or directory), client: 192.241.219.174, server: localhost, request: "GET /hudson HTTP/1.1", host: "136.49.246.64"

And here is the nextcloud acces logs

192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.015 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.015" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.015 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.015" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.015 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.015" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.014 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.013" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.017 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.017" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.020 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.019" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.017 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.016" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.016 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.016" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.018 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.017" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.013 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.013" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.011 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.011" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.014 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.014" ul="306" cs=-
192.168.1.1 - - [10/Sep/2022:00:00:02 -0500] "GET /index.php/204 HTTP/2.0" 500 289 "-" "Mozilla/5.0 (Android) Nextcloud-android/3.21.2" "-" "cloud.aslanfrench.work" sn="cloud.aslanfrench.work" rt=0.020 ua="unix:/run/php/php7.4-fpm.sock" us="500" ut="0.020" ul="306" cs=-
2

You see the 500 error in the access log as well. You need to check the error log in the same time range. In you php-config, you can perhaps enable logging as well. And you checked all the required php modules are intalled?

3

Ubuntu update are bullshit… Most of the time, dependencies are not updated, or new stuff is installed without consent, like for exemple php8.1 when you had php 8.0 …

Check your modules, check dependencies, check also the DB version and php version …

4

How do I know what things I’m supposed to check? Like is not a way to run some kind of thing that just tells me what isn’t installed that needs to be installed? Apologies, if this is a dumb question.

5

dpkg --get-selections

gives you all packages installed. Problem is that packages are renamed and sometimes restructured between versions. So it’s not a 1:1 model. However, with php packages, you see if there are some missing and if you had phpx.y-module, in the new version it is probably phpz.y-module. The logs should throw errors as well that php-module is missing.

6

Sorry I know I probably should already know this but how do I check the error logs? I checked the nginx log but it didn’t say anything about missing php modules.

7

and it wont.

php modules can by “reinstalled” on top of each other without problems.

Just simple php -m to list compile and installed modules

# yum list installed  `grep -i php` #RHEL/CentOS|
# dnf list installed  `grep -i php` #Fedora 22+
# dpkg --get-selections  `grep -i php`#Debian/Ubuntu
# uniform ultimate linux command, my dream... never to be fullfill

if this can help, my module list ( debian11 - php8 - apache )

[PHP Modules]
calendar
Core
ctype
curl
date
dom
exif
FFI
fileinfo
filter
ftp
gd
gettext
hash
iconv
igbinary
json
libxml
mbstring
mcrypt
mysqli
mysqlnd
openssl
pcntl
pcre
PDO
pdo_mysql
Phar
posix
readline
redis
Reflection
session
shmop
SimpleXML
sockets
sodium
SPL
standard
sysvmsg
sysvsem
sysvshm
tokenizer
xml
xmlreader
xmlwriter
xsl
Zend OPcache
zip
zlib

[Zend Modules]
Zend OPcache
1 Like
8

I tried this command but it didn’t work. The use of the ticks marks look weird to me but my bash is pretty novice. Are those two separate commands?

Here are my php modules:

[PHP Modules]
apcu
calendar
Core
ctype
date
exif
FFI
fileinfo
filter
ftp
gettext
hash
iconv
igbinary
imagick
json
libsmbclient
libxml
openssl
pcntl
pcre
PDO
Phar
posix
readline
redis
Reflection
session
shmop
smbclient
sockets
sodium
SPL
standard
sysvmsg
sysvsem
sysvshm
tokenizer
Zend OPcache
zlib

[Zend Modules]
Zend OPcache

I notice curl missing which seems like it would probably be pretty important.

It won’t show up in the error logs?

9

Here are some requirements in the documentation:
https://docs.nextcloud.com/server/latest/admin_manual/installation/source_installation.html

Sometimes you need to raise the log level in the configuration and restart the service.

10

I appreciate all the help! After doing some investigation, it looks like my main SSD that the server runs on is starting to give out so I’m just going to do a clean install of Nextcloud from the ground up.