Troubleshooting Log / NC 21 keeps crashing

Support intro

Sorry to hear you’re facing problems :slightly_frowning_face:

help.nextcloud.com is for home/non-enterprise users. If you’re running a business, paid support can be accessed via portal.nextcloud.com where we can ensure your business keeps running smoothly.

In order to help you as quickly as possible, before clicking Create Topic please provide as much of the below as you can. Feel free to use a pastebin service for logs, otherwise either indent short log examples with four spaces:

example

Or for longer, use three backticks above and below the code snippet:

longer
example
here

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can :heart:

Nextcloud version (eg, 20.0.5): 21.0.0
Operating system and version (eg, Ubuntu 20.04): 20.04.2
Apache or nginx version (eg, Apache 2.4.25): Apache/2.4.41
PHP version (eg, 7.4): 7.4.3

The issue you are facing:

Is this the first time you’ve seen this error? (Y/N): N

Steps to replicate it:

  1. Upgraded NC20 with a lot of apps to NC21
  2. NC runs for a while (1-2days) then stops working (apache restart does not help)
  3. Log is full of errors

The output of your Nextcloud log in Admin > Logging:

https://paste.ubuntu.com/p/C5Sv5JS9XF/

The output of your config.php file in /path/to/nextcloud (make sure you remove any identifiable information!):

<?php
$CONFIG = array (
  'passwordsalt' => '<redacted>',
  'secret' => '<redacted>',
  'trusted_domains' =>
  array (
    0 => 'localhost',
    1 => '<redacted>',
    2 => '<redacted>',
    3 => '<redacted>',
  ),
  'datadirectory' => '/mnt/ncdata',
  'dbtype' => 'pgsql',
  'version' => '21.0.0.18',
  'overwrite.cli.url' => '<redacted>',
  'dbname' => 'nextcloud_db',
  'dbhost' => 'localhost',
  'dbport' => '',
  'dbtableprefix' => 'oc_',
  'dbuser' => 'ncadmin',
  'dbpassword' => '<redacted>',
  'installed' => true,
  'instanceid' => '<redacted>',
  'upgrade.disable-web' => 'true',
  'log_type' => 'file',
  'logfile' => '/var/log/nextcloud/nextcloud.log',
  'loglevel' => '2',
  'log.condition' =>
  array (
    'apps' =>
    array (
      0 => 'admin_audit',
    ),
  ),
  'mail_smtpmode' => 'smtp',
  'remember_login_cookie_lifetime' => '1800',
  'log_rotate_size' => '10485760',
  'trashbin_retention_obligation' => 'auto, 180',
  'versions_retention_obligation' => 'auto, 365',
  'simpleSignUpLink.shown' => false,
  'memcache.local' => '\\OC\\Memcache\\APCu',
  'filelocking.enabled' => true,
  'memcache.distributed' => '\\OC\\Memcache\\Redis',
  'memcache.locking' => '\\OC\\Memcache\\Redis',
  'redis' =>
  array (
    'host' => '/var/run/redis/redis-server.sock',
    'port' => 0,
    'timeout' => 0.5,
    'dbindex' => 0,
    'password' => '<redacted>',
  ),
  'logtimezone' => 'Europe/Zurich',
  'htaccess.RewriteBase' => '/',
  'enable_previews' => true,
  'enabledPreviewProviders' =>
  array (
    11 => 'OC\\Preview\\PNG',
    12 => 'OC\\Preview\\JPEG',
    13 => 'OC\\Preview\\GIF',
    14 => 'OC\\Preview\\BMP',
    15 => 'OC\\Preview\\MarkDown',
    16 => 'OC\\Preview\\MP3',
    17 => 'OC\\Preview\\TXT',
    18 => 'OC\\Preview\\Movie',
  ),
  'preview_max_x' => '2048',
  'preview_max_y' => '2048',
  'jpeg_quality' => '60',
  'maintenance' => false,
  'mail_smtpsecure' => 'ssl',
  'mail_sendmailmode' => 'smtp',
  'mail_smtpauth' => 1,
  'mail_smtpauthtype' => 'LOGIN',
  'mail_from_address' => '<redacted>',
  'mail_domain' => '<redacted>',
  'mail_smtphost' => '<redacted>',
  'mail_smtpport' => '465',
  'mail_smtpname' => '<redacted>',
  'mail_smtppassword' => '<redacted>',
  'default_phone_region' => 'ch',
  'app_install_overwrite' =>
  array (
    0 => 'occweb',
    1 => 'apporder',
  ),
);

The output of your Apache/nginx/system log in /var/log/____ (output of apache error.log):

[Fri Mar 05 01:19:43.065282 2021] [ssl:error] [pid 134959:tid 140601014279232] AH02604: Unable to configure certificate adminer.<redacted.com>:443:0 for stapling
[Fri Mar 05 01:19:43.065876 2021] [mpm_event:notice] [pid 134959:tid 140601014279232] AH00489: Apache/2.4.41 (Ubuntu) OpenSSL/1.1.1f configured -- resuming normal operations
[Fri Mar 05 01:19:43.065886 2021] [core:notice] [pid 134959:tid 140601014279232] AH00094: Command line: '/usr/sbin/apache2'
[Fri Mar 05 01:19:47.134579 2021] [core:warn] [pid 134959:tid 140601014279232] AH00045: child process 199261 still did not exit, sending a SIGTERM
[Fri Mar 05 01:19:47.134670 2021] [core:warn] [pid 134959:tid 140601014279232] AH00045: child process 199262 still did not exit, sending a SIGTERM
[Fri Mar 05 01:19:49.136481 2021] [core:warn] [pid 134959:tid 140601014279232] AH00045: child process 199261 still did not exit, sending a SIGTERM
[Fri Mar 05 01:19:49.136549 2021] [core:warn] [pid 134959:tid 140601014279232] AH00045: child process 199262 still did not exit, sending a SIGTERM
[Fri Mar 05 01:19:51.138660 2021] [core:warn] [pid 134959:tid 140601014279232] AH00045: child process 199261 still did not exit, sending a SIGTERM
[Fri Mar 05 01:19:51.138729 2021] [core:warn] [pid 134959:tid 140601014279232] AH00045: child process 199262 still did not exit, sending a SIGTERM
[Fri Mar 05 01:19:53.140450 2021] [core:error] [pid 134959:tid 140601014279232] AH00046: child process 199261 still did not exit, sending a SIGKILL
[Fri Mar 05 01:19:53.140569 2021] [core:error] [pid 134959:tid 140601014279232] AH00046: child process 199262 still did not exit, sending a SIGKILL
[Fri Mar 05 01:19:54.142052 2021] [mpm_event:notice] [pid 134959:tid 140601014279232] AH00491: caught SIGTERM, shutting down
[Fri Mar 05 01:19:57.351254 2021] [ssl:error] [pid 199594:tid <redacted>] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=<redacted.com> / issuer: CN=R3,O=Let's Encrypt,C=US / serial: <redacted> / notbefore: Feb 21 21:36:40 2021 GMT / notafter: May 22 21:36:40 2021 GMT]
[Fri Mar 05 01:19:57.351266 2021] [ssl:error] [pid 199594:tid <redacted>] AH02604: Unable to configure certificate netdata.<redacted.com>:443:0 for stapling
[Fri Mar 05 01:19:57.351618 2021] [ssl:error] [pid 199594:tid <redacted>] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=<redacted.com> / issuer: CN=R3,O=Let's Encrypt,C=US / serial: <redacted> / notbefore: Feb 21 21:36:40 2021 GMT / notafter: May 22 21:36:40 2021 GMT]
[Fri Mar 05 01:19:57.351629 2021] [ssl:error] [pid 199594:tid <redacted>] AH02604: Unable to configure certificate adminer.<redacted.com>:443:0 for stapling
[Fri Mar 05 01:19:57.362572 2021] [ssl:error] [pid 199595:tid <redacted>] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=<redacted.com> / issuer: CN=R3,O=Let's Encrypt,C=US / serial: <redacted> / notbefore: Feb 21 21:36:40 2021 GMT / notafter: May 22 21:36:40 2021 GMT]
[Fri Mar 05 01:19:57.362585 2021] [ssl:error] [pid 199595:tid <redacted>] AH02604: Unable to configure certificate netdata.<redacted.com>:443:0 for stapling
[Fri Mar 05 01:19:57.362900 2021] [ssl:error] [pid 199595:tid <redacted>] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=<redacted.com> / issuer: CN=R3,O=Let's Encrypt,C=US / serial: <redacted> / notbefore: Feb 21 21:36:40 2021 GMT / notafter: May 22 21:36:40 2021 GMT]
[Fri Mar 05 01:19:57.362909 2021] [ssl:error] [pid 199595:tid <redacted>] AH02604: Unable to configure certificate adminer.<redacted.com>:443:0 for stapling
[Fri Mar 05 01:19:57.364433 2021] [mpm_event:notice] [pid 199595:tid <redacted>] AH00489: Apache/2.4.41 (Ubuntu) OpenSSL/1.1.1f configured -- resuming normal operations
[Fri Mar 05 01:19:57.364460 2021] [core:notice] [pid 199595:tid <redacted>] AH00094: Command line: '/usr/sbin/apache2'
[Fri Mar 05 16:21:52.836877 2021] [mpm_event:notice] [pid 199595:tid <redacted>] AH00493: SIGUSR1 received.  Doing graceful restart
[Fri Mar 05 16:21:52.852714 2021] [ssl:error] [pid 199595:tid <redacted>] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=<redacted.com> / issuer: CN=R3,O=Let's Encrypt,C=US / serial: <redacted> / notbefore: Feb 21 21:36:40 2021 GMT / notafter: May 22 21:36:40 2021 GMT]
[Fri Mar 05 16:21:52.852726 2021] [ssl:error] [pid 199595:tid <redacted>] AH02604: Unable to configure certificate netdata.<redacted.com>:443:0 for stapling
[Fri Mar 05 16:21:52.853081 2021] [ssl:error] [pid 199595:tid <redacted>] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=<redacted.com> / issuer: CN=R3,O=Let's Encrypt,C=US / serial: <redacted> / notbefore: Feb 21 21:36:40 2021 GMT / notafter: May 22 21:36:40 2021 GMT]
[Fri Mar 05 16:21:52.853093 2021] [ssl:error] [pid 199595:tid <redacted>] AH02604: Unable to configure certificate adminer.<redacted.com>:443:0 for stapling
[Fri Mar 05 16:21:52.853763 2021] [mpm_event:notice] [pid 199595:tid <redacted>] AH00489: Apache/2.4.41 (Ubuntu) OpenSSL/1.1.1f configured -- resuming normal operations
[Fri Mar 05 16:21:52.853772 2021] [core:notice] [pid 199595:tid <redacted>] AH00094: Command line: '/usr/sbin/apache2'
[Fri Mar 05 16:23:26.538924 2021] [mpm_event:notice] [pid 199595:tid <redacted>] AH00493: SIGUSR1 received.  Doing graceful restart
[Fri Mar 05 16:23:26.551051 2021] [ssl:error] [pid 199595:tid <redacted>] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=<redacted.com> / issuer: CN=R3,O=Let's Encrypt,C=US / serial: <redacted> / notbefore: Feb 21 21:36:40 2021 GMT / notafter: May 22 21:36:40 2021 GMT]
[Fri Mar 05 16:23:26.551063 2021] [ssl:error] [pid 199595:tid <redacted>] AH02604: Unable to configure certificate netdata.<redacted.com>:443:0 for stapling
[Fri Mar 05 16:23:26.551401 2021] [ssl:error] [pid 199595:tid <redacted>] AH02217: ssl_stapling_init_cert: can't retrieve issuer certificate! [subject: CN=<redacted.com> / issuer: CN=R3,O=Let's Encrypt,C=US / serial: <redacted> / notbefore: Feb 21 21:36:40 2021 GMT / notafter: May 22 21:36:40 2021 GMT]
[Fri Mar 05 16:23:26.551413 2021] [ssl:error] [pid 199595:tid <redacted>] AH02604: Unable to configure certificate adminer.<redacted.com>:443:0 for stapling
[Fri Mar 05 16:23:26.552005 2021] [mpm_event:notice] [pid 199595:tid <redacted>] AH00489: Apache/2.4.41 (Ubuntu) OpenSSL/1.1.1f configured -- resuming normal operations
[Fri Mar 05 16:23:26.552014 2021] [core:notice] [pid 199595:tid <redacted>] AH00094: Command line: '/usr/sbin/apache2'
[Fri Mar 05 16:23:30.622579 2021] [core:warn] [pid 199595:tid <redacted>] AH00045: child process 199596 still did not exit, sending a SIGTERM
[Fri Mar 05 16:23:30.622664 2021] [core:warn] [pid 199595:tid <redacted>] AH00045: child process 199597 still did not exit, sending a SIGTERM
[Fri Mar 05 16:23:30.622686 2021] [core:warn] [pid 199595:tid <redacted>] AH00045: child process 260424 still did not exit, sending a SIGTERM

logs look a bit different when i do it via CLI and not via the GUI, seems checking logs via GUI causes its own errors…
here are some more errors from the nextcloud.log file:
https://paste.ubuntu.com/p/wNZGzqQCyC/

did I miss to provide the necessary information?
What else should I provide, anyone able to help?

i hope its ok to “bump”

i guess it is, “bump”

please? anyone?