OCP\Files\NotFoundException with object store as primary v. 22.2.3

Support intro

Sorry to hear you’re facing problems :slightly_frowning_face:

help.nextcloud.com is for home/non-enterprise users. If you’re running a business, paid support can be accessed via portal.nextcloud.com where we can ensure your business keeps running smoothly.

In order to help you as quickly as possible, before clicking Create Topic please provide as much of the below as you can. Feel free to use a pastebin service for logs, otherwise either indent short log examples with four spaces:

example

Or for longer, use three backticks above and below the code snippet:

longer
example
here

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can :heart:

Nextcloud version: 22.2.3
Operating system and version : Ubuntu 20.04
Apache or nginx version: Apache 2.4.52
PHP version: 7.4
DBMS: PostgreSQL 12

The issue you are facing:

I have a working Nextcloud installation with a Swift container configured as primary object storage.
It is connected to LDAP for authentication.

Everything was working correctly until this morning, when - while updating email fields for some LDAP users - I received a 500 internal server error when trying to go back to the dashboard.

Inspecting the log, it seems that the error is caused by this exception (partial output from occ log:watch):

Error   objectstore  OCP\Files\NotFoundException: object urn:oid:<someid> not found in object store at  lib/private/Files/ObjectStore/Swift.php line 119

I did an inspect with Chrome, to watch the requests returning 500, and I believe this is related to a missing CSS file, for some reason:

image

So I’ve tried restoring a database backup from a few days earlier, to no avail.

I’ve listed the objects in the Swift container and found none with that urn:oid, I also couldn’t find any entries in the Nextcloud database, although I don’t think I’ve looked in the correct table.

I really have no idea how to solve this problem, so any help would be appreciated.
Thanks.

Is this the first time you’ve seen this error?:

Y

Steps to replicate it:

I’m not sure, since this seemed to come out of nowhere, as far as I understand.

The output of your Nextcloud log in Admin > Logging:

{"reqId":"RbNKJ4sCOPezYq3dczno","level":3,"time":"2022-01-24T14:34:38+00:00","remoteAddr":"<IP>","user":"--","app":"index","method":"GET","url":"/index.php/csrftoken","message":"object urn:oid:<someid> not found in object store","userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:96.0) Gecko/20100101 Firefox/96.0","version":"22.2.3.0","exception":{"Exception":"OCP\\Files\\NotFoundException","Message":"object urn:oid:<someid> not found in object store","Code":0,"Trace":[{"file":"/var/www/html/nextcloud/lib/private/Files/ObjectStore/ObjectStoreStorage.php","line":312,"function":"readObject","class":"OC\\Files\\ObjectStore\\Swift","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Files/Storage/Common.php","line":196,"function":"fopen","class":"OC\\Files\\ObjectStore\\ObjectStoreStorage","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Files/Storage/Wrapper/Wrapper.php","line":247,"function":"file_get_contents","class":"OC\\Files\\Storage\\Common","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Files/Storage/Wrapper/Availability.php","line":264,"function":"file_get_contents","class":"OC\\Files\\Storage\\Wrapper\\Wrapper","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Files/View.php","line":1171,"function":"file_get_contents","class":"OC\\Files\\Storage\\Wrapper\\Availability","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Files/View.php","line":601,"function":"basicOperation","class":"OC\\Files\\View","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Files/Node/File.php","line":56,"function":"file_get_contents","class":"OC\\Files\\View","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Files/SimpleFS/SimpleFile.php","line":90,"function":"getContent","class":"OC\\Files\\Node\\File","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Template/IconsCacher.php","line":115,"function":"getContent","class":"OC\\Files\\SimpleFS\\SimpleFile","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Template/SCSSCacher.php","line":350,"function":"setIconsCss","class":"OC\\Template\\IconsCacher","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Template/SCSSCacher.php","line":188,"function":"cache","class":"OC\\Template\\SCSSCacher","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Template/CSSResourceLocator.php","line":110,"function":"process","class":"OC\\Template\\SCSSCacher","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Template/CSSResourceLocator.php","line":62,"function":"cacheAndAppendScssIfExist","class":"OC\\Template\\CSSResourceLocator","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Template/ResourceLocator.php","line":78,"function":"doFind","class":"OC\\Template\\CSSResourceLocator","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/TemplateLayout.php","line":339,"function":"find","class":"OC\\Template\\ResourceLocator","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/TemplateLayout.php","line":247,"function":"findStylesheetFiles","class":"OC\\TemplateLayout","type":"::"},{"file":"/var/www/html/nextcloud/lib/private/legacy/OC_Template.php","line":182,"function":"__construct","class":"OC\\TemplateLayout","type":"->"},{"file":"/var/www/html/nextcloud/lib/private/Template/Base.php","line":132,"function":"fetchPage","class":"OC_Template","type":"->"},{"file":"/var/www/html/nextcloud/lib/base.php","line":297,"function":"printPage","class":"OC\\Template\\Base","type":"->"},{"file":"/var/www/html/nextcloud/lib/base.php","line":949,"function":"checkMaintenanceMode","class":"OC","type":"::"},{"file":"/var/www/html/nextcloud/index.php","line":36,"function":"handleRequest","class":"OC","type":"::"}],"File":"/var/www/html/nextcloud/lib/private/Files/ObjectStore/Swift.php","Line":119,"CustomMessage":"--"}}

The output of your config.php file in /path/to/nextcloud (make sure you remove any identifiable information!):

<?php
$CONFIG = array (
  'instanceid' => '***sensitive***',
  'trusted_domains' =>
  array (
    0 => '***sensitive***',
  ),
  'datadirectory' => '/var/www/html/nextcloud/data',
  'dbtype' => 'pgsql',
  'dbname' => '***sensitive***',
  'dbuser' => '***sensitive***',
  'dbpassword' => '***sensitive***',
  'dbhost' => '127.0.0.1:<port>',
  'dbport' => '',
  'dbtableprefix' => 'oc_',
  'default_language' => '***sensitive***',
  'default_locale' => '***sensitive***',
  'knowledgebaseenabled' => true,
  'log_rotate_size' => 104857600,
  'memcache.locking' => '\\OC\\Memcache\\Redis',
  'memcache.local' => '\\OC\\Memcache\\Redis',
  'redis' =>
  array (
    'host' => 'localhost',
    'port' => 6379,
    'timeout' => 0.0,
    'read_timeout' => 0.0,
    'user' => '***sensitive***',
    'password' => '***sensitive***',
    'dbindex' => 0,
  ),
  'version' => '22.2.3.0',
  'overwrite.cli.url' => '***sensitive***',
  'installed' => true,
  'mail_smtpmode' => 'smtp',
  'mail_smtpsecure' => 'ssl',
  'mail_sendmailmode' => 'smtp',
  'mail_from_address' => '***sensitive***',
  'mail_domain' => '***sensitive***',
  'mail_smtpauthtype' => 'LOGIN',
  'mail_smtpauth' => 1,
  'mail_smtphost' => '***sensitive***',
  'mail_smtpport' => '465',
  'mail_smtpname' => '***sensitive***',
  'objectstore' =>
  array (
    'class' => 'OC\\Files\\ObjectStore\\Swift',
    'arguments' =>
    array (
      'autocreate' => false,
      'user' =>
      array (
        'name' => '***sensitive***',
        'password' => '***sensitive***',
        'domain' =>
        array (
          'name' => '***sensitive***',
        ),
      ),
      'scope' =>
      array (
        'project' =>
        array (
          'name' => '***sensitive***',
          'domain' =>
          array (
            'name' => '***sensitive***',
          ),
        ),
      ),
      'serviceName' => 'Object Store',
      'region' => '***sensitive***',
      'url' => '***sensitive***',
      'bucket' => '***sensitive***',
    ),
  ),
  'mail_smtppassword' => '***sensitive***',
  'passwordsalt' => '***sensitive***',
  'secret' => ***sensitive***',
  'default_phone_region' => '***sensitive***',
  'maintenance' => true,
  'ldapProviderFactory' => 'OCA\\User_LDAP\\LDAPProviderFactory',

The output of your Apache/nginx/system log in /var/log/____:

***sensitive*** - - [24/Jan/2022:15:51:14 +0100] "GET /core/js/dist/files_fileinfo.js?v=7df8c54e-21 HTTP/1.1" 200 10173 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive*** - - [24/Jan/2022:15:51:14 +0100] "GET /core/js/dist/maintenance.js?v=7df8c54e-21 HTTP/1.1" 200 34644 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive***- - [24/Jan/2022:15:51:14 +0100] "GET /core/js/dist/files_client.js?v=7df8c54e-21 HTTP/1.1" 200 51701 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive*** - - [24/Jan/2022:15:51:15 +0100] "GET /core/img/background.png?v=2 HTTP/1.1" 200 10227 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive*** - - [24/Jan/2022:15:51:15 +0100] "GET /core/img/logo/logo.svg?v=1 HTTP/1.1" 200 907 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive***- - [24/Jan/2022:15:51:14 +0100] "GET /index.php/apps/theming/image/logo?useSvg=1&v=21 HTTP/1.1" 500 18465 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive*** - - [24/Jan/2022:15:51:14 +0100] "GET /index.php/js/core/merged-template-prepend.js?v=7df8c54e-21 HTTP/1.1" 200 12055 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive*** - - [24/Jan/2022:15:51:14 +0100] "GET /core/js/dist/main.js?v=7df8c54e-21 HTTP/1.1" 200 490430 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive*** - - [24/Jan/2022:15:51:16 +0100] "GET /status.php HTTP/1.1" 200 1141 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"
***sensitive*** - - [24/Jan/2022:15:51:37 +0100] "GET /status.php HTTP/1.1" 200 9034 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Safari/537.36"