Files not listed in Nextcloud client and Web UI, although they exist

The Basics

  • Nextcloud Server version (e.g., 29.x.x):
    • 30.0.4
  • Operating system and version (e.g., Ubuntu 24.04):
    • Ubuntu 24.04
  • Web server and version (e.g, Apache 2.4.25):
    • Apache 2.4.62
  • Reverse proxy and version _(e.g. nginx 1.27.2)
    • n/a
  • PHP version (e.g, 8.3):
    • 8.3.12
  • Is this the first time you’ve seen this error? (Yes / No):
    • yes
  • When did this problem seem to first start?
    • it might be, that this issue started when syncing a lot of files via the Nextcloud client 3.15.2
  • Installation method (e.g. AlO, NCP, Bare Metal/Archive, etc.)
    • VM on Proxmox
  • Are you using CloudfIare, mod_security, or similar? (Yes / No)
    • mod_security

Summary of the issue you are facing:

We store all our data on our NAS. Nextcloud is running on a VM on a Proxmox cluster (not on NAS) and the files are access in Nextcloud via the app External Storage Support (Configuring External Storage (GUI) — Nextcloud latest Administration Manual latest documentation). This has been running for years.

User A put a lot of pictures in it’s Nextcloud folder on it’s laptop which started uploading. Unclear if related (could very well be), but a couple of hours later it was noticed, that files in another folder were not visible anymore (not in the Nextcloud folder of the client and not via the web UI). Complete folders were empty. Others did still have all or parts of their content. When checking on the NAS all files were still there, so it seems to be a Nextcloud issue.

I ran a " sudo -u www-data php occ files:scan userA -v" but the files did not re-appear. The output was something like this (I have anonymized the output as I do not want to disclose the real filenames.

	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/A.pdf
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/B.txt
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/C.pdf
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/D.docx
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/E.txt
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/F.txt
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/G.pdf
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/H.pdf
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/I.docx
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/J.pdf
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/K.pdf
	File	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/L.pdf
	Folder	/usera/files/NAS-home/FolderA/FolderB/FolderC/FolderD/FolderE/Other
	Folder	/usera/files/NAS-home/FolderA/FolderB/FolderC/A
	Folder	/usera/files/NAS-home/FolderA/FolderB/FolderC/B
	Folder	/usera/files/NAS-home/FolderA/FolderB/FolderC/C
	Folder	/usera/files/NAS-home/FolderA/FolderB/FolderC/D
	Folder	/usera/files/NAS-home/FolderA/FolderB/E
	Folder	/usera/files/NAS-home/FolderA/FolderB/F
	Folder	/usera/files/NAS-home/FolderA/FolderB/G
	Folder	/usera/files/NAS-home/FolderA/H
	Folder	/usera/files/NAS-home/FolderA/I
	Folder	/usera/files/NAS-home/FolderA/J

All directories that only show a “folder” entry are empty. When I run a file:scan on that sub-directory separately however, files are found. When I repeat the scan for all files, those newly found files disappear again.

When I logon with my own user, I do see some of the files that userA does not see.

It is sort of driving me crazy.

As a full file:scan did not solve the issue, what further options do I have to analyze or (ideally) solve the issue? Very happy to attempt to answer questions you might have.

Thanks a lot!!

Log entries

Nextcloud

During the file:scan no entries are written in nextcloud.log

Configuration

Nextcloud

The output of occ config:list system or similar is best, but, if not possible, the contents of your config.php file from /path/to/nextcloud is fine (make sure to remove any identifiable information!):

{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": [
            "localhost",
            "192.168.3.85",
            "lin-nextcloud",
            "www.spiezmaestro.ch"
        ],
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "pgsql",
        "version": "30.0.4.1",
        "overwrite.cli.url": "https:\/\/lin-nextcloud\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "default_phone_region": "CH",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "log_type": "file",
        "logfile": "\/var\/log\/nextcloud\/nextcloud.log",
        "loglevel": 1,
        "mail_smtpmode": "smtp",
        "maintenance_window_start": 1,
        "log_rotate_size": "10485760",
        "trashbin_retention_obligation": "auto, 180",
        "versions_retention_obligation": "auto, 365",
        "simpleSignUpLink.shown": false,
        "memcache.local": "\\OC\\Memcache\\APCu",
        "filelocking.enabled": true,
        "skeletondirectory": "",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "memcache.distributed": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0.5,
            "dbindex": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "logtimezone": "Europe\/Zurich",
        "htaccess.RewriteBase": "\/",
        "maintenance": false,
        "twofactor_enforced": "true",
        "twofactor_enforced_groups": [],
        "twofactor_enforced_excluded_groups": [
            "Gasten",
            "No2FA"
        ],
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_sendmailmode": "smtp",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpauthtype": "LOGIN",
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpport": "587",
        "mail_smtpstreamoptions": {
            "ssl": {
                "allow_self_signed": true,
                "verify_peer": false,
                "verify_peer_name": false
            }
        },
        "app_install_overwrite": [
            "cms_pico",
            "occweb",
            "unsplash",
            "radio",
            "uploaddetails",
            "weather",
            "joplin",
            "twofactor_webauthn",
            "sharerenamer",
            "breezedark",
            "files_downloadactivity",
            "flowupload",
            "health",
            "ransomware_detection",
            "terms_of_service",
            "bruteforcesettings",
            "ocsms",
            "epubreader",
            "dicomviewer",
            "files_readmemd",
            "apporder",
            "rainloop",
            "richdocuments",
            "impersonate",
            "news",
            "gpoddersync",
            "bookmarks",
            "tasks",
            "side_menu",
            "maps"
        ],
        "enable_previews": false,
        "onlyoffice": {
            "verify_peer_off": true
        },
        "has_rebuilt_cache": true,
        "theme": "",
        "updater.release.channel": "stable",
        "mail_smtpauth": 1,
        "mail_smtpname": "***REMOVED SENSITIVE VALUE***",
        "mail_smtppassword": "***REMOVED SENSITIVE VALUE***"
    }
}

Apps

The output of occ app:list (if possible).

Enabled:
  - activity: 3.0.0
  - admin_audit: 1.20.0
  - app_api: 4.0.3
  - bookmarks: 15.0.4
  - bruteforcesettings: 3.0.0
  - calendar: 5.0.8
  - cloud_federation_api: 1.13.0
  - contacts: 6.1.2
  - cookbook: 0.11.2
  - cospend: 3.0.8
  - dashboard: 7.10.0
  - dav: 1.31.1
  - event_update_notification: 2.5.0
  - federatedfilesharing: 1.20.0
  - federation: 1.20.0
  - files: 2.2.0
  - files_downloadlimit: 3.0.0
  - files_external: 1.22.0
  - files_pdfviewer: 3.0.0
  - files_reminders: 1.3.0
  - files_sharing: 1.22.0
  - files_trashbin: 1.20.1
  - files_versions: 1.23.0
  - forms: 4.3.4
  - gpoddersync: 3.11.0
  - gpxpod: 7.0.4
  - impersonate: 1.17.0
  - logreader: 3.0.0
  - lookup_server_connector: 1.18.0
  - maps: 1.5.0
  - news: 25.1.2
  - notes: 4.11.0
  - notifications: 3.0.0
  - oauth2: 1.18.1
  - password_policy: 2.0.0
  - phonetrack: 0.8.2
  - polls: 8.0.0-alpha4
  - privacy: 2.0.0
  - provisioning_api: 1.20.0
  - repod: 3.5.4
  - serverinfo: 2.0.0
  - settings: 1.13.0
  - sharebymail: 1.20.0
  - suspicious_login: 8.0.0
  - tasks: 0.16.1
  - text: 4.1.0
  - theming: 2.5.0
  - twofactor_backupcodes: 1.19.0
  - twofactor_nextcloud_notification: 4.0.0
  - twofactor_totp: 12.0.0-dev
  - twofactor_webauthn: 2.0.0
  - unsplash: 3.0.3
  - updatenotification: 1.20.0
  - viewer: 3.0.0
  - weather_status: 1.10.0
  - webhook_listeners: 1.1.0-dev
  - workflowengine: 2.12.0
Disabled:
  - announcementcenter: 7.0.1 (installed 7.0.1)
  - appointments: 2.3.5 (installed 2.3.5)
  - apporder: 0.15.0 (installed 0.15.0)
  - breezedark: 29.0.0 (installed 29.0.0)
  - circles: 30.0.0 (installed 27.0.1)
  - collectives: 2.15.2 (installed 2.15.2)
  - comments: 1.20.1 (installed 1.14.0)
  - contactsinteraction: 1.11.0 (installed 1.5.0)
  - dicomviewer: 2.3.0 (installed 2.3.0)
  - encryption: 2.18.0
  - epubreader: 1.4.7 (installed 1.4.7)
  - extract: 1.3.6 (installed 1.3.6)
  - files_antivirus: 5.6.1 (installed 5.6.1)
  - files_downloadactivity: 1.17.0 (installed 1.17.0)
  - files_markdown: 2.4.1 (installed 2.4.1)
  - files_readmemd: 3.0.2 (installed 3.0.2)
  - files_rightclick: 0.15.1 (installed 1.6.0)
  - files_texteditor: 2.15.1 (installed 2.15.1)
  - files_trackdownloads: 1.11.0 (installed 1.11.0)
  - firstrunwizard: 3.0.0 (installed 2.13.0)
  - flowupload: 1.1.3 (installed 1.1.3)
  - gpxedit: 0.0.14 (installed 0.0.14)
  - gpxmotion: 0.1.0 (installed 0.1.0)
  - groupfolders: 18.0.8 (installed 18.0.8)
  - guests: 4.0.1 (installed 4.0.1)
  - health: 2.2.2 (installed 2.2.2)
  - integration_deepl: 1.3.0 (installed 1.3.0)
  - integration_discourse: 2.2.0 (installed 2.2.0)
  - integration_github: 3.1.1 (installed 3.1.1)
  - integration_gitlab: 3.1.2 (installed 3.1.2)
  - integration_mastodon: 3.0.1 (installed 3.0.1)
  - joplin: 0.0.25 (installed 0.0.25)
  - mail: 4.1.1 (installed 4.1.1)
  - metadata: 0.21.0 (installed 0.21.0)
  - music: 2.1.1 (installed 2.1.1)
  - ncdownloader: 1.0.21 (installed 1.0.21)
  - nextcloud_announcements: 2.0.0 (installed 1.13.0)
  - occweb: 0.2.0 (installed 0.2.0)
  - onlyoffice: 9.5.0 (installed 9.5.0)
  - photos: 3.0.2 (installed 1.6.0)
  - polls.532: 5.3.2
  - previewgenerator: 5.7.0 (installed 5.7.0)
  - quota_warning: 1.20.0 (installed 1.20.0)
  - radio: 1.0.3 (installed 1.0.3)
  - ransomware_protection: 1.14.0 (installed 1.14.0)
  - recommendations: 3.0.0 (installed 0.8.0)
  - related_resources: 1.5.0 (installed 1.3.0)
  - richdocuments: 8.5.3 (installed 8.5.3)
  - richdocumentscode: 24.4.1002 (installed 24.4.1002)
  - side_menu: 4.0.1 (installed 4.0.1)
  - smb_test: 0.3.10 (installed 0.3.10)
  - snappymail: 2.38.2 (installed 2.38.2)
  - support: 2.0.0 (installed 1.3.0)
  - survey_client: 2.0.0 (installed 1.5.0)
  - systemtags: 1.20.0 (installed 1.14.0)
  - terms_of_service: 4.1.0 (installed 4.1.0)
  - twofactor_u2f: 6.3.0 (installed 6.3.0)
  - user_ldap: 1.21.0
  - user_status: 1.10.0 (installed 1.4.0)
  - welcome: 1.2.0 (installed 1.2.0)

Nextcloud shows “no files” if there are too many in a folder and nextcloud cannot read it in time or due to php memory limits. But since you say it happens to all folders that cannot be it.

There are folders that only have a few files, even just some subdirs are not shown.

After trying a lot (hurray for backups!), I think I have solved the issue. Apparently after the last PHP upgrade, I missed to install php-smbclient :upside_down_face:. The native smbclient package was installed, so that is why I could access external storage (be it flawed).

After installing php-smbclient the occ files:scan did found all files (at least as far I can identify).

This topic was automatically closed 8 days after the last reply. New replies are no longer allowed.