Desktop app client not able to upload any file bigger than 9.5mb

[naz]

Support intro

Sorry to hear you’re facing problems

help.nextcloud.com is for home/non-enterprise users. If you’re running a business, paid support can be accessed via portal.nextcloud.com where we can ensure your business keeps running smoothly.

In order to help you as quickly as possible, before clicking Create Topic please provide as much of the below as you can. Feel free to use a pastebin service for logs, otherwise either indent short log examples with four spaces:

example

Or for longer, use three backticks above and below the code snippet:

longer
example
here

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can

Nextcloud version (eg, 29.0.5): 29.0.7-30.0.0
Operating system and version (eg, Ubuntu 24.04): 22.0.4
Apache or nginx version (eg, Apache 2.4.25): 2.4.52
PHP version (eg, 8.3): 8.1.29

The issue you are facing:

• Desktop app client not able to upload any file bigger than 9.5mb
• Web interface work fine
• Been tried to digging up anything on the internet but not thing seem to match and solve the issue
• The set up is 1 Main account share 1 folder to 10 different sub account, The data here are around TB
• The issue are occur happen on the 10 sub account, The main account are not affect
• Create a new Account with a new folder not solve the issue but if connected direct with IP without URL (Cloudflare) solve the issue
• Share the folder above to any other account will result in false upload anyways so it work around but not fix the issue
• Upload any type of file less than 9.5mb are working fine anything above that size will fail

We have beeen using Nextcloud since the project start and even before with Owncloud
We’ve complete refresh the system around 4 years ago and running it until today

Is this the first time you’ve seen this error? (Y/N): Y

Steps to replicate it:

1. Upgrade form 29.0.5 to 29.0.7

The output of your Nextcloud log in Admin > Logging:

none

The output of your config.php file in /path/to/nextcloud (make sure you remove any identifiable information!):

<?php
$CONFIG = array (
  'instanceid' => '',
  'passwordsalt' => 'sensitive',
  'secret' => 'sensitive',
  'trusted_domains' => 
  array (
    0 => 'sensitive',
	1 => 'sensitive',
  ),
  'datadirectory' => '/var/www/nextcloud/data',
  'tempdirectory' => '/mnt/nctemp', # newly added here
  'trashbin_retention_obligation' => 'auto, 90',
  'filelocking.enabled' => false,
  'dbtype' => 'mysql',
  'version' => '29.0.7.1',
  'overwrite.cli.url' => 'sensitive',
  'dbname' => 'nextcloud',
  'dbhost' => 'localhost',
  'dbport' => '',
  'dbtableprefix' => 'oc_',
  'dbuser' => 'sensitive',
  'dbpassword' => 'sensitive',
  'skeletondirectory' => '',
  'installed' => true,
  'memcache.local' => '\\OC\\Memcache\\APCu',
  'memcache.distributed' => '\\OC\\Memcache\\Redis',
  'redis' => 
  array (
    'host' => '/run/redis/redis-server.sock',
    'port' => 0,
    'dbindex' => 0,
    'password' => '',
    'timeout' => 1.5,
  ),
  'objectstore' => 
  array (
    'class' => '\\OC\\Files\\ObjectStore\\S3',
    'arguments' => 
    array (
      'bucket' => 'sensitive',
      'autocreate' => true,
      'key' => 'sensitive',
      'secret' => 'sensitive',
      'hostname' => 'ams3.digitaloceanspaces.com',
      'use_ssl' => true,
      'region' => 'ams3',
      'use_path_style' => true,
    ),
  ),
  'theme' => '',
  'loglevel' => 2,
  'log_type' => 'errorlog',
  'logfile' => '/var/www/nextcloud/data/nextcloud.log',
  'logdateformat' => 'F d, Y H:i:s',
  'log_rotate_size' => 104857600,
  'logtimezone' => 'sensitive',
  'maintenance' => false,
  'maintenance_window_start' => 1,
  'mysql.utf8mb4' => true,
  'updater.release.channel' => 'stable',
  'mail_smtpmode' => 'smtp',
  'mail_sendmailmode' => 'smtp',
  'mail_from_address' => 'support',
  'mail_domain' => 'sensitive',
  'mail_smtpauthtype' => 'LOGIN',
  'mail_smtpauth' => 1,
  'mail_smtphost' => 'sensitive',
  'mail_smtpport' => '465',
  'mail_smtpname' => 'sensitive',
  'mail_smtppassword' => 'sensitive',
  'encryption.legacy_format_support' => false,
  'encryption.key_storage_migrated' => false,
  'default_phone_region' => 'sensitive',
  'twofactor_enforced' => 'true',
  'twofactor_enforced_groups' => 
  array (
  ),
  'twofactor_enforced_excluded_groups' => 
  array (
    0 => 'sensitive',
    1 => 'sensitive',
    2 => 'sensitive',
    3 => 'sensitive',
  ),
  'data-fingerprint' => 'sensitive',
  'enable_previews' => true,
  'enabledPreviewProviders' => 
  array (
    0 => 'OC\\Preview\\Imaginary',
  ),
  'preview_imaginary_url' => 'sensitive',
  'mail_smtpsecure' => 'ssl',
  'tempdirectory' => '/tmp/nextcloudtemp',
);

The output of your Apache/nginx/system log in /var/log/____:

None

Output errors in nextcloud.log in /var/www/ or as admin user in top right menu, filtering for errors. Use a pastebin service if necessary.

[nextcloud][PHP][3] {"reqId":"3mF86sqe3oVkxRP4JCaJ","level":3,"time":"September 26, 2024 16:42:10","remoteAddr":"sensitive","user":"sensitive","app":"PHP","method":"GET","url":"/remote.php/dav/avatars/sensitive/128.png","message":"fopen(https://ams3.digitaloceanspaces.com/sensitive/urn%3Aoid%3A11640837): Failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found\\r\\n at /var/www/nextcloud/lib/private/Files/ObjectStore/S3ObjectTrait.php#72","userAgent":"Mozilla/5.0 (Windows) mirall/3.13.4stable-Win64 (build 20240912) (Nextcloud, windows-10.0.19045 ClientArchitecture: x86_64 OsArchitecture: x86_64)","version":"30.0.0.14","data":{"app":"PHP"}}
[nextcloud][PHP][3] {"reqId":"3mF86sqe3oVkxRP4JCaJ","level":3,"time":"September 26, 2024 16:42:10","remoteAddr":"sensitive","user":"sensitive","app":"PHP","method":"GET","url":"/remote.php/dav/avatars/sensitive/128.png","message":"fopen(httpseek://): Failed to open stream: "OC\\\\Files\\\\Stream\\\\SeekableHttpStream::stream_open" call failed at /var/www/nextcloud/lib/private/Files/Stream/SeekableHttpStream.php#49","userAgent":"Mozilla/5.0 (Windows) mirall/3.13.4stable-Win64 (build 20240912) (Nextcloud, windows-10.0.19045 ClientArchitecture: x86_64 OsArchitecture: x86_64)","version":"30.0.0.14","data":{"app":"PHP"}}
[nextcloud][objectstore][3] {"reqId":"3mF86sqe3oVkxRP4JCaJ","level":3,"time":"September 26, 2024 16:42:10","remoteAddr":"sensitive","user":"sensitive","app":"objectstore","method":"GET","url":"/remote.php/dav/avatars/sensitive/128.png","message":"{\\"Exception\\":\\"Exception\\",\\"Message\\":\\"Failed to read object urn:oid:11640837\\",\\"Code\\":0,\\"Trace\\":[{\\"file\\":\\"/var/www/nextcloud/lib/private/Files/ObjectStore/ObjectStoreStorage.php\\",\\"line\\":308,\\"function\\":\\"readObject\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\ObjectStore\\\\\\\\S3\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/lib/private/Files/Storage/Common.php\\",\\"line\\":163,\\"function\\":\\"fopen\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\ObjectStore\\\\\\\\ObjectStoreStorage\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/lib/private/Files/View.php\\",\\"line\\":1136,\\"function\\":\\"file_get_contents\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\Storage\\\\\\\\Common\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/lib/private/Files/View.php\\",\\"line\\":545,\\"function\\":\\"basicOperation\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\View\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/lib/private/Files/Node/File.php\\",\\"line\\":33,\\"function\\":\\"file_get_contents\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\View\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/lib/private/Files/SimpleFS/SimpleFile.php\\",\\"line\\":55,\\"function\\":\\"getContent\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\Node\\\\\\\\File\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/lib/private/Avatar/Avatar.php\\",\\"line\\":72,\\"function\\":\\"getContent\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\SimpleFS\\\\\\\\SimpleFile\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/apps/dav/lib/Avatars/AvatarNode.php\\",\\"line\\":43,\\"function\\":\\"get\\",\\"class\\":\\"OC\\\\\\\\Avatar\\\\\\\\Avatar\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php\\",\\"line\\":85,\\"function\\":\\"get\\",\\"class\\":\\"OCA\\\\\\\\DAV\\\\\\\\Avatars\\\\\\\\AvatarNode\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php\\",\\"line\\":89,\\"function\\":\\"httpGet\\",\\"class\\":\\"Sabre\\\\\\\\DAV\\\\\\\\CorePlugin\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\\",\\"line\\":472,\\"function\\":\\"emit\\",\\"class\\":\\"Sabre\\\\\\\\DAV\\\\\\\\Server\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\\",\\"line\\":253,\\"function\\":\\"invokeMethod\\",\\"class\\":\\"Sabre\\\\\\\\DAV\\\\\\\\Server\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/apps/dav/lib/Server.php\\",\\"line\\":370,\\"function\\":\\"start\\",\\"class\\":\\"Sabre\\\\\\\\DAV\\\\\\\\Server\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/apps/dav/appinfo/v2/remote.php\\",\\"line\\":19,\\"function\\":\\"exec\\",\\"class\\":\\"OCA\\\\\\\\DAV\\\\\\\\Server\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/remote.php\\",\\"line\\":146,\\"args\\":[\\"/var/www/nextcloud/apps/dav/appinfo/v2/remote.php\\"],\\"function\\":\\"require_once\\"}],\\"File\\":\\"/var/www/nextcloud/lib/private/Files/ObjectStore/S3ObjectTrait.php\\",\\"Line\\":75,\\"message\\":\\"Could not get object urn:oid:11640837 for file appdata_oc4ux9048f90/avatar/sensitive/avatar.128.png\\",\\"exception\\":{},\\"CustomMessage\\":\\"Could not get object urn:oid:11640837 for file appdata_oc4ux9048f90/avatar/sensitive/avatar.128.png\\"}","userAgent":"Mozilla/5.0 (Windows) mirall/3.13.4stable-Win64 (build 20240912) (Nextcloud, windows-10.0.19045 ClientArchitecture: x86_64 OsArchitecture: x86_64)","version":"30.0.0.14"}
[nextcloud][webdav][3] {"reqId":"3mF86sqe3oVkxRP4JCaJ","level":3,"time":"September 26, 2024 16:42:10","remoteAddr":"sensitive","user":"sensitive","app":"webdav","method":"GET","url":"/remote.php/dav/avatars/sensitive/128.png","message":"{\\"Exception\\":\\"OCP\\\\\\\\Files\\\\\\\\GenericFileException\\",\\"Message\\":\\"\\",\\"Code\\":0,\\"Trace\\":[{\\"file\\":\\"/var/www/nextcloud/lib/private/Files/SimpleFS/SimpleFile.php\\",\\"line\\":55,\\"function\\":\\"getContent\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\Node\\\\\\\\File\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/lib/private/Avatar/Avatar.php\\",\\"line\\":72,\\"function\\":\\"getContent\\",\\"class\\":\\"OC\\\\\\\\Files\\\\\\\\SimpleFS\\\\\\\\SimpleFile\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/apps/dav/lib/Avatars/AvatarNode.php\\",\\"line\\":43,\\"function\\":\\"get\\",\\"class\\":\\"OC\\\\\\\\Avatar\\\\\\\\Avatar\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php\\",\\"line\\":85,\\"function\\":\\"get\\",\\"class\\":\\"OCA\\\\\\\\DAV\\\\\\\\Avatars\\\\\\\\AvatarNode\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php\\",\\"line\\":89,\\"function\\":\\"httpGet\\",\\"class\\":\\"Sabre\\\\\\\\DAV\\\\\\\\CorePlugin\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\\",\\"line\\":472,\\"function\\":\\"emit\\",\\"class\\":\\"Sabre\\\\\\\\DAV\\\\\\\\Server\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php\\",\\"line\\":253,\\"function\\":\\"invokeMethod\\",\\"class\\":\\"Sabre\\\\\\\\DAV\\\\\\\\Server\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/apps/dav/lib/Server.php\\",\\"line\\":370,\\"function\\":\\"start\\",\\"class\\":\\"Sabre\\\\\\\\DAV\\\\\\\\Server\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/apps/dav/appinfo/v2/remote.php\\",\\"line\\":19,\\"function\\":\\"exec\\",\\"class\\":\\"OCA\\\\\\\\DAV\\\\\\\\Server\\",\\"type\\":\\"->\\"},{\\"file\\":\\"/var/www/nextcloud/remote.php\\",\\"line\\":146,\\"args\\":[\\"/var/www/nextcloud/apps/dav/appinfo/v2/remote.php\\"],\\"function\\":\\"require_once\\"}],\\"File\\":\\"/var/www/nextcloud/lib/private/Files/Node/File.php\\",\\"Line\\":35,\\"message\\":\\"\\",\\"exception\\":{},\\"CustomMessage\\":\\"Exception thrown: OCP\\\\\\\\Files\\\\\\\\GenericFileException\\"}","userAgent":"Mozilla/5.0 (Windows) mirall/3.13.4stable-Win64 (build 20240912) (Nextcloud, windows-10.0.19045 ClientArchitecture: x86_64 OsArchitecture: x86_64)","version":"30.0.0.14"}

[naz]

Thing i’ve tried and still not solve

1. Chunk setting on both server and client
2. Nginx with those location thing from the internet
3. try different many Client apversion
4. We actually storage our data on Wasabi before, We had experience with them updating something and cause our Mattermost to break and able to upload anything, we are then migrate data to DigitalOcean and it solve the issue so we’ve try it with nextcloud but still out of luck

[vawaver]

There are some bugs in Nextcloud client version 3.14.
Try to downgrade to 3.13.

[naz]

Thank you Vawaver for suggestion,
As mention i’ve try multiple version of client. 3.12, 3.13 also tested
Track back from logs, the issue start to happen since upgrade the server from 29.0.5 to 29.0.7
While that time we using client 3.11 something i’m not sure.
As usual i like to wait 2-3 Minor version release before i upgrade or update anything here.

[wwe]

I don’t see this problem with NC29.0.7 and client 3.13.3 (win) - tested files sync with multiple files > 100MB .

[naz]

Thank you for reply wwe,
i’ve been looking around on the internet for 3 days and not found anything. as mention we using nextcloud for many years without any problems, we keep everything maintenance patch and update time to time.
it seem that the fresh install are the only option. At the moment only Main Account who’s share a main folder to other 10 sub account are able to upload with Client app. all other account need to upload from web interface.
If anyone willing to dig this up and would like me to provide any info i’m happy to do it for case study.

[vawaver]

Just a small thought for you to consider.

Recently, I reinstalled Nextcloud AIO and essentially skipped synchronization using the Nextcloud Client or uploading through the Web interface.

Here’s my process:

1. I backed up the data of individual accounts from the Nextcloud server to my local disk (direct copying on the server and then using rsync from the server to the local PC).
2. Reinstalled Nextcloud AIO and added the original user accounts.
3. Using rsync, I uploaded the data back to the server and moved it to the correct Nextcloud directories (I’m not connecting as root, so I had to do this additional moving step).
4. Set CHOWN and CHMOD for the directories and files of these data.
5. Ran the rescan command on the server – this ensures that the data is displayed to individual Nextcloud users in their accounts.
6. Finally, I just synchronized with users’ devices. This was just a short synchronization between the server data and local data.

I did this for around 1 TB of data, and this method saved me a lot of time.

[naz]

Thank again for reply vawaver,
Thank you for suggestion, i also consider those process option with fresh install along with duo server to create account and sync all the files to a new server seamlessly too then i can reduce a lots of down time with this.
But the thing is i did not thing Unusual to the setting and the server, just regular use i believe and if thing happen like this again in the future without manual fix or solution than to refresh the install then i believe it should be the last option.

[vawaver]

Of course, I understand that.
Reinstalling the server is the last thing we want to deal with.
I replaced the disk on the Nextcloud server (HDD → NVMe), which is why I went with a reinstallation. Otherwise, there was no reason to, as everything was working perfectly until then.

If you need help with any of the steps from my process, just let me know. I took notes on it.

[naz]

Glad you understand and thank you again for your time to read and reply for this i really appreciate.

Honestly i’ve done many hard test before we start to use thing since Owncloud >> Nextcloud LocalStorage >> Nextcloud S3Storage
I Did try many scenario, Play around, Did dirty thing try to restore thing and etc.

The issue i’m facing of course i got back up and can restore to 29.0.5 but if i going to use nextcloud and cannot update it then there is not point of it.

The issue i’m facing also difficult to explain, To me it just something not usual with the Share folder permission. All the other account are able to upload any thing with client to their storage but not on the folder that shared from other user.
Feel like it limit something here with the other account on share folder.
I’ve try to upgrade 29.0.5 from my backup to 29.0.7 again and it still occur too.

[wwe]

@naz

All the other account are able to upload any thing with client to their storage but not on the folder that shared from other user.

this sounds like a very interesting detail. I remember some issue shortly related to share uploads but don’t have any reference handy…

but at the end please create logs from client and server showing “normal” upload to users data and one uploading to shared folder - you likely will spot a difference and once you see where the problem is you can isolate and maybe fix or maybe this is a real regression and requires a bug report… but there is not better approach than systematically analyse the issue.

as you mention s3 maybe this is relevant for you https://github.com/nextcloud/server/issues/43642 I would also double check if the issue happens with local storage as well.

[naz]

Thank wwe,
Good suggestion, I was about to try to disable all the app and see if it solve the issue. will also put on debug log to check, i can’t do this on the live server then i’ll create from a backup and see.
I’ll be back.

[naz]

The logs seem to be way too big to post here,
Anyone passing by got suggestion how i can post the log please?
Just upload the .txt here? or make a URL direct link to it?

[wwe]

you can use pastebin service or ideally you can analyze them yourself

[caos30]

Hello, I understand that you have not yet resolved the issue?

I encountered the same problem in 2021, so I am surprised that it continues to persist. You can find the solution in this GitHub issue of mine:

Files greater than 9.6Mb (10Mb) not syncing, but uploading to user UPLOADS directory

In brief:

• Nextcloud splits large files into smaller chunks during the upload process, using temporary filenames that begin with a dot (.)
• This can be problematic depending on your NGINX configuration. Typically, files beginning with a dot are considered system hidden files in linux servers, and NGINX may limit access to them, causing the Nextcloud upload and sync system to fail.

The solution involves checking your NGINX configuration file and making a small adjustment. You can find more details in the GitHub issue linked above.

[naz]

Thank you caos30,
I’ve found that post at early date and try those and it not working Plus i don’t have any error reassembling the chunk file as mention in the topic as i said if i use the main account who’s share the folder its upload able
Or if i use Sub account and upload to their own storage not on the share folder from the main account then it upload able too

My Client just said error 502, cannot sync file and check more detail on server log.

I’m try to check from all the logs line by line at the moment and i cant seem to post my logs here since it too long.
wwe suggest pastbin but my log still way too long for it too.

if anyone have an idea of where specific to look from the logs then it will be helpful then i’ll be able to post it here.

[vawaver]

I think my problem is related to this one.

Nextcloud VM Crashes When Syncing Large Files

Issue: Nextcloud VM Crashes When Syncing Large Files Greetings, I am running Nextcloud AIO (9.6.0) with Nextcloud v29.0.7 on a Proxmox server 8.2.7. The VM dedicated to Nextcloud has the following specs: CPU: 12 cores RAM: 15 GB OS: Ubuntu Server 24.04 LTS Connection speeds: 990 Mbit / 500 Mbit This Nextcloud instance is used by only 4 users. Initially, my entire Proxmox setup was running on a traditional HDD, but I switched to an NVMe disk for reasons I will outline below. Problem Descript…

[naz]

Hi vawaver,
FYI i got sub user often upload zip file 1-3gb without problems for more than 90% of the time, it rarely fails but still did fails some time but still manage to re-upload and solve.
My Server is in DigitalOcean, 2 Core 8GB Nvme 10GB network
Server is in EU, its blazing fast.
But when it sync to client app in SEA it fails some time but automatic resume and finish as usual for years.
I’ve try to download manual from Interface and it never fail even 5GB zip

[naz]

Update info for anyone passing by,
Using Cyberduck to upload and it work success.

[naz]

Update

Setting “chunkSize” in client at nextcloud.cfg can by pass the issue
I was mess with “MaxChunkSize” before from this topic: Nextcloud Client not Chunking (uploads over 100 MB fail) · Issue #4271 · nextcloud/desktop · GitHub and it went to wrong point, size it already set to default at 5G from: https://github.com/nextcloud/desktop/blob/master/doc/conffile.rst

Variable	Default	Meaning
chunkSize	10000000 (10 MB)	Specifies the chunk size of uploaded files in bytes. The client will dynamically adjust this size within the maximum and minimum bounds (see below).

10MB was default size and somehow limit all the size upload BUT some how only limit to share folder sub account but not the main account
to upload 100mb file i will need to setup chunkSize to match size, anything over 100mb are not upload at all, Let summary thing after change chunkSize down below

Main acc
Can upload any size till php limit

Sub acc
Can upload size up to “chunkSize” setting in nextcloud.cfg only