Nextcloud version 30 uploading_big_file

ℹ️ Support
, ,
1

Hello!

• Nextcloud Server version: 30.0.5-fpm

• Operating system and version: Docker image (service deployed in Kubernetes using Helm chart)

• Web server and version: Nginx Alpine

• Reverse proxy and version: No

• PHP version: 8.2.27

• Is this the first time you’ve seen this error?: Yes

• When did this problem seem to first start?: Today, 21.01.2025, after updating from version 30.0.2-fpm to 30.0.5-fpm.

• Installation method: Helm upgrade

• Are you using Cloudflare, mod_security, or similar?: No, but using S3 for file storage.

Summary of the issue you are facing

After updating from version 30.0.2-fpm to 30.0.5-fpm, files larger than 8 GB fail to upload via the UI. The upload process is interrupted, and errors are logged related to S3 storage and missing keys. These issues were not present in version 30.0.2-fpm.

Steps to replicate it (hint: details matter!)

  1. Attempt to upload a file of 8 GB via the Nextcloud UI.

  2. Observe the failure and the logged errors related to S3 storage.

Log entries

Nextcloud

open(https://s3-basket-/disk/urn%3Aoid741): Failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found

at /var/www/html/lib/private/Files/ObjectStore/S3ObjectTrait.php#72

Exception

Failed to read object urn:oid:7741

Could not get object urn:oid:7741 for file uploads/web-file-upload-c2caceb/256

RuntimeException

Unable to read from stream

Could not create object urn:oid:7929 for files/RET_A64FRE_ru-ru.iso

RuntimeException

Unable to read from stream

S3Exception

Error executing “CopyObject” on “https://s3-basket/disk/urn%3Aoid1”; AWS HTTP error: Client error: PUT https:*//s3-basket/disk/urn%3Aoid%31 resulted in a 404 Not Found response: <?xml version="1.0" encoding="UTF-8"?> NoSuchKey The specified key does not exist.</Me (truncated…) NoSuchKey (client): The specified key does not exist. - <?xml version="1.0" encoding="UTF-8"?> NoSuchKey The specified key does not exist. *

Exception thrown: Aws\S3\Exception\S3Exception

DoesNotExistException

Did expect one result but found none when executing: query “SELECT * FROM *PREFIX*files_versions WHERE (file_id = :dcValue1) AND (timestamp = :dcValue2)”;

Exception thrown: OCP\AppFramework\Db\DoesNotExistException

Web server / Reverse Proxy

Nginx Configuration

client_max_body_size 20G;

fastcgi_buffers 64 4K;

proxy_buffering off;

proxy_request_buffering off;

image
image896×96 13.2 KB

2

None specifically. But there are also many different types of timeouts – at various points of the end-to-end path – that can impact uploads. So:

  • what is the error specifically you’re seeing?
  • what type of upload? (i.e. chunked from an official client including web UI or other?)
  • which HTTP transaction specifically is timing out?
  • what’s the specific error in your reverse proxy and web server error log?
3

I am attempting to upload an 8 GB file through the UI and encountering the following error:

fopen(https://s3-basket/disk%3A7741): Failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found

at /var/www/html/lib/private/Files/ObjectStore/S3ObjectTrait.php#72

fopen(httpseek://): Failed to open stream: "OC\Files\Stream\SeekableHttpStream::stream_open" call failed at /var/www/html/lib/private/Files/Stream/SeekableHttpStream.php#49

RuntimeException

Unable to read from stream

Could not create object urn:oid:7929 for files/RET_A64FRE_ru-ru.iso

Here are the current Nginx settings in use:

fastcgi_buffers 64 4K;

client_max_body_size 50G;

client_body_timeout 1200s;

fastcgi_read_timeout 1200s;

Could you please advise on what might be causing this issue and provide recommendations to resolve it? Thank you!

4

That does not look like a timeout related to uploads, but something with your S3 Primary Storage configuration.

I suggested editing your post with the contents of the support template filled out.

5

I have edited.