Long-running request to MOVE .file after large file upload times out causing DEL to be called

Some or all of the below information will be requested if it isn’t supplied; for fastest response please provide as much as you can. :heart:

The Basics

  • Nextcloud Server version (e.g., 29.x.x):
    Nextcloud Hub 9 (30.0.3)
  • Operating system and version (e.g., Ubuntu 24.04):
    Fedora 41
  • Installation method (e.g. AIO, NCP, Bare Metal/Archive, etc.)
    Podman, LSIO image
  • Are you using Cloudflare, mod_security, or similar? (Yes / No)
    Cloudflare Argo Tunnel (cloudflared)

Summary of the issue you are facing:

I am testing uploading a very large file (10GB) and I noticed the upload never works through CloudFlare. I pinned down the reason being the time it takes for the response to the MOVE .file request to assembly chunked uploads takes too long.

Doing this on a direct connection to my NC although still takes long, it works, it takes up to 3 minutes to complete sometimes. Through CloudFlare, requests have a 1min30s timeout before the tunnel ends the connection and returns a timeout response. To exacerbate the problem, the web app reacts to that by calling DEL on the file mid-assembly, cancelling the operation and deleting everything.

The proper solution to this problem would be making the server respond immediately to that MOVE .file request with an identifier of some sort that would enable any client to start polling for status updates (or better yet - to subscribe to a Server-Sent Event stream and wait for that event).

That said, this is not the case. I would be happy to help but I don’t know PHP neither the NC codebase to propose a code solution.

I am asking if there is any known way to increase the speed of that assembly operation, or maybe a suggestion of an alternative trusted service to cloudflared that I can use - my use case is to overcome the fact that my ISP blocks all my ports to outside connections so I cannot host stuff like that.

Steps to replicate it (hint: details matter!):

Setup NC behind CF and upload a very large file.

Log entries

Apps

The output of occ app:list (if possible).

/# occ app:list
Enabled:
  - activity: 3.0.0
  - app_api: 4.0.3
  - bruteforcesettings: 3.0.0
  - calendar: 5.0.6
  - circles: 30.0.0
  - cloud_federation_api: 1.13.0
  - comments: 1.20.1
  - contacts: 6.1.1
  - contactsinteraction: 1.11.0
  - dashboard: 7.10.0
  - dav: 1.31.1
  - deck: 1.14.2
  - documentserver_community: 0.1.20
  - drawio: 3.0.3
  - federatedfilesharing: 1.20.0
  - federation: 1.20.0
  - files: 2.2.0
  - files_downloadlimit: 3.0.0
  - files_pdfviewer: 3.0.0
  - files_reminders: 1.3.0
  - files_sharing: 1.22.0
  - files_trashbin: 1.20.1
  - files_versions: 1.23.0
  - firstrunwizard: 3.0.0
  - forms: 4.3.4
  - logreader: 3.0.0
  - lookup_server_connector: 1.18.0
  - mail: 4.0.7
  - maps: 1.5.0
  - nextcloud_announcements: 2.0.0
  - notes: 4.11.0
  - notifications: 3.0.0
  - oauth2: 1.18.1
  - password_policy: 2.0.0
  - photos: 3.0.2
  - privacy: 2.0.0
  - provisioning_api: 1.20.0
  - recognize: 8.1.1
  - recommendations: 3.0.0
  - related_resources: 1.5.0
  - richdocuments: 8.5.2
  - serverinfo: 2.0.0
  - settings: 1.13.0
  - sharebymail: 1.20.0
  - socialsharing_email: 3.2.0
  - socialsharing_facebook: 3.2.0
  - spreed: 20.1.0
  - support: 2.0.0
  - survey_client: 2.0.0
  - systemtags: 1.20.0
  - tasks: 0.16.1
  - text: 4.1.0
  - theming: 2.5.0
  - twofactor_backupcodes: 1.19.0
  - updatenotification: 1.20.0
  - user_status: 1.10.0
  - viewer: 3.0.0
  - weather_status: 1.10.0
  - webhook_listeners: 1.1.0-dev
  - workflowengine: 2.12.0
Disabled:
  - admin_audit: 1.20.0
  - appointments: 2.3.4 (installed 2.3.4)
  - encryption: 2.18.0
  - files_external: 1.22.0
  - gestion: 2.6.2 (installed 2.6.2)
  - money: 0.28.0 (installed 0.28.0)
  - onlyoffice: 9.5.0 (installed 9.5.0)
  - suspicious_login: 8.0.0
  - twofactor_nextcloud_notification: 4.0.0
  - twofactor_totp: 12.0.0-dev
  - user_ldap: 1.21.0

Related: Chunked upload performance improvements · Issue #47682 · nextcloud/server · GitHub

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.