Nextcloud 11.0.3 uploaded file size 150g

ℹ️ Support
1

Hello!
I’m having problem when i try to upload а file size 150 Gigabyte by Windows sync client.
I have nextcloud 11.0.3, php5, Debian 8. After uploading the file to the server, begins synchronization. During sync I have error: connection timeout exceeded. So… in file php.ini (/php5/apache2/php.ini and /php5/cli/php.ini) I introducec corrections:
upload_max_filesize = 160G
max_input_time = -1
max_execution_time = 36000
default_socket_timeout = 36000.
I start nextcloud sync client with logging and that i saw:
After reboot in nextcloud sync clinet log I saw (when i try to sync file):
12-04 12:42:11:929 3452 OCC::SocketListener::sendMessage: SocketApi: Sending message: "STATUS:SYNC:D:\Backup"
12-04 12:42:11:929 3452 OCC::OwncloudPropagator::start: Using QNAM/HTTP parallel code path
12-04 12:42:11:930 3452 OCC::SyncEngine::slotDiscoveryJobFinished: <<#### Post-Reconcile end #################################################### 200
12-04 12:42:11:930 3452 OCC::Folder::slotSyncStarted: #### Propagation start #################################################### >>
12-04 12:42:11:931 3452 OCC::SocketApi::slotUpdateFolderView: Not sending UPDATE_VIEW for “1” because status() is 3
12-04 12:42:11:932 3452 OCC::ownCloudGui::slotSyncStateChange: Sync state changed for folder “xxx.xx.xx/nextcloud/remote.php/dav/files/user/Backup” : "Sync Running"
12-04 12:42:24:452 3452 OCC::AbstractNetworkJob::start: !!! OCC::PropfindJob created for “xxx.xx.xx/nextcloud” + “/” "OCC::QuotaInfo"
12-04 12:42:43:800 3452 OCC::ConnectionValidator::checkAuthentication: # Check whether authenticated propfind works.
12-04 12:42:43:801 3452 OCC::AbstractNetworkJob::start: !!! OCC::PropfindJob created for “xxx.xx.xx/nextcloud” + “/” "OCC::ConnectionValidator"
12-04 12:42:54:576 3452 OCC::AbstractNetworkJob::start: !!! OCC::PropfindJob created for “xxx.xx.xx/nextcloud” + “/” "OCC::QuotaInfo"
12-04 12:43:15:808 3452 OCC::ConnectionValidator::checkAuthentication: # Check whether authenticated propfind works.
12-04 12:43:15:809 3452 OCC::AbstractNetworkJob::start: !!! OCC::PropfindJob created for “xxx.xx.xx/nextcloud” + “/” "OCC::ConnectionValidator"
12-04 12:43:24:700 3452 OCC::AbstractNetworkJob::start: !!! OCC::PropfindJob created for “xxx.xx.xx/nextcloud” + “/” "OCC::QuotaInfo"
12-04 12:43:47:820 3452 OCC::ConnectionValidator::checkAuthentication: # Check whether authenticated propfind works.

So… I cant upload large file to nextcloud. What i do wrong?

2

First off… make sure, that you do have enough space in /tmp, since php places the upload temporarily in /tmp. You can also configure php to use another folder for that.

3

I have another folder for upload at another HDD. In config.php changed the line: ‘datadirectory’ => ‘/mnt/nextcloud/data’, so i can upload file for 4gb, 1gb and other. On another HDD I have about 500Gb free space. After upload big file free space on HDD become smaller.

4

Yeah, but that’s only where the file gets copied to, after it has been uploaded to a temporary location. Check your /etc/php.ini for this value and see where it points to:

; sys_temp_dir = "/tmp"

Then make sure, that there is enough space at the destination or point sys_temp_dir somewhere, where the is. Just remember to mind the permissions of the location, where you point it to.

5

Thnx, changed the line to sys_temp_dir = “mnt/nextcloud/tmp” and change the ownership. So try to download a 60GB file and waiting ))

6

Probably withg the leading / in front of mnt, no?

7

Yes, of course )

8

So… uploading a large file (60gb) is not successful. Nextcloud sync client error: server timeout exceeded.

9

So increase the Server Timeout :wink:

I don´t know the exact parameter, but you´ll find it in php.ini somewhere.

How long do you wait until you see the timeout message? Does it start sending the files but then brings the error after some time? My suggestion only applies if the latter is true.

10

In php.ini I found:
default_socket_timeout = 35000 (increase for 35000)
mysql.connect_timeout = -1 (change from 60)
oci8.persistent_timeout = -1
bliat
;sybct.login_timeout= (do not touch)
;mssql.connect_timeout = 5 (do not touch)
;opcache.force_restart_timeout=180 (do not touch)
;mysqlnd.net_read_timeout = 31536000 (do not touch)
I waiting about 6 hour to see the timeout message. It start uploading file to server and after 6 hour i saw error. And after uploading i can see uploaded file in debian’s dirrectory (/mnt/shared_disk/nextcloud/user/uploads) but I don’t saw him in nextcloud (browser or sync client).

11

Do you use a 64-bit version of PHP?

12

Debian 3.16.39-1+deb8u2 (2017-03-07) x86_64 GNU/Linux
PHP 5.6.30-0+deb8u1
Think, that I use 64-bit version of PHP. Am i right?

13

Sorry for my late answer.

I think you cannot determine the 64bit/32bit-version from this information.
I determined the version by following this advice on SO https://stackoverflow.com/a/5424121/5418064

However, there is only a slight chance that this is your problem. But, if you have a 32-bit PHP version you will certainly not be able to have files > 4 GB in your Nextcloud.

14

In case you missed it, there’s a bunch of good info about doing this in the Nextcloud manual
https://docs.nextcloud.com/server/12/admin_manual/configuration_files/big_file_upload_configuration.html