Failing uploads at 100%

I’ve noticed with large video files that regularly autoupload, many fail after hanging at 100%.

I can replicate this behaviour consistently.

Am I the only one seeing this? 9.0.52 on Ubuntu.

I appreciate this is light on information, I’m posting from mobile so I don’t forget - will add more later and feel free to request specifics in the meantime.

So I’m guessing it’s likely related to this:

Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929.mp4-chunking-2680-139.6omEQ5bGWdAMtvQc.part at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:48:18+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929 (2).mp4-chunking-4805-257 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:36+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929 (2).mp4-chunking-4805-257 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:36+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929 (2).mp4- chunking-4805-220 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:36+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929 (2).mp4-chunking-4805-220 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:36+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929.mp4-chunking-4426-26 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:36+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929.mp4-chunking-4426-51 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:36+00:00	jason
Error	PHP	unlink(/media/Storage/lxd-data/data/jason/cache/20160820_102929.mp4-chunking-4426-26): No such file or directory at /var/www/html/lib/private/files/storage/local.php#204	2016-08-21T18:41:36+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929.mp4-chunking-4426-51 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:36+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929 (2).mp4-chunking-4805-48 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:36+00:00	jason
Error	PHP	unlink(/media/Storage/lxd-data/data/jason/cache/20160820_102929 (2).mp4-chunking-4805-48): No such file or directory at /var/www/html/lib/private/files/storage/local.php#204	2016-08-21T18:41:35+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929 (2).mp4-chunking-3649-28 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:35+00:00	jason
Error	PHP	filemtime(): stat failed for /media/Storage/lxd-data/data/jason/cache/20160820_102929.mp4-chunking-4426-124 at /var/www/html/lib/private/files/storage/local.php#159	2016-08-21T18:41:35+00:00	jason

This is basically the entirety of errors in my logfile. There’s a large amount.

On the bugtracker there were some reports in the past. In some cases, it was not possible to reproduce this error: e.g.

In this case your detailed configuration might be interesting (external storage, encryption app, shared folder, …).

Sure,

  • no external storage
  • no share on the DIR it uploads to
  • no encryption (yet)

It’s simply an instantupload_video directory situated under a root “multimedia” directory.

I would first update to the latest version 9.0.53, just in case something was already fixed.

I’m not using Android myself, I would perhaps check, if larger upload via oc-client (desktop) show similar issues. Make sure that you have all required (and recommended) modules installed. Is your hard-drive large enough (also for the /tmp-folder)?

In terms of server, it’s a Ubuntu 16.04 LXD container running atop a Ubuntu 16.04 host with both the container and the data directory on a 16TB ZFS array; it has more space than it could ever need :slight_smile:

I’m holding off on upgrading until 10 - I don’t fancy manually upgrading to 9.0.53, then 10.0.0 before automated updates become available, so I’d be happy to postpone this issue until 10 drops.

Let’s ask the Android developers, if they are doing file chunking differently and if you need to open a bug report in their bugtracker or the core:
@Andy @tobiasKaminsky

We will have to look into it. Right now the Android client doesn’t do chucking but this is something we starters working on for up and downloads in general.
Would have to check if the chucking solves this issue. Due to Tobias and me being both on vacation at the moment it might still be some days / weeks until this feature appears in the beta version.

So the chunks can’t be from the android clinet?

@JasonBayton: Can you check your cache folder

when these files were created? You should only find new files, everything older than a day indicates that the clean-up is not running properly. Have you set up cronjobs?
https://docs.nextcloud.com/server/9/admin_manual/configuration_server/background_jobs_configuration.html?highlight=cron#cron

Caching is taken care of with cron; at the moment it’s empty.

I manually upped to 10.0.0 and haven’t seen this since, so I’ll do more testing.

Hmm, well I’m still seeing random disconnects, connection errors and general instability through the Android app on 10, but can’t replicate it through the web interface.

The Android app seems to thoroughly dislike uploading hundreds of megabytes of video file, as photos and other files which are typically only a few meg are always fine.

I am having the same problem. did you ever figure out a fix?

@Carlos_Roque I didn’t need to, various updates to the Android client have resolved it for me since September; these days I have other upload issues :slight_smile:. Join the Android beta on Google Play or grab the official Nextcloud Beta app from github and see if you can replicate it there.

This is an old thread, so you’d do well to start a new one with your server version, Android version, Android NC App version, a snapshot of logs showing the errors you’re getting and any other information you feel may be pertinent.

Thanks, I will do that.