Uploading large files fails even with desktop sync client


#22

The only other part I can remove besides the BrowserMatch section would be the StdEnvVars section. And I am not sure whether either of those are causing this issue. The rest is either necessary for SSL or logging.

I can give it a go, but I am skeptical this is the issue.


#23

I’m having this exact same issue! I’ve tried all sorts of things to get it fixed. Increasing PHP upload settings. Changing the tmp directory. This is the first thread that seems to be exactly my issue.


#24

I thought about changing my tmp directory tonight. But I do remember that nextcloud 11 now just writes straight to the data directory anyways. So I don’t think that’s the issue.


#25

Never mind, it is definitely still writing into the temp directory, but I have more than enough space in there.


#26

I’m just now starting to use Nextcloud(moved from pydio) so testing I’ve installed Nextcloud multiple times using techandme install scripts and it’s happened every time.


#27

I found an owncloud article with a similar problem and the only solution that was brought up was switched to NGINX…
https://forum.owncloud.org/viewtopic.php?f=36&t=32709&start=10


#28

@goober2186 Are you using Fedora 25 as well? I wonder if its some weird issue with Fedora 25’s version of Apache.


#29

Just for your info, I am running Ubuntu 16.04 with Apache 2.4.18.


#30

I’m actually running Ubuntu 16.04 with Apache 2.4.18 as well


#31

Are you guys hosting these Nextcloud instances on a home connection?

@goober2186 Does the problem only appear when transferring files on the same network?


#32

@urbenlegend I’m hosting from my house on google fiber. I can successfully upload if I’m syncing externally(tested with VPN) and yes only occurs within the same network. It’s mind boggling for sure.


#33

I just used wireshark and here was the result

Transmission Control Protocol, Src Port: 49902, Dst Port: 443, Seq: 169916754, Ack: 15931, Len: 0
Source Port: 49902
Destination Port: 443
[Stream index: 7]
[TCP Segment Len: 0]
Sequence number: 169916754 (relative sequence number)
Acknowledgment number: 15931 (relative ack number)
Header Length: 20 bytes
Flags: 0x014 (RST, ACK)
000. … … = Reserved: Not set
…0 … … = Nonce: Not set
… 0… … = Congestion Window Reduced (CWR): Not set
… .0… … = ECN-Echo: Not set
… …0. … = Urgent: Not set
… …1 … = Acknowledgment: Set
… … 0… = Push: Not set
… … .1… = Reset: Set
[Expert Info (Warning/Sequence): Connection reset (RST)]
[Connection reset (RST)]
[Severity level: Warning]
[Group: Sequence]
… … …0. = Syn: Not set
… … …0 = Fin: Not set
[TCP Flags: ·······A·R··]
Window size value: 0
[Calculated window size: 0]
[Window size scaling factor: 256]
Checksum: 0x8014 [unverified]
[Checksum Status: Unverified]
Urgent pointer: 0
[SEQ/ACK analysis]


#34

Sync Client Log Files


04-22 00:45:13:361 0xe7610 OCC::AbstractNetworkJob::start: !!! OCC::PUTFileJob created for “https://www.domain.com” + “/test.zip-chunking-2129476149-104-19” ""
04-22 00:45:13:765 0x7c3f368 unknown: ERRORING CURRENT QHttpNetworkReply(0x7d71a88) QUrl( “https://www.domain.com/remote.php/webdav/test.zip-chunking-2129476149-104-17” )
04-22 00:45:13:765 0xe7610 OCC::AbstractNetworkJob::slotFinished: void OCC::AbstractNetworkJob::slotFinished() 99 “Error while reading: error:140943FC:SSL routines:ssl3_read_bytes:sslv3 alert bad record mac” QVariant(Invalid)
04-22 00:45:13:766 0xe7610 OCC::PropagateUploadFileQNAM::slotPutFinished: void OCC::PropagateUploadFileQNAM::slotPutFinished() QUrl( “https://www.domain.com/remote.php/webdav/test.zip-chunking-2129476149-104-17” ) FINISHED WITH STATUS 99 “Error while reading: error:140943FC:SSL routines:ssl3_read_bytes:sslv3 alert bad record mac” QVariant(Invalid) QVariant(Invalid)
04-22 00:45:13:766 0xe7610 OCC::PropagateUploadFileQNAM::slotPutFinished: ""
04-22 00:45:13:766 0xe7610 OCC::PropagateUploadFileQNAM::abort: virtual void OCC::PropagateUploadFileQNAM::abort() OCC::PUTFileJob(0x7dba3f8) "test.zip"
04-22 00:45:13:767 0xe7610 OCC::AbstractNetworkJob::slotFinished: void OCC::AbstractNetworkJob::slotFinished() 5 “Operation canceled” QVariant(Invalid)
04-22 00:45:13:767 0xe7610 OCC::PropagateUploadFileQNAM::slotPutFinished: void OCC::PropagateUploadFileQNAM::slotPutFinished() QUrl( “https://www.domain.com/remote.php/webdav/test.zip-chunking-2129476149-104-18” ) FINISHED WITH STATUS 5 “Operation canceled” QVariant(Invalid) QVariant(Invalid)
04-22 00:45:13:767 0xe7610 OCC::PropagateUploadFileQNAM::abort: virtual void OCC::PropagateUploadFileQNAM::abort() OCC::PUTFileJob(0x7dba380) "test.zip"
04-22 00:45:13:768 0xe7610 OCC::AbstractNetworkJob::slotFinished: void OCC::AbstractNetworkJob::slotFinished() 5 “Operation canceled” QVariant(Invalid)
04-22 00:45:13:768 0xe7610 OCC::PropagateUploadFileQNAM::slotPutFinished: void OCC::PropagateUploadFileQNAM::slotPutFinished() QUrl( “https://www.domain.com/remote.php/webdav/test.zip-chunking-2129476149-104-19” ) FINISHED WITH STATUS 5 “Operation canceled” QVariant(Invalid) QVariant(Invalid)
04-22 00:45:13:768 0xe7610 OCC::SyncEngine::slotItemCompleted: void OCC::SyncEngine::slotItemCompleted(const OCC::SyncFileItem&, const OCC::PropagatorJob&) “test.zip” INSTRUCTION_NEW 1 "Error while reading: error:140943FC:SSL routines:ssl3_read_bytes:sslv3 alert bad record mac"
04-22 00:45:13:769 0xe7610 OCC::SocketApi::sendMessage: SocketApi: Sending message: "STATUS:SYNC:C:\Users\user\Nextcloud"
04-22 00:45:13:770 0xe7610 OCC::SocketApi::sendMessage: SocketApi: Sending message: "STATUS:ERROR:C:\Users\user\Nextcloud\test.zip"
04-22 00:45:13:768 0x7c3f368 unknown: QIODevice::write: device not open
04-22 00:45:13:774 0xe7610 OCC::SyncEngine::slotItemCompleted: void OCC::SyncEngine::slotItemCompleted(const OCC::SyncFileItem&, const OCC::PropagatorJob&) “” INSTRUCTION_NONE 0 ""
04-22 00:45:13:774 0xe7610 OCC::SocketApi::sendMessage: SocketApi: Sending message: "STATUS:IGNORE:C:\Users\user\Nextcloud"
04-22 00:45:13:778 0xe7610 OCC::SyncJournalDb::walCheckpoint: void OCC::SyncJournalDb::walCheckpoint() took 0 msec
04-22 00:45:13:779 0xe7610 OCC::SyncJournalDb::commitInternal: void OCC::SyncJournalDb::commitInternal(const QString&, bool) Transaction commit "All Finished."
04-22 00:45:13:780 0xe7610 OCC::SyncJournalDb::close: void OCC::SyncJournalDb::close() "C:/Users/user/Nextcloud/.csync_journal.db"
04-22 00:45:13:780 0xe7610 OCC::SyncJournalDb::commitTransaction: No database Transaction to commit
04-22 00:45:13:792 0xe7610 OCC::SyncEngine::finalize: CSync run took 13587
04-22 00:45:13:793 0xe7610 OCC::SocketApi::sendMessage: SocketApi: Sending message: "STATUS:IGNORE:C:\Users\user\Nextcloud"
04-22 00:45:13:793 0xe7610 OCC::BandwidthManager::~BandwidthManager: virtual OCC::BandwidthManager::~BandwidthManager()
04-22 00:45:13:794 0xe7610 OCC::FolderWatcher::pathIsIgnored: * Ignoring file "C:/Users/user/Nextcloud/.csync_journal.db-wal"
04-22 00:45:13:794 0xe7610 OCC::FolderWatcher::pathIsIgnored: * Ignoring file "C:/Users/user/Nextcloud/.csync_journal.db"
04-22 00:45:13:794 0xe7610 OCC::FolderWatcher::pathIsIgnored: * Ignoring file "C:/Users/user/Nextcloud/.csync_journal.db-shm"
04-22 00:45:13:795 0xe7610 OCC::FolderWatcher::pathIsIgnored: * Ignoring file "C:/Users/user/Nextcloud/.csync_journal.db-wal"
04-22 00:45:13:795 0xe7610 OCC::Folder::slotSyncFinished: - client version 2.2.4 (build 2) Qt 5.4.0 SSL OpenSSL 1.0.2h 3 May 2016
04-22 00:45:13:795 0xe7610 OCC::Folder::slotSyncFinished: -> SyncEngine finished with ERROR, warn count is 1
04-22 00:45:13:800 0xe7610 OCC::Folder::bubbleUpSyncResult: Processing result list and logging took 3 Milliseconds.
04-22 00:45:13:811 0xe7610 OCC::Folder::bubbleUpSyncResult: OO folder slotSyncFinished: result: 3
04-22 00:45:13:812 0xe7610 OCC::Folder::slotSyncFinished: ** error Strings: (“Error while reading: error:140943FC:SSL routines:ssl3_read_bytes:sslv3 alert bad record mac”, “test.zip: Error while reading: error:140943FC:SSL routines:ssl3_read_bytes:sslv3 alert bad record mac”)
04-22 00:45:13:812 0xe7610 OCC::Folder::slotSyncFinished: * owncloud csync thread finished with error
04-22 00:45:13:812 0xe7610 OCC::Folder::slotSyncFinished: the last 1 syncs failed
04-22 00:45:13:812 0xe7610 OCC::SocketApi::sendMessage: SocketApi: Sending message: "STATUS:IGNORE:C:\Users\user\Nextcloud"
04-22 00:45:13:813 0xe7610 OCC::SocketApi::sendMessage: SocketApi: Sending message: "UPDATE_VIEW:C:\Users\user\Nextcloud"
04-22 00:45:13:815 0xe7610 unknown: QString::arg: Argument missing: “https://docs.nextcloud.com/desktop/2.2/” , 2
04-22 00:45:13:816 0xe7610 unknown: QString::arg: Argument missing: “https://docs.nextcloud.com/desktop/2.2/” , 2
04-22 00:45:13:816 0xe7610 OCC::ownCloudGui::slotSyncStateChange: Sync state changed for folder “https://www.domain.com/remote.php/webdav/” : "Error"
04-22 00:45:13:818 0xe7610 OCC::FolderWatcher::pathIsIgnored: * Ignoring file "C:/Users/user/Nextcloud/.owncloudsync.log"
04-22 00:45:13:924 0xe7610 OCC::SocketApi::command_RETRIEVE_FILE_STATUS: void OCC::SocketApi::command_RETRIEVE_FILE_STATUS(const QString&, QIODevice*) "C:\Users\user\Nextcloud (backup)"
04-22 00:45:13:924 0xe7610 OCC::SocketApi::sendMessage: SocketApi: Sending message: "STATUS:NOP:C:\Users\user\Nextcloud (backup)"
04-22 00:45:13:925 0xe7610 OCC::SocketApi::command_RETRIEVE_FILE_STATUS: void OCC::SocketApi::command_RETRIEVE_FILE_STATUS(const QString&, QIODevice*) "C:\Users\user\Nextcloud"
04-22 00:45:13:926 0xe7610 OCC::SocketApi::sendMessage: SocketApi: Sending message: "STATUS:IGNORE:C:\Users\user\Nextcloud"
04-22 00:45:14:017 0xe7610 OCC::FolderMan::slotFolderSyncFinished: <===================================== sync finished for "https://www.domain.com/remote.php/webdav/"
04-22 00:45:15:300 0xe7610 unknown: Failed to resolve EGL function eglGetPlatformDisplayEXT (The specified procedure could not be found.)
04-22 00:45:15:302 0xe7610 unknown: static QWindowsEGLStaticContext* QWindowsEGLStaticContext::create(): Could not initialize EGL display: error 0x3001
04-22 00:45:15:302 0xe7610 unknown: static QWindowsEGLStaticContext* QWindowsEGLStaticContext::create(): When using ANGLE, check if d3dcompiler_4x.dll is available
04-22 00:45:15:645 0xe7610 OCC::AbstractNetworkJob::start: !!! OCC::PropfindJob created for “https://www.domain.com” + “/” “OCC::QuotaInfo”


#35

I am at my wits end. Is this router related? DNS related?

Using a Netgear R7800 and I have Namecheap as my DNS.


#36

I wouldn’t expect the DNS to be the issue since once the IP has been resolved for that session it won’t need to resolve anything, so the upload of large files should just continue even if DNS is down. On the other hand a router (or switch) could cause issues if for example the throughput is higher than it can handle, or for some reason it drops packets.

Maybe what you could do is run a tcpdump on the NC server from the beginning of the upload to the end where it fails. It will be a big file, but you can then analyse the whole stream. Especially at the end to see which side closes the data flow (socket).


#37

I’ve been out of town all week, but I’ll be back in town this weekend and I’ll give the TCPDUMP a shot and let you know what I find.


#38

I’m not having any luck getting a TCPDUMP that says anything from the server side. It just kinda stops without any issues.


#39

But with the tcpdump you can see which side (server or client) initiates the closing of the socket. This might help to indicate on which side the investigation has to go to.


#40

@goober2186

Can you set your SSL logging level to debug in your apache conf and see if it spits out anything useful? I’ll do the same when I get back home tonight.


#41

I’m having this exact issue on Ubuntu on several computers. It fails, always. I have to move stuff over to a windows system to be able to upload directories.