Impossible to finalize synch with nextcloud client

ℹ️ Support
1

Hi,

  1. Nexcloud 14.0.4, nginx/php-fpm/redis/mariadb/fail2ban native softwares on Debian Stable.
  2. Encrypted file on the server side.
  3. Timeout OK for light upload lines.
  4. Installation OK and nice synchro the first time. 3 users and OK for the daily use on different machines (even for the same account).

Thanks for the dev team: nice job :sunny:

I have one problem since I move/restore my original repository. That has changed the timestamp of all the files. I should have ask here before restoring but I don’t :imp:

When my nextcloud client (2.5.1git on Mint 19.1) tries to synchronize again, it has uploaded all the repository again (about 16,5 Go). (I don’t know why it hadn’t just compare the MD5sum and changed timestamp). It is a long long way behind a light DSL connexion :sweat:

But now, it cannot synchronize all the repository.

I notice few “error” messages:

The first one in the client interface:

Capture%20du%202018-12-21%2014-24-25

In the log client file, the associated error message is

|[OCC::PropagateItemJob::scheduleSelfOrChild |Starting INSTRUCTION_SYNC propagation of "XXX/CLIP0624.ASF" by OCC::PropagateUploadFileNG(0x558f41061d30)||---|---|
|[OCC::PropagateUploadFileCommon::startUploadFile |Running the compute checksum|
|[OCC::PropagateUploadFileCommon::slotComputeContentChecksum |Tryint to compute the checksum of the file|
|[OCC::PropagateUploadFileCommon::slotComputeContentChecksum |Still trying to understand if this is the local file or the uploaded one|
|[OCC::ComputeChecksum::start |Computing "SHA1" checksum of "XXX/CLIP0624.ASF" in a thread|
|[OCC::ComputeChecksum::start |Computing "" checksum of "XXX/CLIP0623.ASF" in a thread|
|[OCC::AccessManager::createRequest |6 "PROPFIND" "https://zzz/remote.php/dav/uploads/pk/1217202477" has X-Request-ID "e7b078f1-cd8d-49b1-a34a-0564c8605b81"|
|[OCC::AbstractNetworkJob::start |OCC::LsColJob created for "https://zzz" + """OCC::PropagateUploadFileNG"|
|[OCC::ComputeChecksum::start |Computing "" checksum of "XXX/CLIP0622.ASF" in a thread|
|[OCC::AccessManager::createRequest |6 "PROPFIND" "https://zzz/remote.php/dav/uploads/pk/341331446" has X-Request-ID "264eea29-de7e-4786-b7ea-486b976bb967"|
|[OCC::AbstractNetworkJob::start |OCC::LsColJob created for "https://zzz" + ""  OCC::PropagateUploadFileNG"|
|[OCC::WebFlowCredentials::slotFinished |request finished|
|[OCC::WebFlowCredentials::stillValid |Still valid?|
|[OCC::WebFlowCredentials::stillValid |QNetworkReply::NetworkError(NoError)|
|[OCC::WebFlowCredentials::stillValid |"Erreur inconnue"|
|[OCC::LsColJob::finished |LSCOL of QUrl("https://zzz/remote.php/dav/uploads/pk/1217202477") FINISHED WITH STATUS "OK"|
|[OCC::PropagateUploadFileNG::slotPropfindFinished |Resuming  "XXX/CLIP0623.ASF"  from chunk  2 ; sent = 12957474|
|[OCC::AccessManager::createRequest |6 "MOVE" "https://zzz/remote.php/dav/uploads/pk/1217202477/.file" has X-Request-ID "7d739121-adee-4a20-b5e9-33d2836c933c"|
|[OCC::AbstractNetworkJob::start |OCC::MoveJob created for "https://zzz" + "" "OCC::PropagateUploadFileNG"|
|[OCC::ComputeChecksum::start |Computing "" checksum of "XXX/CLIP0624.ASF" in a thread|
|[OCC::AccessManager::createRequest |6 "PROPFIND" "https://zzz/remote.php/dav/uploads/pk/3858864334" has X-Request-ID "1a201c2e-d844-47a3-aa72-88fbe2d3e499"|
|[OCC::AbstractNetworkJob::start |OCC::LsColJob created for "https://zzz" + "" "OCC::PropagateUploadFileNG"|
|[OCC::WebFlowCredentials::slotFinished |request finished|
|[OCC::WebFlowCredentials::stillValid |Still valid?|
|[OCC::WebFlowCredentials::stillValid |QNetworkReply::NetworkError(NoError)|
|[OCC::WebFlowCredentials::stillValid |"Erreur inconnue"|
|[OCC::LsColJob::finished |LSCOL of QUrl("https://zzz/remote.php/dav/uploads/pk/3858864334") FINISHED WITH STATUS "OK"|
|[OCC::PropagateUploadFileNG::slotPropfindFinished |Resuming  "XXX/CLIP0624.ASF"  from chunk  111 ; sent = 289026765|
|[OCC::AccessManager::createRequest |6 "MOVE" "https://zzz/remote.php/dav/uploads/pk/3858864334/.file" has X-Request-ID "d6938045-1903-4bd1-951e-d5ef5a1d97fa"|
|[OCC::AbstractNetworkJob::start |OCC::MoveJob created for "https://zzz" + "" "OCC::PropagateUploadFileNG"|
|[OCC::AccessManager::createRequest |6 "PROPFIND" "https://zzz/remote.php/dav/files/pk/" has X-Request-ID "e37cc80d-03c6-4b34-a08a-d88f1bd1cf44"|

Note that this file is not too big (a few Mo, already uploaded once and I have uploaded bigger files)

In the nextcloud log files (in the admin console), I have:

    Sabre\DAV\Exception\BadRequest: expected filesize 10000000 got 49152
    /var/www/nextcloud/apps/dav/lib/Connector/Sabre/Directory.php - line 156:
    OCA\DAV\Connector\Sabre\File->put(null)
    /var/www/nextcloud/apps/dav/lib/Upload/UploadFolder.php - line 39:
    OCA\DAV\Connector\Sabre\Directory->createFile("00000000", null)
    /var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php - line 1096:
    OCA\DAV\Upload\UploadFolder->createFile("00000000", null)
    /var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php - line 529:
    Sabre\DAV\Server->createFile("uploads/pk/ ... 0", null, null)
    Sabre\DAV\CorePlugin->httpPut(Sabre\HTTP\R ... "}, Sabre\HTTP\Response {})
    /var/www/nextcloud/3rdparty/sabre/event/lib/EventEmitterTrait.php - line 105:
    call_user_func_array([ Sabre\DAV\ ... "], [ Sabre\HTTP ... }])
    /var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php - line 479:
    Sabre\Event\EventEmitter->emit("method:PUT", [ Sabre\HTTP ... }])
    /var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php - line 254:
    Sabre\DAV\Server->invokeMethod(Sabre\HTTP\R ... "}, Sabre\HTTP\Response {})
    /var/www/nextcloud/apps/dav/lib/Server.php - line 293:
    Sabre\DAV\Server->exec()
    /var/www/nextcloud/apps/dav/appinfo/v2/remote.php - line 35:
    OCA\DAV\Server->exec()
    /var/www/nextcloud/remote.php - line 163:
    require_once("/var/www/ne ... p")

I have regular messages like this and the only change is the number after “got” (all about 49152 and 65536)

I have NOTHING in my server log (php, nginx, kernel, fail2ban), except for nginx

2018/12/22 09:06:15 [error] 2090#2090: *53313 access forbidden by rule, client: XXX, server: zzz, request: "GET /data/.ocdata?t=1545465975249 HTTP/2.0", host: "zzz"

which is a local security test of nextcloud (note: I disagree this way to test by opening a file causing an error message. You should test only the .htaccess values (rxw) instead of creating error message. Error message is for error, not for tests (this is my admin part saying :slight_smile:)

Last error message (but this way in the nextcloud client). I have this recurrent messages

|OCC::PropfindJob::finished |PROPFIND of QUrl("https:/zzz/remote.php/dav/files/pk/") FINISHED WITH STATUS "OK"|
|---|---|
|[OCC::Folder::slotRunEtagJob |Trying to check "https://zzz/remote.php/dav/files/pk/" for changes via ETag check. (time since last sync: 1768 s)|
|[OCC::AccessManager::createRequest |6 "PROPFIND" "https:/zzz/remote.php/dav/files/pk/" has X-Request-ID "e811b651-96c1-435b-9976-494d537356d3"|
|[OCC::AbstractNetworkJob::start |OCC::RequestEtagJob created for "https://zzz" + "/" "OCC::Folder"|
|[OCC::WebFlowCredentials::slotFinished |request finished|
|[OCC::WebFlowCredentials::stillValid |Still valid?|
|[OCC::WebFlowCredentials::stillValid |QNetworkReply::NetworkError(NoError)|
|[OCC::WebFlowCredentials::stillValid |"Erreur inconnue"|

I have about 2 or 3 messages by second.

If I pause the synch, I still have this message every time:

|[OCC::AccessManager::createRequest |6 "PROPFIND" "https://zzz/remote.php/dav/files/pk/" has X-Request-ID "a143f9dd-5283-408f-993d-12bdb3aa92c4"|
|---|---|
|[OCC::AbstractNetworkJob::start |OCC::PropfindJob created for "https://zzzz" + "/" "OCC::QuotaInfo"|
|[OCC::WebFlowCredentials::slotFinished |request finished|
|[OCC::WebFlowCredentials::stillValid |Still valid?|
|[OCC::WebFlowCredentials::stillValid |QNetworkReply::NetworkError(NoError)|
|[OCC::WebFlowCredentials::stillValid |"Erreur inconnue"|

note that is the same message that above. I can’t understand why there is still activities when the client is pausing?

I can’t deal a solution with all that. I need help.

I can give more information if any.

Thanks,

2

I forgot something:

The size inside the server is too big to my mind: about 47 Go for 17 Go on the local side. Even if there is an encryption way, is it normal? My trashbin is about 800 Mo.

Thanks