Desktop app failing to upload some files (looks random)

sp31415t1 · August 13, 2023, 5:41pm

Hello

I would like to submit a strange behaviour and maybe have a workaround.
When I create or modifiy a file, the upload is not always done as it should. The desktop app icon stay at blue circle with 2 arrows. I have to kill the app. If I re-run the app, it try to upload again and again but fail the same way.
I can upload the failing file with the web interface or to another provider.
Numerous files are failing but not all and not with the same host.
It’s happening since a few months.

I failed to identified a pattern or reason.
I tried using the debian package, newer version (build myself and including the last one).
I think It can be related to server version, because not all accounts start failing at the same date.
I’m using Linux Debian stable.

desktop logs:

2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.h:145 ] [ OCC::SqlQuery::bindValue ]:   SQL bind 1 "hidden-path-filename-value1"
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.h:145 ] [ OCC::SqlQuery::bindValue ]:   SQL bind 2 0
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.h:145 ] [ OCC::SqlQuery::bindValue ]:   SQL bind 3 0
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.h:145 ] [ OCC::SqlQuery::bindValue ]:   SQL bind 4 0
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.h:145 ] [ OCC::SqlQuery::bindValue ]:   SQL bind 5 734644
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.h:145 ] [ OCC::SqlQuery::bindValue ]:   SQL bind 6 1642161086
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.h:151 ] [ OCC::SqlQuery::bindValue ]:   SQL bind 7 "MD5:hidden-md5-value2"
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.cpp:295 ]       [ OCC::SqlQuery::exec ]:        SQL exec "INSERT OR REPLACE INTO uploadinfo (path, chunk, transferid, errorcount, size, modtime, contentChecksum) VALUES ( ?1 , ?2, ?3 , ?4 ,  ?5, ?6 , ?7 )"
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.cpp:328 ]       [ OCC::SqlQuery::exec ]:        Last exec affected 1 rows.
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database ./src/common/syncjournaldb.cpp:2660 ]   [ OCC::SyncJournalDb::commitInternal ]: Transaction commit "Upload info" and starting new transaction
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.h:151 ] [ OCC::SqlQuery::bindValue ]:   SQL bind 1 "hidden-path-filename-value1"
2023-08-13 19:07:57:338 [ debug nextcloud.sync.database.sql ./src/common/ownsql.cpp:295 ]       [ OCC::SqlQuery::exec ]:        SQL exec "SELECT baseFileId, baseModtime, baseEtag, basePath FROM conflicts WHERE path=?1;"
2023-08-13 19:07:57:338 [ info nextcloud.sync.propagator.bulkupload ./src/libsync/bulkpropagatorjob.cpp:183 ]:  "/hidden-path-filename-value1" transmission checksum "hidden-md5-value2" "/home/hidden/hidden/hidden-path-filename-value1"
2023-08-13 19:07:57:339 [ info nextcloud.sync.accessmanager ./src/libsync/accessmanager.cpp:78 ]:       4 "" "https://nch.pl/remote.php/dav/bulk" has X-Request-ID "hidden-value3"
2023-08-13 19:07:57:339 [ debug nextcloud.sync.cookiejar ./src/libsync/cookiejar.cpp:90 ]       [ OCC::CookieJar::cookiesForUrl ]:      QUrl("https://nch.pl/remote.php/dav/bulk") requests: (QNetworkCookie("__Host-nc_sameSiteCookielax=true; secure; HttpOnly; SameSite=lax; expires=Fri, 31-Dec-2100 23:59:59 GMT; domain=nch.pl; path=/"), QNetworkCookie("__Host-nc_sameSiteCookiestrict=true; secure; HttpOnly; SameSite=strict; expires=Fri, 31-Dec-2100 23:59:59 GMT; domain=nch.pl; path=/"), QNetworkCookie("oc_sessionPassphrase=hidden-value4; secure; HttpOnly; SameSite=Lax; domain=nch.pl; path=/"), QNetworkCookie("ocqpvr8rxwya=hidden-value5; secure; HttpOnly; SameSite=Lax; domain=nch.pl; path=/"))
2023-08-13 19:07:57:339 [ info nextcloud.sync.networkjob ./src/libsync/abstractnetworkjob.cpp:358 ]:    OCC::PutMultiFileJob created for "https://nch.pl" + "" "OCC::BulkPropagatorJob"

I’m looking for suggestion in order to keep using nextcloud and be happy with a background sync

Regrds,
Serge

holocronweaver · November 5, 2023, 1:16am

Having what seems to be the same issue, not sure exactly when it started but just noticed today on Ubuntu 22.04 (Nextcloud client 3.4.2).

The files that fail to sync are no longer in Nextcloud cloud, but they were there before, so this is some form of cloud data loss.

Strongly considering moving away from Nextcloud for file sync, I’ve experience data loss via Nextcloud a few years ago and don’t want to experience it again. The devs seem to have put their focus on office suite stuff I would never use, while sync languishes with the same bugs it has had for years.

holocronweaver · November 5, 2023, 5:18am

…and updating to client 3.10.1 solved the issue for me, all files are now uploaded and some conflicts that were not surfaced before were shown.

I didn’t realize the PPA had been disabled so I wasn’t receiving updates, but I’m also not sure why it makes a difference as 3.4.2 was released early 2022, so it is not that old and I haven’t changed it since on any of my machines, nor have I changed anything in Nextcloud since ~6 months ago.

I do daily automated backups of my nextcloud data just in case, but I will stick with it for now and hopefully it will be another few years before the next risk of data loss.