Hello everyone, I hope that someone with some experience can help me out here.
I have a NextCloudServer hosting 700GB of data.
My share is:
242,588 Files, 10,403 Folders and I sync 10.5 GB of these.
A lot of images, source code, text documents.
Every time I write to a single file 1270 files starts to sync. When the client is just started up it can sync 40 files a second. After running the client for some while the sync speed slows down considerably. After timing it syncs aproximately 2.3 files a second.
Nextcloud version 3.6.0stable-Win64 (build 20220906)
There must be a reason for this strange number of files (it doesn’t match the number of files in the cloud, in the folder of the files that change or anything similar. So I don’t understand the reason.
The slowing down seems also kind of strange, as nothing else changes but the number of times the synchronization has been run.
I got more information: It looks very much like this is a CPU bound thing, not network. After watching a slow sync in action, In the task manager can see that it grabs a core of my CPU and uses it at least 50%, in addition to hogging 0.5GB of memory.
I wouldn’t mind the memory if it used it to sync mega-fast, but it doesn’t.
I’m having this problem too. Brand new Truenas instance, installed nextcloud App on the Truenas control panel. This is super slick btw. Works fine in browser, but the win11 client is just cpu bound. Took almost a week to sync 700G photos (could barely use my pc during that uploading time) and now that it’s finished with the 700G it just chews up all the cpu on my very fast PC. I’m not sure why because it’s already in sync and no more files are changing. I will try to debug for a few more days, but this is unusable in the current state.
Server app version: 25_1.6.13
Win11 Client: Nextcloud-3.6.1
I found the log files for the PC client in C:\Users\MY_PC_USER_NAME\AppData\Roaming\Nextcloud
The log has over 100k lines of errors, all the same “Network error: 99”.
I had to uninstall the client as it was unusable. Soaked up a core, Explorer would stop responding, tray icon interaction would take several minutes. Nextcloud server was idle.
I saw network error 99 in the log as well. It would then sometimes go to “Disconnected”. I would have to close and restart the nextcloud sync agent. I could still access the server through a browser during this disconnect from same workstation.
Server is a quad core 1.7Ghz Xeon 8GB memory running Debian 11 on VMware 7.x.
Nextcloud 25.0.1
Apache
Workstation is a Dell XPS13Plus i7 with 32GB memory and Windows 11. Very capable machine.
3279 directories, 29673 files
286G total consumed.
May I ask how are you using syncthing and why would you say it’s a better solution than a native app outside of the obvious performance issues?
In my newb ignorance, I would think the only way to get the files in/out of NC would be to talk directly to the data director and run scripts to do chmod, chown and occ.
Several reason, I had owncloud on my previous box. Owncloud had major problems with large file count syncs. So I was very excited to hear there was a NextCloud. It is suppose to be the updated version of Owncloud and I was hoping all the issues were fixed. I really wish it worked.
As for syncthing… peer to peer syncing. Very easy to setup and create a “cloud”. Just point your PCs and Macs to the server. Well might as well let them know about each other as well - and you get a performance boost. cool.
Also, I did huge syncs between my machines without issue. You can even sync the existing owncloud folders it it won’t re-copy the data. It “rescans” and figures it out.
Conflict resolution screen super easy to use shows all conflicts, dates, times, machines with the conflicts and you pick which one you want to override.
Finally, it’s very easy to backup other folders to your server. Just peer-to-peer your dev box/ folder with your server. Previously everything had to be in the “owncloud” folder. Now I can have a bunch of distinct folders to backup. Then Truenas creates a snapshot for me every day. Never loose anything by accident.
Yeah, I mean, that’s the whole point of Next(own)cloud. Be the cloud and use their apps to sync everything everywhere. Throwing syncthing in the middle is a deviation from the complete package. To me it feels like buying a car that you don’t like the engine so you put a different one. Preference but you’ve added a path to complexity and incompatibility.
Either way, glad it works for you.
I did install the Nextcloud app on my wife’s computer and hers seems fine. Maybe I’ll have to try it again on my laptop.