Nextcloud vs syncthing speed

[willi4m]

hi,

i just setup nextcloud in truens scale, bellow is my server spec
i7 3770, 16GB, HDD 1T mirroring 7200rpm, LAN 1GB, WIFI 5ghz, home lan all using 1GB port + cat6

i still don’t know why compare with syncthing transfer file more faster then nextcloud.
i test from my pc to my server by local lan, nextcloud speed no more than 80mbps, test by phone with wifi 5ghz no more than 30mbps. i do test speed from server to pc and to my phone

pc u/d around 980mbps
phone u/d around 380mbps

any solution to make nextcloud more faster using local lan? or my cpu is not good enough?

thanks

[wwe]

Your specs are definitely OK. In my setup I can saturate 1Gbit/s LAN with slower hardware.

NC download speed slower through traefik

In the meanwhile I moved my docker to PC (Debian 10 on i3 6th Gen+16GB RAM+spinning disk). While the speed is unchanged with WiFi, with LAN connection I get much higher throughput. Browser transfer is >100MBIt/s for 1GB file and client sync goes over 500MBit/s (spikes to >800MBit/s). My conclusion is the problem is not related to Traefik itself as my tests proof it CAN handle faster transfers. [image] [image] [image] [image]

Limited upload speed on docker container

I don’t exactly get what you are looking for. It may be the case NC15 ist faster then NC21. I assume current version has contains move moving parts. My test show that NC itself and traefik CAN saturate the network - see another test, here I added 4 files with total size of 3,5GB. It was interesting initially I had send speed close to 1 GBit/s, then short pause and then another block at ~300-500MBit/s. complete transfer was finished in less then 40 seconds on NC21 container with traefik, with HT…

Limited upload speed on docker container

I’m sorry there is nothing wrong with Nextcloud running as Docker container behind Traefik. Below results from Windows 10 desktop client 3.3.6 against Nextcloud Docker container 22.2.3 running on old Core i3/16GB RAM where container lives on magnetic HDD with ZFS filesystem: [image] [image] Download from NAS is definitely faster but NC is close enough on hardware limits… 570 Mbps is far more you need for daily usage…

But in general transfer speed is highly dependent on the files - large files are expected to transfer close to hardware limits, lot of small files could be significant slower due to application overhead (e.g. read/write to the database).

Review you NC config - some apps are known to slow down the system e.g. external storage. Start with really basic system and and functionality slowly to nail the problem.

Slow desktop client sync

Nextcloud version (eg, 19.0.3): Operating system and version (QNAP QTS 4.4.3+Docker): Apache or nginx version (Docker image 19.0.3): CPU: Celeron J1900 @ 1.99GHz (4*cores) RAM: 8GB initially posted as comment to https://help.nextcloud.com/t/up-download-to-slow-only-2mb-s-after-installation-despite-good-hardware/96105/15 but break out to own topic due to recommendation of @KarlF12 it takes multiple days to perform initial sync to the clients - both on Win and Linux in local LAN with 1GBit…

[willi4m]

@wwe

Review you NC config - some apps are known to slow down the system e.g. external storage. Start with really basic system and and functionality slowly to nail the problem.

NC config still using default, because the server is fresh setup, and this is my first time setup server, all still using default configuration

Just confused when using syncthing send from pc to same server can achive max speed in around 700-800mbps.

Search the forum still no found fit solution for speed issue

[just]

Syncthing is a more efficient protocol. It is much faster than webdav for most transfer types, if not all.

Syncthing wins at speed and conflict resolution.
Webdav excels cause everything Nextcloud rounds it out with besides speed and sync performance.

[TessyPowder]

Due to the architecture of nextcloud and the WebDAV protocol, nextcloud will loose in terms of speed to Syncthing, but will win in terms of features and versatility. If you want both you need to use nextcloud and throw hardware at the problem, but that is probably not an option.

Developing an app to get nextcloud to talk the syncthing protocol is definitely on my list of things i want to do when i find time for it, but in the meantime you will need to decide between speed and features.

Also there are lots of things you can change about the nextcloud config to get better general performance, like PHP 8, switching from mysql to postgres, php-fpm settings …

[wwe]

@willi4m

Just confused when using syncthing send from pc to same server can achive max speed in around 700-800mbps.

Search the forum still no found fit solution for speed issue

as I referenced above NC is definitely capable to achieve this speed for big files. Before you troubleshoot a miracle first check “if you have a speed issue”. if you reach more than a half of your theoretical hardware throughput - I would suggest to do nothing and leave it as is…

[tflidd]

You can do a few things to speed up Nextcloud:

• use caches (redis and apcu)
• optimize database caches
• high performance backend (Nextcloud faster than ever! Introducing Files High Performance Back-end - Nextcloud), it’s for notifications,

Then the memory size for php, number of threads and so on depends on the usage.

@wwe

half of your theoretical hardware throughput

That is a good benchmark of what you can expect.

[willi4m]

Actually i no use all nextcloud functions, just need backups my photo from my phone and my pc

Before i use syncthing than i realize syncthing do 100% sync from 1 devices to other device. Than it will be major issue for my phone, than i found nextcloud can do streaming like google photo. Just show picture and download when i need it, save my storage.

I think i will stay with nextcloud and hope next version can solve speed issue. No much i can do either, I’m not expert tech guy.

Anyway thanks for all reply

[tflidd]

@willi4m

I think i will stay with nextcloud and hope next version can solve speed issue. No much i can do either, I’m not expert tech guy.

If you don’t tune your system, this won’t happen automatically. Like for the caches, developers consider that you are using them already for reasonable performance, so they won’t invest time to improve it for people who don’t use it.

[just]

There is nothing to wait for, because these are different sync protocols.
WebDav will never be Syncthing, nor will it ever be rsync.

Use whatever works best for you and glad you got your question answered.

[triver]

You can find out much of how to do your configuration in these pages. In general the documentation of Nextcloud is really complete and helpful.
https://docs.nextcloud.com/server/stable/admin_manual/

Look specifically for the cache pages