# Nextcloud Sync 2.0 brings 10x faster syncing **URL:** \ **Category:** šŸ“° News\ **Created:** [September 6, 2021, 9:31am UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174 "2021-09-06T09:31:45Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![system](https://help.nextcloud.com/user_avatar/help.nextcloud.com/system/32/29333_2.png) [@system](https://help.nextcloud.com/u/system)\ **Post date:** [September 6, 2021, 9:31am UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/1 "2021-09-06T09:31:45Z")
Originally published at: [https://nextcloud.com/blog/nextcloud-sync-2-0-brings-10x-faster-syncing/](https://nextcloud.com/blog/nextcloud-sync-2-0-brings-10x-faster-syncing/) 2021 is a year of massive improvements to the Nextcloud desktop client. The introduction of Instant Sync with Nextcloud Hub 21 brought file changes instantly to the desktop while decreasing server load from the clients by nearly 90%. There have also been numerous improvements to End-to-end Encryption and the Virtual Files, all hooking deep in the sync engine of the client. One more big change is coming: a massive improvement to the syncing speed of small files, impacting the overall syncing speed significantly and further reducing server load. All this has added up to such a big change weā€™ve decided to up the version number of our sync engine. ![](https://nextcloud.com/media/sync-speed.png) ## Sync Engine 2.0 Small files are currently a bit of a bottleneck for the sync client, as each file is uploaded individually. Thus, 1000 1kb files will take 1000 connections, giving a lot of overhead compared to a single 1mb file. Version 2.0 of Nextcloud Sync will do away with this: the File Packing feature will upload multiple small files in a single request! ### 10x faster upload This means faster upload of small files ā€“ hundreds, even thousands of times faster depending on the file size and network limitations, as internal testing on a tech preview shows! Of course, in a more typical scenario of mixed file sizes, the benefits are more modest, but it is not unlikely that most full sync runs will be between 2x to 10x faster. ### 10x lower server load The sync client uploads multiple files in parallel to get the most speed out of the network. If many clients sync simultaneously, this can cause some serious load and by eliminating a large number of connections, the new sync engine has the potential to dramatically decrease the load on servers. ![](https://nextcloud.com/media/server-load.png) ## Syncing at a new level: 10x to 100x With Instant Sync thanks to the High Performance Back-end for Files introduced earlier this year, and the File Packing coming to V2 of the Sync Engine, both user experience and server load will dramatically improve. This is augmented by dozens other improvements made to the syncing process over the last year. Internal testing shows that in most situations, the sync speed will now simply be limited by the bandwidth of the network connection of the user. For the server, idle load will have decreased by 10x thanks to the HPB, while during syncing the number of connections is also reduced by about a factor 10! Users will benefit from instant availability of their files, even if they need to have large numbers of small files made available locally. Nextcloud Sync v2 will be made available as part of a desktop client release later this year, alongside the release of Nextcloud 23. ---
**Author:** ![Nemskiller](https://help.nextcloud.com/user_avatar/help.nextcloud.com/nemskiller/32/875_2.png) [@Nemskiller](https://help.nextcloud.com/u/Nemskiller)\ **Post date:** [September 6, 2021, 10:22am UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/2 "2021-09-06T10:22:11Z")
I donā€™t get one thing : In order to get this improvement we need to have a HPB ? ---
**Author:** ![GieltjE](https://help.nextcloud.com/letter_avatar/gieltje/32/5_5575768a8748004e209b776fc1b2916d.png) [@GieltjE](https://help.nextcloud.com/u/GieltjE)\ **Post date:** [September 6, 2021, 1:01pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/3 "2021-09-06T13:01:36Z")
If you donā€™t have HPB yet (wether or not it is required for this new client (setting?)), give it a go. The results are pretty good. ---
**Author:** ![mwalbeck](https://help.nextcloud.com/letter_avatar/mwalbeck/32/5_5575768a8748004e209b776fc1b2916d.png) [@mwalbeck](https://help.nextcloud.com/u/mwalbeck)\ **Post date:** [September 6, 2021, 1:41pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/4 "2021-09-06T13:41:32Z")
Knowing what the HPB for files does and reading the announcement Iā€™m pretty sure the HPB wonā€™t be required. This will be an upgrade to the sync engine itself, where the HPB for files is still optional and needs to be installed and configured by an admin before it works. Of course for the best experience the HPB is recommended. ---
**Author:** ![anon75456558](https://help.nextcloud.com/letter_avatar/anon75456558/32/5_5575768a8748004e209b776fc1b2916d.png) [@anon75456558](https://help.nextcloud.com/u/anon75456558)\ **Post date:** [September 6, 2021, 4:29pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/5 "2021-09-06T16:29:10Z")
> [@system](#): > > Nextcloud Sync v2 will be made available as part of a desktop client release later this year, alongside the release of Nextcloud 23. So, Sync 2.0 will not be supported from the webui itself? If someone drops 1,000 1k files into a filedrop shared url they will still be on the old method. Just checking. ā¤ ---
**Author:** ![bb77](https://help.nextcloud.com/letter_avatar/bb77/32/5_5575768a8748004e209b776fc1b2916d.png) [@bb77](https://help.nextcloud.com/u/bb77)\ **Post date:** [September 6, 2021, 4:48pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/6 "2021-09-06T16:48:49Z")
> [@anon75456558](#): > > will still be on the old method. > Just checking Most likley yes, because file packing has to be done by the client in order to upload the files with a single request. ---
**Author:** ![Ka\_Pa](https://help.nextcloud.com/user_avatar/help.nextcloud.com/ka_pa/32/7751_2.png) [@Ka\_Pa](https://help.nextcloud.com/u/Ka_Pa)\ **Post date:** [September 6, 2021, 5:02pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/7 "2021-09-06T17:02:31Z")
Actually, from a purely technical point of view, there is no reason they couldnā€™t do it in the webui too. Similarly to the desktop client, they would collect the list of files in JavaScript, then pack and upload it to the server endpoint, all in JS. This would need to be a totally separate re-implementation of the packing logic & upload protocol however and couldnā€™t share code with the desktop client, so I doubt they will do this. ---
**Author:** ![danger89](https://help.nextcloud.com/user_avatar/help.nextcloud.com/danger89/32/67378_2.png) [@danger89](https://help.nextcloud.com/u/danger89)\ **Post date:** [September 6, 2021, 7:37pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/8 "2021-09-06T19:37:00Z")
Thank you devs! This was one of my biggest problems with nextcloud for the past years. Finally this issue is getting attention and solved! Thank you once again. That is also why I created my own sync app: [Melroy van den Berg / Nextcloud File Drop Ā· GitLab](https://gitlab.melroy.org/melroy/nextcloud-file-drop) ---
**Author:** ![Larry\_Boyd](https://help.nextcloud.com/user_avatar/help.nextcloud.com/larry_boyd/32/32851_2.png) [@Larry\_Boyd](https://help.nextcloud.com/u/Larry_Boyd)\ **Post date:** [September 7, 2021, 1:45pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/9 "2021-09-07T13:45:11Z")
What Iā€™d really like to see, is a NON-SYNCHRONIZING virtual drive (maybe fuse for \*nix, and whatever you do to make a drive-letter mapped mount on MS) using this new approach. This would be an alternative to using WebDAV, which is needed in order to completely avoid synchronizing. ---
**Author:** ![Gatak](https://help.nextcloud.com/letter_avatar/gatak/32/5_5575768a8748004e209b776fc1b2916d.png) [@Gatak](https://help.nextcloud.com/u/Gatak)\ **Post date:** [September 12, 2021, 11:09am UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/10 "2021-09-12T11:09:20Z")
What is the HPB backend? ---
**Author:** ![Schmu](https://help.nextcloud.com/user_avatar/help.nextcloud.com/schmu/32/7823_2.png) [@Schmu](https://help.nextcloud.com/u/Schmu)\ **Post date:** [September 12, 2021, 12:10pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/11 "2021-09-12T12:10:42Z")
HPB stands for High Performance Backend: > [@Nextcloud faster than ever! Introducing Files High Performance Back-end](https://help.nextcloud.com/t/nextcloud-faster-than-ever-introducing-files-high-performance-back-end/108633): > > Originally published at: [Nextcloud faster than ever! Introducing Files High Performance Back-end ā€“ Nextcloud](https://nextcloud.com/blog/nextcloud-faster-than-ever-introducing-files-high-performance-back-end/) At a virtual presentation [streamed worldwide](https://nextcloud.com/countdown/), the Nextcloud team introduced the availability of Nextcloud Hub 21. Nextcloud Hub 21 brings a wide range of improvements in file handling performance with Files High Performance Back-end and important new collaboration features in Text, Talk, Groupware and Files. In this blog, we go into a bit more detail of the performance improvementsā€¦ ---
**Author:** ![Gatak](https://help.nextcloud.com/letter_avatar/gatak/32/5_5575768a8748004e209b776fc1b2916d.png) [@Gatak](https://help.nextcloud.com/u/Gatak)\ **Post date:** [September 12, 2021, 12:29pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/12 "2021-09-12T12:29:51Z")
I see. Remember reading about it. Itā€™s still not for webui or normal webdav connections, is it? ---
**Author:** ![jospoortvliet](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jospoortvliet/32/3_2.png) [@jospoortvliet](https://help.nextcloud.com/u/jospoortvliet)\ **Post date:** [September 13, 2021, 3:12pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/13 "2021-09-13T15:12:27Z")
> [@Gatak](#): > > I see. Remember reading about it. Itā€™s still not for webui or normal webdav connections, is it? The HPB for Files sends notifications - both for the clients and the webUI. This makes sure the web UI or devices know that there has been a change and trigger a sync run to get the files or new notification (like an incoming call) in real-time instead of just checking every 30 seconds or using long polling (the PHP alternative for keeping a connection open, quite heavy on server resources). This doesnā€™t speed up the sync per-se, but makes you wait less. In a way, for the networking techies - the HPB decreases the latency, while Sync 2.0 increases the bandwidth šŸ˜‰ And these two are, as usual, mostly independent. > [@anon75456558](#): > > So, Sync 2.0 will not be supported from the webui itself? > If someone drops 1,000 1k files into a filedrop shared url they will still be on the old method. > Just checking. ā¤ Well, thatā€™s not our initial plan, but in time we will get to that too, of course. In the end, it took a while to get chunking in the web uploader but we now have that, too (only for logged-in users btw) . So, then I think we can do this, too, itā€™s effectively the opposite of chunking šŸ˜‰ but it might take a while, so donā€™t hold your breath. But you shouldnā€™t do that anyway šŸ™ˆ ---
**Author:** ![jospoortvliet](https://help.nextcloud.com/user_avatar/help.nextcloud.com/jospoortvliet/32/3_2.png) [@jospoortvliet](https://help.nextcloud.com/u/jospoortvliet)\ **Post date:** [September 14, 2021, 3:31pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/14 "2021-09-14T15:31:47Z")
Given the speed limit is on the server side, I wonder how your app would be any faster? If it uses pure webdav and not our chunked upload, it could be less reliable than uploading with the client or web interface would be. I donā€™t want to diss you, itā€™s great you build an app for this - Iā€™m just trying to figure out if we do something wrong or if itā€™s just a use case thing and not a performance thing - your app does seem useful if you just want to upload a file to a specific folder but not use the desktop clientā€¦ ---
**Author:** ![maddox](https://help.nextcloud.com/letter_avatar/maddox/32/5_5575768a8748004e209b776fc1b2916d.png) [@maddox](https://help.nextcloud.com/u/maddox)\ **Post date:** [December 7, 2021, 10:53am UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/15 "2021-12-07T10:53:05Z")
NC Server v.22 and Client v.3.4.0 have been released. Neither was there a hint regarding the new Sync, nor do I notice a difference. Can you tell me what is the state? When will the new sync be released? ---
**Author:** ![tflidd](https://help.nextcloud.com/letter_avatar/tflidd/32/5_5575768a8748004e209b776fc1b2916d.png) [@tflidd](https://help.nextcloud.com/u/tflidd)\ **Post date:** [December 7, 2021, 1:09pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/16 "2021-12-07T13:09:08Z")
It should be working with the newly released version NC 23. There were a few issues with the v3.4.0 client ([Desktop client 3.4.0 destroys local time stamp and keeps uploading data to server](https://help.nextcloud.com/t/desktop-client-3-4-0-destroys-local-time-stamp-and-keeps-uploading-data-to-server/128512)) and it isnā€™t pushed for updates any more. Iā€™d wait for a fix for this issue and then test again. ---
**Author:** ![anon75456558](https://help.nextcloud.com/letter_avatar/anon75456558/32/5_5575768a8748004e209b776fc1b2916d.png) [@anon75456558](https://help.nextcloud.com/u/anon75456558)\ **Post date:** [December 7, 2021, 2:46pm UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/17 "2021-12-07T14:46:39Z")
Did you set it up? HPB requires some steps to get working so youā€™ll need to follow the documentation to get it running. ---
**Author:** ![maddox](https://help.nextcloud.com/letter_avatar/maddox/32/5_5575768a8748004e209b776fc1b2916d.png) [@maddox](https://help.nextcloud.com/u/maddox)\ **Post date:** [December 9, 2021, 8:39am UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/18 "2021-12-09T08:39:29Z")
So I found the time for additional tests. Each client uses client v.3.4.0, Server is NC Hub2 Yes, i set up HPB. According to the stats command it is working. Having a bulk of 9000 small files (each \< 10kb) I noticed that upload is done in chunks of 100 files each. The next computer, which has to download the files receives them NOT in bulk. Each file is downloaded seperately. ---
**Author:** ![szaimen](https://help.nextcloud.com/user_avatar/help.nextcloud.com/szaimen/32/63019_2.png) [@szaimen](https://help.nextcloud.com/u/szaimen)\ **Post date:** [December 9, 2021, 8:51am UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/19 "2021-12-09T08:51:30Z")
> [@maddox](#): > > The next computer, which has to download the files receives them NOT in bulk. Each file is downloaded seperately. This is expected. See [Bulk upload Ā· Issue #3657 Ā· nextcloud/desktop Ā· GitHub](https://github.com/nextcloud/desktop/issues/3657#issuecomment-909069066) ---
**Author:** ![danger89](https://help.nextcloud.com/user_avatar/help.nextcloud.com/danger89/32/67378_2.png) [@danger89](https://help.nextcloud.com/u/danger89)\ **Post date:** [February 2, 2023, 12:50am UTC](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174/20 "2023-02-02T00:50:12Z")
(sorry for the late reply) I did notice better upload performance during the past year. Lot of changes are most likely made in that area in the meanwhile. Iā€™m also unsure why the web interface upload could be any slower. Since the difference now seems to be minimal, I donā€™t think itā€™s worth running performance tests anymore. **Orā€¦ maybe we still should?** My Nextcloud server (v25.0.3) runs on a beefy machine. Currently running PHP 8.1 (fpm) with [tweaked PHP configs](https://gitlab.melroy.org/-/snippets/91) (applied all production settings you can think of) and Nginx reverse proxy (also running with [production config](https://gitlab.melroy.org/-/snippets/87)). I think the biggest performance improvement was maybe configuring MySQL (MariaDB) with [production configs](https://gitlab.melroy.org/-/snippets/92). Which is [also explained in your docs](https://docs.nextcloud.com/server/latest/admin_manual/configuration_database/linux_database_configuration.html) as well as updating the `20-mysqli.ini` file at the PHP side. [Next page](https://help.nextcloud.com/t/nextcloud-sync-2-0-brings-10x-faster-syncing/123174.md?page=2)