*.Nextcloud.com - connectivity issues

Looks like the bandwidth is limited if too many request. I just downloaded the latest release with decent speed.

2020-09-09 14:11:43 (13,5 MB/s) - ‘nextcloud-19.0.2.zip.1’ saved [120824125/120824125]

The problem is that there are about 50.000 other people doing the very same thing at the same time continuously over the day, and thus our download server is maxed out. We’ll look into a CDN solution, but that will take a bit of time…

4 Likes

I totally understand that, hence I was mentioning the growth of people using Nextcloud, which is a good thing as it becomes even more popular. That’s the reason I mentioned the introduction of mirroring or direct downloads from GitHub.

It was never my intention to blame anyone for this situation and I do apologize, if it came across like that in any of my posts.

A CDN solution sounds good, looking forward to that and if it takes some time, so be it :+1:

You guys are doing a great job with Nextcloud!

2 Likes

Thanks, CFelix, for the kind words!

2 Likes

Good morning,

Today the same problem.
With installer script I try to install the current version.
Download speed at about 100 kb.
With wget on different servers i have pretty much the same result.
Most users run into a timeout with standard Maximum PHP script run time.
Therefore an installation is not possible.

run into a timeout with standard Maximum PHP script run time

For me the problem is also noticeable with the update script (the download server is the same). For this reason I delay every Nextcloud update for 1-2 week as long as no security update is necessary. This is not nice, but as a user I see no other possibility as long as I want to work with the official updater. I assume that Nextcloud is working on the problem.

HugoOps to Nextcloud :heart:

How about to setup an official tracker and distribute it also via torrents as e.g. Ubuntu did? Would be nice backup channel.

and distribute it also via torrents

For updates with the official script this would not help. See: Possibility to use a local Mirror · Issue #291 · nextcloud/updater · GitHub

My suggestion: Mooorree Download Servers and round robin via DNS. Or a CDN.

For me, nextcloud.com is down, the site is not loading at all

1 Like

@jospoortvliet mentioned above, that they are looking into a CDN solution but it will take some time. At the moment we have to live with the current situation and make the best out of it, even if that is not the answer people are looking for :wink:

and make the best out of it

I already do, see: *.Nextcloud.com - connectivity issues - #52 by mritzmann :wink:

Okay, here’s an out of scope idea. With an installed base of millions, show a one time popup on the next update asking for help (this would be exposed in the settings as well for later opt-in). The request would be to set aside, say, 500MB of space for an Updates folder to be shared with others, and the owner could set a maximum number of downloads (e.g., 10, 100, unlimited). Fresh updates are fetched via cronjob that checks 3 volunteer servers before defaulting to the root server, in case one of them has already fetched it. The hash of the downloaded file is checked from the root before the upgrade is made available to others.

When the automatic update function is called, it randomly tries 3 volunteer servers in the current list before falling back to the root server.

Instant volunteer CDN.

Even if you put it before to update to your dowload folder?

Downloading: downloads the code in the version it should update to. This is also shown in the web UI before the update is started. This archive is downloaded to /updater-INSTANCEID/downloads/ .

I strongly believe if you download archive manually e.g. via torrents and put it into downloads folder, the automatic updater will simply skip this step and proceed to “Extracting” step. Maybe it will calculate some checksum before

No :frowning: (updater/lib/Updater.php at a4a3248d541fb82f3c9f8f9bf0774c1b70324ab3 · nextcloud/updater · GitHub)

But sounds like a good enhancement.

1 Like

There are existing repos for open source software (https://www.gnu.org/server/mirror.html), either use one of them or set up something similar. Setting up a similar mirror with rsync shouldn’t be a that difficult either.

Yeah, I also checked it after post and was laughing on my broken expectations: ->recursiveDelete :smiley: could be verifyIntegrity instead.

But sounds like a good enhancement

I still think this should be the besser enhancement: Possibility to use a local Mirror · Issue #291 · nextcloud/updater · GitHub

The result is the same, but in beautiful :slight_smile:

@mritzmann
You can also download the newest version of nextcloud from another source and then copy it to “nc.zip”
Read /setup-nextcloud.php says it has succeeded but it hasn't installed anything - #2 by devnull

The problem: there is no mirror

How it works with updater? Seems its removing file if presented.

I don’t think so. I care about updates with updater.phar not about new installations. And there’ s no nc.zip in the code. This is the reason why I created this issue.