Forum performance: still a problem?

and whatā€™s your geographical location and are you using vpn?

Hey sorry for the delay, UK and no VPN used to visit here

1 Like

Heads up with these curl tests: be sure to include the --compressed flag. Donā€™t do what I did and leave it out! It makes a huge difference in timings. The main Discourse Javascript resource can be 3MB uncompressed and 540KB compressed. For me thatā€™s 5min vs 1min to download at 10KB/s. And yeah, 10KB/s is still mysteriously slow, but at least compressing traffic will give us more accurate single-file download speed tests.

I just texted ~100 nerds in couple chats asking them to try this curl test from different networks:

curl --compressed -o /dev/null https://help.nextcloud.com/assets/discourse-12a807403b8f23c14a92099c4e078ddbbac432d1409edb731c4150ac17a7d55d.js

Most of them got fast downloads, say, less than 2sec to get the Discourse Javascript file. A couple of them, (also on Lumen/Centurylink fiber!) reported very slow download speeds: ~12KB/s, for a total of around a minute to download that ~.5MB file. But another person (also on lumen/centurylink fiber) reported normal/fast download speed (sub-second), so I donā€™t have a 100% repro.

Others also reported that one hop in the traceroute was also dropping 90% or more packets. The IP address is 4.68.38.173 and apparently it is owned by Level 3 (which is owned by Lumen/CenturyLink). No idea if that is related.

One of the chats is called ā€œSeattle Matrixā€, in case anyone is curious and wants to join.

I have had a problem for quite some time.
If a havenā€™t connected to the forum URL for a week or so when I try I have the 5 color dots for at least 45 seconds.

Then once that has happened its ok opening more tabs.
Thanks

I think there is a problem with first load of the website (no cache, no cookie). In my case i must load e.g. 28 Javascript files with 25 MB of data. I think that is not only a problem of Discourse because other Discourse e.g. OpenStreetMap Community are much smaller with better performance. Maybe someone like to comare both Discourse installations (files and filesize). Oh yes. And everything that is not Discourse should be thrown out.

1 Like

I just ran this on a small post.

https://www.webpagetest.org/result/230223_AiDc2F_5KY/

A NC server login page is about 14 mb?

At some free advise. I have used this site on and off for 15 years. https://www.webpagetest.org/result/230223_AiDc2F_5KY/1/experiments/#Usable

1 Like

Im currently crawling this forum with Yacy and its slow. I have set yacy not to load images plus a bunch of other file extensions. eg ISO,gz.etc.

The text is in my search engine I have just seen its raw html code.

I have added a Pic because the forum translates it,

.jpeg 2x' data-dominant-color='D3EBF8'></a></div><p></p> <p><a href='https://help.nextcloud.com/t/sync-tool-osx-and-performance-owncube/152029/3'>Read full topic</a></p>
#### [Sync tool OSX and performance [owncube]](https://help.nextcloud.com/t/sync-tool-osx-and-performance-owncube/152029/3)

[![bookmark|11x11](http://localhost:8090/env/grafics/empty.gif "bookmark")](http://localhost:8090/yacysearch.html?query=performance&maximumRecords=100&resource=local&verify=ifexist&prefermaskfilter=&cat=href&constraint=&contentdom=text&strictContentDom=false&meanCount=5&former=performance&auth&startRecord=0&bookmarkurl=b%7CaHR0cHM6Ly9oZWxwLm5leHRjbG91ZC5jb20vdC9zeW5jLXRvb2wtb3N4LWFuZC1wZXJmb3JtYW5jZS1vd25jdWJlLzE1MjAyOS8z&bookmarkref=kiWSNexFffU5)[![recommend|11x11](http://localhost:8090/env/grafics/empty.gif "recommend")](http://localhost:8090/yacysearch.html?query=performance&maximumRecords=100&resource=local&verify=ifexist&prefermaskfilter=&cat=href&constraint=&contentdom=text&strictContentDom=false&meanCount=5&former=performance&auth&startRecord=0&recommendref=kiWSNexFffU5)[![delete|11x11](http://localhost:8090/env/grafics/empty.gif "delete")](http://localhost:8090/yacysearch.html?query=performance&maximumRecords=100&resource=local&verify=ifexist&prefermaskfilter=&cat=href&constraint=&contentdom=text&strictContentDom=false&meanCount=5&former=performance&auth&startRecord=0&deleteref=kiWSNexFffU5)[![blacklist host|11x11](http://localhost:8090/env/grafics/empty.gif "blacklist host")](http://localhost:8090/yacysearch.html?query=performance&maximumRecords=100&resource=local&verify=ifexist&prefermaskfilter=&cat=href&constraint=&contentdom=text&strictContentDom=false&meanCount=5&former=performance&auth&startRecord=0&blacklisturl=b%7CaHR0cHM6Ly9oZWxwLm5leHRjbG91ZC5jb20vdC9zeW5jLXRvb2wtb3N4LWFuZC1wZXJmb3JtYW5jZS1vd25jdWJlLzE1MjAyOS8z)

https://help.nextcloud.com/t/sync-tool-osx-and-performance-owncube/152029/3

.jpeg 2x' data-dominant-color='D3EBF8'></a></div><p></p> <p><a href='https://help.nextcloud.com/t/sync-tool-osx-and-**performance**-owncube/152029/3'>Read full topic</a></p>

Mon, 19 Dec 2022 | [Citations](http://localhost:8090/api/citation.html?hash=kiWSNexFffU5&filter=true) | [![Browse index|15x8](http://localhost:8090/env/grafics/minitree.png "Browse index")](http://localhost:8090/IndexBrowser_p.html?path=https://help.nextcloud.com/t/sync-tool-osx-and-performance-owncube/152029/3)

I am not sure whatā€™s going on.
Todays posts are fine. The other discourse forums have the same problem.
I will post on the yacy forum or raise at github issue.

Images load time on the forum at ~10 kb/s, 5.1 seconds for png. optimized. 55kb

100%[==================================>] 346.59K 10.0KB/s in 33s
The result of the pic above.

Sorry only 5 MB for https://help.nextcloud.com (mostly Javascript).
And here 40 errors in the website.
One error 404: Wordpress Fonts from Nextcloud in Discourse? I do not see the need.

Looks like your site has iframe sort of errors. I am not really sure too sure.

But if you open the page in chrome or firefox and hit ctrl + shift + j you will see the errors on that page.

That was how I found a way to set my local web server as a back end/front end???
I had similar problems with my piholes to put in a page in an iframe on another server.

It could be that we are talking past each other. Itā€™s not about a web server or Nextcloud of mine, but about the forum here.

With ctrl + shift + j i get much less errors. But the errors does not really help.

Yes the problem I have here with this forum.

These are the DNS requests asked when I use wget to the URL you supplied. From my local Pihole.


2023-02-23 18:52:18 	A	www.nextcloud.com	192.168.1.20	OK (answered by 8.8.8.8#53)	IP (349.1ms)

|2023-02-23 19:35:04 |AAAA|help.nextcloud.com|192.168.1.20|OK (answered by 8.8.8.8#53)|IP (66.2ms)||
|---|---|---|---|---|---|---|
|2023-02-23 19:35:04 |A|help.nextcloud.com|192.168.1.20|OK (cache)|IP (0.2ms)||
|2023-02-23 19:35:04 |A|help.nextcloud.com|192.168.1.20|OK (cache)|IP (0.2ms)||
|2023-02-23 19:31:35 |A|**stats.nextcloud.com|192.168.1.20|Blocked (gravity)|IP** (0.4ms)||
|2023-02-23 19:31:25 |A|nextcloud.com|192.168.1.20|OK (answered by 8.8.8.8#53)|IP (66.7ms)||
|2023-02-23 19:31:25 |A|help.nextcloud.com|192.168.1.20|OK (cache)|IP (0.3ms)||

stats subdomain being blocked, not sure of the effects of this.

The output of wget, there is a 2 second delay before any data is given. I am not sure about this operation in a web server environment.


root@Nextcloud-ASUS:~# wget help.nextcloud.com
URL transformed to HTTPS due to an HSTS policy
--2023-02-23 19:33:19--  https://help.nextcloud.com/
Resolving help.nextcloud.com (help.nextcloud.com)... 95.217.53.158, 2a01:4f9:2b:29dc::146
Connecting to help.nextcloud.com (help.nextcloud.com)|95.217.53.158|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/html]
Saving to: ā€˜index.html.1ā€™

index.html.1                 [  <=>                              ]  22.04K  68.5KB/s    in 0.3s

There is a problem with the html code on some posts and in other discourse forums.

Output of the current crawler at a depth of 7 activity. contact yacy for more infoā€¦

Will you try this?

curl --compressed -o /dev/null https://help.nextcloud.com/assets/discourse-fa0bebf654588c3e45c7d642211b1a3a7f39649c44fec50bcbf3317afdb6b976.js

Thatā€™s one example of a forum Javascript file that takes some people a second or two to download. For me it takes ~45 seconds.

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  508k  100  508k    0     0  11257      0  0:00:46  0:00:46 --:--:-- 14792

Whatever you are willing to share about your physical location and ISP would be helpful, just maybe use approximate values for privacy.

Is the /e/ OS forum fast for you? https://community.e.foundation/

You can try a similar download test with theirs:

curl --compressed -o /dev/null https://community.e.foundation/assets/application-f58e2fca790bb4e9478185ad73807d2e.js

Hereā€™s my result:

  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  448k  100  448k    0     0   314k      0  0:00:01  0:00:01 --:--:--  314k

I think it is a problem with the webserver or at Hetzner. The second file is so fast that i do not get a time. First file 10 seconds, screenshot above from me was 25 seconds. I think the factor is 10+ between the second to the first file.

curl --compressed -o /dev/null https://help.nextcloud.com/assets/discourse-fa0bebf654588c3e45c7d642211b1a3a7f39649c44fec50bcbf3317afdb6b976.js
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  508k  100  508k    0     0  48980      0  0:00:10  0:00:10 --:--:-- 55733
curl --compressed -o /dev/null https://community.e.foundation/assets/application-f58e2fca790bb4e9478185ad73807d2e.js
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  448k  100  448k    0     0   728k      0 --:--:-- --:--:-- --:--:--  727k

Traceroute https://help.nextcloud.com

 6  decix-gw.hetzner.com (80.81.192.164)  37.915 ms  15.303 ms  20.653 ms
 7  core8.fra.hetzner.com (213.239.252.9)  21.927 ms  22.074 ms  23.819 ms
 8  core31.hel1.hetzner.com (213.239.224.165)  50.814 ms core32.hel1.hetzner.com (213.239.224.154)  46.084 ms core31.hel1.hetzner.com (213.239.224.165)  51.064 ms
 9  ex9k2.dc2.hel1.hetzner.com (213.239.224.142)  43.435 ms  47.972 ms  49.941 ms
10  s5.nextcloud.com (95.216.247.163)  45.575 ms  46.509 ms  46.676 ms
11  help.nextcloud.com (95.217.53.158)  48.820 ms  37.774 ms  39.122 ms

Traceroute https://community.e.foundation

 6  decix-gw.hetzner.com (80.81.192.164)  38.210 ms  15.451 ms  16.291 ms
 7  core24.fsn1.hetzner.com (213.239.224.81)  25.743 ms  26.341 ms  26.399 ms
 8  spine3.cloud2.fsn1.hetzner.com (213.239.239.134)  27.886 ms spine4.cloud2.fsn1.hetzner.com (213.239.239.138)  26.571 ms spine1.cloud2.fsn1.hetzner.com (213.239.239.126)  27.904 ms
 9  et-2.16.rs3k8.rz4.hetzner.de (213.239.239.90)  39.467 ms et-1.16.rs3k9.rz4.hetzner.de (213.239.239.82)  44.309 ms 213-239-239-78.clients.your-server.de (213.239.239.78)  44.462 ms
10  * * *
11  22718.your-cloud.host (162.55.117.137)  23.886 ms  24.759 ms  24.949 ms
12  * * *
13  * * *

That could be a DNS issue? or not enough ports available? or concurrent DNS lookups limit error reached at the forums end. we canā€™t load test it for that just but just a single once off test should be okā€¦

There is 2 public hosts down for the A record.

4 Down

This in mineā€¦did a few tries then the A record resolved it up correctly.
I have used this site for my free domain services for Many years. I speeds up DNS propagation.





Its a post from Jan 19 2019 and there is no email notification.
I only start receiving nextcloud system emails Aug 2019.
Not sure if I cleaned it out 5 years ago.

There  was a post reply yesterday. I got a email but not in the webpage portal.


last visit
tflidd)Community leader

[Jan '19]facebook-buy-sell-swap-complaining-of-mp4-video-having-virus-or-malware/45554/2?u=smokingwheels)

trace to help. nextcloud .com
hetzner is ok.
My ip is in the us I forgot exact locationā€¦

 6  143.244.224.213 (143.244.224.213)  2.300 ms 143.244.224.209 (143.244.224.209)  0.602 ms 143.244.224.213 (143.244.224.213)  0.552 ms
 7  * * *
 8  mei-b5-link.ip.twelve99.net (62.115.116.196)  164.820 ms mei-b4-link.ip.twelve99.net (62.115.143.22)  171.210 ms mei-b5-link.ip.twelve99.net (62.115.116.196)  164.783 ms

I have issues with the domain nextcloud . com in yacy.
indexed crawler errors
11821 / 0/ 10964 URLs
Trace route to nextcloud . com (donā€™t want to upset robotā€¦)
The result is over 2 .5 seconds from the US.
Not sure if it is normal or not.

7  snge-b5-link.ip.twelve99.net (80.239.132.150)  1.383 ms snge-b5-link.ip.twelve99.net (80.239.132.212)  1.337 ms *
 8  mei-b4-link.ip.twelve99.net (62.115.143.22)  209.287 ms mei-b5-link.ip.twelve99.net (62.115.116.196)  164.606 ms mei-b5-link.ip.twelve99.net (62.115.112.218)  160.827 ms
 9  ffm-bb1-link.ip.twelve99.net (62.115.116.20)  169.303 ms ffm-bb1-link.ip.twelve99.net (62.115.124.58)  153.380 ms  153.371 ms
10  s-bb2-link.ip.twelve99.net (62.115.138.104)  217.989 ms s-bb1-link.ip.twelve99.net (62.115.143.28)  201.313 ms s-bb2-link.ip.twelve99.net (62.115.138.104)  196.238 ms
11  hls-b3-link.ip.twelve99.net (62.115.122.35)  196.348 ms hls-b3-link.ip.twelve99.net (62.115.122.33)  218.666 ms hls-b4-link.ip.twelve99.net (62.115.123.203)  211.031 ms
12  hetzner-svc076536-ic365572.ip.twelve99-cust.net (62.115.52.255)  206.348 ms hetzner-svc067711-ic351605.ip.twelve99-cust.net (62.115.183.185)  208.283 ms hetzner-svc076536-ic365572.ip.twelve99-cust.net (62.115.52.255)  205.191 ms
13  core32.hel1.hetzner.com (213.239.203.209)  204.868 ms  200.037 ms core31.hel1.hetzner.com (213.239.203.205)  188.807 ms
14  ex9k2.dc2.hel1.hetzner.com (213.239.224.142)  218.222 ms ex9k2.dc2.hel.hetzner.com (213.239.224.146)  212.353 ms ex9k2.dc2.hel1.hetzner.com (213.239.224.142)  208.813 ms
15  s5.nextcloud.com (95.216.247.163)  208.019 ms  214.789 ms  194.436 ms
16  nextcloud.com (95.217.53.155)  211.666 ms  205.251 ms  203.011 ms

Hop 12

Its possibly a load balancer or firewall or NAT.
Extra routes to the destination is what I have seen so far.

A different problem the preview vertical sync is growing more out of place the longer it getsā€¦each time I add length.

Here is an update on the forum, which has received a lot of backend work. Please check if you still are having connectivity issues. Thanks.