High Memory Load from Client with high Access Requests (Apache Access Log)

ℹ️ Support
,
1

Nextcloud version (eg, 12.0.2): 16.0.5
Operating system and version (eg, Ubuntu 17.04): Ubuntu 16.04.6
Apache or nginx version (eg, Apache 2.4.25): Apache/2.4.41
PHP version (eg, 7.1): php-fpm-7.1

The issue you are facing:

I have a very high load of memory usage cause of 2 Clients which are accessing the cloud with the nextcloud client very often.

I have multiple Nextclouds on this server but only facing the problem with two clients (different IPs).

My other Nextclouds on this server and the other customer with clients don’t produce this amount of accesses.

I am using the newest version of this client. Is there maybe a configuration that is forcing so many requests so that my memory gets on high load ?

For Example:

CUSTOMERSERVER - - [01/Oct/2019:14:22:20 +0200] "PROPFIND /remote.php/dav/files/backup/ HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:22 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:27 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:32 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 828 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:37 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:42 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:47 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:52 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:52 +0200] "PROPFIND /remote.php/dav/files/backup/ HTTP/2.0" 207 423 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:22:57 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:02 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:07 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:12 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:17 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:22 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:24 +0200] "PROPFIND /remote.php/dav/files/backup/ HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:27 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:32 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:37 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:42 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:47 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:52 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:56 +0200] "PROPFIND /remote.php/dav/files/backup/ HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:23:57 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:02 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:07 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:12 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:17 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:22 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:27 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:28 +0200] "PROPFIND /remote.php/dav/files/backup/ HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:32 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:37 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:42 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"
CUSTOMERSERVER - - [01/Oct/2019:14:24:47 +0200] "PROPFIND /remote.php/dav/files/backup/Backups/CUSTOMER HTTP/2.0" 207 446 "-" "Mozilla/5.0 (Windows) mirall/2.6.0stable-Win64 (build 20190927) (Nextcloud)"

Is this the first time you’ve seen this error? (Y/N): Y

Steps to replicate it:

  1. Install Clint on PC
  2. Watch Access Log
2

I have exactly the same problem with Nextcloud 17 and Client 2.6.0 !

172.17.0.2 - - [07/Oct/2019:08:43:46 +0200] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/1.1" 200 817 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36"
172.17.0.2 - - [07/Oct/2019:08:43:34 +0200] "GET /apps/logreader/poll?lastReqId=lXXfGaulbEHhxGa5Tmyr HTTP/1.1" 200 704 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36"
172.17.0.2 - - [07/Oct/2019:08:43:54 +0200] "GET /apps/logreader/poll?lastReqId=lXXfGaulbEHhxGa5Tmyr HTTP/1.1" 200 704 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36"
172.17.0.2 - - [07/Oct/2019:08:43:54 +0200] "GET /apps/logreader/poll?lastReqId=lXXfGaulbEHhxGa5Tmyr HTTP/1.1" 200 704 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36"
172.17.0.2 - - [07/Oct/2019:08:44:16 +0200] "GET /ocs/v2.php/apps/notifications/api/v2/notifications HTTP/1.1" 200 817 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36"
172.17.0.2 - - [07/Oct/2019:08:44:14 +0200] "GET /apps/logreader/poll?lastReqId=lXXfGaulbEHhxGa5Tmyr HTTP/1.1" 200 704 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.90 Safari/537.36"
3

Is it high memory load on the php process or the database/other process? Have these users more files/folders than the other ones?

4

Hi, sorry for the late reply, but that week killed me…

The User who has the problem has got only one Folder.

I’m doing a database backup and this is going into a backupfolder which is synchronizing with the cloud.

The interesting thing for me is, that it just affects my users with a Nextcloud Client under windows.

But more interesting is the fact, that it is showing Every 5seconds an access in the Apache Access log.
So why is it looking every 5 seconds ? Like exactly 5seconds ?

5

That sounds strange. I’d suggest to file a bug report for the client: Issues · nextcloud/desktop · GitHub (perhaps you can check that it is still the case for the current version 2.6.0, I couldn’t find a changelog for it to see if it was fixed)

6

Thank you for your answer, I did a issue now:

7

Could you figure out what it was ?

8

Problem temporary solved: