Call for testing: db tunning for NCP

ℹ️ Support 📦 Appliances (Docker, Snappy, VM, NCP, AIO)
1

Hi all,

Since NCP runs in different devices and platforms, I would like to improve the auto-tunning of the database. In order to do this, it would be great to have some “on the field” data

*** THIS WON’T CHANGE YOUR DATABASE, ITS JUST ANALYTICS ***

If you would like to help, please do the following

sudo apt-get update
sudo apt-get install python3-pymysql python3-psutil python3-tabulate
wget https://raw.githubusercontent.com/nextcloud/nextcloudpi/db_tunning/db_tunning.py
sudo python3 db_tunning.py

and share your results!

Here are mine as a reference (Odroid HC2)

╒═══════════════════════════╤════════════════════════╕
│ Parameter                 │ Value -> Recommended   │
╞═══════════════════════════╪════════════════════════╡
│ System RAM                │ 1.95G                  │
├───────────────────────────┼────────────────────────┤
│ DB dedicated RAM          │ 499.23M -> 1.15G       │
├───────────────────────────┼────────────────────────┤
│ Current Data Usage        │ 1.04G                  │
├───────────────────────────┼────────────────────────┤
│ Memory usage %            │ 188.31%                │
├───────────────────────────┼────────────────────────┤
│ Temp tables in RAM %      │ 65.07% -> 25%          │
├───────────────────────────┼────────────────────────┤
│ Innodb buffer pool size   │ 512.00M -> 1.04G       │
├───────────────────────────┼────────────────────────┤
│ Innodb log file size      │ 32.00M -> 64.00M       │
├───────────────────────────┼────────────────────────┤
│ Max heap/tmp table size   │ 64.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max memory usage          │ 940.12M                │
├───────────────────────────┼────────────────────────┤
│ Max possible memory usage │ 3.51G                  │
╘═══════════════════════════╧════════════════════════╛

Note: this is highly experimental, so don’t worry about anything you see in the output.

Note: we need real data, don’t share unless you have been running your instance normally without restarting the database for at least a week.

Thanks!

2

Screenshot 2021-10-21 at 22.24.00
Uptime: 20:23:14 up 15 days, 1:48, 0 users, load average: 0.78, 0.94, 0.98

1 Like
3

Here are my results

Screenshot 2021-10-21 at 22.58.32

Uptime 4 days, 19:08
Raspberry Pi 4 4GB, 64-bit

1 Like
4

params

odroid HC4, uptime 111 days,

1 Like
5

photo5418356562986121115

Other info:

Linux nextcloudpi 5.10.63-v8+ #1459 SMP PREEMPT Wed Oct 6 16:42:49 BST 2021 aarch64 GNU/Linux
@nextcloudpi vie oct 22 08:52:28 BST 2021
Raspberry Pi 4 Model B Rev 1.1

NextCloudPi version|v1.41.12|
NextCloudPi image|NextCloudPi_11-27-20|
OS|Debian GNU/Linux 10. 5.10.63-v8+ (aarch64)|

1 Like
6 
# python3 db_tunning.py
╒═══════════════════════════╤════════════════════════╕
│ Parameter                 │ Value -> Recommended   │
╞═══════════════════════════╪════════════════════════╡
│ System RAM                │ 3.85G                  │
├───────────────────────────┼────────────────────────┤
│ DB dedicated RAM          │ 986.68M -> 2.03G       │
├───────────────────────────┼────────────────────────┤
│ Current Data Usage        │ 35.02M                 │
├───────────────────────────┼────────────────────────┤
│ Memory usage %            │ 168.21%                │
├───────────────────────────┼────────────────────────┤
│ Temp tables in RAM %      │ 55.98% -> 25%          │
├───────────────────────────┼────────────────────────┤
│ Innodb buffer pool size   │ 1.00G -> 35.02M        │
├───────────────────────────┼────────────────────────┤
│ Innodb log file size      │ 32.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max heap/tmp table size   │ 64.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max memory usage          │ 1.62G                  │
├───────────────────────────┼────────────────────────┤
│ Max possible memory usage │ 4.13G                  │
╘═══════════════════════════╧════════════════════════╛

# uptime
11:32:15 up 11 days,  7:32,  1 user,  load average: 0.01, 0.03, 0.00

# uname -a
Linux nextcloudpi 4.19.0-18-amd64 #1 SMP Debian 4.19.208-1 (2021-09-29) x86_64 GNU/Linux

Running Nextcloudpi in a VM on Proxmox.

7 
╒═══════════════════════════╤════════════════════════╕
│ Parameter                 │ Value -> Recommended   │
╞═══════════════════════════╪════════════════════════╡
│ System RAM                │ 15.33G                 │
├───────────────────────────┼────────────────────────┤
│ DB dedicated RAM          │ 3.83G -> 5.46G         │
├───────────────────────────┼────────────────────────┤
│ Current Data Usage        │ 175.12M                │
├───────────────────────────┼────────────────────────┤
│ Memory usage %            │ 113.91%                │
├───────────────────────────┼────────────────────────┤
│ Temp tables in RAM %      │ 65.51% -> 25%          │
├───────────────────────────┼────────────────────────┤
│ Innodb buffer pool size   │ 3.88G -> 175.12M       │
├───────────────────────────┼────────────────────────┤
│ Innodb log file size      │ 32.00M -> 496.00M      │
├───────────────────────────┼────────────────────────┤
│ Max heap/tmp table size   │ 64.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max memory usage          │ 4.37G                  │
├───────────────────────────┼────────────────────────┤
│ Max possible memory usage │ 7.01G                  │
╘═══════════════════════════╧════════════════════════╛

EDIT: Bonus info
11 days uptime,
Debian 4.19.208-1,
around 173k files, 22k folders (18 GB),
1 user, ~4 machines

8

╒═══════════════════════════╤══════════════════════╕
│ Parameter │ Value → Recommended │
╞═══════════════════════════╪══════════════════════╡
│ System RAM │ 1.92G │
├───────────────────────────┼──────────────────────┤
│ DB dedicated RAM │ 491.44M → 1.38G │
├───────────────────────────┼──────────────────────┤
│ Current Data Usage │ 34.73M │
├───────────────────────────┼──────────────────────┤
│ Memory usage % │ 229.68% ├───────────────────────────┼──────────────────────┤
│ Temp tables in RAM % │ 51.00% → 25% │
├───────────────────────────┼──────────────────────┤
│ Innodb buffer pool size │ 512.00M → 34.73M │
├───────────────────────────┼──────────────────────┤
│ Innodb log file size │ 32.00M → 64.00M │
├───────────────────────────┼──────────────────────┤
│ Max heap/tmp table size │ 64.00M → 128.00M │
├───────────────────────────┼──────────────────────┤
│ Max memory usage │ 1.10G │
├───────────────────────────┼──────────────────────┤
│ Max possible memory usage │ 3.63G ╘═══════════════════════════╧══════════════════════╛

9

Bildschirmfoto vom 2021-10-24 18-01-50

Pi 4 4GB, 32-bit
Uptime: ca. 20 days

10

Glad if I can help:

╒═══════════════════════════╤════════════════════════╕
│ Parameter                 │ Value -> Recommended   │
╞═══════════════════════════╪════════════════════════╡
│ System RAM                │ 3.71G                  │
├───────────────────────────┼────────────────────────┤
│ DB dedicated RAM          │ 948.76M -> 1.86G       │
├───────────────────────────┼────────────────────────┤
│ Current Data Usage        │ 312.31M                │
├───────────────────────────┼────────────────────────┤
│ Memory usage %            │ 160.98%                │
├───────────────────────────┼────────────────────────┤
│ Temp tables in RAM %      │ 42.15% -> 25%          │
├───────────────────────────┼────────────────────────┤
│ Innodb buffer pool size   │ 1.00G -> 312.31M       │
├───────────────────────────┼────────────────────────┤
│ Innodb log file size      │ 32.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max heap/tmp table size   │ 64.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max memory usage          │ 1.49G                  │
├───────────────────────────┼────────────────────────┤
│ Max possible memory usage │ 4.13G                  │
╘═══════════════════════════╧════════════════════════╛

nc-info:

NextCloudPi version  v1.42.2
NextCloudPi image    NextCloudPi_11-27-20
OS                   Debian GNU/Linux 10. 5.10.63-v8+ (aarch64)
automount            yes
USB devices          sda sdb 
datadir              /media/myCloudDrive/ncdata
data in SD           no
data filesystem      btrfs
data disk usage      1.3T/4.6T
rootfs usage         3.5G/29G
swapfile             /var/swap
dbdir                /var/lib/mysql
Nextcloud check      ok
Nextcloud version    21.0.4.1
...
uptime               8days

All of that on a RPi 4 4Gb

11

Bildschirmfoto 2021-10-24 um 19.02.10

12

╒═══════════════════════════╤════════════════════════╕
│ Parameter │ Value → Recommended │
╞═══════════════════════════╪════════════════════════╡
│ System RAM │ 3.80G │
├───────────────────────────┼────────────────────────┤
│ DB dedicated RAM │ 972.07M → 1.96G │
├───────────────────────────┼────────────────────────┤
│ Current Data Usage │ 180.48M │
├───────────────────────────┼────────────────────────┤
│ Memory usage % │ 164.90% │
├───────────────────────────┼────────────────────────┤
│ Temp tables in RAM % │ 97.56% → 25% │
├───────────────────────────┼────────────────────────┤
│ Innodb buffer pool size │ 1.00G → 180.48M │
├───────────────────────────┼────────────────────────┤
│ Innodb log file size │ 32.00M → 128.00M │
├───────────────────────────┼────────────────────────┤
│ Max heap/tmp table size │ 64.00M → 128.00M │
├───────────────────────────┼────────────────────────┤
│ Max memory usage │ 1.57G │
├───────────────────────────┼────────────────────────┤
│ Max possible memory usage │ 4.13G │
╘═══════════════════════════╧════════════════════════╛

13

ODROID-HC1, uptime : 92 days

db_tunning.py:
db_tunning_result

nc-info:

NextCloudPi version  v1.42.2
NextCloudPi image    NextCloudPi_01-12-19
OS                   Debian GNU/Linux 10. 4.14.150-odroidxu4 (armv7l)
automount            yes
USB devices          sda
datadir              /media/USBdrive/ncdata
data in SD           no
data filesystem      btrfs
data disk usage      299G/466G
rootfs usage         4.6G/7.2G
swapfile             /var/swap
dbdir                /var/lib/mysql
Nextcloud check      ok
Nextcloud version    21.0.4.1
. . .
uptime               92days
14

Database Tuning

Here’s some real data from my RPi 4B device, output is from running the python script and I also fetched some system information from various places. Hopefully at least some of it is of use

Output

╒═══════════════════════════╤════════════════════════╕
│ Parameter                 │ Value -> Recommended   │
╞═══════════════════════════╪════════════════════════╡
│ System RAM                │ 3.71G                  │
├───────────────────────────┼────────────────────────┤
│ DB dedicated RAM          │ 948.76M -> 1.96G       │
├───────────────────────────┼────────────────────────┤
│ Current Data Usage        │ 105.30M                │
├───────────────────────────┼────────────────────────┤
│ Memory usage %            │ 168.95%                │
├───────────────────────────┼────────────────────────┤
│ Temp tables in RAM %      │ 32.66% -> 25%          │
├───────────────────────────┼────────────────────────┤
│ Innodb buffer pool size   │ 1.00G -> 105.30M       │
├───────────────────────────┼────────────────────────┤
│ Innodb log file size      │ 32.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max heap/tmp table size   │ 64.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max memory usage          │ 1.57G                  │
├───────────────────────────┼────────────────────────┤
│ Max possible memory usage │ 4.13G                  │
╘═══════════════════════════╧════════════════════════╛

sudo ncp-report

NextCloudPi diagnostics 
NextCloudPi version  v1.42.5
NextCloudPi image    NextCloudPi_10-08-21
OS                   Debian GNU/Linux 10. 5.10.63-v8+ (aarch64)
automount            yes
USB devices          sda 
datadir              /media/USBdrive/ncdata
data in SD           no
data filesystem      ext2/ext3
data disk usage      368G/3.5T
rootfs usage         2.6G/123G
swapfile             /media/USBdrive/swap
dbdir                /media/USBdrive/ncdatabase
Nextcloud check      ok
Nextcloud version    21.0.5.1
HTTPD service        up
PHP service          up
MariaDB service      up
Redis service        up
HPB service          up
Postfix service      up
internet check       ok
port check 80        closed
port check 443       open
IP                   ***REMOVED SENSITIVE VALUE***
gateway              ***REMOVED SENSITIVE VALUE***
interface            eth0
certificates         ***REMOVED SENSITIVE VALUE***
NAT loopback         no
uptime               11days
Nextcloud configuration 
{
    "system": {
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_domains": {
            "0": "localhost",
            "22": "hostname.local",
            "1": "RPi4-static-IP",
            "11": "**CENSORED**",
            "3": "my_domain_name"
        },
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "dbtype": "mysql",
        "version": "21.0.5.1",
        "overwrite.cli.url": "https:\/\/my.domain.name\/",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "mysql.utf8mb4": true,
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "installed": true,
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "memcache.local": "\\OC\\Memcache\\Redis",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 0,
            "timeout": 0,
            "password": "***REMOVED SENSITIVE VALUE***"
        },
        "tempdirectory": "\/media\/USBdrive\/ncdata\/tmp",
        "mail_smtpmode": "sendmail",
        "mail_smtpauthtype": "LOGIN",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "preview_max_x": "2048",
        "preview_max_y": "2048",
        "jpeg_quality": "60",
        "overwriteprotocol": "https",
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
        "maintenance": false,
        "logfile": "\/media\/USBdrive\/ncdata\/nextcloud.log",
        "loglevel": "2",
        "log_type": "file",
        "twofactor_enforced": "true",
        "twofactor_enforced_groups": [
            "Users",
            "admin"
        ],
        "twofactor_enforced_excluded_groups": [],
        "default_phone_region": "NL",
        "updater.secret": "***REMOVED SENSITIVE VALUE***",
        "theme": "",
        "app_install_overwrite": [
            "files_readmemd"
        ],
        "mail_sendmailmode": "smtp"
    }
}
HTTPd logs 
[Fri Oct 29 00:00:10.818611 2021] [mpm_event:notice] [pid 1102:tid 547619075456] AH00489: Apache/2.4.38 (Debian) OpenSSL/1.1.1d   configured -- resuming normal operations
[Fri Oct 29 00:00:10.818737 2021] [core:notice] [pid 1102:tid 547619075456] AH00094: Command line: '/usr/sbin/apache2'
Database logs
Nextcloud logs

<–! The logs are filled with errors from Share Permissions because I downloaded and enabled it earlier today but disabled it shortly after since it was filling the logs → 

{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:51+00:00","remoteAddr":"my_public_ip_adress","user":"admin","app":"filesystem","method":"GET","url":"/ocs/v2.php/apps/user_status/api/v1/user_status","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (Linux; Android 10) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Mobile Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:51+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/css/icons/icons-vars.css?v=1635441932","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:51+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/css/notes/737e-6b3e-global.css?v=d41d8cd98f00b204e9800998ecf8427e-8fda457b","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:52+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/css/core/412e-6b3e-server.css?v=d41d8cd98f00b204e9800998ecf8427e-8fda457b","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:52+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/css/settings/1980-6b3e-settings.css?v=d41d8cd98f00b204e9800998ecf8427e-8fda457b","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:52+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/css/text/070a-6b3e-icons.css?v=d41d8cd98f00b204e9800998ecf8427e-8fda457b","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:52+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/js/core/merged-template-prepend.js?v=8fda457b","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:52+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/apps/accessibility/img/logo/logo.svg?v=1","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:53+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/apps/external/icons/fct.svg?v=8fda457b","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:53+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/apps/external/icons/mona.svg?v=8fda457b","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:53+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/apps/external/icons/lbc.svg?v=8fda457b","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:53+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/index.php/apps/dashboard/","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:53+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"POST","url":"/index.php/apps/notify_push/pre_auth","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:53+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/ocs/v2.php/apps/notifications/api/v2/notifications","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:54+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"PUT","url":"/index.php/apps/user_status/heartbeat","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:54+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/ocs/v2.php/search/providers?from=%2Fsettings%2Fuser","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:26:54+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"filesystem","method":"GET","url":"/ocs/v2.php/apps/user_status/api/v1/user_status","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:27:00+00:00","remoteAddr":"my_public_ip_adress","user":"admin","app":"filesystem","method":"POST","url":"/index.php/settings/apps/disable","message":"Storage wrapper 'sharepermissions' was not registered via the 'OC_Filesystem - preSetup' hook which could cause potential problems.","userAgent":"Mozilla/5.0 (Linux; Android 10) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/94.0.4606.71 Mobile Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":2,"time":"2021-10-28T17:29:29+00:00","remoteAddr":"remote_users_public_ip","user":"user_2","app":"cms_pico","method":"POST","url":"/index.php/apps/cms_pico/personal/websites","message":{"Exception":"OCA\\CMSPico\\Exceptions\\WebsiteExistsException","Message":"","Code":0,"Trace":[{"file":"/var/www/nextcloud/apps/cms_pico/lib/Controller/WebsitesController.php","line":121,"function":"createWebsite","class":"OCA\\CMSPico\\Service\\WebsitesService","type":"->","args":[{"__class__":"OCA\\CMSPico\\Model\\Website"},"empty"]},{"file":"/var/www/nextcloud/lib/private/AppFramework/Http/Dispatcher.php","line":218,"function":"createPersonalWebsite","class":"OCA\\CMSPico\\Controller\\WebsitesController","type":"->","args":[{"name":"**CENSORED**","site":"**CENSORED**","theme":"default","template":"empty","path":"**CENSORED**"}]},{"file":"/var/www/nextcloud/lib/private/AppFramework/Http/Dispatcher.php","line":127,"function":"executeController","class":"OC\\AppFramework\\Http\\Dispatcher","type":"->","args":[{"__class__":"OCA\\CMSPico\\Controller\\WebsitesController"},"createPersonalWebsite"]},{"file":"/var/www/nextcloud/lib/private/AppFramework/App.php","line":157,"function":"dispatch","class":"OC\\AppFramework\\Http\\Dispatcher","type":"->","args":[{"__class__":"OCA\\CMSPico\\Controller\\WebsitesController"},"createPersonalWebsite"]},{"file":"/var/www/nextcloud/lib/private/Route/Router.php","line":302,"function":"main","class":"OC\\AppFramework\\App","type":"::","args":["OCA\\CMSPico\\Controller\\WebsitesController","createPersonalWebsite",{"__class__":"OC\\AppFramework\\DependencyInjection\\DIContainer"},{"_route":"cms_pico.Websites.createPersonalWebsite"}]},{"file":"/var/www/nextcloud/lib/base.php","line":993,"function":"match","class":"OC\\Route\\Router","type":"->","args":["/apps/cms_pico/personal/websites"]},{"file":"/var/www/nextcloud/index.php","line":37,"function":"handleRequest","class":"OC","type":"::","args":[]}],"File":"/var/www/nextcloud/apps/cms_pico/lib/Service/WebsitesService.php","Line":138,"CustomMessage":"--"},"userAgent":"Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.54 Safari/537.36","version":"21.0.5.1"}
{"reqId":"**CENSORED**","level":4,"time":"2021-10-28T19:28:49+00:00","remoteAddr":"my_public_ip_adress","user":"user_1","app":"webdav","method":"PROPFIND","url":"**CENSORED**","message":{"Exception":"OCA\\DAV\\Connector\\Sabre\\Exception\\InvalidPath","Message":"File name contains at least one invalid character","Code":0,"Trace":[{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Tree.php","line":78,"function":"getChild","class":"OCA\\DAV\\Connector\\Sabre\\Directory","type":"->","args":["**CENSORED**"]},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":971,"function":"getNodeForPath","class":"Sabre\\DAV\\Tree","type":"->","args":["PRIVATE-INFORMATION"]},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":1661,"function":"getPropertiesIteratorForPath","class":"Sabre\\DAV\\Server","type":"->","args":["**CENSORED**",["{http://open-collaboration-services.org/ns}share-permissions","{http://owncloud.org/ns}fileid","{http://owncloud.org/ns}privatelink"],0]},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":1646,"function":"writeMultiStatus","class":"Sabre\\DAV\\Server","type":"->","args":[{"elementMap":[],"contextUri":"/remote.php/dav/","namespaceMap":{"DAV:":"d","http://sabredav.org/ns":"s","http://owncloud.org/ns":"oc","http://nextcloud.org/ns":"nc"},"classMap":[],"__class__":"Sabre\\Xml\\Writer"},{"__class__":"Generator"},false]},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/CorePlugin.php","line":346,"function":"generateMultiStatus","class":"Sabre\\DAV\\Server","type":"->","args":[{"__class__":"Generator"},false]},{"file":"/var/www/nextcloud/3rdparty/sabre/event/lib/WildcardEmitterTrait.php","line":89,"function":"httpPropFind","class":"Sabre\\DAV\\CorePlugin","type":"->","args":[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":472,"function":"emit","class":"Sabre\\DAV\\Server","type":"->","args":["method:PROPFIND",[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]]},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":253,"function":"invokeMethod","class":"Sabre\\DAV\\Server","type":"->","args":[{"__class__":"Sabre\\HTTP\\Request"},{"__class__":"Sabre\\HTTP\\Response"}]},{"file":"/var/www/nextcloud/3rdparty/sabre/dav/lib/DAV/Server.php","line":321,"function":"start","class":"Sabre\\DAV\\Server","type":"->","args":[]},{"file":"/var/www/nextcloud/apps/dav/lib/Server.php","line":332,"function":"exec","class":"Sabre\\DAV\\Server","type":"->","args":[]},{"file":"/var/www/nextcloud/apps/dav/appinfo/v2/remote.php","line":35,"function":"exec","class":"OCA\\DAV\\Server","type":"->","args":[]},{"file":"/var/www/nextcloud/remote.php","line":167,"args":["/var/www/nextcloud/apps/dav/appinfo/v2/remote.php"],"function":"require_once"}],"File":"/var/www/nextcloud/apps/dav/lib/Connector/Sabre/Directory.php","Line":227,"CustomMessage":"--"},"userAgent":"Mozilla/5.0 (Linux) mirall/3.3.5git (build 7628) (Nextcloud, bunsenlabs-4.19.0-18-amd64 ClientArchitecture: x86_64 OsArchitecture: x86_64)","version":"21.0.5.1"}

Device

lscpu output 
Model:		Raspberry Pi 4 Model B Rev 1.2
Architecture:        aarch64
Byte Order:          Little Endian
CPU(s):              4
On-line CPU(s) list: 0-3
Thread(s) per core:  1
Core(s) per socket:  4
Socket(s):           1
Vendor ID:           ARM
Model:               3
Model name:          Cortex-A72
Stepping:            r0p3
CPU max MHz:         1500.0000
CPU min MHz:         600.0000
BogoMIPS:            108.00
Flags:               fp asimd evtstrm crc32 cpuid
cat /proc/meminfo output 
MemTotal:        3886104 kB
MemFree:          531028 kB
MemAvailable:    2772516 kB
Buffers:         1276800 kB
Cached:           920784 kB
SwapCached:            0 kB
Active:          1448432 kB
Inactive:        1575636 kB
Active(anon):      13680 kB
Inactive(anon):   917656 kB
Active(file):    1434752 kB
Inactive(file):   657980 kB
Unevictable:          16 kB
Mlocked:              16 kB
SwapTotal:       5983244 kB
SwapFree:        5977100 kB
Dirty:                 0 kB
Writeback:             0 kB
AnonPages:        826500 kB
Mapped:           161040 kB
Shmem:            105084 kB
KReclaimable:     225980 kB
Slab:             262396 kB
SReclaimable:     225980 kB
SUnreclaim:        36416 kB
KernelStack:        6048 kB
PageTables:         7936 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:     7926296 kB
Committed_AS:    4207604 kB
VmallocTotal:   262930368 kB
VmallocUsed:       29076 kB
VmallocChunk:          0 kB
Percpu:              816 kB
CmaTotal:         327680 kB
CmaFree:          174684 kB
vcgencmd get_config int output 
arm_64bit=1
arm_freq=1500
audio_pwm_mode=514
config_hdmi_boost=5
core_freq=500
core_freq_min=200
disable_commandline_tags=2
disable_l2cache=1
display_hdmi_rotate=-1
display_lcd_rotate=-1
dvfs=3
enable_gic=1
force_eeprom_read=1
force_pwm_open=1
framebuffer_ignore_alpha=1
framebuffer_swap=1
gpu_freq=500
gpu_freq_min=250
init_uart_clock=0x2dc6c00
lcd_framerate=60
mask_gpu_interrupt0=1024
mask_gpu_interrupt1=0x10000
max_framebuffers=2
over_voltage_avs=7500
pause_burst_frames=1
total_mem=4096
< free > total used free shared buff/cache available
Mem: 3886104 930720 532196 105080 2423188 2773312
Swap: 5983244 6144 5977100
< free -m -t > total used free shared buff/cache available
Mem: 3795 909 519 102 2366 2707
Swap: 5843 6 5837
Total: 9638 915 6356
15

Untitled

Total uptime is 13 days. I’ve been running this instance for around 6 months.

16

Well we can already see that my personal instance has uncharacteristic “Current Data Usage” compared to most other users.

Thanks all for the feedback, and keep’em coming!

1 Like
17

uname -a: Linux … 4.14.133-odroidxu4 #2 SMP PREEMPT Fri Aug 2 02:19:55 UTC 2019 armv7l GNU/Linux

Uptime: 00:17:52 up 11 days, 10:27, 1 user, load average: 0.15, 0.16, 0.11

╒═══════════════════════════╤════════════════════════╕
│ Parameter                 │ Value -> Recommended   │
╞═══════════════════════════╪════════════════════════╡
│ System RAM                │ 1.95G                  │
├───────────────────────────┼────────────────────────┤
│ DB dedicated RAM          │ 499.22M -> 1.33G       │
├───────────────────────────┼────────────────────────┤
│ Current Data Usage        │ 66.58M                 │
├───────────────────────────┼────────────────────────┤
│ Memory usage %            │ 218.52%                │
├───────────────────────────┼────────────────────────┤
│ Temp tables in RAM %      │ 70.71% -> 25%          │
├───────────────────────────┼────────────────────────┤
│ Innodb buffer pool size   │ 512.00M -> 66.58M      │
├───────────────────────────┼────────────────────────┤
│ Innodb log file size      │ 32.00M -> 64.00M       │
├───────────────────────────┼────────────────────────┤
│ Max heap/tmp table size   │ 64.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max memory usage          │ 1.07G                  │
├───────────────────────────┼────────────────────────┤
│ Max possible memory usage │ 3.63G                  │
╘═══════════════════════════╧════════════════════════╛
18 
╒═══════════════════════════╤════════════════════════╕
│ Parameter                 │ Value -> Recommended   │
╞═══════════════════════════╪════════════════════════╡
│ System RAM                │ 3.73G                  │
├───────────────────────────┼────────────────────────┤
│ DB dedicated RAM          │ 953.63M -> 1.84G       │
├───────────────────────────┼────────────────────────┤
│ Current Data Usage        │ 15.30M                 │
├───────────────────────────┼────────────────────────┤
│ Memory usage %            │ 158.17%                │
├───────────────────────────┼────────────────────────┤
│ Temp tables in RAM %      │ 98.45% -> 25%          │
├───────────────────────────┼────────────────────────┤
│ Innodb buffer pool size   │ 1.00G -> 15.30M        │
├───────────────────────────┼────────────────────────┤
│ Innodb log file size      │ 32.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max heap/tmp table size   │ 64.00M -> 128.00M      │
├───────────────────────────┼────────────────────────┤
│ Max memory usage          │ 1.47G                  │
├───────────────────────────┼────────────────────────┤
│ Max possible memory usage │ 4.13G                  │
╘═══════════════════════════╧════════════════════════╛


                                 eyduh@myncp 
                                 ------------ 
      █ █ █ █ █ █ █ █ █ █ █      OS: Armbian buster (21.08.6) aarch64 
     ███████████████████████     Host: Hardkernel ODROID-HC4 
   ▄▄██                   ██▄▄   Kernel: 5.10.81-meson64 
   ▄▄██    ███████████    ██▄▄   Uptime: 3 days, 13 hours, 29 mins 
   ▄▄██   ██         ██   ██▄▄   Packages: 921 (dpkg) 
   ▄▄██   ██         ██   ██▄▄   Shell: bash 5.0.3 
   ▄▄██   ██         ██   ██▄▄   Resolution: 1024x768 
   ▄▄██   █████████████   ██▄▄   Terminal: /dev/pts/0 
   ▄▄██   ██         ██   ██▄▄   CPU: (4) @ 2.100GHz 
   ▄▄██   ██         ██   ██▄▄   Memory: 1580MiB / 3814MiB 
   ▄▄██   ██         ██   ██▄▄
   ▄▄██                   ██▄▄                           
     ███████████████████████                             
      █ █ █ █ █ █ █ █ █ █ █