Snap Setup of NC 25. A RamDisk Experiment on old Recycled Hardware with new HDD

A RamDisk Experiment on old Recycled Hardware with a new HDD.
I am going to test NC 25 on an I5 notebook that has 4 GB’s of ram currently running NC 25.
If it turns out ok I will modify my backup test unit. I5 NC server as well.
Folder/User stats synced files from windows.
166 GB
166 GB
3,117 Files, 300 Folders

My project details for NC install/setup.

My Benchmark/Current speed on I5 8 GB 2 TB 7200 rpm. is ~1 second per file/ per new file when Syncing with a NC client once there are a lot of files in the NC Server. Will have to power it up and look at the bash history to find what I have tried so far if needed.

I will also share the QB64 BASIC code I create to test basic file performance in Hz on a normal HDD and of the RamDisk.

If tests results are good I may also add a ThinLinc remote access server to the experiment as well.

Continuing the discussion from Change favico.ico or color on Nextcloud Support forum website:

I have tested this Ramdisk setup with Plex TV server’s Transcode cache folder, it worked very well increasing the number of streams playing and with very low CPU usage once the streams where running.

Playback Results:

Chrome on Win 11 tied up the CPU and also was trying to save the streamed data by the looks on the resource monitor.
4 tabs playing Videos with 100% CPU.

FireFox was much better, less CPU with more tabs open with video playing.
7 tabs playing Videos With 50% CPU.

The RAM disk setup I used to have a folder at /mnt/ramdisk used by Plex.

as root 
mount -o size=4G,uid=1000 -t tmpfs tmpfs /mnt/ramdisk

As root.
nano /etc/fstab

As root add line fstab at under the last line.
Will try first line on test system.
 
none /mnt/ramdisk tmpfs size=4G,uid=1000 0 0

Then during each boot a new, empty ram disk will be mounted at /mnt/ramdisk for files discarded during shutdown.

I will also make a snapshot of my working current test install.

I will also use a YaCy Search Engine in Webportal mode for research.
Yacy now running and crawling, my QB64 webserver console also.
I have to try a patch from SUSE Linux for iotop in Ubuntu.

I will edit this post as I add idea’s, experiment’s, so bookmark it otherwise it gets spread out down the ladder too far and also I have a record of what works.

Other Links for research.
https://help.nextcloud.com/t/how-to-setup-nc-snapshot-sync-does-anyone-how-to-do-it-right/49451/3
https://help.nextcloud.com/t/how-to-share-url-of-video-in-nextcloud-for-a-wordpress-blog/156134
https://community.thinlinc.com/t/i-now-have-my-local-thinlinc-server-iframed-on-a-qb64-webserver-program-and-other-types-of-webservers/560
https://discourse.pi-hole.net/t/trying-to-have-a-local-web-page-with-iframes-so-i-can-monitor-all-my-piholes/61371
https://forum.snapcraft.io/t/has-anyone-restored-a-snapshot-to-another-machine-even-different-hardware/33953
https://community.thinlinc.com/t/i-now-have-my-local-thinlinc-server-iframed-on-a-qb64-webserver-program-and-other-types-of-webservers/560/2
https://community.searchlab.eu/
https://www.suse.com/support/kb/doc/?id=000020888
https://community.searchlab.eu/t/i-am-using-yacy-as-part-of-my-project-about-running-a-ramdisk-in-a-nextcloud-server-on-low-end-hardware/1366?u=roamn
https://www.suse.com/support/kb/doc/?id=000020888
https://askubuntu.com/questions/1288580/sudo-grub2-mkconfig-command-not-found

Found a way to capture iotop output to txt…

Total DISK READ:         9.23 M/s | Total DISK WRITE:         3.63 M/s
Current DISK READ:      10.77 M/s | Current DISK WRITE:       9.20 M/s
    TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND
 139777 be/4 john        2.29 M/s    0.00 B/s  0.00 % 99.99 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
   1614 be/4 root      129.73 K/s    0.00 B/s 86.46 % 97.65 % canonical-livepatchd
 110393 be/4 root      109.70 K/s    0.00 B/s 80.29 % 97.15 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
 140642 be/4 john        2.29 M/s    0.00 B/s  0.00 % 94.77 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 117426 be/4 root        3.26 M/s    0.00 B/s  0.00 % 94.63 % php-fpm: pool www
   2653 be/4 root       17.41 K/s  111.44 K/s 63.39 % 73.80 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
 114060 be/4 root        0.00 B/s    0.00 B/s  0.00 % 60.09 % [kworker/u8:6-writeback]
 110709 be/4 root        0.00 B/s    0.00 B/s  0.00 % 59.95 % [kworker/u8:5+flush-8:0]
 101323 be/4 root      278.61 K/s    0.00 B/s  0.00 % 56.92 % [kworker/u8:4-ext4-rsv-conversion]
 110708 be/4 root      407.47 K/s    0.00 B/s  0.00 % 45.54 % [kworker/u8:0-loop4]
 114062 be/4 root      153.23 K/s    0.00 B/s  0.00 % 23.68 % [kworker/u8:8-writeback]
   2649 be/4 root        0.00 B/s   41.79 K/s  0.00 % 23.44 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
 119069 be/4 root      212.44 K/s    0.00 B/s  0.00 % 22.41 % [kworker/u8:9-loop22]
 133849 be/4 root      101.00 K/s    0.00 B/s  0.00 % 17.01 % [kworker/u8:2-writeback]
   7365 be/4 john        0.00 B/s    3.27 M/s  0.00 %  6.16 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26d9d5878b2d9e104f.AppImage --background
 114061 be/4 root        0.00 B/s    0.00 B/s  0.00 %  6.12 % [kworker/u8:7-flush-8:0]
    870 be/4 syslog      0.00 B/s    3.48 K/s  0.00 %  4.66 % rsyslogd -n -iNONE [rs:main Q:Reg]
   2651 be/4 root        0.00 B/s   13.93 K/s  0.00 %  0.77 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
    238 be/3 root        0.00 B/s   24.38 K/s  0.00 %  0.00 % [jbd2/sda5-8]
    278 be/3 root       13.93 K/s  170.65 K/s  0.00 %  0.00 % systemd-journald
   1747 be/4 root        3.48 K/s    0.00 B/s  0.00 %  0.00 % canonical-livepatchd
      1 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % init splash
      2 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kthreadd]
      3 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_gp]
      4 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_par_gp]
      5 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [slub_flushwq]
      6 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [netns]
      8 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kworker/0:0H-events_highpri]
     10 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [mm_percpu_wq]
  keys:  any: refresh  q: quit  i: ionice  o: active  p: procs  a: accum
  sort:  r: asc  left: SWAPIN  right: COMMAND  home: TID  end: COMMAND

canatonical-livepatch...
update notifiyer
   5536 be/4 john        6.95 K/s    0.00 B/s  2.85 %  2.84 % gjs /usr/share/gnome-shell/extensions/d~ 0 -D 0:0:1366:768:1:27:0:50:0:0 [gdbus]
   8037 be/4 john        6.95 K/s    0.00 B/s  1.91 %  1.91 % update-notifier

 DISK READ:        23.64 M/s | Total DISK WRITE:        19.44 M/s
Current DISK READ:      24.75 M/s | Current DISK WRITE:    1878.76 K/s
    TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND
 110709 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % [kworker/u8:5+flush-8:0]
 140642 be/4 john        9.12 M/s    0.00 B/s  0.00 % 99.99 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 139777 be/4 john        2.71 M/s    0.00 B/s  0.00 % 99.99 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 142576 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % [kworker/u8:1-writeback]
 114061 be/4 root        0.00 B/s    0.00 B/s  0.00 % 99.99 % [kworker/u8:7+flush-8:0]
   5513 be/4 john      277.82 K/s    0.00 B/s 45.25 % 49.04 % gjs /usr/share/gnome-shell/extensions/d~t.com -M 0 -D 0:0:1366:768:1:27:0:50:0:0
 117426 be/4 root       11.18 M/s    0.00 B/s  0.00 % 48.72 % php-fpm: pool www
   2280 be/4 john       79.87 K/s    0.00 B/s 42.33 % 42.64 % gnome-shell
   1749 be/4 root       38.20 K/s    0.00 B/s 24.52 % 27.19 % canonical-livepatchd
   2605 be/4 john       20.84 K/s    0.00 B/s 16.88 % 16.87 % gnome-shell [gdbus]
   1747 be/4 root       34.73 K/s    0.00 B/s 11.25 % 12.33 % canonical-livepatchd
    986 be/4 root       20.84 K/s    0.00 B/s  2.98 %  4.64 % canonical-livepatchd
    833 be/4 messageb    3.47 K/s    0.00 B/s  4.24 %  4.23 % @dbus-daemon --system --address=systemd~dfile --systemd-activation --syslog-only
   5536 be/4 john        6.95 K/s    0.00 B/s  2.85 %  2.84 % gjs /usr/share/gnome-shell/extensions/d~ 0 -D 0:0:1366:768:1:27:0:50:0:0 [gdbus]
   8037 be/4 john        6.95 K/s    0.00 B/s  1.91 %  1.91 % update-notifier
   7365 be/4 john        6.95 K/s   19.43 M/s  1.51 %  1.50 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26d9d5878b2d9e104f.AppImage --background
   1279 be/4 john        3.47 K/s    0.00 B/s  0.61 %  0.61 % systemd --user
 145520 be/4 root       32.99 K/s    3.47 K/s  0.00 %  0.00 % bash /snap/snapd-desktop-integration/49~ion/49/usr/bin/snapd-desktop-integration
      1 be/4 root      114.60 K/s    0.00 B/s  0.00 %  0.00 % init splash
    278 be/3 root        0.00 B/s    6.95 K/s  0.00 %  0.00 % systemd-journald
 145308 be/4 john        3.47 K/s    0.00 B/s  0.00 %  0.00 % xdg-desktop-portal [pool-/usr/libex]
      2 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kthreadd]
      3 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_gp]
      4 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_par_gp]
      5 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [slub_flushwq]
      6 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [netns]
      8 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kworker/0:0H-events_highpri]
     10 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [mm_percpu_wq]
     11 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_tasks_kthread]
  keys:  any: refresh  q: quit  i: ionice  o: active  p: procs  a: accum
  sort:  r: asc  left: SWAPIN  right: COMMAND  home: TID  end: COMMAND

Bug: No sync. NC Client on update check. Stuck behind default keyring login after reboot.

All tests done at 1 Gbit connection with thru 2 TP-Link 8 Port Switches.


Test bandwidth: Straight Upload SSH transfer ~50 mb/s to NC non mirror area.

11:26:45.770 Changing current remote folder to '/home/john/Downloads' succeeded.
11:33:20.461 Upload list passed to upload manager.
11:33:20.467 Uploading local file 'C:\Users\John Doe\Videos\2023-02-16 18-23-34.mkv' started. Using 'binary' transfer mode.
11:33:37.585 Uploading local file 'C:\Users\John Doe\Videos\2023-02-16 18-23-34.mkv' completed successfully. 806,546,406 bytes transferred.

Test bandwidth: Straight Download SSH transfer ~94 mb/s NC non mirror area to Win 11.
11:43:27.609 Renaming local file 'C:\Users\John Doe\Videos\2023-02-16 18-23-34.mkv' to 'C:\Users\John Doe\Videos\2023-02-16 18-23-34.mkv.mkv' succeeded.
11:44:17.942 Download list passed to download manager.
11:44:17.946 Downloading remote file '/home/john/Downloads/2023-02-16 18-23-34.mkv' started. Using 'binary' transfer mode.
11:44:26.949 Downloading remote file '/home/john/Downloads/2023-02-16 18-23-34.mkv' completed successfully. 806,546,406 bytes transferred.


The windows client was stuck uploading at 8.1 mbits for sometime.
I tried to repeat test but it was normal…
I then used a bigger file because 806 GB was nothing exciting and happen to fast to capture any data on…

12:06:29.987 Refreshing current remote folder '/home/john/192.168.1.52-smokingwheels/Video' succeeded.
12:13:59.797 Copying log to clipboard succeeded.
12:20:50.505 Removing remote file '/home/john/192.168.1.52-smokingwheels/Video/2023-02-23 11-38-38.mkv' succeeded.


win client end copy to sync area local HDD not SSD..
It started at 8.1 mbps upload to NC for some time.
I waited a bit then started clicking window for a clue but it eventually finished.

tested with SSH 806 GB in 9 seconds. upload to mirror 90 mb/s...upload non mirror 94 mb/s 

Had to use win 11 iso........The clent/server did not repeat the fault even though I tested again..
806 GB sync transfer was not really exciting! or long enough to capture any data..

Old hardware specs my start or beginning with installing NC 12…
https://help.nextcloud.com/t/how-to-reclaim-space-from-misconfigured-backup/156422/4?u=smokingwheels

At the test of 744 mb ssh to ramdrive.

snap-store gappl process high disk io.

Did a http test NC zip output of a folder 32 GB
It did slow down to 5.5 mb/s for awhile…
50 mb/s most of the time between NC notebook HDD 5400 rpm and notebook HDD 5400


Did test of smaller files but not large enough. 1GB

dual-core processor for ultrabooks launched in Q2 2014
9 years

root@Nextcloud-ASUS:/run/user/1000# lscpu
Architecture:            x86_64
  CPU op-mode(s):        32-bit, 64-bit
  Address sizes:         39 bits physical, 48 bits virtual
  Byte Order:            Little Endian
CPU(s):                  4
  On-line CPU(s) list:   0-3
Vendor ID:               GenuineIntel
  Model name:            Intel(R) Core(TM) i5-4210U CPU @ 1.70GHz
    CPU family:          6
    Model:               69
    Thread(s) per core:  2
    Core(s) per socket:  2
    Socket(s):           1
    Stepping:            1
    CPU max MHz:         2700.0000
    CPU min MHz:         800.0000
    BogoMIPS:            4789.04
    Flags:               fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clf
                         lush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm c
                         onstant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid
                          aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx est tm2 ssse3 sdbg fma
                         cx16 xtpr pdcm pcid sse4_1 sse4_2 movbe popcnt tsc_deadline_timer aes xsave
                          avx f16c rdrand lahf_lm abm cpuid_fault epb invpcid_single pti ssbd ibrs i
                         bpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust
                         bmi1 avx2 smep bmi2 erms invpcid xsaveopt dtherm ida arat pln pts md_clear
                         flush_l1d
Virtualization features:
  Virtualisation:        VT-x
Caches (sum of all):
  L1d:                   64 KiB (2 instances)
  L1i:                   64 KiB (2 instances)
  L2:                    512 KiB (2 instances)
  L3:                    3 MiB (1 instance)
NUMA:
  NUMA node(s):          1
  NUMA node0 CPU(s):     0-3
Vulnerabilities:
  Itlb multihit:         KVM: Mitigation: VMX disabled
  L1tf:                  Mitigation; PTE Inversion; VMX conditional cache flushes, SMT vulnerable
  Mds:                   Mitigation; Clear CPU buffers; SMT vulnerable
  Meltdown:              Mitigation; PTI
  Mmio stale data:       Unknown: No mitigations
  Retbleed:              Not affected
  Spec store bypass:     Mitigation; Speculative Store Bypass disabled via prctl
  Spectre v1:            Mitigation; usercopy/swapgs barriers and __user pointer sanitization
  Spectre v2:            Mitigation; Retpolines, IBPB conditional, IBRS_FW, STIBP conditional, RSB f
                         illing, PBRSB-eIBRS Not affected
  Srbds:                 Mitigation; Microcode
  Tsx async abort:       Not affected
root@Nextcloud-ASUS:/run/user/1000#

QB64 web console.

Pihole 7

ThinLinc


Reboot needed has been up for 45 days

I can also see on my pihole how crawling is going in realtime.

Rebooting NC.
https://youtu.be/avSqT242BXI

My YaCy Search Engine in Webportal mode. Results for pihole nextcloud
My Normal everyday Zoom level.

The Discourse forum Bot at the Yacy forum locks you out if you crawl the forum. I have lost access to 2 accounts.
smokingwheels and roamn. 5 + 2 results total.


Zoomed out.

Search with site and author selected.


Ok Bitvise ssh up.

trap/feature transfer as root to NC Mirror...no sync on client.
feature: bandwidth test ssh..

set 777 2023-02-23 11-38-38.mkv 5 gb see if remote server and client in running after reboot.

Ubuntu was set to login and asking for default keyring password NC client was on update check splash at top of background of desktop.

disk io in progress.. maybe rereading all files.
io read 30 mbs write 30 mbs

from iotop try to find..

cd /tmp/sockets
error
cd /run/user/0

I personally! have been trying to capture iotop output for many years…

canatonical-livepatch… in progress
update notifiers

   5536 be/4 john        6.95 K/s    0.00 B/s  2.85 %  2.84 % gjs /usr/share/gnome-shell/extensions/d~ 0 -D 0:0:1366:768:1:27:0:50:0:0 [gdbus]
   8037 be/4 john        6.95 K/s    0.00 B/s  1.91 %  1.91 % update-notifier


otal DISK READ:        32.28 M/s | Total DISK WRITE:         6.13 M/s
Current DISK READ:      32.41 M/s | Current DISK WRITE:     124.48 K/s
    TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND
 153384 be/4 john     1991.65 K/s    0.00 B/s  0.00 % 99.99 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 158055 be/4 john     1106.47 K/s    0.00 B/s  0.00 % 99.99 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 168660 be/4 root        6.05 M/s    0.00 B/s  0.00 % 92.68 % php-fpm: pool www
 161320 be/4 root      366.52 K/s    0.00 B/s  0.00 % 87.47 % [kworker/u8:7+loop22]
 172010 be/4 root       96.82 K/s    0.00 B/s  0.00 % 73.37 % php -c /snap/nextcloud/33730/config/php~33730/htdocs/occ -n status --output=json
 159667 be/4 john        5.83 M/s    0.00 B/s  0.00 % 68.48 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 140642 be/4 john       16.86 M/s    0.00 B/s  0.00 % 60.87 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
   7365 be/4 john        0.00 B/s    6.05 M/s  0.00 % 37.99 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26d9d5878b2d9e104f.AppImage --background
    834 be/4 root        0.00 B/s    0.00 B/s  0.00 % 37.77 % NetworkManager --no-daemon
    870 be/4 syslog      0.00 B/s    0.00 B/s  0.00 % 24.31 % rsyslogd -n -iNONE [rs:main Q:Reg]
 119069 be/4 root        0.00 B/s    0.00 B/s  0.00 %  8.63 % [kworker/u8:9+flush-8:0]
    278 be/3 root       55.32 K/s   79.53 K/s  0.00 %  0.00 % systemd-journald
  29352 be/4 root        3.46 K/s    0.00 B/s  0.00 %  0.00 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
 171603 be/4 root        0.00 B/s    3.46 K/s  0.00 %  0.00 % php-fpm: pool www
      1 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % init splash
      2 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kthreadd]
      3 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_gp]
      4 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_par_gp]
      5 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [slub_flushwq]
      6 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [netns]
      8 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kworker/0:0H-events_highpri]
     10 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [mm_percpu_wq]
     11 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_tasks_kthread]
     12 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_tasks_rude_kthread]
     13 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_tasks_trace_kthread]
     14 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [ksoftirqd/0]
     15 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_preempt]
     16 rt/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [migration/0]
     17 rt/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [idle_inject/0]
  keys:  any: refresh  q: quit  i: ionice  o: active  p: procs  a: accum
  sort:  r: asc  left: SWAPIN  right: COMMAND  home: TID  end: COMMAND

load 10
top - 10:04:27 up  2:22,  4 users,  load average: 10.21, 10.93, 10.54
Tasks: 261 total,   2 running, 259 sleeping,   0 stopped,   0 zombie
%Cpu(s):  6.9 us,  6.5 sy,  0.0 ni,  7.3 id, 79.1 wa,  0.0 hi,  0.1 si,  0.0 st
MiB Mem :   3745.3 total,    102.3 free,    510.0 used,   3132.9 buff/cache
MiB Swap:   2048.0 total,   1287.8 free,    760.2 used.   2901.5 avail Mem

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
   7365 john      20   0 1770168  36316  19400 D  16.9   0.9  13:15.56 AppRun
  59446 root      20   0   26740   8492   3672 R  10.3   0.2  13:46.74 iotop
     61 root      20   0       0      0      0 S   1.3   0.0   1:09.51 kswapd0
   2343 root      20   0 2673788  35292  10084 S   1.3   0.9   2:08.62 mysqld
   6385 root      20   0 1979920   2288   2288 S   1.3   0.1   0:27.71 httpd
 168660 root      20   0  346424  36172  35484 S   1.3   0.9   0:07.16 php-fpm
 117053 root      20   0   13212   2796   2260 S   0.7   0.1   0:16.48 top
     80 root       0 -20       0      0      0 I   0.3   0.0   0:08.91 kworker/1:1H-kblockd
    863 root      20   0  128580   4540   3852 S   0.3   0.1   0:00.83 thermald
   1533 root      20   0   65488   3532   2296 S   0.3   0.1   0:23.38 redis-server
   4194 root      20   0  341944  17584  17452 S   0.3   0.5   0:02.56 php-fpm
 101323 root      20   0       0      0      0 I   0.3   0.0   0:04.03 kworker/u8:4-events_power_e+
 163718 root      20   0   13208   3164   2636 R   0.3   0.1   0:03.35 top
      1 root      20   0  167132   8436   5264 S   0.0   0.2   0:02.99 systemd
      2 root      20   0       0      0      0 S   0.0   0.0   0:00.00 kthreadd
      3 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 rcu_gp
      4 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 rcu_par_gp
      5 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 slub_flushwq
      6 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 netns
      8 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 kworker/0:0H-events_highpri
     10 root       0 -20       0      0      0 I   0.0   0.0   0:00.00 mm_percpu_wq
     11 root      20   0       0      0      0 I   0.0   0.0   0:00.00 rcu_tasks_kthread
     12 root      20   0       0      0      0 I   0.0   0.0   0:00.00 rcu_tasks_rude_kthread
     13 root      20   0       0      0      0 I   0.0   0.0   0:00.00 rcu_tasks_trace_kthread

load 10
otal DISK READ:         9.82 M/s | Total DISK WRITE:         2.86 M/s
Current DISK READ:       9.82 M/s | Current DISK WRITE:     327.24 K/s
    TID  PRIO  USER     DISK READ  DISK WRITE  SWAPIN     IO>    COMMAND
 140642 be/4 john        2.18 M/s    0.00 B/s  0.00 % 97.17 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 153384 be/4 john        2.50 M/s    0.00 B/s  0.00 % 94.76 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 158055 be/4 john        2.39 M/s    0.00 B/s  0.00 % 90.26 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26~.AppImage --background [Thread (pooled)]
 168660 be/4 root        2.61 M/s    0.00 B/s  0.00 % 89.55 % php-fpm: pool www
   2650 be/4 root        0.00 B/s   69.63 K/s  0.00 % 56.45 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
  12493 be/4 root       27.85 K/s    0.00 B/s 38.95 % 53.53 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
 172862 be/4 root       32.20 K/s    0.00 B/s 16.57 % 51.26 % php-fpm: pool www
 110393 be/4 root       20.89 K/s    0.00 B/s 46.10 % 46.08 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
   3660 be/4 root       20.89 K/s    0.00 B/s 36.60 % 36.58 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
   2663 be/4 root       10.44 K/s   13.93 K/s 24.46 % 24.45 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
   2661 be/4 root        0.00 B/s    0.00 B/s  0.00 % 21.22 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
 171911 be/4 root        6.96 K/s    0.00 B/s  0.00 % 11.71 % [kworker/u8:5-events_freezable_power_]
   2653 be/4 root       13.93 K/s  111.40 K/s  0.07 %  9.06 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
   2659 be/4 root        6.96 K/s    0.00 B/s  0.00 %  7.89 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
   3819 be/4 root        0.00 B/s    0.00 B/s  0.00 %  1.78 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
   7365 be/4 john        0.00 B/s    2.61 M/s  0.00 %  0.22 % Nextcloud-3.6.4-x86_64_d25cda3be8ef9f26d9d5878b2d9e104f.AppImage --background
    238 be/3 root        0.00 B/s   17.41 K/s  0.00 %  0.00 % [jbd2/sda5-8]
   2649 be/4 root        0.00 B/s   27.85 K/s  0.00 %  0.00 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
   2651 be/4 root        0.00 B/s   13.93 K/s  0.00 %  0.00 % mysqld --defaults-file=/snap/nextcloud/~sql.pid --socket=/tmp/sockets/mysql.sock
      1 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % init splash
      2 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kthreadd]
      3 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_gp]
      4 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_par_gp]
      5 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [slub_flushwq]
      6 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [netns]
      8 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [kworker/0:0H-events_highpri]
     10 be/0 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [mm_percpu_wq]
     11 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_tasks_kthread]
     12 be/4 root        0.00 B/s    0.00 B/s  0.00 %  0.00 % [rcu_tasks_rude_kthread]
  keys:  any: refresh  q: quit  i: ionice  o: active  p: procs  a: accum
  sort

Cloud Party System is still alive and well…A Mirrorcloud too.

I just recorded a Video an a few pic’s and some screenshots on my phone then used My Cloud Party system to upload from my phone and they automagicaly end up on my PC…

Oh: Also you can just keep adding and uploading more than once when the count down timer is running on the page. Previous, I was waiting for the count down timer to run out.

You use a phone browser to a shared folder in NC.

You also have the option to do cam pic, cam video and files. I think you need to have the NC client installed.

It’s really faster than a direct USB 2 connection to pc after the event, you have the data go straight to the NC server and its not stored on the phone.
Need to test! You can use a random phone at event and record things upload some of there personal shots of the event as well (you need permission…of course). I never had time to do that until I had completed my first experimental test…

Now Tested on second phone with NC Client installed.

I found the above when I was checking my logs with a Yacy Search Engine. Good news very small amount of load errors on re crawl.

cloudparty ..no mods sec  i 5 4 core 2 threads = 8. 7200 RPM 3.5 HDD

Feb 18 16:36:10 cloud-party nextcloud.apache[5304]: System config value redis => port set to integer 0
Feb 18 16:36:10 cloud-party nextcloud.apache[5380]: System config value memcache.locking set to string \OC\Memcache\Redis
Feb 18 16:36:11 cloud-party nextcloud.apache[5453]: System config value memcache.local set to string \OC\Memcache\Redis
Feb 18 16:36:12 cloud-party nextcloud.apache[5581]: No such app enabled: updatenotification
Feb 18 16:36:12 cloud-party nextcloud.apache[2839]: Making sure nextcloud is fully upgraded...
Feb 18 16:36:13 cloud-party nextcloud.apache[5728]: Nextcloud is already latest version
Feb 18 16:36:13 cloud-party nextcloud.apache[1455]: All set! Running httpd...
Feb 18 16:36:13 cloud-party nextcloud.apache[5794]: No certificates are active: using HTTP only
Feb 18 16:36:13 cloud-party nextcloud.apache[5794]: HTTP compression is enabled
Feb 18 16:36:13 cloud-party nextcloud.apache[5848]: AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 192.168.1.53. Set the 'ServerName' directive globally to suppress this message


ramdisk -1 sec  2 core 2 threads = 4. 5400 RPM 2.5 HDD
Feb 25 18:15:07 Nextcloud-ASUS nextcloud.apache[816326]: System config value redis => port set to integer 0
Feb 25 18:15:07 Nextcloud-ASUS nextcloud.apache[816398]: System config value memcache.locking set to string \OC\Memcache\Redis
Feb 25 18:15:08 Nextcloud-ASUS nextcloud.apache[816472]: System config value memcache.local set to string \OC\Memcache\Redis
Feb 25 18:15:08 Nextcloud-ASUS nextcloud.apache[816548]: No such app enabled: updatenotification
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[814912]: Making sure nextcloud is fully upgraded...
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[816741]: Nextcloud is already latest version
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[814706]: All set! Running httpd...
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[816749]: No certificates are active: using HTTP only
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[816749]: HTTP compression is disabled
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[816801]: AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 127.0.1.1. Set the 'ServerName' directive globally to suppress this message
cloudparty ..no mods  i 5 4 core 2 threads = 8. 7200 RPM 3.5 HDD

Feb 07 09:03:31 cloud-party systemd[1]: Started Service for snap application nextcloud.apache.
Feb 07 09:03:45 cloud-party nextcloud.apache[1424]: Making sure nextcloud is setup...
Feb 07 09:03:46 cloud-party nextcloud.apache[2085]: Waiting for PHP...
Feb 07 09:04:20 cloud-party nextcloud.apache[2085]: done
Feb 07 09:04:29 cloud-party nextcloud.apache[4514]: System config value redis => host set to string /tmp/sockets/redis.sock
Feb 07 09:04:31 cloud-party nextcloud.apache[5102]: System config value redis => port set to integer 0
Feb 07 09:04:32 cloud-party nextcloud.apache[5303]: System config value memcache.locking set to string \OC\Memcache\Redis
Feb 07 09:04:33 cloud-party nextcloud.apache[5429]: System config value memcache.local set to string \OC\Memcache\Redis
Feb 07 09:04:34 cloud-party nextcloud.apache[5533]: No such app enabled: updatenotification
Feb 07 09:04:34 cloud-party nextcloud.apache[2085]: Making sure nextcloud is fully upgraded...
Feb 07 09:04:35 cloud-party nextcloud.apache[5708]: Nextcloud is already latest version
Feb 07 09:04:35 cloud-party nextcloud.apache[1424]: All set! Running httpd...

From: Sunday, 26 February 2023 at 9:33:31 am
To: Sunday, 26 February 2023 at 9:34:35 am

Result: 0 hours, 1 minute and 4 seconds
The duration is 0 hours, 1 minute and 4 seconds
ramdisk 2 core 2 threads = 4. 5400 RPM 2.5 HDD

Feb 25 18:14:46 Nextcloud-ASUS systemd[1]: Started Service for snap application nextcloud.apache.
Feb 25 18:14:46 Nextcloud-ASUS nextcloud.apache[814706]: Making sure nextcloud is setup...
Feb 25 18:14:46 Nextcloud-ASUS nextcloud.apache[814912]: Waiting for PHP...
Feb 25 18:15:05 Nextcloud-ASUS nextcloud.apache[814912]: done
Feb 25 18:15:06 Nextcloud-ASUS nextcloud.apache[816214]: System config value redis => host set to string /tmp/sockets/redis.sock
Feb 25 18:15:07 Nextcloud-ASUS nextcloud.apache[816326]: System config value redis => port set to integer 0
Feb 25 18:15:07 Nextcloud-ASUS nextcloud.apache[816398]: System config value memcache.locking set to string \OC\Memcache\Redis
Feb 25 18:15:08 Nextcloud-ASUS nextcloud.apache[816472]: System config value memcache.local set to string \OC\Memcache\Redis
Feb 25 18:15:08 Nextcloud-ASUS nextcloud.apache[816548]: No such app enabled: updatenotification
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[814912]: Making sure nextcloud is fully upgraded...
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[816741]: Nextcloud is already latest version
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[814706]: All set! Running httpd...
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[816749]: No certificates are active: using HTTP only
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[816749]: HTTP compression is disabled
Feb 25 18:15:09 Nextcloud-ASUS nextcloud.apache[816801]: AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 127.0.1.1. Set the 'ServerName' directive globally to suppress this message

Result: 0 hours, 0 minutes and 23 seconds
The duration is 0 hours, 0 minutes and 23 seconds

806 MB file testing yesterday.
By the time you take to decide where to put the download…

Is that roughly 5 seconds of traffic?

A full backup before reboot…

https://github.com/nextcloud-snap/nextcloud-snap/wiki/How-to-backup-your-instance#start-of-content

I have this…

[[quote=“hannah.sabir, post:1, topic:127882”] couldn't determine user name from uid 4294967295, [/quote]](https://[quote=“hannah.sabir, post:1, topic:127882”] couldn't determine user name from uid 4294967295, [/quote])

apache2 issue.
https://help.nextcloud.com/t/nextcloud-apache2-issue-need-to-discuss/147006?u=smokingwheels

Did full backup using snap nextcloud.export ~2 hours then ~2 hours to SSH 167 GB’s of folders and files no zip.

I use bitvise to copy the export as root to windows then logged in as a user and transferred back to a non Mirror area on my desktop NC server.

I am learning how to…
I have a remote NC server that I want to transfer to a laptop NC server in my home.

https://github.com/nextcloud-snap/nextcloud-snap/wiki/How-to-backup-your-instance#start-of-content

I got good download results with windows after terminating all updaters running in the background doing a slow disk read with no write. I tried my Linux Desktop a test NC 25 Mirror setup.

Note: The terminals with black backgrounds are on Windows looking at the Notebook NC 25 server. I normally SSH from the IP displayed at the top of the window to another IP.

Also there is a files open warning in the debug log with suggestion…The network setting in both Linux OS have not been changed so far. Its the Desktop version with Live Patch enabled.
https://ubuntu.com/pro

Free Personal Token

Up to 5 machines.

Testing: download = Linux to Linux.
Note: This is with the RamDrive in use.

When the php-fpm iotop stat sits at 99.9% towards the end of a 10.5 GB single file browser download to my Linux NC 25 with a thinlinc session the transfer rate slows down, also in windows as well.

The receiver is a NC 25 and has a 1TB 3.5 " 7200 rpm drive.

needs fixing.
Raw disk image (application/x-raw-disk-image)
2022-09-22-raspios-bullseye-armhf-full.img
11.1 GB (11,102,322,688 bytes)

This pic below is just before the download speed drops down to 2.5 - 5 mb/s while the CPU has to wind up again.

There is a cheat = don’t click save data in location until the network traffic has passed…

Also note in the picture you are looking at 2 separate systems…Done by using a ThinLinc remote session.

Tested Linux to Linux transfer http including wget.

looks very close to saturating. a 1 Gbs * 2 consumer grade 8 Port Switches cat 6.
I will have to find my 5 m cat 5 xover cable today and test later on. after I research Windows SATA to network speed issues.

Note: This is with the RamDrive in use.

john@cloud-party:~/temp7200$ wget http://192.168.1.52/index.php/s/B7S/download

Connecting to 192.168.1.52:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2459566080 (2.3G) [application/octet-stream]
Saving to: ‘download’

download               100%[============================>]   2.29G   111MB/s    in 24s     

2023-02-27 05:39:05 (98.1 MB/s) - ‘download’ saved [2459566080/2459566080]

Bandwidth converter

https://toolstud.io/data/bandwidth.php?compare=harddisk&speed=1&speed_unit=Gbps

Assumes 100 % efficient.

Convert data/time
bits per second
1 Gbps
SI decimal
125 MB/s = 7.5 GB/min = 450 GB/hr = 10.8 TB/day = 75.6 TB/wk = 324 TB/mo = 3.94 PB/yr
1 MB = megabyte = 106 = 1 000 000 bytes
SI binary
119.2 MiB/s = 6.98 GiB/min = 419.1 GiB/hr = 9.82 TiB/day = 68.8 TiB/wk = 294.7 TiB/mo = 3.5 PiB/yr
1 MiB = mebibyte = 220 = 1 048 576 bytes

I don’t really know whether Linux displays the units in SI decimal or SI binary?? Never had to look at that before.
Wget displays both.

wget http to i5 desktop 3.5 inch HDD with Ubuntu Pro (esm-apps) patched enabled.

john@cloud-party:~/temp7200$ = 7200 RPM storage.
wget 2023-02-27 05:51:07-- 
raspios-bullseye-armhf-full.img 10 GB.
 
2poFyLCB/download/2022-09-22-raspios-bullseye-armhf-full.img
Connecting to :80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 11102322688 (10G) [application/octet-stream]
Saving to: ‘2022-09-22-raspios-bullseye-armhf-full.img’

2022-09-22-raspios-bul 100%[============================>]  10.34G  32.8MB/s    in 4m 47s  

2023-02-27 05:55:54 (36.9 MB/s) - ‘2022-09-22-raspios-bullseye-armhf-full.img’ saved [11102322688/11102322688]

\Note: This is with the RamDrive in use.

You can see actually see in realtime after all the cache is exhausted everywhere the NC CPU will wind up to full load for some time (rated at 4 is dependant on CPU type) with the download slowed to ~5 mb/s to 2.5 mb/s then the transfer rate picks up again.

REF FFMpeg: In 2018 I turned 150 k photos off an iphone 4 into about 17 or 18 videos seperate videos with just frame after frame to MP4. Using tools from Linux and Windows office.

The problem I had in 2018 is in the time taken to synchronize locally with the NC server with the same new data generated on 1 Linux Client or with 2 other Windows clients connected to the same account. Also the same delay applies for each Windows client making changes to turn up on the other 2.

At that stage I had only been using NC 12 on a Pentium 4 1 GB for a about a year.

Mirror Cloud Multi PC same user case
Tested already small scale still running a NC 25 in virtual machine between 2 locations ~200 km apart 3 PC’s in total, I have the NC 25 cloud data on 1 Linux box locally and 1 Windows box locally to process the footage like adding single photos to an MP4 video and editing the short draft video footage I took at the event on the night.

The process was create a DVD iso of the event this was done after I returned home.
I did processed the draft footage twice while at the remote event the I stayed 2 days afterwards. To previewed the draft video to the family as MP4 shared thru a Plex server to there TV.

rem come back here edit.

After the 2nd lot of remote processing using the virtual 2 CPU NC 25 host with ffmpeg installed on the Mirror side of the NC server.

rem NC to change location and move NC 25 cloud to NC 25 local. Can be shutdown till needed again or minor changes.

NC 25 server testing.

The HDD’s that I have the Nextcloud Server on is a 2.5 inch SATA 3 rated at SATA 3 connection is up advised a lot to 140 mb/s.

I will find the specs on the Mainboards, so I can see what I have so far.

I have the option at the local NC 25 server end is to try *Ubuntu Pro (esm-apps --beta). I will Later on after I have a go at Windows SATA issues.

Needed:
Just a few tests without the Ramdisk enabled later on after I have tested to transfer rate behavior on a few other devices.

I think I have 2 * 2 core duo PC’s with earlier versions of Ubuntu.

1 is a backup, I used some time ago when the RTC stopped in my intel Core 2 Quad desktop.

Notes:
I need to move Pic’s later on. Forum sync preview is ok this way.
It gets out if you move the right hand contents.