NCP supports SATA, yes.
I just uploaded another rockpro image two days ago
I always recommend BTRFS, if you use the wizard or ncp tools to format USB that’s the default.
Of course, this is a 100% functional NextCloudPi instance
NCP supports SATA, yes.
I just uploaded another rockpro image two days ago
I always recommend BTRFS, if you use the wizard or ncp tools to format USB that’s the default.
Of course, this is a 100% functional NextCloudPi instance
Sorry, not clear with my question. What I meant to ask was do the native tools (Formatting disks, configuring and managing backups, etc) support SATA drives, or should I have to do those tasks on my own.
I do know that I can use a SATA drive with NCP as I have a Popcorn Hour Transformer setup as my main NCP server now.
I’ll download the new image before I set up my RockPro64.
Thanks!
Yes, SATA is fully supported
Motherboard: Supermicro X8DT3
CPU: 2 x Intel® Xeon® CPU X5570 @ 2.93GHz
Memory: 16 GB DIMM DDR3 1066 MHz (0.9 ns) ECC
Controllercard: MegaRaid SAS/SATA
all that for less than 200$ and its damn fast secure klick link for images.
I’m trying to compile a list of “Oldie but Goodie” Mini-Tower PCs over here. Such PC’s would also run Nextcloud well, as Nextcloud is lightweight enough to run on PC’s about 8 years old.
Do you know something about consumption of this box? Point to use ARM is lower Power consumption.
By the way, also cheap HW based on Asrock J4205ITX (x86, Mini-ITX) around 210 € without HDDs:
https://www.golem.de/news/freenas-und-windows-10-der-erste-nas-selbstbau-macht-gluecklich-1903-139995.html
Looks ok. Good price.
I have similar set-up with celeron 3865u soc board, 8GB ram and ssd.
On idle I get around 5-6W of power consumption and up to 15W under heavy load.
And it is comparable to my router Nighthawk R7000 power consumption (5-6W in idle, up to 12W on heavy load).
Looks like we have a new champion with the RasberryPI4
Hi…I have decided to play and see how software Raid plays with a Sata port multiplier on my I5 running Ubuntu.
Then when I get one of those boards or maybe it might actually be a rom swap on a tv-box to name drop rk3399 once more I will have some comparison.
Yes, but price of 4GB version is not 35$, but around 60$.
I am looking to buy either a RockPro64 or Odroid HC2 for running Nextcloud. Which one would be better? I will soon have a spare Intel i5 2500K with 24 GB of RAM but I am really concerned about the power consumption. I will also have to buy a new cabinet and power supply if I want to use the 2500K as a server, since the existing one will be used in a new Ryzen system.
What should I do? Its Just for 3-4 users, with mobile phones. I have been using Rpi 2, and somehow getting by, but I want something faster. Rpi 4 seems like an option too now but I am not sure. I have 2 1TB SATA HDD available with me. I will use just one and use the second for periodic backups. Also have USB enclosures for both of them.
Rockpi4 with Marvell 9235 4 port sata
Ok got some disks 4x Integral SSD 120gb P5 as that should been the card is the bottleneck.
Couldn’t afford anything more really as x4 gets a bit expensive.
Staring with Debian-stretch-4.4-latest and mdadm going to try a raid10
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 20355 28533 43513 44568 22556 28612
102400 16 60835 71891 111520 107540 66074 71640
102400 512 149988 129385 253123 263113 211684 131649
102400 1024 161360 164943 274007 275765 253893 165764
102400 16384 181646 182851 338294 347395 342601 176768
rock@rockpi4:~$ cat /proc/mdstat
Personalities : [raid0] [raid10]
md0 : active raid10 sdd[3] sdc[2] sdb[1] sda[0]
234309632 blocks super 1.2 512K chunks 2 near-copies [4/4] [UUUU]
[===========>.........] resync = 55.4% (129931520/234309632) finish=8.5min speed=202624K/sec
bitmap: 2/2 pages [8KB], 65536KB chunk
Jul 4 13:46:45 rockpi4 kernel: [ 75.172062] md0: detected capacity change from 479866126336 to 0
Jul 4 13:46:45 rockpi4 kernel: [ 75.172628] md: md0 stopped.
Jul 4 13:46:45 rockpi4 kernel: [ 75.173397] md: unbind<sda>
Jul 4 13:46:45 rockpi4 kernel: [ 75.190852] md: export_rdev(sda)
Jul 4 13:46:45 rockpi4 kernel: [ 75.191282] md: unbind<sdd>
Jul 4 13:46:45 rockpi4 kernel: [ 75.206849] md: export_rdev(sdd)
Jul 4 13:46:45 rockpi4 kernel: [ 75.207325] md: unbind<sdb>
Jul 4 13:46:45 rockpi4 udisksd[565]: Unable to resolve /sys/devices/virtual/block/md0/md/dev-sdb/block symlink
Jul 4 13:46:45 rockpi4 kernel: [ 75.239056] md: export_rdev(sdb)
Jul 4 13:46:45 rockpi4 kernel: [ 75.239439] md: unbind<sdc>
Jul 4 13:46:45 rockpi4 kernel: [ 75.254837] md: export_rdev(sdc)
Jul 4 13:47:12 rockpi4 kernel: [ 102.258308] sdc: sdc1 sdc2
Jul 4 13:47:12 rockpi4 kernel: [ 102.288150] sdc: sdc1 sdc2
Jul 4 13:48:09 rockpi4 kernel: [ 159.300017] md: bind<sda>
Jul 4 13:48:09 rockpi4 kernel: [ 159.308923] md: bind<sdb>
Jul 4 13:48:09 rockpi4 kernel: [ 159.319055] md: bind<sdc>
Jul 4 13:48:09 rockpi4 kernel: [ 159.320188] md: bind<sdd>
Jul 4 13:48:09 rockpi4 kernel: [ 159.326830] md/raid0:md0: md_size is 937238528 sectors.
Jul 4 13:48:09 rockpi4 kernel: [ 159.327314] md: RAID0 configuration for md0 - 1 zone
Jul 4 13:48:09 rockpi4 kernel: [ 159.327759] md: zone0=[sda/sdb/sdc/sdd]
Jul 4 13:48:09 rockpi4 kernel: [ 159.328165] zone-offset= 0KB, device-offset= 0KB, size= 468619264KB
Jul 4 13:48:09 rockpi4 kernel: [ 159.328937] sdc: sdc1 sdc2
Jul 4 13:48:09 rockpi4 kernel: [ 159.329369]
Jul 4 13:48:09 rockpi4 kernel: [ 159.330145] md0: detected capacity change from 0 to 479866126336
Jul 4 13:48:09 rockpi4 udisksd[565]: Error creating watch for file /sys/devices/virtual/block/md0/md/sync_action: No such file or directory (g-file-error-quark, 4)
Jul 4 13:48:09 rockpi4 udisksd[565]: Error creating watch for file /sys/devices/virtual/block/md0/md/degraded: No such file or directory (g-file-error-quark, 4)
Jul 4 13:49:40 rockpi4 kernel: [ 250.355809] EXT4-fs (md0): mounted filesystem with ordered data mode. Opts: (null)
Jul 4 13:55:31 rockpi4 kernel: [ 601.335494] panel disable
Jul 4 14:02:26 rockpi4 anacron[1047]: Anacron 2.3 started on 2019-07-04
Jul 4 14:02:26 rockpi4 anacron[1047]: Normal exit (0 jobs run)
Jul 4 14:02:59 rockpi4 kernel: [ 1049.309314] md0: detected capacity change from 479866126336 to 0
Jul 4 14:02:59 rockpi4 kernel: [ 1049.309886] md: md0 stopped.
Jul 4 14:02:59 rockpi4 kernel: [ 1049.310176] md: unbind<sdd>
Jul 4 14:02:59 rockpi4 kernel: [ 1049.327147] md: export_rdev(sdd)
Jul 4 14:02:59 rockpi4 kernel: [ 1049.327821] md: unbind<sdc>
Jul 4 14:02:59 rockpi4 kernel: [ 1049.350959] md: export_rdev(sdc)
Jul 4 14:02:59 rockpi4 kernel: [ 1049.351512] md: unbind<sdb>
Jul 4 14:02:59 rockpi4 udisksd[565]: Unable to resolve /sys/devices/virtual/block/md0/md/dev-sdb/block symlink
Jul 4 14:02:59 rockpi4 kernel: [ 1049.366971] md: export_rdev(sdb)
Jul 4 14:02:59 rockpi4 kernel: [ 1049.367513] md: unbind<sda>
Jul 4 14:02:59 rockpi4 kernel: [ 1049.383124] md: export_rdev(sda)
Jul 4 14:03:21 rockpi4 kernel: [ 1071.066678] sdc: sdc1 sdc2
Jul 4 14:03:21 rockpi4 kernel: [ 1071.092394] sdc: sdc1 sdc2
Jul 4 14:05:23 rockpi4 kernel: [ 1193.551804] md: bind<sda>
Jul 4 14:05:23 rockpi4 kernel: [ 1193.552267] sdc: sdc1 sdc2
Jul 4 14:05:23 rockpi4 kernel: [ 1193.552547] md: bind<sdb>
Jul 4 14:05:23 rockpi4 kernel: [ 1193.553780] md: bind<sdc>
Jul 4 14:05:23 rockpi4 kernel: [ 1193.554266] md: bind<sdd>
Jul 4 14:05:23 rockpi4 kernel: [ 1193.570556] md: raid10 personality registered for level 10
Jul 4 14:05:23 rockpi4 kernel: [ 1193.573138] md/raid10:md0: not clean -- starting background reconstruction
Jul 4 14:05:23 rockpi4 kernel: [ 1193.573765] md/raid10:md0: active with 4 out of 4 devices
Jul 4 14:05:23 rockpi4 kernel: [ 1193.575635] created bitmap (2 pages) for device md0
Jul 4 14:05:23 rockpi4 kernel: [ 1193.578102] md0: bitmap initialized from disk: read 1 pages, set 3576 of 3576 bits
Jul 4 14:05:23 rockpi4 kernel: [ 1193.581797] md0: detected capacity change from 0 to 239933063168
Jul 4 14:05:23 rockpi4 kernel: [ 1193.583297] md: md0 switched to read-write mode.
Jul 4 14:05:23 rockpi4 kernel: [ 1193.588652] md: resync of RAID array md0
Jul 4 14:05:23 rockpi4 kernel: [ 1193.589019] md: minimum _guaranteed_ speed: 1000 KB/sec/disk.
Jul 4 14:05:23 rockpi4 kernel: [ 1193.589541] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for resync.
Jul 4 14:05:23 rockpi4 kernel: [ 1193.590381] md: using 128k window, over a total of 234309632k.
Jul 4 14:25:02 rockpi4 kernel: [ 2372.292473] md: md0: resync done.
Jul 4 14:25:02 rockpi4 kernel: [ 2372.452970] RAID10 conf printout:
Jul 4 14:25:02 rockpi4 kernel: [ 2372.452989] --- wd:4 rd:4
Jul 4 14:25:02 rockpi4 kernel: [ 2372.452998] disk 0, wo:0, o:1, dev:sda
Jul 4 14:25:02 rockpi4 kernel: [ 2372.453005] disk 1, wo:0, o:1, dev:sdb
Jul 4 14:25:02 rockpi4 kernel: [ 2372.453012] disk 2, wo:0, o:1, dev:sdc
Jul 4 14:25:02 rockpi4 kernel: [ 2372.453019] disk 3, wo:0, o:1, dev:sdd
Jul 4 14:30:45 rockpi4 kernel: [ 2715.470782] EXT4-fs (md0): mounted filesystem with ordered data mode. Opts: (null)
RAID5
rock@rockpi4:~$ sudo mdadm --create --verbose /dev/md0 --level=5 --raid-devices=4 /dev/sda /dev/sdb /dev/sdc /dev/sdd
mdadm: layout defaults to left-symmetric
mdadm: layout defaults to left-symmetric
mdadm: chunk size defaults to 512K
mdadm: /dev/sdc appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 00:00:00 1970
mdadm: partition table exists on /dev/sdc but will be lost or
meaningless after creating array
mdadm: size set to 117154816K
mdadm: automatically enabling write-intent bitmap on large array
Continue creating array? y
mdadm: Defaulting to version 1.2 metadata
mdadm: array /dev/md0 started.
rock@rockpi4:~$ cat /proc/mdstat
Personalities : [raid10] [raid6] [raid5] [raid4]
md0 : active raid5 sdd[4] sdc[2] sdb[1] sda[0]
351464448 blocks super 1.2 level 5, 512k chunk, algorithm 2 [4/3] [UUU_]
[>....................] recovery = 1.6% (1898560/117154816) finish=19.2min speed=99924K/sec
bitmap: 0/1 pages [0KB], 65536KB chunk
Jul 4 14:49:52 rockpi4 kernel: [ 491.913061] md: bind<sda>
Jul 4 14:49:52 rockpi4 kernel: [ 491.913784] md: bind<sdb>
Jul 4 14:49:52 rockpi4 kernel: [ 491.914381] md: bind<sdc>
Jul 4 14:49:52 rockpi4 kernel: [ 491.914971] md: bind<sdd>
Jul 4 14:49:52 rockpi4 kernel: [ 491.920396] sdc: sdc1 sdc2
Jul 4 14:49:52 rockpi4 kernel: [ 491.929530] async_tx: api initialized (async)
Jul 4 14:49:52 rockpi4 kernel: [ 491.952339] md: raid6 personality registered for level 6
Jul 4 14:49:52 rockpi4 kernel: [ 491.952833] md: raid5 personality registered for level 5
Jul 4 14:49:52 rockpi4 kernel: [ 491.953316] md: raid4 personality registered for level 4
Jul 4 14:49:52 rockpi4 kernel: [ 491.959926] md/raid:md0: device sdc operational as raid disk 2
Jul 4 14:49:52 rockpi4 kernel: [ 491.960484] md/raid:md0: device sdb operational as raid disk 1
Jul 4 14:49:52 rockpi4 kernel: [ 491.961025] md/raid:md0: device sda operational as raid disk 0
Jul 4 14:49:52 rockpi4 kernel: [ 491.962943] md/raid:md0: allocated 4384kB
Jul 4 14:49:52 rockpi4 kernel: [ 491.964488] md/raid:md0: raid level 5 active with 3 out of 4 devices, algorithm 2
Jul 4 14:49:52 rockpi4 kernel: [ 491.965161] RAID conf printout:
Jul 4 14:49:52 rockpi4 kernel: [ 491.965169] --- level:5 rd:4 wd:3
Jul 4 14:49:52 rockpi4 kernel: [ 491.965177] disk 0, o:1, dev:sda
Jul 4 14:49:52 rockpi4 kernel: [ 491.965183] disk 1, o:1, dev:sdb
Jul 4 14:49:52 rockpi4 kernel: [ 491.965188] disk 2, o:1, dev:sdc
Jul 4 14:49:52 rockpi4 kernel: [ 491.965603] created bitmap (1 pages) for device md0
Jul 4 14:49:52 rockpi4 kernel: [ 491.966746] md0: bitmap initialized from disk: read 1 pages, set 1788 of 1788 bits
Jul 4 14:49:52 rockpi4 kernel: [ 491.968765] md0: detected capacity change from 0 to 359899594752
Jul 4 14:49:52 rockpi4 kernel: [ 491.969465] md: md0 switched to read-write mode.
Jul 4 14:49:52 rockpi4 kernel: [ 491.969930] RAID conf printout:
Jul 4 14:49:52 rockpi4 kernel: [ 491.969951] --- level:5 rd:4 wd:3
Jul 4 14:49:52 rockpi4 kernel: [ 491.969968] disk 0, o:1, dev:sda
Jul 4 14:49:52 rockpi4 kernel: [ 491.969984] disk 1, o:1, dev:sdb
Jul 4 14:49:52 rockpi4 kernel: [ 491.969997] disk 2, o:1, dev:sdc
Jul 4 14:49:52 rockpi4 kernel: [ 491.970009] disk 3, o:1, dev:sdd
Jul 4 14:49:52 rockpi4 kernel: [ 491.980149] md: recovery of RAID array md0
Jul 4 14:49:52 rockpi4 kernel: [ 491.980523] md: minimum _guaranteed_ speed: 1000 KB/sec/disk.
Jul 4 14:49:52 rockpi4 kernel: [ 491.981044] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery.
Jul 4 14:49:52 rockpi4 kernel: [ 491.981894] md: using 128k window, over a total of 117154816k.
Jul 4 14:51:41 rockpi4 kernel: [ 601.050246] panel disable
Jul 4 15:00:30 rockpi4 anacron[1052]: Anacron 2.3 started on 2019-07-04
Jul 4 15:00:30 rockpi4 anacron[1052]: Normal exit (0 jobs run)
Jul 4 15:05:53 rockpi4 kernel: [ 1453.287257] md: md0: recovery done.
Jul 4 15:05:53 rockpi4 kernel: [ 1453.567652] RAID conf printout:
Jul 4 15:05:53 rockpi4 kernel: [ 1453.567661] --- level:5 rd:4 wd:4
Jul 4 15:05:53 rockpi4 kernel: [ 1453.567666] disk 0, o:1, dev:sda
Jul 4 15:05:53 rockpi4 kernel: [ 1453.567670] disk 1, o:1, dev:sdb
Jul 4 15:05:53 rockpi4 kernel: [ 1453.567674] disk 2, o:1, dev:sdc
Jul 4 15:05:53 rockpi4 kernel: [ 1453.567677] disk 3, o:1, dev:sdd
Jul 4 15:07:07 rockpi4 kernel: [ 1527.108599] EXT4-fs (md0): mounted filesystem with ordered data mode. Opts: (null)
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 8159 8947 43789 42643 24543 10212
102400 16 33078 40985 98244 98407 70763 41851
102400 512 52870 53418 212184 202157 203772 50657
102400 1024 66426 69555 250660 250200 249607 69539
102400 16384 108537 112300 326090 324173 320777 106363
RAID1
rock@rockpi4:~$ sudo mdadm --create --verbose /dev/md0 --level=1 --raid-devices=2 /dev/sda /dev/sdb
mdadm: Note: this array has metadata at the start and
may not be suitable as a boot device. If you plan to
store '/boot' on this device please ensure that
your boot-loader understands md/v1.x metadata, or use
--metadata=0.90
mdadm: size set to 117155264K
mdadm: automatically enabling write-intent bitmap on large array
Continue creating array? y
mdadm: Defaulting to version 1.2 metadata
mdadm: array /dev/md0 started.
rock@rockpi4:~$ cat /proc/mdstat
Personalities : [raid10] [raid6] [raid5] [raid4] [raid1]
md0 : active raid1 sdb[1] sda[0]
117155264 blocks super 1.2 [2/2] [UU]
[>....................] resync = 2.3% (2801408/117155264) finish=8.8min speed=215492K/sec
bitmap: 1/1 pages [4KB], 65536KB chunk
unused devices: <none>
Jul 4 15:20:25 rockpi4 kernel: [ 2324.757953] md: bind<sda>
Jul 4 15:20:25 rockpi4 kernel: [ 2324.759742] md: bind<sdb>
Jul 4 15:20:25 rockpi4 kernel: [ 2324.772561] md: raid1 personality registered for level 1
Jul 4 15:20:25 rockpi4 kernel: [ 2324.783910] md/raid1:md0: not clean -- starting background reconstruction
Jul 4 15:20:25 rockpi4 kernel: [ 2324.784534] md/raid1:md0: active with 2 out of 2 mirrors
Jul 4 15:20:25 rockpi4 kernel: [ 2324.785261] created bitmap (1 pages) for device md0
Jul 4 15:20:25 rockpi4 kernel: [ 2324.787956] md0: bitmap initialized from disk: read 1 pages, set 1788 of 1788 bits
Jul 4 15:20:25 rockpi4 kernel: [ 2324.790798] md0: detected capacity change from 0 to 119966990336
Jul 4 15:20:25 rockpi4 kernel: [ 2324.791556] md: md0 switched to read-write mode.
Jul 4 15:20:25 rockpi4 kernel: [ 2324.794162] md: resync of RAID array md0
Jul 4 15:20:25 rockpi4 kernel: [ 2324.794546] md: minimum _guaranteed_ speed: 1000 KB/sec/disk.
Jul 4 15:20:25 rockpi4 kernel: [ 2324.795124] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for resync.
Jul 4 15:20:25 rockpi4 kernel: [ 2324.795964] md: using 128k window, over a total of 117155264k.
Jul 4 15:30:14 rockpi4 kernel: [ 2913.737079] md: md0: resync done.
Jul 4 15:30:14 rockpi4 kernel: [ 2913.745998] RAID1 conf printout:
Jul 4 15:30:14 rockpi4 kernel: [ 2913.746016] --- wd:2 rd:2
Jul 4 15:30:14 rockpi4 kernel: [ 2913.746027] disk 0, wo:0, o:1, dev:sda
Jul 4 15:30:14 rockpi4 kernel: [ 2913.746035] disk 1, wo:0, o:1, dev:sdb
Jul 4 15:31:19 rockpi4 kernel: [ 2978.675630] EXT4-fs (md0): mounted filesystem with ordered data mode. Opts: (null)
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 24759 31559 39765 41196 25476 30710
102400 16 62662 73245 124756 125744 62209 72778
102400 512 139397 160038 260433 261606 218154 147652
102400 1024 165815 155189 258119 261744 232643 164702
102400 16384 172905 186702 318211 322998 321997 170680
RAID0
rock@rockpi4:~$ sudo mdadm --create --verbose /dev/md0 --level=0 --raid-devices=4 /dev/sda /dev/sdb /dev/sdc /dev/sdd
mdadm: chunk size defaults to 512K
mdadm: /dev/sdc appears to be part of a raid array:
level=raid0 devices=0 ctime=Thu Jan 1 00:00:00 1970
mdadm: partition table exists on /dev/sdc but will be lost or
meaningless after creating array
Continue creating array? y
mdadm: Defaulting to version 1.2 metadata
mdadm: array /dev/md0 started.
rock@rockpi4:~$ cat /proc/mdstat
Personalities : [raid10] [raid6] [raid5] [raid4] [raid1] [raid0]
md0 : active raid0 sdd[3] sdc[2] sdb[1] sda[0]
468619264 blocks super 1.2 512k chunks
unused devices: <none>
Jul 4 15:38:35 rockpi4 kernel: [ 3415.084442] md: bind<sda>
Jul 4 15:38:35 rockpi4 kernel: [ 3415.085523] md: bind<sdb>
Jul 4 15:38:35 rockpi4 kernel: [ 3415.086511] md: bind<sdc>
Jul 4 15:38:35 rockpi4 kernel: [ 3415.087930] md: bind<sdd>
Jul 4 15:38:35 rockpi4 kernel: [ 3415.101830] md: raid0 personality registered for level 0
Jul 4 15:38:35 rockpi4 kernel: [ 3415.101836] sdc: sdc1 sdc2
Jul 4 15:38:35 rockpi4 kernel: [ 3415.107953] md/raid0:md0: md_size is 937238528 sectors.
Jul 4 15:38:35 rockpi4 kernel: [ 3415.108427] md: RAID0 configuration for md0 - 1 zone
Jul 4 15:38:35 rockpi4 kernel: [ 3415.108866] md: zone0=[sda/sdb/sdc/sdd]
Jul 4 15:38:35 rockpi4 kernel: [ 3415.109261] zone-offset= 0KB, device-offset= 0KB, size= 468619264KB
Jul 4 15:38:35 rockpi4 kernel: [ 3415.109973]
Jul 4 15:38:35 rockpi4 kernel: [ 3415.110235] md0: detected capacity change from 0 to 479866126336
Jul 4 15:38:35 rockpi4 udisksd[572]: Error creating watch for file /sys/devices/virtual/block/md0/md/sync_action: No such file or directory (g-file-error-quark, 4)
Jul 4 15:38:35 rockpi4 udisksd[572]: Error creating watch for file /sys/devices/virtual/block/md0/md/degraded: No such file or directory (g-file-error-quark, 4)
Jul 4 15:41:08 rockpi4 kernel: [ 3568.278677] EXT4-fs (md0): mounted filesystem with ordered data mode. Opts: (null)
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 31874 42784 44859 48796 26191 42465
102400 16 89104 112188 110570 114486 77652 111816
102400 512 248787 259180 258800 270097 227197 229707
102400 1024 309271 324243 293455 293122 268819 286143
102400 16384 373574 382208 324869 326204 326070 380622
Concurrent single disks
Command line used: iozone -l 4 -u 4 -r 16k -s 512M -F /home/rock/sda/tmp1 /home/rock/sdb/tmp2 /home/rock/sdc/tmp3 /home/rock/sdd/tmp4
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
Min process = 4
Max process = 4
Throughput test with 4 processes
Each process writes a 524288 kByte file in 16 kByte records
Children see throughput for 4 initial writers = 468982.85 kB/sec
Parent sees throughput for 4 initial writers = 391562.16 kB/sec
Min throughput per process = 115979.48 kB/sec
Max throughput per process = 118095.79 kB/sec
Avg throughput per process = 117245.71 kB/sec
Min xfer = 513488.00 kB
Children see throughput for 4 rewriters = 448753.70 kB/sec
Parent sees throughput for 4 rewriters = 378103.46 kB/sec
Min throughput per process = 108174.91 kB/sec
Max throughput per process = 119841.15 kB/sec
Avg throughput per process = 112188.42 kB/sec
Min xfer = 472992.00 kB
Children see throughput for 4 readers = 319857.60 kB/sec
Parent sees throughput for 4 readers = 319587.93 kB/sec
Min throughput per process = 78386.40 kB/sec
Max throughput per process = 81170.33 kB/sec
Avg throughput per process = 79964.40 kB/sec
Min xfer = 506336.00 kB
Children see throughput for 4 re-readers = 331737.53 kB/sec
Parent sees throughput for 4 re-readers = 331539.26 kB/sec
Min throughput per process = 74617.11 kB/sec
Max throughput per process = 90278.13 kB/sec
Avg throughput per process = 82934.38 kB/sec
Min xfer = 433360.00 kB
Children see throughput for 4 reverse readers = 769042.86 kB/sec
Parent sees throughput for 4 reverse readers = 768023.53 kB/sec
Min throughput per process = 43320.77 kB/sec
Max throughput per process = 262961.66 kB/sec
Avg throughput per process = 192260.72 kB/sec
Min xfer = 86384.00 kB
Children see throughput for 4 stride readers = 1795856.09 kB/sec
Parent sees throughput for 4 stride readers = 1781767.61 kB/sec
Min throughput per process = 65569.88 kB/sec
Max throughput per process = 920383.50 kB/sec
Avg throughput per process = 448964.02 kB/sec
Min xfer = 37360.00 kB
Children see throughput for 4 random readers = 1971409.70 kB/sec
Parent sees throughput for 4 random readers = 1958188.18 kB/sec
Min throughput per process = 69869.92 kB/sec
Max throughput per process = 861175.75 kB/sec
Avg throughput per process = 492852.43 kB/sec
Min xfer = 41904.00 kB
Children see throughput for 4 mixed workload = 1176863.17 kB/sec
Parent sees throughput for 4 mixed workload = 275991.88 kB/sec
Min throughput per process = 98414.23 kB/sec
Max throughput per process = 606498.81 kB/sec
Avg throughput per process = 294215.79 kB/sec
Min xfer = 84304.00 kB
Children see throughput for 4 random writers = 428459.84 kB/sec
Parent sees throughput for 4 random writers = 318774.34 kB/sec
Min throughput per process = 96696.56 kB/sec
Max throughput per process = 118440.29 kB/sec
Avg throughput per process = 107114.96 kB/sec
Min xfer = 428352.00 kB
Children see throughput for 4 pwrite writers = 467800.79 kB/sec
Parent sees throughput for 4 pwrite writers = 381736.33 kB/sec
Min throughput per process = 111798.68 kB/sec
Max throughput per process = 120814.23 kB/sec
Avg throughput per process = 116950.20 kB/sec
Min xfer = 485168.00 kB
Children see throughput for 4 pread readers = 309714.87 kB/sec
Parent sees throughput for 4 pread readers = 309501.91 kB/sec
Min throughput per process = 76447.56 kB/sec
Max throughput per process = 79120.13 kB/sec
Avg throughput per process = 77428.72 kB/sec
Min xfer = 506592.00 kB
Children see throughput for 4 fwriters = 442763.85 kB/sec
Parent sees throughput for 4 fwriters = 373418.60 kB/sec
Min throughput per process = 107828.45 kB/sec
Max throughput per process = 114495.70 kB/sec
Avg throughput per process = 110690.96 kB/sec
Min xfer = 524288.00 kB
Children see throughput for 4 freaders = 331765.48 kB/sec
Parent sees throughput for 4 freaders = 325459.39 kB/sec
Min throughput per process = 81387.83 kB/sec
Max throughput per process = 86099.32 kB/sec
Avg throughput per process = 82941.37 kB/sec
Min xfer = 524288.00 kB
single disk sda
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 36038 45031 52457 52672 27342 44553
102400 16 93224 115531 124822 114115 79868 115219
102400 512 249415 223799 267595 273488 227651 258480
102400 1024 259449 236700 268852 273148 242803 266988
102400 16384 313281 317096 324922 325600 319687 267843
single disk sdb
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 33918 45021 52628 52655 27404 44621
102400 16 100152 106531 127148 115452 76579 113503
102400 512 251035 259812 272338 273634 227332 225607
102400 1024 260791 268019 273578 276074 241042 268323
102400 16384 267448 316877 323467 324679 319983 316710
single disk sdc
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 36074 44819 52358 52592 23334 44073
102400 16 92510 114568 127346 126830 72293 112819
102400 512 220032 260191 271136 274745 225818 258574
102400 1024 258895 228236 270047 271946 239184 267370
102400 16384 312151 316425 318919 323689 317570 268308
single disk sdd
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 36100 44939 52756 52768 27569 42697
102400 16 100207 111073 127120 118992 76555 105342
102400 512 248869 259052 271718 272745 227450 258252
102400 1024 226653 266979 262772 265104 236617 266018
102400 16384 314211 269062 322937 325634 320150 315470
There are quite a few Armsoc boards with PCIe now and that is probably the biggest criteria.
I love the form factor of the rockpi4 as it was a Pi with a RK3399 and a hell of a lot crammed in.
The m.2 boards make extremely tidy solutions but the RockPro64 does have a full size PCIex4 not sure of any others that do.
It can be quite tricky with fuller size boards because obviously an Armsoc doesn’t have a bios and uses uboot.
So you want ‘biosless’ cards whatever the interface and control is via the bios to initialise a card is called you don’t want as its likely it will prob not work.
The cheaper ‘non boot’ cards are more likely to have no bios interface and work.
I haven’t got my Rockpro64 anymore as I lost interest with the slow progress of a working mainline rather than board manufacturer images based on backports.
5.2 sees Panfrost but might be 5.3 but finally it happened so apols Pine if my attention span deteriorated, but a x2/x4 lane Pcie Sata card might be the best option for price & performance.
I can say the Marvell 9235 4 port sata works quite well on the RockPi4 as you have the above benchmarks.
Well it really helps speed things up if you enable pcie2 and not run tests at pcie1 speeds.
Also if you are a plonker and forget to edit /boot/hw_intfc.conf
from #intfc:dtoverlay=pcie-gen2
to intfc:dtoverlay=pcie-gen2
you will be running on pcie-gen1
RAID 10
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 11719 15447 55220 53720 25421 12773
102400 16 39410 54840 139482 145128 81258 43792
102400 512 228002 220126 334104 339660 265930 225507
102400 1024 244376 243730 451377 462467 397566 258481
102400 16384 270088 304411 597462 610057 615669 297855
RAID 5
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 6133 6251 47505 46013 25046 8190
102400 16 17103 17134 113272 133606 79753 20420
102400 512 61418 50852 241860 246467 244030 58031
102400 1024 79325 73325 363343 359830 361882 83655
102400 16384 127548 124702 625256 642094 650407 136680
RAID 1
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 23713 29698 45608 45983 23657 30381
102400 16 79205 82546 138060 144557 82126 93921
102400 512 212859 221943 307613 304036 259783 179355
102400 1024 235985 243783 366101 369935 317354 198861
102400 16384 289036 290279 410520 398875 399868 295329
RAID 0
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 33519 47927 52701 51023 26700 46382
102400 16 105763 132604 138080 155514 87026 135111
102400 512 276220 320320 311343 294629 267624 335363
102400 1024 493565 522038 463105 470833 398584 522560
102400 16384 687516 701200 625733 623531 555318 681535
4 individual disk concurrent
Command line used: iozone -l 4 -u 4 -r 16k -s 512M -F /srv/dev-disk-by-label-sda/tmp1 /srv/dev-disk-by-label-sdb/tmp2 /srv/dev-disk-by-label-sdc/tmp3 /srv/dev-disk-by-label-sdd/tmp4
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
Min process = 4
Max process = 4
Throughput test with 4 processes
Each process writes a 524288 kByte file in 16 kByte records
Children see throughput for 4 initial writers = 884590.91 kB/sec
Parent sees throughput for 4 initial writers = 701620.17 kB/sec
Min throughput per process = 195561.27 kB/sec
Max throughput per process = 234457.59 kB/sec
Avg throughput per process = 221147.73 kB/sec
Min xfer = 437344.00 kB
Children see throughput for 4 rewriters = 822771.77 kB/sec
Parent sees throughput for 4 rewriters = 701488.29 kB/sec
Min throughput per process = 180381.25 kB/sec
Max throughput per process = 232223.50 kB/sec
Avg throughput per process = 205692.94 kB/sec
Min xfer = 408720.00 kB
Children see throughput for 4 readers = 755252.30 kB/sec
Parent sees throughput for 4 readers = 753357.02 kB/sec
Min throughput per process = 169105.11 kB/sec
Max throughput per process = 198976.81 kB/sec
Avg throughput per process = 188813.07 kB/sec
Min xfer = 445664.00 kB
Children see throughput for 4 re-readers = 753492.39 kB/sec
Parent sees throughput for 4 re-readers = 750353.64 kB/sec
Min throughput per process = 160626.64 kB/sec
Max throughput per process = 201223.11 kB/sec
Avg throughput per process = 188373.10 kB/sec
Min xfer = 418528.00 kB
Children see throughput for 4 reverse readers = 780261.86 kB/sec
Parent sees throughput for 4 reverse readers = 778761.55 kB/sec
Min throughput per process = 58371.02 kB/sec
Max throughput per process = 254657.08 kB/sec
Avg throughput per process = 195065.47 kB/sec
Min xfer = 120192.00 kB
Children see throughput for 4 stride readers = 317923.62 kB/sec
Parent sees throughput for 4 stride readers = 316905.36 kB/sec
Min throughput per process = 63171.63 kB/sec
Max throughput per process = 98114.27 kB/sec
Avg throughput per process = 79480.91 kB/sec
Min xfer = 337600.00 kB
Children see throughput for 4 random readers = 798898.78 kB/sec
Parent sees throughput for 4 random readers = 794905.95 kB/sec
Min throughput per process = 57059.89 kB/sec
Max throughput per process = 391248.59 kB/sec
Avg throughput per process = 199724.70 kB/sec
Min xfer = 76480.00 kB
Children see throughput for 4 mixed workload = 647158.06 kB/sec
Parent sees throughput for 4 mixed workload = 491223.65 kB/sec
Min throughput per process = 28319.04 kB/sec
Max throughput per process = 305288.75 kB/sec
Avg throughput per process = 161789.51 kB/sec
Min xfer = 48720.00 kB
Children see throughput for 4 random writers = 734947.98 kB/sec
Parent sees throughput for 4 random writers = 544531.66 kB/sec
Min throughput per process = 167241.00 kB/sec
Max throughput per process = 207134.38 kB/sec
Avg throughput per process = 183737.00 kB/sec
Min xfer = 424704.00 kB
Children see throughput for 4 pwrite writers = 879712.72 kB/sec
Parent sees throughput for 4 pwrite writers = 686621.58 kB/sec
Min throughput per process = 186624.69 kB/sec
Max throughput per process = 236047.30 kB/sec
Avg throughput per process = 219928.18 kB/sec
Min xfer = 415856.00 kB
Children see throughput for 4 pread readers = 777243.34 kB/sec
Parent sees throughput for 4 pread readers = 773302.81 kB/sec
Min throughput per process = 184983.08 kB/sec
Max throughput per process = 203392.77 kB/sec
Avg throughput per process = 194310.84 kB/sec
Min xfer = 476896.00 kB
Children see throughput for 4 fwriters = 820877.50 kB/sec
Parent sees throughput for 4 fwriters = 693823.17 kB/sec
Min throughput per process = 194228.28 kB/sec
Max throughput per process = 217311.28 kB/sec
Avg throughput per process = 205219.38 kB/sec
Min xfer = 524288.00 kB
Children see throughput for 4 freaders = 1924029.62 kB/sec
Parent sees throughput for 4 freaders = 1071393.99 kB/sec
Min throughput per process = 268087.50 kB/sec
Max throughput per process = 970331.94 kB/sec
Avg throughput per process = 481007.41 kB/sec
Min xfer = 524288.00 kB
Single disk sda reference
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 35191 45728 56689 53307 27889 48508
102400 16 104379 122405 154385 157484 88670 113964
102400 512 315788 347042 351932 348604 271399 288430
102400 1024 358399 366194 388893 379453 338470 369888
102400 16384 353154 443256 425396 422384 410580 444530
Check this russian forum: http://4pda.ru/forum/index.php?showtopic=916265 Summery it works very good, but quite hot, so you have to take big radiator and take care about air flows. Also you can added cards to have 4 SATA (not this that comes from Pine) based on Marvell 88SE9230 quite cheap from Aliexpress.
Yeah the RockPro64 is a great bit of kit with full size PCIex4 that means cards tend to be a little bit cheaper than their m.2 cousins.
You sure about the 88SE9230 and that its not a 88SE9235 as I test the 88SE9230 first and its not the embedded version and has bios functionality and didn’t work on the RockPi4.
Also has software settings accessible via bios or unfortunately only windows software, sent my 88SE9230 back and replaced it with a 88SE9235.
Same card without built in Raid and hybrid functionality but worked out of the box, but to be honest doesn’t matter as using software RAID that can configure a cache.
That seems to be the rule of thumb pcie.2.1 x1-4 lanes that are dumb bios-less cards and they work?
There are quite an array of rk3399 boards which are very similar so its all fed back and quite a strong platform.
https://www.friendlyarm.com/index.php?route=product/product&product_id=241
https://libre.computer/products/boards/roc-rk3399-pc/
and quite a few more
Looking at the system block diagram in the respective datasheets the difference is that the 9230 has a raid processor while the 9235 does not.
If you can get the 9235 for less bucks than a 9230 better choose 9235.
I would always avoid proprietary RAID stuff (since now the RAID controller becomes another single point of failure and if you don’t have an identical spare part around good luck if anything fails with the controller). And wrt encryption better choose encryption acceleration available at the host. That’s AES-NI on x86 for example or with 64-bit ARM boards ‘ARMv8 Crypto Extensions’.
Als 9235 works →
https://forum.pine64.org/showthread.php?tid=6486&pid=41736#pid41736
I’m currently doing the same thing but besides NC I want to run
all of them are well known to run e.g. on Raspberry Pi but the space requirements are not fully clarified yet.
I want to run databases/cache on the eMMC (Rockpro64 support up to 128GB but properly pricy, others come with 16GB or 32GB) to have nice responsiveness. Have you done any research in this regard?
thx
stefan
This is an Evo 970 plus on a Rockpi4
Command line used: iozone -e -I -a -s 100M -r 4k -r 16k -r 512k -r 1024k -r 16384k -i 0 -i 1 -i 2
Output is in kBytes/sec
Time Resolution = 0.000001 seconds.
Processor cache size set to 1024 kBytes.
Processor cache line size set to 32 bytes.
File stride size set to 17 * record size.
random random bkwd record stride
kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread
102400 4 52099 77524 104207 105324 48114 78504
102400 16 160544 231475 276300 278531 160180 233806
102400 512 738881 809485 685261 707192 676594 811610
102400 1024 795915 841642 708547 730494 693498 851120
102400 16384 1111519 1167200 1098700 1139913 1110364 1193693
There are much cheaper nvme out there I am just testing / waiting for delivery of.
https://www.mymemory.co.uk/integral-120gb-m-2-2280-pcie-nvme-ssd-drive.html
But for £25 it doesn’t really make sense for eMMc or SD nut you do need the m.2 extender card.
I would prob pic OMV (Open Media Vault) for the base and run through the docker GUI it has.
Snapraid & UnionFs work great of a cluster of usb drives for that home /media environment that you would never use for ‘standard’ raid.
The USB PD power is 5.1-20v so you can use a 12v ‘CCTV’ transformer with USB-C adapter and power a host of drives via the 12v.
The PCIex4 opens up a whole load of options though and the Rockpi4 or RockPro64 are extremely capable at running several docker containers on OMV.
Stick your rock on top and your drives inside and your away.