Why use S3 over file system?

[Reiner_Nippes]

@Paradox55

Looks like I can mount the pool and backup that way

maybe rclone.org is usefull to backup/sync S3 objects. and in combination with restic it should be easy to get a scripted backup of the database and the S3 objects.

Rsync to cloud storage for backups?

yes. to make it better you can combine it with restic. restic takes care about the lifecycle of your backups since it is backup program, encrypts the files again, can use rclone as a target repo and is cool. https://restic.readthedocs.io/en/latest/010_introduction.html An example script: #!/bin/bash export RESTIC_REPOSITORY="/var/nc-backup" export RESTIC_PASSWORD="EAtcVlENiC6TlMwH73X9PRfD17vsEEHI" # abort entire script if any command fails set -e # Make sure nextcloud is enabled wh…

@Reiner_Nippes

# backup the data dir 
/usr/local/bin/restic backup /var/nc-data

that line should be replaced with an rclone command.

but still I would try this in a save environment before release it to production. because I have no idea how to recover a single file. and if recover a hole site works at all.

@Paradox55

Alternatively I could use s3ql as a drop in replacement

I even have a playbook for this. but not yet released. because this would be a tricky setup. (that is to say, if something breaks I would have no idea how to recover.)

imho there are too many layer between you and the files on the physical storage device. and you have to rely on a lot of people fixing bugs.

@Paradox55

it has to go through that database constantly.

same with “normal” filesystems (hdd, esb, nfs, you-name-it). or?

@Paradox55

I don’t mean to make assumptions but

yeah. sorry. I had only the Armageddon scenario in mind that one aws region goes down. user deleting files or getting attacked from malware or aws taking down its S3 service is of course not covered. (and except armageddon I have seen this all. you are right.)

so “Why should I use this over a file system?”: I wouldn’t use S3 as primary storage. to many layers and unclear how to recover. but as a backup target (restic/rclone) it should be ideal. (replicate/backup everything to aws, digitalocean and scaleway and you should be more than save.)

p.s.: i’m not speaking on behalves of nextcloud prof service. If you bought a subscription and nextcloud is happy to support your setup. ignore my comments.