Hi folks,
First time posting here!
My current environment is:
- Nextcloud server
- CentOS7
- ZFS on Linux
- Nextcloud via docker-compose https://github.com/nextcloud/docker/tree/master/.examples/docker-compose/with-nginx-proxy-self-signed-ssl/mariadb/fpm
- Pine64 with armbian latest with an external USB3 hard disk mounted in
/HDD- ssh listening in a non default port (let’s say 1234)
Where the folders are:
- Server
-
~/nextcloud/to host the docker-compose, etc. -
~/nextcloud/scriptsto host some scripts I use for nextcloud (like update.sh and backup.sh) -
/tank/nextcloud-dba ZFS subvolume to store the MariaDB database -
/tank/nextclouda ZFS subvolume to store nextcloud
-
- Pine64
- /HDD
The script does the following:
- Set nextcloud in maintenance mode
- Dumps a MariaDB backup
- Performs a ZFS snapshot of the nextcloud subvolume
- Disable nextcloud maintenance mode (so, total downtime, the MariaDB backup only as the ZFS snapshots are immediate!)
- Backup the ZFS snapshot and the MariaDB backup remotely using rsync in an incremental fashion (using hardlinks, etc., see https://blog.interlinked.org/tutorials/rsync_time_machine.html currently down
) - Keep older backups with the backup date
- Have a
currentsymlink to the latest successfull backup
The script is the following:
#!/bin/bash
set -eo pipefail
# Folders
BACKUPFOLDER="/tank/backup"
DESTINATION="/HDD/nextcloud-backup"
# Nextcloud volume
NEXTCLOUDVOLUME="tank/nextcloud"
# Files
DOCKERCOMPOSEFILE="/home/myuser/nextcloud/docker-compose.yml"
DBENVFILE="/home/myuser/nextcloud/db.env"
DBFILE="${BACKUPFOLDER}/nextcloud.sql"
EXCLUDEDFILES="/home/myuser/nextcloud/excluded-files.txt"
# Others
HOST="pine64.example.com"
DESTUSER="myuser"
SSHKEY="/home/myuser/.ssh/id_rsa"
SSHPORT="1234"
BWLIMIT="2048"
# Get mysql credentials
source ${DBENVFILE}
DATE=$(date "+%Y-%m-%dT%H_%M_%S")
echo "Started at ${DATE}"
echo "Checking /HDD"
ssh ${HOST} -p ${SSHPORT} \
"grep /HDD /proc/mounts -q || exit 2"
# Set nextcloud to maintenance mode
docker-compose -f ${DOCKERCOMPOSEFILE} exec -T --user www-data app \
php occ maintenance:mode --on
# Dump mysqldatabase
docker-compose -f ${DOCKERCOMPOSEFILE} exec db \
sh -c 'exec mysqldump --single-transaction -u${MYSQL_USER} -p"${MYSQL_PASSWORD}" "${MYSQL_DATABASE}"' > ${DBFILE}
# Create a zfs snapshot
sudo zfs snapshot ${NEXTCLOUDVOLUME}@backup
# Restart nextcloud
docker-compose -f ${DOCKERCOMPOSEFILE} exec -T --user www-data app \
php occ maintenance:mode --off
# Create a symlink in the destination folder to the zfs snapshot (readonly)
ln -s /${NEXTCLOUDVOLUME}/.zfs/snapshot/backup/ ${BACKUPFOLDER}/nextcloud
cd ${BACKUPFOLDER}
# Perform the backup
# https://blog.interlinked.org/tutorials/rsync_time_machine.html
# Removed compression due to https://gist.github.com/KartikTalwar/4393116
sudo rsync -aPL \
-e "ssh -l ${DESTUSER} -i ${SSHKEY} -p ${SSHPORT} -o Compression=no" \
--delete \
--delete-excluded \
--exclude-from ${EXCLUDEDFILES} \
--bwlimit=${BWLIMIT} \
--link-dest=${DESTINATION}/current \
${BACKUPFOLDER}/ ${HOST}:${DESTINATION}/incomplete_back-${DATE}
# Organize the stuff in the backup host
ssh ${HOST} -p ${SSHPORT}\
"mv ${DESTINATION}/incomplete_back-${DATE} ${DESTINATION}/back-${DATE} && \
rm -f ${DESTINATION}/current && \
ln -s ${DESTINATION}/back-${DATE} ${DESTINATION}/current"
# Clean up the symlink
rm -f ${BACKUPFOLDER}/nextcloud
# Clena up the database
rm -f ${DBFILE}
# Destroy the snapshot
sudo zfs destroy ${NEXTCLOUDVOLUME}@backup
DATEEND=$(date "+%Y-%m-%dT%H_%M_%S")
echo "Finished at ${DATEEND}"
exit 0
The content of the excluded-files.txt is:
nextcloud/html/data/myuser/files_trashbin/
nextcloud/html/data/myuser2/files_trashbin/
nextcloud/html/data/admin/files_trashbin/
HTH!