Remote Cifs share syncing with database update & some logic

[das1996]

I have an AIO printer with scan function. Scans are saved to a usb flash drive housed in a nearby router in AP mode (asus merlin). My pc (windows) has a task that periodically (several times a day) syncs the files from the flash drive to a folder on the pc for backup. Access to the share on the router is configured for ftp or samba.

Pc is not always on. Nextcloud instance is, so why not back up to it.

My linux knowledge is very limited. I clobbered my way through to make the following.

Implementation required several tasks

1. Map remote share to a mount point
2. sync files
3. update nextcloud database

I came up with the following for each step

1. /etc/fstab

//192.168.1.5/canon /mnt/192.168.1.5 cifs credentials=/mnt/ncdata/.192.168.1.5.smb,vers=2.0,uid=www-data,gid=www-data 0 0


File .192.168.1.5.smb contains credentials for the share in plaintext. Set as root:root, chmod 600.

Is there a way to hash it?

2. The following script handles #2 & #3 functions.

In a nutshell, the flow is to perform the sync. Generate notification email if sync fails. If successful, compare destination folder state to state before sync. If same, end script. If different, run nc database update.

#!/bin/sh
DESTINATION_FOLDER=“/mnt/ncdata/user/files/Faxes and scans/scans/”
FOLDERSTATE_PRESYNC=$(stat -c %y “$DESTINATION_FOLDER”)
#DATE=$(date ‘+%Y/%m/%d %H:%M:%S’)
DATE=“date ‘+%m/%d/%Y %H:%M:%S’”
NC_LOG=“/tmp/nc_database.log”
RSYNC_LOG=“/mnt/ncdata/rsync.log”
OCC_PATH=“/user/files/Faxes and scans/scans/”

#Perform folder sync
rsync --log-file=$RSYNC_LOG --ignore-existing -avz --chown=www-data:www-data --chmod=D755,F644 /mnt/192.168.1.5/scans/ “/mnt/ncdata/user/files/Faxes and scans/scans” > /dev/null 2>&1

#generate failure email if rsync faults for any reason
if [ $? -ne 0 ]; then

echo 'Issue with rsync on nextcloud on ’ “$(eval $DATE)” “\n\n”“$(tail -n 30 $RSYNC_LOG)” | mail -a FROM:“ncadmin ncadmin@nc.domain.com” -s “Nextcloud Rsync fault” user@domain.com > /dev/null 2>&1

else

#upon successful rsync, update NC database if new files present

    FOLDERSTATE_POSTSYNC=$(stat -c %y "$DESTINATION_FOLDER")

    if [ "$FOLDERSTATE_PRESYNC" != "$FOLDERSTATE_POSTSYNC" ]; then
    echo "\n$(eval $DATE)" NextCloud Database started  >> $NC_LOG
    php /var/www/nextcloud/occ files:scan --path="$OCC_PATH" >> $NC_LOG
    OCC_ERRORCODE=$?
    echo "$(eval $DATE)" NextCloud Database updated  >> $RSYNC_LOG

if [ $OCC_ERRORCODE -ne 0 ]; then

    echo 'Issue with database update on nextcloud on ' "$(eval $DATE)" "\n\n$(tail -n 30 $NC_LOG)"   | mail -a FROM:"ncadmin <ncadmin@nc.domain.com>" -s "Nextcloud database sync fault" user@domain.com  > /dev/null  2>&1

fi

else

echo “$(eval $DATE)” No new files to sync, no database update. >> /mnt/ncdata/rsync.log

    fi

fi

#send daily nc_database update log to via email between 0000 and 0100, then delete
if [ $(eval date +“%H%M%S”) -le “010000” -a $(eval date +“%H%M%S”) -ge “000000” ];
then

   echo 'Nextcloud database update log for  ' "$(eval $DATE)" "\n\n$(cat $NC_LOG)"   | mail -a FROM:"ncadmin <ncadmin@nc.domain.com>" -s "Nextcloud nightly update log" user@domain.com  > /dev/null  2>&1

rm $NC_LOG

fi

This script is the final result after many iterations. It started as a simple rsync and database update which morphed into something more sensible.

Any suggestions for improving, making more secure, or other ideas?

The script is in /mnt/ncadmin folder with www-data:www-data owner/group, 755 permissions. It’s called from a cron job every 3 hours between 6am and midnight with the following line in /etc/cron.d/rsync_cron

0 0,6,9,12,15,18,21 * * * www-data /mnt/ncdata/192.168.1.5_sync.sh > /dev/null 2>&1

Thanks!

[szaimen]

Why not use the external storage app for this?

[das1996]

I think my definition of syncing needs clarifying. Specifically, I don’t just want the remote files to be visible through nc. I want those files to be copied to the nc storage – ie. an additional backup location.

Maybe I missed it in the external storage. How would I do the above?