Are 5 GB/days of binlogs for a ~100 users Nextcloud instance normal?

ℹ️ Support
,
1

Hello, as a quick info, is 5 GB/day of mysql binlogs for a Nextcloud instance of ~ 100 users to be considered “normal” ?

Most of my logs are:

BINLOG '
[5 hashed rows]
'/*!*/;
### UPDATE `nextcloud`.`oc_file_locks`
### WHERE
###   @1=483327984
###   @2=0
###   @3='files/9e0086aa4fceb08d2f7c0b95e29ae2d1'
###   @4=1634524660
### SET
###   @1=483327984
###   @2=1
###   @3='files/9e0086aa4fceb08d2f7c0b95e29ae2d1'
###   @4=1634525189
# at 1145747
#211018  3:46:29 server id 1  end_log_pos 1145819 CRC32 0x33884d11      Table_map: `nextcloud`.`oc_file_locks` mapped to number 126
# at 1145819
#211018  3:46:29 server id 1  end_log_pos 1145969 CRC32 0xce7ee6d8      Update_rows: table id 126 flags: STMT_END_F

(and then the following @2 from 1 to zero)

Seems normal but… 5 GB per day!

(PS: the login to this forum with google doesn’t work 522 bad gateway Firefox/Chrome)

2

100 users… how much storage space and bandwidth do this many people use on an average day?

Thanks for reporting that error.

3

~ 1.5 TB used storage and 0.5/1 GB/day I/O traffic

4

Thanks for sharing! Do you impose storage limits (and do many users reach them)?

Lots of logs makes sense if those people are using files and other apps such as Talk, calendar, contacts, etc. I know some admins disable News for example because it can grow to be very resource intensive across many users.

Do you have monitoring in place? Prometheus/Grafana or Matomo can be very helpful in better understanding resource usage.

Hopefully someone more technical will chime in to answer your question

5

I’d use redis for the file locking, it takes a lot of load from your database server (and thus faster file transfers). Once this part is on redis, it won’t fill up your binlog either.