How to suppress ClamAV's swap memory

I rent a server with 4GB memory and install and run Nextcloud only. I am having a lot of trouble with ClamAV’s memory usage. The number of user accounts in my NC is very small. I am often warned about the amount of swap memory used during times when obviously no one is operating.

On average, 2.2GB of memory is used and 1.2GB of free memory is available. And the swap memory is constantly being used over 900MB and I am constantly being warned by the server.

Please let me know how I can reduce the memory consumption of ClamAV in running NC on this server.