Remove all contacts field from user account

Is it possible to remove the “Contacts” field from the user screen(top right corner)?

Or make it so that not every user is able to see all the registered users? I thought that putting them in group would fix this, but it doesn’t.

I am using the most recent version of Nextcloud on a HyperV virtual machine.