I’m not an nginx user, I don’t mean to point fingers, there are plenty of nginx setups that run fine… but I will say I have personally noticed a pattern of people reporting performance issues and using nginx in some fashion.
If you’re not averse to trying something a little different, I would suggest trying Apache, or using Docker. I wrote a guide for doing a Docker setup on Ubuntu, but I expect it would adapt easily to Debian.