I’m using a similar setup – Nextcloud AIO behind a reverse proxy, but in my case it’s an NGINX Proxy Server running on a separate VM.
You can check out my full configuration here:
[Solved] Docker based NextCloud AiO with nginx on separate Ubuntu VM - not working - #6 by vawaver
Maybe it’ll help you identify the issue.