Same issue here. Disabling front controller works, but pretty URLs (without /index.php/) are gone. This is btw. the purpose of this directive.
For Apache, enabling pretty URLs also leaded to missing icons. This was solved by https://github.com/nextcloud/server/issues/6271
Maybe for Nginx this has to be solved separately as well?