Issue with nextcloud and onlyoffice integration

When connecting to Nextcloud and trying to open a DOCX and XLSX file that is hosted on there, OnlyOffice tries to download the file instead of opening it.

Nextcloud Version: 20.0.4

Server OS: Ubuntu 20.04

Desktop OS: Windows 10 Professional

PHP Version: 7.4

NGiNX Version: 1.18

OnlyOffice Desktop Editor Version: 6.1.0.90

I have two computers that connect to this cloud, one is able to open the same files just fine in the editor but the other keeps wanting to download. What is going on? How can I fix this?