What did the trick for me was just hitting the save button in the document server settings.
So the server address was filled automatically, I just hit save to see what happens and see if error messages come up and that actually solved the problem of files just being offered for download before. Now they open in onlyoffice.
Hope that works for you, too.