Still logged in on the apps after password change

Hello community,
i´ve changed a password from a user recently to finally get rid of old app installations.
The thing is that these devices still have access, even without giving in the new password.

I have been waiting now for more then two days, and still no “bad password” message.

Is this meant to be?