I guess clearing the activity table should be painless, but dump a backup first.
The filecache table is not a cache in that way, more an index of all files in your users data folders. Empty it will lead at least to an empty files app in web ui, maybe syncing that also to all attached clients (?). So I would not recommend that!