Until Nextcloud 22 unfortunately there is no trashbin for contacts. Maybe it will be implemented in a future version.
However, if you have a database backup you can restore your addressbook with the help of calcardbackup. Have a look at the section Does this also work with a broken ownCloud/Nextcloud instance? in the README of the repo.