Is there a way to find duplicate documents?

[Sanook]

In different folders, documents with different filename but same content.

Thank you!

[linucksrox]

I don’t think there’s a built in way in Nextcloud (feel free to write an app though!). I use fdupes in the terminal for accomplishing this, it will compare file hashes.

[Cult]

I will start storing an hash of the content and see if I can do some search on duplicate hash in the elasticsearch; then I will see if I can find almost identical content; but this is not in the near future

[vvong]

I use FSlint on Linux box to tidy up my old media server (tons of family baby video with serious duplication), very powerful.

[Blox]

hi, sorry to dig this out, just want to verify this:
the nextcloud file database does not store hashes but “only” timestamps?

greetings

[rugk]

Old thread, but maybe people want to see the solution now and this is also found via search engines, so:

• there is MediaDC nowadays, which has quite much features, but depends on some stuff (mostly Python), also it was featured in the blog and can find not-exact duplicates (similar images and videos)
• Simple and lesser known seems to be the duplicate finder that just seems to compare the exact file hash

Apart from that there are many threads here that are duplicates and ask for the same:

Duplicate File Detection

Hi there I’m just starting with nextcloud (such a great solution), and i think this would be really useful. I think maybe using and integrating an already existent tool would be possible. I was just searching and found ‘rmlint’. Maybe there’s a reason not to do so, that I’m totally overseeing. I thought I could just drop in the idea. I’d gladly help if convenient. Greetings

Duplicate finder

Greetings, is there an app that search and (eventually) delete duplicate files? Mainly in pictures (so with picture related file extension), however, an app that search all duplicate files in storage would be very handy. One that can allow to choose the duplicate file to delete. Thanks kattivius

Locate the duplicate images

Because you use a Managed Nextcloud you can only use the included features of the Nextcloud and the client features e.g. Nextcloud desktop or WebDAV. I think the best way is to delete all pictures in the Nextcloud and upload them again.