Hi!

I hope this is the right place to ask this, but I’ve got about 30TB of videos from a variety of sources that I know has numerous duplicates, however most of the duplicates will either have a watermark that is different or one video will be a part of the other or simply be different resolutions, I have been hunting for suitable software to scan for this but have had no luck in my own searches.

surely something exists that scans videos for matching or similar frames?

I am willing to pay for software (within reason) if someone can confirm that it’s likely to do what I need.

I’ve used things like dupeguru and czkawka consistently and they’ve been good for images and identical videos, but they can’t handle this type of issue with videos.

  • ZackCanadaB
    link
    fedilink
    English
    arrow-up
    1
    ·
    11 months ago

    I have same problem but with photos. I transferred about 30000 photos from few iCloud libraries into Synology Photos and there must be hundreds of duplicates in that bunch. Need to clear that mess out.

    • Tarman183OPB
      link
      fedilink
      English
      arrow-up
      1
      ·
      11 months ago

      Czkawka is quite good for photos, use “Duplicate files” mode first, then “similar images” and work down the similarity levels one by one. Good for watermarked versions and different resolution Bad for cropped versions, also draws false positives on similar images mode if you have two frames from a video saved as images.