Announcement

#1 2021-08-30 15:44:49

kevinpita
Member
2021-08-30
3

Remove duplicates based on checksum

Hello/Hi/Greetings,

I would like to remove duplicates based on checksum, I have done the checksum and I can see the duplicates but I don't know if selecting all and doing a batch delete will delete also the original ones, I would like to delete all copies and have only the "original" one


    Piwigo 11.5.0 Check for upgrade
    Operating system: Linux
    PHP: 7.4.22 (Show info) [2021-08-30 15:44:37]
    MySQL: 5.5.5-10.6.4-MariaDB-1:10.6.4+maria~focal [2021-08-30 13:44:37]
    Graphics Library: ImageMagick 7.0.11-13


Piwigo URL: localhost

Offline

 

#2 2021-08-31 01:12:48

erAck
Only trying to help
2015-09-06
2029

Re: Remove duplicates based on checksum

If you select *all* then of course *all* selected will be deleted.
Besides, how should it know what you consider the original of two identical duplicates.


Running Piwigo at https://erack.net/gallery/

Offline

 

#3 2021-08-31 13:41:53

kevinpita
Member
2021-08-30
3

Re: Remove duplicates based on checksum

erAck wrote:

If you select *all* then of course *all* selected will be deleted.
Besides, how should it know what you consider the original of two identical duplicates.

Ok, but isn't there anyway to select only duplicates?

Offline

 

#4 2021-08-31 16:21:49

jnashpiwigo
Piwigo Team
2014-10-21
254

Re: Remove duplicates based on checksum

Which is the original and which is the duplicate?  And then, which album is the said original supposed to be in.  That is the riddle of life.

Offline

 

#5 2021-09-08 00:32:56

Alexander83706
Member
Boise
2019-07-07
148

Re: Remove duplicates based on checksum

If you have them in the mysql database already. Then you can


select (T1.name, t1.md5sum where ( t1.md5sum=t2.md5sum )) and ( T1.second_field <> T2.second_field ))

from  table_one T1 table_one T2 

You'll have to check the syntax, but it can be done

The mysql 5.7 manual on-line has a fine example of this.

Offline

 

#6 2021-09-15 20:27:37

kevinpita
Member
2021-08-30
3

Re: Remove duplicates based on checksum

jnashpiwigo wrote:

Which is the original and which is the duplicate?  And then, which album is the said original supposed to be in.  That is the riddle of life.

they are all in the same album, I don't really care which one is the "original" but the oldest would be ok

Offline

 

#7 2023-03-27 15:01:18

rmvanderspek
Member
2023-03-27
2

Re: Remove duplicates based on checksum

I have a similar 'issue'. I have a lot of duplicates and the only thing I want to do is merge them. I don't care which is the original. In my eyes they are both copy and both original. Only thing I want is to be left with one of the two. I don't care in which album they are, or will be. Is there any way to do this easily? Manually selecting 1000+ images is not my hobby :-P.

Offline

 

#8 2023-03-27 17:50:52

BigIsland270972
Member
Norway
2022-03-15
374

Re: Remove duplicates based on checksum

Hello. I use DupeGuru for this kind of tasks. See: https://dupeguru.voltaicideas.net/
Robert


Piwigo 14.0 | https://fotoarkiv.no | https://foto.arki.vet | http://Bergen.gallery  | http://Ålesund.gallery | http://geiranger.gallery | http://fjord.photos | http://foto.oslo.no
Apache | PHP 8.1 | MariaDB

Offline

 

#9 2023-03-28 08:43:22

rmvanderspek
Member
2023-03-27
2

Re: Remove duplicates based on checksum

Thanks BigIsland, so I guess your answer is also that there is no way of doing this within Piwigo. It would have been a great feature.

Offline

 

Board footer

Powered by FluxBB

github twitter newsletter Donate Piwigo.org © 2002-2024 · Contact