Announcement

#1 2020-03-02 21:53:06

stevehh
Member
2019-03-02
5

Exclamation marks have appeared.

Hello/Hi/Greetings,

I've used piwigo for a while, with no issues, then tonight when I looked at historical pictures, pre 2019 some or all pictures and thumbnails have been replaced with exclamation marks.   As I don't often look at historical pictures, I don't know when piwigo started doing this.

I have looked at the maintenance, and selected, Repair and optimize database, nothing changed.

I have little idea of SQL or how piwigo works, all I have done up to now is upload, and use batch manager to file the photos by year and date.

Can someone please advise what I can try to get the thumbnails and pictures back.

Many thanks

Steve



Piwigo version: 2.10.1
PHP version: 7.3.14
MySQL version: 10.3.22-MariaDB-cll-lve
Piwigo URL: https://stevehh.com/piwigo/

Offline

 

#2 2020-03-03 01:29:57

erAck
Only trying to help
2015-09-06
2020

Re: Exclamation marks have appeared.

Check that directories under _data/i/upload/ exist (with yyyy/mm/dd subdirectories) and the thumbnail files thereunder and that the files and all directories above are actually accessible and readable by the webserver's user.


Running Piwigo at https://erack.net/gallery/

Offline

 

#3 2020-03-03 13:10:07

stevehh
Member
2019-03-02
5

Re: Exclamation marks have appeared.

Thanks for the reply.   I've looked in the directories.   The permissions appear ok.
The next is what I've found, and may not be the full extent of my issue.

The original uploaded files are missing.  The folders and files are not present
e.g.  https://stevehh.com/piwigo/upload/2018/ … 57a93c.jpg
only 2019 and 2020 folders are present.  The 2018 folder and files are missing.
e.g. The file 20181126234326-e457a93c.jpg does not exist on the server.

I imported via sync, the 2018 files from Flickr.   

It looks as if all the Flickr imported photos have gone.   Anything manally up loaded after this is present on the server.
Are Flickr sync files treated differently than imported photos?

As I don't often look at historical photos, I have no idea when the folders / files went missing.  So do not know if I have a backup with the data on it.

I have local copies of all files.

What is the best way to recover from this?    Re upload the Flickr files?


Steve

Offline

 

#4 2020-03-03 16:46:31

erAck
Only trying to help
2015-09-06
2020

Re: Exclamation marks have appeared.

stevehh wrote:

I imported via sync, the 2018 files from Flickr.

How exactly?


Running Piwigo at https://erack.net/gallery/

Offline

 

#5 2020-03-03 17:10:56

stevehh
Member
2019-03-02
5

Re: Exclamation marks have appeared.

Hi,

I had forgotton the detail, but my plugin list contains a deactivated Flickr2Piwigo.
https://piwigo.org/ext/extension_view.php?eid=612

I got a key from Flickr, and all the photos and albums were imported.
Some of the GPS data was lost, but mostly it worked.

I never looked where the files went.

I looked through the logs, and found entries similar to:
2020-02-14 20:26:15] [DEBUG] [i.php] convert "/home/pwlevoee/public_html/piwigo/upload/2018/11/27/20181127111759-5d095da0.jpg

and others converting the original files in the 2018 folder, all went without error.

Then after I uploaded ~900 photos taken recently, all references to 2018 have errors.

Steve

Offline

 

#6 2020-03-03 19:13:28

erAck
Only trying to help
2015-09-06
2020

Re: Exclamation marks have appeared.

I wonder what that conversion actually did, from what to what, or from where to where..
The relevant code at the end of i.php suggests the log entry should have more information than just the source file name. Anyway, apparently that should had created the derivative, but not deleted the original.

However, restore the files from the last known good backup, or reimport.


Running Piwigo at https://erack.net/gallery/

Offline

 

#7 2020-03-04 17:59:58

stevehh
Member
2019-03-02
5

Re: Exclamation marks have appeared.

Hi,

My hosting company claim to have had disk problems, and cannot provide a backup, other than last nights.
So I can't recover the historical files.

After looking at recovering from my copies, the following has become apparent.
All my photos were stored in Flickr, mostly with EXIF geolocation data.
I exported all the files as per the Flickr export instructions, 20 or so zip files, all appeared OK.
The exported files from Flickr have the geolocation stripped out.
Flickr2Piwigo will read the Flickr pictures and metadata, and import all the Piwigo.
My photos are still on Flickr.

So to keep the geolocation data with Piwigo, I'm using Flickr2Piwigo to copy the photos.
Flickr2Piwigo creates the same file structure as a normal upload
\upload\year\month\date

There are 15000 photos, so it'll take a while.

I'll update when complete.

Steve

Offline

 

Board footer

Powered by FluxBB

github twitter newsletter Donate Piwigo.org © 2002-2024 · Contact