Announcement

#1 2021-03-01 19:07:27

TheFeral
Member
2021-03-01
1

Dashboard storage seems incorrect

Hello/Hi/Greetings,

First off, thank you so much to all involved in making this amazing solution!  By far the best way of self hosting photos!

I am curious what the storage dashboards "other" refers too.  I searched the forum and only found one other question and my site seems to differ.

I had 3 categories before upgrading from 11.0 -> 11.3, Other, Photos and Cache.

Now on 11.3 I only have 3, Other and Photos.

Other: 49.33 GB
Photos: 3.25 GB

However, if I look at where the disk usage is on the linux node:

Running this:
du -sh /var/www/html/photos/*

And excluding the small files and other dirs I have this:

7.8G    /var/www/html/photos/_data
51G     /var/www/html/photos/upload

I assume the "_data" is thumbnails and the raw photos are in the "upload"

If I run this linux command:
find /var/www/html/photos/upload -name '*.jpg' -exec stat -c %s {} \; | awk '{sum+=$1}END{print sum}'

I get:
5.37988e+10

Which is ~53 GB of jpg files in the upload dir. 

If I run the same linux command, but on the "_data":
find /var/www/html/photos/_data -name '*.jpg' -exec stat -c %s {} \; | awk '{sum+=$1}END{print sum}'

8.16495e+09

Which is ~ 8 GB of jpgs in _data

So, on the dashboard I think the "Other" on the dashboard is the actual photos and I am not sure what the 3.25 GB for the "Photos" means.

I tried doing the Tools\Synchronize with "directories + files", non-simulation checking the "synchronize metadata but NOT checking the "even already synchronized photos".  With no change.

Also tried running "update albums information" maintenance job.  With no change.

I was a little worried to run the "update photos information" with the warning that is listed on the help.

Is there another job I can run to update dashboard to correctly list the storage space used?

This is the only issue I have found, which is rather small, which shows the level of effort that you all do to create and verify such a great software app!

Thanks again,
Dave


Environment details:

Piwigo 11.3.0 Check for upgrade
Operating system: Linux
PHP: 7.0.33-0ubuntu0.16.04.15 (Show info) [2021-03-01 12:43:10]
MySQL: 5.7.31-0ubuntu0.16.04.1 [2021-03-01 12:43:10]
Graphics Library: External ImageMagick 6.8.9-9

Offline

 

#2 2021-03-01 23:41:06

erAck
Only trying to help
2015-09-06
2029

Re: Dashboard storage seems incorrect

The size calculation in 11.3 is done only for files present in the database table piwigo_images, not what is on disk (because there were timeout problems with calculating that iterating over directory entries).

Photos: files with extension registered in $conf['picture_ext']
Videos: files with extension of 'webm','webmv','ogg','ogv','mp4','m4v'
Others: well, all others..
(plus in total maybe a sum of filesize of table piwigo_image_format, I didn't dig into that deeper as that table is empty for me, apparently present if images are made available in several formats).


Running Piwigo at https://erack.net/gallery/

Offline

 

#3 2021-03-02 10:59:31

plg
Piwigo Team
Nantes, France, Europe
2002-04-05
13791

Re: Dashboard storage seems incorrect

Offline

 

Board footer

Powered by FluxBB

github twitter newsletter Donate Piwigo.org © 2002-2024 · Contact