Hello
After upgrading to Piwigo 2.10, I am seeing a lot of missing image icons on the thumbnail pages.
For example here: http://hmyzslovenska.info/index.php?/category/798
Before the update I made the transition from menalto gallery.

I am a beginner. Help me please. My site http://www.hmyzslovenska.info
Thank you. Regards Karol

Last edited by karolox (2019-10-12 10:42:09)

plg wrote:

@karolox your problem is not related to this topic (but to your photo filename having special chars in them), please open a dedicated topic :-)

Thank you. I adjusted the file config_default.inc ($conf['sync_chars_regex'])...
It was rewritten after the update.
Regards Karol

Thank you all for looking into this. I now managed to workaround the issue.

Short wrap-up what I did:

1. edited file "admin/themes/default/js/batchManagerGlobal.js" on my server and added the missing "]" on three occurances, described here: https://piwigo.org/forum/viewtopic.php?id=29631#p174580

2. turned off js/css combine (I finally found the setting/switch)

Now I was able to compute the missing checksums. Thanks again for your help!

Sidenote about the admin backend:
At first I didn't find the option to turn off "js/css combine" in the left sidebar (I looked in "Tools" -> "Maintenance" where I was expecting a setting like that). I never bevor clicked or noticed the upper right "Tools"-Link in the top-bar.
To me, the whole Piwigo admin is very left-sidebar-focused and having two "Tools" Links on a admin GUI might not be ideal (the one in the sidebar, the other one in the upper right top bar)
Long story short: maybe you should consider cleaning up functionalities a little bit. Without knowing all the reasons why things are the way they are, I would rename "Tools" in the top bar to "Debug" or something like that. Additionally, it wouldn't hurt, to add the "combine css/js" switch also under "siderbar" -> "Tools" -> "Maintenance" since the option to "purge compiled templates" is also possible in both locations. But that's just my opinion...

EDIT: it seems, that the setting "Tools" -> "combine js/css" in the topbar does not permanently disable the js/css-combination-feature. When I was logged out, my browser network tab showed me, that still the combined js file was loaded. So, to have a permanent effect, I hat do set "$conf['template_combine_files'] = false;" in "local/config/config.inc.php"
This is another good reason to rename that menu item from tools into debug :)

Last edited by mphased (2019-10-12 14:59:26)

kc27 wrote:

My webhost also increased the connection time-out. I was able to get another 5% of the checksums created, but it consumes 100% of my system resources according to the CPanel on my site:

2 GB of 2 GB of physical memory and 2 MB of 2 MB of I/O Usage.

Creating the checksums is very disk and processor intensive, so seeing 100% usage of system resources isn't surprising.  I suspect you would be able to refresh the page and try again, get another 5% done, refresh the page, etc.  Otherwise, maybe there's a Piwigo setting that would limit how many checksums it tries to compute at once?  (Seems to be 5 on my host, if I recall correctly.)

aberkvam wrote:

Creating the checksums is very disk and processor intensive, so seeing 100% usage of system resources isn't surprising.

It surprises me. md5 algorithm was designed to be fast at computing a binary signature for your file.

aberkvam wrote:

I suspect you would be able to refresh the page and try again, get another 5% done, refresh the page, etc.

It's exactly why we added a progressive processing : to avoid reloading the page.

aberkvam wrote:

Otherwise, maybe there's a Piwigo setting that would limit how many checksums it tries to compute at once?  (Seems to be 5 on my host, if I recall correctly.)

No, it's currently (Piwigo 2.10.0) hardcoded : the smallest value between "half the set size" or 1000. If you have 15k missing md5, it will process 1k photos at once. If you have 600 missing md5, it will process 300 at once.

You can change this value in file admin/themes/default/js/batchManagerGlobal.js line 423 :

421  var addBlockSize = Math.min(
422    Number((jQuery('#md5sum_to_add').data('origin') / 2).toFixed()),
423    1000
424  );

Replace "1000" by 10, and see if it works any better.

I just made a test with big photo file (15MB) and computing 1000 md5 signatures takes ~15 seconds, which is quite high actually.

TODO:

* reduce the default block size, to 50
* fix bug to keep using the same block size, whatever the iteration

windracer wrote:

After I upgraded to 2.10.1, the "some checksums are missing" message is gone from my dashboard. Thanks!

you will find it again on page [Administration > Tools > Synchronize] ;-)