Announcement

#1 2015-02-01 22:15:19

cnoork
Guest

Very slow thumpnail creation on Synology

Hello/Hi/Greetings,

I have a Synology DS412+ and would like to switch from Gallery to Piwigo. Currently I am testing Piwigo. I have the issue that I have uploaded only 141 photo’s and then it is generating thumbnails extremely slow. My NAS is then overloaded, sometimes I see 11 conversions at the same time which gives the NAS a load from 33 (what I have seen with top). Most of the time nothing will response anymore at that load. Who can point me to te issue I have, currently I cannot migrate if the it gives these problems to import the current 141 pictures, have more than 10.000 pictures to go.

With kind regards,
Chris


Here some output from the shell:

======================
root@/volume1> top
Mem: 943384K used, 69972K free, 0K shrd, 4020K buff, 49608K cached
CPU:  0.0% usr  2.2% sys  0.0% nic  0.0% idle 97.7% io  0.0% irq  0.0% sirq
Load average: 33.12 33.87 25.97 2/490 5738
  PID  PPID USER     STAT   VSZ %MEM %CPU COMMAND
4335  4334 http     D    94168  9.2  0.2 /opt/bin/convert /volume1/web/piwigo/upload/2015/01/31/20150131165018-fd4f9562.jpg -crop 3264x3264+824+0 -filter Lanczos -resize 120x120! -str
4524  4522 http     D    94164  9.2  0.2 /opt/bin/convert /volume1/web/piwigo/upload/2015/01/31/20150131161241-bc9c22b0.jpg -crop 3264x3264+824+0 -filter Lanczos -resize 120x120! -str
4523  4521 http     D    94164  9.2  0.1 /opt/bin/convert /volume1/web/piwigo/upload/2015/01/31/20150131161321-45b81b52.jpg -crop 3264x3264+0+824 -filter Lanczos -resize 120x120! -str
4526  4525 http     D    94164  9.2  0.1 /opt/bin/convert /volume1/web/piwigo/upload/2015/01/31/20150131161131-64dc8564.jpg -crop 3264x3264+824+0 -filter Lanczos -resize 120x120! -str
======================
root@/volume1> ps | grep convert | grep sh
4252 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161147-d11b0207.jpg" -crop 3264x3264+824+0 -filter L
4253 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161349-9f9ae244.jpg" -crop 3264x3264+0+824 -filter L
4257 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161321-45b81b52.jpg" -crop 3264x3264+0+824 -filter L
4268 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161118-4af6c175.jpg" -crop 3264x3264+824+0 -filter L
4334 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131165018-fd4f9562.jpg" -crop 3264x3264+824+0 -filter L
4519 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161118-4af6c175.jpg" -crop 3264x3264+824+0 -filter L
4521 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161321-45b81b52.jpg" -crop 3264x3264+0+824 -filter L
4522 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161241-bc9c22b0.jpg" -crop 3264x3264+824+0 -filter L
4525 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161131-64dc8564.jpg" -crop 3264x3264+824+0 -filter L
4532 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161334-a95bc86a.jpg" -crop 3264x3264+824+0 -filter L
4535 http      3772 S    sh -c /opt/bin/convert "/volume1/web/piwigo/upload/2015/01/31/20150131161147-d11b0207.jpg" -crop 3264x3264+824+0 -filter L
root@/volume1> ps | grep convert | grep sh -c
11
======================


Piwigo version: 2.7.3
PHP version: 5.5.19
MySQL version: 5.5.39-MariaDB
Piwigo URL: http://noork.nl/piwigo
Graphics Library: External ImageMagick 6.6.9-1

DSM version: DSM 5.1-5021

 

#2 2015-02-02 19:42:03

cnoork
Guest

Re: Very slow thumpnail creation on Synology

Hi,

Looked further on the web and found some info about the MAGICK_THREAD_LIMIT but when I check the current setting this is already on "1". I suspect that this is for every started ImageMagick on how many threats it may run and not how many ImageMagick commands may start.

Still looks like Piwigo will fire all conversions. Where could I set the maximum parallel sessions? How is this controlled?

With kind regards,
Chris

===============
root@/volume1> convert -list resource
File         Area       Memory          Map         Disk    Thread         Time
-------------------------------------------------------------------------------
768      259.4MB     989.6MiB    1.9328GiB    unlimited         1    unlimited
===============

 

#3 2015-02-02 22:01:11

cnoork
Guest

Re: Very slow thumpnail creation on Synology

Hi,

Found that if I use "Batch Manager" the thumbnails are generated one at a time. That helped me for the first step.

Now I want to do it on the command prompt instead I need to keep the browser open. Found the following post: http://piwigo.org/forum/viewtopic.php?id=22465

But the i.php command did not work for me. I get an error (see below)

What is going wrong?

With kind regards,
Chris

=========
root@/volume1/web/piwigo> find . -name "20150202202507-8b669884*" -print
./upload/2015/02/02/20150202202507-8b669884.jpg
=========
root@/volume1/web/piwigo> php i.php?/upload/2015/02/02/20150202202507-8b669884-me.jpg
Could not open input file: i.php?/upload/2015/02/02/20150202202507-8b669884-me.jpg
=========

 

Board footer

Powered by FluxBB

github twitter facebook google+ newsletter Donate Piwigo.org © 2002-2019 · Contact