Announcement

  •  » Miscellaneous
  •  » New, Trying To Organize Fifteen Thousand Photos In Eight Categories

#1 2016-12-20 23:39:11

ClintDanbury
Member
2016-12-20
21

New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Hello Piwigo Experts.

First post here, don't know the etiquette of the community; guessing at everything, cut me some slack and I'll catch on.

I have tried Piwigo on my own without guidance, five or six times, with different levels of success. The URL in the "Environment" section at the end of this message will give you an idea of where I stand knowledge-wise.

The individual albums and individual folders have come out okay

My goal at this moment is to organize my photos and albums under one admin, under one URL extension, so that I can just go to Piwigo one time at one place on my website, and do my maintenance and uploads from that one spot without the requirement of interfacing with multiple invocations of Piwigo in multiple places on my site.

The URL below has one album and two sub-albums.

It holds about two thousand photos; roughly a thousand in each sub album.

My immediate goal at the moment is to organize this album with others on my site so that my other albums are under the same system control; hopefully, without having to upload the zillion gigs of data again

i.e., I don't want /pics/leaves to be the actual home of the  album itself, but instead, a SUB-album which I administer under the one admin account which I access at my /pics/ directory.

My longer term goals include a desire to...

-+- Give other people a single link to click
-+- When they do, they will arrive on that album (which will actually be a 'sub' album)
-+- They won't be confused by a large number of different URLs and so on.

My next project will be to upload about fifteen thousand photos which are arranged in about eight different categories.

I welcome advice and suggestions on what to do before I begin that task, as I am currently stuck with a ten megabit connection.

If there are Piwigo video tutorials about this which are already up on the internet anywhere, please point me to them.

If there is an online-FAQ or whatever, point me.

I hope this post is in line with what the community deems appropriate.


===================ENVIRONMENT==============
Piwigo version: 2.8.3
PHP version: PHP: 5.5.36  [2016-12-20 16:27:32]
MySQL version: MySQL: 5.5.45-cll-lve [2016-12-20 16:27:32]
Piwigo URL: http://clintdanbury.info/pics/leaves/

Offline

 

#2 2016-12-21 11:41:25

flop25
Piwigo Team
2006-07-06
7037

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Hello
our Doc and this forum are rich sources of information
Take a deep look at the local configuration and especially $conf['random_index_redirect']


To get a better help : Politeness like Hello-A link-Your past actions precisely described
Check my extensions : more than 30 available
who I am and what I do : http://fr.gravatar.com/flop25
My gallery : an illustration of how to integrate Piwigo in your website

Offline

 

#3 2016-12-21 22:41:10

ClintDanbury
Member
2016-12-20
21

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Okay, I have determined that the HTTP and the HTML interface are totally wrong for uploading a whole bunch of files  (in this case, five thousand of them).

I think I should try FTP.

Can I do that ?  Will Piwigo know what to do with them ?

Where do I put them ?

Is this the right forum to ask this question ?

Offline

 

#4 2016-12-21 22:42:36

ClintDanbury
Member
2016-12-20
21

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

flop25 wrote:

our Doc ... rich sources of information...
Take a deep look at the local configuration...]

Where do I find that Doc ?

Where do I find the local configuration ?

Last edited by ClintDanbury (2016-12-21 22:43:46)

Offline

 

#5 2016-12-22 02:12:47

jnashpiwigo
Piwigo Team
2014-10-21
254

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Look back up at the top of this page.   You'll see the Docs tab, right next to the Forums tab.

And, yes, FTP will work, but you'll probably want to read the docs to see how it works.  You basically have to FTP to a particular folder, then synchronize.  Look Here: http://piwigo.org/doc/doku.php?id=user_ … ture&s[]=ftp

Last edited by jnashpiwigo (2016-12-22 02:15:24)

Offline

 

#6 2016-12-22 02:16:00

ClintDanbury
Member
2016-12-20
21

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Thank you jnashpiwigo.

Very helpful, and I will be clicking there next.

Offline

 

#7 2016-12-22 02:19:38

jnashpiwigo
Piwigo Team
2014-10-21
254

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Not sure if the link posted correctly...

Trying this... as the brackets are breaking the link...

Code:

http://piwigo.org/doc/doku.php?id=user_documentation:learn:add_picture&s[]=ftp

Oh, and welcome to Piwigo... I have about 55k pics in my gallery and can attest to its speed and functionality.  I love it!

Last edited by jnashpiwigo (2016-12-22 02:21:45)

Offline

 

#8 2016-12-22 08:01:10

ClintDanbury
Member
2016-12-20
21

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Okay, I hope I've read the instructions and understood them

Tonight I established an FTP session and created a sub-directory under the "galleries" subdirectory.

FileZilla is working on the files now.

I think this particular group has five thousand of them.

Hope I'm doing this properly.

I'll know more tomorrow morning.  This is several GigaBytes and my connection is ten MegaBits

Feedback and advice are welcome.

Offline

 

#9 2016-12-22 14:07:45

jnashpiwigo
Piwigo Team
2014-10-21
254

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Once you get them uploaded, you'll need to go in to your gallery admin and synchronize.

Offline

 

#10 2016-12-23 01:43:36

ClintDanbury
Member
2016-12-20
21

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Okay, FTP to the rescue.  It handled the five thousand photographs, apparently with perfection.

What I have is a collection of about fifteen thousand photographs grouped into six categories.

The five thosand photos were from the largest category.

The other categories have something like two thousand photos each.

Should I go ahead and FTP those first, before synchronizing them ?

Two categories have  two sub categories each, while two others just have the photos.

i.e.,,,,,,,,,,,,

---- Main Album
------ Sub-Album-1           
--------- Sub-Album-1-A  (Has the actual pics)
--------- Sub-Album-1-B  (Has the actual pics)
------ Sub-Album-2
--------- Sub-Album-2-A  (Has the actual pics)
--------- Sub-Album-2-B  (Has the actual pics)
------ Sub-Album-3          (Has the actual pics)
------ Sub-Album-4          (Has the actual pics)

Should I get those arranged on my server first ?

Offline

 

#11 2016-12-23 03:13:12

jnashpiwigo
Piwigo Team
2014-10-21
254

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

If I'm not mistaken, you can create the directory structures via FTP, upload the pics, then synchronize, and it will automagically create the albums/subalbums base on the directory structure.

I'd trial it first with a few subdirs and photos to make sure.

Offline

 

#12 2016-12-24 14:25:50

ClintDanbury
Member
2016-12-20
21

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

I just clicked a couple of times with FileZilla, and apparently FTP is doing exactly what you have suggested.

Nice call.

I wish I had read that first.

It would have put me a day ahead, probably two days ahead.

So now I have  17 Gig of pics (17,611,096,716 bytes)  and a 10 Megabit connection.


Somebody correct me; My arithmetic says 26 hours (twenty six)

Offline

 

#13 2016-12-24 14:58:56

reddn
Member
DC, USA
2015-09-29
30

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Your math is wrong.  3.7 hrs if you are actually getting 10 Mbit throughput.

17000000000 / (10000000/8) = seconds needed
Seconds needed / 60 = minutes
Minutes /60 = hours

Last edited by reddn (2016-12-24 15:05:10)

Offline

 

#14 2016-12-24 21:51:00

ClintDanbury
Member
2016-12-20
21

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

reddn wrote:

Your math is wrong.  3.7 hrs if you are actually getting 10 Mbit throughput.

Late night math, sleep is more important than we want to admit.

Your math is correct.  I was wondering where I could have made such a huge error.

Obviously, I am not getting that throughput.

Your math is based on two numbers; i.e., size and speed, and yes it is theoretically correct; I just ran your numbers myself, and they check out here.

My math is based on some ballpark thumbnail observations and guesses.

-+- I watched three or four files actually upload
-+- I noticed that they were taking between six and seven seconds apiece.
-+- My guess was 6.5 seconds per file.

Total number is: 14,508 Files

14,508 x 6.5 = 94,302 seconds

94,302 / 3600 = 26 Hours, 11 Minutes, 42 seconds

As I am typing this, FileZilla has moved 11,500 of the 14,500 files.

Based on various message time stamps here, that is roughly 7 hours.

7 hours x 60 minutes * 60 seconds is 25,200 seconds.

25,200 / 11,500 is about  2.2 seconds per file

I'm going to estimate some more.

Average file size: 1,213,888 bytes, which is 9,711,104 bits, which is not quite exactly my transfer rate per second, but pretty close.

Going with rough numbers, 1/2.2  is about 45 percent utilization, which jibes with what I'm getting.

I spent 10 minutes at the FileZilla website and didn't see an immediately obvious reference to any facility which would allow me to view elapsed time or effective speed, so, I guess my actual speed is about 450 Kilobits per second.

Offline

 

#15 2016-12-24 23:53:13

ClintDanbury
Member
2016-12-20
21

Re: New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Update: I am apparently getting about 150 to 200 kilobits per second with File Zilla.

He apparently is doing two files at one time, so my real speed appears to be 300 to 400 K

Oh great, EL-Stupe-O in action.  There were some video files on my disk on my computer here which are 50 and 60 times larger than the photographs.

Ooops, now to Update this Update:  Hopefully that is done now. Looks like I'm down to the final thousand files now.

Last edited by ClintDanbury (2016-12-25 00:04:56)

Offline

 
  •  » Miscellaneous
  •  » New, Trying To Organize Fifteen Thousand Photos In Eight Categories

Board footer

Powered by FluxBB

github twitter newsletter Donate Piwigo.org © 2002-2024 · Contact